Data processing method and device, computer, readable storage medium and program product

Abstract

Embodiments of the present application disclose a data processing method and device, a computer, a readable storage medium and a program product. The method comprises: receiving virtual object coordinates respectively sent by N virtual reality clients, obtaining first scene frames corresponding to the N virtual reality clients respectively and belonging to a target virtual background type based on the virtual object coordinates; N is a positive integer; performing similarity matching on the first scene frames corresponding to the N virtual reality clients respectively to obtain a rendering pixel group comprising similar pixel frames; the rendering pixel group is associated with S virtual reality clients; the first scene frames of the S virtual reality clients associated with the rendering pixel group all comprise the similar pixel frames in the rendering pixel group; S is a positive integer less than or equal to N; and the similar pixel frames included in the rendering pixel group are multicast to the S virtual reality clients associated with the rendering pixel group. The present application can improve the transmission rate of virtual reality data.

Description

Technical Field

[0001] This application relates to the field of virtual reality technology, and in particular to a data processing method, apparatus, computer, and readable storage medium. Background Technology

[0002] With the development of Virtual Reality (VR) technology, it is being used in an increasing number of scenarios. In VR-based multi-object interaction scenarios, due to the need for high bandwidth and low latency, VR devices often use edge computing services for scene rendering. In these scenarios, VR data transmission is typically achieved through adaptive video resolution adjustment technology. Specifically, the resolution of the VR scene display is adaptively adjusted based on measurements such as current bandwidth and latency to match the wireless transmission bandwidth and the number of objects. However, while this method alleviates the bandwidth requirement to some extent, it results in poor resolution of the rendered VR scene. Changes in bandwidth can also cause sudden changes in the resolution, leading to less smooth scene transitions and poor rendering quality. Summary of the Invention

[0003] This application provides a data processing method, apparatus, computer, readable storage medium, and program product, which can improve the transmission efficiency of virtual reality data, reduce sudden changes in clarity during virtual reality scene rendering, thereby improving the rendering effect of virtual reality scenes and enhancing the user experience.

[0004] One embodiment of this application provides a data processing method, the method comprising:

[0005] Receive the coordinates of virtual objects sent by N virtual reality clients, and obtain the first scene frame of the target virtual background type for each of the N virtual reality clients based on the coordinates of the virtual objects; N is a positive integer;

[0006] Perform similarity matching on the first scene frames corresponding to N virtual reality clients to obtain a rendering pixel group that includes similar pixel frames; the rendering pixel group is associated with S virtual reality clients; the first scene frames of the S virtual reality clients associated with the rendering pixel group all include similar pixel frames in the rendering pixel group; S is a positive integer less than or equal to N;

[0007] The rendering pixel group contains similar pixel frames that are multicast to the S virtual reality clients associated with the rendering pixel group.

[0008] One embodiment of this application provides a data processing method, the method comprising:

[0009] The target virtual reality client sends the coordinates of a virtual object to the virtual reality management device, so that the virtual reality management device can determine the first scene frame belonging to the target virtual background type corresponding to the target virtual reality client based on the coordinates of the virtual object, and determine similar pixel frames from the first scene frame; similar pixel frames refer to virtual scene frames included in the rendering pixel group, and the rendering pixel group is associated with S virtual reality clients; S is a positive integer; the S virtual reality clients include the target virtual reality client;

[0010] Receive similar pixel frames sent by the virtual reality management device based on multicast; similar pixel frames are used to compose a target virtual reality scene for the target virtual reality client.

[0011] One embodiment of this application provides a data processing apparatus, the apparatus comprising:

[0012] The acquisition module is used to receive the coordinates of virtual objects sent by N virtual reality clients, and to obtain the first scene frame of the target virtual background type corresponding to each of the N virtual reality clients based on the coordinates of the virtual objects; N is a positive integer;

[0013] The matching module is used to perform similarity matching on the first scene frames corresponding to N virtual reality clients to obtain a rendering pixel group that includes similar pixel frames; the rendering pixel group is associated with S virtual reality clients; the first scene frames of the S virtual reality clients associated with the rendering pixel group all include similar pixel frames in the rendering pixel group; S is a positive integer less than or equal to N;

[0014] The multicast module is used to multicast similar pixel frames included in the rendered pixel group to the S virtual reality clients associated with the rendered pixel group.

[0015] One embodiment of this application provides a data processing apparatus, the apparatus comprising:

[0016] The sending module is used to send the coordinates of a virtual object from the target virtual reality client to the virtual reality management device, so that the virtual reality management device can determine the first scene frame belonging to the target virtual background type corresponding to the target virtual reality client based on the coordinates of the virtual object, and determine similar pixel frames from the first scene frame; similar pixel frames refer to virtual scene frames included in the rendering pixel group, and the rendering pixel group is associated with S virtual reality clients; S is a positive integer; the S virtual reality clients include the target virtual reality client;

[0017] The receiving module is used to receive similar pixel frames sent by the virtual reality management device based on multicast; the similar pixel frames are used to form a target virtual reality scene for the target virtual reality client.

[0018] One embodiment of this application provides a computer device, including a processor, a memory, and an input / output interface;

[0019] The processor is connected to a memory and an input / output interface, respectively. The input / output interface is used to receive and output data, the memory is used to store computer programs, and the processor is used to call the computer programs so that the computer device containing the processor executes the data processing method in one aspect of the embodiments of this application.

[0020] One aspect of this application provides a computer-readable storage medium storing a computer program adapted to be loaded and executed by a processor, so that a computer device having the processor performs the data processing method of one aspect of this application.

[0021] One aspect of this application provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in various optional embodiments of this application. In other words, when the computer instructions are executed by the processor, they implement the methods provided in various optional embodiments of this application.

[0022] Implementing the embodiments of this application will have the following beneficial effects:

[0023] In this embodiment, the virtual reality management device can receive virtual object coordinates sent by N virtual reality clients, and obtain the first scene frames corresponding to the target virtual background type for each of the N virtual reality clients based on the virtual object coordinates; N is a positive integer; perform similarity matching on the first scene frames corresponding to the N virtual reality clients to obtain a rendering pixel group including similar pixel frames; associate the rendering pixel group with S virtual reality clients; the first scene frames of the S virtual reality clients associated with the rendering pixel group all include similar pixel frames in the rendering pixel group; S is a positive integer less than or equal to N; and multicast the similar pixel frames included in the rendering pixel group to the S virtual reality clients associated with the rendering pixel group. Through the above process, the virtual reality management device can further analyze the virtual reality scene in the virtual reality scene, perform similarity matching on the background elements of different virtual objects (i.e., virtual scene frames belonging to the target virtual background type), and then perform unified multicast rendering transmission, thereby reducing the amount of data that the virtual reality management device needs to send, reducing the demand for transmission bandwidth, thereby improving the transmission efficiency of virtual reality data and reducing network requirements. Attached Figure Description

[0024] Figure 1 This is a network interaction architecture diagram for data processing provided in an embodiment of this application;

[0025] Figure 2 This is a schematic diagram of a data processing scenario provided in an embodiment of this application;

[0026] Figure 3 This is a flowchart of a data processing method provided in an embodiment of this application;

[0027] Figure 4 This is a schematic flowchart of a data processing method provided in an embodiment of this application;

[0028] Figure 5 This application provides a scene frame for determining a scene, as illustrated in the embodiments of this application.

[0029] Figure 6 This is a schematic diagram of a scene for determining the target distance range region based on a viewpoint, provided in an embodiment of this application.

[0030] Figure 7 This is a flowchart of another data processing method provided in an embodiment of this application;

[0031] Figure 8 This is a schematic flowchart of another data processing method provided in the embodiments of this application;

[0032] Figure 9 This is a schematic diagram of a data interaction scenario provided in an embodiment of this application;

[0033] Figure 10 This is a schematic diagram of a data processing device provided in an embodiment of this application;

[0034] Figure 11 This is a schematic diagram of another data processing device provided in an embodiment of this application;

[0035] Figure 12 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0036] The technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.

[0037] If this application requires the collection of object data (such as user data), a prompt interface or pop-up window will be displayed before and during the collection process. This prompt interface or pop-up window is used to inform the user that XXXX data is currently being collected. The data acquisition steps will only begin after the user confirms the prompt interface or pop-up window; otherwise, the process will end. Furthermore, the acquired user data will be used in reasonable and legal scenarios or for legitimate purposes. Optionally, in scenarios where user data needs to be used but user authorization has not been obtained, authorization can be requested from the user, and the user data can only be used after authorization is granted.

[0038] In the embodiments of this application, please refer to Figure 1 , Figure 1 This is a network interaction architecture diagram for data processing provided in an embodiment of this application. This application can be used in multi-object interaction scenarios based on virtual reality (VR), such as virtual reality games, virtual reality communication, virtual reality education, or virtual reality video. Specifically, the virtual reality management device 101 can interact with multiple virtual reality clients, such as virtual reality client 102a, virtual reality client 102b, and virtual reality client 102c, etc., where the number of virtual reality clients is denoted as N, and N is a positive integer. The virtual reality management device 101 can obtain the coordinates of virtual objects sent by each of the N virtual reality clients. In other words, each virtual reality client corresponds to a virtual object in the virtual reality scene, and the coordinates of the virtual object refer to the position of the corresponding virtual object in the virtual reality scene. Furthermore, the virtual reality management device 101 can parse the virtual scene frames associated with each virtual reality client based on the coordinates of the virtual objects corresponding to the N virtual reality clients, to determine the far-view frame (i.e., the virtual scene frame corresponding to the target virtual background type) and the near-view frame (i.e., the virtual scene frame corresponding to the real-time virtual background type) corresponding to each virtual reality client. It can then perform similarity matching on the far-view frames corresponding to the N virtual reality clients to determine similar pixel frames that can be multicast, and multicast the similar pixel frames to the corresponding virtual reality clients. This allows the virtual reality management device 101 to send similar pixel frames only once to the virtual reality clients that need to receive them, reducing the demand for transmission bandwidth, reducing network requirements, and improving the transmission efficiency of virtual reality data.

[0039] Virtual Reality (VR), also known as virtual environment, virtual world, or artificial environment, is a technology that combines virtual and reality. It is a computer simulation system that can create and experience virtual worlds. It uses computers to generate a simulated environment, which means using computers to generate a virtual world that can directly exert visual, auditory, and tactile sensations on participants and allow them to interactively observe and operate it.

[0040] For details, please see Figure 2 , Figure 2 This is a schematic diagram of a data processing scenario provided in an embodiment of this application. For example... Figure 2 As shown, N virtual reality clients 201 (such as virtual reality client 2011, virtual reality client 2012, ... and virtual reality client 201n, etc.) send virtual object coordinates to the virtual reality management device 202. The virtual reality management device 202 receives the virtual object coordinates sent by the N virtual reality clients 201, and based on each virtual object coordinate, obtains the first scene frame corresponding to the target virtual background type for each of the N virtual reality clients 201, such as the first scene frame 1 corresponding to virtual reality client 2011, the first scene frame 2 corresponding to virtual reality client 2012, ... and the first scene frame n corresponding to virtual reality client 201n, etc. The first scene frame corresponding to the target virtual background type can be considered as a virtual scene frame that is far from the corresponding virtual object coordinates in the virtual reality scene, also known as a distant frame. The virtual reality management device 202 performs similarity matching on the first scene frames corresponding to the N virtual reality clients to obtain a rendering pixel group including similar pixel frames. This rendering pixel group can be associated with S virtual reality clients, and the first scene frames corresponding to the S virtual reality clients all include the similar pixel frames, where S is a positive integer. Optionally, the number of rendering pixel groups can be one or at least two, and the number of virtual reality clients associated with each rendering pixel group can be the same or different. The virtual reality management device 202 can multicast similar pixel frames included in a rendering pixel group to the S virtual reality clients associated with that rendering pixel group. For example, assuming a rendering pixel group containing similar pixel frames is obtained, and this rendering pixel group is associated with virtual reality client 2012 and virtual reality client 201n, then the similar pixel frames included in the rendering pixel group are multicasted to virtual reality client 2012 and virtual reality client 201n. This allows the virtual reality management device 202 to send similar pixel frames based on multicast, reducing the amount of virtual reality data that needs to be sent, thereby reducing the demand for transmission bandwidth, reducing network requirements, and improving the transmission efficiency of virtual reality data.

[0041] It is understood that the virtual reality client mentioned in the embodiments of this application can be any type of VR device, which can have wireless communication capabilities and video rendering capabilities, such as VR glasses or VR chairs. The virtual reality management device can be a server or a smart device, such as a home smart box device or a VR cloud service device, etc., without limitation. The virtual reality management device can have wireless transmission capabilities, video rendering capabilities, and secondary development capabilities. Optionally, the server mentioned above can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, vehicle-to-everything (V2X) communication, content delivery networks (CDN), and big data and artificial intelligence platforms.

[0042] Optionally, the data involved in the embodiments of this application may be stored in a virtual reality management device, or the data may be stored based on cloud storage technology or a blockchain network, without limitation.

[0043] Further, please see Figure 3 , Figure 3 This is a flowchart of a data processing method provided in an embodiment of this application. Figure 3 As shown, the data processing procedure, described with a virtual reality management device as the executing entity, may include:

[0044] S301, Receive the coordinates of virtual objects sent by N virtual reality clients respectively, and obtain the first scene frame belonging to the target virtual background type for each of the N virtual reality clients based on the coordinates of the virtual objects.

[0045] In this embodiment, N virtual reality clients can send virtual object coordinates to the virtual reality management device, where each virtual reality client corresponds to a virtual object. The virtual object coordinates refer to the position of the corresponding virtual object in the virtual reality scene. Optionally, the virtual object coordinates corresponding to the N virtual reality clients are based on the same location in the virtual reality scene as the origin. N is a positive integer. Optionally, the N virtual reality clients can send frame acquisition requests to the virtual reality management device. These frame acquisition requests include the virtual object coordinates of the corresponding virtual reality client. If the frame acquisition request is associated with a target virtual background type, then based on the virtual object coordinates corresponding to the N virtual reality clients, the first scene frames corresponding to the target virtual background type for each of the N virtual reality clients are obtained from the virtual reality scene. Optionally, the virtual reality management device can receive virtual object coordinates sent by N virtual reality clients, and based on these coordinates, obtain the first scene frame corresponding to the target virtual background type for each of the N virtual reality clients from the virtual scene frame corresponding to the virtual reality scene model. This virtual reality scene model can be an f-dimensional model, where f is a positive integer. In this case, the virtual object coordinates can be considered as f-dimensional coordinates with the origin of the virtual reality scene model as the reference. For example, if f is 3, the virtual object coordinates can be considered as a three-dimensional coordinate (x, y, z); if f is 4, the virtual object coordinates can be considered as a four-dimensional coordinate (x, y, z, t), and so on. The virtual reality scene model can be a model obtained by modeling the virtual reality scene, or it can be generated during the rendering process of the virtual reality scene, etc., without limitation. Optionally, the virtual reality management device can receive virtual object coordinates sent by N virtual reality clients, and based on these coordinates, obtain the first scene frame corresponding to the target virtual background type for each of the N virtual reality clients from the virtual scene frames corresponding to the virtual reality scene. The virtual scene frame corresponding to this virtual reality scene refers to the data used to render the virtual reality scene. As virtual reality technology develops, the method for determining the virtual scene frame may be continuously optimized; that is, the method of generating the virtual scene frame may change. Therefore, the method of generating the virtual scene frame corresponding to this virtual reality scene is not limited here. For example, the virtual scene frame can be obtained based on the aforementioned virtual reality scene model, or it can be obtained based on other methods that can obtain data used to render the virtual reality scene.

[0046] Specifically, the virtual reality management device can determine the target range size for each of the N virtual reality clients based on the coordinates and states of the virtual objects corresponding to those clients. This target range size refers to the number of virtual scene frames belonging to the target virtual background type that the corresponding virtual reality client needs to acquire. In other words, since the virtual objects corresponding to the N virtual reality clients are in motion, meaning their coordinates are changing, and because the scene display differs at different locations, the degree of change in the displayed virtual reality scene varies with the movement of virtual objects. This makes the number of virtual scene frames belonging to the target virtual background type, or the number of pixels they contain, variable. Therefore, the target range size for each of the N virtual reality clients can be determined based on their coordinates, thus determining the number of virtual scene frames belonging to the target virtual background type that need to be acquired. This satisfies the far-view rendering needs of each virtual reality client, achieving flexibility in virtual reality data transmission. This reduces the issue of excessive far-view frame acquisition leading to choppy frame rendering transitions, and also reduces the issue of insufficient far-view frame acquisition leading to an increased number of near-view frames requiring real-time rendering, reducing the amount of virtual reality data transmitted and improving the transmission efficiency. Optionally, the virtual reality management device can determine the target confidence level for each of the N virtual reality clients based on the coordinates and states of the virtual objects corresponding to the N virtual reality clients, and then determine the target range size for each of the N virtual reality clients based on the target confidence level. Further, based on the first virtual distance, virtual object coordinates, and target range size for each of the N virtual reality clients, a target distance range area is determined for each of the N virtual reality clients. Based on the target distance range area, a first scene frame belonging to the target virtual background type is obtained for each of the N virtual reality clients. Here, the first scene frame is a virtual scene frame belonging to the target virtual background type. Optionally, the virtual scene frames belonging to the target virtual background type for each of the N virtual reality clients can be collectively referred to as the first scene frame. Here, the first scene frame can be considered as a scene frame composed of multiple pixels, each pixel including its pixel information, etc. In other words, the virtual scene frame is a general concept used to represent data that can be used to render a virtual reality scene. For example, the virtual scene frame can be considered as pixels and their pixel information. Virtual scene frames belonging to the target virtual background type are determined as the first scene frames.

[0047] S302, perform similarity matching on the first scene frames corresponding to N virtual reality clients respectively to obtain a rendering pixel group including similar pixel frames.

[0048] In this embodiment, the virtual reality management device can perform similarity matching on the first scene frames corresponding to N virtual reality clients, and cluster virtual reality clients with the same pixel frames to obtain rendering pixel groups. Each rendering pixel group is associated with S virtual reality clients; the first scene frames of the S virtual reality clients associated with a rendering pixel group all include similar pixel frames in the rendering pixel group; S is a positive integer less than or equal to N. Since the first scene frame of one virtual reality client may have the same pixels as the first scene frames of multiple other virtual reality clients, the number of rendering pixel groups can be one or at least two. If the number of rendering pixel groups is at least two, then the S virtual reality clients associated with different rendering pixel groups may have the same virtual reality clients. Each similar pixel frame can be considered as a frame composed of multiple pixels and the pixel information of each pixel; in other words, the pixels in the first scene frame can be considered to include the pixels in the similar pixel frames. For example, if rendering pixel group 1 is associated with virtual reality client 1 and virtual reality client 2, and rendering pixel group 2 is associated with virtual reality client 1 and virtual reality client 3, then the first scene frame of virtual reality client 1 and the first scene frame of virtual reality client 2 both include similar pixel frames included in rendering pixel group 1, and the first scene frame of virtual reality client 1 and the first scene frame of virtual reality client 3 both include similar pixel frames included in rendering pixel group 2. For example, if the similar pixel frames included in rendering pixel group 1 are pixel a, pixel b, and pixel c, then the first scene frame of the virtual reality client associated with rendering pixel group 1 includes these similar pixel frames. That is, the first scene frame of virtual reality client 1 also includes pixel a, pixel b, and pixel c, and the first scene frame of virtual reality client 2 also includes pixel a, pixel b, and pixel c. In general, the frames mentioned in this application can be considered to be in units of pixels. Optionally, if the virtual reality scene is rendered in units of frames, then the frames in this application can also be in units of images. That is, the first scene frame includes multiple images, the similar pixel frame includes one or at least two images, and the images in the first scene frames of the S virtual reality clients associated with the rendering pixel group all include the images in the similar pixel frames of the rendering pixel group, etc. In other words, the relationships between the frames in this application are determined by the specific unit of rendering the virtual reality scene.

[0049] Specifically, the computer device can perform pixel-by-pixel similarity matching on the first scene frames corresponding to N virtual reality clients. If there are h identical pixel frames among the first scene frames corresponding to S virtual reality clients, and h satisfies the inter-frame similarity threshold, then the h identical pixel frames are determined as similar pixel frames associated with the S virtual reality clients, and these similar pixel frames are grouped into rendering pixel groups associated with the S virtual reality clients; h is a positive integer. The inter-frame similarity threshold can be a numerical value or a percentage, etc., and is not limited here. Optionally, if the inter-frame similarity threshold is a numerical value, then when h is greater than or equal to the inter-frame similarity threshold, h is determined to meet the inter-frame similarity threshold. For example, assuming the inter-frame similarity threshold is 50, then when h is greater than or equal to 50, h is determined to meet the inter-frame similarity threshold. If the inter-frame similarity threshold is a percentage, then when the proportion of h in the first scene frame corresponding to each of the S virtual reality clients is greater than or equal to the inter-frame similarity threshold, h is determined to meet the inter-frame similarity threshold. For example, assuming the inter-frame similarity threshold is 80%, then when the proportion of h identical pixel frames in the first scene frame of any of the S virtual reality clients is greater than or equal to 80%, h is determined to meet the inter-frame similarity threshold. Since each virtual reality client corresponds to the same virtual reality scene, the first scene frames corresponding to each virtual reality client are likely to contain some identical pixel frames to varying degrees. By using an inter-frame similarity threshold to restrict the similarity matching between the first scene frames corresponding to each virtual reality client, the resource consumption caused by too few similar pixel frames can be reduced while clustering similar first scene frames as much as possible. That is, if rendering pixel groups are generated even when there are too few similar pixel frames, the amount of data propagated by multicast is reduced, and it may also cause resource consumption for data storage and processing. Therefore, an inter-frame similarity threshold can be used to limit the amount of data transmitted while reducing resource consumption. Of course, if it is necessary to minimize the amount of data propagated, this inter-frame similarity threshold can be omitted.

[0050] S303, multicasts similar pixel frames included in the rendered pixel group to the S virtual reality clients associated with the rendered pixel group.

[0051] In this embodiment, the virtual reality management device can multicast similar pixel frames included in a rendered pixel group to S virtual reality clients associated with the rendered pixel group. This allows the virtual reality management device to send the similar pixel frames included in the rendered pixel group only once, and all S virtual reality clients can receive them, reducing the amount of data sent for similar pixel frames, thereby reducing network and bandwidth requirements and improving the transmission efficiency of virtual reality data. The similar pixel frames included in the rendered pixel group can be considered as a frame composed of multiple pixels and their pixel information. That is, the similar pixel frames can be considered to have no concept of quantity, but rather as a frame composed of a group of pixels determined based on a region of the virtual reality scene. Alternatively, if the virtual reality scene is rendered in units of frames, the similar pixel frames can be considered as a frame composed of one or more images; this is not limited here.

[0052] Wherein, if the number of rendered pixel groups is at least two, and at least two rendered pixel groups are jointly associated with M virtual reality clients; M is a positive integer greater than or equal to S and less than or equal to N. Further, the virtual reality management device can determine the different pixel frames corresponding to N virtual reality clients from the first scene frames corresponding to N virtual reality clients, based on the similar pixel frames corresponding to the M virtual reality clients respectively. Specifically, the virtual reality management device can determine the virtual scene frames in the first scene frame corresponding to the i-th virtual reality client, excluding the similar pixel frames corresponding to the i-th virtual reality client, as the different pixel frames corresponding to the i-th virtual reality client. Further, the different pixel frames corresponding to the N virtual reality clients are unicasted to the corresponding virtual reality clients. The i-th virtual reality client can render the region of the target virtual background type based on the similar pixel frames and different pixel frames corresponding to the i-th virtual reality client; that is, the similar pixel frames and different pixel frames corresponding to the i-th virtual reality client constitute the first scene frame corresponding to the i-th virtual reality client. Optionally, the i-th virtual reality client may render a similar pixel frame when it receives a similar pixel frame, and perform supplementary rendering of a different pixel frame when it receives a different pixel frame; or, the i-th virtual reality client may render the region of the target virtual background type when it receives both similar and different pixel frames.

[0053] Optionally, the virtual reality management device can determine the scene frame to be rendered for the i-th virtual reality client based on the coordinates of the virtual object corresponding to the i-th virtual reality client. Based on the first scene frame corresponding to the i-th virtual reality client, a second scene frame is obtained from the scene frame to be rendered for the i-th virtual reality client; the second scene frame refers to any virtual scene frame other than the first scene frame in the corresponding scene frame to be rendered. The second scene frame corresponding to the i-th virtual reality client is sent to the i-th virtual reality client. This second scene frame can be considered a virtual scene frame belonging to the real-time virtual background type, and can be considered a close-up frame. The rendering frequency of distant frames is less than that of close-up frames. In other words, visually, the difference between distant frames corresponding to the virtual object at adjacent time points is smaller, while the difference between close-up frames at adjacent time points is larger. Alternatively, a distant frame can be considered a virtual scene frame whose distance from the virtual object is greater than the distance between the close-up frame and the virtual object.

[0054] For details, please refer to Figure 4 , Figure 4 This is a schematic flowchart illustrating a data processing method provided in an embodiment of this application. Figure 4 As shown, with the virtual reality management device as the executing entity, the data processing process may include:

[0055] S401 receives the coordinates of virtual objects sent by N virtual reality clients.

[0056] In the embodiments of this application, see [reference needed]. Figure 3 The description in S301 is as follows. The virtual object coordinates can be considered as f-dimensional coordinates. For example, assuming f is 3, the virtual reality management device can receive virtual object coordinates sent by N virtual reality clients. Optionally, the virtual object coordinates sent by N virtual reality clients can be received based on an array. For example, it can be denoted as Object[i] = {x, y, z}, used to represent the virtual object coordinates of the i-th virtual reality client. The f-dimensional array corresponding to each virtual reality client is used to represent the position coordinates of the virtual object of the corresponding virtual reality client, such as the position coordinates in the virtual reality scene model. For example, please refer to... Figure 5 , Figure 5 This is a scene frame determination diagram provided in an embodiment of this application. For example... Figure 5As shown, taking a virtual reality scene model as an example, assume that virtual reality scene model 501 is a three-dimensional model with point O as the origin, including X, Y, and Z dimensions. Virtual reality scene model 501 refers to the model used for rendering the virtual reality scene. Assuming the i-th virtual reality client corresponds to virtual object A, the distance of virtual object A in f dimensions from point O is the virtual object coordinate of virtual object A.

[0057] S402, obtain the first scene frame of the target virtual background type corresponding to N virtual reality clients based on the coordinates of the virtual object.

[0058] In the embodiments of this application, see [reference needed]. Figure 3 The description in S301 is as follows. Specifically, taking the i-th virtual reality client as an example, based on the coordinates of the virtual object corresponding to the i-th virtual reality client and the state of the virtual object corresponding to the i-th virtual reality client, the target range size corresponding to the i-th virtual reality client is determined. The target range size is used to represent the amount of virtual scene frames belonging to the target virtual background type determined for the i-th virtual reality client, which can be considered as a region size. Optionally, the target confidence level corresponding to the i-th virtual reality client can be determined according to the virtual reality display size and the virtual scene information corresponding to the i-th virtual reality client, and the target range size corresponding to the i-th virtual reality client can be determined based on the target confidence level. The target confidence level is used to represent the degree of change of the virtual scene frames belonging to the target virtual background type of the i-th virtual reality client. A higher target confidence level indicates a greater degree of change, and a smaller determined target range size; or, a higher target confidence level indicates a smaller degree of change, and a larger determined target range size. Furthermore, based on the first virtual distance, virtual object coordinates, and target range size corresponding to the i-th virtual reality client, the target distance range area corresponding to the i-th virtual reality client in the virtual reality scene can be determined. The first virtual distance refers to the farthest visible distance of the i-th virtual reality client in the virtual reality scene when rendering the virtual reality scene. Taking the virtual reality scene model as an example, based on the first virtual distance, virtual object coordinates, and target range size corresponding to the i-th virtual reality client, the target distance range area corresponding to the i-th virtual reality client in the virtual reality scene model can be determined. The first virtual distance refers to the farthest visible distance of the i-th virtual reality client in the virtual reality scene model when rendering the virtual reality scene based on the virtual reality scene model. The virtual scene frames located within the target distance range area corresponding to the i-th virtual reality client are determined as the first scene frames belonging to the target virtual background type corresponding to the i-th virtual reality client; i is a positive integer less than or equal to N.

[0059] Optionally, the virtual reality management device can determine the default virtual distance as the first virtual distance of the i-th virtual reality client. Alternatively, it can obtain the virtual reality display size corresponding to the i-th virtual reality client, parse the virtual scene frame located at the coordinates of the virtual object corresponding to the i-th virtual reality client, and obtain the virtual scene information corresponding to the i-th virtual reality client. Here, the virtual reality display size refers to the maximum size of the image displayed by the i-th virtual reality client when rendering the virtual reality scene; or it can be the preset rendering size of the virtual reality scene; or it can be the display size corresponding to the i-th virtual reality client when rendering the virtual reality scene, etc. Differences between virtual reality clients, or their respective configuration information (such as resolution selection), may lead to differences in the virtual reality display size of each virtual reality client. Obtaining this virtual reality display size parameter improves the flexibility of frame acquisition. The virtual scene information represents the information of the rendered image corresponding to the coordinates of the virtual object in the virtual reality scene. Further, based on the virtual reality display size and the virtual scene information corresponding to the i-th virtual reality client, the first virtual distance corresponding to the i-th virtual reality client is determined.

[0060] In one method of determining the target range size, if the virtual object state corresponding to the i-th virtual reality client is in an operation-triggered state, then the virtual operation triggered by the i-th virtual reality client is obtained. Based on the virtual operation, the scene change amplitude of the i-th virtual reality client is determined. The target range size corresponding to the i-th virtual reality client is determined based on the virtual object coordinates and the scene change amplitude. The larger the scene change amplitude, the greater the probability that the virtual scene frame belonging to the target virtual background type of the i-th virtual reality client will change, and thus the smaller the target range size. If the virtual object state corresponding to the i-th virtual reality client is in a no-operation state, then the target range size corresponding to the i-th virtual reality client is determined based on the virtual object coordinates. In this case, the virtual object state can be considered to include the virtual operation state, which includes both the operation-triggered state and the no-operation state.

[0061] In one method of determining the target range size, if the virtual object state corresponding to the i-th virtual reality client is a historical object state, then the historical inter-frame similarity between historical scene frames is obtained. The historical object state includes the historical scene frames determined for the i-th virtual reality client at e historical acquisition time points. The historical acquisition time point refers to the historical time point at which the virtual scene frames belonging to the target virtual background type corresponding to the i-th virtual reality client are acquired; e is a positive integer. The target inter-frame similarity is predicted based on the historical inter-frame similarity. The target range size corresponding to the i-th virtual reality client is determined based on the target inter-frame similarity and the coordinates of the virtual object corresponding to the i-th virtual reality client. Optionally, the target inter-frame similarity can be predicted based on the distribution of historical inter-frame similarity. Optionally, the target inter-frame similarity can be obtained by predicting the historical inter-frame similarity based on a similarity prediction model.

[0062] Furthermore, when determining the target distance range, the virtual reality management device can determine the first rendering boundary of the i-th virtual reality client based on the first virtual distance of the i-th virtual reality client, where the distance between the first rendering boundary of the i-th virtual reality client and the coordinates of the virtual object of the i-th virtual reality client is the first virtual distance. Based on the target range size, a second rendering boundary corresponding to the i-th virtual reality client is determined along the direction from the first rendering boundary to the coordinates of the virtual object of the i-th virtual reality client. The area between the first rendering boundary and the second rendering boundary is determined as the target distance range corresponding to the i-th virtual reality client. Figure 5 As shown, the virtual reality management device determines the target range size of the i-th virtual reality client based on the coordinates of the virtual object. It obtains the first virtual distance d1 of the i-th virtual reality client, determines the first rendering boundary 502 based on d1, and assumes the target range size is d2. Based on the target range size d2, the first rendering boundary 502, and the virtual object coordinates, it determines the second rendering boundary 503 of the i-th virtual reality client. The distance between the first rendering boundary 502 and the second rendering boundary 503 is the target range size d2. Optionally, the distance between the virtual object coordinates and the second rendering boundary 503 can be denoted as the near distance d3. The area between the first rendering boundary 502 and the second rendering boundary 503 is defined as the target distance range area corresponding to the i-th virtual reality client.

[0063] Optionally, the virtual reality management device can obtain the virtual view range corresponding to the i-th virtual reality client. Optionally, the virtual reality management device can obtain the view type of the i-th virtual reality client and obtain the virtual view range corresponding to the i-th virtual reality client based on the view type. The view type can include first-person view type and third-person view type, etc. Under different view types, the visible range of virtual objects in the virtual reality scene may differ. Therefore, obtaining the virtual view range corresponding to the i-th virtual reality client based on the view type reduces unnecessary scene frame acquisition, thereby improving the transmission efficiency of virtual reality data. Further, in the virtual reality scene, based on the first virtual distance and virtual view range corresponding to the i-th virtual reality client, the first rendering boundary of the i-th virtual reality client is determined. The distance between the first rendering boundary of the i-th virtual reality client and the coordinates of the virtual object of the i-th virtual reality client is the first virtual distance, and the first rendering boundary of the i-th virtual reality client is located within the virtual view range of the i-th virtual reality client. Based on the target range size, the second rendering boundary corresponding to the i-th virtual reality client is determined along the direction from the first rendering boundary to the virtual object coordinates of the i-th virtual reality client. The distance between the first and second rendering boundaries is the target range size. The region between the first and second rendering boundaries is defined as the target distance range region corresponding to the i-th virtual reality client.

[0064] For example, please see Figure 6 , Figure 6 This is a schematic diagram illustrating a scene for determining a target distance range region based on a viewpoint, as provided in an embodiment of this application. Figure 6 As shown, the virtual reality management device obtains virtual object A from the i-th virtual reality client, and the position coordinates of virtual object A in the virtual reality scene are the coordinates of the virtual object of the i-th virtual reality client. The virtual reality management device obtains the virtual view range corresponding to the i-th virtual reality client based on the view type, assuming that the virtual view range is... Figure 6 Region 601, i.e., virtual view range 601, is defined. Based on the first virtual distance d1 corresponding to the i-th virtual reality client and the virtual view range 601, the first rendering boundary 602 of the i-th virtual reality client is determined. Based on the target range size d2, the second rendering boundary 603 of the i-th virtual reality client is determined along the direction from the first rendering boundary 602 to the virtual object coordinates (i.e., the position coordinates of virtual object A) of the i-th virtual reality client. The region between the first rendering boundary 602 and the second rendering boundary 603 is defined as the target distance range region of the i-th virtual reality client.

[0065] Furthermore, virtual scene frames located within the target distance range corresponding to the i-th virtual reality client are identified as the first scene frame belonging to the target virtual background type corresponding to the i-th virtual reality client. Optionally, the above process can be implemented based on the virtual reality scene model corresponding to the virtual reality scene. For example, in the virtual reality scene model, virtual scene frames located within the target distance range corresponding to the i-th virtual reality client are identified as the first scene frame belonging to the target virtual background type corresponding to the i-th virtual reality client.

[0066] Optionally, a background resolution method can be used to extract the first scene frames corresponding to each of the N virtual reality clients. This process can be denoted as BackGroundPro(Object, Fraction), where Object refers to the coordinates of the virtual objects corresponding to the N virtual reality clients, and Fraction refers to the target confidence or target range size corresponding to the N virtual reality clients. The first scene frame corresponding to the i-th virtual reality client is obtained, and the position coordinates of the first scene frame corresponding to the i-th virtual reality client can be denoted as DistantFrame[i][j] = {x, y, z}, where j represents the j-th pixel in the first scene frame. The process of obtaining the first scene frame corresponding to the i-th virtual reality client can be denoted as DistantFrame[i][j] = BackGroundPro(Object[i], Fraction).

[0067] S403, perform similarity matching on the first scene frames corresponding to N virtual reality clients respectively.

[0068] In this embodiment, the virtual reality management device can perform similarity matching on the first scene frames corresponding to N virtual reality clients, as detailed in the following example. Figure 3 As shown in S302. That is, similarity matching can be performed pixel by pixel on DistantFrame[i][j]. This process is called SimilarAnalysis(DistantFrame[i][j]). When there are h identical pixel frames between the first scene frames corresponding to S virtual reality clients, the h identical pixel frames can be identified as similar pixel frames associated with the S virtual reality clients. The h identical pixel frames are added to the rendering pixel group at once. Optionally, the rendering pixel group can be denoted as SimilarFrame_s_object[k], where s_object indicates that there are identical pixel frames between the first scene frames corresponding to S virtual reality clients, and k represents the kth rendering pixel group.

[0069] S404, detects the rendering pixel group.

[0070] In this embodiment, it is detected whether there are still rendering pixel groups, that is, whether there are still unparsed virtual scene frames with the same pixel frames in the first scene frames corresponding to at least two virtual reality clients. If there are other rendering pixel groups, the process returns to S403; if there are no other rendering pixel groups, the process executes S405.

[0071] S405 multicasts similar pixel frames included in the rendered pixel group to the associated virtual reality client.

[0072] In this embodiment, similar pixel frames included in a rendered pixel group are multicast to the associated virtual reality client. The number of rendered pixel groups can be one or at least two. The virtual reality management device can, based on the similar pixel frames included in the rendered pixel group, determine the different pixel frames corresponding to each of the N virtual reality clients from the first scene frames corresponding to each of the N virtual reality clients, and unicast the different pixel frames corresponding to each of the N virtual reality clients to the corresponding virtual reality clients.

[0073] Optionally, based on the coordinates of the virtual object corresponding to the i-th virtual reality client, determine the scene frame to be rendered for the i-th virtual reality client; i is a positive integer less than or equal to N. Based on the first scene frame corresponding to the i-th virtual reality client, obtain the second scene frame from the scene frames to be rendered corresponding to the i-th virtual reality client; the second scene frame refers to the virtual scene frame other than the first scene frame in the corresponding scene frames to be rendered. Send the second scene frame corresponding to the i-th virtual reality client to the i-th virtual reality client. Here, the second scene frame refers to a virtual scene frame that is relatively close to the coordinates of the virtual object and needs to be updated in real time; therefore, the virtual reality management device can send the second scene frame in real time. Optionally, when no first scene frame is generated, the virtual reality management device can determine the scene frame to be rendered for the i-th virtual reality client based on the coordinates of the virtual object corresponding to the i-th virtual reality client. Obtain the latest first scene frame corresponding to the i-th virtual reality client; the latest first scene frame refers to the first scene frame with the longest determination time among the first scene frames determined for the i-th virtual reality client. The virtual reality management device can obtain the second scene frame from the scene frame to be rendered corresponding to the i-th virtual reality client based on the latest first scene frame corresponding to the i-th virtual reality client. For example, if the first scene frame 1 corresponding to the i-th virtual reality client is determined at the first historical acquisition time point, and the first scene frame 2 corresponding to the i-th virtual reality client is determined at the second historical acquisition time point, and the second time point is greater than the first time point, and the first historical acquisition time point and the second historical acquisition time point are adjacent when determining the first scene frame, then the virtual reality management device uses the first scene frame 1 to determine the second scene frame corresponding to the i-th virtual reality client between the first historical acquisition time point and the second historical acquisition time point.

[0074] Please see below. Figure 7 , Figure 7 This is a flowchart of another data processing method provided in an embodiment of this application, such as... Figure 7 As shown, the method takes a target virtual reality client as the execution subject, which can be any one of N virtual reality clients. The method includes:

[0075] S701, the target virtual reality client sends the coordinates of the virtual object to the virtual reality management device.

[0076] In this embodiment, the target virtual reality client sends virtual object coordinates to the virtual reality management device, enabling the virtual reality management device to determine the first scene frame belonging to the target virtual background type corresponding to the target virtual reality client based on the virtual object coordinates, and to determine similar pixel frames from the first scene frame. Similar pixel frames refer to virtual scene frames included in a rendered pixel group, where the rendered pixel group is associated with S virtual reality clients; S is a positive integer; the S virtual reality clients include the target virtual reality client. At this time, the target virtual reality client has virtual scene frames identical to those of other virtual reality clients.

[0077] Optionally, the target virtual reality client can periodically synchronize the first scene frame from the virtual reality management device. Specifically, the target virtual reality client detects the rendering timer for the target virtual background type. If the rendering timer reaches the requested time point, it sends the virtual object coordinates to the virtual reality management device and resets the rendering timer. If the rendering timer does not reach the requested time point, it monitors the virtual reality management device and executes step S702, receiving similar pixel frames sent by the virtual reality management device based on multicast.

[0078] S702 receives similar pixel frames sent by the virtual reality management device based on multicast.

[0079] In this embodiment, similar pixel frames sent by the virtual reality management device via multicast are received; these similar pixel frames are used to form a target virtual reality scene for the target virtual reality client. Optionally, the target virtual reality client may not have identical virtual scene frames with other virtual reality clients; in this case, the target virtual reality client will not receive the similar pixel frames sent by the virtual reality management device via multicast.

[0080] Furthermore, it can receive difference pixel frames sent by the virtual reality management device via unicast; difference pixel frames refer to virtual scene frames other than similar pixel frames in the first scene frame corresponding to the target virtual reality client. Based on the similar pixel frames and difference pixel frames, the scene area corresponding to the target virtual background type is rendered. Optionally, if there are no identical virtual scene frames between the target virtual reality client and other virtual reality clients, then the difference pixel frames received by the target virtual reality client are the first scene frame of the target virtual reality client.

[0081] Optionally, a second scene frame of the real-time virtual background type, sent in real time by the virtual reality management device, is received; the real-time virtual background type refers to a virtual background type other than the target virtual background type. The scene area corresponding to the real-time virtual background type is rendered based on the second scene frame; the scene area corresponding to the target virtual background type and the scene area corresponding to the real-time virtual background type together constitute the target virtual reality scene of the target virtual reality client.

[0082] For details, please refer to Figure 8 , Figure 8 This is a schematic diagram illustrating the specific flow of another data processing method provided in an embodiment of this application. For example... Figure 8 As shown, with the target virtual reality client as the execution subject, the method may include:

[0083] S801, start the rendering timer.

[0084] In this embodiment, the target virtual reality client can initiate a rendering timer for the target virtual background type. This rendering timer is used to manage the frame acquisition period of virtual scene frames of the target virtual background type.

[0085] S802, Has the rendering timer reached the requested time point?

[0086] In this embodiment, it is detected whether the rendering timer has reached the requested time point. If the rendering timer has reached the requested time point, step S803 is executed; if the rendering timer has not reached the requested time point, step S805 is executed. Optionally, the rendering timer can be a forward timer or a countdown timer. For example, assuming the rendering timer is a forward timer and its initial value is a default timer value, such as 0, when the value of the rendering timer is greater than or equal to the frame acquisition period, it is determined that the rendering timer has reached the requested time point; when the value of the rendering timer is less than the frame acquisition period, it is determined that the rendering timer has not reached the requested time point. Assuming the rendering timer is a countdown timer and its initial value is the frame acquisition period, when the value of the rendering timer is a default timer value, such as 0, it is determined that the rendering timer has reached the requested time point; when the value of the rendering timer is not the default timer value, it is determined that the rendering timer has not reached the requested time point.

[0087] S803 sends the coordinates of virtual objects to the virtual reality management device.

[0088] In the embodiments of this application, see [reference needed]. Figure 7 As shown in S701, it will not be described again here.

[0089] S804, Reset render timer.

[0090] In this embodiment, assuming the rendering timer is in positive time, the value of the rendering timer is reset to the default timer value; assuming the rendering timer is in countdown time, the value of the rendering timer is reset to the frame acquisition period. Further, S805 is executed.

[0091] S805, detect whether a distant view frame has been received.

[0092] In this embodiment, a virtual reality management device is monitored to detect whether a distant view frame has been received, i.e., a first scene frame belonging to the target virtual background type has been received. Optionally, similar pixel frames in the first scene frame are sent by the virtual reality management device via multicast, and different pixel frames in the first scene frame are sent by the virtual reality management device via unicast. Optionally, the target virtual reality client may not have any pixel frames identical to those of other virtual reality clients. In this case, the target virtual reality client will only receive different pixel frames sent by the virtual reality management device via unicast, and these different pixel frames are the first scene frames of the target virtual reality client. Further, if a distant view frame is received, S806 is executed; if no distant view frame is received, the process returns to S802.

[0093] S806 receives similar pixel frames sent by the virtual reality management device based on multicast.

[0094] In this embodiment, the target virtual reality client can receive similar pixel frames sent by the virtual reality management device via multicast, and perform rendering based on these similar pixel frames. It can also receive different pixel frames sent by the virtual reality management device via unicast, and perform supplementary rendering based on these different pixel frames, thereby rendering the target virtual background type region. Optionally, after receiving both similar and different pixel frames, the target virtual reality client can perform unified rendering based on both, thereby rendering the target virtual background type region.

[0095] S807, render the second scene frame.

[0096] In this embodiment, the target virtual reality client can render a scene area of ​​a real-time virtual background type based on a second scene frame. Optionally, the target virtual reality client can receive a second scene frame sent by a virtual reality management device; it can also determine the second scene frame based on a first scene frame, etc. Optionally, the target virtual reality client can respond to the interactive operation of the target object and render the virtual object corresponding to the target virtual reality client and the interactive object with the virtual object.

[0097] In this embodiment, the virtual reality management device can receive virtual object coordinates sent by N virtual reality clients, and obtain first scene frames belonging to the target virtual background type for each of the N virtual reality clients based on the virtual object coordinates; N is a positive integer; perform similarity matching on the first scene frames corresponding to the N virtual reality clients to obtain a rendering pixel group including similar pixel frames; associate the rendering pixel group with S virtual reality clients; the first scene frames of the S virtual reality clients associated with the rendering pixel group all include similar pixel frames in the rendering pixel group; S is a positive integer less than or equal to N; and multicast the similar pixel frames included in the rendering pixel group to the S virtual reality clients associated with the rendering pixel group. The virtual reality clients can perform partial rendering of the target virtual background type area based on the received similar pixel frames. Through the above process, the virtual reality management device can further analyze the virtual reality scene in the virtual reality scene, perform similarity matching on the background elements of different virtual objects (i.e., virtual scene frames belonging to the target virtual background type), and then perform unified multicast rendering transmission, thereby reducing the amount of data that the virtual reality management device needs to send, reducing the demand for transmission bandwidth, thereby improving the transmission efficiency of virtual reality data and reducing network demands. Meanwhile, this application does not compress or process the data related to the virtual reality scene. In other words, it does not reduce the clarity of the rendered virtual reality scene based on bandwidth or other factors. This allows the virtual reality client to maintain the clarity of the rendered virtual reality scene, improve the smoothness of the virtual reality scene rendering, and thus improve the user experience.

[0098] Further, see Figure 9 , Figure 9 This is a schematic diagram of a data interaction scenario provided in an embodiment of this application. For example... Figure 9 As shown, the process includes:

[0099] ①N virtual reality clients synchronize the coordinates of virtual objects to the virtual reality management device 902. These N virtual reality clients include, but are not limited to, virtual reality client 9011, virtual reality client 9012, and virtual reality client 9013.

[0100] ② Based on step ①, the virtual reality management device 902 obtains the coordinates of the virtual objects corresponding to N virtual reality clients in the virtual reality scene. Using a background analysis module, the coordinates of the virtual objects corresponding to the N virtual reality clients are analyzed to obtain rendering pixel groups including similar pixel frames.

[0101] ③ Based on the multicast module, the similar pixel frames included in the rendered pixel group are multicasted to the virtual reality client associated with the rendered pixel group.

[0102] ④ Based on the frame difference analysis module, determine the difference pixel frames corresponding to each of the N virtual reality clients from the first scene frames corresponding to the N virtual reality clients respectively.

[0103] ⑤ Based on the unicast module, the difference pixel frames corresponding to N virtual reality clients are unicasted to the corresponding virtual reality clients.

[0104] ⑥ Based on steps ③ and ⑤ above, distribute scene frames to N virtual reality clients.

[0105] ⑦ The virtual reality client receives the first scene frame. Specifically, it receives similar pixel frames sent by the virtual reality management device based on multicast, and receives different pixel frames sent by the virtual reality management device based on unicast. It performs similar frame rendering based on the similar pixel frames and different frame rendering based on the different pixel frames to realize the rendering of the area belonging to the target virtual background type.

[0106] ⑧ The virtual reality client performs close-up frame rendering. Optionally, it can respond to interactive operations by the user (such as a user) and render based on those interactive operations.

[0107] Further, please see Figure 10 , Figure 10 This is a schematic diagram of a data processing apparatus provided in an embodiment of this application. The data processing apparatus can be a computer program (including program code, etc.) running on a computer device; for example, the data processing apparatus can be application software. The apparatus can be used to execute corresponding steps in the methods provided in the embodiments of this application. Figure 10 As shown, the data processing device 1000 can be used for Figure 3 Specifically, the computer device in the corresponding embodiment may include: a coordinate acquisition module 11, a matching module 12, and a multicast module 13.

[0108] The acquisition module 11 is used to receive the coordinates of virtual objects sent by N virtual reality clients respectively, and to obtain the first scene frame of the target virtual background type corresponding to each of the N virtual reality clients based on the coordinates of the virtual objects; N is a positive integer;

[0109] Matching module 12 is used to perform similarity matching on the first scene frames corresponding to N virtual reality clients respectively, to obtain a rendering pixel group including similar pixel frames; the rendering pixel group is associated with S virtual reality clients; the first scene frames of the S virtual reality clients associated with the rendering pixel group all include similar pixel frames in the rendering pixel group; S is a positive integer less than or equal to N;

[0110] Multicast module 13 is used to multicast similar pixel frames included in the rendered pixel group to the S virtual reality clients associated with the rendered pixel group.

[0111] The acquisition module 11 includes:

[0112] The determining unit 111 is used to determine the target range size corresponding to the i-th virtual reality client based on the coordinates of the virtual object corresponding to the i-th virtual reality client and the state of the virtual object corresponding to the i-th virtual reality client; the target range size is used to represent the number of virtual scene frames belonging to the target virtual background type determined for the i-th virtual reality client.

[0113] The determining unit 111 is further configured to determine the target distance range area corresponding to the i-th virtual reality client based on the first virtual distance, virtual object coordinates, and target range size corresponding to the i-th virtual reality client; the first virtual distance refers to the farthest visible distance of the i-th virtual reality client when rendering the virtual reality scene;

[0114] The determining unit 111 is further configured to determine the virtual scene frame located within the target distance range area corresponding to the i-th virtual reality client as the first scene frame belonging to the target virtual background type corresponding to the i-th virtual reality client; i is a positive integer less than or equal to N.

[0115] The device 1000 also includes:

[0116] The parsing module 14 is used to obtain the virtual reality display size corresponding to the i-th virtual reality client, and to parse the virtual scene frame located at the coordinates of the virtual object corresponding to the i-th virtual reality client to obtain the virtual scene information corresponding to the i-th virtual reality client.

[0117] The determining module 15 is used to determine the first virtual distance corresponding to the i-th virtual reality client based on the virtual reality display size and the virtual scene information corresponding to the i-th virtual reality client.

[0118] The determining unit 111 includes:

[0119] Get subunit 1111, used to get the virtual operation triggered by the i-th virtual reality client if the virtual object state corresponding to the i-th virtual reality client is the operation triggered state;

[0120] Determine subunit 1112, used to determine the scene change magnitude of the i-th virtual reality client based on virtual operations;

[0121] The determining subunit 1112 is also used to determine the target range size corresponding to the i-th virtual reality client based on the virtual object coordinates and scene change range of the i-th virtual reality client;

[0122] The determining subunit 1112 is also used to determine the target range size corresponding to the i-th virtual reality client based on the coordinates of the virtual object corresponding to the i-th virtual reality client if the virtual object corresponding to the i-th virtual reality client is in an inactive state.

[0123] The determining unit 111 includes:

[0124] The determining subunit 1112 is further configured to obtain the historical frame similarity between historical scene frames if the virtual object state corresponding to the i-th virtual reality client is a historical object state; the historical object state includes the historical scene frames determined for the i-th virtual reality client at e historical acquisition time points; the historical acquisition time point refers to the historical time point at which the virtual scene frame corresponding to the i-th virtual reality client belonging to the target virtual background type is acquired; e is a positive integer;

[0125] The prediction subunit 1113 is used to predict the target frame similarity based on the historical frame similarity, and to determine the target range size corresponding to the i-th virtual reality client based on the target frame similarity and the coordinates of the virtual object corresponding to the i-th virtual reality client.

[0126] The determining unit 111 includes:

[0127] The acquisition subunit 1111 is used to acquire the virtual view range corresponding to the i-th virtual reality client;

[0128] The determining subunit 1112 is also used to determine the first rendering boundary of the i-th virtual reality client based on the first virtual distance and virtual view range corresponding to the i-th virtual reality client;

[0129] The determining subunit 1112 is also used to determine the second rendering boundary corresponding to the i-th virtual reality client based on the target range size and along the direction from the first rendering boundary to the virtual object coordinates of the i-th virtual reality client.

[0130] The determining subunit 1112 is also used to determine the area between the first rendering boundary and the second rendering boundary as the target distance range area corresponding to the i-th virtual reality client.

[0131] Specifically, the matching module 12 is used for:

[0132] For each of the N virtual reality clients, perform pixel-by-pixel similarity matching on the first scene frame. If there are h identical pixel frames among the first scene frames corresponding to the S virtual reality clients, and h satisfies the inter-frame similarity threshold, then the h identical pixel frames are determined as similar pixel frames associated with the S virtual reality clients, and the similar pixel frames are grouped into rendering pixel groups associated with the S virtual reality clients; h is a positive integer.

[0133] The device 1000 includes at least two rendering pixel groups, with each group associated with M virtual reality clients; M is a positive integer greater than or equal to S and less than or equal to N; the device 1000 also includes:

[0134] The acquisition module 11 is also used to determine the difference pixel frames corresponding to N virtual reality clients from the first scene frames corresponding to N virtual reality clients based on the similar pixel frames corresponding to M virtual reality clients respectively.

[0135] The unicast module 16 is used to unicast the difference pixel frames corresponding to N virtual reality clients to the corresponding virtual reality clients.

[0136] The device 1000 also includes:

[0137] The acquisition module 11 is also used to determine the scene frame to be rendered corresponding to the i-th virtual reality client based on the coordinates of the virtual object corresponding to the i-th virtual reality client.

[0138] Module 17 is selected to obtain a second scene frame from the scene frame to be rendered corresponding to the i-th virtual reality client based on the first scene frame corresponding to the i-th virtual reality client; the second scene frame refers to the virtual scene frame other than the first scene frame in the corresponding scene frame to be rendered.

[0139] The sending module 18 is used to send the second scene frame corresponding to the i-th virtual reality client to the i-th virtual reality client.

[0140] Further, please see Figure 11 , Figure 11 This is a schematic diagram of another data processing apparatus provided in an embodiment of this application. The data processing apparatus can be a computer program (including program code, etc.) running on a computer device; for example, the data processing apparatus can be application software. The apparatus can be used to execute corresponding steps in the methods provided in the embodiments of this application. Figure 11 As shown, the data processing device 1100 can be used for Figure 7 Specifically, the computer device in the corresponding embodiment may include a sending module 31 and a receiving module 32.

[0141] The sending module 31 is used to send the coordinates of a virtual object from the target virtual reality client to the virtual reality management device, so that the virtual reality management device can determine the first scene frame of the target virtual reality client that belongs to the target virtual background type based on the coordinates of the virtual object, and determine similar pixel frames from the first scene frame; similar pixel frames refer to virtual scene frames included in the rendering pixel group, and the rendering pixel group is associated with S virtual reality clients; S is a positive integer; the S virtual reality clients include the target virtual reality client;

[0142] The receiving module 32 is used to receive similar pixel frames sent by the virtual reality management device based on multicast; the similar pixel frames are used to form a target virtual reality scene for the target virtual reality client.

[0143] The sending module 31 includes:

[0144] The sending unit 311 is used to detect the rendering timer for the target virtual background type by the target virtual reality client. If the rendering timer reaches the requested time point, it sends the coordinates of the virtual object to the virtual reality management device and resets the rendering timer.

[0145] The device 1100 also includes:

[0146] The monitoring module 33 is used to monitor the virtual reality management device and perform the process of receiving similar pixel frames sent by the virtual reality management device based on multicast if the rendering timer has not reached the requested time point.

[0147] The device 1100 also includes:

[0148] The receiving module 32 is also used to receive the difference pixel frames sent by the virtual reality management device based on unicast; the difference pixel frames refer to the virtual scene frames other than the similar pixel frames in the first scene frame corresponding to the target virtual reality client;

[0149] The rendering module 34 is used to render the scene area corresponding to the target virtual background type based on similar pixel frames and different pixel frames.

[0150] The device 1100 also includes:

[0151] The receiving module 32 is also used to receive a second scene frame belonging to the real-time virtual background type sent in real time by the virtual reality management device; the real-time virtual background type refers to a virtual background type other than the target virtual background type.

[0152] The rendering module 34 is also used to render the scene area corresponding to the real-time virtual background type based on the second scene frame; the scene area corresponding to the target virtual background type and the scene area corresponding to the real-time virtual background type together form the target virtual reality scene of the target virtual reality client.

[0153] This application provides a data processing apparatus. This apparatus allows a virtual reality management device to receive virtual object coordinates sent by N virtual reality clients. Based on the virtual object coordinates, it obtains first scene frames corresponding to the target virtual background type for each of the N virtual reality clients; N is a positive integer. It performs similarity matching on the first scene frames corresponding to the N virtual reality clients to obtain a rendering pixel group including similar pixel frames. The rendering pixel group is associated with S virtual reality clients. The first scene frames of the S virtual reality clients associated with the rendering pixel group all include similar pixel frames from the rendering pixel group; S is a positive integer less than or equal to N. The similar pixel frames included in the rendering pixel group are multicast and sent to the S virtual reality clients associated with the rendering pixel group. Through this process, the virtual reality management device can further analyze the virtual reality scene, perform similarity matching on the background elements of different virtual objects (i.e., virtual scene frames belonging to the target virtual background type), and then perform unified multicast rendering transmission. This reduces the amount of data that the virtual reality management device needs to send, lowers the bandwidth requirements, improves the transmission efficiency of virtual reality data, and lowers network requirements. Meanwhile, this application does not compress or process the data related to the virtual reality scene. In other words, it does not reduce the clarity of the rendered virtual reality scene based on bandwidth or other factors. This allows the virtual reality client to maintain the clarity of the rendered virtual reality scene, improve the smoothness of the virtual reality scene rendering, and thus improve the user experience.

[0154] See Figure 12 , Figure 12 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Figure 12 As shown, the computer device in this embodiment may include one or more processors 1201, a memory 1202, and an input / output interface 1203. The processor 1201, memory 1202, and input / output interface 1203 are connected via a bus 1204. The memory 1202 stores a computer program, which includes program instructions. The input / output interface 1203 receives and outputs data, such as for data interaction between a virtual reality client and a virtual reality management device. The processor 1201 executes the program instructions stored in the memory 1202.

[0155] The processor 1201 is integrated into the virtual reality management device and can perform the following operations:

[0156] Receive the coordinates of virtual objects sent by N virtual reality clients, and obtain the first scene frame of the target virtual background type for each of the N virtual reality clients based on the coordinates of the virtual objects; N is a positive integer;

[0157] Perform similarity matching on the first scene frames corresponding to N virtual reality clients to obtain a rendering pixel group that includes similar pixel frames; the rendering pixel group is associated with S virtual reality clients; the first scene frames of the S virtual reality clients associated with the rendering pixel group all include similar pixel frames in the rendering pixel group; S is a positive integer less than or equal to N;

[0158] The rendering pixel group contains similar pixel frames that are multicast to the S virtual reality clients associated with the rendering pixel group.

[0159] The processor 1201 is integrated into the virtual reality client and can perform the following operations:

[0160] The target virtual reality client sends the coordinates of a virtual object to the virtual reality management device, so that the virtual reality management device can determine the first scene frame belonging to the target virtual background type corresponding to the target virtual reality client based on the coordinates of the virtual object, and determine similar pixel frames from the first scene frame; similar pixel frames refer to virtual scene frames included in the rendering pixel group, and the rendering pixel group is associated with S virtual reality clients; S is a positive integer; the S virtual reality clients include the target virtual reality client;

[0161] Receive similar pixel frames sent by the virtual reality management device based on multicast; similar pixel frames are used to compose a target virtual reality scene for the target virtual reality client.

[0162] In some feasible implementations, the processor 1201 may be a central processing unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0163] The memory 1202 may include read-only memory and random access memory, and provides instructions and data to the processor 1201 and input / output interface 1203. A portion of the memory 1202 may also include non-volatile random access memory. For example, the memory 1202 may also store device type information.

[0164] In practice, the computer device can perform actions such as these through its built-in functional modules. Figure 3 or Figure 7 For details on the implementation methods provided for each step, please refer to [the relevant documentation / document / etc.]. Figure 3 or Figure 7 The implementation methods provided for each step are not elaborated here.

[0165] This application provides a computer device including a processor, an input / output interface, and a memory. The processor retrieves a computer program from the memory and executes it. Figure 3 or Figure 7 Each step of the method shown involves data processing. This embodiment of the application receives virtual object coordinates sent by N virtual reality clients, obtains first scene frames corresponding to the target virtual background type for each of the N virtual reality clients based on the virtual object coordinates (N is a positive integer), performs similarity matching on the first scene frames corresponding to the N virtual reality clients to obtain a rendering pixel group including similar pixel frames, associates the rendering pixel group with S virtual reality clients, and ensures that the first scene frames of the S virtual reality clients associated with the rendering pixel group all include similar pixel frames from the rendering pixel group (S is a positive integer less than or equal to N), and multicasts the similar pixel frames included in the rendering pixel group to the S virtual reality clients associated with the rendering pixel group. Through the above process, the virtual reality management device can further analyze the virtual reality scene within the virtual reality scene, perform similarity matching on the background elements of different virtual objects (i.e., virtual scene frames belonging to the target virtual background type), and then perform unified multicast rendering transmission. This reduces the amount of data that the virtual reality management device needs to send, lowers the demand for transmission bandwidth, and thus improves the transmission efficiency of virtual reality data while reducing network requirements. Meanwhile, this application does not compress or process the data related to the virtual reality scene. In other words, it does not reduce the clarity of the rendered virtual reality scene based on bandwidth or other factors. This allows the virtual reality client to maintain the clarity of the rendered virtual reality scene, improve the smoothness of the virtual reality scene rendering, and thus improve the user experience.

[0166] This application also provides a computer-readable storage medium storing a computer program adapted to be loaded and executed by a processor. Figure 3 or Figure 7For details on the data processing methods provided in each step, please refer to the document. Figure 3 or Figure 7 The implementation methods provided for each step are not repeated here. Furthermore, the beneficial effects of using the same method are also not repeated. For technical details not disclosed in the computer-readable storage medium embodiments involved in this application, please refer to the description of the method embodiments of this application. As an example, a computer program may be deployed to execute on a single computer device, or on multiple computer devices located in one location, or on multiple computer devices distributed across multiple locations and interconnected via a communication network.

[0167] The computer-readable storage medium can be the data processing apparatus provided in any of the foregoing embodiments or the internal storage unit of the computer device, such as the hard disk or memory of the computer device. The computer-readable storage medium can also be an external storage device of the computer device, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., provided on the computer device. Furthermore, the computer-readable storage medium can include both internal storage units and external storage devices of the computer device. The computer-readable storage medium is used to store the computer program and other programs and data required by the computer device. The computer-readable storage medium can also be used to temporarily store data that has been output or will be output.

[0168] This application also provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform... Figure 3 or Figure 7 The method provided among the various optional approaches further analyzes the virtual reality scene within the virtual reality scene, performs similarity matching on the background elements of different virtual objects (i.e., virtual scene frames belonging to the target virtual background type), and then performs unified multicast rendering transmission. This reduces the amount of data that the virtual reality management device needs to send, lowers the demand for transmission bandwidth, and thus improves the transmission efficiency of virtual reality data and reduces network requirements. Furthermore, this application does not compress or otherwise process the relevant data of the virtual reality scene; in other words, it does not reduce the clarity of the rendered virtual reality scene based on bandwidth limitations. This allows the virtual reality client to maintain the clarity of the rendered virtual reality scene, improves the smoothness of virtual reality scene rendering, and thus enhances the user experience.

[0169] The terms "first," "second," etc., in the specification, claims, and drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the term "comprising," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, apparatus, product, or device that includes a series of steps or units is not limited to the listed steps or modules, but may optionally include steps or modules not listed, or may optionally include other step units inherent to these processes, methods, apparatuses, products, or devices.

[0170] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of each example have been generally described in terms of functionality. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this application.

[0171] The methods and related apparatuses provided in this application are described with reference to the method flowcharts and / or structural diagrams provided in this application. Specifically, each block of the method flowchart and / or structural diagram, as well as combinations of blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing device to create a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing device, generate instructions for implementing the process. Figure 1 A schematic diagram of one or more processes and / or structures. Figure 1 The computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process. Figure 1 A schematic diagram of one or more processes and / or structures. Figure 1 The functions specified in one or more boxes. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable apparatus for implementing the process. Figure 1 A process or multiple processes and / or structures illustrate the steps of the functions specified in one or more boxes.

[0172] The steps in the method of this application embodiment can be adjusted, combined, or deleted according to actual needs.

[0173] The modules in the device of this application embodiment can be merged, divided, and deleted according to actual needs.

[0174] The above-disclosed embodiments are merely preferred embodiments of this application and should not be construed as limiting the scope of this application. Therefore, any equivalent variations made in accordance with the claims of this application shall still fall within the scope of this application.

Claims

1. A data processing method, characterized by, The method includes: Receive the coordinates of virtual objects sent by N virtual reality clients; Based on the coordinates of the virtual objects corresponding to the N virtual reality clients, the target area size corresponding to the N virtual reality clients is determined; N is a positive integer. Obtain the virtual reality display size corresponding to each of the N virtual reality clients, and parse the virtual scene frames located at the coordinates of the virtual objects corresponding to each of the N virtual reality clients to obtain the virtual scene information corresponding to each of the N virtual reality clients; Based on the virtual reality display size corresponding to each of the N virtual reality clients and the virtual scene information corresponding to each of the N virtual reality clients, determine the first virtual distance corresponding to each of the N virtual reality clients; Based on the first virtual distance, virtual object coordinates, and target range size corresponding to the N virtual reality clients respectively, the target distance range area corresponding to the N virtual reality clients is determined. Based on the target distance range, obtain the first scene frame belonging to the target virtual background type for each of the N virtual reality clients; A similarity match is performed on the first scene frames corresponding to the N virtual reality clients to obtain a rendering pixel group that includes similar pixel frames; the rendering pixel group is associated with S virtual reality clients; the first scene frames of the S virtual reality clients associated with the rendering pixel group all include the similar pixel frames in the rendering pixel group; S is a positive integer less than or equal to N; The similar pixel frames included in the rendered pixel group are multicast to the S virtual reality clients associated with the rendered pixel group.

2. The method as described in claim 1, characterized in that, The process involves determining the target range size corresponding to each of the N virtual reality clients based on the coordinates of the virtual objects they correspond to; obtaining the virtual reality display size corresponding to each of the N virtual reality clients; parsing the virtual scene frames located at the coordinates of the virtual objects corresponding to each of the N virtual reality clients to obtain the virtual scene information corresponding to each of the N virtual reality clients; determining the first virtual distance corresponding to each of the N virtual reality clients based on the virtual reality display size and the virtual scene information corresponding to each of the N virtual reality clients; and determining the target distance range area corresponding to each of the N virtual reality clients based on the first virtual distance, the coordinates of the virtual objects, and the target range size. Based on the target distance range, obtain the first scene frame belonging to the target virtual background type for each of the N virtual reality clients, including: Based on the coordinates of the virtual object corresponding to the i-th virtual reality client and the state of the virtual object corresponding to the i-th virtual reality client, the target range size corresponding to the i-th virtual reality client is determined; the target range size is used to represent the number of virtual scene frames belonging to the target virtual background type determined for the i-th virtual reality client; i is a positive integer less than or equal to N; Obtain the virtual reality display size corresponding to the i-th virtual reality client, parse the virtual scene frame located at the coordinates of the virtual object corresponding to the i-th virtual reality client, and obtain the virtual scene information corresponding to the i-th virtual reality client; Based on the virtual reality display size and the virtual scene information corresponding to the i-th virtual reality client, determine the first virtual distance corresponding to the i-th virtual reality client; Based on the first virtual distance, virtual object coordinates, and target range size corresponding to the i-th virtual reality client, the target distance range area corresponding to the i-th virtual reality client is determined; the first virtual distance refers to the farthest visible distance of the i-th virtual reality client when rendering a virtual reality scene; The virtual scene frames located within the target distance range corresponding to the i-th virtual reality client are determined as the first scene frames belonging to the target virtual background type corresponding to the i-th virtual reality client.

3. The method as described in claim 2, characterized in that, Determining the target range size corresponding to the i-th virtual reality client based on the coordinates of the virtual object corresponding to the i-th virtual reality client and the state of the virtual object corresponding to the i-th virtual reality client includes: If the virtual object state corresponding to the i-th virtual reality client is in the operation triggered state, then obtain the virtual operation triggered by the i-th virtual reality client, determine the scene change range of the i-th virtual reality client based on the virtual operation, and determine the target range size corresponding to the i-th virtual reality client according to the virtual object coordinates of the i-th virtual reality client and the scene change range. If the virtual object corresponding to the i-th virtual reality client is in an inactive state, then the target range size corresponding to the i-th virtual reality client is determined based on the coordinates of the virtual object corresponding to the i-th virtual reality client.

4. The method as described in claim 2, characterized in that, Determining the target range size corresponding to the i-th virtual reality client based on the coordinates of the virtual object corresponding to the i-th virtual reality client and the state of the virtual object corresponding to the i-th virtual reality client includes: If the virtual object state corresponding to the i-th virtual reality client is a historical object state, then the historical frame similarity between historical scene frames is obtained; the historical object state includes the historical scene frames determined for the i-th virtual reality client at e historical acquisition time points respectively; the historical acquisition time point refers to the historical time point at which the virtual scene frames corresponding to the i-th virtual reality client belonging to the target virtual background type are acquired; e is a positive integer; Based on the historical inter-frame similarity, the target inter-frame similarity is predicted. Based on the target inter-frame similarity and the coordinates of the virtual object corresponding to the i-th virtual reality client, the target range size corresponding to the i-th virtual reality client is determined.

5. The method as described in claim 2, characterized in that, The step of determining the target distance range region corresponding to the i-th virtual reality client based on the first virtual distance, virtual object coordinates, and target range size corresponding to the i-th virtual reality client includes: Obtain the virtual view range corresponding to the i-th virtual reality client; Based on the first virtual distance and virtual view range corresponding to the i-th virtual reality client, the first rendering boundary of the i-th virtual reality client is determined; Based on the target range size, the second rendering boundary corresponding to the i-th virtual reality client is determined along the direction from the first rendering boundary to the virtual object coordinates of the i-th virtual reality client; The area between the first rendering boundary and the second rendering boundary is determined as the target distance range area corresponding to the i-th virtual reality client.

6. The method as described in claim 1, characterized in that, The step of performing similarity matching on the first scene frames corresponding to the N virtual reality clients to obtain a rendering pixel group including similar pixel frames includes: For each of the N virtual reality clients, a pixel-by-pixel similarity matching is performed on the first scene frames corresponding to each of the S virtual reality clients. If there are h identical pixel frames among the first scene frames corresponding to each of the S virtual reality clients, and the h frames satisfy the inter-frame similarity threshold, then the h identical pixel frames are determined as similar pixel frames associated with the S virtual reality clients, and the similar pixel frames are grouped into rendering pixel groups associated with the S virtual reality clients; h is a positive integer.

7. The method as described in claim 1, characterized in that, The number of rendering pixel groups is at least two, and at least two rendering pixel groups are associated with M virtual reality clients; M is a positive integer greater than or equal to S and less than or equal to N; the method further includes: Based on the similar pixel frames corresponding to the M virtual reality clients, the different pixel frames corresponding to the N virtual reality clients are determined from the first scene frames corresponding to the N virtual reality clients. The difference pixel frames corresponding to the N virtual reality clients are unicasted to the corresponding virtual reality clients.

8. The method as described in claim 1, characterized in that, The method further includes: Based on the coordinates of the virtual object corresponding to the i-th virtual reality client, determine the scene frame to be rendered corresponding to the i-th virtual reality client; i is a positive integer less than or equal to N; Based on the first scene frame corresponding to the i-th virtual reality client, a second scene frame is obtained from the scene frame to be rendered corresponding to the i-th virtual reality client; the second scene frame refers to the virtual scene frame other than the first scene frame in the corresponding scene frame to be rendered. Send the second scene frame corresponding to the i-th virtual reality client to the i-th virtual reality client.

9. A data processing method, characterized in that, The method includes: The target virtual reality client sends virtual object coordinates to the virtual reality management device, enabling the virtual reality management device to determine, based on the virtual object coordinates, a first scene frame belonging to the target virtual background type corresponding to the target virtual reality client, and to determine similar pixel frames from the first scene frame. The similar pixel frames refer to virtual scene frames included in a rendering pixel group, which is associated with S virtual reality clients; S is a positive integer; the S virtual reality clients include the target virtual reality client. The first scene frame is obtained based on the target distance range area of ​​the target virtual reality client. The target distance range area is determined based on the first virtual distance, virtual object coordinates, and target range size corresponding to the target virtual reality client. The first virtual distance is obtained based on the virtual reality display size corresponding to the target virtual reality client and the virtual scene information corresponding to the target virtual reality client. The virtual scene information is obtained by parsing the virtual scene frame located at the virtual object coordinates corresponding to the target virtual reality client. The target range size is determined based on the virtual object coordinates corresponding to the target virtual reality client. The virtual reality management device receives the similar pixel frames sent by the virtual reality management device based on multicast; the similar pixel frames are used to form a target virtual reality scene for the target virtual reality client.

10. The method as described in claim 9, characterized in that, The target virtual reality client sends virtual object coordinates to the virtual reality management device, including: The target virtual reality client detects the rendering timer for the target virtual background type. If the rendering timer reaches the requested time point, it sends the virtual object coordinates to the virtual reality management device and resets the rendering timer. The method further includes: If the rendering timer does not reach the requested time point, the virtual reality management device is monitored, and the process of receiving the similar pixel frames sent by the virtual reality management device based on multicast is executed.

11. The method as described in claim 9, characterized in that, The method further includes: Receive the difference pixel frame sent by the virtual reality management device based on unicast; the difference pixel frame refers to the virtual scene frame other than the similar pixel frame in the first scene frame corresponding to the target virtual reality client; Based on the similar pixel frames and the different pixel frames, the scene area corresponding to the target virtual background type is rendered.

12. The method as described in claim 9, characterized in that, The method further includes: Receive a second scene frame belonging to the real-time virtual background type sent in real time by the virtual reality management device; the real-time virtual background type refers to a virtual background type other than the target virtual background type; The scene area corresponding to the real-time virtual background type is rendered based on the second scene frame; the scene area corresponding to the target virtual background type and the scene area corresponding to the real-time virtual background type together constitute the target virtual reality scene of the target virtual reality client.

13. A data processing apparatus, characterized in that, The device includes: The acquisition module is used to receive the coordinates of virtual objects sent by N virtual reality clients respectively, and to acquire the first scene frame belonging to the target virtual background type for each of the N virtual reality clients based on the coordinates of the virtual objects; N is a positive integer; The matching module is used to perform similarity matching on the first scene frames corresponding to the N virtual reality clients respectively, to obtain a rendering pixel group including similar pixel frames; the rendering pixel group is associated with S virtual reality clients; the first scene frames of the S virtual reality clients associated with the rendering pixel group all include the similar pixel frames in the rendering pixel group; S is a positive integer less than or equal to N; A multicast module is used to multicast the similar pixel frames included in the rendered pixel group to the S virtual reality clients associated with the rendered pixel group; The acquisition module is used for: Based on the coordinates of the virtual objects corresponding to the N virtual reality clients, determine the target range size corresponding to the N virtual reality clients respectively; Obtain the virtual reality display size corresponding to each of the N virtual reality clients, and parse the virtual scene frames located at the coordinates of the virtual objects corresponding to each of the N virtual reality clients to obtain the virtual scene information corresponding to each of the N virtual reality clients; Based on the virtual reality display size corresponding to each of the N virtual reality clients and the virtual scene information corresponding to each of the N virtual reality clients, determine the first virtual distance corresponding to each of the N virtual reality clients; Based on the first virtual distance, virtual object coordinates, and target range size corresponding to the N virtual reality clients respectively, the target distance range area corresponding to the N virtual reality clients is determined. Based on the target distance range, obtain the first scene frame belonging to the target virtual background type for each of the N virtual reality clients.

14. A data processing apparatus, characterized in that, The device includes: A sending module is used to send virtual object coordinates from a target virtual reality client to a virtual reality management device, so that the virtual reality management device can determine a first scene frame belonging to a target virtual background type corresponding to the target virtual reality client based on the virtual object coordinates, and determine similar pixel frames from the first scene frame; the similar pixel frames refer to virtual scene frames included in a rendering pixel group, the rendering pixel group being associated with S virtual reality clients; S is a positive integer; the S virtual reality clients include the target virtual reality client; the first scene frame is obtained based on the target distance range area of ​​the target virtual reality client; the target distance range area is determined based on the first virtual distance, virtual object coordinates, and target range size corresponding to the target virtual reality client; the first virtual distance is obtained based on the virtual reality display size corresponding to the target virtual reality client and the virtual scene information corresponding to the target virtual reality client; the virtual scene information is obtained by parsing the virtual scene frame located at the virtual object coordinates corresponding to the target virtual reality client; the target range size is determined based on the virtual object coordinates corresponding to the target virtual reality client; The receiving module is used to receive the similar pixel frames sent by the virtual reality management device based on multicast; the similar pixel frames are used to form a target virtual reality scene for the target virtual reality client.

15. A computer device, characterized in that, It includes a processor and a memory; the memory is used to store a computer program, and the processor is used to invoke the computer program to cause the computer device to perform the method according to any one of claims 1-8, or to perform the method according to any one of claims 9-12.

16. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program adapted to be loaded and executed by a processor to cause a computer device having the processor to perform the method of any one of claims 1-8, or the method of any one of claims 9-12.

17. A computer program product comprising a computer program / instructions, characterized in that, When the computer program / instructions are executed by the processor, they implement the method according to any one of claims 1-8, or perform the method according to any one of claims 9-12.

Images