Physical simulation and rendering method, apparatus, and storage medium

Abstract

The application relates to the field of artificial intelligence, in particular to a physical simulation and rendering method and device and a storage medium. The method comprises the following steps: an edge computing device cooperates with a cloud computing device to obtain a target physical simulation result through physical simulation, wherein the target physical simulation result indicates physical information simulated in a target local area in a virtual world after cooperation; a rendering image of the target local area is obtained through rendering according to the second physical simulation result; and the rendering image is sent to a terminal device. Through the introduction of the edge computing device, the cloud side and the edge side cooperate in the process of physical simulation, a new physical simulation and rendering architecture is realized, the problems existing in the current physical and rendering architecture in the related art are solved, the cloud side and the edge side transmit data through an internal backbone network, the data transmission quality is ensured, and the data transmission delay is reduced.

Description

Technical Field

[0001] This application relates to the field of artificial intelligence (AI), and more particularly to a physical simulation and rendering method, apparatus, and storage medium. Background Technology

[0002] Physics simulation and rendering are core technologies for applications such as cloud gaming and the metaverse. Physics simulation simulates objects and their motion laws in the real world within a virtual world, such as rigid body motion and collisions, fluid motion, smoke and explosions, and even the hair, muscles, and bones of characters. Rendering is based on the original model of the object, adding elements such as color, lighting, and shadows, and finally rendering it onto the screen. As time progresses, the physics engine provides information such as the position and state (velocity, acceleration) of the simulated objects in the virtual world, and the rendering engine uses this information to render the objects, creating realistic images presented to the user.

[0003] Among related technologies, cloud-based physical simulation and rendering architectures, such as Figure 1 As shown, the cloud-side physics engine 11 calculates the entire virtual world, while the edge-side physics engine 21 calculates and renders its respective visible portion of the virtual world. When the physical information on both sides is inconsistent, they need to be synchronized. The workflow is as follows: Users interact through the edge-side upper-layer application 22 (cloud gaming, metaverse, etc.), such as clicking the screen or buttons to influence objects within the visible view. The edge-side upper-layer application 22 transmits and exchanges data (control commands, etc.) with the cloud-side upper-layer application 12 via a wide area network. The cloud-side upper-layer application 12 inputs the interaction data into its local physics engine 11, which updates the entire virtual world over time based on all user input. The cloud-side upper-layer application 12 sends the virtual world state and state values ​​visible to each terminal to the corresponding edge. The edge-side upper-layer application 22 inputs the user's interaction data into its local physics engine 21, which updates the visible portion of the virtual world over time based on user input. The device checks whether the physical information sent from the cloud side is consistent with the local physical information. If they are inconsistent, the device updates the local physical information from the cloud side. The device's rendering engine 23 renders the visible part of the virtual world, and the upper-layer application 22 on the device side displays the application screen to the user.

[0004] However, the above methods suffer from large transmission latency and jitter over wide area networks. Cloud gaming and metaverse applications have high requirements for network transmission quality. When physical information is synchronized between the cloud side and the terminal side, the screen latency is large. Summary of the Invention

[0005] In view of this, a physical simulation and rendering method, apparatus, and storage medium are proposed. This application's embodiments introduce edge computing devices, enabling collaboration between the cloud and edge sides during the physical simulation process, thus realizing a new physical simulation and rendering architecture. This addresses the problems existing in current physical and rendering architectures in related technologies. Data is transmitted between the cloud and edge sides through an internal backbone network, ensuring data transmission quality and reducing data transmission latency.

[0006] In a first aspect, embodiments of this application provide a physical simulation and rendering method for use in an edge computing device, wherein the edge computing device and a cloud computing device transmit data through an internal backbone network, the method comprising:

[0007] The physical simulation performed in collaboration with the cloud computing device yields a target physical simulation result, which indicates the physical information simulated in a target local area of ​​the virtual world after collaboration.

[0008] The rendered image of the target local region is obtained by rendering based on the second physical simulation result;

[0009] The rendered image is sent to the terminal device.

[0010] In this implementation, by introducing edge computing devices, cloud computing devices and edge computing devices collaborate on physical simulation, with the edge computing devices performing subsequent rendering. That is, the edge computing devices are responsible for both physical simulation and rendering, while the cloud computing devices are only responsible for physical simulation, thus realizing a new physical simulation and rendering architecture. On the one hand, the cloud side does not need to perform rendering, saving computing power to simulate the entire virtual world; on the other hand, the edge side performs rendering, but the physical simulation only simulates a portion of the view; furthermore, the cloud side and the edge side transmit data through an internal backbone network, ensuring data transmission quality and reducing data transmission latency.

[0011] In one possible implementation, the cloud computing device is used to perform physical simulation at first time intervals to obtain a first physical simulation result, the first physical simulation result indicating physical information simulated in the virtual world;

[0012] The physical simulation conducted in collaboration with the cloud computing device yields the target physical simulation results, including:

[0013] A second physical simulation result is obtained by performing a physical simulation every second time interval, and the second physical simulation result indicates the physical information simulated in the target local area;

[0014] Based on the comparison between the first physical simulation result and the second physical simulation result, the target physical simulation result is determined, wherein the target physical simulation result is consistent with the physical information indicated by the first physical simulation result on the target local region.

[0015] In this implementation, the cloud computing device performs physical simulation every first time interval to obtain a first physical simulation result, and the edge computing device performs physical simulation every second time interval to obtain a second physical simulation result. The first physical simulation result and the second physical simulation result are compared to synchronize physical information and ensure the collaborative work of the cloud computing device and the edge computing device.

[0016] In another possible implementation, determining the target physical simulation result based on a comparison between the first physical simulation result and the second physical simulation result includes:

[0017] Obtain the first feature information of the target local region in the first physical simulation result and the second feature information in the second physical simulation result;

[0018] If the first feature information and the second feature information are inconsistent, the second physical simulation result is refreshed to obtain the target physical simulation result;

[0019] If the first feature information and the second feature information are consistent, the second physical simulation result is determined as the target physical simulation result.

[0020] In this implementation, the edge computing device acquires the first feature information of the target local area in the first physical simulation result and the second feature information in the second physical simulation result. In the case of inconsistent feature information, it is necessary to synchronize the physical information, which provides a prerequisite guarantee for the collaborative work of cloud computing devices and edge computing devices.

[0021] In another possible implementation, the step of refreshing the second physical simulation result to obtain the target physical simulation result when the first feature information and the second feature information are inconsistent includes:

[0022] If the first feature information and the second feature information are inconsistent, a refresh request is sent to the cloud computing device, and the refresh request instructs the cloud computing device to return the object state of the target local area in the first physical simulation result.

[0023] Based on the returned object state of the target local region, the second physical simulation result is refreshed to obtain the target physical simulation result.

[0024] In this implementation, when the feature information is inconsistent, the edge computing device sends a refresh request to the cloud computing device. Based on the object state of the target local area returned by the cloud computing device, the second physical simulation result is refreshed, thereby synchronizing the physical information of the edge computing device with that of the cloud computing device.

[0025] In another possible implementation, the edge computing device is connected to the terminal device via a wide area network, and the distance between the edge computing device and the terminal device is less than a distance threshold.

[0026] In this implementation, the edge computing device and the terminal device can simply stream data. Since the terminal device is relatively close to the edge computing device's network, using a wide area network (WAN) can guarantee the data transmission latency.

[0027] In another possible implementation, the target local region is a portion of the virtual world determined by the set of perspectives of the terminal devices connected to the edge computing device.

[0028] In this implementation, the target local area is a portion of the virtual world determined by the set of viewpoints of the terminal devices connected to the edge computing device. That is, the region division of the virtual world is determined according to the set of viewpoints of all terminals on the access edge, which ensures the rationality of the region division.

[0029] In another possible implementation, the terminal device is used to receive and display the rendered image.

[0030] In this implementation, the terminal device is used to receive and display the rendered image. That is, the terminal does not need any high-end processor and graphics card. It only needs a thin client to transmit the rendered image and maintain the data stream with the edge. There is no need to adapt to the differences between different hardware platforms.

[0031] Secondly, embodiments of this application provide a physical simulation and rendering method for a collaborative system, the collaborative system including cloud computing devices and edge computing devices, wherein the edge computing devices and the cloud computing devices transmit data through an internal backbone network, the method comprising:

[0032] The edge computing device and the cloud computing device perform collaborative physical simulation to obtain target physical simulation results, and the target physical simulation results indicate the physical information simulated in the target local area of ​​the virtual world after collaboration.

[0033] The edge computing device renders the target local region based on the second physical simulation result;

[0034] The edge computing device sends the rendered image to the terminal device.

[0035] In one possible implementation, the edge computing device and the cloud computing device perform collaborative physical simulation to obtain the target physical simulation result, including:

[0036] The cloud computing device performs physical simulation at a first time interval to obtain a first physical simulation result, and the first physical simulation result indicates the physical information simulated in the virtual world;

[0037] The edge computing device performs physical simulation every second time interval to obtain a second physical simulation result, the second physical simulation result indicating the physical information simulated in the target local area;

[0038] The edge computing device determines the target physical simulation result based on the comparison between the first physical simulation result and the second physical simulation result, wherein the target physical simulation result is consistent with the physical information indicated by the first physical simulation result on the target local area.

[0039] In another possible implementation, the edge computing device determines the target physical simulation result based on a comparison between the first physical simulation result and the second physical simulation result, including:

[0040] Obtain the first feature information of the target local region in the first physical simulation result and the second feature information in the second physical simulation result;

[0041] If the first feature information and the second feature information are inconsistent, the second physical simulation result is refreshed to obtain the target physical simulation result;

[0042] If the first feature information and the second feature information are consistent, the second physical simulation result is determined as the target physical simulation result.

[0043] In another possible implementation, the step of refreshing the second physical simulation result to obtain the target physical simulation result when the first feature information and the second feature information are inconsistent includes:

[0044] If the first feature information and the second feature information are inconsistent, a refresh request is sent to the cloud computing device, and the refresh request instructs the cloud computing device to return the object state of the target local area in the first physical simulation result.

[0045] Based on the returned object state of the target local region, the second physical simulation result is refreshed to obtain the target physical simulation result.

[0046] In another possible implementation, the edge computing device is connected to the terminal device via a wide area network, and the distance between the edge computing device and the terminal device is less than a distance threshold.

[0047] In another possible implementation, the target local region is a portion of the virtual world determined by the set of perspectives of the terminal devices connected to the edge computing device.

[0048] In another possible implementation, the terminal device is used to receive and display the rendered image.

[0049] Thirdly, embodiments of this application provide a physical simulation and rendering apparatus for use in an edge computing device, wherein the edge computing device and the cloud computing device transmit data through an internal backbone network, the apparatus comprising:

[0050] The simulation unit is used to perform physical simulation in collaboration with the cloud computing device to obtain target physical simulation results, wherein the target physical simulation results indicate the physical information simulated in a target local area of ​​the virtual world after collaboration.

[0051] A rendering unit is used to render a rendered image of the target local area based on the second physical simulation result;

[0052] The sending unit is used to send the rendered image to the terminal device.

[0053] In one possible implementation, the cloud computing device is used to perform physical simulation at first time intervals to obtain a first physical simulation result, the first physical simulation result indicating physical information simulated in the virtual world;

[0054] The simulation unit is also used for:

[0055] A second physical simulation result is obtained by performing a physical simulation every second time interval, and the second physical simulation result indicates the physical information simulated in the target local area;

[0056] Based on the comparison between the first physical simulation result and the second physical simulation result, the target physical simulation result is determined, wherein the target physical simulation result is consistent with the physical information indicated by the first physical simulation result on the target local region.

[0057] In another possible implementation, the simulation unit is further configured to:

[0058] Obtain the first feature information of the target local region in the first physical simulation result and the second feature information in the second physical simulation result;

[0059] If the first feature information and the second feature information are inconsistent, the second physical simulation result is refreshed to obtain the target physical simulation result;

[0060] If the first feature information and the second feature information are consistent, the second physical simulation result is determined as the target physical simulation result.

[0061] In another possible implementation, the simulation unit is further configured to:

[0062] If the first feature information and the second feature information are inconsistent, a refresh request is sent to the cloud computing device, and the refresh request instructs the cloud computing device to return the object state of the target local area in the first physical simulation result.

[0063] Based on the returned object state of the target local region, the second physical simulation result is refreshed to obtain the target physical simulation result.

[0064] In another possible implementation, the edge computing device is connected to the terminal device via a wide area network, and the distance between the edge computing device and the terminal device is less than a distance threshold.

[0065] In another possible implementation, the target local region is a portion of the virtual world determined by the set of perspectives of the terminal devices connected to the edge computing device.

[0066] In another possible implementation, the terminal device is used to receive and display the rendered image.

[0067] Fourthly, embodiments of this application provide a physical simulation and rendering apparatus for use in a collaborative system, the collaborative system including cloud computing devices and edge computing devices, the edge computing devices transmitting data with the cloud computing devices through an internal backbone network, the apparatus comprising:

[0068] The cloud computing device and the edge computing device are used to perform collaborative physical simulation to obtain target physical simulation results, wherein the target physical simulation results indicate the physical information simulated in a target local area of ​​the virtual world after collaboration.

[0069] The edge computing device is further configured to render a rendered image of the target local region based on the second physical simulation result;

[0070] The edge computing device is also used to send the rendered image to the terminal device.

[0071] In one possible implementation,

[0072] The cloud computing device is also used to perform physical simulation at every first time interval to obtain a first physical simulation result, wherein the first physical simulation result indicates the physical information simulated in the virtual world;

[0073] The edge computing device is also used to perform physical simulation every second time interval to obtain a second physical simulation result, the second physical simulation result indicating the physical information simulated in the target local area;

[0074] The edge computing device is further configured to determine the target physical simulation result based on a comparison between the first physical simulation result and the second physical simulation result, wherein the target physical simulation result is consistent with the physical information indicated by the first physical simulation result on the target local region.

[0075] In another possible implementation, the edge computing device is further used for:

[0076] Obtain the first feature information of the target local region in the first physical simulation result and the second feature information in the second physical simulation result;

[0077] If the first feature information and the second feature information are inconsistent, the second physical simulation result is refreshed to obtain the target physical simulation result;

[0078] If the first feature information and the second feature information are consistent, the second physical simulation result is determined as the target physical simulation result.

[0079] In another possible implementation, the edge computing device is further used for:

[0080] If the first feature information and the second feature information are inconsistent, a refresh request is sent to the cloud computing device, and the refresh request instructs the cloud computing device to return the object state of the target local area in the first physical simulation result.

[0081] Based on the returned object state of the target local region, the second physical simulation result is refreshed to obtain the target physical simulation result.

[0082] In another possible implementation, the edge computing device is connected to the terminal device via a wide area network, and the distance between the edge computing device and the terminal device is less than a distance threshold.

[0083] In another possible implementation, the target local region is a portion of the virtual world determined by the set of perspectives of the terminal devices connected to the edge computing device.

[0084] In another possible implementation, the terminal device is used to receive and display the rendered image.

[0085] Fifthly, embodiments of this application provide a physical simulation and rendering apparatus, the apparatus comprising:

[0086] processor;

[0087] Memory used to store processor-executable instructions;

[0088] The processor is configured to implement the above method when executing the instructions.

[0089] Sixthly, embodiments of this application provide a computing device cluster, including at least one computing device, each computing device including a processor and memory;

[0090] The processor of the at least one computing device is used to execute instructions stored in the memory of the at least one computing device to cause the cluster of computing devices to perform the method described above.

[0091] In a seventh aspect, embodiments of this application provide a computer program product containing instructions that, when executed by a cluster of computing devices, cause the cluster of computing devices to perform the method described above.

[0092] Eighthly, embodiments of this application provide a computer-readable storage medium including computer program instructions that, when executed by a cluster of computing devices, perform the method described above. Attached Figure Description

[0093] The accompanying drawings, which are included in and form part of this specification, illustrate exemplary embodiments, features, and aspects of this application together with the specification and serve to explain the principles of this application.

[0094] Figure 1 A schematic diagram of a cloud-based physical simulation and rendering architecture is shown in the relevant technology.

[0095] Figure 2 This illustration shows a schematic diagram of the evolution of the physical simulation and rendering architecture provided in an exemplary embodiment of this application.

[0096] Figure 3 A flowchart illustrating a physical simulation and rendering method provided in an exemplary embodiment of this application is shown.

[0097] Figure 4 A flowchart of a physical simulation and rendering method provided by another exemplary embodiment of this application is shown.

[0098] Figure 5A schematic diagram of a physical simulation and rendering architecture provided in an exemplary embodiment of this application is shown.

[0099] Figure 6 A schematic diagram of the region division involved in the physical simulation and rendering method provided in an exemplary embodiment of this application is shown.

[0100] Figure 7 This illustration shows a view update involved in a physical simulation and rendering method provided by an exemplary embodiment of this application.

[0101] Figure 8 This illustration shows a schematic diagram of view synchronization between cloud edges provided in an exemplary embodiment of this application.

[0102] Figure 9 This illustration shows a schematic diagram of the view changes between sides provided in an exemplary embodiment of this application.

[0103] Figure 10 A block diagram of a physical simulation and rendering apparatus provided in an exemplary embodiment of this application is shown.

[0104] Figure 11 A block diagram of a physical simulation and rendering apparatus provided in another exemplary embodiment of this application is shown. Detailed Implementation

[0105] Various exemplary embodiments, features, and aspects of this application will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.

[0106] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.

[0107] Furthermore, to better illustrate this application, numerous specific details are provided in the following detailed embodiments. Those skilled in the art should understand that this application can be implemented without certain specific details. In some instances, methods, means, components, and circuits well-known to those skilled in the art have not been described in detail in order to highlight the main points of this application.

[0108] In related technologies, cloud-based physics simulation and rendering architectures suffer from high latency and jitter in wide area network transmission. Cloud gaming and metaverse applications have high requirements for network transmission quality, and when synchronizing physical information between the cloud and the client, screen latency is significant. Furthermore, users' client-side computing power is limited, leading to untimely screen updates and stuttering in applications such as AAA games. The client-side physics and rendering engines need to adapt to different software and hardware architectures, increasing the difficulty of development and maintenance.

[0109] This application aims to address issues such as high network transmission quality requirements, limited computing power on the user side, and the need for the user side to adapt to heterogeneous architectures in cloud-based physical simulation and rendering. It seeks to reduce the development and maintenance difficulties for application developers and improve the user experience. It supports the following features: physically distributed synchronization between the cloud and edge sides, back-to-back physical simulation and rendering on the edge side, and rendering streaming between the edge and the client side.

[0110] This application's embodiment introduces edge computing devices, where the edge is responsible for physics simulation and rendering, while cloud computing only handles physics simulation. The cloud and edge physics work together to form a distributed, collaborative physics engine, achieving a superior physics simulation and rendering architecture that solves the problems existing in current physics and rendering architectures in related technologies. On one hand, the powerful network (such as a backbone network) between the cloud and edge reduces transmission latency, and the powerful computing power (cluster) of the cloud and edge accelerates computation, reducing data transmission latency. On the other hand, the endpoint and edge only perform simple streaming; the endpoint is relatively close to the edge network, and wide area network transmission can guarantee data transmission latency. Furthermore, the endpoint does not require any high-end processors or graphics cards; only a lightweight client is needed to transmit rendered images and maintain data flow with the edge, eliminating the need to adapt to different hardware platform differences.

[0111] First, let me introduce some of the terms used in this application.

[0112] 1. Edge computing devices: Computing devices deployed in edge environments. An edge environment is an environment geographically close to the user's terminal device. Edge environments include edge computing devices, such as edge servers and edge stations with computing capabilities.

[0113] 2. Cloud computing devices: Computing devices deployed in a cloud environment. These can include virtual machine instances, container instances, physical servers, etc.

[0114] 3. Terminal device: This can be a computing device that needs to display and render images, such as a virtual reality (VR) device used for flight training, a computer used for virtual games, or a smartphone used for virtual shopping malls, etc. No specific limitations are made here. The operating system of the terminal device 110 can be iOS, Android, Windows, Linux, etc.

[0115] 4. Physics Engine: Used during rendering application runtime to physically simulate the motion, rotation, and collision behavior of at least one 3D model in a virtual scene using object properties (such as velocity, acceleration, momentum, impulse, force, torque, damping, or elasticity). It also simulates the skeletal motion of the 3D model after a collision, obtaining physical simulation results such as the coordinates of points on the 3D model (e.g., characters, animals, plants), the velocity of the points, the acceleration of the points, the angle of the points, and the direction of the points. The physics engine can even simulate complex mechanical devices such as ball joints, wheels, cylinders, or hinges.

[0116] 5. Rendering Engine: This can include at least one of the following pipelines: ray tracing renderer, rasterization rendering pipeline, etc. The rendering engine can render based on the physical simulation results sent by the physics engine to obtain the rendered image. In addition to rendering based on the physical simulation results, the rendering engine can also perform some simple rendering itself, such as rendering the lighting and shadows of virtual scenes, rendering the clothing of characters, etc.

[0117] The collaborative system in this application embodiment is deployed based on a terminal, edge, and cloud model. For example... Figure 2 As shown, the system 200 in the related technology includes: cloud side 201 and terminal side 202. Cloud side 201 is responsible for physical simulation, and terminal side 202 is responsible for physical simulation and rendering. Cloud side 201 and terminal side 202 transmit data through a wide area network.

[0118] The collaborative system 220 provided in this application embodiment includes: a cloud-side 221, an edge-side 222, and a terminal-side 223. The cloud-side 221 is equipped with a physics engine for physics simulation; the edge-side 222 is equipped with both a physics engine and a rendering engine, with the physics engine used for physics simulation and the rendering engine used for rendering; the terminal-side 223 is equipped with a slim client, which is used to exchange screen frames and / or control commands, maintaining data flow communication with the edge-side 222. In other words, physics simulation requires coordination between the cloud-side 221 and the edge-side 222 (synchronizing physical information when necessary) to form a distributed physics engine, while rendering occurs only on the edge-side 222. The following description only uses the example of the cloud-side 221 including cloud computing devices, the edge-side 222 including edge computing devices, and the terminal-side 223 including terminal devices. It should be noted that this application embodiment does not limit the number of cloud computing devices, edge computing devices, or terminal devices.

[0119] In this system, cloud computing devices and edge computing devices transmit data through an internal network (such as a backbone network), while edge computing devices and terminal devices transmit data through an external network (such as a wide area network).

[0120] Optionally, the distance between the edge computing device and the terminal device is less than a distance threshold, meaning the terminal device is relatively close to the edge computing device network.

[0121] Optionally, the entire virtual world can be divided into regions, with the physical engine of each edge computing device used to simulate a portion of the virtual world (the collection of views from the access end), and the rendering engine of each edge computing device used to render the corresponding portion of the virtual world.

[0122] Optionally, when the virtual world of each edge computing device is inconsistent with the entire virtual world of the cloud computing device, the edge computing device is used to synchronize the corresponding virtual world portion on the cloud computing device.

[0123] Optionally, edge computing devices deploy physics and rendering engines on a unified hardware architecture, and upper-layer applications on terminal devices do not depend on physics and rendering engines and do not need to be adapted to different hardware architectures.

[0124] The physical simulation and rendering methods provided in the embodiments of this application will now be described using several exemplary embodiments.

[0125] Please refer to Figure 3 This document illustrates a flowchart of a physical simulation and rendering method provided in an exemplary embodiment of this application. This embodiment uses the method in the aforementioned collaborative system as an example for illustration. The method includes the following steps.

[0126] Step 301: The edge computing device and the cloud computing device perform a collaborative physical simulation to obtain the target physical simulation result. The target physical simulation result indicates the physical information simulated in the target local area of ​​the virtual world after collaboration.

[0127] Optionally, the cloud computing device performs physical simulation to obtain a first physical simulation result, which indicates the physical information simulated in the virtual world; the edge computing device performs physical simulation to obtain a second physical simulation result, which indicates the physical information simulated in the target local area; the edge computing device determines the target physical simulation result based on the comparison between the first physical simulation result and the second physical simulation result.

[0128] Optionally, cloud computing devices can perform physical simulation using their own physical engines to obtain a first physical simulation result, while edge computing devices can perform physical simulation using their own physical engines to obtain a second physical simulation result.

[0129] The first physical simulation result indicates the physical information simulated throughout the entire virtual world, while the second physical simulation result indicates the physical information simulated in a target local region. The target local region is a subset of the entire virtual world, meaning it represents a portion of the virtual world within the entire virtual world. Optionally, the first physical simulation result can be a view of the entire virtual world, and the second physical simulation result can be a view of the target local region.

[0130] Optionally, the edge computing device is connected to at least one terminal device via a wide area network, and the distance between the edge computing device and the connected terminal device is less than a distance threshold.

[0131] Optionally, the target local region is a portion of the virtual world determined by the set of viewpoints of terminal devices connected to the edge computing device.

[0132] Step 302: The edge computing device renders the target local area based on the second physical simulation results to obtain a rendered image.

[0133] Optionally, the edge computing device can render the target local area using its own rendering engine based on the results of the second physical simulation.

[0134] Step 303: The edge computing device sends the rendered image to the terminal device.

[0135] Optionally, the edge computing device sends the rendered image to at least one terminal device connected to the edge computing device. The terminal device then receives and displays the rendered image.

[0136] Optionally, the terminal device receives the rendered image and displays it through its own slim client.

[0137] In summary, by introducing edge computing devices, cloud computing devices and edge computing devices collaborate on physical simulation, with the edge computing devices handling subsequent rendering. That is, the edge computing devices are responsible for both physical simulation and rendering, while the cloud computing devices only handle physical simulation. This achieves a new physical simulation and rendering architecture. On one hand, the cloud side does not need to perform rendering, saving computing power to simulate the entire virtual world. On the other hand, the edge side performs rendering, but the physical simulation only covers a portion of the view. Furthermore, the cloud side and the edge side transmit data through an internal backbone network, ensuring data transmission quality and reducing data transmission latency.

[0138] Please refer to Figure 4 This document illustrates a flowchart of a physical simulation and rendering method provided in another exemplary embodiment of this application. This embodiment uses the method in the aforementioned collaborative system as an example. The method includes the following steps.

[0139] Step 401: The cloud computing device performs physical simulation at first time intervals to obtain a first physical simulation result, which indicates the physical information simulated in the virtual world.

[0140] Optionally, the regional division of the virtual world of the cloud computing device and the edge computing device is determined based on the views of all terminal devices connected to the edge computing device. Optionally, the target local area of ​​the edge computing device is a portion of the virtual world determined by the set of viewpoints of the terminal devices connected to the edge computing device. Illustratively, simulated objects are added to the corresponding virtual world according to their positions to complete the initialization of the virtual world.

[0141] Optionally, after the virtual world is initialized, the cloud computing device performs a physical simulation every first time interval to obtain the first physical simulation result. The first time interval is preset.

[0142] Optionally, the first physical simulation result indicates the physical information simulated in the virtual world, where the physical information is the state of the simulated object in the virtual world. The cloud computing device, through its own physics engine, calculates and updates the state of the simulated object according to configuration parameters and the object's initialization state, following physical laws. For example, the object's initialization state indicates at least one of the simulated object's position, velocity, and forces. For example, the physical law is Newton's second law. For example, the simulated object's state indicates its position and / or velocity. This application's embodiments do not limit this.

[0143] Step 402: The edge computing device performs physical simulation every second time interval to obtain a second physical simulation result, which indicates the physical information simulated in the target local area.

[0144] Optionally, after the virtual world is initialized, the edge computing device performs a physical simulation every second time interval to obtain a second physical simulation result.

[0145] Optionally, the second time interval is preset and differs from the first time interval. Generally speaking, cloud-side simulation of the entire virtual world involves high computational load and low update frequency. The edge side needs to interact with the terminal side, requiring a higher refresh rate to achieve good display results. Terminal-side simulation of a portion of the view involves relatively less computation and can have a higher update frequency. Therefore, the second time interval can be set to be shorter than the first time interval. For example, the first time interval is 0.5s, and the second time interval is 20ms. This application does not limit this specific time interval.

[0146] Optionally, the second physical simulation result indicates the physical information simulated in the target local region, where the physical information is the state of the simulated object in the target local region. The edge computing device calculates and updates the state of the simulated object according to physical laws based on the configuration parameters and the object's initialization state using its own physics engine.

[0147] Step 403: The edge computing device determines the target physical simulation result based on the comparison between the first physical simulation result and the second physical simulation result. The physical information indicated by the target physical simulation result and the first physical simulation result in the target local area is consistent.

[0148] Optionally, the edge computing device acquires first feature information of the target local region in the first physical simulation result and second feature information in the second physical simulation result; if the first feature information and the second feature information are inconsistent, the second physical simulation result is refreshed to obtain the target physical simulation result; if the first feature information and the second feature information are consistent, the second physical simulation result is determined as the target physical simulation result.

[0149] Optionally, for an edge computing device, the cloud computing device determines the first feature information of the target local area of ​​the edge computing device in the first physical simulation result and sends the first feature information to the edge computing device. The edge computing device compares its own second feature information with the first feature information. If they match, no refresh request is needed; if they do not match, the edge computing device requests a refresh of its view from the cloud computing device.

[0150] Optionally, the time progression from the initialization of the virtual world to the time of the cloud-edge collaborative inspection is gradual, with different time intervals (frequency) configured on the cloud and edge sides to advance step by step. For example, if the interval between the initialization of the virtual world and the time of the cloud-edge collaborative inspection is 1 second, the first time interval configured on the cloud side is 0.5 seconds, which requires two iterations; the second time interval configured on the edge side is 20 milliseconds, which requires 50 iterations.

[0151] Optionally, if the first feature information and the second feature information are inconsistent, the edge computing device sends a refresh request to the cloud computing device. The refresh request instructs the cloud computing device to return the object state of the target local area in the first physical simulation result. Based on the returned object state of the target local area, the second physical simulation result is refreshed to obtain the target physical simulation result.

[0152] Schematic, the first feature information is the hash value of the target local region in the first physical simulation result, and the second feature information is the hash value of the target local region in the second physical simulation result. For example, the first feature information includes the MD5 message-digest algorithm value of all object states of the target local region in the first physical simulation result, and the second feature information includes the MD5 value of all object states of the target local region in the second physical simulation result.

[0153] Optionally, the above describes the simulation process of the physical engine in collaboration between the cloud and edge. From the moment of virtual world initialization to the moment of cloud-edge collaboration check and then to the moment of cloud-edge synchronization, the physical engines of cloud computing devices and edge computing devices advance at their respective time intervals (the time intervals for advancing the physical engines of multiple edge computing devices are consistent) and work together periodically.

[0154] Step 404: The edge computing device renders the target local area based on the second physical simulation results to obtain a rendered image.

[0155] Optionally, the edge computing device can render the target local area using its own rendering engine based on the results of the second physical simulation.

[0156] Step 405: The edge computing device sends the rendered image to the terminal device.

[0157] Optionally, the edge computing device sends the rendered image to at least one terminal device connected to the edge computing device via a wide area network.

[0158] Step 406: The terminal device receives and displays the rendered image.

[0159] Correspondingly, the terminal device receives and displays the rendered image. Optionally, the terminal device receives the rendered image and displays it through its own slim client.

[0160] In an illustrative example, such as Figure 5 As shown, the collaborative system includes cloud computing devices, multiple edge computing devices, and multiple terminal devices. The cloud computing devices and edge computing devices transmit data via a backbone network, while the edge computing devices and connected terminal devices transmit data via a wide area network. Physical engines are deployed on the cloud computing devices and multiple edge computing devices respectively, cooperating to form a distributed collaborative physical engine during physical simulation. For ease of explanation, the figure only schematically shows two edge computing devices (referred to as edge 1 and edge 2) and four terminal devices (referred to as terminal 1, terminal 2, terminal 3, and terminal 4). This embodiment does not limit the number of devices. Based on... Figure 5The provided collaborative system, with its cloud-edge collaborative distributed physical engine workflow including but not limited to the following steps:

[0161] At time T0, the system initializes and determines the regional division of the virtual world of the cloud computing device and the edge computing device based on the views of all terminal devices connected to the edge computing device. (Illustrative example, such as...) Figure 6 The view shown Figure 1 Heshi Figure 2 The region is divided. The simulated objects are added to the corresponding virtual world of the physical simulation according to their positions, and the virtual world is initialized. For example, the circle, square and triangle are added to the virtual world of the cloud computing device, the circle and square are added to the virtual world of side 1, and the triangle is added to the virtual world of side 2. The state of all simulated objects is initialized, and the advancement time interval of the cloud computing device and the edge computing device is set, namely the first time interval and the second time interval.

[0162] As time progresses from T0 to T1, the physics engines of the cloud computing device and multiple edge computing devices calculate and update the simulated object's state (such as position, velocity, and forces) according to physical laws, based on their respective configuration parameters and the object's initial state. (Illustrative example follows.) Figure 7 The physical engine of the cloud computing device updated the positions of the circle, square, and triangle; the physical engine of edge 1 updated the positions of the circle and square; and the physical engine of edge 2 updated the position of the triangle. It should be noted that the time progression from time T0 to time T1 is gradual. The cloud computing device and the edge computing device are configured with different time intervals (frequency) for gradual progression. For example, if the interval from time T0 to time T1 is 1 second, the first time interval configured for the cloud computing device is 0.5 seconds, requiring two iterations; the second time interval configured for the edge computing device is 20 milliseconds, requiring 50 iterations.

[0163] At time T1, the cloud computing device generates hash values ​​based on the views of each edge computing device, such as the MD5 values ​​of all simulated object states, and sends them to each edge computing device for verification. Each edge computing device compares its own view's hash value with the cloud view's hash value. If the hash values ​​of the two views match, no refresh request is needed; otherwise, a refresh request is needed from the cloud side. In most cases, the corresponding parts of the edge-side view and the cloud-side view are identical; however, in some cases, inconsistencies may occur. When the hash values ​​of two views are inconsistent, such as... Figure 8 Edge 1 sends a refresh request to the cloud computing device, requesting a refresh of the state of each simulated object in the view. After the refresh is completed, the view of Edge 1... Figure 1 The status is consistent with the corresponding part of the cloud computing device.

[0164] Time continues to advance from time T1 to time T2, as follows: Figure 9The process from time T1 to time T2 is almost identical to the process from time T0 to time T1. The difference is that during the process from time T1 to time T2, the view of edge 1... Figure 1 The square in the middle moves away from and into the view of edge 2 over time. Figure 2 In this process, the physics engine of edge 1 deletes the square and synchronizes its state, such as position, velocity, and force conditions, to the physics engine of edge 2. The physics engine of edge 2 receives the request, processes it, and adds the square back to the view. Figure 2 The square state is initialized, and then the square participates in the physical simulation process of side 2. This action is completed between two frames of the physical simulation process of side 2.

[0165] At time T2, similar to time T1, the cloud computing device needs to verify whether the view state is consistent with that of each edge computing device. If they are inconsistent, the view state needs to be synchronized.

[0166] Taking the process from time T0 to time T1 to time T2 as an example, this paper describes the simulation process of the physical engine for cloud-side and edge-side collaboration. Time T0 is the initialization time, and time T1 and time T2 are the time for cloud-edge collaboration check and synchronization. Between these times, the physical engines of the cloud side and the edge side advance at their respective time intervals (the advance time interval of the physical engines between the edge sides is consistent) and work together periodically.

[0167] In summary, this application provides a cloud-edge collaborative physical simulation and rendering architecture. It addresses the high network latency and poor user experience of cloud gaming and metaverse applications under cloud architecture. Firstly, it achieves cloud-edge physical distributed synchronization: the distributed physical engine, through backbone network transmission, ensures latency, the cloud side calculates the entire virtual world, and the edge side calculates its respective part of the virtual world; when states are inconsistent, automatic synchronization is achieved. Secondly, it enables back-to-back physical simulation and rendering on edge computing devices. On the edge computing device, physical simulation and rendering are performed back-to-back; after the physical world state is updated, rendering can proceed directly to the virtual world, using local memory without data exchange. Thirdly, it implements rendering streams between the edge and the device side. The device side only requires a lean client for exchanging frame rates and control commands, without the need for complex hardware or software; maintaining data flow with the edge side is sufficient.

[0168] It should be noted that the embodiments of this application do not limit the protocols used for collaboration between the distributed physical engine cloud and edge, or between edge devices. For example, synchronization between the cloud and edge, or between edge devices, can be achieved through sockets or peer-to-peer (P2P) networks. The embodiments of this application do not limit the type of terminal device, as long as it can exchange screen frames and control commands. This solution does not require the cloud and edge devices to be based on the same hardware architecture and system.

[0169] The following are embodiments of the apparatus described in this application, which can be used to execute the embodiments of the method described in this application. For details not disclosed in the apparatus embodiments of this application, please refer to the embodiments of the method described in this application.

[0170] Please refer to Figure 10 This diagram illustrates a block diagram of a physical simulation and rendering apparatus provided in an exemplary embodiment of this application. The apparatus can be implemented as all or part of an edge computing device through software, hardware, or a combination of both, transmitting data between the edge computing device and cloud computing devices via an internal backbone network. The apparatus may include: a simulation unit 1010, a rendering unit 1020, and a transmission unit 1030.

[0171] Simulation unit 1010 is used to perform physical simulation in collaboration with cloud computing devices to obtain target physical simulation results, which indicate the physical information simulated in the target local area of ​​the virtual world after collaboration.

[0172] The rendering unit 1020 is used to render the target local area based on the second physical simulation results to obtain a rendered image.

[0173] The sending unit 1030 is used to send the rendered image to the terminal device.

[0174] In one possible implementation, the cloud computing device is used to perform physical simulation at first time intervals to obtain a first physical simulation result, the first physical simulation result indicating the physical information simulated in the virtual world;

[0175] Simulation unit 1010 is also used for:

[0176] A second physical simulation result is obtained by performing a physical simulation every second time interval. The second physical simulation result indicates the physical information simulated in the local area of ​​the target.

[0177] Based on the comparison between the first physical simulation result and the second physical simulation result, the target physical simulation result is determined. The physical information indicated by the target physical simulation result and the first physical simulation result in the target local area is consistent.

[0178] In another possible implementation, simulation unit 1010 is also used for:

[0179] Obtain the first feature information of the target local region in the first physical simulation result and the second feature information in the second physical simulation result;

[0180] If the first feature information and the second feature information are inconsistent, the second physical simulation result is refreshed to obtain the target physical simulation result;

[0181] If the first feature information and the second feature information are consistent, the second physical simulation result is determined as the target physical simulation result.

[0182] In another possible implementation, simulation unit 1010 is also used for:

[0183] If the first feature information and the second feature information are inconsistent, a refresh request is sent to the cloud computing device. The refresh request instructs the cloud computing device to return the object state of the target local area in the first physical simulation result.

[0184] Based on the object state of the returned target local region, the second physical simulation result is refreshed to obtain the target physical simulation result.

[0185] In another possible implementation, the edge computing device and the terminal device are connected via a wide area network, and the distance between the edge computing device and the terminal device is less than a distance threshold.

[0186] In another possible implementation, the target local region is a portion of the virtual world determined by the set of perspectives of terminal devices connected to the edge computing device.

[0187] In another possible implementation, the terminal device is used to receive and display the rendered image.

[0188] It should be noted that the apparatus provided in the above embodiments is only illustrated by the division of the above functional modules when implementing its functions. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0189] Please refer to Figure 11 This illustration shows a block diagram of a physical simulation and rendering apparatus provided in another exemplary embodiment of this application. The apparatus can be implemented as all or part of a collaborative system via software, hardware, or a combination of both. The collaborative system includes cloud computing devices and edge computing devices, with the edge computing devices transmitting data to the cloud computing devices via an internal backbone network. The apparatus may include a cloud computing device 1110 and an edge computing device 1120, with the edge computing device 1120 transmitting data to the cloud computing device 1110 via an internal backbone network.

[0190] The cloud computing device 1110 and the edge computing device 1120 are used to perform collaborative physical simulation to obtain target physical simulation results, which indicate the physical information simulated in the target local area of ​​the virtual world after collaboration.

[0191] The edge computing device 1120 is also used to render a rendered image of the target local area based on the results of the second physical simulation;

[0192] The edge computing device 1120 is also used to send rendered images to terminal devices.

[0193] In one possible implementation,

[0194] The cloud computing device 1110 is also used to perform physical simulation at every first time interval to obtain a first physical simulation result, the first physical simulation result indicating the physical information simulated in the virtual world;

[0195] The edge computing device 1120 is also used to perform physical simulation every second time interval to obtain a second physical simulation result, the second physical simulation result indicating the physical information simulated in the target local area;

[0196] The edge computing device 1120 is also used to determine a target physical simulation result based on a comparison between a first physical simulation result and a second physical simulation result, wherein the physical information indicated by the target physical simulation result and the first physical simulation result on a target local region is consistent.

[0197] In another possible implementation, the edge computing device 1120 is also used for:

[0198] Obtain the first feature information of the target local region in the first physical simulation result and the second feature information in the second physical simulation result;

[0199] If the first feature information and the second feature information are inconsistent, the second physical simulation result is refreshed to obtain the target physical simulation result;

[0200] If the first feature information and the second feature information are consistent, the second physical simulation result is determined as the target physical simulation result.

[0201] In another possible implementation, the edge computing device 1120 is also used for:

[0202] If the first feature information and the second feature information are inconsistent, a refresh request is sent to the cloud computing device 1110. The refresh request instructs the cloud computing device 1110 to return the object state of the target local area in the first physical simulation result.

[0203] Based on the object state of the returned target local region, the second physical simulation result is refreshed to obtain the target physical simulation result.

[0204] In another possible implementation, the edge computing device 1120 is connected to the terminal device via a wide area network, and the distance between the edge computing device 1120 and the terminal device is less than a distance threshold.

[0205] In another possible implementation, the target local region is a portion of the virtual world determined by the set of viewpoints of the terminal devices connected to the edge computing device 1120.

[0206] In another possible implementation, the terminal device is used to receive and display the rendered image.

[0207] It should be noted that the apparatus provided in the above embodiments is only illustrated by the division of the above functional modules when implementing its functions. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0208] Embodiments of this application provide a physics simulation and rendering apparatus, the apparatus comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the above-described method when executing instructions.

[0209] Embodiments of this application provide a computing device cluster, including at least one computing device, each computing device including a processor and a memory; the processor of the at least one computing device is used to execute instructions stored in the memory of the at least one computing device, so that the computing device cluster performs the method described above.

[0210] Embodiments of this application provide a computer program product containing instructions that, when executed by a cluster of computing devices, cause the cluster of computing devices to perform the method described above.

[0211] Embodiments of this application provide a computer-readable storage medium including computer program instructions, which, when executed by a cluster of computing devices, perform the method described above.

[0212] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), electrically programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), compact disc read-only memory (CD-ROM), digital video disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination of the foregoing.

[0213] The computer-readable program instructions or code described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0214] The computer program instructions used to perform the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as "C" or similar languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are personalized by utilizing state information from computer-readable program instructions. These electronic circuits can execute computer-readable program instructions to implement various aspects of this application.

[0215] Various aspects of this application are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0216] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0217] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0218] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of apparatus, systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved.

[0219] It should also be noted that each block in the block diagram and / or flowchart, as well as combinations of blocks in the block diagram and / or flowchart, can be implemented using hardware (such as circuits or ASICs (Application Specific Integrated Circuits)) that performs the corresponding function or action, or using a combination of hardware and software, such as firmware.

[0220] Although this application has been described herein in conjunction with various embodiments, those skilled in the art, by reviewing the accompanying drawings, disclosure, and appended claims, will understand and implement other variations of the disclosed embodiments in carrying out the claimed application. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude multiple instances. A single processor or other unit can implement several functions listed in the claims. While different dependent claims may recite certain measures, this does not mean that these measures cannot be combined to produce good results.

[0221] The various embodiments of this application have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or improvement of the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A physical simulation and rendering method, characterized in that, Used in edge computing devices, where the edge computing devices and cloud computing devices transmit data via an internal backbone network, the method includes: The physical simulation performed in collaboration with the cloud computing device yields a target physical simulation result, which indicates the physical information simulated in a target local area of ​​the virtual world after collaboration. The rendering of the target local region is obtained by rendering based on the second physical simulation result, and the second physical simulation result is the target physical simulation result after being combined. The rendered image is sent to the terminal device; The cloud computing device is used to perform physical simulation at each first time interval to obtain a first physical simulation result, the first physical simulation result indicating the physical information simulated in the virtual world; The physical simulation conducted in collaboration with the cloud computing device yields the target physical simulation results, including: A second physical simulation result is obtained by performing a physical simulation every second time interval, and the second physical simulation result indicates the physical information simulated in the target local area; Based on the comparison between the first physical simulation result and the second physical simulation result, the target physical simulation result is determined, wherein the target physical simulation result is consistent with the physical information indicated by the first physical simulation result on the target local region; Determining the target physical simulation result based on the comparison between the first physical simulation result and the second physical simulation result includes: Obtain the first feature information of the target local region in the first physical simulation result and the second feature information in the second physical simulation result; If the first feature information and the second feature information are inconsistent, the second physical simulation result is refreshed to obtain the target physical simulation result; If the first feature information and the second feature information are consistent, the second physical simulation result is determined as the target physical simulation result.

2. The method according to claim 1, characterized in that, The step of refreshing the second physical simulation result to obtain the target physical simulation result when the first feature information and the second feature information are inconsistent includes: If the first feature information and the second feature information are inconsistent, a refresh request is sent to the cloud computing device, and the refresh request instructs the cloud computing device to return the object state of the target local area in the first physical simulation result. Based on the returned object state of the target local region, the second physical simulation result is refreshed to obtain the target physical simulation result.

3. The method according to claim 1 or 2, characterized in that, The edge computing device and the terminal device are connected via a wide area network, and the distance between the edge computing device and the terminal device is less than a distance threshold.

4. The method according to claim 1 or 2, characterized in that, The target local area is a portion of the virtual world determined by the set of perspectives of the terminal devices connected to the edge computing device.

5. The method according to claim 1 or 2, characterized in that, The terminal device is used to receive and display the rendered image.

6. A physical simulation and rendering method, characterized in that, For use in a collaborative system, the collaborative system including cloud computing devices and edge computing devices, the edge computing devices and the cloud computing devices transmitting data through an internal backbone network, the method includes: The edge computing device and the cloud computing device perform collaborative physical simulation to obtain target physical simulation results, and the target physical simulation results indicate the physical information simulated in the target local area of ​​the virtual world after collaboration. The edge computing device renders the target local region based on the second physical simulation result, and the second physical simulation result is the target physical simulation result after being combined. The edge computing device sends the rendered image to the terminal device; The edge computing device and the cloud computing device perform collaborative physical simulation to obtain the target physical simulation results, including: The cloud computing device performs physical simulation at a first time interval to obtain a first physical simulation result, and the first physical simulation result indicates the physical information simulated in the virtual world; The edge computing device performs physical simulation every second time interval to obtain a second physical simulation result, the second physical simulation result indicating the physical information simulated in the target local area; The edge computing device determines the target physical simulation result based on the comparison between the first physical simulation result and the second physical simulation result, wherein the target physical simulation result is consistent with the physical information indicated by the first physical simulation result on the target local area; The edge computing device determines the target physical simulation result based on a comparison between the first physical simulation result and the second physical simulation result, including: Obtain the first feature information of the target local region in the first physical simulation result and the second feature information in the second physical simulation result; If the first feature information and the second feature information are inconsistent, the second physical simulation result is refreshed to obtain the target physical simulation result; If the first feature information and the second feature information are consistent, the second physical simulation result is determined as the target physical simulation result.

7. A physical simulation and rendering apparatus, characterized in that, For use in edge computing devices, where the edge computing device and cloud computing device transmit data via an internal backbone network, the device includes: The simulation unit is used to perform physical simulation in collaboration with the cloud computing device to obtain target physical simulation results, wherein the target physical simulation results indicate the physical information simulated in a target local area of ​​the virtual world after collaboration. A rendering unit is used to render a rendered image of the target local region based on the second physical simulation result, wherein the second physical simulation result is the target physical simulation result after being combined. A sending unit is used to send the rendered image to a terminal device; The cloud computing device is used to perform physical simulation at each first time interval to obtain a first physical simulation result, the first physical simulation result indicating the physical information simulated in the virtual world; The simulation unit is also used for: A second physical simulation result is obtained by performing a physical simulation every second time interval, and the second physical simulation result indicates the physical information simulated in the target local area; Based on the comparison between the first physical simulation result and the second physical simulation result, the target physical simulation result is determined, wherein the target physical simulation result is consistent with the physical information indicated by the first physical simulation result on the target local region; The edge computing device determines the target physical simulation result based on a comparison between the first physical simulation result and the second physical simulation result, including: Obtain the first feature information of the target local region in the first physical simulation result and the second feature information in the second physical simulation result; If the first feature information and the second feature information are inconsistent, the second physical simulation result is refreshed to obtain the target physical simulation result; If the first feature information and the second feature information are consistent, the second physical simulation result is determined as the target physical simulation result.

8. A physical simulation and rendering apparatus, characterized in that, For use in a collaborative system, the collaborative system includes cloud computing devices and edge computing devices, the edge computing devices and the cloud computing devices transmit data through an internal backbone network, the device includes: The cloud computing device and the edge computing device are used to perform collaborative physical simulation to obtain target physical simulation results, wherein the target physical simulation results indicate the physical information simulated in a target local area of ​​the virtual world after collaboration. The edge computing device is further configured to render a rendered image of the target local region based on the second physical simulation result, wherein the second physical simulation result is the target physical simulation result after being combined. The edge computing device is also used to send the rendered image to the terminal device; The cloud computing device is also used to perform physical simulation at every first time interval to obtain a first physical simulation result, wherein the first physical simulation result indicates the physical information simulated in the virtual world; The edge computing device is also used to perform physical simulation every second time interval to obtain a second physical simulation result, the second physical simulation result indicating the physical information simulated in the target local area; The edge computing device is further configured to determine the target physical simulation result based on a comparison between the first physical simulation result and the second physical simulation result, wherein the target physical simulation result is consistent with the physical information indicated by the first physical simulation result on the target local region; The edge computing device is also used for: Obtain the first feature information of the target local region in the first physical simulation result and the second feature information in the second physical simulation result; If the first feature information and the second feature information are inconsistent, the second physical simulation result is refreshed to obtain the target physical simulation result; If the first feature information and the second feature information are consistent, the second physical simulation result is determined as the target physical simulation result.

9. A physical simulation and rendering apparatus, characterized in that, The device includes: processor; Memory used to store processor-executable instructions; The processor is configured to implement the method of any one of claims 1-5, or the method of claim 6, when executing the instructions.

10. A computing device cluster, characterized in that, It includes at least one computing device, each computing device including a processor and memory; The processor of the at least one computing device is configured to execute instructions stored in the memory of the at least one computing device to cause the cluster of computing devices to perform the method as described in any one of claims 1-5, or the method as described in claim 6.

11. A computer program product containing instructions, characterized in that, When the instruction is executed by the computing device cluster, the computing device cluster performs the method as described in any one of claims 1-5, or the method as described in claim 6.

12. A computer-readable storage medium, characterized in that, It includes computer program instructions, which, when executed by a cluster of computing devices, perform the method as described in claims 1-5, or the method as described in claim 6.

Images