143 results about "Cloud rendering" patented technology

The invention provides a large-scale scene multi-level-of-detail cloud rendering processing method and device based on 3DGS, and relates to the technical field of three-dimensional modeling, and the method comprises the steps: dividing a target modeling scene into a plurality of sub-blocks; performing particle redundancy reconstruction and overlapping region marking on boundary regions between adjacent sub-blocks of each sub-block to obtain processed sub-blocks; performing multi-detail level division on each processing sub-block to generate a particle level set; determining a current visual area according to the user motion data, and scheduling a target hierarchy of a particle hierarchy set in the current visual area; the rendering tasks of all the processing sub-blocks of the target hierarchy are distributed to a plurality of rendering nodes to execute real-time rendering operation; and performing video stream coding on pictures rendered by each rendering node, decoding and displaying received video stream data, and performing particle level updating and re-rendering operation according to an interaction instruction. According to the invention, high-quality detail rendering can be realized for a model of a large scene.

The invention relates to a high-fidelity cloud rendering cluster scheduling method and system, and the method comprises the steps: receiving a rendering task, generating a multi-level priority queue according to the task complexity, timeliness and resource demand classification, and automatically optimizing a scheduling strategy; monitoring the resource state of the heterogeneous computing node in real time; allocating tasks by using preemptive and round-robin scheduling strategies, and adjusting and coping with resource fluctuation in combination with a dynamic code rate; the tasks are decomposed by adopting a spatial blocking and time framing strategy, and an execution sequence is controlled according to a topological sorting algorithm; abnormal nodes are identified through heartbeat detection, and affected subtasks are migrated through incremental task updating. According to the method, efficient resource allocation, scheduling algorithm and idle key frame scheme can be realized, the GPU directly outputs the video stream, the rendering speed is remarkably improved, resource waste and operation cost are reduced through a dynamic resource allocation mechanism, a fault-tolerant mechanism is provided, the task is ensured to be normally completed under the condition of node fault, and the task efficiency is improved. And distributed rendering and synthesis of large-scale high-resolution images are supported.

The invention relates to the technical field of computer systems and human-computer interaction, in particular to a text travel element universe virtual role collaboration system and method based on large-space interaction. The method specifically comprises the following steps: tracking a user spatial position in real time through a multi-source positioning technology, and carrying out identity authentication and equipment legality verification by fusing multi-modal features; constructing a virtual-real fused semantic point cloud structural body, binding role interaction nodes, dynamically generating a task collaboration graph by using a graph neural network, and driving multiple roles to collaboratively execute subtasks; calling a graph attention network and a GPT module to deduce personalized plot branches in combination with user multi-modal input and a historical track, and rendering an immersive interactive scene in real time; spatial preferences and content interests are mined by adopting DBSCAN clustering and depth feature coding, a dynamic portrait is constructed, and a task path and content presentation are optimized through a weighted recommendation algorithm. According to the method, cloud rendering, edge calculation and cross-module cooperative control are integrated, and the interactivity and immersion experience of the text travel element universe are remarkably improved.

The invention discloses a volume cloud rendering method and system based on three-dimensional Gaussian splash, and the method comprises the steps: carrying out the feature matching and structure reconstruction of a volume cloud image through an SfM algorithm, obtaining a sparse point cloud in a scene, and representing the sparse point cloud as an anisotropic Gaussian ellipsoid; decomposing the illumination transmission process of the volume cloud into two parts of forward single scattering and internal multiple scattering based on a radiation transmission equation to obtain an illumination modeling formula embedded volume cloud rendering process; determining the contribution of each three-dimensional Gaussian ellipsoid to a rendering result according to the opacity index of the three-dimensional Gaussian ellipsoid, and dynamically cutting the low-contribution three-dimensional Gaussian ellipsoid by adopting a delay deletion strategy to reduce redundancy; a comprehensive loss function is constructed, so that the three-dimensional Gaussian model is focused on the volume cloud region and the structure detail reduction capability is enhanced; and outputting the optimized volume cloud rendering result and the three-dimensional Gaussian model. According to the method, the volume cloud rendering efficiency and quality are effectively improved on the premise of ensuring real-time rendering.

The invention provides a spatial path visualization method and device for coupling a place name label and a Voronoi diagram, and relates to the technical field of geographic information visualization, and the method comprises the steps: carrying out the preprocessing of obtained initial path data, and generating a path point sequence; obtaining a point-of-interest score corresponding to the specific type parameter of each city in the path point sequence, and determining a first display space corresponding to each city based on the sum of the point-of-interest scores, determining a second display space corresponding to the specific type parameters of each type in the first display space based on the interest point scores of the specific type parameters of different types in each city; and performing word cloud rendering on the second display space to generate a visual path parameter display diagram. According to the method, the spatial region is hierarchically divided through the weighted Voronoi graph, and the sub-regions are filled with the corresponding POI word cloud information, so that the path visualization has higher information bearing capacity and a more intuitive semantic expression effect.

The invention discloses a lightweight transmission and loading optimization method for cloud rendering of a high-precision three-dimensional model, belongs to the technical field of network transmission, and aims to solve the problems of large data volume, high transmission delay and slow loading of cloud rendering of the high-precision three-dimensional model. Carrying out importance evaluation on the rendering primitives, constructing a feature matrix and a weight vector, and determining important data points through matrix multiplication; important data points are subjected to lightweight coding and preferential transmission, and non-important data points are subjected to high-strength compression or delayed transmission. At the client side, client importance re-evaluation is carried out on received rendering data blocks, a client feature matrix and a weight vector are constructed, high-priority loading data are determined through matrix multiplication, and decoding, loading and rendering are preferentially carried out. According to the invention, lightweight transmission and rapid loading of the high-precision three-dimensional model are realized, and the user experience and the resource utilization efficiency are remarkably improved.

The invention provides a virtual digital human interaction method and system based on digital twinning, and the method comprises the steps: S1, obtaining an operation instruction of a digital human, carrying out the preprocessing of the obtained operation instruction of the digital human, and obtaining a processed operation instruction of the digital human; s2, triggering a cloud rendering configurator to complete interaction between the digital human and the digital twin system based on the processed digital human operation instruction, and updating the real-time state of the digital twin system; and S3, encoding the updated real-time state of the digital twin system into a pixel stream video, and transmitting the pixel stream video to a client to realize real-time state synchronization of the digital twin system.

The application provides a Windows three-dimensional cloud rendering system, method and device, relates to the technical field of cloud computing, and the system comprises a model data acquisition unit which judges whether a corresponding historical rendering model is stored in a cloud server; three-dimensional model data to be rendered and rendering parameters corresponding to the three-dimensional model data are acquired according to a judgment result; a load balancing unit dynamically distributes according to the node state of a service node, and distributes rendering tasks to a plurality of rendering nodes; a task scheduling unit constructs a cloud rendering node cluster according to all the rendering nodes; rendering tools are deployed according to the cloud rendering node cluster, and local resources are called; and a rendering unit utilizes the rendering tools and the local resources to perform rendering according to the rendering parameters. The application performs task acquisition, load balancing, resource scheduling and rendering execution through various units, enhances the reliability and scalability of the system, and improves the cloud rendering efficiency of Windows.

The invention discloses a cross-platform three-dimensional rendering task allocation co-processing system and method.In the system, a cloud rendering task scheduling module constructs a rendering time consumption prediction model of a rendering task based on triangle throughput rate calibration and video memory bandwidth calibration, and predicts the rendering duration during local rendering; and a cloud rendering task is scheduled based on a frame-level preemptive formula. According to the method, a dynamic unloading strategy is adopted, load balancing between the rendering task of the mobile equipment and the rendering task of the edge node can be realized, the load pressure of the local rendering task is reduced, and the computing power of the edge node is saved to a certain extent; according to the method, a three-order assembly line and frame-level preemptive scheduling mode is adopted, so that the delay between ends is effectively reduced; and under the condition of network jitter, dynamic screening of cloud rendering tasks is realized, local rendering is taken as a main part, and the influence of delay fluctuation is reduced.

The invention discloses a digital twin modeling and dynamic visualization method based on multi-source heterogeneous data fusion, which comprises the following steps: firstly, constructing a multi-source data access engine, and standardly integrating heterogeneous data such as GIS, IoT, BIM, video monitoring and the like; secondly, realizing rapid three-dimensional modeling by adopting aerial photography of an unmanned aerial vehicle and an AI algorithm, and optimizing rendering performance in combination with an LOD technology; and finally, dynamic visualization and interaction are realized through a spatio-temporal data engine and a cloud rendering technology. According to the method, the problems of scenic spot data islands, low modeling efficiency and large-scale scene rendering lagging are solved, the real-time performance and decision-making efficiency of scenic spot management are remarkably improved, and total-factor scene support is provided for smart tourism.

The invention discloses a middleware-based cloud rendering method and a middleware system, and relates to the technical field of cloud rendering, and the middleware-based cloud rendering method comprises the following steps: creating an application instance, loading the application instance to a cloud rendering platform system, and starting a three-dimensional rendering task; a three-dimensional rendering task is scheduled and allocated through a resource management and scheduling module of the cloud rendering platform system according to the resource use conditions of the load and the server; receiving a three-dimensional rendering task through middleware, and transmitting three-dimensional rendering data of the three-dimensional rendering task between a client and a Web server through a two-way communication module of the cloud rendering platform system to realize real-time communication; and under the condition that the three-dimensional rendering task is finished, waiting for a next rendering task instruction. According to the method, the resource management and operation and maintenance process in the containerized environment can be effectively optimized, and the expandability, stability and usability of the system are improved.

The invention provides an end-cloud unified three-dimensional rendering interface framework, belongs to the technical field of computer graphic rendering, and solves the problems that end rendering and cloud rendering interfaces are not unified and development and maintenance are complex in the prior art by compiling a unified development framework. According to the framework, by introducing a layered framework comprising a unified rendering API, a rendering mode adaptation layer and a rendering execution layer, abstract packaging of bottom layer rendering technologies (such as WebGL / WebGPU, game engine pixel flow and the like) is achieved. According to the method, an application program is allowed to be intelligently and transparently switched between an end rendering mode and a cloud rendering mode through the same API according to conditions such as equipment performance and network conditions. According to the method, the development complexity of cross-platform three-dimensional application can be remarkably simplified, the terminal or cloud computing power is fully utilized to optimize the rendering performance, the consistent experience on different devices is ensured, and the method is particularly suitable for the fields of smart cities, digital twinning, universal three-dimensional visualization and the like.

The invention relates to the technical field of mobile phone end cloud rendering display, and discloses a mobile phone end simulation scene interactive display method based on cloud rendering. The method comprises the following steps: collecting user interaction data, equipment state information and network environment parameters of a mobile phone end, and generating an interaction state monitoring value through validity verification, noise filtering and multi-source integration; extracting a rendering engine configuration parameter based on the monitoring value, and selecting a resolution and detail level balance point through an optimization algorithm to obtain a rendering parameter optimization value; in combination with real-time network delay and equipment electric quantity, a rendering strategy is adjusted according to the optimization value, and an environment response adjustment value is generated; setting a frame rate and an image quality threshold and dynamically applying the frame rate and the image quality threshold to obtain a display threshold set value; capturing a user behavior mode and scene complexity change, analyzing a prediction demand through a time sequence, and generating a scene demand prediction value; and comparing the actual rendering output with the predicted value, calculating an error, feeding back and controlling a rendering process, and outputting an optimized interactive display result.

The invention discloses a computer system for digital human rendering, local equipment and cloud equipment, and belongs to the field of digital human. The computer system comprises local equipment and cloud equipment, and the computer system supports a local rendering mode and a cloud rendering mode. The local equipment is used for sending input information to the cloud equipment; the cloud equipment is used for generating rendering related information according to the input information; in the local rendering mode, the cloud device is used for sending rendering related information to the local device, and the local device is used for obtaining video stream data of the digital human through rendering according to the rendering related information; and in the cloud rendering mode, the cloud device is used for rendering according to the rendering related information to obtain the video stream data of the digital person, and the local device is used for receiving the video stream data of the digital person. The computer system supports two rendering modes, rendering is performed by the local device in the local rendering mode, and rendering is performed by the cloud device in the cloud rendering mode, so that service requirements in different scenes are met.

The invention relates to the technical field of digital human synthesis, in particular to a digital human synthesis system based on an interactive multimedia editing and cloud rendering technology, which comprises a multi-mode interactive editing front end, and the multi-mode interactive editing front end is coupled with a distributed action synthesis engine. The distributed action synthesis engine is coupled with an elastic cloud rendering cluster, and the elastic cloud rendering cluster is coupled with an intelligent synchronous controller. According to the digital human synthesis system based on the interactive multimedia editing and cloud rendering technology, through triple innovation of algorithm-architecture-theory, the end-to-end delay is less than 80ms under film and television level image quality, and a performance benchmark is established for next-generation digital human application; the problem that in the actual use process of a digital man-machine synthesis system in the prior art, when a GPU conducts path tracking under the 4K resolution, the single-frame rendering time exceeds 500 ms, and the 100 ms threshold value of real-time interaction cannot be met is solved.

Systems and methods are disclosed herein for inserting supplemental content into cloud-rendered media content, such as video game cutscenes. The media content is rendered and encoded for streaming to a client device. Data related to a current session associated with the client device is retrieved. Based on the retrieved session data, a supplemental content item is identified for insertion into the streaming media content. If an insertion point is detected within the streaming media content, the supplemental content item is streamed to the client device in place of the streaming media content. Once streaming of the supplemental content item has ended, either at the end of the supplemental content item or in response to a request from the client device to skip the supplemental content item, streaming of the streaming media content is resumed.

The invention discloses a cloud rendering method and system for space computing and terminal equipment, and belongs to the technical field of cloud computing and virtual / augmented reality. The method aims at solving the technical problems that an existing space computing device cannot run severe applications due to limitation of local computing power, power consumption and heat dissipation, and application ecology is separated from a traditional two-dimensional desktop. The method comprises the following steps: operating an operating system environment capable of bearing two-dimensional and three-dimensional applications on a cloud server, performing real-time synthesis and rendering on the output of each application in a three-dimensional virtual space, and updating a scene according to user interaction data received from terminal equipment, and the generated three-dimensional scene is transmitted to terminal equipment in a streaming manner by adopting an optimized coding technology. The method has the beneficial effects that a core computing task is arranged at the cloud end, so that a user can obtain top-level workstation performance through light-weight terminal equipment, various professional applications can be seamlessly operated, persistence and cross-equipment roaming of a working space are realized, and the productivity value of space computing is greatly improved.

The present disclosure provides a digital conference interaction method, device, system and related device, comprising: accessing a conference system through a webpage end by a user terminal, and sending user data to an edge node; analyzing user semantics and intention based on the user data by the edge node, and requesting a rendering flow of public semantics from a cloud server; requesting three-dimensional model data corresponding to the user from a cloud storage based on information saved by a public semantic library of the cloud server, constructing a public semantic scene and cloud rendering by the cloud server; returning the cloud rendering flow to the edge node; constructing a private semantic library based on the user data by the edge node, requesting data from the cloud storage, constructing a private semantic scene and edge rendering; rendering and synthesizing the cloud rendering flow and the edge rendering flow; and returning the synthesized flow to the user terminal, so that the user terminal receives a conference scene and a picture of a user digital person in real time on the webpage end, the picture including real-time expressions, actions, position states of the digital person.

The invention discloses a cloud rendering method and device based on a shared cache, equipment and a medium. Receiving a target scene identifier and a target scene view angle pose sent by the target terminal; loading a target scene model file according to the target scene identifier, and converting the target scene model file into a data structure object; loading a target radiance hash table corresponding to the target scene identifier from a public storage server; based on the target scene view angle pose and the target detection light, determining a patch intersection point set having a collision intersection point with patch data in the data structure object; and based on the target radiance hash table, determining a target radiance corresponding to each patch intersection point in the patch intersection point set, calculating a pixel color value of the corresponding patch intersection point in the patch intersection point set according to each target radiance, obtaining a target scene view angle image, and sending the target scene view angle image to a target terminal for display. Therefore, the data calculation amount of cloud rendering is reduced, and the cloud rendering efficiency in a multi-user scene is improved.

This application provides a data processing method, system, and electronic device. The method includes: before the encoder encodes an image rendered by a graphics processor, the graphics processor acquires rendering information related to the rendered image, then compresses and transmits the compressed rendering information; subsequently, during the encoder's encoding of the rendered image, it can perform encoding optimization based on the compressed rendering information. This reduces the amount of rendering information, thereby reducing the transmission latency of the rendering information. Furthermore, the encoder performs encoding only after receiving the rendering information; therefore, this application can reduce the encoder's waiting time for encoding, thereby reducing the overall transmission latency of the cloud rendering process.

The invention relates to the technical field of illegal building identification, and discloses a cloud rendering-based high-altitude protruding illegal building identification monitoring method and system, and the method comprises the steps: generating a building dense point cloud model of a target building, and carrying out the meshing of the model; generating a building facade view of the three-dimensional building model, and extracting material features and structural features of any building facade in the building facade view; constructing a building illegal building identification model to carry out illegal building identification and illegal building marking on the building facade to obtain an illegal building facade; and performing dynamic area growth and segmentation processing on the facade of the illegal building by adopting a dynamic growth algorithm to form an illegal building area, and generating and recording a positioning coordinate of the illegal building area and an illegal building type. According to the method, the three-dimensional building model is generated based on the multi-angle RGB-D data, the facade material and structure features are extracted, automatic identification, positioning and classification of high-altitude protruding illegal buildings are realized through illegal building identification and a dynamic segmentation algorithm, and the monitoring precision and the automation level are improved.

The application discloses an AI-driven cloud rendering service fault rapid positioning method, relates to the technical field of service fault positioning, and is used for solving the problems of low efficiency and large resource waste of rendering retry behavior, acquiring a cloud rendering operation target, performing regional division, collecting the resolution and artifact area of each region, comprehensively calculating the cloud rendering fault indexes of the regions, evaluating fault region positioning features based on the fault indexes and storing the fault region positioning features in a temporary database, setting multiple rendering retries within a retry time, counting retry fault frequencies, detecting the rendering execution time of each time and calculating rendering levels, evaluating fault type positioning features in combination with the retry fault frequencies and the rendering levels, fusing the fault region positioning features in the temporary database, selecting an adaptive fault region or type positioning method for processing, intelligently analyzing multidimensional fault features, realizing rapid and accurate positioning of cloud rendering faults, and improving service stability and operation and maintenance efficiency.

This invention discloses a collaborative cloud rendering system, including a lighting and shadow rendering module. The module's direct lighting rendering unit performs rendering through direct lighting calculations, the shadow rendering unit performs rendering through shadow calculations, the ambient occlusion rendering unit performs rendering through ambient occlusion calculations, and the indirect lighting rendering unit performs rendering through indirect lighting calculations. The indirect lighting rendering unit runs on a cloud backend device. A hybrid rendering unit performs rendering through hybrid calculations and runs on a web frontend device. Depending on the performance of the web frontend device, each unit runs on either the web frontend device or the cloud backend device. Therefore, this invention proposes four key real-time lighting and shadow rendering algorithms for collaborative real-time dynamic lighting and shadow rendering in Web3D cloud rendering, optimized through analysis of various data such as algorithm frame rate, the operating efficiency of the device running the algorithm, and the lighting and shadow rendering results.

The invention relates to the field of augmented reality, and discloses a cross-terminal collaborative socialized AR interaction method and system, and the method comprises the following steps: S1, building connection between a plurality of user terminals and a cloud rendering server, and forming an interaction group; s2, the user terminals upload positions, postures and operation instructions in real time, and the cloud rendering server dynamically updates AR views of other user terminals in the group; s3, the cloud rendering server synchronizes AR scene data and aligns AR views of all the user terminals; s4, the cloud rendering server triggers and coordinates a cooperative task according to the user terminal data; the system comprises a multi-terminal cooperation module, a cooperation task engine module and an AI interaction module. According to the invention, by introducing a multi-terminal cooperation mechanism and an innovative cooperation task design, the fundamental transformation of AR navigation from single-person information reception to multi-person sharing exploration is realized, and the interactive experience and cooperation fun between users are improved.

The application discloses a bad frame detection method for rendering sequence frames. By utilizing an SSIM algorithm and an image prediction technology, a set of sequence frame bad frame detection system is built on a cloud rendering platform, so that the bad frames in output can be detected in time, the rendering system is informed in time, the system reminds the user in time or automatically re-renders the bad frames, and therefore, the efficiency of the rendering platform is effectively improved, and the time of the user is greatly saved.

The application discloses a cloud rendering platform integrated picture super-resolution reconstruction method, which first trains a middleware for performing super-resolution reconstruction, and integrates the middleware to a deployment of a cloud rendering platform on a graphics card machine hardware; when a super-resolution lossless magnification task needs to be performed, the cloud rendering platform performs logical processing, calls an API interface of the middleware, the middleware requests to access a picture storage address of an original task, performs AI magnification processing after obtaining a low-resolution picture, and finally outputs a generated equal-proportion high-definition magnified rendering product picture to the cloud rendering platform. The application can generate an equal-proportion high-definition magnified rendering product picture in the cloud by integrating the picture super-resolution reconstruction technology on the cloud rendering platform. The generated equal-proportion high-definition magnified rendering product picture meets the demand of users for high-quality images, improves user experience, and reduces rendering cost.

The invention discloses a cloud rendering method, device and equipment for an aircraft component and a medium, which are applied to the field of image processing, and the method comprises the following steps: obtaining a rendering request of a client, the rendering request comprising an interactive operation for a to-be-rendered aircraft component; determining a to-be-rendered aircraft component and corresponding control information according to the rendering request; according to the control information, a target rendering model is determined from candidate rendering models of the to-be-rendered aircraft component, and the candidate rendering models represent at least two groups of rendering data with different rendering data volumes of the to-be-rendered aircraft component; and rendering the to-be-rendered aircraft component based on the target rendering model to generate a rendered video frame, and sending the rendered video frame to the client. According to the technical scheme provided by the invention, the rendering efficiency of the aircraft component can be improved, the rendering time is shortened, and meanwhile, the accuracy of the aircraft component rendered by the cloud is ensured.

The invention provides a road condition rendering method, system and device and a program product, and the method comprises the steps: loading a three-dimensional road model which is preset with spatial geometric information of a plurality of road regions and a mapping relation between each vertex in the three-dimensional road model and a UV coordinate; acquiring road condition updating data in real time, wherein the road condition updating data comprises real-time road condition information of the plurality of road areas; generating a road condition UV map based on the road condition update data, wherein the display texture of the road condition UV map is used for representing the real-time road condition information of the plurality of road areas; and mapping the road condition UV map to the surface of the three-dimensional road model based on the UV coordinate of each pixel point in the road condition UV map and the mapping relationship between each vertex and the UV coordinate in the three-dimensional road model, and generating a three-dimensional rendering model with real-time road condition information. According to the method, cloud rendering of the server side and rendering of the client side are decoupled, the model does not need to be reloaded, the road condition rendering efficiency is improved, and the road condition rendering cost is reduced.

The application provides a building design software and cloud rendering platform synchronization method and system, and relates to the technical field of building information modeling. The method comprises the following steps: format conversion, converting the model in the building design software; data uploading, uploading the model data after format conversion to the cloud rendering platform; data display, displaying the model rendering effect after format conversion; data synchronization, synchronizing the modification operation of the user to the engine of the cloud rendering platform. The method and system provided by the application do not require the user to export and re-import the model file. After the user starts the cloud rendering platform, the user can directly return to the building design software to modify the model. Only the command defined by the plug-in needs to be triggered, and the plug-in will synchronize the user's operation to the cloud rendering engine, so that the user can see the rendered model in the browser, the display is seamlessly connected, the work efficiency is improved, and the design output effect is better.

The application discloses a method for optimizing shadow precomputation based on light source clustering technology, which comprises the following steps: firstly, uploading a scene file; secondly, analyzing light source properties; thirdly, setting rendering parameters and submitting the scene file and the rendering parameters to a cloud rendering system; fourthly, clustering light sources through script processing of node machines of the cloud rendering farm, and then identifying key light sources; fifthly, allocating machine resources and precomputing allocation; sixthly, generating a map after power allocation; seventhly, synthesizing shadows; eighthly, dynamically adjusting; ninthly, performing rendering; and tenthly, generating and outputting a rendering output image. The application not only improves rendering efficiency and shadow quality, but also provides an efficient, simple and reliable offline rendering solution for users through intelligent management and optimization.