137 results about "Screen space" patented technology

The invention discloses an SPH fluid rendering method and system based on a Gaussian function, and belongs to the technical field of computer graphics, and the method comprises the steps: receiving SPH simulated fluid particle data, and constructing a particle connection graph based on a particle neighborhood relation; based on the particle connection graph, extracting local geometric features of each particle through a neural network and aggregating the local geometric features into global geometric features; analyzing the global geometric features into Gaussian function parameters to generate a plurality of Gaussian functions for each particle, and superposing all Gaussian functions in space to form an implicit fluid surface; performing screen space rendering on the implicit fluid surface to obtain a final fluid rendering image; and after foam particles generated by SPH simulation are also mapped into a Gaussian function, a fluid rendering image containing a foam visual effect is obtained through screen space rendering. The method can improve the smoothness and reality of the rendering result while guaranteeing the calculation efficiency, and achieves the consideration of the efficiency and quality of fluid rendering.

The invention provides a game rendering method and system capable of eliminating volume cloud and mist in real time and electronic equipment, and belongs to the technical field of game development. The method comprises the steps that a cloud and mist area is set, the set cloud and mist area is divided into a plurality of equal-size grids, and each grid stores an elimination state and an elimination progress value; dynamically updating vertex concentration textures; calculating and storing cloud and mist concentration values of vertexes around each grid based on the grid elimination progress; view cone optimization rendering: determining a visible cloud range, combining adjacent grids to be rendered into a rectangular region in a two-dimensional plane, expanding the rectangular region into a cube, and projecting the cube to a screen space to calculate a bounding box; and shader sampling: for pixels in the screen bounding box, calculating cloud transparency and color through ray stepping sampling. According to the method, through grid dynamic management, rendering range optimization and shader efficient sampling, low-consumption and real-time elimination high-quality volume cloud and mist rendering can be realized at a mobile terminal, and performance and game interaction experience are considered.

The invention relates to a hierarchical occlusion perception grid infinitesimal streaming transmission and adaptive rendering method, which comprises the following steps of: S1, decomposing a model into grid infinitesimal, recursively constructing a bounding volume hierarchical tree BVH from bottom to top by taking the grid infinitesimal as a leaf node, and setting a semantic error and a geometric error for each sub-node cluster; s2, acquiring camera parameters of a current frame, comparing a total screen space error with an error threshold value, if the error is smaller than the threshold value, stopping traversing, and adding the cluster node into a to-be-rendered list of the current frame; and S3, if the grid infinitesimal corresponding to the cluster node in the to-be-rendered list is not loaded to the GPU memory, sending a loading request to an asynchronous streaming manager, asynchronously loading the corresponding grid infinitesimal from the memory, and rendering a father node of the cluster node. Compared with the prior art, the method has the advantages that large-scale and high-precision model data can be rendered on the lightweight XR all-in-one machine in real time, and the like.

The invention discloses a multi-factor exponential decay three-dimensional model precision control and loading method and system, and is used for loading a three-dimensional model based on a tile data service, and the multi-factor exponential decay three-dimensional model precision control and loading method comprises the steps: based on the tile data service, according to a current viewpoint, obtaining a root node as a current tile node; traversing child nodes of the current tile node, and screening visible child node tiles of the current scene; determining a screen space error corresponding to each visible sub-node tile based on the current viewpoint height, the distance between the current viewpoint and each visible sub-node tile and the inclination angle; and loading the tiles based on the screen space errors corresponding to the visible child node tiles. According to the method, the visualization effect is ensured, and the data loading efficiency and rendering performance are improved.

The invention discloses a port avionics hub digital twin multi-level simulation model construction and visualization method, which comprises the following steps: obtaining a multi-view RGB image of a target port area, obtaining a camera attitude of each view by using an SfM algorithm, and reconstructing a sparse three-dimensional point cloud; constructing an LOD2 shell model with a semantic mark; an LLO3 model with holes is constructed; the LOD0-LOD3 model is serialized into a glTF 2.0 binary format and transmitted to a client side through HTTP / 2, the client side calls WebGL 2.0 through a browser to complete decompression, uploading and PBR rendering, and interactive plug-in-free visualization is achieved; constructing an eight-fork-two-fork-four-fork mixed spatial index, and performing multi-stage division and persistence on the LOD < 0 >-LOD < 3 > tiles, so that a client locates visible tiles within constant time based on node numbers; visual cone cutting and screen space error judgment are adopted to execute progressive loading on visible tiles, LOD0 is loaded at first, then LOD1-LOD3 is subjected to incremental superposition, low-level tiles in the same area are replaced with the LOD3 in a cross fading mode at the ultra-close distance (the Euclidean distance d from the center of a camera to the center of a target tile is smaller than or equal to 100 m), and smooth visual experience is obtained in a browser.

The invention discloses an ocean terrain digital display method based on three-dimensional modeling. The ocean terrain digital display method comprises the following steps of 1, constructing a multi-source ocean data set; 2, performing space fusion by adopting a self-adaptive interpolation method based on position weight to generate a three-dimensional space density field; 3, performing contour surface extraction by adopting an improved Marching Cubes algorithm to generate an initial three-dimensional terrain model; 4, performing local modeling by adopting a Delaunay triangulation network reconstruction method, and constructing a complete three-dimensional terrain model; 5, obtaining a texture terrain model; step 6, constructing an LOD tree structure and realizing dynamic loading in combination with view cone cutting and a screen space error control strategy; and step 7, based on a dynamic loading result of the LOD tree structure, driving node switching through a time controller, and performing visual display. According to the method, three-dimensional modeling and an LOD tree structure are fused, and high-precision reconstruction and evolution display of the ocean topography are achieved.

The invention discloses a 3D Gaussian splash rendering optimization method based on a Unity engine in VR, and relates to the technical field of computer graphics. PLY point cloud files are converted into SOG high-compression formats containing multi-level LOD information, after low-transparency Gaussian points are removed, Morton coding sorting is carried out on the center coordinates of the Gaussian points, and then the 3D Gaussian splash rendering optimization method based on the Unity engine in VR is realized. The method comprises the following steps: constructing an octree spatial index containing a spatial bounding box and multiple LOD data, removing Gaussian points in a grading manner according to a camera distance, selecting an LOD hierarchy, carrying out deep barrel sorting on visible Gaussian points, executing drawing by taking a barrel as a unit, and combining near-to-far sorting, an improved mixed equation and screen space edge removal and amplification operation to obtain a target image. According to the method, through multi-dimensional optimization such as loading, space elimination and rendering, the loading efficiency of the VR equipment is improved, the rendering burden is reduced, Tile-Based hardware is adapted, and smooth operation of 3D Gaussian splashing on the VR all-in-one machine is realized.

A technique for rendering is provided. The technique includes distributing primitives to a set of screen space processors based on a first assignment configuration; modifying assignment configuration to replace the first assignment configuration with a second assignment configuration; and distributing primitives to the set of screen space processors based on the second assignment configuration.

The invention discloses an illumination scene rendering method and device, a computer readable storage medium and a computer program product, and the method comprises the steps: setting a plurality of illumination probes in a three-dimensional Gaussian splashing scene, and determining a first spherical harmonic coefficient of each illumination probe based on the light field data of the three-dimensional Gaussian splashing scene, the illumination probe is used for collecting omnidirectional illumination information of a spatial point of a three-dimensional Gaussian splashing scene; for each unshielded pixel of the to-be-rendered object, determining indirect diffuse reflection light for the to-be-rendered object based on a target spherical harmonic coefficient of a target illumination probe determined by the unshielded pixel, the to-be-rendered object being an object placed in the three-dimensional Gaussian splash scene; for each unshielded pixel, based on the normal direction of the unshielded pixel and the constructed hierarchical Z buffer, indirect specular reflection light for the to-be-rendered object is determined through screen space reflection and a reflection ball; and fusing the indirect diffuse reflection light, the indirect specular reflection light and the direct light to generate an illumination rendering result for the to-be-rendered object.

This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for a dicing oracle for texture space shading. A processor obtains an indication of a UV parameterization for each of a set of geometry units and a target number of pixels per region of the UV parameterization, where the UV parameterization includes a first set of UV coordinates for an object space. The processor renders the set of geometry units in order to obtain a second set of UV coordinates for a screen space and a set of derivatives for the second set of UV coordinates. The processor calculates a resolution for a mip region map based on the set of derivatives and the target number of pixels per region. The processor outputs an indication of the calculated resolution.

The embodiment of the invention discloses an image rendering display method and device, equipment, a medium and a product, and relates to the technical field of computer image processing. The method comprises the following steps: rendering a scene where a three-dimensional model object is located to obtain a scene basic graph; determining a screen space coordinate of a preset virtual light source and a first distance between the preset virtual light source and the three-dimensional model object, and constructing a first light shade based on the screen space coordinate and the first distance; obtaining a first outer stroke effect picture of the three-dimensional model object, and obtaining a second outer stroke effect picture of an outer stroke located in the first light shade illuminated by a preset virtual light source based on the first outer stroke effect picture and the first light shade; the post-processing effect picture is obtained based on the scene basic picture and the second outer stroking effect picture, and the post-processing effect picture is displayed, so that the picture coordination degree and the style flexibility are improved, the problem of visual separation of light and stroking is solved, and the quality, controllability and efficiency of the post-processing effect are improved.

The invention discloses a real-time relighting method based on 2D Gaussian splashing and screen space light stepping, and the method comprises the following steps: collecting a multi-view image of an object model and a scene, and carrying out the initial reconstruction of the multi-view image through a motion recovery structure algorithm, so as to obtain an initial 2D Gaussian point cloud; obtaining a 2D Gaussian point cloud with complete geometric and material attributes; the method comprises the following steps: generating a geometric buffer area comprising depth, normal and material attributes based on a 2D Gaussian point cloud with complete geometric and material attributes, calculating a direct illumination result based on the geometric buffer area and an environment illumination map, calculating an indirect illumination result by adopting a screen space light stepping algorithm, and calculating a real-time illumination result. And synthesizing the direct illumination result and the indirect illumination result to output a real-time relighting result. According to the method, the technical problem that the existing relighting technology based on ray tracing cannot be real-time can be solved, and the rendering quality and the reality sense of relighting are improved through the global illumination of the screen space and the optimized illumination sampling strategy on the premise of ensuring the real-time performance.

Illumination rendering techniques for virtual environments are described herein. The techniques may include obtaining light data of a plurality of illumination probes in a scene; determining, based on the light data, a first ray, a second ray, and first indirect illumination data in a plurality of rays, the first ray being a ray that hits a pixel in a current screen space in the scene, the second ray being a ray that does not hit a pixel in the current screen space, and the first indirect illumination data being indirect illumination data of the hit pixel; obtaining an element hit by the second ray outside the current screen space, and obtaining second indirect illumination data from an illumination buffer library of the element, the second indirect illumination data being indirect illumination data of the element; and performing illumination rendering on the scene based on the first indirect illumination data and the second indirect illumination data. The method improves accuracy of illumination rendering.

The invention relates to the technical field of three-dimensional image processing, in particular to a distributed parallel processing and loading method for large-scale scene three-dimensional model data, which comprises the following steps of: acquiring a plurality of large-scale scene three-dimensional model patch coordinate sets, normal vector sets and material identification sets, calculating an adjacent matrix and judging a spatial aggregation region; the method comprises the following steps: segmenting and generating regional data subsets, calculating patch quantity and texture size matching calculation node capability, constructing a distribution path table, extracting a continuous triangular patch chain and reconstructing compressed data, calculating a loading priority in combination with a view angle, and loading and caching data according to scheduling. The spatial aggregation degree of adjacent patches is calculated, spatial regions are divided by combining material change points, the computing power and bandwidth capacity of nodes are dynamically matched and computed according to the patch number and the texture size, and the screen space intersection area and the viewpoint distance are computed by combining the user view angle to adjust the loading priority. And the visual angle-oriented visual scheduling response efficiency is improved.

The invention relates to the technical field of computer-aided design (CAD), and discloses a CAD large model quick conversion method, which comprises the following steps of: splitting a CAD three-dimensional model into topologically continuous triangular micro-units, performing compression coding on the triangular micro-units, and constructing a three-level index system; a multi-level LOD chain is generated, and dynamic smooth transition is achieved by combining screen space error constraint and curvature sensitivity; projecting the vertexes of the triangular micro-units to a UV space to generate and splice a virtual expanded graph into a giant graph set; and finally, integrating the discrete buffer area to form a single giant buffer, performing compression optimization, remapping positioning data by means of an index, realizing high-fidelity conversion processing of a complex bladed disc assembly model, supporting seamless connection from an original design file to a digital twin virtual scene, and realizing high-fidelity conversion processing of the complex bladed disc assembly model. And a three-dimensional model foundation which is free of geometric deformation and fully reserved in parameters is provided for compressor bladed disc crack simulation, dynamic roaming and full-life-cycle virtual-real fusion research.

When monitoring multiple individuals using GPS devices, the goal is to optimize the map display according to the status of each individual within the limited screen space of the guardian's device (monitoring device), thereby improving the efficiency and visibility of monitoring. [Solution] The server (20) receives location information from multiple GPS terminals (40a, 40b). In response to a map display request from the monitoring terminal (30), the server (20) dynamically determines the display size of the map corresponding to each GPS terminal to be displayed on the monitoring terminal (30) based on the location information of each GPS terminal and related situation information (risk level, schedule, facility information, distance between terminals, etc.). Information including the determined display size and location information is transmitted from the server (20) to the monitoring terminal (30), and the monitoring terminal (30) displays the multiple maps on the display unit at the determined size based on the received information.

The application provides a picture rendering method and device, computer equipment and a storage medium. Based on the spatial geometric parameters and appearance parameters of a Gaussian point, the equivalent maximum radius of each Gaussian point in a screen space is determined, and accurate bounding box information is generated accordingly. Compared with the approximate method of a traditional axis-aligned bounding box, the application can more accurately represent the actual coverage range of the Gaussian point on the screen, improve the accuracy and picture detail fidelity of the rasterization process, reduce the number of irrelevant tiles divided into the bounding box, and effectively improve the rasterization efficiency.

The invention discloses an adaptive subdivision CAD model rendering method based on a parameter domain triangle. The method comprises the following steps: firstly, uniformly converting a model curved surface into a Bezier curved surface, and initializing metadata of the Bezier curved surface; the curved surface bounding box and curvature data are uploaded to a GPU, and a corresponding storage buffer area is created; performing visual cone elimination through a task shader, calculating a dynamic subdivision factor by combining the side length and curvature of a screen space, and performing attenuation by considering a sight distance; the grid shader generates UV coordinates according to the subdivision level, after the UV coordinates are mapped to an effective parameter domain, accurate space coordinates are obtained through parallel calculation, and finally triangular primitives are assembled and sent to the pixel shader to complete rendering. In the rendering stage, correct performance can be achieved under the condition that original curved surface cutting information is not considered, high-precision real-time rendering of the CAD model is achieved, the method can be applied to a scene for rendering a large-scale CAD model, the geometric precision is guaranteed, and the frame rate of smooth interaction is achieved.

The application discloses a kind of multi-resolution digital elevation model 3D visualization method and device, comprising: one, data preprocessing stage: S1, obtain digital elevation model DEM data;S2, calculate the multiple terrain factors of digital elevation model DEM data, principal component analysis, and the terrain feature comprehensive index is calculated;Two, real-time data processing stage: S3, multiple evaluation factor quadtree construction;S4, multiple evaluation factor quadtree updates;S5, terrain visualization: based on the multiple evaluation factor quadtree, screen space clipping is carried out, occlusion is removed, feature evaluation is carried out, obtains all points needing to be loaded, constructs irregular triangle net, is sent to GPU rendering, loads picture.

The invention discloses a depth map adjusting method for relieving 2D (two-dimensional) to 3D (three-dimensional) video display crosstalk. According to the method, an initial depth map is obtained through monocular depth estimation, a spatial weight map of a crosstalk sensitive area is generated in combination with a screen spatial position, a motion weight map is generated based on an inter-frame optical flow, and a gradient magnitude map of the initial depth map is calculated; fusing the multiple weight maps to generate a self-adaptive smooth weight map, performing attenuation optimization on a gradient field of the initial depth map, and performing reconstruction by solving a Poisson equation to obtain an optimized depth map; and finally, left and right eye views are generated based on the optimized depth map, and a 3D video stream is synthesized and output. The method does not need to depend on hardware modification, can intelligently target a crosstalk high-risk area, retains the stereoscopic impression of a central area to the greatest extent while effectively relieving crosstalk, is adaptive to various monocular depth models and 3D display equipment, has the advantages of accurate crosstalk suppression, excellent stereoscopic vision experience, high compatibility and the like, is suitable for various 2D-to-3D video processing scenes, and has a wide application prospect. And the 3D watching comfort of the user is improved.

Provided in the present application are a dynamic visual effect generation method and apparatus. The dynamic visual effect generation method in the present application comprises: receiving an interaction instruction, wherein the interaction instruction is generated by an interactive operation performed by a user on a visual element within a screen space; acquiring a programmatic rule corresponding to the interaction instruction, wherein the programmatic rule is used for generating a dynamic visual effect after the interactive operation is performed on the visual element; on the basis of the programmatic rule, generating a first layer which has the dynamic visual effect, wherein the dynamic visual effect comprises visual features of the visual element, and the visual features comprise a geometric feature, a material feature and a motion feature; and fusing the first layer and a background layer, so as to obtain an image which includes a target visual effect. The present application can save storage space, reduce the power consumption of a terminal device, and meet the requirement of a real-time response to a user, thereby improving user engagement.

Systems, methods, and computer readable media for an augmented reality (AR) shared screen space. Examples relate to a host augmented realty (AR) device sharing a screen and a relative location of the AR device to the screen with guest AR devices where the guest AR devices share a relative location of the guest AR devices to a copy of the screen displayed on the display of the guest AR devices and where the users of the AR devices may see each other's location with the use of avatars around the shared screen and add augmentations to the shared screen. The yaw, roll, and pitch of the head of the avatars tracks the movement of the head of the user of the AR wearable device.

The invention discloses a real-time hair de-noising and repairing method and equipment based on geometric parameterization modeling, and the method comprises the steps: (1) constructing a visible buffer region, and capturing the core geometric features of hair in a screen space through a light tracing technology by adopting the visible buffer region; (2) aiming at a hairline fracture area caused by low sampling, screening a pixel with the most matched direction from adjacent pixels as a filling reference source, and gradually filling core geometric features of the hairline fracture area in a visibility buffer area according to a dynamic step length in the hairline extension direction based on the filling reference source; (3) coloring each hairline pixel of each hairline according to the filled visible buffer area; (4) performing brightness compensation on the coloring result, so that the hair pixel brightness sum of each hair before and after filling is unchanged; and (5) performing screen space filtering on each hairline pixel of each hairline along the hairline extension direction to realize hairline denoising and repairing. The method is better in denoising effect.

A system and method for an adaptive graphic user interface (AGUI) (501) that can identify the characteristics of one or more users and display candidates and dynamically select display content and generate an interface (502-506 . . . ) customized to one or more users and display candidates and dynamically arrange, modify, map and adapt an AGUI display to any object (350,730), device, clothing, equipment, furniture, appliance, room, building, vehicle, person, or other passive or active display surface, screen, space or other display candidate and embodiments of an AGUI apparatus (500) that can network, coordinate and / or operate with the AGUI platform (1302) to identify one or more users and display candidates and enabling one or more users to interface with a single AGUI display across multiple display candidates.

The invention discloses a plane transmission and reflection reconstruction method based on three-dimensional Gaussian, and the method comprises the steps: firstly, projecting the three-dimensional Gaussian to a screen space and accumulating colors for a given visual angle based on the joint representation of the three-dimensional Gaussian which represents plane transmission and reflection at the same time and a reflection plane of a modeling reflection model, and obtaining a transmission color graph; the three-dimensional gauss are symmetrical according to a reflection plane, and a reflection color map is obtained through rendering in the same mode; and finally, calculating a reflection coefficient according to a Fresnel reflection model on the reflection plane, and weighting and combining the transmission color map and the reflection color map to obtain a final rendering result. According to the method, a multi-stage optimization strategy is also designed to realize accurate separation and reconstruction of transmission and reflection, and real-time high-fidelity new view angle synthesis can be realized in a scene containing complex plane transmission and reflection.

The invention provides a video conference screen splitting method and device, electronic equipment and a storage medium. The video conference screen splitting method comprises the following steps: detecting active spokesmen in a video conference, and adding the active spokesmen into an active spokesman list; calculating a speaking weight of each active spokesman in the active spokesman list based on a dynamic split screen decision; determining a target active spokesman and a target split screen mode according to the speaking weight of the active spokesman in the active spokesman list; and displaying a video picture of the target active spokesman according to the target split screen mode. According to the embodiment of the invention, the active spokesman can be dynamically detected, the weight of the active spokesman can be calculated, and the target active spokesman and the target split-screen mode can be dynamically determined according to the weight of the active spokesman, so that the split-screen mode more suitable for the current conference state can be dynamically adopted, the screen space utilization is optimized, and the user experience is improved. The method focuses on displaying more important spokesmen, so that the accuracy and rationality of screen splitting can be improved.

Conventional user interfaces have the drawback of being monotonous, taking up unnecessary screen space, and requiring multiple operations to access desired functions. [Solution] An area called a ghost interface is installed within the software screen or graphical user interface (GUI). This ghost interface can operate software functions by combining the type of user operation and the coordinate information of the operation. This makes it possible to provide multiple functions with a single user operation from the same coordinates without interfering with the visual information and functions of existing GUIs. In addition, ghost marks and ghost guides are used to visually inform the user of the operation status and functions. [Effect] The present invention allows many functions to be implemented in a limited screen space, improving user operability.

The present application relates to the technical field of scene rendering, in particular to a kind of adaptive hybrid rendering method, system and medium based on multidimensional feature, the method is generated by geometry channel G-Buffer containing scene information, comprehensively utilize depth, normal, material and motion and so on Multidimensional feature information;Using decision function, screen space pixel is adaptively divided into visual key area and non-visual key area;For non-visual key area, delay rendering technology is used, for visual key area, path tracking rendering technology is used;The rendering result is weighted and fused to obtain final rendering result.The present application can effectively reduce the invalid calculation overhead of non-visual key area, significantly improve the update efficiency of acceleration structure under dynamic scene, while guaranteeing the physical reality of large-scale dynamic three-dimensional scene, meet the performance requirements of real-time interaction.

The invention discloses an image rendering method and device, a storage medium and electronic equipment. The method comprises the following steps: acquiring depth information of each vertex in a three-dimensional model corresponding to a to-be-rendered object; based on the depth information, inversely mapping pixel points captured from the screen space in real time to the view space, and performing projection transformation on the three-dimensional coordinate points in the view space based on the original projection matrix to obtain a global distortion amount; under the condition that the global distortion amount is greater than a first threshold value, correcting the original projection matrix to obtain a corrected projection matrix; and determining a target color value of each pixel point based on the corrected projection matrix and a screen curvature, and rendering the to-be-rendered object based on the target color values, the screen curvature representing a depth change rate of the pixel points in the local image area. The technical problem that the visual quality of the rendered image in the real-time rendering scene is low is solved.

The invention discloses a fluid special effect generation method and apparatus, a storage medium, a device and a program product. The method comprises the steps of obtaining first fluid information of a first fluid generated in a current frame; based on the first preset transformation matrix and the fluid depth information of the previous frame, calculating a screen space coordinate and second depth information of a second fluid included in the current frame in a screen space coordinate system; calculating second speed information of the second fluid based on a second preset transformation matrix and the second depth information, and superposing the second speed information and the first speed information to serve as third speed information of a third fluid of the current frame; and based on the screen space coordinates, the third speed information and the first fluid information, reconstructing current fluid information of the third fluid in the screen space, and rendering the current fluid information to generate a fluid special effect. The generation consumption of fluid special effects can be reduced, and the performance pressure is relieved.