160 results about "Viewing frustum" patented technology

The invention discloses a scene rendering method and system based on three-dimensional Gaussian splashing. The method comprises the following steps: organizing and constructing an original 3D Gaussian set to obtain a spatial hierarchical structure; generating corresponding level details for the primitives in the spatial hierarchical structure to obtain a spatial hierarchical structure associated with the level details; traversing the spatial hierarchical structure associated with level details, and executing hierarchical view cone cutting and shielding elimination to obtain a visible node list; traversing the visible node list, calculating a level detail selection standard, and generating a level detail activity Gaussian set; performing optimization sorting on the level detail activity Gaussian set to obtain an activity primitive list; and performing tile-based rasterization on the active primitive list, and performing adaptive processing according to level details of the primitives to obtain a final color value of each pixel. According to the method, the rendering performance can be greatly improved, the occupation of a memory and a video memory is remarkably reduced, the rendering quality is improved, visual flaws are reduced, and the expandability of the 3DGS rendering method is enhanced.

Disclosed in the present invention is a three-dimensional Gaussian splatting optimization method for an unposed input. The method comprises: for an input image, predicting a ray bundle distribution by using a ray prediction model, to obtain distribution features in the form of ray bundles; on the basis of the distribution features in the form of ray bundles, calculating a camera pose; for the ray bundle distribution, performing sampling on the basis of the volumetric density of light rays, to obtain an initial spatial distribution of a three-dimensional Gaussian point cloud focused on a visual center area; for the input image, obtaining a visible shell by means of view frustum projection and object-mask computation; on the basis of the initial spatial distribution of the three-dimensional Gaussian point cloud and the visible shell, performing three-dimensional Gaussian splatting scene training, to obtain a three-dimensional scene reconstruction model satisfying a preset loss function criterion, the loss function comprising a training regularization term for a camera pose parameter. The present invention provides important scene initialization information for three-dimensional Gaussian splatting training, and significantly improves the quality and the richness of detail of the final three-dimensional structure.

The invention relates to the field of scene rendering, and particularly discloses a three-dimensional scene optimization method and system for collaborative rendering of dynamic LOD and view cone rejection based on space-time prediction, and the method comprises the steps: dynamically calculating the visibility frequency of an object, and dynamically adjusting the loading and rendering modes of objects with different priorities; predicting a view cone range of multiple frames in the future by using an LSTM network architecture; dividing the scene into uniform grid blocks, and then performing grading elimination; optimizing a heterogeneous computing pipeline; rendering the execution process; the system comprises a dynamic LOD and visual cone rejection collaborative optimization module, an LSTM visual cone prediction module, a block-level mixed rejection module, a heterogeneous calculation pipeline module, an optimization CPU-GPU task allocation and data transmission module and a rendering execution control module. According to the method, the technologies of collaborative optimization of dynamic LOD and view cone removal, block-level mixed removal, heterogeneous calculation assembly line optimization and the like are adopted, so that unnecessary rendering calculation and resource loading are reduced, and the rendering efficiency is improved.

The invention relates to the technical field of smart campuses, in particular to a Cesium-based three-dimensional GIS smart campus visualization platform system, which comprises a three-dimensional visualization engine module, a 1: 1 campus digital twin model constructed based on Cesium, and a GLB format model dynamic loading and 360-degree free view angle browsing support, the data fusion module is used for integrating security and protection monitoring and energy consumption monitoring multi-source data and realizing multi-dimensional data linkage through ECharts; the performance optimization module is used for optimizing the model loading efficiency by adopting view cone cutting and LOD technologies; according to the method, 1: 1 campus digital twin modeling is realized by adopting a Cesium engine, the reality sense and the spatial analysis capability of a three-dimensional scene are improved by combining a precise positioning algorithm of a WGS84-to-Cartesian coordinate system and a GLB format model dynamic loading technology, and meanwhile, real-time coupling of dynamic data such as energy consumption and security and protection and the three-dimensional scene is realized by adopting a CZML protocol.

The invention relates to an OpenGL (Open Graphics Library)-based large-scale three-dimensional model object quick pickup method. The method comprises the following steps: converting an interactive operation of a user into a three-dimensional space structure; a CPU constructs octree space acceleration structures based on a bounding box of an object in a large-scale three-dimensional model, and leaf nodes, intersecting with a pickup ray or a pickup view pyramid, of an axis alignment bounding box in each octree space acceleration structure are screened out to serve as candidate leaf nodes; collecting triangles contained in all candidate leaf nodes, and constructing a candidate triangle set; dynamically allocating thread groups and threads of the GPU based on the number of candidate triangles in the candidate triangle set; and performing highlight display on the candidate triangles intersected with the pickup ray or the pickup view cone, and feeding back IDs of the corresponding candidate triangles. According to the method, the data transmission quantity and the video memory access pressure are remarkably reduced, the pickup response time is greatly shortened in a large-scale three-dimensional model scene, and the requirements of real-time interaction and visual operation can be met.

The invention discloses a rendering method, which comprises the following steps: constructing an octree, and storing a to-be-rendered object in a to-be-rendered three-dimensional scene in a child node of the octree to obtain a space management octree; dividing the view cone into different view cone levels; traversing the space management octree, and determining a first intersection part between the space of the child node and the view cone and a view cone level to which the first intersection part belongs; distributing the first intersection part to different rendering queues according to the view cone hierarchy to which the first intersection part belongs; shielding and removing the first intersection parts in the different rendering queues to obtain current visible objects to be rendered; and rendering the current visible to-be-rendered object. According to the method, the octree is constructed to manage the three-dimensional scene space, the view cone levels are divided, the rendering queues are distributed, the view cone removing and multi-level shielding removing technologies are combined, the visible objects are accurately judged, the rendering load is effectively reduced, and the method has the advantages that the rendering performance is improved, space management is optimized, and the complex scene processing efficiency is improved.

The invention discloses an apparatus and method for converting compressed geometries into accelerated data structures. An apparatus and method for transforming lossy compressed geometries into a bounding volume hierarchy. For example, one embodiment of a method includes constructing a bounding volume hierarchy (BVH) based on a compressed hierarchy (LOD) structure formed from iteratively merged geometric primitive cluster pairs, where constructing the BVH includes traversing the compressed hierarchy (LOD) structure, to select a subset of the cluster on one or more levels of a compressed hierarchy (LOD) structure based on the current cone of view; decompressing each cluster and constructing a per-cluster BVH on the primitive of each cluster, wherein each per-cluster BVH comprises a per-cluster BVH root node; and fusing the per-cluster BVH root nodes to form a BVH, the BVH being used to efficiently ray trace all decompressed geometric primitives in the scene.

The embodiment of the invention provides an underwater scene three-dimensional reconstruction method based on three-dimensional Gaussian sputtering and related equipment, and belongs to the technical field of computer vision. The method comprises the following steps: performing feature point analysis on each real two-dimensional image to obtain a sparse point cloud set; a three-dimensional Gaussian ellipsoid of each point cloud in the sparse point cloud set is initialized to represent a three-dimensional underwater scene, and the three-dimensional Gaussian ellipsoid is used for representing Gaussian distribution of the position, the covariance matrix, the color and the opacity of the point cloud; selecting a plurality of three-dimensional Gaussian ellipsoids located in a corresponding camera view cone based on the target camera pose, and performing two-dimensional projection rendering according to the plurality of selected three-dimensional Gaussian ellipsoids to obtain a rendered two-dimensional image; and updating the three-dimensional Gaussian ellipsoids in the point cloud space according to the rendered two-dimensional image and the real two-dimensional image with the same target camera pose to obtain a plurality of three-dimensional Gaussian ellipsoids accurately representing the underwater scene. According to the invention, the accuracy and efficiency of underwater scene three-dimensional reconstruction can be improved.

The invention relates to the technical field of unmanned aerial vehicle image processing, and discloses an unmanned aerial vehicle image compensation slicing method, device and equipment and a storage medium. The method comprises the following steps: acquiring flight mark data, inspection parameter data and a region image when an unmanned aerial vehicle inspects a long-strip-shaped target region, and extracting various types of flight parameter data; performing superposition calculation on the coordinates of the unmanned aerial vehicle based on the positioning compensation data, and constructing a camera imaging view cone model in combination with the inspection parameter data; performing intersection calculation on the view cone model and the strip-shaped target area to obtain an effective image coverage area, and determining image slice parameter data; and performing non-uniform tile cutting on the inspection area image based on the slice parameters to generate image slice data, and performing multi-resolution structure storage of non-uniform spatial index according to the inspection main axis direction to obtain an inspection image compensation slice result. According to the invention, the adaptive slicing of the unmanned aerial vehicle image is realized, the redundancy of the long-strip-shaped target slice is reduced, and the three-dimensional visual loading efficiency is improved.

The invention discloses a port avionics hub digital twin multi-level simulation model construction and visualization method, which comprises the following steps: obtaining a multi-view RGB image of a target port area, obtaining a camera attitude of each view by using an SfM algorithm, and reconstructing a sparse three-dimensional point cloud; constructing an LOD2 shell model with a semantic mark; an LLO3 model with holes is constructed; the LOD0-LOD3 model is serialized into a glTF 2.0 binary format and transmitted to a client side through HTTP / 2, the client side calls WebGL 2.0 through a browser to complete decompression, uploading and PBR rendering, and interactive plug-in-free visualization is achieved; constructing an eight-fork-two-fork-four-fork mixed spatial index, and performing multi-stage division and persistence on the LOD < 0 >-LOD < 3 > tiles, so that a client locates visible tiles within constant time based on node numbers; visual cone cutting and screen space error judgment are adopted to execute progressive loading on visible tiles, LOD0 is loaded at first, then LOD1-LOD3 is subjected to incremental superposition, low-level tiles in the same area are replaced with the LOD3 in a cross fading mode at the ultra-close distance (the Euclidean distance d from the center of a camera to the center of a target tile is smaller than or equal to 100 m), and smooth visual experience is obtained in a browser.

The invention relates to a method and device for searching a window for a specific landscape, and the method comprises the steps: obtaining building information and a multi-view image set in a target region, and constructing a three-dimensional model of the target region according to the building information and the image set; analyzing frame images in the image set to determine a window data set; determining a view cone of the window according to a preset view field angle and an outer normal vector in the geometric space representation data, and determining view field data of the window generated when the view cone is projected to the three-dimensional model; according to the building information, the geometric space representation data of each window and the visual field data, constructing a visual field database of all windows in the target area; and according to the multi-modal query information uploaded by the user, searching a window conforming to the multi-modal query information in the visual field database. The searching efficiency of the window with the specific landscape outside the window is improved.

The invention discloses a scene data scheduling and rendering method based on dual PVS, and relates to the technical field of data processing. According to the method, the target scene unit where the camera viewpoint is located is determined, the rendering scene tree corresponding to the target scene unit is obtained, the nodes of the rendering scene tree are the target visible objects corresponding to the target scene unit, and then the view cone corresponding to the camera viewpoint is determined; and selecting a target node in the rendering scene tree as a target rendering object according to the view cone, determining a hierarchical detail model corresponding to the target rendering object according to the distance between the target rendering object and the camera viewpoint, loading the hierarchical detail model to the rendering pipeline from the rendering scene tree, and rendering the target rendering object. According to the method, the target visible objects are screened through the rendering scene tree, and then the target rendering object is determined in the target visible objects through the view cone, so that the objects needing to be rendered are further reduced, and the computing resource consumption of model rendering is reduced.

The invention relates to a landslide visual monitoring method and device, and belongs to the technical field of landslide monitoring, and the method comprises the steps: obtaining the disaster scene data of a landslide monitoring area, constructing a view cone of the landslide monitoring area, dividing the disaster scene data through a plurality of LOD layers of the view cone, and obtaining the landslide scene data of the landslide monitoring area. Initial disaster scene data of each LOD level are obtained, error calculation and judgment can be carried out on the initial disaster scene data of each LOD level, and therefore multi-level visual analysis of the disaster scene data can be achieved; and the initial disaster scene data of each target LOD level can be subjected to adaptive scheduling and visual display, so that the intelligent degree and the adaptive capability of the disaster scene are improved, and the visualization efficiency is improved.

The invention provides a water conservancy twinborn model rendering optimization method for dynamically generating gray level image frames based on a view cone. The method comprises the following steps: obtaining visible area model data after the current view cone is dynamically cut; outputting the visible area model data to a multi-layer rendering target comprising a color buffer area, a vertex buffer area and a depth buffer area through off-screen rendering so as to generate intermediate frame data isolated from screen display; performing gridding processing on the intermediate frame data, and displaying the equipment resolution according to the physical range size of the water conservancy project or the drainage basin scene; the average color value of each grid unit is calculated, desaturation processing is carried out to generate a basic grey-scale map, and adaptive feature enhancement processing is carried out to generate an optimized grey-scale map or a gradient map; and a GPU rendering pipeline is input and acts on hydrological feature analysis of the post-processing stage of the current frame and a preloading data source rendered by a twinborn model of the next frame at the same time, historical frame data are reused in a static region through motion detection, and real-time rendering is triggered in a dynamic region.

The invention discloses an ultrahigh-resolution immersive scene rendering method based on hexagonal picture segmentation. The method comprises the following steps: 1, determining a hexagonal segmentation style of an immersive display surface; 2, unfolding the immersive display surface into a plane; 3, acquiring 3D point information of each hexagonal surface, respectively calculating the width W and the height H of the enveloping quadrilateral surface, and calculating a local coordinate system V of the hexagonal surface S; 4, using W, H and V to construct a view cone and a viewpoint matrix of the three-dimensional scene; 5, setting a shade M of a plane expansion view for the hexagonal surface S; 6, calling a rendering scene of the 3D scene for the mask region by using information of the view cone and the viewpoint matrix, and rendering the mask region into a picture at the position S of the hexagonal surface; and 7, repeating the steps 5-6, and sequentially carrying out the same treatment on each hexagonal surface. According to the method and the device, the ultrahigh-resolution picture can be rendered in a scene segmentation form, and the method and the device are suitable for ultrahigh-resolution picture rendering under immersive display equipment.

The invention discloses a roadside multi-mode fusion sensing method. According to the method, an initial 3D view cone tensor with depth information is generated through a depth estimation network, features of pixel points are projected to a coordinate system in combination with internal and external parameter matrixes of a camera, then a three-dimensional space point coordinate set is generated according to projected feature position information, a Gaussian function is adopted to distribute weights of neighborhood grids, and a three-dimensional space point coordinate set is obtained. And finally, inputting the image features and the features into a fusion unit, respectively carrying out uncertainty modeling on the two types of features, automatically generating a fusion weight, and finally, carrying out normalization weighted aggregation on the features in the neighborhood so as to reduce the position approximation error and obtain the calibrated image features, and finally, inputting the image features and the features into the fusion unit, and respectively carrying out uncertainty modeling on the two types of features and automatically generating a fusion weight. And dynamic optimization is carried out according to a self-supervised loss function in the fusion process, so that the stability of multi-modal feature fusion is ensured, the detection accuracy is high, the performance is relatively good, and the problem of global feature dislocation caused by external parameter deviation and depth error can be avoided.

The invention pertains to a computer-implemented method for visualizing 3D data of a multitude of data sets (1-5) in a scene using a computing device having limited available memory for visualizing the 3D data, the method comprising receiving the multitude of data sets, each data set having an LOD structure given as a tree comprising a multitude of nodes, determining the amount of memory available, selecting nodes of the data sets that comprise 3D data to be loaded into the available memory, loading the 3D data of the selected nodes into the memory; and visualizing the 3D data loaded into the memory on a display. Selecting the nodes comprises performing an LOD selection comprising obtaining camera-frustrum information defining a camera frustrum (10) comprising a near plane (11) and a far plane (12), dividing the camera frustrum by defining at least a near frustrum (15) and a background frustrum (16), defining a subset of data sets as foreground data sets based on an overlap of their nodes with the near frustrum, dividing the camera frustrum into a multitude of regions, allocating the available memory to the multitude of regions, and selecting, based on the allocated memory, the nodes that comprise 3D data to be loaded into the available memory. Allocating the available memory comprises determining, based at least on the amount of memory available, a tree-traversal depth, traversing the LOD structure of each foreground data set using the tree-traversal depth, recording all nodes that have an overlap with the camera frustrum and determining a screen space for each of the recorded nodes, mapping each recorded node to one of the regions, and assigning memory to each region based on the screen spaces of the nodes that have been mapped to the respective region.

The invention discloses a valve recognition pose estimation method and system based on an FPPE network, and relates to the field of image recognition. The problems that an existing visual positioning and pose detection method for the valve is not high in pose recognition degree and too large in calculated amount are solved. The method comprises the following steps: collecting a multi-angle valve picture and valve point cloud data, and constructing a valve point cloud data set and template point cloud; the RT-DETR v2 target detection network is trained; an FPPE network is constructed and trained; according to the trained RT-DETR v2 network, carrying out target identification and plane target position detection on the valve image to obtain a central position coordinate of a valve area and an ROI boundary point pixel coordinate; points of all depths in the ROI space area are extracted to form a view cone point cloud; and inputting the view cone point cloud into the trained FPPE network to obtain a final valve pose estimation result. The method is applied to the technical field of object positioning.

The present invention relates to the technical field of geographic information systems, and discloses a sensor observation method and system based on Cesium. In this observation method, a viewing frustum is constructed using the PerspectiveFrustum function, and the parameters of different types of sensors are customized to adjust the observation perspective, and the target to be observed within the viewing frustum is observed, thereby simulating the sensor observation environment. The present invention solves the problems existing in the prior art, such as not supporting the customization of different types of sensors to adjust the current perspective and being difficult to observe various targets in a complex environment from multiple angles in real time.

The present invention relates to the field of game image generation technology, and in particular to a method and system for generating game images based on a 3D rendering engine. The method comprises: obtaining intersecting objects in a 3D model of a game engine that intersect with a surface of a viewing frustum; screening suspicious objects based on the overlap between the bounding box of the intersecting object and the viewing frustum, the change in physics engine information, and the distance between intersecting objects on the same surface of the viewing frustum; determining the user perspective following time difference based on the consistency between the spatial vector of the historical intersecting object and the corresponding camera perspective vector, and the matching relationship between the change in the spatial vector of the historical intersecting object and the change in the corresponding camera perspective vector; calculating the attention level of the suspicious object based on the projection distribution of the suspicious object and its matching object relative to the plane aligned with the camera lens, and the change in the spatial vector when the suspicious object changes state, thereby generating a game image. The present invention ensures the rendering effect of the game image.

The invention discloses a holographic computing task distributed distribution method and system based on multi-person multi-view interaction, and relates to the technical field of distributed computing and holographic interaction.The system comprises a main scheduling node, a plurality of computing nodes and a user terminal.The main scheduling node obtains scene graph data of a current frame and view cone parameters of the user terminal; generating a dynamic granularity task block with metadata through a dynamic sensing task block generator; obtaining a visual angle coherence cluster through a visual angle coherence clustering engine; calculating sharing benefits and full-link cost of task blocks and clusters, constructing a benefit-cost ratio objective function, and obtaining an optimal matching relationship through an optimization algorithm; according to the method, dynamic adaptation of task granularity and optimal allocation of resources are achieved, redundant rendering and transmission delay are reduced, and the fluency of multi-user holographic interaction and the resource utilization rate are improved.

This invention discloses a method, apparatus, device, and storage medium for constructing a 3D map, applicable to the field of 3D mapping. It involves determining a reference point within the view frustum of a viewpoint, constructing a reference plane containing the reference point and parallel to the view frustum, determining the height of the 3D map rendering interface window, and determining the height of the reference plane window. The unit of the 3D map rendering interface window height is pixels, while the unit of the reference plane window height is length. A distance-pixel ratio is determined based on the ratio of the reference plane window height to the 3D map rendering interface window height. The 3D map scale of the reference point is determined based on the distance-pixel ratio, constructing a 3D map containing the 3D map scale. Based on perspective projection rules, the scale information at any location in the 3D map can be calculated quickly and accurately, improving the efficiency of constructing a 3D map with a high-precision scale. The high-precision scale can assist in obtaining accurate geographic information within the 3D map, thereby improving modeling accuracy.

A mesh-based graphics method comprises the steps of outputting for display an image of a virtual environment based upon a viewpoint of a virtual camera and receiving information indicating a position

The application discloses a virtual camera simulation data generation method and system based on a Gaussian point cloud model, relates to the technical field of three-dimensional point cloud processing and modeling, and comprises the following steps: after completing multi-source data interaction, a point cloud dataset is established according to the data interaction result; after completing space-time registration on the dataset, a fusion space dataset is constructed, and a Gaussian point cloud model is obtained through modeling; then, virtual camera parameters are configured, a frustum is constructed to identify invalid points, and point labels are established; center perception fusion is carried out by using the point labels to obtain a perspective simulation image; and after target perception feedback correction, simulation data is established. The application solves the technical problem that the prior art cannot accurately fuse multi-source information, the virtual camera simulation data generated has a large deviation from a real scene, and the data processing result is inaccurate, and achieves the technical effect that the virtual camera simulation data accurately fits the real scene and the accuracy of the data processing result is improved.

This invention discloses a 3D train detection and positioning method based on ground-based monocular vision. It eliminates the need for satellite signals or additional trackside equipment. Through convolutional-trans depth estimation and pseudo-point cloud optimization, the absolute relative error of depth estimation can be reduced to below 0.06. After pseudo-point cloud optimization, the 3D detection accuracy is improved by more than 20%, achieving a final positioning accuracy of 1 meter, meeting the auxiliary positioning requirements of train control systems. Furthermore, through view frustum region extraction and lightweight network design, the inference frame rate is ≥10fps, meeting the real-time positioning requirements of high-speed trains. In addition, existing ground-based monocular cameras can be reused, eliminating the need for additional hardware. The deployment and maintenance costs are only 1 / 10 of those of transponder positioning systems. Overall, this invention provides a novel technical path for train positioning and can be widely applied to auxiliary positioning systems for conventional and high-speed railways. It is particularly suitable for the intelligent upgrading and transformation of existing lines, possessing extremely high engineering application value.

The invention relates to the technical field of computer graphics and geological exploration visualization, and discloses a geologic body space penetration processing system based on a domestic digital twin engine technology, and the system comprises a heterogeneous data mapping module which is used for carrying out the normalization interpolation of discrete geological data, and generating a continuous three-dimensional body texture; the view cone depth weighted statistical analysis module is used for carrying out view cone sampling on the body texture and generating a weighted histogram in combination with a depth weight; the time domain damping adaptive threshold value control module is used for solving an instantaneous threshold value based on the histogram and generating a smooth final application threshold value in combination with a historical threshold value; and the multi-dimensional gradient mapping and penetration rendering module is used for calculating comprehensive visual potential energy in combination with the attribute value and the surface orientation factor, and executing fragment elimination or output based on a final threshold value. According to the method, a time domain damping self-adaptive threshold control mechanism is constructed, the time sequence stability of a rendered picture in the dynamic roaming process is ensured, and visual jump is eliminated.

This application discloses a method, apparatus, and electronic device for displaying a three-dimensional model of a game character. The method includes: determining a target three-dimensional model and multiple preset original texture layers; obtaining a resizing parameter for the two-dimensional original texture layer within the viewing frustum based on the relative position of the two-dimensional original texture layer and a virtual camera; adjusting the original size of the two-dimensional original texture layer to a target size based on the resizing parameter to obtain a target texture layer; generating a three-dimensional virtual scene background based on the target texture layer, and displaying the target three-dimensional model within the three-dimensional virtual scene background. This application solves the technical problem of virtual scene backgrounds lacking a sense of three-dimensionality.

The invention discloses a management-oriented data center system and a data processing method. The system comprises a 3D visualization module, a resource monitoring module, a machine room management module, an interaction adaptation module, a feedback closed loop module, a system configuration module and a data processing unit. According to the method, the physical layout and the operation state of the data center are visually presented through the 3D visualization technology, and the problem that traditional management information is not visual is solved; the refined resource monitoring and machine room management functions improve the resource allocation and scheduling efficiency; the responsive interactive design and shortcut key support optimize the operation convenience; the feedback closed loop module realizes quick response of user requirements and continuous optimization of the system; a system configuration module and a security mechanism guarantee the stability, expandability and data security of enterprise-level applications, and in addition, through performance optimization strategies such as view cone elimination, assembly lazy loading and virtual rolling, it is ensured that the system can still run smoothly in a large-data-volume scene.