87 results about "Viewing frustum" patented technology

Disclosed in the present invention is a three-dimensional Gaussian splatting optimization method for an unposed input. The method comprises: for an input image, predicting a ray bundle distribution by using a ray prediction model, to obtain distribution features in the form of ray bundles; on the basis of the distribution features in the form of ray bundles, calculating a camera pose; for the ray bundle distribution, performing sampling on the basis of the volumetric density of light rays, to obtain an initial spatial distribution of a three-dimensional Gaussian point cloud focused on a visual center area; for the input image, obtaining a visible shell by means of view frustum projection and object-mask computation; on the basis of the initial spatial distribution of the three-dimensional Gaussian point cloud and the visible shell, performing three-dimensional Gaussian splatting scene training, to obtain a three-dimensional scene reconstruction model satisfying a preset loss function criterion, the loss function comprising a training regularization term for a camera pose parameter. The present invention provides important scene initialization information for three-dimensional Gaussian splatting training, and significantly improves the quality and the richness of detail of the final three-dimensional structure.

The invention relates to an OpenGL (Open Graphics Library)-based large-scale three-dimensional model object quick pickup method. The method comprises the following steps: converting an interactive operation of a user into a three-dimensional space structure; a CPU constructs octree space acceleration structures based on a bounding box of an object in a large-scale three-dimensional model, and leaf nodes, intersecting with a pickup ray or a pickup view pyramid, of an axis alignment bounding box in each octree space acceleration structure are screened out to serve as candidate leaf nodes; collecting triangles contained in all candidate leaf nodes, and constructing a candidate triangle set; dynamically allocating thread groups and threads of the GPU based on the number of candidate triangles in the candidate triangle set; and performing highlight display on the candidate triangles intersected with the pickup ray or the pickup view cone, and feeding back IDs of the corresponding candidate triangles. According to the method, the data transmission quantity and the video memory access pressure are remarkably reduced, the pickup response time is greatly shortened in a large-scale three-dimensional model scene, and the requirements of real-time interaction and visual operation can be met.

The invention discloses a port avionics hub digital twin multi-level simulation model construction and visualization method, which comprises the following steps: obtaining a multi-view RGB image of a target port area, obtaining a camera attitude of each view by using an SfM algorithm, and reconstructing a sparse three-dimensional point cloud; constructing an LOD2 shell model with a semantic mark; an LLO3 model with holes is constructed; the LOD0-LOD3 model is serialized into a glTF 2.0 binary format and transmitted to a client side through HTTP / 2, the client side calls WebGL 2.0 through a browser to complete decompression, uploading and PBR rendering, and interactive plug-in-free visualization is achieved; constructing an eight-fork-two-fork-four-fork mixed spatial index, and performing multi-stage division and persistence on the LOD < 0 >-LOD < 3 > tiles, so that a client locates visible tiles within constant time based on node numbers; visual cone cutting and screen space error judgment are adopted to execute progressive loading on visible tiles, LOD0 is loaded at first, then LOD1-LOD3 is subjected to incremental superposition, low-level tiles in the same area are replaced with the LOD3 in a cross fading mode at the ultra-close distance (the Euclidean distance d from the center of a camera to the center of a target tile is smaller than or equal to 100 m), and smooth visual experience is obtained in a browser.

The invention discloses a holographic computing task distributed distribution method and system based on multi-person multi-view interaction, and relates to the technical field of distributed computing and holographic interaction.The system comprises a main scheduling node, a plurality of computing nodes and a user terminal.The main scheduling node obtains scene graph data of a current frame and view cone parameters of the user terminal; generating a dynamic granularity task block with metadata through a dynamic sensing task block generator; obtaining a visual angle coherence cluster through a visual angle coherence clustering engine; calculating sharing benefits and full-link cost of task blocks and clusters, constructing a benefit-cost ratio objective function, and obtaining an optimal matching relationship through an optimization algorithm; according to the method, dynamic adaptation of task granularity and optimal allocation of resources are achieved, redundant rendering and transmission delay are reduced, and the fluency of multi-user holographic interaction and the resource utilization rate are improved.

This invention discloses a method, apparatus, device, and storage medium for constructing a 3D map, applicable to the field of 3D mapping. It involves determining a reference point within the view frustum of a viewpoint, constructing a reference plane containing the reference point and parallel to the view frustum, determining the height of the 3D map rendering interface window, and determining the height of the reference plane window. The unit of the 3D map rendering interface window height is pixels, while the unit of the reference plane window height is length. A distance-pixel ratio is determined based on the ratio of the reference plane window height to the 3D map rendering interface window height. The 3D map scale of the reference point is determined based on the distance-pixel ratio, constructing a 3D map containing the 3D map scale. Based on perspective projection rules, the scale information at any location in the 3D map can be calculated quickly and accurately, improving the efficiency of constructing a 3D map with a high-precision scale. The high-precision scale can assist in obtaining accurate geographic information within the 3D map, thereby improving modeling accuracy.

The application discloses a virtual camera simulation data generation method and system based on a Gaussian point cloud model, relates to the technical field of three-dimensional point cloud processing and modeling, and comprises the following steps: after completing multi-source data interaction, a point cloud dataset is established according to the data interaction result; after completing space-time registration on the dataset, a fusion space dataset is constructed, and a Gaussian point cloud model is obtained through modeling; then, virtual camera parameters are configured, a frustum is constructed to identify invalid points, and point labels are established; center perception fusion is carried out by using the point labels to obtain a perspective simulation image; and after target perception feedback correction, simulation data is established. The application solves the technical problem that the prior art cannot accurately fuse multi-source information, the virtual camera simulation data generated has a large deviation from a real scene, and the data processing result is inaccurate, and achieves the technical effect that the virtual camera simulation data accurately fits the real scene and the accuracy of the data processing result is improved.

This invention discloses a 3D train detection and positioning method based on ground-based monocular vision. It eliminates the need for satellite signals or additional trackside equipment. Through convolutional-trans depth estimation and pseudo-point cloud optimization, the absolute relative error of depth estimation can be reduced to below 0.06. After pseudo-point cloud optimization, the 3D detection accuracy is improved by more than 20%, achieving a final positioning accuracy of 1 meter, meeting the auxiliary positioning requirements of train control systems. Furthermore, through view frustum region extraction and lightweight network design, the inference frame rate is ≥10fps, meeting the real-time positioning requirements of high-speed trains. In addition, existing ground-based monocular cameras can be reused, eliminating the need for additional hardware. The deployment and maintenance costs are only 1 / 10 of those of transponder positioning systems. Overall, this invention provides a novel technical path for train positioning and can be widely applied to auxiliary positioning systems for conventional and high-speed railways. It is particularly suitable for the intelligent upgrading and transformation of existing lines, possessing extremely high engineering application value.

The invention relates to the technical field of computer graphics and geological exploration visualization, and discloses a geologic body space penetration processing system based on a domestic digital twin engine technology, and the system comprises a heterogeneous data mapping module which is used for carrying out the normalization interpolation of discrete geological data, and generating a continuous three-dimensional body texture; the view cone depth weighted statistical analysis module is used for carrying out view cone sampling on the body texture and generating a weighted histogram in combination with a depth weight; the time domain damping adaptive threshold value control module is used for solving an instantaneous threshold value based on the histogram and generating a smooth final application threshold value in combination with a historical threshold value; and the multi-dimensional gradient mapping and penetration rendering module is used for calculating comprehensive visual potential energy in combination with the attribute value and the surface orientation factor, and executing fragment elimination or output based on a final threshold value. According to the method, a time domain damping self-adaptive threshold control mechanism is constructed, the time sequence stability of a rendered picture in the dynamic roaming process is ensured, and visual jump is eliminated.

The invention discloses a management-oriented data center system and a data processing method. The system comprises a 3D visualization module, a resource monitoring module, a machine room management module, an interaction adaptation module, a feedback closed loop module, a system configuration module and a data processing unit. According to the method, the physical layout and the operation state of the data center are visually presented through the 3D visualization technology, and the problem that traditional management information is not visual is solved; the refined resource monitoring and machine room management functions improve the resource allocation and scheduling efficiency; the responsive interactive design and shortcut key support optimize the operation convenience; the feedback closed loop module realizes quick response of user requirements and continuous optimization of the system; a system configuration module and a security mechanism guarantee the stability, expandability and data security of enterprise-level applications, and in addition, through performance optimization strategies such as view cone elimination, assembly lazy loading and virtual rolling, it is ensured that the system can still run smoothly in a large-data-volume scene.

The application discloses a kind of based on three-dimensional reconstruction's silt flocculation structure parameter measurement method, system, equipment and medium, belong to flocculation monitoring technical field.The method comprises: by at least two image acquisition devices, the two-dimensional image of silt flocculation is synchronously collected from different visual angle, and its imaging geometric parameter is obtained;The two-dimensional image of silt flocculation is segmented to obtain the binary mask of each visual angle;Based on imaging geometric parameter, each mask is reversely projected to three-dimensional space to form visual cone, and the three-dimensional visual convex hull model of silt flocculation is obtained by intersection operation;Based on the three-dimensional visual convex hull model, the structure parameter of silt flocculation is output.Therefore, by implementing the present application, the problem that the calculation error of irregular silt flocculation structure parameter is large in the prior art based on single visual angle two-dimensional projection and sphere assumption can be solved, and the accurate measurement of the real three-dimensional morphology of silt flocculation is realized.

This invention discloses a deep learning-based 3D reconstruction method for ship engines, belonging to the field of computer vision technology. The method includes: obtaining 10 input images containing a reference image and neighboring images from 10 images; inputting each of the 10 input images into a pre-trained DAS-MVSNet network, which performs the following steps: sequentially inputting each input image into a feature extraction module, a Deep-ASPP module, and a Conv1 convolutional layer to obtain 10 first feature maps; establishing a reference camera viewpoint and uniformly sampling along the optical center direction within its view frustum to form multiple planes of different depths; mapping each first feature map to multiple planes of different depths to generate 1 feature volume; aggregating the 10 feature volumes into a single cost volume and inputting it into a four-scale 3D convolutional neural network to obtain an optimized depth map; and finally, after traversing all images, generating a point cloud model based on the optimized depth map. This invention improves the accuracy and completeness of 3D reconstruction.

This invention discloses a method, system, and terminal device for displaying a 3D geographic information system based on multiple screens, relating to the field of 3D display technology. The method includes: acquiring 3D geographic information data; constructing a 3D geographic scene in a 3D rendering engine; determining the observer's viewpoint within a physical space, which is enclosed by multiple planar display screens forming a multi-screen display; deploying a corresponding number of virtual cameras facing the corresponding screens, with the observer's viewpoint as the origin; configuring the cameras in a physical trapezoidal combination based on the physical size and position of the screens relative to the observer and calculating the asymmetric view frustum projection matrix; allocating rendering tasks to pre-built distributed rendering cluster nodes, and controlling the synchronous output of each camera's image to the corresponding screen through a hardware synchronization mechanism. This invention achieves naked-eye stereoscopic display on multiple screens, eliminates perspective distortion at screen junctions, ensures seamless synchronization of multi-screen images without tearing, and enhances the immersiveness and accuracy of 3D geographic information display.

This application discloses a lightweight preprocessing method for geometric components in 3D scene rendering, relating to the field of 3D rendering. The method includes: when there are multiple edge points in a triangular mesh model, performing component edge shape detection based on the position information of the multiple edge points to determine whether the component to be processed is a cylindrical component; when the component to be processed is determined to be a cylindrical component, performing circular fullness detection on the bottom surface to determine whether the cylindrical component is a cylindrical pipeline; converting the geometric features of each cylindrical pipeline into an instantiated reuse matrix; combining the view frustum parameters of the current viewpoint and the instantiated reuse matrix to perform view frustum culling and occlusion judgment to determine whether each cylindrical pipeline is visible; for cylindrical pipelines, collaborative optimization is achieved in three stages: recognition efficiency, lightweight transmission, and rendering visibility screening. Through the preprocessing mechanism in the early stage of rendering, the overall efficiency of subsequent rendering is effectively improved.

The application discloses a three-dimensional target detection method based on RGBD data and a view cone, and comprises the following steps: acquiring a feature image of a scene RGB image according to the scene RGB image; inputting the feature image of the scene RGB image into a region generation network to acquire a bounding box of a to-be-detected object and a category vector of the to-be-detected object; acquiring a 3D view cone point cloud according to the bounding box of the to-be-detected object and a depth image of the scene; inputting the position coordinates of points in the 3D view cone point cloud and the category vector of the to-be-detected object into a PointNet network with an attention mechanism to acquire the center point coordinates of the to-be-detected object; and further acquiring the parameters of a 3D bounding box of the to-be-detected object to detect the three-dimensional to-be-detected object. The application simultaneously considers the plane information and the depth information of a scene, improves the detection precision, and makes the detection result more accurate while ensuring the efficiency.

The invention relates to the field of image processing, in particular to an industrial gas leakage detection method based on infrared thermal imaging, which comprises the following steps of: acquiring video streams by using a plurality of infrared thermal imagers, and constructing a gas basic geometric voxel grid through a background difference and view cone intersection method; thirdly, the sight line penetration depth and a statistical variable coefficient are calculated, and adaptive normalized radiation feature mapping based on statistical moments is constructed so as to solve errors caused by traditional homogeneous hypothesis; then, measuring and calculating a three-dimensional form compactness factor, generating a heterogeneous space density field weight in combination with the relative depth, and fitting a real diffusion gradient; and finally, calibrating a physical mapping coefficient by using single-point sensor data, and performing integral calculation on the real-time mass flow in combination with a three-dimensional optical flow method. According to the invention, the complex density gradient in the gas can be effectively reduced, and high-precision three-dimensional visual display and quantitative flow monitoring of gas leakage are realized.

This invention discloses a method and system for optimizing the dynamic loading efficiency of ultra-large scenes in 3D engines, belonging to the field of computer game design technology. It aims to solve problems such as high computational overhead, resource lag, and fragmented video memory in existing scene loading methods. The method includes: constructing a dynamic sparse octree index to achieve ordered spatial data organization; predicting future positions based on viewpoint motion vectors and constructing pre-loaded view frustums; establishing a multi-threaded asynchronous I / O scheduling mechanism to read and convert data in parallel according to priority; implementing video memory pooling management and reference counting strategies to achieve resource reclamation and reuse by page blocks; and using a time-weighted linear interpolation algorithm to achieve smooth switching between multiple levels of detail. The system includes corresponding index construction, state prediction, streaming scheduling, pooling management, and dynamic update modules. Through the above solutions, this invention significantly improves the real-time performance of data loading and hardware utilization, effectively eliminating screen stuttering, white models, and visual jump phenomena.

The invention belongs to the field of image reconstruction, and particularly discloses a multi-stereoscopic view volume rendering method and system based on 3D Gaussian sputtering. The invention provides a brand new self-adaptive control mode, specifically, Gaussian balls in a 3D Gaussian voxel model are classified according to scene features, voxel division operation is performed on each high-detail demand area, voxel merging operation is performed on each low-detail demand area, and voxel dynamic loading is performed. According to the method, the extracted scene features serve as the basis of region classification, high / low detail demand regions under the full view angle can be accurately recognized, the voxel adjustment strategy is strongly bound with the region features, invalid voxels are filtered out in combination with a dynamic loading mechanism of view cone removal, and therefore, the accuracy of region classification is improved. Compared with a traditional algorithm, the method has the advantages that the frame rate of complex scene rendering is increased by 20%-40%, the sharpness of object edges is increased by more than 30%, the occupation of a GPU video memory is reduced by 30%-50%, and the multi-scene rendering requirement is met.

Disclosed are a multimodal weakly-supervised three-dimensional (3D) object detection method and system, and a device. The method includes: shooting multiple two-dimensional (2D) red, green and blue (RGB) images with a camera, acquiring ground points by a vehicle LiDAR sensor and generating a 3D frustum based on 2D box labels on each of the 2D RGB images; filtering ground points in the 3D frustum and selecting a region with most 3D points; generating a 3D pseudo-labeling bounding box of an object according to the region with the most 3D points; training a multimodal superpixel dual-branch network with the 3D pseudo-labeling bounding boxes as labels and the 2D RGB image and the 3D point cloud as inputs; and inputting a 2D RGB image of a current frame and a 3D point cloud of a current scenario to a trained multimodal superpixel dual-branch network to generate an overall 3D point cloud.

A see-through display method and a see-through display system are disclosed. The method includes the following steps. A user image is captured toward the front side of a display through a first image sensor, and a scene image is captured toward the rear side of the display through a second image sensor. User position information associated with the three-dimensional reference coordinate system is obtained according to the user image. Scene position information associated with the three-dimensional reference coordinate system is obtained according to the scene image. A viewing frustum is determined based on the user position information and a physical size of the display. A projection matrix of the viewing frustum is used to generate a display frame projected on the display plane of the display according to the scene position information. The display frame is output through the display to show the scene behind the display.

The weak constraint 3D WebGIS video fusion method belongs to the technical field of virtual video fusion, and is characterized in that: including the following steps: S1, three-dimensional model construction; S2, three-dimensional model optimization adjustment; S3, 3D WebGIS platform construction; S4, access to video stream data; S5, model view matrix and projection matrix calculation; S6, view cone construction and occlusion detection; S7, rendering based on WebGL fragment shader; S8, video image dynamic texture mapping; S9, video projection edge feathering; S10, dynamic parameter adjustment. The weak constraint 3D WebGIS video fusion method solves the problem of video projection occlusion to a certain extent, realizes video fusion under weak constraint, improves the video fusion effect, and has high practicability, applicability and adaptability.

The invention relates to the technical field of photography data processing, in particular to a large-volume oblique photography data visualization loading method and system, and the method comprises the steps: obtaining OSGB format original data; during preprocessing, grids are divided according to spatial scales, OSGB files of low-level LOD are merged into 3DTiles by an octree, an index is generated, and after surface features are semantically segmented by AI, simplification is carried out according to engineering requirements; the dynamic LOD scheduling comprises the steps of dividing an octree into multiple layers of tiles, screening visible tiles through a view cone, filtering shielding through ray detection, and slicing pixel errors; storing the data in a register-memory-SSD-HDD four-level cache by using an LRU-K strategy; performing GPU rendering on SSD data, and adjusting LOD according to a feedback load; the system comprises a data preprocessing module, a dynamic LOD processing module, a distributed cache module and a renderer module which cooperatively realize efficient loading. The problems that in an existing oblique photography data loading technology, static LOD adaptation is poor, data blocks are single, storage hierarchies are insufficient, and the video memory utilization rate is low are solved.

This disclosure provides a method for clustering point light sources, a rendering method, and a computer program product. The method includes: acquiring a point light source dataset corresponding to a target geographic region, wherein the point light source dataset includes the identifier, location, and radius of each point light source, and the number of point light sources is two or more; establishing an association between the identifier of each point light source and the geographic grid obtained by pre-dividing the target geographic region based on the location range of each point light source and the geographic grid obtained by pre-dividing the target geographic region; determining the target geographic grid related to the visible range of the view frustum based on the location range of the geographic grid, the view frustum parameters, and the camera pose; using the point light sources associated with the target geographic grid as point light sources to be processed, and clustering the point light sources to be processed based on the view frustum parameters, the location and radius of the point light sources to be processed, and the preset number of blocks of the view frustum clipping plane, wherein one cluster corresponds to one block of the clipping plane, and the number of point light sources in each cluster does not exceed a preset number threshold.

The application relates to the technical field of multimedia data transmission, and particularly relates to a multimedia data transmission method and system. The method determines a target space unit where a gaze point is located according to gaze point data of each client, and determines a plurality of peripheral space units covered by a view cone according to a view cone range parameter of the client; a highest enhancement precision level is allocated to the target space unit of each client, and a corresponding enhancement precision level is allocated according to the distance between the plurality of peripheral space units of each client and the gaze point; a predicted target space unit of the client is predicted according to the gaze point data change track of the client in a historical time period; a predicted attention client quantity distribution paying attention to the predicted target space unit is acquired, and model data corresponding to the enhancement precision level of the predicted target space unit is transmitted to the corresponding client according to the predicted attention client quantity distribution, so that the user experience in a virtual reality environment is effectively improved.

The invention discloses a visualization method, device and equipment for monitoring data in a machining process and a medium, and relates to the technical field of precision manufacturing, and the method comprises the following steps: obtaining coordinate data of a cutter and machining monitoring data in a workpiece cutting process; performing data fusion of the coordinate data and the processing monitoring data based on real-time stream processing and real-time linear interpolation of historical data to obtain fused data; constructing a three-dimensional scene of the workpiece cutting process based on a finite element network, and putting the fusion data into the three-dimensional scene; and according to the three-dimensional scene, the fusion data in the view cone is rendered, and the rendering depth is determined according to the fusion data and the visual distance of the user. According to the method, the physical state of the cutter in the cutting process can be reproduced in real time, omnibearing visualization of the machining process in the three-dimensional angle and the stress aspect is achieved, then the real-time visualization monitoring effect of the numerical control machine tool machining process is achieved, and networking and informatization development of the numerical control technology is promoted.

This invention belongs to the field of image processing technology. It provides a method, apparatus, and system for rendering digital content in an image, comprising: acquiring all transparent objects in the rendering scene, classifying and labeling them and assigning unique IDs; dividing the scene into equal spatial blocks using an octree algorithm; equipping each spatial block with a unique set of classification labels; constructing a static transparent object depth value table; establishing a dynamic depth value prediction model by combining dynamic object motion parameters, animation keyframes, or interaction history; filtering effective spatial blocks through axis-aligned bounding boxes and view frustum intersection tests; generating an initial rendering sorting table by combining the maximum depth value of static objects and the depth stability weight of dynamic objects; filtering overlapping transparent object combinations based on oriented bounding boxes and the separating axis theorem; verifying spatial relationships using ray casting; and correcting the sorting order using a weighted scoring method.

This invention discloses a GPU-based method and system for culling invisible objects. The method calculates the six plane equations of the view frustum of the observation camera and the world coordinates of each observed object. It then uses the GPU to calculate in parallel the front or back face of each observed object on a certain plane of the view frustum, thereby determining whether the object is outside the view frustum and culling all objects outside the view frustum. Next, hierarchical Z-buffer data is generated in the GPU using the depth map of the current frame. The object's position and other information are passed to the GPU and used to calculate with the hierarchical Z-buffer data, culling completely occluded objects. This invention utilizes the parallel computing power of the GPU, improving culling efficiency, significantly reducing the CPU computational burden during rendering, and reducing the probability of culling errors.

The present application relates to unmanned aerial vehicle inspection technology field, concretely for edible mushroom house autonomous inspection unmanned aerial vehicle system based on multi-source information fusion, the system includes: point cloud filtering module, pose estimation module, voxel modeling module, inspection planning module, coverage optimization module.In the present application, by constructing the joint screening mechanism of reflection intensity gradient and geometric curvature, the physical properties of the layer frame metal edge and the environment background are stripped and the pose optimization weight is given, the soft film interference is eliminated and the rigid skeleton is forced to lock to maintain the positioning stability in complex environment, the three-dimensional voxel information entropy gradient is used to drive the viewpoint active optimization decision, the aircraft is guided to shoot again in the fuzzy area and avoid the block automatically, the high-precision reconstruction is completed with the least shutter number, the image and the physical grid overlap proportion are calculated based on the effective projection section of the view cone, the space index logic with primary and secondary level weight is established, and the inspection data is accurately archived to the corresponding physical position and the information retrieval accuracy is improved.

The invention discloses a 3D scene loading optimization method and device based on a WeChat applet and a medium, and relates to the technical field of scene loading optimization, and the method comprises the steps: obtaining an original 3D model file, and splitting the original 3D model file to obtain a multi-stage 3D resource file; constructing a scene frame corresponding to the multi-level 3D resource file to determine an interactive 3D scene graph; based on the interactive 3D scene graph, obtaining a resource loading sequence through view cone priority analysis; according to the resource loading sequence, determining a dynamic renderable 3D scene through asynchronous queue loading; and performing rendering process optimization on the dynamic renderable 3D scene to obtain an adaptive 3D scene. By means of the method, the technical problems that in an existing WeChat applet environment, the 3D scene loading speed is low, the rendering performance is poor, and the network flow requirement is high are solved.