4407 results about "Reconstruction method" patented technology

The invention discloses a building digital twinning three-dimensional reconstruction method and system based on a large model, and relates to the technical field of building digital twinning and three-dimensional modeling fusion, and the method comprises the steps: laying multi-source equipment in a building, collecting building multi-angle data, and carrying out type distinguishing and structured preprocessing. An adaptive deep network model is constructed and trained to identify building features, and the robustness of the model is improved by adopting a multi-type enhancement strategy. Point cloud splicing and coordinate unification are realized by using a fusion algorithm, and twin model updating and synchronization are realized based on a multi-dimensional threshold. According to the method, high-quality input is established for a depth model; building structure feature recognition has the advantages of robustness and precision; and the twinborn model has dynamic updatable capability. The three parts form a complete closed loop, the technical bottlenecks of a traditional reconstruction method in precision, stability and renewability are finally broken through, and a new building digital twinning three-dimensional modeling path facing a complex scene is achieved.

The invention provides a reconstruction method of a three-dimensional reconstruction model based on two-dimensional Gaussian splashing, which comprises the following steps: S1, carrying out sparse reconstruction on an input image sequence through a multi-view stereoscopic vision algorithm to generate an initial sparse three-dimensional point cloud and a corresponding camera pose parameter; s2, inputting an improved two-dimensional Gaussian radiation field by using the sparse three-dimensional point cloud and the camera pose as information; s3, dynamically screening a visible anchor point subset based on the current view angle parameter, and generating a rendered image through a differentiable rendering pipeline; s4, calculating a loss function of the rendering image of the training track and the input image to optimize a reconstruction scene; and S5, starting a special visualization tool, and inputting a rendering result. According to the method, by introducing a trimmable anchor point parameterization framework and a multi-scale feature fusion mechanism, light-weight and high-precision three-dimensional scene modeling is achieved, and the problems that traditional 2D Gaussian sputtering is insufficient in multi-view geometric consistency, storage overhead and weak texture region reconstruction and an existing 2D Gaussian splashing method is insufficient in self-adaptive mechanism are solved.

The invention discloses a large-scene three-dimensional reconstruction method based on three-dimensional Gaussian sputtering, and relates to computer graphics. The method comprises the following steps: collecting a multi-view image set of a large scene; obtaining a scene sparse point cloud according to the multi-view image set; performing monocular depth estimation on the multi-view image by using a pre-trained depth prediction network to obtain monocular depth estimation priori; the method comprises the following steps of: performing global training on a scene by utilizing scene sparse point cloud and monocular depth estimation prior to obtain an initial three-dimensional Gaussian model, and performing space grid division on the initial three-dimensional Gaussian model to obtain a plurality of scene blocks with axis alignment bounding boxes; setting image view angle data of each scene block; performing deep supervised training on the Gaussian ellipsoids in the plurality of scene blocks by using a parallel GPU (Graphics Processing Unit); combining the trained scene blocks to obtain a final three-dimensional Gaussian model; in view of low geometric structure reconstruction precision caused by only depending on color information of a multi-view image in large-scene three-dimensional rendering, the method improves the reconstruction precision of large-scene rendering.

The invention discloses a historical block scene three-dimensional reconstruction method and system based on Gaussian sputtering, and the method comprises the steps: collecting a historical block video sequence through a lightweight panorama camera, extracting a multi-frame panorama, and generating an image data set through a projection converter; monocular depth and normal estimation is carried out through a pre-training visual model, and a prior depth and normal graph data set of a historical block scene is constructed; sparse reconstruction is carried out on the multi-view image data set based on the SfM technology, initial point cloud and camera pose information are acquired, and a Gaussian ellipsoid is optimized in combination with prior depth and normal information; dynamically calculating the geometric width estimation value of the street, and guiding and adjusting the adaptive density of the Gaussian ellipsoids of the vertical surfaces on the two sides; rendering the optimized Gaussian ellipsoid through an improved rasterization renderer; and designing a multi-modal loss function and a regularization mechanism to optimize reconstruction and rendering results. According to the method, high-fidelity three-dimensional reconstruction of the historical block scene is realized, and the adaptability of the Gaussian sputtering method to the complex block scene is enhanced.

The invention discloses a three-dimensional Gaussian sputtering scene reconstruction method based on structure perception refined Gaussian, and aims to solve the problems of Gaussian drift, edge blur, structure artifacts and the like of a reconstruction model due to the fact that sparse point cloud contains outliers, Gaussian morphology and normal are mismatched and a multi-dimensional optimization target is lacked in an existing three-dimensional Gaussian sputtering reconstruction method. A key frame is extracted by collecting target scene video data, sparse three-dimensional point clouds are reconstructed by using an SfM algorithm, a depth map and a normal map are generated through a Lotus model, three-dimensional Gaussian distribution is initialized after the sparse point clouds are filtered, a Gaussian covariance matrix is adjusted by using a normal consistency regular term, and the sparse point clouds are extracted. And after structure attribute analysis is carried out, a comprehensive scoring function is constructed to screen Gaussian points, and finally, a combined training framework including luminosity, normal consistency and structure continuity loss is adopted to optimize and generate a three-dimensional Gaussian scene model. The method is mainly applied to the field of three-dimensional reconstruction and multi-view rendering, and scene reconstruction precision and geometric consistency can be improved.

The invention discloses an indoor real scene three-dimensional reconstruction method based on improved 3D Gaussian sputtering, belongs to the technical field of three-dimensional reconstruction, and aims to complement initial point clouds in a self-adaptive manner through a designed feed-forward point cloud densification network, generate a high-density 3D Gaussian radiation field, fill scene missing details and avoid the problem of precision attenuation caused by lack of point cloud constraints. In the cost body optimization stage, a depth regularization loss module is designed by integrating global structure features, depth information is integrated into the optimization process, algorithm reasoning is accelerated, and object structure fuzziness is relieved; and finally, in combination with adaptive density control and Gaussian pruning, radiation field parameters and density distribution are finely adjusted, indoor scene reconstruction with double improvement of visual fidelity and structural integrity is realized, interactive application becomes possible, a real-time solution is provided for indoor scene reconstruction, and application of a three-dimensional reconstruction technology is widened.

The invention, which relates to the technical field of image processing, discloses a city component automatic three-dimensional reconstruction method based on a sub-meter high-resolution remote sensing image, comprising the following steps: acquiring a sub-meter high-resolution remote sensing image of a target area, and establishing an initial ground-image projection mapping relation based on a rational polynomial coefficient model; acquiring a ground control point, correcting the mapping relation, and outputting a registration image; performing multi-view geometric matching on the registered image to generate dense earth surface point cloud, and inputting the dense earth surface point cloud into a semantic neural radiation field network to generate dense point cloud; performing cross-modal feature alignment and fusion on the dense point cloud and the vector data, and outputting a fused multi-source dense point cloud; according to the method, through fine correction of the multi-source remote sensing image, the problems of large registration error, more point cloud sparse noise and semantic deficiency are solved, and high-precision and automatic three-dimensional reconstruction of urban components is realized.

The invention discloses a sparse view three-dimensional reconstruction method and system based on dynamic occlusion perception and multi-prior fusion. The sparse view three-dimensional reconstruction method comprises the steps of obtaining a sparse view; extracting multi-scale geometric features from the sparse view through a feature pyramid network, constructing a probabilistic depth estimation module, and generating an initial sparse point cloud based on the probabilistic depth estimation module; based on the initial sparse point cloud, a dynamic occlusion perception attention mask is introduced, and occlusion area mismatching propagation is inhibited through cross-view visibility analysis and a multi-stage confidence aggregation strategy; and fusing geometric priori, semantic priori and implicit priori, carrying out multi-source priori collaborative constraint through an adaptive weight distribution strategy, enhancing the geometric accuracy of the weak texture region, repairing the occlusion region, and outputting a three-dimensional reconstruction image of the sparse view. According to the invention, the integrity and precision of sparse view reconstruction are improved.

Improved novel 3D imaging and reconstruction methods for quantitative and accurate 3D imaging used in multiple industries, segments, and applications within each. Improvement includes methods and hardware configured to improve performance and lower radiation and improve accessibility. Using simplified system matrix and datasets of little scatter interference in tomographic image acquisition and reconstruction, in some cases, using time continuity and spatial continuity to generate parameter data for substances within VOI for a number of key applications in medical and non-medical fields.

The invention discloses an APT attack chain reconstruction method based on a knowledge graph and a graph neural network, and belongs to the technical field of network security. Multi-source heterogeneous attack clues are subjected to advanced analysis by introducing a large language model, and time sequence enhanced knowledge graph representation and the deep learning ability of a graph convolution attention network are combined, so that the multi-source heterogeneous attack clues are reconstructed. The method promotes the efficient completion and dynamic reconstruction of the attack chain, and solves the problems that in the prior art, due to the problems of data sparsity, relation complexity, time sequence characteristics and the like, obvious limitation exists in the aspects of attack chain completion and inference, and a traditional method lacks the deep learning ability for the implicit relation in the attack chain. And thus, the problem of insufficient inference capability on unknown attack behaviors is solved.

The invention discloses a super-resolution image reconstruction method, system and device based on dynamic frequency domain adaptive coding and contrast constraint optimization, and a medium. The method comprises the following steps: creating an original training data set; image data features and application scenes are considered, and feature extraction is performed on image data by adopting a modular design method; in combination with discrete cosine transform and inverse transform thereof, adaptive transform coding is carried out on different frequency components in the image features through a dynamic weight adjustment mechanism; the U-Net and Transform architectures are combined, isotropic design is optimized, a diffusion model and a feature fusion and reconstruction technology are applied, and diffusion process reconstruction is achieved; by introducing a contrast loss function, contrast learning is carried out between images with different resolutions, and the feature learning ability is enhanced. The image reconstruction method is more intelligent and efficient, and can effectively deal with frequency feature recovery and detail reconstruction problems in a complex image scene.

The invention provides a self-adaptive network topology dynamic reconstruction method and system based on deep reinforcement learning, and relates to the technical field of deep reinforcement learning, and the method comprises the steps: obtaining the topology state information, service flow distribution information and historical reconstruction records of a current network; extracting topological correlation characteristics among nodes through graph convolution operation, and generating fusion state representation in combination with service flow information; inputting the fusion state representation into a deep reinforcement learning model to identify bottleneck nodes and redundant links, and outputting a reconstruction action candidate set; searching and evaluating the long-term cumulative income of the candidate actions through a Monte Carlo tree, and screening an optimal reconstruction action sequence; a graph coloring algorithm is utilized to allocate time slots and process resource conflicts, and a resource-feasible topology adjustment scheme is generated; and extracting a network evolution rule through tensor decomposition, and constructing a topological optimization association mapping graph. According to the method, the network bottleneck can be intelligently identified, the network topology structure is dynamically optimized, and the network performance and the resource utilization rate are effectively improved.

The invention discloses a rapid three-dimensional reconstruction method for an unmanned aerial vehicle mine inspection scene, and particularly relates to the technical field of image processing and three-dimensional modeling, and the method comprises four steps: environment perception collection, inclination angle adaptive path planning, image quality optimization and three-dimensional model construction. Sensing information such as illumination, wind speed and gradient through a sensor to dynamically adjust a shooting strategy, and generating a normal supplementary shooting path in a gradient sudden change area; image quality is improved through image enhancement and feature extraction, and a confidence scoring model is constructed to screen high-quality images to participate in modeling; carrying out confidence evaluation on a modeling result, triggering a supplementary shooting mechanism, and improving the precision and integrity of the model; according to the method, the feature extraction stability of the image under the condition of illumination dramatic change is improved, the image coverage integrity of a high and steep slope area is enhanced, and stable control of image acquisition and fusion in a wind disturbance environment is realized, so that the precision, continuity and robustness of three-dimensional modeling are effectively improved.

The present disclosure relates to the field of computer vision and discloses a three-dimensional dynamic scene reconstruction method and apparatus, and a storage medium. The three-dimensional dynamic scene reconstruction method comprises: acquiring synchronized videos of a plurality of viewpoints of a dynamic scene; computing matching points between video images of different viewpoints, and estimating intrinsic and extrinsic parameters of each camera; obtaining a Gaussian splatting point set {p0} on the basis of a sparse point cloud constructed according to the depth of each matching point; for the first image frame of each video, using {p0} to perform static training thereon, to obtain a Gaussian splatting point set {p}; for the remaining image frames, dividing {p} into a static point set {S} and a dynamic point set {D}, performing dynamic training on {D}, and constructing a dynamic Gaussian splatting point set {P} from {p}, {S}, and the final {D}; and, in view of the intrinsic and extrinsic parameters of each camera, rendering {P} using a Gaussian splatting rendering pipeline, to obtain rendered images at different moments from new viewpoints.

The invention discloses a high-temporal-spatial-resolution refined flow field reconstruction method, device and equipment and a medium, and relates to the technical field of ocean current reconstruction, and the method comprises the steps: carrying out the normalization and temporal-spatial alignment of satellite remote sensing, buoy observation and numerical simulation data; based on the alignment data, performing rehearsal on the unstructured nested grid through an FVCOM model, and then dynamically encrypting the grid according to the flow field gradient and generating a background flow field; inputting the background flow field into a PINN-GAN combined framework, and outputting a refined flow field through physical constraint loss and double-discriminator adversarial training; and scheduling a calculation task by adopting a heterogeneous accelerator, verifying the reconstructed refined flow field in real time, and performing feedback optimization. Through generation of the background flow field and refinement reconstruction, the ocean current flow field with high temporal-spatial resolution can be reconstructed efficiently and accurately.

The invention discloses a three-dimensional human body reconstruction method based on an implicit neural network and a diffusion model, and belongs to the field of three-dimensional reconstruction. According to the invention, a diffusible density volume representation is constructed, and identity-based rendering is realized by using a diffusion model. By adopting parameterized three-dimensional distribution representation, Pareto optimum, balanced realistic rendering and feasible prediction are realized in an unbalanced optimization framework. In order to increase the rendering training speed without sacrificing the quality, mixed multi-resolution hash grid features are adopted to enhance the directional feature representation capability. Meanwhile, a multi-scale structural similarity constraint (MSSC) is provided to maintain identity distinguishability and ensure geometric consistency, so that synthesis with high calculation efficiency and satisfactory visual effect is realized. According to the method, the three-dimensional human body model can be reconstructed from a single image based on limited geometric and appearance information, the method is excellent in topology credibility and visual fidelity, and a more flexible and efficient solution is provided for an actual application scene.

The invention relates to the technical field of oceanographic engineering surveying and mapping, and provides an oceanographic engineering surveying and mapping deep sea terrain reconstruction method, which comprises the steps of multi-modal data synchronous acquisition, frequency domain feature cross enhancement, dynamic convolution feature fusion, inverse projection terrain reconstruction and terrain credibility verification. According to the invention, an acousto-optic multi-mode fusion technology is adopted, and the advantages of acoustic penetrability and optical high resolution are combined, so that the complex terrain detail capturing capability is improved; the dynamic convolution network adaptively adjusts convolution kernel parameters through frequency domain energy, the multi-scale feature fusion effect is enhanced, and the accuracy of terrain texture expression is improved; according to the motion distortion compensation method, carrier attitude drift is corrected in real time through inertial navigation data, and the geometric fidelity of a reconstruction model is guaranteed. The method is suitable for a deep sea complex environment, and provides high-precision terrain reconstruction method support for ocean engineering surveying and mapping and ocean resource exploration.

A high-fidelity three-dimensional reconstruction method for a specular reflection plane comprises the steps of decomposing pixel colors into diffuse reflection and specular reflection components based on a 3D Gaussian sphere, introducing a dynamic reflection ratio parameter and a spherical harmonic function coefficient to respectively represent two reflection characteristics, and simulating light multi-reflection behaviors through weight fusion of cumulative projection and a reflection ratio map. Secondly, in combination with monocular inverse depth calibration, depth smoothing constraint of color gradient weighting and edge mutual exclusion loss, geometric consistency is enhanced, and artifacts are suppressed; a progressive multi-resolution training strategy is further adopted, low resolution is gradually optimized to complete resolution, reflection parameters are activated in stages, 3D Gaussian sphere overgrowth and floating artifacts are inhibited, and efficiency and precision are balanced. According to the method, the reconstruction fidelity of the specular reflection scene is remarkably improved while the real-time rendering advantage of the 3DGS is reserved, and the method is suitable for the high-precision modeling fields of virtual reality, augmented reality and the like.

The invention discloses an aircraft surface flow field intelligent reconstruction method and system based on multi-source data fusion, and belongs to the technical field of flow field intelligent prediction. Acquiring multi-source sensor data on the surface of the aircraft, and constructing a multi-source data set; a flow field reconstruction model based on Transform is constructed; a multi-source data set is adopted to train a flow field reconstruction model; and outputting an aircraft surface flow field reconstruction result based on the trained flow field reconstruction model, and visually displaying the aircraft surface flow field reconstruction result. Based on the strong nonlinear mapping capability of the deep learning model, through training of a large amount of sensor data, high-order correlation characteristics among pressure, heat flow and friction resistance stress can be automatically extracted, through fusion of sparse discrete data, a continuous physical field of the whole surface of the aircraft can be effectively reconstructed, and the method is suitable for the aircraft. The limitation of a traditional analytical model in dealing with a strong nonlinear problem is broken through, and the precision and reliability of aircraft flow field prediction are improved.

The invention discloses a self-adaptive three-dimensional scene reconstruction method and system based on a single panorama, and belongs to the field of computer vision processing. The method comprises the following steps: firstly, generating a depth map through an indoor scene panorama and constructing an initial three-dimensional grid; then generating a multi-view image and a shielding mask thereof based on view conversion, forming a training sample pair for fine tuning of the diffusion completion model, and injecting scene prior information for the model; then extracting a grid boundary contour and calculating a central axis, and adaptively constructing a camera pose set; after the integrity of the grid is optimized through iteration completion, the grid is converted into a 3D Gaussian sputtering field, and Gaussian point parameters are optimized through multi-view data; in the optimization process, an up-sampling strategy of rendering error feedback and edge Gaussian points is adopted, and finally a scene model with complete geometric textures is output. According to the method, a high-quality three-dimensional scene is reconstructed from a single panorama through a structure self-adaptive completion and Gaussian refining technology, and the method is particularly suitable for immersive roaming reconstruction of indoor scenes.

The invention relates to the technical field of topographic mapping, in particular to a DEM super-resolution reconstruction method and system combined with a depth map, and the method comprises the steps: constructing a multi-modal data set which comprises an optical image, a depth map, a low-resolution DEM image and a high-resolution DEM image which are paired; designing a multi-modal fusion super-resolution network; designing a pseudo Siamese feature extraction module to extract low-level features and high-level features of the optical image, the depth map and the low-resolution DEM image; fusing the low-layer feature map generated by the pseudo Siamese feature extraction module in a shallow layer through a multi-scale feature fusion module, and fusing the deep-layer feature map in a deep layer; outputting a high-resolution DEM image through a DEM reconstruction module; and training the multi-modal fusion super-resolution network by using the multi-modal data set and the collaborative loss function. According to the method, the depth map generated by the optical image is used as priori knowledge to guide the DEM super-resolution reconstruction task based on the basic depth large model, a complex fine adjustment process is not needed, and the DEM reconstruction precision and efficiency are improved.

The invention provides a multi-view three-dimensional point cloud reconstruction method and device based on DPE-SE depth estimation, and relates to the technical field of computer vision and three-dimensional reconstruction. The method comprises the following steps: acquiring multi-view image data; preprocessing the image; inputting the preprocessed image into a DPE-SE-based depth estimation model, carrying out key constraint on an edge region through a semantic edge guiding mechanism, carrying out adaptive propagation updating on a weak texture region, realizing accurate depth estimation, and generating a multi-view depth result; then geometric consistency check and multi-scale depth fusion are performed on a multi-view depth result, and a dense depth map is constructed; and finally, performing three-dimensional back projection reconstruction and point cloud optimization processing, and outputting high-quality point cloud data containing three-dimensional coordinates and confidence information. According to the method, the problems of edge mismatching and depth voids are remarkably improved in complex illumination, weak texture and shielding environments, the continuity and structural integrity of the point cloud are improved, and technical support is provided for unmanned aerial vehicle surveying and mapping, building detection and digital twin modeling.

The invention discloses a 3D object reconstruction method combining multi-view fusion and a neural network, and the method comprises the following steps: collecting a multi-view image of a target object, carrying out the geometric calibration and view parameter calibration, and generating a standardized image sequence; inputting the image sequence into a feature extraction and voxel fusion module to obtain a preliminary three-dimensional space representation body as a coarse reconstruction model; performing uncertainty evaluation on the coarse reconstruction model, generating a voxel-level confidence coefficient heat map, and dividing the voxel-level confidence coefficient heat map into a plurality of confidence coefficient intervals; based on the confidence interval, constructing an adaptive repair network with a multi-scale residual path, and outputting and activating different repair paths as required by using a path gating mechanism; and fusing the residual output of each repair path with the coarse reconstruction model to generate an optimized final three-dimensional reconstruction model. According to the method, the risk of excessive repair or error repair can be effectively reduced, the adaptability of the model to complex areas such as sheltered areas is enhanced, and the integrity and precision of the whole three-dimensional reconstruction model are improved.

The invention discloses a dynamic scene three-dimensional reconstruction method and device based on hydrogen energy unmanned aerial vehicle survey, and the method comprises the steps: obtaining dense time sequence multi-view image data of a target region through a hydrogen energy unmanned aerial vehicle platform, and carrying out the preprocessing of radiation correction and geometric correction; carrying out optical flow analysis and deformation rate clustering on the preprocessed image, identifying a pseudo-static anchor point and constructing a dynamic reference field; introducing a dynamic reference field as a soft constraint in a binding adjustment process, and optimizing a camera pose to generate a three-dimensional point cloud with consistent time and space; and finally, mapping the point cloud to a space-time voxel grid, constructing a surface evolution model by using a graph neural network or an anisotropic diffusion algorithm, and calculating a surface deformation vector to realize continuous and high-precision three-dimensional reconstruction of the disaster scene surface deformation process.

The invention relates to the technical field of voice processing, can be applied to service system platforms of medical health, financial science and technology, communication and the like, and discloses an audio compression and reconstruction method, device, equipment and medium. Residual vector quantization and inverse quantization are carried out to generate basic spectrum features; and compensating a high-frequency component by adopting a spectrum expansion network, predicting a time domain error in combination with a long-short-term memory network, generating a time domain residual compensation signal, and superposing the time domain residual compensation signal with the reconstructed time domain audio signal to obtain a target audio signal. Through residual vector quantization and neural network modeling, the audio reconstruction quality under low-bit-rate compression is improved, spectrum detail reservation and time domain error compensation are optimized, meanwhile, the calculation complexity is reduced, and the method is suitable for high-sampling-rate and resource-limited scenes.

Disclosed in the present invention is a bridge scour curved surface morphological feature reconstruction method based on three-dimensional sonar point clouds, comprising the following steps: collecting point cloud data of a three-dimensional morphology of an underwater riverbed terrain near a bridge foundation, and acquiring original point cloud data of a complete morphology of an underwater riverbed; performing denoising and ball pivoting reconstruction preprocessing on the collected original point cloud data to complete preliminary reconstruction of point clouds; on the basis of the point cloud data having undergone preliminary reconstruction, performing point cloud binarization-based scour morphology recognition on the basis of a computer vision principle, calculating scour pit element classification values of all the point clouds, and recognizing scour pit point clouds; on the basis of the recognized scour pit point clouds, using a K-means clustering algorithm for clustering, and calculating the maximum depth of each pier scour pit; and on the basis of the obtained scour pit element classification values of all the point clouds, providing a curved surface reconstruction method based on scour recognition to perform high-precision curved surface reconstruction on the scour pits. The present invention can achieve high-precision scour pit morphology reconstruction.

The invention provides a panoramic image three-dimensional reconstruction method based on 3DGS, and relates to the technical field of computer vision and image processing, and the method comprises the steps: 1, collecting a panoramic image sequence of a to-be-reconstructed scene, carrying out the unified coding through equidistant cylindrical projection, and obtaining a coding data set; and step 2, executing panoramic motion recovery structure processing on the coded data set, and generating six-degree-of-freedom camera pose parameters of each image and a corresponding sparse three-dimensional point cloud. According to the invention, high-precision and high-efficiency panoramic scene three-dimensional reconstruction is realized, a high-quality panoramic image or a dense three-dimensional model can be output, and the three-dimensional reconstruction quality and efficiency are improved.

The invention discloses a three-dimensional scene reconstruction method and device based on large model geometric prior, and a medium, and aims to solve the problems that a conventional 3DGS is liable to have artifacts and detail loss in geometric discontinuity, data redundancy and illumination variation scenes, and predicts a dense depth map and a normal map from a monocular image by using a pre-trained large model. The position and form of the Gaussian kernel are constrained as additional geometric priori; a primitive adjustment strategy based on kernel density estimation is introduced in the training stage, small Gaussian primitives with similar structures and adjacent spaces are combined into a large Gaussian primitive, the rendering quality is kept, redundancy is reduced, and the volume of the model is reduced; an exposure coefficient is adaptively estimated for each input image, an exposure compensation image loss function is constructed, and floating artifacts caused by illumination differences at shooting moments are eliminated. Experiments show that compared with the prior art, the method improves the three-dimensional reconstruction precision and real-time rendering quality of complex illumination and less-texture areas in a public data set and an unmanned aerial vehicle aerial photography scene.

The invention discloses an end-to-end underwater three-dimensional reconstruction method and system based on an underwater imaging model, and belongs to the technical field of underwater image processing. According to the method, deep learning pose estimation is combined with an underwater imaging model; firstly, a multi-frame underwater image sequence is collected as input, a deep neural network is constructed, and the network mainly comprises two core sub-modules: a pose estimation network; secondly, a three-dimensional reconstruction network is adopted, dense point cloud or voxel reconstruction is completed according to the predicted pose and image content, pose estimation and the three-dimensional reconstruction process are integrated in the same system, and overall joint optimization is achieved; and in combination with a self-adaptive underwater imaging model, modeling is performed on physical processes such as underwater illumination attenuation and scattering, so that the reality sense and the accuracy of a reconstruction result are improved. According to the method, high-quality three-dimensional reconstruction of images in a complex underwater environment is realized, and the method can be widely applied to ocean engineering, underwater robots, submarine topography surveying and mapping and underwater cultural relic protection.

The invention relates to the technical field of computer graphics, in particular to a real-time three-dimensional graphic rendering optimization method and device based on deep learning, and the method comprises the steps: carrying out the feature extraction of the geometric, texture and illumination information of a graphic through a multi-modal deep neural network, and generating a high-dimensional feature vector; dynamically adjusting the resolution of the triangular mesh by adopting a graph neural network, and outputting an optimized geometric mesh structure; predicting global illumination of the graph by using a neural radiation field model, and generating an optimized illumination map through a variational auto-encoder; performing fusion analysis on the illumination map and the texture data by using a visual Transform model to generate an adaptive texture mapping scheme; and in combination with a rendering scheduling strategy of deep reinforcement learning and a super-resolution reconstruction method of a generative adversarial network, a rendering result is optimized, and a rendered image is post-processed. According to the method, multiple deep learning technologies are comprehensively utilized, and the quality and efficiency of real-time three-dimensional graph rendering are remarkably improved.