Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

88 results about "Motion recovery" patented technology

Construction site three-dimensional scene reconstruction method based on unmanned aerial vehicle image and monitoring video

The invention discloses a construction site three-dimensional scene reconstruction method based on an unmanned aerial vehicle image and a monitoring video. The method comprises the following steps: acquiring a construction site scene multi-view image; a sparse three-dimensional point cloud and a camera pose are generated through a feature matching and motion recovery structure algorithm, and dense reconstruction is carried out to obtain a global three-dimensional point cloud; aligning the global three-dimensional point cloud with a world coordinate system by using geographic position information; estimating the position of a shooting camera in the three-dimensional point cloud, sampling a candidate view angle and rendering a virtual RGB image; based on two-dimensional feature matching of the shot image and the virtual RGB image, internal parameters and external parameters of the shooting camera are iteratively solved through triangulation and a pose optimization algorithm; monocular depth estimation is carried out on the shot image, and the shot image is converted to a measurement scale through static region depth alignment; and projecting the depth of the shot image to the three-dimensional point cloud, updating the dynamic object in real time, and fusing the dynamic object into a complete three-dimensional scene model. The method has the advantage that the real-time three-dimensional reconstruction of the dynamic scene of the construction site is realized.
Owner:CHINA RAILWAY 24TH BUREAU GROUP CO LTD

Building group safety inspection method based on external structure size displacement detection

The invention relates to the technical field of building structure health monitoring, and particularly discloses a building group safety inspection method based on external structure size displacement detection, and the method comprises the steps: obtaining three-dimensional laser scanning point cloud data of a target building group at a plurality of time points, adding timestamp information, and constructing a time sequence point cloud data set; initial registration is carried out by adopting a feature matching and motion recovery structure technology, and the registration precision and stability in a dynamic environment are improved in combination with a global optimization model fused with space-time consistency constraints; identifying and eliminating pseudo displacement point clusters through track consistency analysis, and extracting a static background structure; finally, key part deformation identification is carried out on the differential point cloud data, and a structure health state evaluation report is generated. According to the invention, full-process automatic processing from data acquisition, optimization registration to intelligent evaluation is realized, the dynamic interference influence is effectively inhibited, the precision and reliability of structural deformation monitoring are improved, and technical support is provided for long-term safety inspection of building groups.
Owner:SHENZHEN ZHONGRUIHENG MANAGEMENT PLANNING CO LTD

Oblique photography three-dimensional earth surface model geological modeling system and method

ActiveCN120707760A3D modellingTerrainVoxel
The invention relates to the technical field of three-dimensional geological modeling and geological mapping data processing, in particular to an oblique photography three-dimensional surface model geological modeling system and method, and the system comprises a data collection module, a scene construction module, a boundary line processing module, a geologic body modeling module, a profile linkage module and a result output module. The data acquisition module fuses the oblique photography image and topographic data, and generates a three-dimensional earth surface model through a motion recovery structure algorithm; the geologic body modeling module constructs a closed geologic body through implicit curved surface reconstruction and constrained triangulation; a profile linkage module calls a graph neural network to predict a stratigraphic intersection line trend, and realizes two-dimensional and three-dimensional real-time synchronization based on event driving and sparse voxel hash mapping; and the result output module executes data verification and generates a multi-dimensional geological report. According to the scheme, dependence of a third-party tool is eliminated, geological mapping efficiency is improved, and the problem of section linkage delay is solved.
Owner:HUBEI CHANGLU JINGTONG INFORMATION TECHNOLOGY CO LTD

Three-dimensional geographic environment real-time intelligent deduction method based on multi-modal large model

The invention discloses a three-dimensional geographic environment real-time intelligent deduction method based on a multi-modal large model, and relates to the technical field of computer vision. The method is used for solving the technical problem of unified modeling and real-time deduction of a dynamic object and a static environment in a three-dimensional geographical environment. The method comprises the following steps: firstly, resolving a camera pose through a motion recovery structure algorithm to generate a sparse point cloud, and separating a dynamic foreground object in a monitoring video to extract motion features; thirdly, initializing a three-dimensional Gaussian distribution set based on the sparse point cloud, extracting semantic features through a visual encoder, and mapping the semantic features to corresponding Gaussian distribution; thirdly, a topological graph structure of Gaussian distribution is constructed, motion features are used as initial excitation, and coordinate offset and appearance variation of each distribution are iteratively updated through message passing calculation; finally, Gaussian distribution attributes are dynamically updated, a continuous deduction image sequence is synthesized through micro-rasterization rendering, and high-reality real-time simulation of dynamic evolution of the three-dimensional geographical environment is achieved.
Owner:LIAONING HONGTU CHUANGZHAN SURVEYING & MAPPING CO

Unmanned aerial vehicle bridge detection method based on machine vision

The invention discloses an unmanned aerial vehicle bridge detection method based on machine vision. According to the method, an unmanned aerial vehicle is used as an autonomous mobile platform, and full-coverage and high-resolution image data acquisition of structural surfaces such as a bridge deck, a beam body and a bridge pier is realized through systematic task planning. The collected data is processed by a motion recovery structure and a multi-view three-dimensional algorithm to generate a high-precision three-dimensional live-action model and a digital orthophoto map. On the basis, a deep learning target detection algorithm is adopted to perform intelligent analysis on the image, apparent defects such as cracks, spalling and corrosion are automatically identified, positioned and classified, and accurate quantification of parameters such as crack width and spalling area is realized. According to the method, the problems of high risk, low efficiency, high subjectivity, existence of detection blind areas and the like in traditional manual detection are effectively solved, and key technical support is provided for digital and intelligent transformation of bridge operation and maintenance management.
Owner:江西软件职业技术大学 +1

Multi-unmanned aerial vehicle rapid three-dimensional reconstruction and decision-making auxiliary method for disaster site and related equipment

The invention provides a disaster site-oriented multi-unmanned aerial vehicle rapid three-dimensional reconstruction and decision-making auxiliary method and related equipment, and belongs to the technical field of emergency surveying and mapping and three-dimensional reconstruction. The method comprises the steps that multiple unmanned aerial vehicles are used for cooperatively collecting image data of a disaster site, and uncertainty indexes used for representing the data missing degree are constructed; taking the uncertainty index as input, selecting an optimal viewpoint to generate a supplementary collection task and executing the supplementary collection task based on the contribution degree of candidate viewpoints to reduction of uncertainty and the comprehensive cost of executing the viewpoints, and obtaining an image data set with coverage integrity; screening a key frame set for three-dimensional reconstruction from the image data set; performing motion recovery structure and space partitioning based on the key frame set, and fusing depth priori and semantic information to obtain an initialized point cloud; and based on a three-dimensional Gaussian sputtering model, extracting structured elements, constructing a risk cost map, and obtaining a rescue route and a disaster situation decision report. According to the invention, emergency command and rescue actions can be supported.
Owner:CHINA ENERGY ENG GRP GUANGDONG ELECTRIC POWER DESIGN INST CO LTD +1

Small sample new view synthesis method based on reinitialized three-dimensional Gaussian splashing

The invention discloses a small sample new view synthesis method based on reinitialization three-dimensional Gaussian splashing. The method comprises the following steps: firstly, acquiring sparse three-dimensional point cloud and camera internal and external parameters from a training view through a motion recovery structure algorithm; then, sampling points are generated in the point cloud bounding box by adopting a spatial expansion hybrid sampling strategy, and a coarse-grained Gaussian set is constructed and optimized; thirdly, obtaining a rendered image through Gaussian initialization and splash rendering, calculating pixel importance through depth errors and transmissivity, generating a fine-grained Gaussian set through back projection, and optimizing the fine-grained Gaussian set; and finally, calculating a sampling probability based on the cross-view contribution degree, screening key Gaussian distribution, and optimizing to form a final Gaussian set, thereby realizing high-quality new view synthesis. According to the method, the problem of sparsity difference is solved by eliminating extended view dependence, the multi-view consistency and local geometric details of a new view scene are improved, and high-quality new view synthesis of sparse data is realized.
Owner:ZHEJIANG UNIV

Deep learning based method and system for intelligent reconstruction of building three-dimensional model

This invention relates to the field of intelligent reconstruction technology for 3D models, specifically a method and system for intelligent reconstruction of 3D building models based on deep learning. The method includes acquiring multi-source data of the target ancient building; generating a dense point cloud through motion reconstruction and multi-view stereo matching; identifying structural and non-structural components through semantic segmentation and reconstructing an initial mesh model with semantically labeled information; using a graph neural network to analyze the spatial topological relationships of structural components, and combining this with a historical construction knowledge base to generate hierarchical combination methods and connection constraint rules; adaptively adjusting the pose of mesh nodes according to the connection constraint rules to drive the precise assembly of parameterized components, and fusing them to obtain a structured 3D model of the target ancient building. This invention can restore the structural component connection relationships in hidden areas of ancient buildings under non-contact acquisition conditions, significantly improving the structural rationality and geometric accuracy of the 3D model.
Owner:JIANGXI NUCLEAR IND SURVEYING & MAPPING INST GRP CO LTD

Multi-view three-dimensional reconstruction method for slender object based on curve guidance

The invention discloses a multi-view three-dimensional reconstruction method for a slender object based on curve guidance. According to the method, geometric prior and a deep learning segmentation network are fused, two-stage foreground extraction, a curve-guided motion recovery structure (SfM) and a surface optimization module capable of differential Poisson reconstruction are provided, and a set of complete processing flow is established for the problem that a slender and weak-texture object is difficult to accurately reconstruct. The method comprises the following steps: acquiring a multi-view image through a consumer-level terminal and performing frame extraction to obtain an input data set; generating a high-quality foreground mask by utilizing depth estimation and semantic segmentation; performing curve-guided SfM initialization based on the foreground skeleton curve to realize joint estimation of the camera pose and the sparse three-dimensional curve; carrying out surface geometric optimization through a micro Poisson equation and differentiable grid rendering; and designing a multi-branch loss function fusing luminosity, mask, regularization and Gaussian rendering supervision to train the model. Finally, the method can output a three-dimensional reconstruction result of the slender structure with high geometric accuracy, strong structural integrity and smooth surface, and has good robustness and application value.
Owner:NORTH CHINA ELECTRIC POWER UNIV

Underwater long-sight-distance adaptive three-dimensional reconstruction and rendering method based on Gaussian variable-distance field

The invention relates to the technical field of three-dimensional reconstruction and rendering, and particularly discloses an underwater long-sight-distance adaptive three-dimensional reconstruction and rendering method based on a Gaussian variable-distance field, and the method comprises the steps: carrying out the initialization point cloud generation based on a motion recovery structure algorithm for RGB image data obtained by underwater image collection equipment; points on the initialized point cloud are combined with a three-dimensional Gaussian distribution model, a three-dimensional Gaussian primitive is defined, and parameter initialization about information such as a Gaussian geometric center, a three-dimensional covariance matrix, opacity and color is carried out on the three-dimensional Gaussian primitive; the method comprises the following steps: establishing a Gaussian cross-space transformation model, performing transformation from a Cartesian coordinate space to a homogeneous coordinate space on a three-dimensional Gaussian primitive, establishing a Gaussian full-parameter space mapping model, mapping color information of the three-dimensional Gaussian primitive after cross-space transformation into a spherical harmonic function, and spatial adaptive three-dimensional reconstruction and rendering in an underwater long-sight-distance environment are realized.
Owner:DALIAN MARITIME UNIVERSITY

Structural semantic guided bridge point cloud Gaussian splash modeling and rendering method

The invention discloses a structural semantic guided bridge point cloud Gaussian splash modeling and rendering method, and belongs to the technical field of computer vision and bridge engineering digitization. The method comprises the steps of collecting a multi-view image of a bridge, and obtaining a sparse point cloud and a camera pose through a motion recovery structure technology; dense point clouds are generated, deep learning semantic segmentation is carried out, and key components such as piers, bridge floors and cables are identified; mapping the semantic tag back to the sparse point cloud; performing differential Gaussian element initialization on the sparse point cloud based on semantic tags, and endowing different parts with initial shapes conforming to geometric characteristics of the different parts; a geometric constraint loss function is introduced in the optimization process for joint optimization; and finally, outputting a Gaussian splash model of a high-fidelity and accurate geometric structure. According to the method, the problems of model redundancy and geometric distortion when a traditional Gaussian splashing technology is used for processing a bridge scene are solved, and lightweight and high-precision reconstruction and real-time rendering of the bridge model are realized.
Owner:ZHEJIANG UNIV

Forest three-dimensional integrated reconstruction method fusing on-forest and under-forest images

The invention discloses a forest three-dimensional integrated reconstruction method fusing on-forest and under-forest images, and belongs to the technical field of forestry informatization, three-dimensional reconstruction and remote sensing. According to the method, two collection tasks with complementary functions are executed by deploying the same technology; an advanced unmanned aerial vehicle-based cross surrounding route is utilized to perform canopy surveying and mapping, and a crossing unmanned aerial vehicle is innovatively adopted to perform under-forest crossing collection. And carrying out independent reconstruction and high-precision registration on the two groups of homologous image data through a motion recovery structure algorithm, and finally generating a vertical structure integrated forest three-dimensional model. The result shows that the point cloud reconstructed by the CCO route is close to the airborne laser radar in integrity, and the individual tree parameters extracted by the integrated point cloud are highly related to the foundation laser radar. Through an innovative multi-view and multi-level data acquisition and fusion strategy and a single and economic photogrammetry technology, the method has the potential of obtaining comprehensive forest three-dimensional structure information, and a new method is provided for realizing large-scale and high-precision forest dynamic monitoring.
Owner:CHINA AGRI UNIV

Virtual-real fusion method and system based on Gaussian splashing real scene reconstruction

The invention relates to the technical field of computer graphics, in particular to a virtual-real fusion method and system based on Gaussian splash live-action reconstruction, and the method comprises the following steps: S1, carrying out the motion recovery structure processing of an obtained target scene image sequence, and generating a sparse point cloud of a target scene; s2, training the sparse point cloud through a Gaussian splashing technology, generating a live-action three-dimensional Gaussian model, carrying out lightweight processing on the live-action three-dimensional Gaussian model, and outputting a lightweight live-action model; and S3, acquiring an internal parameter matrix, an external parameter matrix and a real-time video stream of the physical camera. According to the method, the spatial mapping relation between the live-action reconstruction model and the artificial fine model is established, the user interaction instruction is responded, and the explicit and implicit states of different detail level models in a unified scene are dynamically controlled, so that smooth switching without context loss from macroscopic to microscopic is realized; the problems of visual angle jump and spatial cognition interruption caused by system switching in a traditional scheme are solved.
Owner:XIAN TALI TECH CO LTD

Power line corridor intrusion real-time detection method and system based on 3D Gaussian sputtering

The invention discloses a power line corridor intrusion detection method based on 3D Gaussian sputtering. The method comprises the following steps: acquiring an unmanned aerial vehicle video sequence of a power line corridor and preprocessing the unmanned aerial vehicle video sequence; based on the preprocessed data, performing three-dimensional reconstruction by using a motion recovery structure and a 3D Gaussian sputtering technology to obtain a high-precision 3D GS model of the power line corridor; based on a two-dimensional image detection and segmentation result, performing semantic annotation on a three-dimensional Gaussian ellipsoid in the 3D GS model through multi-view back projection and fusion, and identifying a target object at least including the engineering machinery and the power transmission conductor; calculating the minimum space distance between the identified engineering machinery and the transmission conductor in the three-dimensional space; and judging whether intrusion occurs or not according to whether the minimum spatial distance is smaller than a safety threshold, and outputting alarm information. According to the method, the problems of low reconstruction precision, indirect measurement, poor real-time performance and the like in the prior art are solved, and real-time three-dimensional detection and early warning of the power line corridor intrusion target are realized.
Owner:JIANGMEN POWER SUPPLY BUREAU OF GUANGDONG POWER GRID CO LTD

Rock mass three-dimensional structural plane intelligent identification method based on AI vision large model

The present application relates to the field of rock mass structure plane identification, and in particular to a rock mass three-dimensional structure plane intelligent identification method based on an AI vision large model. The method combines an artificial intelligence vision large model with a motion recovery structure technology and uses data of different photogrammetry devices to realize three-dimensional structure plane identification. The method converts the identification task from point cloud to original image data by using the correlation between image pixels and point cloud in the motion recovery structure (which is often ignored by previous research), thereby significantly reducing the implementation difficulty. Benchmark tests show that the method achieves an average accuracy of 0.91 in a three-dimensional database and identifies 87 structure planes. The results show that the method has high precision and high efficiency and provides a powerful tool for geological data labeling.
Owner:ZHEJIANG UNIV +1

Three-dimensional model reconstruction method and device based on Gaussian sputtering model

The invention relates to a three-dimensional model reconstruction method and device based on a Gaussian sputtering model. The method comprises the following steps: acquiring a scene image of a sparse view angle of a target scene, and determining initialization parameter information of a Gaussian ellipsoid according to the scene image through a motion recovery structure technology and a Gaussian sputtering model; determining a priori depth, a color loss function and a gradient smoothing loss function through a monocular depth model according to a scene image; determining a reference depth according to the scene image through a multi-view three-dimensional depth estimation algorithm; determining a depth consistency loss function according to the prior depth and the reference depth; and updating the initialization parameter information through a Gaussian sputtering model based on a depth consistency loss function, a color loss function and a gradient smooth loss function, determining updated parameter information, and generating a three-dimensional model of the target scene according to the updated parameter information. The reliability and robustness of the three-dimensional model can be improved through depth prior constraint information and a dynamic gradient control method.
Owner:建科(武汉)勘测设计有限公司

New viewpoint generation method based on point cloud densification and multi-modal collaborative optimization under sparse viewpoint

The invention discloses a new viewpoint generation method based on point cloud densification and multi-modal collaborative optimization under a sparse viewpoint, which belongs to the field of new viewpoint generation and comprises the following steps of: 1, acquiring a sparse viewpoint image; 2, obtaining a camera pose through a motion recovery structure (SfM), and generating a sparse point cloud; 3, generating a depth map of the input image through a DPT model; 4, generating a high-density and low-noise initial point cloud through a point cloud densification process; 5, initializing the densified point cloud into a 3D Gaussian parameter; 6, through semantic regularization and local depth regularization, 3D Gaussian parameters are optimized in a combined mode; and 7, generating a final new view angle image and a final depth map through a 3D Gaussian sputtering engine. According to the method, through global and local feature perception mechanisms, sparse point cloud densification and multi-modal regularization collaborative optimization, the quality and efficiency of new viewpoint generation under sparse viewpoints are improved.
Owner:CHANGCHUN UNIV OF SCI & TECH

Real-time intelligent deduction method for three-dimensional geographic environment based on multi-modal large model

The application discloses a three-dimensional geographic environment real-time intelligent deduction method based on a multi-modal large model, and relates to the technical field of computer vision. The method is used to solve the technical problem of unified modeling and real-time deduction of dynamic objects and static environment in a three-dimensional geographic environment. First, a camera pose is calculated by a motion recovery structure algorithm to generate a sparse point cloud, and a dynamic foreground object in a monitoring video is separated to extract motion features. Then, a three-dimensional Gaussian distribution set is initialized based on the sparse point cloud, semantic features are extracted by a visual encoder and are mapped to corresponding Gaussian distributions. Next, a topological graph structure of the Gaussian distributions is constructed, and the motion features are used as initial excitation to iteratively update the coordinate offset and appearance change of each distribution by message passing calculation. Finally, the Gaussian distribution attributes are dynamically updated, and a continuous deduction image sequence is rendered by differentiable rasterization to realize high-fidelity real-time simulation of the dynamic evolution of the three-dimensional geographic environment.
Owner:LIAONING HONGTU CHUANGZHAN SURVEYING & MAPPING CO

Intelligent grading method and system for tunnel face surrounding rock

The invention discloses an intelligent grading method and system for tunnel face surrounding rock. According to the method, a two-dimensional image, a three-dimensional point cloud and environmental mechanics data of a tunnel face are synchronously collected through a sensor array integrated on tunneling equipment; after space-time registration fusion is carried out on the multi-source data, pixel-level identification and quantitative extraction of geological features are carried out by using a deep learning model, and three-dimensional reconstruction is carried out based on a motion recovery structure algorithm to obtain rock mass structural plane occurrence parameters; visual, geometric and environmental characteristics are fused, and accurate prediction of the surrounding rock grade is realized through an integrated learning model; and finally, dynamic excavation numerical simulation is carried out by combining the three-dimensional geologic model and a prediction result, the surrounding rock stability is analyzed, and safety early warning is generated. According to the method, automation and quantification of the whole process of surrounding rock grading are achieved, and the accuracy and timeliness of tunnel construction safety decision making are effectively improved.
Owner:HUBEI UNIV OF ARTS & SCI

Image quick stitching method and device capable of real-time display

This application discloses a real-time image stitching method and apparatus. The method includes: receiving images uploaded to the cloud by a camera device in real time; extracting feature points from the images and matching feature points between the current frame and the previous frame; calculating the ratio of the homography matrix score to the sum of the homography matrix score and the fundamental matrix score to determine whether to use the homography matrix or the fundamental matrix to recover the image's pose parameters and map points, and initializing the map; estimating the pose of the current frame and optimizing the pose of the current frame using candidate frames; converting the coordinates of the map points to two-dimensional coordinates and performing plane fitting; converting the coordinates of the image corner points in the camera coordinate system to the object coordinate system, calculating perspective transformation parameters and performing geometric transformation on the image; and performing Gaussian pyramid fusion on the generated tiles. This method solves the problems of low efficiency in scene reconstruction using motion reconstruction algorithms and the inability to process real-time photogrammetric data.
Owner:SHAANXI TUDOU DATA TECH CO LTD

Human-centered video scene reconstruction and separation method, system, medium and device

This application provides a method, system, medium, and device for human-centered video scene reconstruction and separation. The method includes: for a first-person perspective video sequence, initializing a 3D Gaussian set covering the background, hands, and objects based on a priori knowledge of structure recovery from motion; assigning a learnable dynamic category probability vector to each Gaussian point in the 3D Gaussian set; constructing a dedicated deformation branch; according to the learnable dynamic category probability vector of each Gaussian point, assigning each Gaussian point to the dedicated deformation branch for processing through a preset soft-hard two-stage routing mechanism, determining the Gaussian points processed by the dedicated deformation branch; rendering the Gaussian points processed by the dedicated deformation branch to determine the 4D scene reconstruction image and the decomposed reconstruction images of the background, hands, and objects. This application achieves 4D scene reconstruction of human-centered video and explicit, fine-grained separation of the background, hands, and objects.
Owner:SHANGHAI JIAOTONG UNIV

Cross-source point cloud registration method based on adversarial neural network

This application belongs to the field of computer vision technology and discloses a cross-source point cloud registration method based on adversarial neural networks. The method includes: inputting a multi-frame LiDAR point cloud sequence and a UAV video sequence; segmenting each frame of the LiDAR point cloud into ground points and non-ground points and registering them to obtain a global LiDAR point cloud; performing motion recovery structure reconstruction on the UAV video sequence to generate a dense color point cloud; inputting the global LiDAR point cloud and the SfM dense color point cloud into an MMAlignNet network to construct a shared latent feature space; solving for the rigid transformation matrix from the LiDAR point cloud to the SfM dense color point cloud; and aligning the cross-modal point clouds according to the rigid transformation matrix to obtain a multimodal 3D reconstruction result. This application improves the registration accuracy, completeness, and robustness of large-scale outdoor environment 3D reconstruction by fusing UAV imagery and mobile LiDAR data, combined with cross-modal feature alignment and geometric constraint optimization methods.
Owner:NANJING UNIV OF POSTS & TELECOMM

Three-dimensional reconstruction and deformation detection method and system for industrial parts

The invention discloses a three-dimensional reconstruction and deformation detection method and system for industrial parts. According to the method, a multi-view image is collected through a monocular camera, and sparse point clouds are obtained through background removal and motion recovery structure processing; a three-dimensional Gaussian sputtering method is adopted for training reconstruction, and the reconstruction quality and efficiency are improved through a progressive strategy, edge tangential densification and a composite loss function; performing point cloud registration on the reconstructed model and a standard CAD model, and sequentially performing geometric center alignment, coarse registration based on multi-neighborhood feature descriptors and fine registration of introducing a robust loss function and dynamic weight optimization to realize high-precision alignment and generate an error cloud picture; and automatically outputting a deformation qualification judgment result based on comparison between the maximum error of the error cloud picture and a preset threshold value. According to the invention, the submillimeter-level requirement of industrial detection is pursued and met in precision, and the efficiency, the cost and the automation level are remarkably improved in practicability.
Owner:HUNAN UNIV

Rock mass structure information intelligent extraction method based on deep learning

The invention relates to the technical field of image data processing, particularly discloses a rock mass structure information intelligent extraction method based on deep learning, and aims to solve the problems that a traditional rock mass structure surface recognition method is low in automation degree, sensitive to point cloud density change and difficult to accurately express plane direction information. A high-quality rock image is obtained through combination of multi-view unmanned aerial vehicle near-earth photogrammetry and high-dynamic range fusion and polarization calculation; reconstructing a three-dimensional point cloud by using a motion recovery structure and a plane perception improved multi-view stereoscopic vision algorithm; constructing a neighborhood by adopting farthest point sampling and ball query, and extracting hierarchical embedding features layer by layer through a point cloud deep learning network; and a plane perception hierarchical density space clustering algorithm is provided, and structural plane clustering is carried out by fusing the embedding representation similarity and the normal vector consistency. According to the method, full-automatic, high-precision and robust recognition of the rock mass structural surface and accurate extraction of occurrence parameters can be realized, and reliable technical support is provided for slope stability analysis and geological disaster early warning.
Owner:POWER CHINA KUNMING ENG CORP LTD +1

Micro-nano structure three-dimensional reconstruction method and system based on scanning electron microscope

The invention provides a micro-nano structure three-dimensional reconstruction method and system based on a scanning electron microscope, and belongs to the fields of biological micro-nano surface structure analysis, ultra-precision machining and manufacturing and the like. The method comprises the following steps: acquiring an SEM image of a multi-view multi-detector of a to-be-measured micro-nano sample, performing initial geometric estimation based on a motion recovery structure algorithm, taking a neural field model as an implicit representation model of a three-dimensional shape, introducing a differentiable BSE forward model, and realizing reconstruction through a three-stage training strategy. According to the method, the neural field is used as a representation basis of three-dimensional reconstruction, so that the reconstruction capability of a complex and discontinuous microstructure is remarkably improved; a standard sample does not need to be used for parameter calibration, reconstruction can be completed only by depending on a group of SEM images of the target sample, and the operation process is simplified; the method has robustness to the shadow area in the image, effectively reduces the interference of the shadow on the surface reconstruction result through the shadow separation strategy introduced in the training process, improves the reconstruction accuracy, and widens the application range.
Owner:ZHEJIANG UNIV

Method for reconstructing sparse view three-dimensional gaussian splatter based on compressed sensing

The application discloses a sparse-view 3D Gaussian splatting reconstruction method based on compressed sensing, and relates to the technical field of computer vision; comprising: step one, running a motion recovery structure from a sparse input image and a camera pose to obtain an initial point cloud, and initializing a 3D Gaussian set based on the point cloud; step two, formulating a local iterative optimization process of the 3D Gaussian splatting into a compressed sensing linear inverse problem, and taking a Jacobian matrix as a sensing matrix. The sparse-view 3D Gaussian splatting reconstruction method based on compressed sensing, by modeling the 3D Gaussian splatting optimization into a compressed sensing linear inverse problem, generates new Gaussian primitives through uniform random sampling, significantly reduces the expected cross-correlation between a sensing matrix and a vector, makes the matrix satisfy a restricted isometry property, fundamentally solves the problems of geometric ambiguity, overfitting and floating artifacts caused by deterministic midpoint splitting, and greatly improves the stability of sparse-view reconstruction.
Owner:UNIV OF SCI & TECH BEIJING

A fisheye image 3D gaussian reconstruction method, system, terminal and storage medium

ActiveCN121505126BImprove realismReduce 3D reconstruction errorsImage enhancementImage analysisPoint cloudAlgorithm
This invention belongs to the field of visual 3D reconstruction technology and discloses a method, system, terminal, and storage medium for 3D Gaussian reconstruction of fisheye images. The method includes: acquiring a fisheye image; generating a sparse 3D point cloud corresponding to the fisheye image based on a motion recovery structure algorithm; optimizing the 3D Gaussian reconstruction algorithm based on a reversible residual network and an octahedral projection model; and reconstructing a 3D model of the fisheye image based on the optimized 3D Gaussian reconstruction algorithm and the sparse 3D point cloud. This invention reduces the 3D reconstruction error of fisheye images by simulating camera distortion parameters of a lens distortion model using a reversible residual network and incorporating these parameters into the 3D Gaussian reconstruction algorithm. Replacing the planar perspective model of the 3D Gaussian reconstruction algorithm with an octahedral projection model reduces stretching and image boundary distortion. The optimized 3D Gaussian reconstruction algorithm is used to generate the 3D model of the fisheye image, improving the realism of the 3D model reconstructed from the fisheye image.
Owner:SHENZHEN UNIV

Oblique photograph three-dimensional surface model geological modeling system and method

ActiveCN120707760B3D modellingTerrainVoxel
The present application relates to the technical field of three-dimensional geological modeling and geological mapping data processing, and particularly relates to a tilt photography three-dimensional surface model geological modeling system and method, comprising data acquisition, scene construction, boundary processing, geological body modeling, profile linkage and result output modules. The data acquisition module fuses tilt photography images and terrain data to generate a three-dimensional surface model through a motion recovery structure algorithm; the geological body modeling module constructs a closed geological body through implicit surface reconstruction and constrained triangulation; the profile linkage module calls a graph neural network to predict stratigraphic intersection trends, and realizes two-dimensional and three-dimensional real-time synchronization based on event driving and sparse voxel hash mapping; and the result output module performs data verification and generates a multi-dimensional geological report. The scheme eliminates the dependence on third-party tools, improves the efficiency of geological mapping, and solves the problem of profile linkage delay.
Owner:HUBEI CHANGLU JINGTONG INFORMATION TECHNOLOGY CO LTD

Automatic identification method and system for slope unstable block under blasting load

The invention provides an automatic identification method and system for an unstable slope block under a blasting load, and relates to the technical field of stability identification, and the method comprises the steps: obtaining the physical and mechanical parameters of a target slope and a multi-angle image of the target slope; processing the multi-angle image of the target slope based on a motion recovery algorithm, and performing structural plane identification on a slope three-dimensional point cloud model obtained through processing by using a clustering algorithm to obtain all single structural planes and geometric parameters thereof; carrying out slope block identification and polyhedron modeling based on all the single structural surfaces and the geometric parameters thereof to obtain a slope polyhedron model; based on the side slope polyhedral model, stability analysis under the blasting load is carried out, and an unstable block of the target side slope is obtained through analysis through safety coefficient calculation under the blasting load. The method has high operation speed, time cost can be reduced, and performance loss can be reduced at the same time.
Owner:SOUTHWEST JIAOTONG UNIV

Method for measuring underwater three-dimensional topography of sandy bed surface

The method for measuring the underwater three-dimensional terrain of the sandy bed surface provided by the present disclosure comprises the following steps: building an image acquisition platform for obtaining an underwater image sequence of the sandy bed surface; arranging water and underwater control points and measuring their coordinates; determining the height, arrangement form and moving space step of the camera array; making all the cameras take pictures of the target water surface area at the same time based on the parameters determined in the previous step, and obtaining the underwater image sequence of the sandy bed surface; performing spatial calculation on the image sequence based on the motion recovery structure method, performing spatial registration only using the water control points, and then performing refraction correction, and then performing spatial registration only using the underwater control points without performing refraction correction, and then performing secondary correction on the point cloud obtained by using only the water control points and performing refraction correction through the average value of the difference between the two, and obtaining the final underwater three-dimensional terrain of the sandy bed surface. The time and space resolution and accuracy of the present disclosure are relatively high, and the observation object is not disturbed.
Owner:INST OF GEOGRAPHICAL SCI & NATURAL RESOURCE RES CAS