Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

1251 results about "3D reconstruction" patented technology

In computer vision and computer graphics, 3D reconstruction is the process of capturing the shape and appearance of real objects. This process can be accomplished either by active or passive methods. If the model is allowed to change its shape in time, this is referred to as non-rigid or spatio-temporal reconstruction.

Building digital twin three-dimensional reconstruction method and system based on large model

The invention discloses a building digital twinning three-dimensional reconstruction method and system based on a large model, and relates to the technical field of building digital twinning and three-dimensional modeling fusion, and the method comprises the steps: laying multi-source equipment in a building, collecting building multi-angle data, and carrying out type distinguishing and structured preprocessing. An adaptive deep network model is constructed and trained to identify building features, and the robustness of the model is improved by adopting a multi-type enhancement strategy. Point cloud splicing and coordinate unification are realized by using a fusion algorithm, and twin model updating and synchronization are realized based on a multi-dimensional threshold. According to the method, high-quality input is established for a depth model; building structure feature recognition has the advantages of robustness and precision; and the twinborn model has dynamic updatable capability. The three parts form a complete closed loop, the technical bottlenecks of a traditional reconstruction method in precision, stability and renewability are finally broken through, and a new building digital twinning three-dimensional modeling path facing a complex scene is achieved.
Owner:中亿丰数字科技集团股份有限公司

Reconstruction method of three-dimensional reconstruction model based on two-dimensional Gaussian splashing

The invention provides a reconstruction method of a three-dimensional reconstruction model based on two-dimensional Gaussian splashing, which comprises the following steps: S1, carrying out sparse reconstruction on an input image sequence through a multi-view stereoscopic vision algorithm to generate an initial sparse three-dimensional point cloud and a corresponding camera pose parameter; s2, inputting an improved two-dimensional Gaussian radiation field by using the sparse three-dimensional point cloud and the camera pose as information; s3, dynamically screening a visible anchor point subset based on the current view angle parameter, and generating a rendered image through a differentiable rendering pipeline; s4, calculating a loss function of the rendering image of the training track and the input image to optimize a reconstruction scene; and S5, starting a special visualization tool, and inputting a rendering result. According to the method, by introducing a trimmable anchor point parameterization framework and a multi-scale feature fusion mechanism, light-weight and high-precision three-dimensional scene modeling is achieved, and the problems that traditional 2D Gaussian sputtering is insufficient in multi-view geometric consistency, storage overhead and weak texture region reconstruction and an existing 2D Gaussian splashing method is insufficient in self-adaptive mechanism are solved.
Owner:GUANGDONG BOHUA UHD INNOVATION CENT CO LTD

Human subject gaussian splatting using machine learning

Aspects of the subject technology provide for human subject Gaussian splatting using machine learning. A method includes receiving a video input having a scene and a subject. The method also includes obtaining a three-dimensional (3D) reconstruction of the subject and the scene from the video input. The method includes generating a 3D Gaussian representation of each of the scene and the subject. The method also includes generating a deformed 3D Gaussian representation of the subject by adapting the 3D Gaussian representation of the subject to the 3D reconstruction of the subject. The method includes rendering a visual output comprising an animatable avatar of the subject and the scene using differentiable Gaussian rasterization based at least in part on the deformed 3D Gaussian representation of the subject and the 3D Gaussian representation of the scene.
Owner:APPLE INC

Three-dimensional environment reconstruction optimization method based on multi-sensor fusion data

The invention discloses a three-dimensional environment reconstruction optimization method based on multi-sensor fusion data, and relates to the field of three-dimensional environment reconstruction optimization, and the three-dimensional environment reconstruction optimization method based on the multi-sensor fusion data comprises the following steps: S1, collecting multi-source sensor data, and constructing a data set under a unified coordinate system; s2, generating dense visual point cloud, and extracting laser point cloud features to construct a model; s3, establishing a local three-dimensional model, and generating a local environment image; s4, shadow parameters are extracted through shadow geometric analysis, and time sequence optimization is carried out; s5, consistency verification and correction are carried out, and three-dimensional reconstruction data are output; and S6, comparing the reconstruction data with the navigation map database, and carrying out map optimization updating. According to the method, time synchronization and space calibration are carried out on data acquired by the depth camera and the laser radar, complete and accurate three-dimensional information modeling of the target environment is realized, and the geometric precision of environment reconstruction and the image detail reduction capability are improved.
Owner:NORTH CHINA UNIV OF WATER RESOURCES & ELECTRIC POWER

Urban component automatic three-dimensional reconstruction method of sub-meter high-resolution remote sensing image

The invention, which relates to the technical field of image processing, discloses a city component automatic three-dimensional reconstruction method based on a sub-meter high-resolution remote sensing image, comprising the following steps: acquiring a sub-meter high-resolution remote sensing image of a target area, and establishing an initial ground-image projection mapping relation based on a rational polynomial coefficient model; acquiring a ground control point, correcting the mapping relation, and outputting a registration image; performing multi-view geometric matching on the registered image to generate dense earth surface point cloud, and inputting the dense earth surface point cloud into a semantic neural radiation field network to generate dense point cloud; performing cross-modal feature alignment and fusion on the dense point cloud and the vector data, and outputting a fused multi-source dense point cloud; according to the method, through fine correction of the multi-source remote sensing image, the problems of large registration error, more point cloud sparse noise and semantic deficiency are solved, and high-precision and automatic three-dimensional reconstruction of urban components is realized.
Owner:SHAANXI TIRAIN TECH CO LTD

Sparse view three-dimensional reconstruction method and system based on dynamic occlusion perception and multi-prior fusion

The invention discloses a sparse view three-dimensional reconstruction method and system based on dynamic occlusion perception and multi-prior fusion. The sparse view three-dimensional reconstruction method comprises the steps of obtaining a sparse view; extracting multi-scale geometric features from the sparse view through a feature pyramid network, constructing a probabilistic depth estimation module, and generating an initial sparse point cloud based on the probabilistic depth estimation module; based on the initial sparse point cloud, a dynamic occlusion perception attention mask is introduced, and occlusion area mismatching propagation is inhibited through cross-view visibility analysis and a multi-stage confidence aggregation strategy; and fusing geometric priori, semantic priori and implicit priori, carrying out multi-source priori collaborative constraint through an adaptive weight distribution strategy, enhancing the geometric accuracy of the weak texture region, repairing the occlusion region, and outputting a three-dimensional reconstruction image of the sparse view. According to the invention, the integrity and precision of sparse view reconstruction are improved.
Owner:HARBIN INSTITUTE OF TECHNOLOGY (SHENZHEN) (INSTITUTE OF SCIENCE AND TECHNOLOGY INNOVATION HARBIN INSTITUTE OF TECHNOLOGY SHENZHEN)

Rapid three-dimensional reconstruction method for unmanned aerial vehicle mine inspection scene

The invention discloses a rapid three-dimensional reconstruction method for an unmanned aerial vehicle mine inspection scene, and particularly relates to the technical field of image processing and three-dimensional modeling, and the method comprises four steps: environment perception collection, inclination angle adaptive path planning, image quality optimization and three-dimensional model construction. Sensing information such as illumination, wind speed and gradient through a sensor to dynamically adjust a shooting strategy, and generating a normal supplementary shooting path in a gradient sudden change area; image quality is improved through image enhancement and feature extraction, and a confidence scoring model is constructed to screen high-quality images to participate in modeling; carrying out confidence evaluation on a modeling result, triggering a supplementary shooting mechanism, and improving the precision and integrity of the model; according to the method, the feature extraction stability of the image under the condition of illumination dramatic change is improved, the image coverage integrity of a high and steep slope area is enhanced, and stable control of image acquisition and fusion in a wind disturbance environment is realized, so that the precision, continuity and robustness of three-dimensional modeling are effectively improved.
Owner:SANSHANDAO GOLD MINE SHANDONG GOLD MINING LAIZHOU +1

Multi-source information fusion rock three-dimensional reconstruction method and system

The invention relates to the technical field of rock mechanics, and discloses a rock three-dimensional reconstruction method and system based on multi-source information fusion, and the method comprises the steps: obtaining and preprocessing data, carrying out the spatial feature learning of a fusion feature vector through a 3D-CNN network, and constructing a three-dimensional voxel model of rock microscopic damage; converting the fused image data into a point cloud model of the underground cavern surrounding rock structure by adopting a three-dimensional reconstruction algorithm based on point cloud, and constructing a digital twin framework of the underground cavern surrounding rock structure based on an implicit surface reconstruction algorithm; feature parameters output by the three-dimensional voxel model and the digital twinning framework are used as input, and the optimal supporting opportunity and supporting parameters are output through an LSTM-CNN fusion model; in the underground engineering construction process, surrounding rock deformation data are collected in real time, and a supporting scheme is adjusted in real time through a depth deterministic strategy gradient algorithm; according to the method, the scientificity and timeliness of support design under complex geological conditions can be improved.
Owner:HUANENG LANCANG RIVER HYDROPOWER CO LTD +3

Distribution network tree barrier real-time analysis method and system based on dynamic vision and SLAM

The invention discloses a distribution network tree barrier real-time analysis method and system based on dynamic vision and SLAM. The method comprises the following steps: generating a dynamic visual baseline by cooperatively controlling the translation and flight displacement of an unmanned aerial vehicle holder, and constructing a bionic binocular model to simulate a time sequence image into a binocular image pair; generating a depth point cloud through epipolar correction and stereo matching; key targets are recognized and extracted through a semantic segmentation network, and semantic point clouds are generated; establishing a dimensionality reduction motion model by utilizing pan-tilt stability augmentation, and fusing a visual inertial odometer and RTK data by adopting a filtering or optimization algorithm to realize centimeter-level pose estimation; and finally, performing optimization processing on the semantic point cloud, completing three-dimensional reconstruction based on multi-modal fusion, and outputting a risk assessment result through tree line spacing calculation and safety margin analysis. According to the invention, accurate, efficient and automatic routing inspection and risk early warning of the distribution network tree obstacles are realized.
Owner:STATE GRID GANSU ELECTRIC POWER CO

Polarization three-dimensional reconstruction method and system based on prior guide diffusion model

The invention provides a polarization three-dimensional reconstruction method and a polarization three-dimensional reconstruction system based on a prior guide diffusion model, which apply a diffusion model in the field of polarization three-dimensional reconstruction and improve the recovery capability of complex details and the robustness of noise interference resistance. According to the method, a two-stage training mode is adopted, and the generation quality and the calculation efficiency are balanced through step-by-step optimization. In the first stage, a VQGAN codec is independently trained to learn high-efficiency low-dimensional potential representation of an image, and direct high-cost calculation in a pixel space is avoided; in the second stage, learnable parameters of the VQGAN are frozen, a diffusion model is trained on a trained potential space, gradual denoising is guided through a priori condition, and potential features are generated and mapped back to an image space. The diffusion model effectively fuses the physical constraint of the polarization clue and the data prior in the gradual denoising process, and the surface normal with rich details can still be stably generated in the case of noise interference or information loss. Experimental results show that the method provided by the invention is excellent in surface normal reconstruction in a plurality of complex scenes.
Owner:WUHAN UNIV

Point projection type three-dimensional reconstruction and segmentation method and system based on semi-Gaussian pruning

The invention relates to the technical field of computer vision, in particular to a point projection type three-dimensional reconstruction and segmentation method and system based on semi-Gaussian pruning. The method comprises the following steps: respectively obtaining an SFM point cloud and a consistency label mask of a cross-view label based on an obtained multi-view image; initializing the obtained SFM point cloud into an identity semi-Gaussian point cloud, and performing rendering optimization by using a differentiable renderer; densifying the initial sparse point cloud by using a localized semi-Gaussian point management method, and identifying a local error region for resetting and repairing; using the obtained consistency label mask to supervise Gaussian identity feature learning by using cross entropy loss, and using unsupervised 3D regularization loss to force spatially adjacent gauss to maintain identity consistency; according to the method, the identity coding semi-Gaussian kernel method is adopted, the inherent representation fuzziness of a single opacity formula is eliminated, and the positive influence on the identity coding precision is generated.
Owner:YANTAI UNIV

Virtual reality scene three-dimensional reconstruction method and system based on multi-source data fusion

The invention discloses a virtual reality scene three-dimensional reconstruction method and system based on multi-source data fusion, and relates to the technical field of underground commercial and traffic integrated space scene three-dimensional reconstruction. The system constructs a multi-dimensional data set through synchronous acquisition of point cloud, images, poses, positioning and semantic text information; a three-dimensional convolutional neural network is adopted to establish an AI reconstruction fusion model, and a three-dimensional model is generated; the system calculates a structural integrity evaluation coefficient JGPG, a fusion consistency evaluation coefficient RHPG and a VR interaction adaptability evaluation coefficient VRJH, compares the coefficients with corresponding thresholds, triggers an optimization strategy, and finally completes model adaptability optimization and packaging output, thereby improving the reduction degree and interaction performance of a virtual reality scene.
Owner:GUANGDONG ZHONGKE KAIZER INFORMATION TECH CO LTD

Three-dimensional scene reconstruction method and device based on large model geometric prior, and medium

The invention discloses a three-dimensional scene reconstruction method and device based on large model geometric prior, and a medium, and aims to solve the problems that a conventional 3DGS is liable to have artifacts and detail loss in geometric discontinuity, data redundancy and illumination variation scenes, and predicts a dense depth map and a normal map from a monocular image by using a pre-trained large model. The position and form of the Gaussian kernel are constrained as additional geometric priori; a primitive adjustment strategy based on kernel density estimation is introduced in the training stage, small Gaussian primitives with similar structures and adjacent spaces are combined into a large Gaussian primitive, the rendering quality is kept, redundancy is reduced, and the volume of the model is reduced; an exposure coefficient is adaptively estimated for each input image, an exposure compensation image loss function is constructed, and floating artifacts caused by illumination differences at shooting moments are eliminated. Experiments show that compared with the prior art, the method improves the three-dimensional reconstruction precision and real-time rendering quality of complex illumination and less-texture areas in a public data set and an unmanned aerial vehicle aerial photography scene.
Owner:NARI INFORMATION & COMM TECH

End-to-end underwater three-dimensional reconstruction method and system based on underwater imaging model

The invention discloses an end-to-end underwater three-dimensional reconstruction method and system based on an underwater imaging model, and belongs to the technical field of underwater image processing. According to the method, deep learning pose estimation is combined with an underwater imaging model; firstly, a multi-frame underwater image sequence is collected as input, a deep neural network is constructed, and the network mainly comprises two core sub-modules: a pose estimation network; secondly, a three-dimensional reconstruction network is adopted, dense point cloud or voxel reconstruction is completed according to the predicted pose and image content, pose estimation and the three-dimensional reconstruction process are integrated in the same system, and overall joint optimization is achieved; and in combination with a self-adaptive underwater imaging model, modeling is performed on physical processes such as underwater illumination attenuation and scattering, so that the reality sense and the accuracy of a reconstruction result are improved. According to the method, high-quality three-dimensional reconstruction of images in a complex underwater environment is realized, and the method can be widely applied to ocean engineering, underwater robots, submarine topography surveying and mapping and underwater cultural relic protection.
Owner:OCEAN UNIV OF CHINA

Real-time online detection method and system for fruit appearance defects

The invention discloses a fruit appearance defect real-time online detection method and system, and relates to the technical field of image processing, and the system comprises an image capture module, a feature extraction and analysis module, a 3D reconstruction module, a dynamic segmentation module, a defect quantification and grading module, and a topology analysis and detection module. According to the real-time online detection method and system for the fruit appearance defects, the defects of a traditional method in the aspects of detection precision, classification fineness and environmental adaptability are overcome by combining a plurality of processes of multispectral image capture, hierarchical feature extraction, high-dimensional clustering analysis, 3D modeling, defect quantitative evaluation and the like. The system can accurately identify various defect types on the surface of the fruit in real time in a complex detection environment and quantify the severity of the defect types. Compared with the prior art, the system has the advantages that the accuracy, the stability and the real-time performance of defect detection are remarkably improved, an intelligent solution is provided for automatic sorting and quality control of fruits, and meanwhile, the labor cost is reduced.
Owner:SHAANXI FRUIT IND TECH GRP CO LTD

Unmanned aerial vehicle oblique photogrammetry data intelligent processing method and system

The invention provides an unmanned aerial vehicle oblique photogrammetry data intelligent processing method and system, and relates to the technical field of unmanned aerial vehicle photogrammetry, and the method comprises the steps: carrying out the preprocessing of an oblique photogrammetry original image, obtaining the exterior orientation elements of a camera, carrying out the scene semantic segmentation through a deep convolutional neural network, adaptively determining the optimal three-dimensional reconstruction parameters of each region, and obtaining the optimal three-dimensional reconstruction parameters of each region. On the basis of multi-view image matching, feature point parallax information is calculated to generate dense point clouds, different areas are processed by adopting an adaptive grid division strategy and a corresponding noise reduction algorithm, and finally, a three-dimensional scene model with real textures is constructed, so that high-precision three-dimensional reconstruction of different scene areas is realized.
Owner:NANJING WENTU INFORMATION TECH CO LTD

Automatic three-dimensional reconstruction method and system based on power transmission corridor point cloud

The invention discloses an automatic three-dimensional reconstruction method and system based on power transmission corridor point cloud. The method comprises the following steps: acquiring data and exporting point cloud data; noise points, outliers and ground points are removed from the acquired point cloud data of the power transmission corridor, and down-sampling is performed on the point cloud with a large data volume; performing clustering segmentation on the preprocessed point cloud of the power transmission corridor, positioning the position of a tower, determining a point cloud range of a power line, and removing point clouds of other objects on the ground; aiming at the structural characteristics of a power line and an insulator in the power transmission line, extracting point clouds of the power line, the insulator and a tower by adopting a geometric constraint principal component analysis (PCA) algorithm; performing automatic geometric model reconstruction on the tower, insulator and power line point clouds according to different reconstruction rules to generate each module grid model; and transforming the grid model of each module, restoring the grid model to the original position of the point cloud, and generating a power transmission line digital twin model conforming to the real size. According to the method, automatic segmentation, classification and real-time reconstruction can be accurately carried out on the point cloud of the power transmission corridor.
Owner:NARI INFORMATION & COMM TECH

Single-Pass 3D Reconstruction of Internal Surface of Pipelines Using Depth Camera Array

A system for inline inspection of a pipeline where the system includes: an inline vehicle to transport the system along the pipeline: a depth camera array (DCA) of multiple RGBD cameras located on an end of the vehicle, circular lights attached around the cameras to illuminate inside the pipeline, and a controller connected to the DCA.
Owner:NUTECH VENTURES LTD

Interventional surgery navigation method based on multi-modal image fusion

The invention relates to the field of cardiology department operations through vascular intervention, and discloses an interventional operation navigation system based on multi-modal image fusion, which comprises a preoperative three-dimensional reconstruction and planning module, which is mainly used for generating a three-dimensional model of a heart through preoperative image data, and planning the position and section of an intraoperative ICE ultrasonic probe based on the model, the intraoperative multi-modal fusion navigation module is mainly used for fusing a three-dimensional model generated before an operation with an intraoperative real-time image and providing accurate navigation support for a doctor; and the dynamic feedback optimization module is mainly used for updating a dynamic track in real time and performing safety protection. According to the invention, through the preoperative three-dimensional reconstruction and virtual path planning module, in combination with the improved 3D U-Net network and the high-precision segmentation algorithm, a three-dimensional model containing key anatomical markers is generated, 20 groups of ICE probe alternative paths are planned, seamless connection of preoperative three-dimensional anatomical information and intraoperative real-time images is realized, doctors can quickly call pre-planned paths, and the accuracy of the ICE probe anatomy is improved. Adjusting time during operation is shortened, and operation efficiency is improved.
Owner:NINGBO FIRST HOSPITAL

Single-view large-scale outdoor scene three-dimensional reconstruction method based on three-dimensional Gaussian splashing

The invention discloses a single-view large-scale outdoor scene three-dimensional reconstruction method based on three-dimensional Gaussian splashing, and the method comprises the steps: collecting a pseudo aerial image, and constructing a panoramic multi-mode supervision end-to-end single-view three-dimensional reconstruction model; meanwhile, panoramic consistency supervision, semantic constraint depth regularization and a radial weighted luminosity loss and Gaussian cutting mechanism are introduced, so that the defect of insufficient geometric constraint of traditional single-view three-dimensional reconstruction is effectively overcome, and high-efficiency and high-fidelity three-dimensional modeling of a large-scale outdoor scene under single image input is realized; the method is suitable for various actual scenes such as smart city construction, automatic driving simulation, virtual reality / augmented reality, digital twinning and the like.
Owner:HANGZHOU MAQUAN INFORMATION TECH CO LTD

Building refined three-dimensional reconstruction method based on airborne LiDAR point cloud

The invention relates to a building refined three-dimensional reconstruction method based on airborne LiDAR point cloud, and belongs to the technical field of three-dimensional modeling. According to the method, high-quality building point cloud data is separated from original airborne LiDAR point cloud data, features and bottom contour lines related to a building are extracted, a roof surface is fitted, and the features and the bottom contour lines are projected to the same horizontal reference surface, so that correlation correction of the features and the bottom contour lines is realized; and completing preliminary reconstruction of a building model by using the corrected building bottom contour line and roof surface, constructing constraint conditions by using priori knowledge, and completing expression of detail components on the model and correction of the reconstructed building roof surface. According to the method, the problems of irregularity, distortion, cavities, difficult facade detail structure expression and the like of the reconstruction model caused by the problems of sparse, missing, cavities and the like of the building facade point cloud data in the prior art are effectively solved, and the problems of irregular edges, distortion, cavities and the like of the constructed building model are solved while efficient, automatic and refined modeling is realized.
Owner:SOUTHWEST JIAOTONG UNIV

Methods of reducing adverse effects of non-thermal ablation

The present invention provides systems, methods, and devices for electroporation-based therapies (EBTs). Embodiments provide patient-specific treatment protocols derived by the numerical modeling of 3D reconstructions of target tissue from images taken of the tissue, and optionally accounting for one or more of physical constraints or dynamic tissue properties. The present invention further relates to systems, methods, and devices for delivering bipolar electric pulses for irreversible electroporation exhibiting reduced or no damage to tissue typically associated with an EBT-induced excessive charge delivered to the tissue.
Owner:VIRGINIA TECH INTELLECTUAL PROPERTIES INC

Depth map generation method and device based on large model, three-dimensional reconstruction method and device, electronic equipment and storage medium

The invention provides a depth map generation method and device based on a large model, a three-dimensional reconstruction method and device, electronic equipment and a storage medium, relates to the technical field of artificial intelligence, in particular to the technical fields of computer vision, deep learning, large models and the like, can be applied to real-time road scene depth perception, environment three-dimensional reconstruction and obstacle avoidance, and can be applied to real-time road scene depth perception. And virtual and real scene fusion and other scenes can be realized. The specific implementation scheme is as follows: performing visual coding on a monocular image to obtain a coded image; inputting the coded image and the target text into a pre-trained large language model for fusion to obtain fusion features; generating global guide features based on the fusion features, wherein the global guide features comprise joint semantic information of visual features and text features; adding noise to the color image of the monocular image to obtain a noise feature sequence; de-noising the noise feature sequence under the condition of the global guide feature, and generating an implicit feature matched with the joint semantic information; a depth map is generated based on the implicit features.
Owner:BEIJING BAIDU NETCOM SCI & TECH CO LTD

Adaptive welding seam detection and three-dimensional reconstruction method based on deep learning and binocular vision

The invention provides an adaptive welding seam detection and three-dimensional reconstruction method based on deep learning and binocular vision. The adaptive welding seam detection and three-dimensional reconstruction method comprises the steps of S1, collecting samples and making a training data set; s2, the picture of the sample to be welded is processed, a feature region is recognized, the image quality of the region to be welded is analyzed and evaluated through wavelet transform and local variance, and the noise level and the contrast ratio are calculated; s3, dynamically generating edge detection parameters and model fitting parameters according to the image quality; s4, using an edge detection algorithm to extract edge point cloud of the welding seam area; s5, performing RANSAC linear fitting, weighted least square fitting and polynomial curve fitting on the edge point cloud in parallel; s6, selecting an optimal fitting result based on an image quality adaptive dynamic scoring model; and S7, carrying out three-dimensional coordinate conversion in combination with the three-dimensional matching model IGEV-Stereo, and outputting a final welding seam three-dimensional coordinate. According to the invention, automatic detection of the position and size of the welding seam can be efficiently and accurately realized.
Owner:HOHAI UNIV

Sparse view outdoor scene three-dimensional reconstruction method based on multi-view stereo and grid

The invention belongs to the technical field of three-dimensional reconstruction in computer graphics, particularly relates to a sparse view outdoor scene three-dimensional reconstruction method based on multi-view stereo and grids, and aims to solve the problems that input depends on dense views, rendering results are prone to generating fuzzy artifacts, large-scale scene memory occupation is high and the like in the existing reconstruction technology. The method is especially suitable for high-precision reconstruction of an outdoor boundless scene under sparse view input. The method comprises the following implementation steps: acquiring a multi-view image of a scene to be reconstructed and a corresponding camera pose, and determining a scene center based on a K-means clustering algorithm; extracting input view features, generating a cost body based on a multi-view three-dimensional framework, and obtaining scene depth distribution priori by combining a probability depth estimation method; guiding voxel grid sampling based on depth distribution, and mapping light rays exceeding a grid boundary into a limited grid range by using a spatial contraction function; extracting image local features and voxel grid global features for adaptive fusion; and finally, generating a reconstructed image through volume rendering.
Owner:CHANGCHUN UNIV OF SCI & TECH

Four-eye structured light stereoscopic vision imaging method

The invention relates to the technical field of three-dimensional imaging, in particular to a four-eye structured light stereoscopic vision imaging method, which comprises the following steps of: arranging four cameras and synchronously acquiring multi-view image data with structured light stripes; carrying out image preprocessing and stripe code identification on the obtained four-view-angle structured light image data, and extracting structured light stripe center line positions and corresponding space projection information under each view angle; generating three-dimensional point cloud data of the high-precision target sample by using parallax calculation and a three-dimensional reconstruction algorithm, and completing spatial registration and filtering optimization of point cloud; fusing the point cloud and the light intensity data by combining the reflection intensity information of the multi-view structured light stripes to generate a composite data set containing space and spectral information; and constructing a dense parallax field and executing three-dimensional consistency verification, and generating a high-fidelity three-dimensional reconstruction model with a complete topological relation and sparse shielding compensation capability. According to the invention, the problems of insufficient view angle coverage, shielding area information loss, difficult edge structure matching and the like of traditional stereoscopic vision imaging can be solved.
Owner:CHAOLIAN AUTOMATION (SUZHOU) CO LTD

Three-dimensional reconstruction system for immovable cultural relics

The invention discloses an immovable cultural relic three-dimensional reconstruction system which comprises a data acquisition module, a feature extraction module, a restoration simulation module and an optimization and decision module. The data acquisition module is used for acquiring three-dimensional data of an antique; the feature extraction module is used for extracting key features of antiques by using a deep learning algorithm; the restoration simulation module is used for constructing a virtual restoration model based on the extracted features, simulating an antique restoration process and evaluating a restoration scheme; and the optimization and decision module is used for realizing precise positioning and navigation of a repair site in combination with the SLAM technology, optimizing a repair path and assisting a repairer in making a scientific decision. According to the method, the repairing efficiency and precision are remarkably improved, automation and intelligentization of the ancient object repairing process are achieved by introducing advanced technologies such as deep learning and NeRF, the repairing efficiency and precision are greatly improved, and the repairing period is shortened.
Owner:ZHEJIANG COLLEGE OF CONSTR

Station platform gauge intelligent detection method and system based on computer vision

The invention relates to the technical field of computer vision, in particular to a station platform limit intelligent detection method and system based on computer vision, and the method comprises the following steps: obtaining platform region spectral data, extracting spectral features according to the reflectivity value of each pixel point in a spectral range, comparing the spectral features with the features of various known materials, and determining the position of the station platform limit. And identifying material types of the plurality of positions, detecting obstacles, and generating material classification feature values. According to the method, the spectral data is acquired, the reflectivity value is compared to identify the material type, the texture feature and the gradient change rate are utilized to analyze and identify the fuzzy area, misjudgment on the fuzzy identification is reduced, point cloud data and image information are adopted for time-space synchronous registration, and multi-source sensing information is fused to enhance the time-space consistency of three-dimensional reconstruction. The size accuracy of the platform model is improved, the space offset is calculated by comparing engineering design drawing data, a structure deviation quantitative evaluation system is established, a deformation area is positioned, and the foreseeability of safety early warning is improved.
Owner:SHAZHOU PROFESSIONAL INST OF TECH

3D gaussian diffusion for single-view reconstruction

Methods, devices, and processor-readable media for method for performing a 3D reconstruction from a single view image, comprising progressively denoising a randomly initialized set of 3D-gaussian representations with continuous guidance from an input image.
Owner:HUAWEI TECH CO LTD

Video dynamic target three-dimensional reconstruction method based on artificial intelligence

The invention relates to the technical field of computer vision, and discloses a video dynamic target three-dimensional reconstruction method based on artificial intelligence, which comprises the following steps: step 1, image optical flow calculation: obtaining each frame of image in a video, calculating the optical flow value of each pixel point in each frame of image by extracting the spatial gradient of each pixel point in the image and the motion information of a target, and calculating the optical flow value of each pixel point in each frame of image; by analyzing the optical flow value, the displacement and the movement track of the target between the video frames are obtained; and step 2, optical flow weighting processing: on the basis of optical flow calculation, weighting processing is carried out on the optical flow value of each pixel. Weighing processing is introduced into image optical flow calculation, weighting factors are adjusted according to the movement speed and angle of the dynamic target, the precision of depth estimation of the dynamic target under the fast movement and complex background is improved, accurate depth data are obtained, depth information is provided for subsequent three-dimensional reconstruction, and the accuracy of depth estimation of the dynamic target is improved. The common error problem in dynamic target depth estimation is solved.
Owner:MIRROR VISION (ZHEJIANG) TECHNOLOGY CO LTD