Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

49 results about "Stereo reconstruction" patented technology

Dynamic self-adaptive multi-view three-dimensional reconstruction method and model based on double-domain information fusion

The invention relates to a three-dimensional reconstruction method and model, in particular to a dynamic self-adaptive multi-view three-dimensional reconstruction method and model based on double-domain information fusion, and aims to solve the problems that in the prior art, the space relation between pixels is explored by utilizing attention along a channel dimension, the self-adaptive long-range information association capability is lacked, and the space relation between pixels is not explored. According to the dynamic adaptive multi-view three-dimensional reconstruction method based on double-domain information fusion, spatial domain detail enhancement and frequency domain dynamic aggregation and enhancement are realized through a multi-scale spatial domain and frequency domain information fusion network, so that multi-scale enhancement characteristics of an input image are obtained; a multi-scale depth prediction network is constructed by adopting a coarse-to-fine framework, depth hypotheses of all scales are obtained, a cost body is generated through adaptive aggregation, finally regularization is carried out to obtain prediction depth, and the prediction depth is converted to obtain a three-dimensional point cloud file of a corresponding scene. Meanwhile, the invention provides a model capable of realizing the method.
Owner:XIAN INST OF OPTICS & PRECISION MECHANICS CHINESE ACAD OF SCI

High-precision three-dimensional reconstruction method for complex scene

The invention discloses a high-precision three-dimensional reconstruction method for a complex scene, and the method comprises the steps: obtaining the position and orientation of a camera from a multi-view image through the pose estimation of the polarization camera, and obtaining a normal vector of a scene surface through an MLP network; according to the method, a scene surface normal vector is used for correcting an ambiguous polarization normal vector calculated by using a polarization image, so that a prior normal vector is obtained, and the prior normal vector is input into a pre-trained improved NeuS network to provide additional constraints, so that the geometric blurring problem of a non-texture region and a mirror reflection region is relieved. And compared with depth priori, the network based on the priori normal vector can generate a smooth geometric shape, and can also avoid the problem of depth scale blur among multiple views, thereby obtaining more accurate three-dimensional information. According to the method, high-precision reconstruction can also be carried out on an object with shielding and an object with a thin structure, and better geometric reconstruction can also be carried out on a scene with sudden depth change.
Owner:XIDIAN UNIV HANGZHOU RES INST

Unsupervised multi-view three-dimensional reconstruction method of anti-occlusion area

The invention discloses an unsupervised multi-view three-dimensional reconstruction method for an anti-occlusion area, which can effectively solve the three-dimensional reconstruction problem of the occlusion area by processing images from a plurality of view angles without depending on real depth information, and can calculate a high-precision point cloud model. Firstly, multi-scale features are extracted; secondly, aggregating global information by adopting a deformable big kernel attention network, and calculating a depth map and a corresponding confidence map of the scene; secondly, calculating comparison consistency loss and perception consistency loss to provide a pseudo-supervision signal for a depth estimation process, and optimizing a depth map; and finally, fusing the depth map to obtain a point cloud model. According to the method, an unsupervised multi-view three-dimensional calculation method based on multiple supervision items is fully utilized, the characteristics of the input image are effectively mined, the high-quality depth map is estimated, and then the accurate point cloud model is calculated.
Owner:ANHUI UNIV

Multi-view three-dimensional reconstruction method based on frequency perception feature enhancement and cost aggregation

The invention relates to an image three-dimensional reconstruction method, in particular to a multi-view three-dimensional reconstruction method based on frequency perception feature enhancement and cost aggregation. The objective of the invention is to overcome the defects of lack of frequency sensing capability and limited processing capability for problems of weak texture, noise, illumination variation, color distortion and the like in an existing learning-based multi-view three-dimensional reconstruction method. According to the method, multi-view three-dimensional reconstruction is realized through the steps of acquiring a multi-view image, calculating a multi-scale frequency sensing feature, calculating an initial cost body, embedding frequency information into the initial cost body, calculating depth estimation, performing back projection and the like in sequence; when multi-scale frequency sensing features are calculated, a double-branch frequency component enhancement module is arranged to process wavelet transform layer decomposition to obtain lossless approximate low-frequency components and high-frequency components of an input image, so that global consistency and local detail expression of depth estimation are improved.
Owner:XIAN INST OF OPTICS & PRECISION MECHANICS CHINESE ACAD OF SCI

Local feature adaptive fusion and high-fidelity new view angle synthesis method based on three-dimensional reconstruction

The invention relates to the technical field of three-dimensional reconstruction, and provides a local feature adaptive fusion and high-fidelity new view angle synthesis method based on three-dimensional reconstruction. According to the method, a local feature module is introduced into a point cloud network, robust matching of local features is realized, a self-adaptive matching strategy is combined, high-resolution images can be efficiently processed, and the precision and stability of three-dimensional reconstruction are remarkably improved. The method is suitable for application scenes such as three-dimensional rendering, three-dimensional reconstruction and new view angle synthesis. The specific process comprises dense reconstruction and initial rendering; and carrying out missing region repairing and iterative optimization. Generating a high-precision point cloud based on an improved stereo matching algorithm, and rendering an initial image of a target view angle in combination with camera parameters; a conditional video generation model is adopted, and holes, distortion and artifacts in initial rendering are repaired; and carrying out progressive complementation on the occlusion region by using the view angle consistency constraint, and improving the reconstruction integrity by jointly optimizing the point cloud geometry and texture. According to the method, the final picture quality is remarkably improved through feature matching optimization and efficient processing capacity. Local feature branches and global context information are coordinated, and the problem of matching ambiguity in a complex scene is solved; the adaptive fusion strategy gives consideration to high-resolution image processing efficiency and detail retention; and the detail fidelity and the overall quality of the rendering result are effectively improved.
Owner:CHANGCHUN UNIV OF SCI & TECH

Photovoltaic module construction quality identification method based on computer vision and three-dimensional modeling

The invention discloses a photovoltaic module construction quality identification method based on computer vision and three-dimensional modeling. The method comprises the following steps: S1, collecting an original image sequence of a photovoltaic construction site and carrying out image preprocessing; s2, outputting a semantic tag graph and a two-dimensional space boundary graph through an improved BiSeNet network; s3, using a mask constraint SIFT algorithm to extract cross-view key point features, generating a dense three-dimensional point cloud according to multi-view stereo reconstruction, and outputting a structure three-dimensional geometric model; s4, mapping the semantic tag graph and the two-dimensional space boundary to the structure three-dimensional geometric model to obtain a semantic three-dimensional model; s5, performing spatial registration on the semantic three-dimensional model and the reference model, and calculating spatial error parameters of the photovoltaic module; s6, performing compliance discrimination on the spatial error parameters, and outputting a quality discrimination result; and S7, generating a construction quality evaluation report. According to the invention, automatic identification and accurate evaluation of the photovoltaic construction quality are realized, and the detection efficiency and the discrimination accuracy are improved.
Owner:POWERCHINA BEIJING ENG CORP

Unsupervised multi-view stereo reconstruction method based on bidirectional attention mechanism

The invention provides an unsupervised multi-view three-dimensional reconstruction method based on a bidirectional attention mechanism, and mainly solves the problem of low three-dimensional reconstruction quality in a weak texture region and a complex shielding scene in the prior art. The scheme comprises the following steps: 1) inputting a multi-view image and camera parameters; 2) preliminarily extracting multi-scale features of an input image through a bidirectional feature pyramid network Bi-FPN, taking the multi-scale features as input data, performing enhancement through an attention mechanism, and then calculating a fusion feature map; 3) performing multi-stage depth estimation from coarse to fine by using the fused feature map; 4) calculating an initial depth map of a data enhancement branch; 5) fusing multi-source information to optimize the initial depth map, and generating a final refined depth map; and 6) converting the refined depth map into a point cloud model to obtain a reconstruction result. According to the method, the multi-scale features of the image can be extracted and fused more efficiently, so that the three-dimensional reconstruction quality of a weak texture region and a complex shielding scene is remarkably improved.
Owner:XIDIAN UNIV

Multi-view three-dimensional reconstruction system and method based on self-attention mechanism

PendingCN119359918AImage enhancementImage analysisEngineeringStereo reconstruction
The invention provides a multi-view three-dimensional reconstruction system and method based on a self-attention mechanism, the system comprises a multi-scale feature extraction module, a matching cost body construction module, a depth sampling range estimation module, a Transform attention aggregation module and a loss function module, the multi-scale feature extraction module is used for extracting multi-scale features of an image; the matching cost body construction module is used for constructing a multi-view matching cost body; the depth sampling range estimation module is used for estimating a depth sampling range; the Transform attention aggregation module is used for aggregating the matching cost body; the loss function module is used for calculating the distance between the predicted depth distribution and the real depth map. According to the multi-view three-dimensional reconstruction system based on the self-attention mechanism provided by the invention, through the multi-scale feature extraction module, the matching cost body construction module, the depth sampling range estimation module, the Transform attention aggregation module and other modules, the problems existing in MVS reconstruction are effectively solved, and the integrity and accuracy of three-dimensional reconstruction are improved.
Owner:GUANGXI NORMAL UNIV +2

Multispectral photometric stereo three-dimensional reconstruction method based on Gaussian process model

The invention relates to a multispectral luminosity three-dimensional reconstruction method based on a Gaussian process model. The method comprises the following steps: constructing a multispectral luminosity three-dimensional imaging system; the light field camera shoots a picture; after channel separation is carried out on the picture, the picture is used as input for depth estimation, and a reconstructed normal vector and a multispectral luminosity three-dimensional reconstruction depth map are obtained; performing three-dimensional reconstruction on the light field camera to obtain a light field camera depth map; and fusing the depth maps obtained in the two modes through a Gaussian process model mode to obtain a final depth map. Compared with a photometric stereo method, a light field camera comprising a micro-lens array has a higher utilization rate of light field information, the method combines light field camera reconstruction with the photometric stereo method based on the idea of Gaussian model hybrid reconstruction, gives full play to the respective advantages of the light field camera reconstruction and the photometric stereo method, improves the utilization rate of the light field information through the light field camera with the micro-lens array, and improves the reconstruction efficiency of the light field camera. And then an algorithm is designed to process the shot picture, so that a good low-frequency reconstruction effect is obtained, and higher precision is achieved.
Owner:XITONG (TIANJIN) OPTOELECTRONICS TECH CO LTD

Efficient multi-view three-dimensional reconstruction method and system for outdoor scene

The invention discloses an outdoor scene-oriented efficient multi-view three-dimensional reconstruction method and system, and belongs to the field of multi-view three-dimensional reconstruction, and the method specifically comprises the steps: preparing a multi-view three-dimensional reconstruction data set for model training; constructing a multi-view three-dimensional reconstruction network comprising an adaptive feature extraction converter module based on big kernel attention, a cost regularization module and a depth estimation module; performing training and fine tuning on the network model to obtain a final model; building a multi-view three-dimensional reconstruction system and equipment; according to the method, the problems of poor accuracy and low integrity of a reconstruction result when an existing multi-view three-dimensional reconstruction method faces an outdoor large-scale scene can be solved, and the training reasoning time and the calculation cost of multi-view three-dimensional reconstruction can be reduced; and an important foundation is laid for application of outdoor large-scale scene image data in the field of multi-view three-dimensional reconstruction and development of a three-dimensional reconstruction technology.
Owner:CHANGCHUN UNIV OF SCI & TECH

Flexible metal material three-dimensional length measuring system and measuring method based on camera rotation

The invention discloses a flexible metal material three-dimensional length measurement system based on a rotary camera mechanism, which is used for solving the problems that the existing contact measurement is easy to cause material deformation, the non-contact measurement is poor in adaptability to high-reflection / low-texture materials and the like. Comprising a rotary camera module (an industrial camera collects images at multiple angles along a semicircular guide rail), a visual calibration module (an ArUco code and a photoelectric sensor realize pose calibration and triggering), a texture enhancement module (structured light / random noise projection optimization feature extraction), a three-dimensional reconstruction module (a multi-view three-dimensional reconstruction algorithm generates point cloud) and an error compensation module (an error compensation module). And a material perception weighted least square fitting and neural network dynamic correction error) and a control splicing module. The bending deformation error of the material is eliminated through non-contact three-dimensional measurement; in combination with texture enhancement and error compensation mechanisms, the measurement precision of high-reflection materials such as aluminum foils and stainless steel bands is improved; and a modular integrated design is adopted, and automatic production line deployment is adapted.
Owner:SHANGHAI DIANJI UNIV

Cow face recognition method based on dense point cloud three-dimensional reconstruction

The invention discloses a cattle face recognition method based on dense point cloud three-dimensional reconstruction, which comprises the following steps: S1, receiving four cattle pictures from different visual angles to capture detailed characteristics of cattle, S2, converting the cattle pictures from different visual angles into 3D dense point cloud coordinates by using a 3D reconstruction technology to ensure high efficiency and accuracy of face recognition, S3, extracting constructed 3D dense point cloud characteristics, and S4, extracting the 3D dense point cloud characteristics from the 3D dense point cloud characteristics. And performing cattle face comparison. Based on the 3D reconstruction technology, a high-quality 3D cattle face model is generated through a limited number of 2D cattle face images, further the 3D features of the cattle face are deeply mined and analyzed, accurate face information comparison is achieved, and cattle identity recognition is completed. The method improves the recognition accuracy and robustness through 3D feature comparison, can be suitable for file establishment, transaction and traceability in the cattle feeding process, is mainly used for cattle identity uniqueness recognition and authentication, is also called as living asset uniqueness authentication, and is used in multiple fields such as insurance and loan in scenes. And the traditional industry is enabled by means of tools of science and technology and general finance.
Owner:JIANGSU HEZEHAIXUN IOT TECHNOLOGY CO LTD

Feature pyramid network in multi-view three-dimensional reconstruction and multi-view three-dimensional reconstruction method

InactiveCN120876776AImage enhancementImage analysisPoint cloudStereo reconstruction
The invention provides a feature pyramid network in multi-view three-dimensional reconstruction and a multi-view three-dimensional reconstruction method. Comprising an input image module, a camera parameter module, a shallow feature extraction module, a multi-scale feature extraction module, a global representation sub-network module, a position coding module, a feature fusion module, an FPN encoder module, an FPN decoder module, a matching cost body construction module, a cost body regularization module, a depth sampling range estimation module and a depth map generation module. A depth map optimization module, a point cloud generation module and a loss function module. The invention provides a feature pyramid network in multi-view three-dimensional reconstruction, which comprises the key technologies of multi-scale feature extraction, global context information extraction, feature fusion, feature pyramid construction, matching cost body construction, cost body regularization, depth sampling range estimation, depth map generation and optimization and the like. And high-efficiency and high-quality multi-view three-dimensional reconstruction is realized.
Owner:NEW ELEMENTS (ZHANGJIAGANG) DIGITAL TECHNOLOGY CO LTD +3

Online defect detection method and system for wiring terminal of optical holographic compressor

The invention belongs to the technical field of defect detection, and relates to an online defect detection method and system for an optical holographic compressor wiring terminal, and the method comprises the steps: firstly obtaining a to-be-detected workpiece image through a spatial three-dimensional optical holographic image, and then carrying out the preprocessing of the obtained workpiece image, and obtaining a high-quality, high-definition, low-noise and undistorted image; secondly, inputting the preprocessed image into a defect detection model for detection to obtain a defect detection result, and obtaining information by utilizing a spatial three-dimensional optical holographic image, so that the detection result is clear in visual gradation, rich in stereoscopic impression and high in imaging definition; optical holographic three-dimensional reconstruction of the workpiece is realized, and low time delay, low leak detection and low false detection are designed, so that the project general situation is mastered, the processing historical information of a production line is recorded, and later maintenance of a manufacturer is facilitated.
Owner:RIZHAO HSBC ELECTRONIC CO LTD

Multi-view three-dimensional reconstruction method based on multi-scale structure perception fusion and confidence weighted optimization

The invention discloses a multi-view three-dimensional reconstruction method based on multi-scale structure perception fusion and confidence weighted optimization, and the method specifically comprises the following steps: 1, obtaining a multi-view data set, and dividing the data set into a training set and a test set; 2, constructing a depth estimation network, wherein the depth estimation network sequentially comprises a multi-scale feature extraction module, a structure perception and attention guidance feature fusion module, a confidence coefficient weighted feature enhancement module and a multi-stage depth estimation and refinement module; step 3, training the depth estimation network by using the training set in the step 1 to obtain a trained depth estimation model; and step 4, inputting the test set constructed in the step 1 into the model trained in the step 3 to obtain a predicted depth map of each reference view. The method solves the problems that an existing reconstruction method is insufficient in detail reduction in a weak texture region and fuzzy in boundary in a shielding and illumination variation region.
Owner:XIAN UNIV OF TECH

Method, system and apparatus for photometric stereo reconstruction of a surface

A method includes capturing a first image of a surface illuminated from a first direction along an axis by a first light at a first elevation angle with other lights of the illumination system off, and capturing a second image of the surface illuminated from a second direction along the axis by a second light at a second elevation angle with the other lights off, the second direction being opposite the first direction, the second elevation angle being substantially identical to the first elevation angle. The images are processed by taking a derivative of a reflected light intensity at each of a plurality of pixel locations in the images, respectively. The respective derivatives are employed to identify a set of invalid pixels where a photometric stereo condition is not satisfied. A photometric stereo reconstruction is generated based on a set of images and the identified set of invalid pixels.
Owner:MATROX ELECTRONICS SYST LTD

Three-dimensional reconstruction method and device of visual target, electronic equipment and storage medium

The embodiment of the invention provides a three-dimensional reconstruction method and device for a visual target, electronic equipment and a storage medium, and relates to the technical field of visual perception, and the method comprises the steps: obtaining a video sequence corresponding to an initial three-dimensional model; sampling the video sequence to obtain an original image corresponding to the initial stereoscopic model; obtaining a convolution processing network for the original image, wherein the convolution processing network at least comprises a convolution coding network and a plurality of convolution decoding networks; performing feature extraction on the original image according to the convolutional coding network to obtain coding features corresponding to the original image; each convolutional decoding network is adopted to carry out progressive decoding processing on the coding features, and attribute elements corresponding to each convolutional decoding network are obtained; according to the method, the element sequence corresponding to each attribute element is obtained, progressive three-dimensional reconstruction is performed on the initial three-dimensional model according to the element sequence, and the target three-dimensional model corresponding to the initial three-dimensional model is obtained, so that the implementation cost is reduced, and the reconstruction output effect is ensured.
Owner:CHINA TELECOM CLOUD TECH CO LTD

Multi-view reconstruction method and system based on geometric perception and attention fusion

The invention discloses a multi-view reconstruction method and system based on geometric perception and attention fusion. The reconstruction method comprises the following steps: designing a multi-scale feature enhancement network and a geometric perception feature fusion network; the multi-scale feature enhancement network extracts a multi-scale feature map and inputs the multi-scale feature map to a multi-stage depth estimation module to generate a preliminary depth map; inputting the initial depth map into a geometric perception feature fusion network to generate a geometric perception enhanced feature map; inputting the geometric perception enhanced feature map into a multi-stage depth estimation module, and performing iterative optimization to output a refined depth map; and training a model constructed by the network by adopting a joint loss function of a pixel-level cross entropy loss function and a depth distribution similarity loss function. According to the method, the expression ability of image features and the utilization efficiency of geometric information are effectively improved, the problem that depth estimation is difficult in a low-texture area and a structure repeated area in an existing multi-view three-dimensional reconstruction method is mainly solved, and the accuracy and integrity of three-dimensional reconstruction are remarkably improved.
Owner:JIANGXI NORMAL UNIV

TECHNIQUES FOR FAST STEREO RECONSTRUCTION FROM IMAGES

Computer-implemented procedure comprising the following steps: Performing a stereo alignment on a pair of images; Straightening (204) the image pair so that epipolar lines become either horizontal or vertical; Applying (206) a stereo alignment to the straightened image pair to establish an initial correspondence between pixels from the image pair; Generating a homography matrix transformation; Defining photo consistency between a template window in a base image of the image pair and a warp window of a translated image of the image pair as an implicit function of the homography matrix transformation; Improve the photo consistency of the warp window; Generating a translated pixel from a basic pixel, wherein the generation comprises repeatedly applying (208) the homography matrix transformation to the basic pixel until the absolute value of an increment step is less than a predetermined value; Triangulating (210) correspondence points to create a three-dimensional scene; and Providing the three-dimensional scene for display.
Owner:TAHOE RES LTD

Multi-view stereoscopic reconstruction system for multi-stage depth estimation and propagation

The invention provides a multi-view three-dimensional reconstruction system for multi-stage depth estimation and propagation. Comprising an image acquisition module, a primary depth estimation module, a depth refinement module, a cross-view propagation module, a feature matching module, a noise filtering module, an abnormal value processing module, a visual angle selection module, a three-dimensional model generation module, a data preprocessing module, a visual feature enhancement module, a computing resource management module, a user interface module and a result evaluation module. The image acquisition module outputs image data to the data preprocessing module; the data preprocessing module receives the image data of the image acquisition module and outputs the preprocessed image data to the feature matching module and the primary depth estimation module. According to the multi-stage depth estimation and propagation mechanism provided by the invention, the precision and efficiency of multi-view three-dimensional reconstruction are remarkably improved, the calculation cost is reduced, and the method has a wide application prospect.
Owner:NEW ELEMENTS (ZHANGJIAGANG) DIGITAL TECHNOLOGY CO LTD +3

A high-precision stereo reconstruction method for complex scenes

The application discloses a high-precision three-dimensional reconstruction method for a complex scene, which comprises the following steps: obtaining the position and orientation of a camera from multi-view images through polarization camera pose estimation; obtaining a scene surface normal vector through an MLP network; correcting an ambiguous polarization normal vector calculated by using a polarization image by using the scene surface normal vector, thereby obtaining a prior normal vector; inputting the prior normal vector into a pre-trained improved NeuS network to provide additional constraints, so as to alleviate the geometric blur problem of a textureless area and a mirror reflection area; and compared with depth prior, the network based on the prior normal vector can generate smooth geometry, can avoid the depth scale blur problem between multiple views, and can obtain more accurate three-dimensional information. The application can also perform high-precision reconstruction on an object with occlusion and an object with a thin structure, and can also perform better geometric reconstruction on a scene with sudden depth changes.
Owner:XIDIAN UNIV HANGZHOU RES INST

An efficient multi-view stereo reconstruction method and system for outdoor scenes

The application discloses an efficient multi-view stereo reconstruction method and system for an outdoor scene, and belongs to the field of multi-view three-dimensional reconstruction. The specific steps are as follows: preparing a multi-view stereo reconstruction data set for model training; constructing a multi-view stereo reconstruction network including an adaptive feature extraction converter module based on a large kernel attention, a cost regularization module and a depth estimation module; training and fine-tuning the network model to obtain a final model; and building a multi-view stereo reconstruction system and equipment. The application can solve the problems of poor reconstruction result accuracy and low completeness of existing multi-view stereo reconstruction methods when facing outdoor large-scale scenes, reduce the training and inference time and calculation cost of multi-view stereo reconstruction, and lay an important foundation for the application of outdoor large-scale scene image data in the field of multi-view three-dimensional reconstruction and the development of three-dimensional reconstruction technology.
Owner:CHANGCHUN UNIV OF SCI & TECH

Dynamic Adaptive Multi-View Stereo Reconstruction Method and Model Based on Dual-Domain Information Fusion

The present invention relates to a three-dimensional reconstruction method and model, specifically to a dynamic adaptive multi-view stereo reconstruction method and model based on dual-domain information fusion. To address the deficiency in the prior art that the use of attention along the channel dimension to explore the spatial relationship between pixels lacks the ability of adaptive long-range information association, resulting in a reduction in image reconstruction performance, a dynamic adaptive multi-view stereo reconstruction method based on dual-domain information fusion in the present invention realizes the enhancement of spatial details and the dynamic aggregation and enhancement in the frequency domain through a multi-scale spatial and frequency domain information fusion network to obtain multi-scale enhanced features of the input image. Then, a multi-scale depth prediction network is constructed using a coarse-to-fine framework to obtain depth hypotheses at each scale. Subsequently, an adaptive aggregation is used to generate a cost volume, and finally, regularization is performed to obtain the predicted depth, which is then converted to obtain a three-dimensional point cloud file of the corresponding scene. Meanwhile, the present invention provides a model capable of implementing the above method.
Owner:XIAN INST OF OPTICS & PRECISION MECHANICS CHINESE ACAD OF SCI

Image rendering technology research based on dense stereo reconstruction and multi-view background fusion

The invention relates to the technical field of three-dimensional reconstruction, provides an image rendering technology research based on dense three-dimensional reconstruction and multi-view background fusion, integrates an image matting network structure, a depth estimation algorithm, a video diffusion model and an image splicing algorithm, and aims to realize high-quality new-view pictures. The method is particularly suitable for application in the fields of three-dimensional rendering, reconstruction, view angle synthesis and the like. According to the method, firstly, a foreground and a background in an original image group are separated by using a foreground segmentation algorithm and a depth threshold segmentation technology; secondly, converting the foreground image into a three-dimensional point set through point cloud reconstruction, and generating a rotating video sequence; meanwhile, feature matching and splicing are carried out on the background image, and a complete background image is constructed. And finally, inputting an expected camera pose, respectively extracting and fusing the foreground and the background from the video sequence and the spliced background by utilizing geometric transformation, and generating an image with a brand new view angle. The method provides a new thought for new view angle generation, and has an important value in the field of three-dimensional reconstruction.
Owner:CHANGCHUN UNIV OF SCI & TECH

An artificial intelligence generated video authentication method based on multi-view consistency

The application discloses an artificial intelligence generated video authentication method based on multi-view consistency. The method comprises the following steps: constructing a large-scale real-world simulation video dataset, using the previous frame as a prompt to generate a future frame video with high consistency in semantics, color and physical laws, and improving data authenticity; designing a detection model based on multi-view consistency physical prior, extracting video features through real-time multi-view matching, combining a time sequence memory module to dynamically store and update inter-frame stereo reconstruction features, and using an attention mechanism to enhance long-time consistency analysis; using a multi-modal large model to generate unified prompts and label data, and improving the model generalization ability; scoring each frame feature through a scorer and globally averaging to output a video authenticity judgment result. The application uses multi-view consistency prior and memory enhancement mechanism to effectively capture the subtle defects in AI generated videos that violate the real physical laws, and significantly improves the detection robustness and accuracy of high-quality generated videos.
Owner:TSINGHUA UNIVERSITY

Multi-view stereo reconstruction method based on frequency-aware feature enhancement and cost aggregation

ActiveCN120707752BImage enhancementImage analysisPattern recognitionCost aggregation
The present application relates to image stereo reconstruction method, specifically to multi-view stereo reconstruction method based on frequency perception feature enhancement and cost aggregation. In order to solve the problem that the existing learning-based multi-view stereo reconstruction method lacks frequency perception ability and has limited processing ability for weak texture, noise, illumination change and color distortion, the present application realizes multi-view stereo reconstruction through the steps of acquiring multi-view images, calculating multi-scale frequency perception features, calculating initial cost volume, embedding frequency information into the initial cost volume, calculating depth estimation and back projection in turn. When calculating multi-scale frequency perception features, a double-branch frequency component enhancement module is set to process the lossless approximate low-frequency component and high-frequency component of the input image decomposed by wavelet transform layer, so as to improve the global consistency and local detail expression of depth estimation.
Owner:XIAN INST OF OPTICS & PRECISION MECHANICS CHINESE ACAD OF SCI

Method, system and equipment for detecting surface defects by photometric stereo method

The invention relates to the technical field of semiconductor detection, in particular to a photometric stereo method surface defect detection method, system and equipment. A corresponding partition control image acquisition device is configured to acquire a plurality of sub-images related to a to-be-detected chip, and the plurality of sub-images are subjected to stereo reconstruction to obtain a 2.5 D image related to the to-be-detected chip; and identifying the 2.5 D image through a target detection model with a coordinate attention mechanism, and identifying an object with a depth value.
Owner:MATRIXTIME ROBOTICS (SHANGHAI) CO LTD

An intelligent magnetic resonance holographic imaging method and system

This invention discloses an intelligent magnetic resonance holographic imaging method and system. The system includes a data acquisition device, an image reconstruction device, and an image display device. The data acquisition device acquires undersampled magnetic resonance data in real time through undersampled scanning and sends it to the image reconstruction device. The image reconstruction device inputs the undersampled magnetic resonance data into a deep learning model and outputs a high-dimensional stereoscopic reconstructed image. The deep learning model takes the undersampled magnetic resonance data of the sample as input and the corresponding fully sampled magnetic resonance data as output, and is obtained through self-supervised training. The image display device renders the stereoscopic reconstructed image in stereo and displays it in stereoscopic form through holographic projection. This invention enables rapid magnetic resonance imaging and real-time stereoscopic magnetic resonance image display, thereby better assisting doctors in surgical interventions and treatments.
Owner:SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI

Multi-view stereo reconstruction method based on adaptive learning and aggregation

The present invention relates to a multi-view stereo reconstruction method based on adaptive learning and aggregation, comprising the following steps: S1. Feature extraction, extracting image features from an input image and removing unimportant information from a large amount of information; S2. Matching cost construction, calculating the matching cost between each pixel in a reference camera and the corresponding matching pixel in its adjacent camera under each sampling depth assumption; S3. Matching cost regularization, denoising the cost volume in the matching cost; S4. Depth map estimation, weighting the result of the regularized matching cost using function regression to obtain an initial depth map; S5. Depth map optimization, reducing the effects of oversmoothing on the edges of the initial depth map. The present invention aims to provide a multi-view stereo reconstruction method based on adaptive learning and aggregation, which has higher reconstruction accuracy and completeness than MVSNet and significantly reduces time consumption and graphics card memory consumption.
Owner:XIAMEN UNIV