11579 results about "Image pair" patented technology

Disclosed in the present invention is a salient contour matching-based method for target measurement in a severe imaging environment. The method specifically comprises: (1) acquiring a binocular image of a target; (2) establishing a global-local joint constraint-based background light estimation model, and removing a scattering effect of a medium in an imaging environment to obtain a restored left eye image and a restored right eye image; (3) learning an original image, and on the basis of a residual between a network reconstructed image and the original image, obtaining target localization prediction maps of the left eye image and the right eye image; and (4) respectively extracting contour lines of the target in the left eye image and the right eye image, constructing feature matching descriptors of contour points, performing stereo matching on the two sets of contour lines by minimizing matching cost, and performing three-dimensional reconstruction on the contour lines in light of calibrated intrinsic and extrinsic parameters to complete the measurement of a key size. According to the present invention, the key sizes of different targets in a severe environment can be accurately measured, thereby providing an effective solution for the problem of measuring the sizes of targets in a severe environment.

The invention relates to the technical field of image processing, and discloses a backlight effect image edge enhancement method based on intelligent identification, which comprises the following steps of: judging a field environment type; performing global optimization on the original image based on a set environment perception type enhancement mechanism according to the judged field environment type, and outputting a global pre-processing image; constructing a backlight area segmentation model for the globally preprocessed image; outputting a local enhanced image; designing a structure perception type local adaptive threshold algorithm for the local enhanced image, and outputting a binary image keeping structural continuity; extracting an edge image of the binarized image through an edge detection algorithm, and optimizing a topological structure of a contour in the binarized image; and comparing with a wood template processing standard feature library, outputting an edge quality evaluation result and feeding back to a processing control system. Defect detection and machining control depth linkage is achieved, passive detection is changed into active optimization, and the production efficiency and the yield are improved.

The invention relates to the technical field of remote sensing monitoring, in particular to a remote sensing image ocean green tide monitoring method and system fusing physical prior and spatio-temporal evolution. The method comprises the following steps: acquiring a multi-modal remote sensing monitoring image; performing multi-modal feature extraction on the acquired image, wherein the multi-modal feature extraction comprises spectral reflectivity feature extraction, ocean dynamics feature extraction and feature alignment and unified representation; establishing a physical prior of a green tide characteristic wave band by using an ocean optical radiation transmission model; constructing a dynamic space-time diagram based on the extracted multi-modal features to obtain a node global feature vector and a dynamic adjacency matrix; carrying out adaptive graph convolution feature coding based on physical prior and a dynamic space-time diagram; through fusion of multi-spectral images of multiple platforms such as satellites and unmanned aerial vehicles and ocean dynamic data and combination of atmospheric correction and wave band resampling, consistency processing and high-precision extraction of multi-source features are realized, and comprehensiveness and reliability of green tide feature recognition are remarkably improved.

The invention provides an engineering construction defect automatic detection and classification method based on deep learning, and the method comprises the steps: obtaining a welding seam surface image through the shooting of an unmanned plane, and carrying out the denoising and illumination normalization processing of the welding seam surface image, and obtaining a standardized image; welding seam surface texture features are extracted from the standardized image, a convolutional neural network is adopted to analyze the spatial distribution characteristics of textures, and vectorization processing is carried out to obtain texture feature vectors; segmenting a weld surface corresponding to abnormal region distribution by adopting a region growing algorithm, and analyzing pore and weld discontinuity in combination with the texture feature vector to obtain a defect candidate region; performing threshold division on the sizes and the numbers of the defects according to the defect types and the feature vectors of the candidate regions to obtain a severity grading result of each type of defects; and severity features are extracted from a grading result, and a Bayesian network is adopted to fuse texture feature vectors and defect type labels to obtain a welding quality evaluation score.

The invention discloses an unmanned aerial vehicle laser and vision fusion inspection method and system for bridge bottom disease detection, and the method comprises the steps: carrying out the synchronous data collection through employing a calibrated laser radar, a camera and an IMU, and obtaining a three-dimensional laser point cloud and a two-dimensional visual image of the appearance of a bridge; sharpening the image containing the motion blur and completing brightness self-adaption of the image; stable feature points are extracted, multi-frame matching is carried out, the corresponding poses of the images are estimated, and bridge dense point cloud reconstruction is completed; performing geometric component segmentation on the point cloud to generate a geometric prior region; component segmentation is carried out on a support area in the image, and a continuous and accurate component segmentation result is obtained in combination with a geometric prior area; screening the image, calling a targeted disease detection model in a corresponding component area, and generating a segmentation mask for the disease; obtaining a real disease three-dimensional point cloud, and carrying out quantitative calculation on the physical size of the disease; and displaying the real disease three-dimensional point cloud data and the physical size of the disease. The method is high in efficiency and precision.

The invention relates to a bill voucher information extraction method based on multi-mode and OCR model fusion. The method comprises the following steps: S1, obtaining an image of a bill voucher; s2, preprocessing the image; s3, identifying the preprocessed image by using an OCR engine to obtain the text content and the corresponding two-dimensional coordinates of each text block; s4, taking the recognized text segments and the original image as input, performing joint coding by using a pre-trained multi-modal model, evaluating and outputting the matching degree of each text segment and a predefined field category by the model, and determining candidate texts of each field and confidence of the candidate texts; s5, accurately positioning and extracting the key field, and verifying the consistency of the OCR output and the semantic result; s6, if the verification result conflicts or the identification reliability of a certain field is lower than a threshold value, error correction operation is carried out; and S7, outputting the structured bill voucher information. Through multi-modal fusion and iterative correction, the error rate of non-standard voucher information extraction is effectively reduced, and the method is suitable for various voucher formats and complex scenes.

The invention provides an aluminum alloy surface oxidation spot defect identification method and device based on machine vision, and relates to the field of intelligent manufacturing and industrial automation, and the method comprises the steps: obtaining an aluminum alloy surface color image, and carrying out the preprocessing of the image, so as to extract a brightness component image; self-adaptive threshold segmentation of local contrast enhancement is carried out on the brightness component image, a defect area binary mask is generated, morphological connected domains are extracted according to the mask, and three basic feature indexes of the area pixel value, the contour Fourier descriptor complexity and the area gray scale standard deviation contrast of each connected domain are calculated; and extracting and marking a connected domain boundary, verifying a boundary closed topological structure, and dynamically generating a curvature-driven self-adaptive sampling point through multi-scale B-spline curvature extreme value detection. Through optical-algorithm-process three-level collaborative innovation, the curved surface reflection false alarm rate is reduced, the pinhole detection rate is increased, and the boundary precision is + / -0.2 pixel.

The invention discloses a distribution network tree barrier real-time analysis method and system based on dynamic vision and SLAM. The method comprises the following steps: generating a dynamic visual baseline by cooperatively controlling the translation and flight displacement of an unmanned aerial vehicle holder, and constructing a bionic binocular model to simulate a time sequence image into a binocular image pair; generating a depth point cloud through epipolar correction and stereo matching; key targets are recognized and extracted through a semantic segmentation network, and semantic point clouds are generated; establishing a dimensionality reduction motion model by utilizing pan-tilt stability augmentation, and fusing a visual inertial odometer and RTK data by adopting a filtering or optimization algorithm to realize centimeter-level pose estimation; and finally, performing optimization processing on the semantic point cloud, completing three-dimensional reconstruction based on multi-modal fusion, and outputting a risk assessment result through tree line spacing calculation and safety margin analysis. According to the invention, accurate, efficient and automatic routing inspection and risk early warning of the distribution network tree obstacles are realized.

The invention belongs to the technical field of digital restoration of computer vision and cultural heritage, and particularly relates to a traditional picture restoration method fusing low-resolution prior and efficient visual selection, which comprises the following steps: constructing a multi-source image data set, taking images in the multi-source image data set as high-resolution images, preprocessing the high-resolution images to obtain low-resolution images, and carrying out high-resolution priori and high-efficiency visual selection on the low-resolution images. The high-resolution image and the low-resolution image are respectively masked to generate simulated damage mask images, and the simulated damage mask images comprise a regular damage mask image and an irregular damage mask image; taking the multi-source image data set and the preprocessed multi-source image data set as training data, and training a multi-source image model; the dual-stage repair network comprises a coarse repair network and a fine repair network; according to the method, the problems of structural semantic loss, high priori information dependency and insufficient global and local coordination when an existing image restoration method is used for processing a complex scene and a large-range missing region are solved.

The invention discloses a two-way visual saliency detection method and device combining difference guidance and texture enhancement, and the method comprises the following steps: 1, obtaining an image to be subjected to saliency detection, and carrying out the marking and preprocessing of a data set; 2, constructing a visual saliency detection model which comprises a dual-path encoder (a saliency detection path and an image reconstruction path), an adaptive interaction network, a decoder network and an output network; a significance detection path in the dual-path encoder network uses a pre-trained ConvNeXt encoder, and an image reconstruction path uses VQ-VAE as a backbone network; the adaptive interactive network comprises a multi-scale convolution module and a gating fusion module; the decoder network comprises a mutual conversion attention module and a double-gating fusion module; the output network comprises a multi-level feature fusion module; 3, training the saliency detection model to obtain a trained saliency detection model; and 4, carrying out saliency detection on the image data by adopting the trained saliency detection model.

The invention provides a multi-modal image fusion method based on modal self-adaption and modal interaction compensation, and the method comprises the following steps: S1, obtaining a multi-modal image fusion data set, and obtaining a training data set through preprocessing; S2, analyzing the modal difference characteristics of infrared and visible light images, and evaluating the correlation characteristics of image pairs in different scenes; s3, capturing a cross-modal feature dependency relationship through a self-attention mechanism; s4, a differential feature extraction strategy is adopted, model parameters are optimized through iterative training, and multi-modal image fusion is completed; s5, a modal interaction compensation module is additionally arranged, unit dynamic balance common features and modal exclusive features are fused, feature complementation is achieved in channel and space dimensions, parameters of the modal interaction compensation module are optimized, the model is made to learn the optimal fusion weight of the multi-modal features in a self-adaptive mode, and multi-modal fusion image generation optimization is achieved through the model; according to the invention, multi-modal image fusion can be accurately and effectively carried out.

The invention provides an aluminum film sealing defect real-time detection method and system based on multi-algorithm fusion, and relates to the technical field of intelligent manufacturing, and the method comprises the steps: triggering an industrial camera at a detection station to collect an original image of a pesticide aluminum film sealing on a conveyor belt; performing adaptive equalization operation on the original image through pixel brightness distribution data, eliminating light fluctuation and surface reflection interference, and outputting a standardized image; three types of defect detection are synchronously executed based on the standardized image, a dynamic threshold segmentation algorithm is combined with local area brightness analysis to detect edge damage, a contour extraction algorithm is adopted to calculate bottleneck center offset to recognize seal offset, wrinkle defects are recognized based on a surface texture feature analysis algorithm, and a primary detection result is output. The aluminum film sealing defect detection method is based on multi-algorithm fusion, has strong anti-interference capability, real-time detection performance and data traceability, and provides an efficient and reliable automatic solution for aluminum film sealing quality management and control.

The invention belongs to the technical field of computer vision and deep learning, and particularly relates to a PCB defect detection method based on combination of a visual converter and conditional diffusion. Comprising the following steps: constructing an unlabeled PCB image data set and carrying out data preprocessing and enhancement to obtain a preprocessed image; executing a self-supervised pre-training task on the preprocessed image to obtain a feature extraction network; based on a conditional diffusion model, generating a synthetic defect PCB image and a label thereof by using the features output by the feature extraction network and the defect type control vector; mixing the synthetic defect image with a small number of real defect images to construct a training set; performing training adjustment on the defect detection model by adopting the training set to obtain a trained defect detection model; performing PCB defect detection by using the trained defect detection model; according to the method, the robustness and the cross-domain generalization ability are remarkably improved, the missed detection risk is reduced, and the rapid and stable quality control requirement of the production line is met.

The invention relates to an intelligent visual identification technology-based cold solder joint microcrack intelligent discrimination method, which comprises the steps of collecting an initial RGB image of a to-be-detected welding spot, carrying out two-dimensional discrete cosine transform and inverse two-dimensional discrete cosine transform on the initial RGB image to obtain an enhanced image, and fusing the enhanced image with an R channel of the initial RGB image to obtain a fused image; forming a dual-channel feature map; calculating the phase consistency of the dual-channel feature map, and obtaining a suspected candidate region of the pseudo soldering microcrack through an adaptive threshold segmentation method; acquiring an RGB image sequence of a continuous time sequence of the welding spots, and performing anomaly detection to obtain an abnormal region set; and constructing a welding spot thermal diffusion model, and inputting the geometric parameters and the environmental parameters in the abnormal region set into the welding spot thermal diffusion model to obtain a final judgment result of the pseudo soldering microcracks. According to the method, through multi-dimensional feature fusion and continuous time sequence dynamic tracking, the detection precision of the pseudo soldering microcracks is remarkably improved, the false detection rate is reduced, and the final judgment result is more accurate.

The invention relates to the technical field of constructional engineering, and discloses a concrete crack intelligent identification and analysis platform based on image and point cloud fusion, the platform operates a concrete crack intelligent identification and analysis method, and the method comprises the following steps: S1, synchronously collecting image data and point cloud data of a concrete structure in the same scene; s2, establishing a unified world coordinate system and generating a depth map corresponding to the image; s3, generating image domain crack candidates; s4, generating a depth domain crack candidate; s5, performing weighted fusion on the image domain crack candidate and the depth domain crack candidate to generate a fusion crack response; s6, extracting a crack skeleton; s7, obtaining a crack three-dimensional model; and S8, selecting an optimal view angle to trigger re-acquisition of the crack area. Through a closed-loop feedback mechanism, an optimal view angle is selected for re-acquisition by calculating a comprehensive utility value after preliminary acquisition, so that information insufficiency caused by illumination, angle or sparse data is effectively made up.

The invention discloses a Gaussian representation SLAM method based on dense matching priori and factor graph constraint, which comprises the steps of inputting a current image and a key frame image, outputting a point graph corresponding to the image through a pre-trained model, returning a matching condition of two frame image points and respective point cloud information, and obtaining a point-level matching result based on a point-level matching result. The method comprises the following steps: constructing a joint optimization problem of a current frame and a key frame by taking a luminosity consistency error and a geometric projection error as targets, performing joint estimation on a camera pose and a point cloud of the current frame, realizing high-precision pose solution, generating point diagram data after Gaussian scene representation and rasterized rendering processing, and transmitting the point diagram data to a rear end for global optimization. And the rear end receives the pose and point cloud data, executes loopback detection to identify repeated key frames, and performs Gaussian rendering through an optimized key frame image to complete global dense three-dimensional reconstruction. The method effectively solves the problem of track drift and scene inconsistency caused by lack of pose priori and global geometric constraints in an existing system.

Methods, systems, and computer programs are presented to perform semantic analysis of video data for event detection and validation. One method includes an operation for training a machine-learning model with text-image pairs to create a semantic model. The semantic model generates text embeddings based on text describing events and image embeddings from video frames. The system calculates similarity values between text and image embeddings to determine event occurrences when the similarity exceeds a predetermined threshold. The system enables precise event detection by analyzing object relationships and attributes within video frames, reducing false alarms and enhancing monitoring efficiency. Further, these techniques can be used to detect any event describable by human text or by some image examples.

The invention discloses a method and a device for detecting abnormity of an electric power inspection image, electronic equipment and a computer readable storage medium. The method comprises the following steps: acquiring the electric power inspection image; identifying and cutting the electric power inspection image based on the type of to-be-inspected equipment to obtain a target inspection image; performing multi-scale decomposition and extraction on the target inspection image to obtain scale features; mapping the target inspection image based on the scale features, and determining a target detection area image; performing enhancement processing on the target detection area image to obtain an enhanced image; and performing comparative analysis on the enhanced image and a normal image at the target detection area image to obtain an anomaly detection result. Through the method and the device provided by the embodiment of the invention, accurate anomaly detection of the electric power inspection image is realized.

The invention relates to the technical field of engineering materials, in particular to an engineering material quality detection method and system based on image recognition, and the method comprises the steps: reference image acquisition, sampling point selection and marking, image acquisition, image comparison and positioning, secondary acquisition and anomaly analysis. Compared with the defects that a detection system in the prior art is rigid in process, poor in adaptability and difficult to cope with a complex and changeable engineering field environment, the scheme constructs a full-process automatic system from intelligent sampling, self-adaptive image acquisition, precise registration and semantic level difference detection to intelligent post-processing and analysis; the method has high intelligence, adaptivity and robustness, and can stably and efficiently complete quality detection tasks in a complex engineering environment.

The invention belongs to the technical field of image processing, and particularly relates to a titanium cylinder inner wall defect detection method and system.The method comprises the steps that a titanium cylinder inner wall image is collected, and a highlight area and boundary pixel points thereof are extracted through threshold segmentation and corrosion operation; calculating a scale adjustment factor by combining a highlight area proportion and a boundary gradient amplitude, dynamically scaling the reference kernel according to the scale adjustment factor, and determining a standard deviation of a multi-scale Gaussian kernel; constructing a Gaussian kernel function of each scale, and calculating the sum of difference values of the titanium cylinder inner wall image and convolution results of all scales in a logarithm domain to obtain an enhanced titanium cylinder inner wall image; and performing threshold segmentation on the enhanced titanium cylinder inner wall image to identify a defect area. According to the method, the filtering scale is adjusted in a self-adaptive mode, mirror reflection interference is effectively restrained, halo artifacts are eliminated, and tiny defects covered by highlight are accurately recognized.

The invention discloses a melanoma lesion area segmentation method based on a CLIP multi-modal fusion network. The method comprises the following steps: 1, constructing an MA-CLIP model; 2, a BLIP language model is finely adjusted through a manually-labeled text-image pair, a large-scale multi-modal data set is constructed, a training set, a test set and a verification set are divided, and preprocessing is carried out; 3, training the MA-CLIP model; 4, evaluating the performance of the MA-CLIP model and optimizing parameters; and 5, inputting a to-be-segmented melanoma clinical image into the trained MA-CLIP model, and outputting a segmentation result. According to the method, the problem of insufficient traditional medical data annotation can be solved, accurate guidance of clinical semantics on image segmentation is realized, and the recognition precision and boundary segmentation capability of a focus in a complex form are improved.

The invention relates to the technical field of artificial intelligence, in particular to a pest and disease identification method and system based on image processing and a medium, and the method comprises the steps: obtaining an original image of a plant leaf, and carrying out the preprocessing of the original image, and obtaining a preprocessed image; performing scab region segmentation on the preprocessed image by using an improved U-Net model to obtain a contour and a position of a scab; carrying out feature extraction on the segmented scab region, extracting deep semantic features through a pre-trained ResNet-50 network, and carrying out splicing fusion on the deep semantic features and color features and shape features of the scab to form a comprehensive feature vector; inputting the comprehensive feature vector into an integrated classifier based on XGBoost to carry out disease and insect pest type identification, and outputting disease and insect pest types and corresponding probabilities; the accuracy of pest and disease prediction can be improved.

The invention belongs to the technical field of hydraulic engineering detection, and particularly provides a hydraulic metal structure surface coating defect detection method and a hydraulic metal structure surface coating defect detection device based on image processing. In a wet and dry alternating environment of a hydraulic metal structure, a multispectral imaging device is used for acquiring an image of a metal structure surface coating, and the acquired multispectral image is preprocessed; a complete and clear image to be detected is obtained; extracting features related to coating defects from the preprocessed to-be-detected image, wherein the features comprise spectral features, texture features and color features; and inputting the extracted features related to the coating defects into a pre-trained classification model, and classifying the coating defects through the classification model. According to the method and the device, the state of the coating can be comprehensively described, and the type and the degree of the coating defect can be accurately identified.

The invention relates to a deformation online measurement and control method for multi-robot collaborative assembly. The method comprises the steps that multi-view surface images of workpieces in the assembly process are collected in real time through distributed robots and cameras arranged at the tail ends of the distributed robots; each view angle surface image is input into a deep learning model trained based on a digital image related technology, the optimal pixel displacement corresponding to each view angle surface image is output, and the optimal pixel displacement corresponding to each view angle surface image is converted into a spatial displacement label; the deep learning model takes an encoder-decoder as a trunk network; fusing the spatial displacement labels corresponding to the view angle surface images to obtain a fused displacement field; based on the fusion displacement field and the nominal path planning point, the tail end pose of the distributed robot is determined; the assembly error is calculated based on the reference target positioning and the tail end pose, and the PID controller adjusts the joint space of the distributed robot based on the assembly error. According to the method, the calculation overhead is remarkably reduced, and the measurement precision and robustness are improved.

The invention provides a small target detection method and system based on aligned visible light and infrared images, and relates to the field of target detection, and the method comprises the steps: obtaining a visible light image and an infrared image of a to-be-detected small target; inputting a visible light image and an infrared image into the trained detection model, firstly, respectively performing multi-scale feature extraction on the visible light image and the infrared image by adopting a double-branch structure, and in the extraction process, performing multi-scale feature extraction on the visible light image and the infrared image through interactive collaborative learning of the visible light image and the infrared image; the method comprises the following steps: firstly, carrying out feature alignment, modal interaction correction and multi-scale feature enhancement between two modals to obtain enhanced visible light features and infrared features, then carrying out feature fusion, and finally, carrying out small target positioning and classification by utilizing the fused features. According to the method, feature level alignment of image pairs is realized by using deformable convolution and modal interaction correction, so that the features of visible light and infrared images are effectively and fully interacted and fused, and the accuracy of a detection algorithm is improved.

The invention relates to the technical field of virtual reality, in particular to an indoor structure reconstruction method based on a panoramic image scene understanding algorithm, and the method comprises the steps: S11, obtaining a plurality of equidistant columnar projection panoramic images of a current indoor scene through a panoramic camera or a panoramic image splicing algorithm; s12, performing semantic segmentation on the collected panoramic image by using SAM, deducing indoor ceiling, floor and wall areas of the panoramic image on the basis of a semantic segmentation result, and generating a multi-channel semantic graph; and S13, inputting the acquired RGB panoramic images and the multi-channel semantic map into a pre-trained panoramic image depth estimation model to obtain a depth map corresponding to each panoramic image. The method is used for automatically generating an indoor structure model, the scheme comprises the core steps of semantic segmentation and layout reasoning, depth estimation and point cloud construction, structure optimization and indoor model reconstruction and the like, and a complete indoor panoramic image scene understanding scheme is formed.

The invention discloses a wildlife detection method fusing an unmanned aerial vehicle thermal infrared image and a visible light image, and belongs to the field of small target wildlife identification, and the method comprises the following steps: S1, obtaining a preprocessed TIR-RGB image pair set; s2, an FDM-YOLO double-source target detection model improved based on YOLOv81 is constructed, and the improved FDM-YOLO double-source target detection model is trained based on the preprocessed TIR-RGB image pair set obtained in the step S1; and S3, inputting an image acquired in real time into the improved FDM-YOLO double-source target detection model trained in the step S2, and outputting a wild animal detection result. By adopting the wild animal detection method fusing the thermal infrared image and the visible light image of the unmanned aerial vehicle, high-precision, real-time and robust detection of a small target of a wild animal in a complex field environment is realized by improving the FDM-YOLO model.

The invention discloses a soil heavy metal inversion method and system integrating satellite remote sensing and near-end sensing, and the method comprises the steps: collecting a soil sample, and measuring the soil heavy metal content and a soil visible light-near infrared spectrum; obtaining a time sequence multispectral image of a research area, calculating a spectral index, and selecting and screening bare soil pixels through a threshold value to obtain a bare soil image; performing spectrum correction on the bare soil image; obtaining a joint dictionary and a sparse coefficient through sparse representation and dictionary learning, and reconstructing a hyperspectral image of the bare soil image; converting the one-dimensional spectral data into a two-dimensional spectrogram by using continuous wavelet transform, extracting spectral features in combination with a 2D-CNN algorithm, and constructing a soil heavy metal inversion model; and using the trained inversion model to predict the soil heavy metal content of the research area based on the reconstructed hyperspectral image. According to the method, satellite remote sensing and near-end sensing are integrated to obtain a large-scale accurate soil heavy metal content distribution map, deep features are extracted in combination with a 2D-CNN algorithm, and the inversion model precision and model efficiency are improved.