2616 results about "Source image" patented technology

Using a pre-trained and fixed Vision Transformer (ViT) model as an external semantic prior, a generator is trained given only a single structure / appearance image pair as input. Given two input images, a source structure image and a target appearance image, a new image is generated by the generator in which the structure of the source image is preserved, while the visual appearance of the target image is transferred in a semantically aware manner, so that objects in the structure image are “painted” with the visual appearance of semantically related objects in the appearance image. A self-supervised, pre-trained ViT model, such as a DINO-VIT model, is leveraged as an external semantic prior, allowing for training of the generator only on a single input image pair, without any additional information (e.g., segmentation / correspondences), and without adversarial training. The method may generate high quality results in high resolution (e.g., HD).

The embodiment of the invention discloses a fire monitoring and early warning method and device based on big data analysis, and belongs to the technical field of data analysis. According to the embodiment of the invention, multi-source data such as satellite remote sensing heat source images, meteorological environment parameters, historical fire event records and geographic information raster data are integrated, a space-time associated dynamic monitoring system is constructed, and environmental anomaly symptoms before fire occurrence can be comprehensively captured. Wherein the space-time reference difference of different source data is eliminated through the space-time fusion processing, so that the heat source distribution, the meteorological change and the historical fire mode form multi-dimensional association under a unified geographic framework, the sensitivity and the reliability of early fire point identification are remarkably improved, and the subsequent accurate fire risk prediction is realized.

The invention discloses a visual detection system and method for tiny flaws of industrial products, and belongs to the technical field of product detection, multi-source image data of a target industrial product under multiple detection angles and illumination conditions are acquired, and an image information matrix is established; performing region segmentation and texture enhancement on the image, and extracting local texture direction inconsistency parameters; carrying out normalization analysis on the pixel ratio under different spectrum channels, and calculating a multispectral reflectance ratio abnormal index; constructing a deep convolution recognition model; reasoning the image by using the model, and outputting a defect judgment result and a confidence score; judging whether the area is a flaw area based on a dynamic threshold mechanism, and outputting a detection report containing flaw position information and a visual heat map; according to the method, multi-dimensional fusion identification of texture structure disturbance and spectral response abnormity is realized, the micro defect identification precision is effectively improved, and the method has high robustness, automation and engineering practicability and is suitable for high-precision quality control requirements of various industrial scenes.

Several embodiments of scalable image processing systems and methods are disclosed herein whereby color management processing of source image data to be displayed on a target display is changed according to varying levels of metadata.

The embodiment of the invention provides a swimming pool robot positioning and trajectory prediction method and system fusing sonar and vision. The method comprises the following steps: collecting terahertz sonar data for a target area; based on terahertz sonar data, constructing a motion track model of the swimming pool robot; acquiring multi-source image data by adopting a multi-spectrum and event camera collaborative acquisition strategy; a dynamic SLAM algorithm based on deep learning is adopted, dynamic objects in the swimming pool environment are recognized and processed in real time based on the multi-source image data, and the environment image data with the dynamic objects removed are adopted to obtain a swimming pool environment model; performing deep fusion on the motion track model and the swimming pool environment model through a knowledge graph network, and predicting the operation state of the swimming pool robot by adopting a quantum machine learning algorithm to obtain a panoramic model; and creating and updating a digital twinborn model corresponding to the panoramic model in real time. The real-time performance and accuracy of positioning and track prediction of the swimming pool robot are improved, and a user can conveniently maintain and manage the swimming pool robot.

The invention relates to the technical field of underwater fish school monitoring, and discloses an underwater fish school monitoring statistical system based on image fusion. According to the system, underwater video streams and sonar reflection intensity data of different spectral bands are acquired through an underwater multi-source image acquisition module, and time-space synchronous multi-modal image data streams are generated through timestamp alignment; a fish school contour reconstruction module is used for segmenting a fish school contour boundary and fusing visible light texture and sonar geometric features to generate an underwater three-dimensional fish school distribution set; the dynamic track mapping module tracks the mass center displacement, calculates the movement rate and the direction deviation angle, and correlates the water area depth to generate a dynamic track topological graph; the behavior anomaly analysis module extracts environment data based on the track mutation node, and detects aggregation density change and direction dispersion to mark an anomaly feature cluster; and the population statistics output module integrates the data, performs classified statistics on population distribution, a quantity threshold value and a migration path overlap ratio, and finally generates a fish school quantity distribution statistics thermodynamic map.

The invention relates to the technical field of multi-image fusion recognition, in particular to a data fusion method and system for CCD visual detection, and the method comprises the following steps: obtaining a horizontal pixel row calculation gradient construction trend sequence, repairing an edge fracture to generate an integrity index, extracting a gray value to detect feature mutation, and distributing fusion weights to establish a mapping relation. And executing image fusion and balancing the contrast to generate a fusion matrix result. According to the method, the fracture edge region is identified, interpolation compensation is executed, the structural similarity index of the local gray sequence in the image overlapping region and feature direction mutation detection are combined, accurate identification of the edge matching result is guided, and fusion weight factor mapping corresponding to signal-to-noise ratio distribution is introduced; according to the method, the distribution relation between the pixels in the region and the credible weight is effectively established, the edge transition among the multi-source images is more natural through Poisson constraint and contrast balance adjustment of the fusion region, and the structural fidelity and the judgment stability of the fusion image are remarkably enhanced.

The invention belongs to the technical field of image processing, and particularly relates to a mine ecological restoration effect evaluation system and method. The system comprises a multi-source remote sensing data fusion part, a data processing and analysis part and an ecological restoration effect evaluation part, the multi-source remote sensing data fusion part is used for acquiring multi-source remote sensing image data including a plurality of source images in a target mine area; the data processing and analyzing part is used for performing multi-scale fractal analysis on the fused remote sensing image data to obtain fractal dimensions related to the scale of the target mine area; and the ecological restoration effect evaluation part is used for obtaining the ecological restoration degree of the mine according to the relationship between the multispectral adaptive vegetation index in the historical data and the ecological restoration of the mine. According to the method, the accuracy and comprehensiveness of mine ecological restoration effect evaluation are remarkably improved.

An illustrative point cloud segmentation system generates an instance-wise semantic mask for a particular source image of a set of source images that has been used to construct a 3D point cloud representing a scene that includes one or more objects. The point cloud segmentation system maps a set of 3D points from the 3D point cloud to corresponding 2D points of the particular source image, then labels, based on contours defined by the instance-wise semantic mask to demarcate the one or more objects, the mapped set of 3D points in accordance with where the corresponding 2D point for each mapped 3D point is positioned with respect to the contours. Based on the labeling of the mapped 3D points, the point cloud segmentation system produces a segmented 3D point cloud including an instance-wise segmentation of the one or more objects at the scene. Corresponding methods and systems are also disclosed.

The invention discloses an educational resource image intelligent recommendation and multi-scale matching system and method based on machine learning, and relates to the technical field of intelligent education, a permeability evaluation model is constructed by collecting interactive behavior data of students and educational resource images to quantify cognitive stability and knowledge mastery parameters; synchronously performing multi-scale analysis on the image to generate a visual feature, a knowledge association feature and a cognitive guide feature; and determining an optimal recommendation level based on dynamic granularity selection processing, generating an enhanced image with a permeability feedback mark, and interactively generating learning evaluation data through the enhanced image. According to the method, cognitive dynamic evaluation and multi-scale feature matching are fused, so that the technical bottleneck of a traditional recommendation system on image granularity selection and cognitive adaptation is solved, and the educational resource recommendation accuracy and learning efficiency are remarkably improved.

The invention relates to the technical field of image processing, in particular to an image fusion driven anti-collision identification method and system. The method comprises the following steps: acquiring multi-source image data, and performing semantic guidance image fusion according to the multi-source image data to obtain image fusion data; performing scene segmentation according to the image fusion data to obtain scene segmentation data, and performing target detection on the scene segmentation data to obtain scene target data; performing confidence hierarchical space positioning according to the scene target data to obtain target positioning data, and performing motion trail prediction according to the target positioning data to obtain motion trail prediction data; and performing collision area propagation risk assessment according to the motion trail prediction data to obtain collision risk data. By fusing image perception depth, semantic understanding dimension and trajectory evolution modeling, the method has higher environmental adaptability, weak target recovery capability and system interpretability.

The invention belongs to the technical field of digital restoration of computer vision and cultural heritage, and particularly relates to a traditional picture restoration method fusing low-resolution prior and efficient visual selection, which comprises the following steps: constructing a multi-source image data set, taking images in the multi-source image data set as high-resolution images, preprocessing the high-resolution images to obtain low-resolution images, and carrying out high-resolution priori and high-efficiency visual selection on the low-resolution images. The high-resolution image and the low-resolution image are respectively masked to generate simulated damage mask images, and the simulated damage mask images comprise a regular damage mask image and an irregular damage mask image; taking the multi-source image data set and the preprocessed multi-source image data set as training data, and training a multi-source image model; the dual-stage repair network comprises a coarse repair network and a fine repair network; according to the method, the problems of structural semantic loss, high priori information dependency and insufficient global and local coordination when an existing image restoration method is used for processing a complex scene and a large-range missing region are solved.

The invention provides an intelligent real-time detection method and system for PCCP welding quality, and relates to the technical field of online detection and intelligent evaluation of pipeline welding quality through machine learning. Light energy data and multi-light-source images of a spiral weld pool are collected, exposure parameters are dynamically adjusted through the energy difference of visible light near-infrared bands, and the real-time detection of the PCCP welding quality is achieved. Inhibiting strong light interference and generating a weld surface image; a stress concentration area is positioned by scanning a welding seam thermal deformation area and combining speckle pattern change, sound frequency change and the elastic characteristic of the thin-wall steel cylinder; inputting the surface image and the deformation data into a space-time convolutional neural network, fusing light energy change, image details and spatial features to construct a weld joint space structure diagram, and adaptively correcting the position of a sensor; and comparing the sinking depth of the three-dimensional point cloud reconstruction, analyzing the correlation between the sinking degree and the stress, and generating a probability thermodynamic diagram to output the pressure-bearing failure risk level, so that the probabilistic early warning of the pressure-bearing failure risk can be realized.

The invention discloses a cigarette packet appearance defect detection method and system based on deep learning, and relates to the technical field of appearance detection.When the system runs, multi-angle and multi-light-source image acquisition is carried out through a high-definition camera and scanning equipment, it is ensured that appearance details of cigarette packets are comprehensively and accurately captured, and the detection accuracy of the appearance defects of the cigarette packets is improved. According to the method, firstly, the image quality and consistency are further improved through image cutting, graying processing, denoising processing, image enhancement and data standardization of the data preprocessing module, a solid foundation is laid for subsequent defect detection, secondly, the defect detection module carries out feature extraction through strong and weak data enhancement and a feature extractor, and the defect detection accuracy is improved. By calculating the similarity of positive and negative samples in a feature space and a total loss function # imgabs0 #, defect identification and optimization are performed in combination with MSE loss, the defect detection precision and robustness of the model are improved, the evaluation module evaluates appearance defects in real time by matching with a preset threshold, and a continuously optimized detection closed loop is formed.

The invention provides a tunnel crack identification method and system based on multi-source image processing, and relates to the technical field of tunnel engineering, and the method comprises the steps: obtaining multi-source data of a horizontal rock stratum tunnel; performing spatial registration on the multi-source data to generate a multi-modal image under the same reference system; extracting multi-modal features according to the multi-modal image, and constructing a multi-source feature map under the same space grid; performing crack initial detection on the multi-source feature map in combination with multi-scale filtering and structure tensor analysis to obtain a crack candidate region mask; accurate crack identification is carried out through the crack candidate area mask, a crack identification result is obtained by combining bedding direction constraint and a microconditional random field, and the crack identification result comprises a crack segmentation map and a crack category. The method solves the problem that existing crack identification does not consider the bedding characteristics of the horizontal rock stratum tunnel.

The invention relates to the technical field of fire-fighting early warning, and discloses a fire-fighting early warning system based on image data relevance. The system comprises a multi-source image acquisition module used for acquiring fire-fighting scene multi-source heterogeneous image data; the correlation feature analysis module is used for performing cross-data-source correlation analysis on the data to generate feature vectors; the spatio-temporal dynamic modeling module is used for constructing a multi-dimensional feature fusion space to generate an associated spatio-temporal feature tensor; the resource optimization scheduling library is used for constructing a double-layer collaborative library; and the intelligent early warning control module generates a real-time fire early warning instruction and an emergency response decision through a hierarchical reinforcement learning framework. The system also has the functions of building structure deformation detection, smoke diffusion prediction and the like. Through cooperation of multiple modules, accurate fire-fighting early warning and efficient emergency response are realized, the fire prevention and control capability is improved, and life and property safety is effectively guaranteed.

The invention relates to an infrared and visible light image fusion method based on a cross-domain Transform, and belongs to the field of computer image processing. The method comprises the following steps: respectively carrying out preprocessing operation on an infrared image and a visible light image to obtain a training data set; an end-to-end image generator network is designed, an encoder module is used for extracting deep semantic features of an infrared image and a visible light image, a fusion module introduces an axial attention mechanism to enhance the global modeling capability of the features, and feature fusion is carried out in combination with information of a spatial domain and a frequency domain; the fused features are gradually recovered to an image space through a decoder module, and a fused image is generated; constructing a fusion loss function module, and guiding the network to focus a significant feature difference between the source image and the fusion image based on a comparative learning idea; and finally, inputting the infrared and visible light image Y channel into the network model, generating a fusion image, completing a training process, and realizing unified optimization of fusion performance and visual quality.

A model training method includes obtaining a training sample set including a triplet training sample that includes a source image, a template image, and a true value image, performing face swapping on the source image and the template image through a first image processing model having a re-parameterization structure to obtain a face-swapped image, obtaining a second image processing model corresponding to the first image processing model and being a pre-trained image processing model, calculating a fusion loss function of the first image processing model according to the second image processing model, the first face-swapped image, and the true value image, training the first image processing model according to the fusion loss function, and determining a model parameter of the first image processing model in response to a training convergence condition of the first image processing model being reached.

The invention discloses a pathological section virtual staining image generation method based on a diffusion model, and belongs to the technical field of medical image processing. The method comprises the following steps: firstly, passing through Hamp; e dyeing serves as a source image data set, and pathological section images subjected to IHC dyeing serve as a target image data set; preprocessing the source image, and converting the source image into a corresponding YUV color space; extracting a saliency map and a gradient map of the source image, and generating a weighted attention map; building a diffusion model by using a neural network, and inputting the preprocessed source image for fine tuning; repeatedly iterating until the loss function converges, and ending the training; and inputting a weighted attention map to perform reasoning of virtual dyeing. According to the method, weighted attention of a pathological section image is added in a reasoning part to serve as an image prompt input network, so that the cell structure of a finally generated image is controlled not to be changed, and meanwhile, color features of a target dyed image are reserved and emphasized; and the accuracy and the reconstruction effect of the generated virtual dyeing image are improved.

The invention discloses a panoramic image real-time splicing algorithm and system based on multi-sensor fusion, and particularly relates to the technical field of panoramic image real-time splicing, and the algorithm comprises the following steps: constructing a structured fusion sequence based on multi-source images, postures and position information, optimizing a matching effect through high-density feature extraction and repeated texture recognition, and obtaining a multi-source image fusion sequence; a dynamic foreground and a static background are distinguished by using sparse optical flow so as to improve the visual angle estimation precision, pose fusion optimization is realized in combination with a multi-mode residual error, and the continuity and stability of a spliced image are improved through edge smoothing, brightness tuning and color correction; according to the method, the structured fusion sequence is constructed through multi-source data alignment, so that the data synchronization and splicing stability is improved; identifying repeated regions based on texture direction features, and optimizing feature matching accuracy; and through edge smoothing, brightness harmonizing and color consistency processing, the visual coherence and output quality of the panoramic image are enhanced.

The invention provides a deep counterfeit detection method based on self-mixing, and compared with the prior art, the method generates a mixed image containing counterfeit artifacts by using a self-mixing technology, and carries out the precise detection and recognition of an artifact region of an input image through combining a backbone network OfficientNet-b3 and a counterfeit artifact detection module. The method comprises the following steps of: firstly, performing framing processing on a real image, generating a source image and a target image by utilizing a self-mixing technology, and generating a mixed image with counterfeit artifacts by combining a mask generator with an alpha blowing model; and then, the backbone network extracts global features from the mixed image, and the fake artifact detection module reinforces local feature expression of a mixed region through an artifact space cooperation attention module, so that an artifact region is accurately positioned. And finally, fusing global and local features by using residual connection, and transmitting the fused features to a full connection layer to complete classification. According to the method, various forged image types can be effectively detected, and excellent generalization ability is shown in cross-dataset and unknown scenes.

The invention provides a multi-source image registration method based on deep learning, and relates to the technical field of image processing. The method comprises the following steps: firstly, respectively carrying out image preprocessing on infrared and visible light images; then constructing and training a feature point extraction model, and respectively extracting feature points and descriptors from the preprocessed infrared and visible light images; carrying out feature matching on the extracted feature points by adopting a feature point matching model to obtain high-precision matching point pairs; robust matching point screening and registration optimization are carried out on the matching point pairs, and a geometric transformation matrix between the infrared image and the visible light image is calculated; and finally, performing geometric transformation on each pixel point of the infrared image through the geometric transformation matrix between the infrared image and the visible light image, and converting the pixel points into a coordinate system of the visible light image to obtain a final registration result of the infrared image and the visible light image. According to the method, when the modal difference between the multi-modal images is large, a stable registration effect can still be obtained, and the robustness of multi-modal image registration is greatly improved.

The invention discloses an intelligent detection method for fault detection of an outdoor power line, and the method comprises the following steps: 1, carrying out the collection and preprocessing of multi-modal data, and carrying out the collection and preprocessing of the multi-modal data through an unmanned plane cluster, a distributed optical fiber sensor, a laser radar and meteorological monitoring equipment; visible light image data, infrared image data, laser point cloud data, vibration waveforms, temperature distribution and environmental parameters of the power line are synchronously obtained, and multi-source image data are processed, namely the visible light image data, the infrared image data and the laser point cloud data are processed; and 2, intelligent fault diagnosis: inputting the data acquired in the step 1 into a multi-task neural network model, and outputting a fault positioning and type identification result. According to the novel detection method based on multi-modal data fusion, an intelligent algorithm and closed-loop optimization, the fault identification precision, the dynamic decision-making capability and the comprehensive protection efficiency are improved, and the intelligent operation and maintenance requirements of a modern power grid are met.

The invention discloses an intelligent safety monitoring method and system for a glass curtain wall, electronic equipment and a storage medium, and relates to the technical field of curtain wall detection. The method comprises the following steps: acquiring multi-source image data of an external facade of the glass curtain wall, wherein the multi-source image data comprises a front view image, an infrared thermal imaging image and an ultraviolet spectrum image of the glass curtain wall, which are acquired at different time periods and different angles; performing registration fusion and identification analysis on the multi-source image data to obtain crack characteristics, deformation characteristics and temperature distribution characteristics of the surface of the glass curtain wall; establishing an abnormal characteristic spectrum of the glass curtain wall based on the crack characteristics, the deformation characteristics and the temperature distribution characteristics; performing spatio-temporal evolution analysis on the abnormal characteristic spectrum to determine a multi-level risk area of the glass curtain wall; and generating a monitoring report of the glass curtain wall according to the multi-level risk area. By implementing the technical scheme provided by the invention, comprehensive monitoring of the glass curtain wall can be realized, so that the monitoring accuracy of the glass curtain wall is improved.

Nonlinear peri-codec optimization for image and video coding includes obtaining a source image including pixel values expressed in a first defined image sample space, generating a neuralized image representing the source image, the neuralized image including pixel values that are expressed as neural latent space values, encoding the input image wherein the neural latent space values are used as pixel values in a second defined image sample space and the input image is in an operative image format of the encoder, such that a decoder decodes the encoded image to obtain a reconstructed image in the second defined image sample space, wherein the reconstructed image is a reconstructed neuralized image including reconstructed neural latent space values, such that a deneuralized reconstructed image corresponding to the source image is obtained by a nonlinear post-codec image processor in the first defined image sample space.

The invention discloses a multi-source remote sensing image zero sample change detection method, and relates to the technical field of remote sensing image processing, and the method comprises the following steps: obtaining remote sensing images collected by two or more remote sensing sensors at different time points in the same geographic area, the image types including optical images and radar images; preprocessing each source image, unifying the spatial resolution and the registration precision, and denoising and standardizing the image; according to the method, the cross-modal shared semantic embedding space is constructed and unsupervised comparative learning is introduced, so that the semantic consistency of the multi-source remote sensing image is effectively improved, and the change recognition capability of the model under the zero sample condition is enhanced; and meanwhile, a difference fusion calculation and structure consistency constraint module is adopted, so that the boundary judgment precision of a change region and the overall structure consistency are improved, and the accuracy and stability of a detection result are remarkably improved.

A method of three-dimensional reconstruction of human heads using a single photo in the form of polygonal mesh, with animation and realistic rendering capabilities for novel head poses is provided. The method includes encoding, by using a first convolutional neural network, a single source image into a neural texture; estimating, by a pre-trained detailed expression capture and animation (DECA) system, a face shape, a facial expression, and a head pose by using the single source image and a target image, and providing an initial mesh; providing a predicted mesh of a head mesh based on the initial mesh and the neural texture; rendering a human image by using the predicted mesh.

The invention provides a multi-mode fusion gas station leakage-fire early warning method and system, and belongs to the field of gas system leakage and fire monitoring. The method comprises the following steps: firstly, acquiring infrared image data, pressure and gas concentration time sequence data of a gas station pipeline; secondly, the collected data are preprocessed; thirdly, an abnormal heat source image data set is manufactured, and a yov5 abnormal heat source monitoring model is constructed and trained and used for recognizing an abnormal heat source and calculating the fire symptom abnormal probability; and then, merging the fire symptom anomaly probability with a sensor data set, making a leakage-fire data set, and establishing a multi-mode gas station leakage-fire anomaly identification model for training and tuning. And finally, the trained multi-mode model is used for carrying out leakage-fire abnormity monitoring on the gas station, and corresponding early warning information is sent out according to an output result. According to the invention, gas leakage-fire joint abnormity discrimination can be realized, and the safety and early warning accuracy of the gas station are improved.

The invention discloses an unmanned aerial vehicle intelligent inspection method for particulate matter pollution prevention and control, and the method comprises the steps: S1, carrying out the aerial photographing to obtain a particulate matter pollution source image, and generating a pollution source image recognition model; s2, aerial photography is carried out to obtain a particulate matter pollution management and control facility image, and a pollution management and control facility image recognition model is generated; s3, collecting related data, and generating a particulate matter pollution source and particulate matter pollution management and control facility list and distribution map; s4, the terminal intelligent control platform plans an unmanned aerial vehicle inspection route; s5, when the particulate matter concentration data of the monitoring site reach an early warning value, starting inspection operation; s6, transmitting the data recorded by the inspection of the unmanned aerial vehicle to the terminal in real time; s7, the terminal identifies the pollution source type, the pollution degree and the pollution control facility state according to the transmitted data to form a pollution source patrol list; and S8, automatically sending the generated list to related personnel. The method is high in target identification precision and accurate in positioning, improves the inspection efficiency of particulate matter pollution prevention and control, and reduces the labor cost.

The invention belongs to the technical field of super high-rise building three-dimensional reconstruction, and particularly relates to a multi-source data fusion super high-rise building group live-action three-dimensional model construction method. According to the method, an initial three-dimensional model is generated through a series of processing such as aerial triangulation encryption and triangulation network construction based on multi-source image data, in the process of recognizing a fuzzy region and performing data supplementary collection, regions with texture loss and structure distortion in the initial three-dimensional model can be positioned, supplementary collection requirements are determined according to characteristics of different regions and a preset threshold value, and the recognition accuracy of the initial three-dimensional model is improved. The method comprises the following steps of: performing oblique photography on an unmanned aerial vehicle to acquire data in a supplementary manner, fusing the data with original data, extracting a building structure contour, matching high-resolution texture data, performing texture binding and processing and the like to form a building monomer model, and performing spatial position and texture fusion on the building monomer model and a process three-dimensional model to generate a regional three-dimensional live-action model. And finally, splicing and fusing the three-dimensional live-action models of all the areas to form a complete super high-rise building group live-action three-dimensional model.