32 results about "Background reconstruction" patented technology

The invention relates to a fire point detection method, device and system based on a multiband infrared image and a storage medium, and relates to the technical field of image data processing. The method comprises the following steps: acquiring multiband infrared image data, and preprocessing the multiband infrared image data; performing feature classification extraction and feature fusion on fire point features of a fire point region and background features of a non-fire point region in the preprocessed multiband infrared image data by adopting a preset fire point detection model to obtain a target fire point segmentation probability graph; wherein the preset fire point detection model comprises an encoder, a fire point segmentation decoder, a background reconstruction decoder and a fusion module; and determining a fire point pixel detection result according to the target fire point segmentation probability graph and the segmentation threshold.

The invention relates to the technical field of automatic driving, in particular to a dynamic scene simulation generation method for automatic driving, which comprises the following steps: step 1, scene initialization and static background reconstruction: utilizing an improved 3D Gaussian splash technology, fusing LiDAR point cloud prior information, reconstructing a large-scale static road environment, and performing semantic decoupling on a scene; step 2, dynamic object and behavior injection: endowing each dynamic object with an initial motion track represented by a learnable Bezier curve, outputting an adjustment instruction for behaviors of other traffic participants by using a generative AI model according to the semantic information of the current scene and a self-vehicle planning track, and finely adjusting a control point of the Bezier curve; the interactive authenticity is improved, human driving behaviors are simulated through generative AI, physical reasonability is ensured through explicit tracks, the test efficiency is improved, and the long-tail scene generation efficiency is improved by 50% or above through conditional generation.

The invention provides a robot multi-modal data enhancement system for an industrial close-range grabbing scene, and relates to the technical field of industrial robots. The system comprises a data preprocessing module which obtains an RGB image composed of a robot execution track and visual information, a depth image and track data; the background reconstruction module is used for carrying out background reconstruction on the RGB image; the adaptive illumination enhancement module generates illumination disturbance images of multiple versions for the RGB image after background reconstruction, and performs fusion processing to obtain an enhanced RGB image; the depth information reconstruction module is used for reconstructing and complementing missing or invalid areas existing in the original depth image; the multi-modal data synchronization verification module is used for carrying out consistency verification; and the enhanced data output module is used for re-packaging and outputting the enhanced RGB image, the depth image, the track data and the corresponding check code. According to the system, on the premise that existing hardware does not need to be replaced, the quality and robustness of multi-modal data are remarkably improved.

The application discloses a three-dimensional static background reconstruction method, device and equipment and a storage medium. Real images and camera parameters of a scene are acquired; initialized 3D Gaussian parameters and the camera parameters are input into a 3D GS renderer; a rendered image output by the 3D GS renderer and the real images are input into a mask predictor; the 3D Gaussian parameters and the mask predictor are trained; the trained 3D Gaussian parameters and the camera parameters are input into the 3D GS renderer, and a rendered image of a reconstructed static background is output. The application is based on the 3D GS renderer and the mask predictor, uses 3D GS to reconstruct a static background from scene data containing dynamic objects, and does not depend on artificial annotation information.

The application relates to an abnormality detection method based on a hyperspectral image. The main body is based on a space-spectrum combined feature extraction method of filtering and low-rank decomposition to perform abnormality detection on the hyperspectral image. The specific method comprises the following steps: firstly, in the spatial dimension, a reduced dimension image is obtained through a data dimension reduction and eigenvalue weighted fusion method, and then an improved spatial filtering method is used to extract the spatial features of the image to obtain an initial spatial feature image. In the spectral dimension, a background reconstruction image of the approximate background is obtained by using a Tucker decomposition method on the original hyperspectral image, and a background dictionary of the image is obtained by using an improved k-means clustering method, then the background dictionary is input into a low-rank decomposition model to obtain a sparse matrix, and an initial spectral feature image is obtained, finally, the initial spectral feature image is fused with the spatial feature image to realize abnormality detection.

The invention provides a model training method and device of a generative model, a generation method and device of the generative model, and equipment. The method comprises the steps of obtaining a target training sample; the target training sample comprises an initial two-dimensional image and mask data used for representing each initial object in the initial two-dimensional image; inputting the initial two-dimensional image and the mask data of each initial object into a to-be-trained generative model to obtain model features of a 3D mesh model representing the initial object in the initial two-dimensional image by using a mid-scene reconstruction branch of the to-be-trained generative model, and reconstructing a background reconstruction branch of the to-be-trained generative model to obtain a model feature of a 3D mesh model representing the initial object in the initial two-dimensional image; background features capable of describing a background area in the initial two-dimensional image are obtained; and performing model training on the to-be-trained generative model based on model features of a 3D mesh model representing an initial object in the initial two-dimensional image and background features describing a background region in the initial two-dimensional image to obtain a target generative model.

The invention belongs to the technical field of underwater sonar imaging and intelligent identification, and relates to a virtual sonar image generation method and system. The method comprises the following steps: mapping a real optical target image into a virtual sonar target image by adopting a vision-text fusion network; embedding the virtual sonar target image into the real sonar background image to generate a combined image; and background compensation and texture consistency adjustment are carried out on the combined image by using a virtual sonar image background reconstruction network to obtain a virtual sonar image with a background. According to the invention, the bottleneck that real sonar data acquisition is limited by environment, cost and equipment conditions is broken through; meanwhile, the target type and number can be flexibly expanded, and the problems that sonar samples are insufficient in category and unbalanced in distribution are effectively solved.

The invention discloses an event camera video reconstruction method and system based on active aperture modulation, and the method comprises the steps: introducing an aperture modulation strategy for the first time, and reconstructing an initial frame with good quality by periodically adjusting the opening and closing of an aperture and actively triggering a dense global event signal; the problem of low background reconstruction quality caused by sparse events in a static region in the prior art is solved, and good prior information is provided for subsequent dynamic scene reconstruction. By constructing a forward-reverse bidirectional network, rich intensity information is provided for a static scene, and the problems of background disappearance and error accumulation in long-time operation in a traditional method are effectively solved. And meanwhile, high-time-resolution capture of a dynamic region is kept, and high-fidelity and high-dynamic-range video reconstruction is realized.

The application discloses a kind of cable sheath micro crack image recognition methods based on deep learning, including the following steps: cable sheath image is collected and image pre-processing operation is executed;Input to improved MAE model, generate background reconstruction map and crack reconstruction map;Pixel-level residual fusion is carried out, and background mask map is generated;Pixel-level fusion is carried out to background mask map and pre-processing image, and background suppression map is generated;Micro crack identification operation is executed, and preliminary crack response heat map set is output by image feature extraction and crack area discrimination;Heat map cumulative analysis operation is executed, and multi-scale cumulative heat map is constructed;According to local response change rate, judge false response risk area;Response value retraction operation is carried out based on corresponding local area, and crack heat map after false response suppression is generated;High confidence crack area is extracted, and cable sheath micro crack recognition result is obtained.The application improves the precision and robustness of micro crack detection, reduces background interference and false detection risk.

This invention relates to a texture primitive extraction method for tire X-ray images, addressing the challenge of accurately obtaining pixel-by-pixel texture information at the individual cord level while suppressing background interference. It falls under the field of computer vision and image processing technology. The method combines frequency domain analysis to obtain texture direction and spacing, utilizes this information to construct a mesh mask, and further combines background point extraction with real background reconstruction to filter out specific background regions in the original image. Under directional constraints, the remaining texture mesh is continuously tracked to obtain pixel-by-pixel texture information, thus achieving texture primitive extraction. This provides a more reliable foundation for subsequent pathological detection, structural analysis, and cord-level texture modeling.

The invention provides a ground coffee foreign matter detection method and device based on background reconstruction, a medium and a product, and the method comprises the following steps: obtaining an original transmission image of to-be-detected ground coffee, and carrying out gray normalization to obtain a standard input image; respectively inputting a standard input image into a background reconstruction branch and a target detection branch; in the background reconstruction branch, generating a pure background prediction image by using a self-encoding model, and calculating a gray difference between the pure background prediction image and the standard input image to obtain a foreign matter residual image; convolutional features are extracted from the foreign matter residual image, and a spatial residual attention weight map is generated; in the target detection branch, performing multi-layer convolution on the standard input image, and performing weighted fusion in combination with the attention weight map to obtain a foreign matter sensitive feature map; and outputting a foreign matter detection result through prediction head network classification and regression decoding. By implementing the technical scheme provided by the invention, the detection sensitivity of low-contrast and low-density foreign matters is improved, and meanwhile, the false detection rate caused by complex powder textures is reduced.

The application relates to the technical field of computer vision, in particular to a NeRF map construction method and device based on visual SLAM, wherein the method comprises the following steps: in a dynamic scene, acquiring a static target feature point of a current frame image of a camera; tracking the static target feature point, solving a current frame camera pose of the camera, and selecting a key frame according to the number of projection inliers in a tracking process and tracking time; sampling pixel points in the key frame according to ORB features, inputting a key frame sampling result into a pre-established NeRF map model for training, obtaining NeRF map model parameters, and obtaining a NeRF map construction result. The application can generate a dense NeRF map in real time for a dynamic scene, overcome the problem of false matching in the dynamic scene, maintain simplicity with high efficiency, eliminate the influence of dynamic targets, complete high-quality background reconstruction, and effectively meet the positioning and mapping application requirements in different scenes.

This invention provides a multimodal data augmentation system for robots in industrial near-field grasping scenarios, relating to the field of industrial robot technology. The system includes: a data preprocessing module, which acquires an RGB image, a depth image, and trajectory data composed of robot execution trajectory and visual information; a background reconstruction module, which reconstructs the background of the RGB image; an adaptive lighting enhancement module, which generates multiple versions of lighting perturbation images from the reconstructed RGB image and fuses them to obtain an enhanced RGB image; a depth information reconstruction module, which reconstructs and completes missing or invalid regions in the original depth image; a multimodal data synchronization verification module, which performs consistency verification; and an enhanced data output module, which repackages and outputs the enhanced RGB image, depth image, trajectory data, and corresponding checksums. This system significantly improves the quality and robustness of multimodal data without requiring replacement of existing hardware.

The application belongs to the technical field of underwater sonar imaging and intelligent identification, and relates to a virtual sonar image generation method and system. The method comprises: mapping a real optical target image to a virtual sonar target image by using a vision-text fusion network; embedding the virtual sonar target image into a real sonar background image to generate a combined image; and performing background compensation and texture consistency adjustment on the combined image by using a virtual sonar image background reconstruction network to obtain a virtual sonar image with a background. The application breaks through the bottleneck of real sonar data collection being limited by environment, cost and equipment conditions; at the same time, the target type and quantity can be flexibly expanded, effectively solving the problems of insufficient sonar sample categories and unbalanced distribution.

This invention relates to a model construction method for background reconstruction of Mura defect images on OLED screens, belonging to the field of Mura defect technology. It solves the problems of poor reliability in identifying Mura defects and inaccurate background reconstruction due to the extremely limited number of Mura defect samples during model training in existing technologies. The method includes: acquiring a defect-free image of the OLED screen; converting the defect-free image to grayscale to obtain a grayscale image; generating a defect-free grayscale image and a defect image based on the grayscale image; constructing a sample image set based on the defect-free grayscale image and the corresponding defect image; constructing a background reconstruction adversarial network model, which includes a background reconstruction network model and a discriminant network model; training the background reconstruction adversarial network model based on the sample image set to obtain a trained background reconstruction adversarial network model; and using the trained background reconstruction network model as the model for background reconstruction of Mura defect images.

This invention discloses a multispectral anomaly detection method and system based on a physically constrained spatial-spectral decoupling GAN, belonging to the field of spectral detection technology. The method includes: acquiring and preprocessing a multispectral image to obtain a standardized tensor block; inputting this block into a dual-stream generator to output an ideal background reconstruction image; inputting this reconstruction image and a real background image into a multi-scale block discriminator for adversarial discrimination, and sending the discrimination result into a model training and optimization module; calculating the gradient using a composite loss function integrating physical constraints, synchronously updating the parameters of the dual-stream generator and the multi-scale block discriminator to obtain a multi-scale dual-stream GAN model; inputting the multispectral image to be tested into the trained model to obtain the ideal background reconstruction image, calculating the anomaly score map between the reconstruction image and the original image, and outputting the anomaly detection binarized result after threshold segmentation. This application solves the problem of difficulty in simultaneously considering texture and spectral features in multispectral data, significantly improves the model's sensitivity to anomalous targets, and reduces the false alarm rate.

The embodiment of the present application provides a kind of modeling method, system, equipment and storage medium for extracting foreground object, belong to three-dimensional reconstruction technical field.Modeling method for extracting foreground object includes: obtaining the image point cloud data of target object and camera pose information;The foreground and background in image point cloud data are separated, and the foreground object point cloud is obtained;According to the foreground object point cloud extracted, the minimum bounding box of foreground is determined;Based on the above data, foreground point data and background point data are determined;Based on foreground point data and background point data, the preset reconstruction network is used to determine foreground object reconstruction data and background reconstruction data;According to foreground object reconstruction data and background reconstruction data, generate target object model and display.The embodiment of the present application calibrates foreground and background using minimum bounding box, reduces the cost of manual annotation, also uses preset reconstruction network to predict model data, improves the accuracy and accuracy of model reconstruction.

The invention discloses a solar cell surface defect intelligent detection system based on deep learning. The system comprises a data acquisition module; according to the method, detection design based on background reconstruction is adopted, the conditional depth reconstruction network is constructed through the original image, easy to obtain, of the surface of the defect-free solar cell, and the defect-free background reconstruction image can be reconstructed through the conditional depth reconstruction network; in the detection stage, the to-be-detected image and the residual image corresponding to the defect-free background reconstruction image can remarkably highlight a defect area which destroys the background regularity, and the defect can be positioned only through the original image of the surface of the defect-free solar cell. According to the method, the technical thought that the background is reconstructed first and then the residual error is calculated is adopted, the defect detection problem is converted from mass pixel-level defect labeling to normal background modeling, and the problems that labeling samples are scarce and labeling cost is high in an industrial scene are greatly relieved.

The application provides a wafer defect detection background suppression and defect feature enhancement method. In the face of serious background interference such as periodic texture and uniform noise in the wafer defect detection image, the method first uses frequency domain background reconstruction and removal technology to obtain a preliminary background removed image. Further, based on the pixel-level labeled defect data set, a self-encoder network architecture with a fusion spatial attention mechanism is designed to realize accurate positioning and feature weighting enhancement of the defect area, while suppressing the residual background noise. On this basis, a background-defect dual-region dynamic adjustment strategy is constructed to complete the adaptive balance fine tuning of the enhancement parameters, and then the cooperative optimization of wafer defect detection image background suppression and defect enhancement is achieved. Through the scheme, high-quality image preprocessing support can be provided for the wafer defect high-precision detection task, and the precision and efficiency of wafer defect detection are effectively improved.

The application discloses a kind of fabric hyperspectral flaw reconstruction method and system based on frequency domain dynamic convolution, belong to computer vision and hyperspectral imaging technical field.The method includes: input fiber end-member spectral library data to carry out physical constraint modeling;Frequency band decoupling convolution kernel is generated based on frequency domain dynamic convolution, linear mixing term and non-linear interaction term are combined to reconstruct background;Through the decomposition of high-frequency sub-band by learnable wavelet base, the flaw feature is enhanced using frequency domain dynamic convolution;Multi-scale feature fusion is realized by adaptive low-pass / high-pass filtering and bidirectional attention gate;Adversarial optimization is carried out based on generative adversarial network, and the flaw mask is output.The system includes: end-member spectral library module, background reconstruction module, flaw residual branch module, frequency domain perception multi-scale fusion module and adversarial optimization module.The application has the advantages of strong physical interpretability and high reconstruction accuracy, and is suitable for camouflage fabric hyperspectral flaw detection.

This application discloses a hyperspectral anomaly detection method and system based on low-rank constrained autoencoders. The method applies low-rank constraints to the hidden layer representation of an autoencoder network, mines high-order low-rank characteristics for background reconstruction, and uses reconstruction errors to identify anomalies. The method implementation steps include: Step 1: Inputting the hyperspectral data X to be detected, setting network parameters W and b, learning rate α, and initial values ​​for adjustment parameters λ1 and λ2; Step 2: Constructing a loss function for the hyperspectral data X using low-rank constraints; Step 3: Learning the network using the loss function, updating the network parameters {W, b}, and obtaining the reconstructed data of the input data X; Step 4: Constructing an error matrix E; Step 5: Detecting the reconstruction error matrix.

The application provides a target elimination method and device, electronic equipment and storage medium, and relates to the field of artificial intelligence. The method comprises the following steps: encoding mask visual data to obtain a first latent representation; wherein the mask visual data is obtained by masking a target object to be eliminated in input visual data based on first mask information, and the first mask information is used for indicating the position of the target object in the input visual data; splicing the first latent representation and the first mask information to obtain a first spliced feature, and extracting a context of the first spliced feature to obtain target context information; and performing denoising processing according to the target context information to generate target visual data after the target object is eliminated. Therefore, the denoising process can generate repair content that is coordinated with the surrounding environment in structure, texture and dynamic characteristics on the premise of preserving spatiotemporal consistency, thereby significantly improving the integrity of target elimination and the realism of background reconstruction.

Apparatuses, systems, and techniques to perform unsupervised keypoint or landmark learning using one or more neural networks. In at least one embodiment, one or more neural networks use pose and appearance information to construct a foreground and a background, which are then used to reconstruct an input image and determine loss values to train the one or more neural networks.

The present application relates to a kind of self-supervised hyperspectral image anomaly detection methods based on limited attention mechanism, comprising the following steps: obtaining the color space data of hyperspectral image;Spectral channel is selected by clustering-based spectral band selection method, and generate hyperspectral cube;Construct spatial limited self-attention layer FSAL:5 limited self-attention module FSAB is constructed;Self-supervised background spectrum reconstruction neural network is constructed;Generate hyperspectral image;Obtain stable hyperspectral background reconstruction model;Using self-supervised background spectrum reconstruction neural network, cooperate anomaly detection algorithm, carry out anomaly detection to hyperspectral data.

The invention discloses a multi-view layered shielding object removal method for a complex shielding scene. The method comprises the steps of preprocessing a multi-view data set, generating a synthetic aperture image, constructing a single-view foreground reconstruction network, constructing a multi-view background reconstruction network, training the network, testing the network and synthesizing a multi-view layered shielding object removal image. And blocking objects in a complex blocking scene are removed through foreground and background layered reconstruction. Through synthetic aperture imaging selective focusing and potential diffusion model detail texture reconstruction, foreground shelters are effectively removed, through combination of the potential diffusion model and multi-view parallax, multi-view features are fully utilized and aligned and fused, background shelters are effectively removed, and the image quality is improved. The problems of inconsistent spatial geometric features, distortion of detail textures and the like in the process of removing the shielding of the complex shielding scene are solved. A contrast experiment shows that the geometric feature consistency and the visual definition of the image without the shielding object are improved, and high-quality image reconstruction of a complex shielding scene is realized.

This application provides a 3D reconstruction method, apparatus, device, and readable storage medium. The electronic device pre-reconstructs the background point cloud of a target scene. Subsequently, after each reconstruction of the foreground point cloud, the foreground point cloud is aligned according to target alignment parameters to obtain the target point cloud. The target point cloud and the background point cloud are then fused to obtain the 3D reconstruction result of the target scene. The target alignment parameters are determined based on a first image used for reconstructing the background point cloud and a second image used for reconstructing the foreground point cloud. Since the determination of the target alignment parameters considers both foreground and background reconstruction, "clipping" can be avoided after the background and foreground point clouds are fused, thereby improving the quality of 3D reconstruction and ultimately enhancing the immersive meeting experience.

This application relates to a method, apparatus, system, and storage medium for fire detection based on multi-band infrared images, and pertains to the field of image data processing technology. The method includes: acquiring multi-band infrared image data and preprocessing the multi-band infrared image data; employing a preset fire detection model to perform feature classification, extraction, and feature fusion on fire features in fire areas and background features in non-fire areas of the preprocessed multi-band infrared image data to obtain a target fire point segmentation probability map; wherein the preset fire detection model includes an encoder, a fire point segmentation decoder, a background reconstruction decoder, and a fusion module; and determining the fire point pixel detection result based on the target fire point segmentation probability map and a segmentation threshold.

The invention discloses a fabric hyperspectral flaw reconstruction method and system based on frequency domain dynamic convolution, and belongs to the technical field of computer vision and hyperspectral imaging. The method comprises the following steps: inputting fiber end member spectrum library data to carry out physical constraint modeling; generating a convolution kernel of frequency band decoupling based on frequency domain dynamic convolution, and reconstructing a background in combination with a linear mixed item and a nonlinear interaction item; decomposing high and low frequency sub-bands through a learnable wavelet basis, and enhancing flaw features by using frequency domain dynamic convolution; multi-scale feature fusion is realized through adaptive low-pass / high-pass filtering and a bidirectional attention gate; and performing adversarial optimization based on the generative adversarial network, and outputting the defect mask. The system comprises an end member spectrum library module, a background reconstruction module, a flaw residual branch module, a frequency domain sensing multi-scale fusion module and an adversarial optimization module. The method has the advantages of high physical interpretability and high reconstruction precision, and is suitable for hyperspectral flaw detection of the camouflage fabric.

The invention relates to the technical field of attack confrontation, in particular to an SAM hidden attack method based on context background reconstruction, which comprises the following steps of: extracting features by using an expanded target mask, taking learnable background prompt as a query vector, and generating reconstructed background context information through cross attention calculation; the background context information and the original image features are input into a generator together to generate adversarial disturbances, and joint optimization is performed through multi-level distillation loss. According to the method and the device, the learnable background prompt is introduced, and the background related information shielded by the target object is reconstructed from the features including the target and the surrounding environment based on the attention mechanism, so that the generated confrontation disturbance has background perception capability, is more targeted and is high in attack efficiency; the learnable background prompt can be quickly applied to a new image and a new target once trained, and has mobility.

This invention relates to a method for detecting low-contrast Mura defects in OLED screens, belonging to the field of OLED screen defect detection technology. It solves the problem of poor Mura defect detection accuracy caused by low contrast in existing technologies. The method includes the following steps: acquiring an actual image of the OLED screen and converting it to grayscale to obtain an initial actual grayscale image; performing image enhancement on the initial actual grayscale image to obtain a final grayscale image; inputting the final grayscale image into a trained background reconstruction network to obtain a reconstructed background image; and obtaining a defect image of the OLED screen based on the reconstructed background image and the final grayscale image.