25127 results about "Light spectrum" patented technology

A system and method are disclosed for generating hyperspectral images from multi-modal sensor data including RGB, LiDAR, thermal, and near-infrared inputs. Training data includes hyperspectral images and corresponding multi-modal measurements. Spectral band grouping is performed based on correlation coefficients. A multi-modal decomposition network with cross-modal attention mechanisms generate reconstructed hyperspectral images by fusing complementary sensor information. A fine-tuning network creates reconstructed RGB images. A comprehensive quality assurance system analyzes spectral consistency, cross-modal coherence, and fusion artifacts to generate quality metrics. Missing data compensation strategies handle corrupted sensor inputs using information from other modalities. The system includes temporal integration for video sequences and multi-resolution processing for different sensor resolutions. Quality metrics guide network weight adjustments to improve reconstruction accuracy while maintaining robustness to sensor failures and environmental variations.

The invention relates to a water quality change trend rapid prediction method based on multi-source data fusion and physical constraint, and the method specifically comprises the following steps: 1, synchronously collecting spectral information, DO, COD, temperature, pH and other data at a key monitoring station, constructing a hydrodynamic water quality coupling equation, simulating the spatial-temporal dynamic distribution of water quality parameters, and calculating the water quality change trend; 2, outputting a water quality sensitive area through a hydrodynamic force-water quality model, screening sensor layout point positions in combination with information entropy evaluation and spatial clustering, realizing low-cost water quality sensor network deployment through a multi-objective optimization algorithm, and calculating a water body global water quality distribution diagram by adopting a spatial interpolation method, 3, synchronously collecting spectral information according to key monitoring sites, analyzing main pollution sources, and adopting a principal component analysis and attention mechanism neural network; 4, based on real-time optical characteristic value-DO data, in combination with a spatial topology network, a water quality gradient and a cross-regional covariance, capturing water quality parameter spatial correlation among different sites, and determining the water quality parameter spatial correlation among different sites; an optical characteristic value-DO-COD dynamic prediction model is constructed; a COD predicted value is corrected by combining pollution traceability and spectral characteristics, and multi-source data is assimilated by adopting ensemble Kalman filtering, so that the model precision is improved.

The invention relates to a high-voltage equipment defect detection method based on deep learning and multispectral image fusion, and relates to the technical field of electric power high-voltage equipment state detection. The method comprises the following steps: acquiring an ultraviolet image, an infrared image and a visible light image of the surface of the high-voltage equipment; carrying out image pixel feature-based fusion processing on the ultraviolet image, the infrared image and the visible light image through an image fusion method; establishing a high-voltage equipment defect detection model, and training the high-voltage equipment defect detection model by using the fused image data to obtain a high-voltage equipment defect identification model based on the YOLO-STrans multispectral fusion network; and inputting the ultraviolet image, the infrared image and the visible light image of the outer surface of the power high-voltage equipment into a high-voltage equipment defect identification model to obtain a fault identification result of the to-be-detected power high-voltage equipment. The method can improve the recognition precision of the extremely early insulation degradation and temperature anomaly defects of the surface of the high-voltage power equipment.

The invention belongs to the technical field of photovoltaic panel surface defect detection, and discloses a photovoltaic panel surface defect detection method and system based on physical property analysis. The method comprises the following steps: firstly, acquiring a surface temperature distribution image, surface deformation data, ultrasonic echo data, a spectral image, spectral characteristic data and eddy current signal characteristic data of the photovoltaic panel by respectively utilizing an infrared thermal imager, a laser speckle interferometer, an ultrasonic flaw detector, a visible light multi-band imager and eddy current detection equipment; various abnormal regions such as temperature, deformation, ultrasonic echo, spectral characteristics and eddy current signals are determined; and then determining defect positions by integrating various abnormal regions, and determining the types and sizes of the surface defects of the photovoltaic panel by combining various data corresponding to the defect positions. According to the method, accurate positioning and identification of the surface defects of the photovoltaic panel are realized through a multi-physical property detection means, and the detection accuracy and reliability are effectively improved.

The invention relates to the technical field of PCB detection, and discloses a PCB defect detection method and system, and the method comprises the steps: collecting multispectral imaging data through an image collection module, and generating an original image data set; the defect analysis server receives the synchronous imaging data to construct a three-dimensional surface topology matrix; in combination with the original image data set and the real-time imaging data, performing multi-scale decomposition on the three-dimensional surface topological matrix, extracting texture features, positioning a defect region, outputting defect type space distribution features through a layered recognition model, and updating the original image data set; and dynamically calibrating the detection parameters according to the feature categories. The system comprises an image acquisition module group, a data transmission module, a three-dimensional modeling module, a defect identification module and a parameter calibration module. According to the scheme, the accuracy, comprehensiveness and efficiency of defect detection are improved, and the detection requirements of modern PCB production are met.

The invention discloses an automatic control method and system for secondary granulation of a high-voltage zinc oxide resistor disc, relates to the technical field of intelligent manufacturing of power equipment, and solves the problems of out-of-control particle morphology caused by dynamic coupling parameter identification lag and control instability caused by multi-physical field parameter coupling in an existing method. According to the invention, a dynamic physical property parameter matrix is generated in real time based on multi-band dielectric relaxation spectrum analysis and terahertz wave tomography; predicting a fluidized phase change threshold value and an energy gathering area through multi-physics field coupling modeling; a time sequence attention deep reinforcement learning algorithm is adopted to generate a multi-field cooperative adjustment instruction; positioning a parameter conflict source and triggering decoupling compensation by combining a high-frequency vibration and acoustic emission combined monitoring module; performing closed-loop correction on the control network weight based on the laser spectrum data and a partial least squares regression model; the real-time performance of fluidization parameter identification, the stability of multi-field coupling control and the recovery efficiency of abnormal working conditions are remarkably improved, and meanwhile the batch consistency of the electrical performance of the resistor discs is guaranteed.

The invention discloses a distributed real-time monitoring and early warning system for a temperature field of a smelting furnace, and relates to the technical field of industrial process intelligent monitoring. The problems of accumulated measurement errors and non-stationary hotspot escape reconstruction hysteresis caused by static emissivity setting in an existing system are solved. Collecting multiband radiation intensity and voltage signals through time domain alignment of the multispectral sensor array and the thermocouple array; iterating emissivity parameters in real time by adopting a dynamic ash body spectrum ratio algorithm in combination with flue gas absorption characteristics; fusing non-contact and contact temperature measurement data based on weighted Kalman filtering and complementary filtering; constructing a space-time variable covariance function to carry out non-stationary Kriging interpolation; dynamically optimizing the local grid resolution by combining an adaptive grid module; the processing flow is accelerated through the parallel computing module; early warning is triggered based on abnormal probability judgment and is fed back to emissivity correction and grid optimization; according to the invention, the monitoring precision and real-time performance of the temperature field are obviously improved, and the risks of false alarm, missing alarm and equipment melting loss are effectively inhibited.

The invention provides an improved YOLOv11s safety helmet wearing detection model and an optimization method thereof, and relates to the technical field of computer vision target detection. According to the improved YOLOv11s safety helmet wearing detection model and the optimization method thereof, the improved YOLOv11s safety helmet wearing detection model comprises the following modules: a multi-modal fusion module, a space-time analysis module, a domain adaptation module, a topological optimization module and a dynamic architecture module; and the multi-modal fusion module is used for realizing feature decoupling by adopting channel separation convolution based on input RGB and near-infrared images, fusing visible light and thermal radiation features through a dynamic weight distribution algorithm, implementing affine transformation alignment on multi-scale features by utilizing a spatial transformation network, and generating a multi-modal feature graph. Through fusion of visible light and near infrared spectrum features and implementation of dynamic weight distribution, complementarity of target texture and thermal radiation features under a complex illumination condition is enhanced, and the problem of feature distortion of single-mode data in a strong backlight or low-illumination scene is solved.

The invention provides a crop whole growth cycle identification method and system based on deep learning, and the method comprises the steps: obtaining a multispectral image sequence of a target crop in a continuous time period through an image collection device, and carrying out the standardized illumination adjustment processing of each image frame in the multispectral image sequence, obtaining a standard illumination image set corresponding to the multispectral image sequence; carrying out crop region segmentation processing on each image, extracting a local feature region related to a target crop, generating a standardized crop image set containing the local feature region, inputting the standardized crop image set into a pre-trained multi-task deep learning model, extracting combined features through parallel convolution branches, and carrying out image segmentation processing on the combined features; and executing cross-stage correlation analysis in the full connection layer, outputting a multi-task classification result corresponding to the target crop growth cycle, and generating a stage identification report corresponding to the target crop full growth cycle. According to the invention, the crop whole growth cycle identification precision and the agricultural management efficiency can be improved.

The invention relates to the technical field of intelligent detection, in particular to a container surface damage detection method and device based on machine vision, and the device consists of a multi-modal data acquisition module, a dynamic compensation processing module, a multi-modal data fusion module and a damage classification and positioning module. The multi-modal data acquisition module generates a high-density three-dimensional point cloud through double-laser line scanning, and acquires a multispectral image, an infrared thermogram and a real-time motion state. The dynamic compensation processing module integrates an optical flow method and acceleration data to realize sub-pixel-level motion compensation, and combines adaptive exposure control to optimize the imaging quality under complex illumination. The multi-modal data fusion module strengthens defect feature expression through space-time alignment and a double-branch collaborative attention mechanism, and model parameters are reduced through lightweight network design. And the damage classification and positioning module adopts an improved deep network to realize defect classification and complete millimeter-level three-dimensional positioning. The automatic detection requirement of a port is met, and the problems of poor container detection precision, poor adaptability and the like are solved.

The invention relates to the technical field of defect detection, and discloses an integrated circuit mask plate defect multispectral cooperative detection method, which comprises the following steps: carrying out preliminary scanning on a mask plate by using a multispectral camera, selecting an optimal wave band combination, switching to a target wave band through a liquid crystal adjustable optical filter, and obtaining a high-confidence multispectral image; the optical path offset is calculated through the linear relation, the deflection angle of the micro-mirror is dynamically adjusted, and images are collected for the second time after imaging offset is compensated; image filtering and registration are completed in the FPGA, and a high-contrast fusion image is generated; if the confidence coefficient is insufficient, triggering a wave band reselection mechanism to recheck; dynamically optimizing a defect type-spectrum mapping table based on real-time detection data; when the environment fluctuation exceeds the limit, an anti-interference mode is automatically switched, and micro-mirror calibration is triggered; and monitoring performance degradation of the optical assembly in real time, switching redundant optical paths, cleaning damaged parts, triggering manual reinspection when conflicts occur, and finally generating a visual report. According to the invention, the detection accuracy of the integrated circuit mask plate can be improved.

The invention discloses a visual detection system and method for tiny flaws of industrial products, and belongs to the technical field of product detection, multi-source image data of a target industrial product under multiple detection angles and illumination conditions are acquired, and an image information matrix is established; performing region segmentation and texture enhancement on the image, and extracting local texture direction inconsistency parameters; carrying out normalization analysis on the pixel ratio under different spectrum channels, and calculating a multispectral reflectance ratio abnormal index; constructing a deep convolution recognition model; reasoning the image by using the model, and outputting a defect judgment result and a confidence score; judging whether the area is a flaw area based on a dynamic threshold mechanism, and outputting a detection report containing flaw position information and a visual heat map; according to the method, multi-dimensional fusion identification of texture structure disturbance and spectral response abnormity is realized, the micro defect identification precision is effectively improved, and the method has high robustness, automation and engineering practicability and is suitable for high-precision quality control requirements of various industrial scenes.

The invention belongs to the technical field of industrial measurement, and discloses a pump machine metal shell size detection method based on image analysis, which comprises the following steps: synchronously acquiring image data of a pump machine metal shell in a visible light wave band and a near-infrared wave band; the contrast ratio of image data is optimized through a dynamic exposure control technology, and a high-dynamic-range multispectral image is obtained; three-dimensional geometric information of the pump machine metal shell is obtained, registration fusion is carried out on the three-dimensional geometric information and the high-dynamic-range multispectral image, a dense three-dimensional point cloud model with multispectral textures is constructed, and a multi-frequency heterodyne algorithm is adopted to process a high-reflection area in the dense three-dimensional point cloud model; the method comprises the following steps: collecting a multi-angle reflection image of a pump machine metal shell by rotating a linear polarizer, calculating a Stokes vector to extract a diffuse reflection component, carrying out diffuse reflection component constraint and brightness suppression on a high-reflection area based on a CIE-Lab color space, and outputting a dense three-dimensional point cloud model after texture enhancement; and the size detection precision of the pump machine metal shell is improved.

The invention discloses a panchromatic sharpening method based on multi-resolution panchromatic feature guidance, which comprises the following steps: firstly, designing a multi-resolution feature extraction network based on a spatial frequency Transform module, and respectively extracting multi-scale features from panchromatic and up-sampled multispectral images; secondly, in order to restrain and optimize the extracted detail features, a multi-head self-attention-based texture injection module is adopted to extract a dependency relationship between panchromatic and multispectral features, and more similar detail features are guided to be injected; thirdly, in order to solve information loss caused by multispectral image up-sampling, multi-level detail features are injected into a multispectral reconstruction network, the detail features are learned step by step and reconstructed to a panchromatic image size, and a spectrum fusion module based on adaptive channel attention is utilized to reconstruct a fused image in a high-quality mode; and finally, optimizing the model performance by combining reconstruction loss based on L1 norm, structural similarity constraint and transmission perception loss in training. According to the method, the spectral fidelity and the spatial resolution of the fused image are remarkably improved.

The invention relates to an injection molding product defect detection method based on machine vision, which comprises the following steps: collecting material information of a to-be-detected injection molding product in real time, and dynamically matching and adjusting light source parameters according to spectral reflection characteristics of materials to ensure image collection quality; secondly, the collected images are preprocessed, edge features and texture features are extracted, a three-dimensional model is constructed through multi-view image splicing, and three-dimensional defect features are extracted; thirdly, the multi-dimensional features are input into a deep learning model, the defect probability is calculated through feature fusion and forward propagation, and whether the product has defects or not is judged; if the defect exists, further identifying the defect category, and calculating the number and size of the defect; and generating a standardized detection report based on the defect information. According to the method, the image adaptability of products made of different materials is improved through dynamic light source adjustment, the two-dimensional and three-dimensional features are fused, the defect recognition accuracy is improved, and full-process automation from qualitative judgment to quantitative analysis of the defects is achieved.

The invention provides a color steel plate coating flatness evaluation method and system based on artificial intelligence. According to the method, the three-dimensional point cloud data is generated by collecting the interference fringe image, and the surface fluctuation characteristics are quantified; capturing a multi-dimensional vibration spectrum of the transmission roller shaft, generating a servo motor compensation control signal, driving a multispectral scanning head to perform reverse displacement compensation, and generating real-time compensation data; inputting the surface topography features in the three-dimensional point cloud and the real-time compensation data into a lightweight convolutional neural network, and outputting fusion features; and dynamically classifying and identifying surface defects and uneven areas based on the fusion result, adjusting a classification threshold in combination with the speed of the production line, outputting a flatness evaluation result, and synchronizing the flatness evaluation result to a speed regulation system of the production line to realize closed-loop optimization. According to the method, laser interference, vibration compensation and lightweight AI technologies are fused, dynamic high-precision evaluation of the surface flatness of the color steel plate of the high-speed production line is achieved, and the problems of defect misjudgment and measurement distortion caused by vibration interference are solved.

The invention discloses an intelligent photoelectric theodolite aerial target positioning and tracking system, which relates to the technical field of photoelectric detection, and comprises a multi-mode photoelectric sensor module integrating visible light, infrared thermal imaging, a laser radar and a polarized light sensor and supporting spectrum adaptive switching; the dynamic noise suppression processing module is used for eliminating environmental interference based on a time-space domain hybrid filtering algorithm; the multi-target tracking control module adopts a time-sharing partition scanning strategy and a graph neural network data association algorithm; the anti-interference servo driving module is used for realizing stable tracking under strong disturbance through inertial navigation-visual fusion compensation; and the edge computing platform is used for deploying a lightweight deep learning model to complete target recognition and trajectory prediction. According to the invention, through interdisciplinary collaboration of quantum dot materials, graph neural networks and physical equation constraints, the bottleneck of a single technology is broken through; and through closed-loop optimization of dynamic anti-interference and edge intelligence, full-link enhancement of'perception-decision-execution 'is realized.

The invention relates to the technical field of remote sensing monitoring, in particular to a remote sensing image ocean green tide monitoring method and system fusing physical prior and spatio-temporal evolution. The method comprises the following steps: acquiring a multi-modal remote sensing monitoring image; performing multi-modal feature extraction on the acquired image, wherein the multi-modal feature extraction comprises spectral reflectivity feature extraction, ocean dynamics feature extraction and feature alignment and unified representation; establishing a physical prior of a green tide characteristic wave band by using an ocean optical radiation transmission model; constructing a dynamic space-time diagram based on the extracted multi-modal features to obtain a node global feature vector and a dynamic adjacency matrix; carrying out adaptive graph convolution feature coding based on physical prior and a dynamic space-time diagram; through fusion of multi-spectral images of multiple platforms such as satellites and unmanned aerial vehicles and ocean dynamic data and combination of atmospheric correction and wave band resampling, consistency processing and high-precision extraction of multi-source features are realized, and comprehensiveness and reliability of green tide feature recognition are remarkably improved.

The invention provides a river water quality monitoring method based on multi-source remote sensing data, and belongs to the technical field of river water quality monitoring. The method comprises the following steps: establishing an inherent optical characteristic model of a river water body based on a Hybrid water body radiation transmission model, optimizing a calculation path by adopting a shortest path algorithm, and carrying out water body optical component inversion by adopting a quasi-analysis algorithm and a generalized inherent optical characteristic algorithm in combination with a multispectral characteristic enhancement model to obtain absorption coefficients of all components; and constructing a multi-band combination index to realize optical coupling effect decoupling, and applying the fine-tuned water quality parameter inversion basic model to a target river area to output a suspended matter concentration distribution diagram, a chlorophyll concentration distribution diagram and a transparency distribution diagram. The technical problem of low precision of remote sensing inversion of water quality parameters caused by mutual coupling of multiple optical active components in a river water body is solved.

The invention provides a high-speed rail part crack real-time detection method, and belongs to the technical field of image detection based on computer vision. Obtaining a hyperspectral image, a visible light image, three-dimensional point cloud data and eddy current signal data of the surface of the high-speed rail part; performing spatial registration on the high-spectral image and the visible light image on the surface of the high-speed rail part, and performing time registration on the three-dimensional point cloud data based on the eddy current signal data; feature enhancement and standardization processing are carried out; performing feature extraction and fusion on the obtained standardized multi-modal data based on a multi-modal feature fusion network to obtain a fusion feature map representing crack details of the high-speed rail parts; based on a self-adaptive crack segmentation method, a crack contour is extracted from the point cloud, and then whether the part has a crack or not and the length and depth of the crack are calculated. According to the invention, three kinds of modal data are creatively integrated, the information dimension limitation of single-modal detection is broken through, and all-weather and non-contact intelligent efficient diagnosis of submillimeter cracks is realized under complex working conditions.

The invention relates to an optical film detection method, device and equipment based on image processing. The method comprises the following steps: collecting multiple frames of images of a multilayer optical film under different illumination conditions, and carrying out preprocessing and characteristic value calculation on the multiple frames of images to obtain a characteristic value response matrix; calculating an optimal weight coefficient of each frame of image according to the feature value response matrix, and performing multi-frame image feature fusion to obtain integrated feature representation; performing multi-scale defect feature extraction on the integrated feature representation to obtain a defect candidate region; spectral response characteristics are extracted based on the defect candidate area, matching degree calculation is carried out on the spectral response characteristics and a preset wavelength-film thickness mapping relation matrix, and a multilayer film defect distribution diagram is obtained; and performing autoregression prediction and processing control parameter optimization on the multilayer film defect distribution diagram to obtain a closed-loop control scheme. According to the invention, accurate identification and classification of different film layer defects are realized, and closed-loop control of defect detection results and manufacturing parameter optimization is further realized.

The invention discloses a PCB three-proofing coating quality detection method and system. The method comprises the steps that a visible light reflection image of the surface of a PCB and scattering spectrum data of a near-infrared band are acquired; performing spatial filtering processing on the visible light reflection image to extract interface area pixels, calculating coating layer thickness gradient distribution based on Mie scattering characteristics in scattering spectrum data, and fusing to generate an edge gradient distribution map; and according to the gradient amplitude change rate in the edge gradient distribution map, segmenting the effective coverage area of the coating layer by adopting a self-adaptive dynamic threshold algorithm, and extracting curvature extreme point density and boundary fractal dimension parameters at the segmentation boundary. According to the invention, three technical barriers of difficult microdefect capture, unmeasurable interface performance and delayed failure risk in traditional detection are solved, and two-dimensional accurate diagnosis of the structural compactness and interface reliability of the coating layer is realized.

The invention relates to the technical field of hydraulic engineering intelligent operation and maintenance, and discloses an AI unmanned aerial vehicle-based auxiliary decision-making platform for hydraulic engineering operation and maintenance, and the platform comprises a data collection module which is used for obtaining multi-modal data of a water conservancy facility through an AI unmanned aerial vehicle, the multi-modal data comprises a visible light image, thermal imaging data, multispectral data and laser radar data; the data processing and fusion module is used for carrying out formatting processing, space-time alignment and feature fusion on the multi-modal data; the health assessment and prediction module is used for assessing the health state of the water conservancy facility based on the processed data and predicting the future change trend of the facility state; and the auxiliary decision-making module is used for generating inspection priority planning of the water conservancy facilities. According to the invention, through multi-source data fusion, dynamic risk assessment and intelligent optimization distribution, the effects of accurate monitoring, efficient operation and maintenance and risk visual management of the whole life cycle of the water conservancy facilities are realized.

The invention relates to the technical field of computer vision and three-dimensional reconstruction, and discloses an exhibition hall three-dimensional modeling intelligent optimization system based on multi-modal data fusion, and the system comprises a data collection module which is configured to synchronously obtain laser radar point cloud data, a multispectral image sequence and inertial measurement unit data; the preprocessing module is used for receiving the output of the data acquisition module, aligning a multi-source sensor coordinate system through a space-time calibration algorithm, and separating a static scene from a dynamic interference element by using a dynamic segmentation network; and the multi-modal fusion module is used for receiving the preprocessed data and carrying out adaptive weighted fusion on the geometric features of the laser radar and the visual texture features through a cross-modal attention mechanism. According to the invention, through multi-modal data fusion and a dynamic scene adaptive mechanism, the modeling precision and the real-time updating capability in a complex exhibition hall environment are significantly improved.

Disclosed in the present invention are a hyperspectral calculation imaging method and system based on multi-domain fusion of spatial, spectral and frequency domains, and a medium. The method of the present invention comprises: using a two-dimensional offline discrete cosine transform (DCT) to convert an RGB image Y into a frequency domain to obtain a frequency domain feature map Yfreq; extracting a frequency information image (I) from the frequency domain feature map Yfreq; using a two-dimensional offline inverse discrete cosine transform (IDCT) to transform the frequency information image (I) into a spatial domain to obtain a frequency information image Xfreq of the spatial domain; and fusing the frequency information image Xfreq of the spatial domain into the spatial-spectral domain features of the RGB image Y to generate a hyperspectral image (II). The present invention aims to solve the problems of poor detail information and low reconstruction accuracy of hyperspectral images in existing hyperspectral calculation imaging, and realizes high-fidelity reconstruction of a target spectrum.

The invention provides an unmanned aerial vehicle identification early warning method and system. The method comprises the following steps: acquiring RGB image data, thermal radiation data and spectral data of an unmanned aerial vehicle no-fly zone through a visible light camera, an infrared thermal imager and a multispectral imager; performing transmission preprocessing on the RGB image data, the thermal radiation data and the spectral data, and adaptively adjusting multi-level fusion of a fusion weight based on real-time environmental parameters to generate target fusion data; based on a deep learning model and a tracking prediction algorithm, performing unmanned aerial vehicle identification early warning on the target fusion data, and generating early warning data; and transmitting the target fusion data and the corresponding abnormal event log to a cloud server, and updating the deep learning model by adopting the target fusion data and the abnormal event log. Through cooperative work of a multi-mode sensor, visible light, infrared, multispectral and other wave bands are covered, all-weather and full-scene unmanned aerial vehicle detection is achieved, the fusion weight is adjusted in real time based on real-time environment parameters, and the accuracy of the recognition result under the complex air situation is ensured.

The invention provides a hyperspectral image open set spectral spatial feature extraction and classification method, and aims to improve the classification precision of a known category and an unknown category in a hyperspectral image and the robustness of a classification model. According to the method, input data are preprocessed through fractional Fourier transform, and rotation analysis of a signal time-frequency plane is achieved. Multi-scale features of multi-branch cavity convolution are fused through an enhanced spectrum space residual module, deep separable convolution enhancement nonlinear representation of a lightweight convolution enhancement block is combined, and self-adaptive separation and weighted fusion of high / low frequency features are realized by innovating a dual-frequency enhancement module. Proposing a class perception comparison loss function, integrating anchoring loss, triple loss and regularization terms, and collaboratively optimizing intra-class compactness, inter-class separability and an open set decision boundary. The model framework provided by the invention is combined with the improved loss function, so that the classification precision of the known class and the unknown class of the hyperspectral image is remarkably improved.

The invention relates to the technical field of unmanned aerial vehicle remote sensing and artificial intelligence crossing, in particular to an intelligent monitoring system and method based on multi-modal remote sensing data and deep learning, and the system comprises an unmanned aerial vehicle cluster networking subsystem, a mixed feature matching subsystem and a multi-modal fusion and continuous learning subsystem. The method comprises the following steps: constructing an unmanned aerial vehicle cluster carrying a multispectral sensor and a laser radar LiDAR, and carrying out wireless networking among a plurality of unmanned aerial vehicles to realize sharing of acquired images; feature point extraction is carried out on collected images of different time phases, the extracted feature points are input into the generative adversarial network, and the feature points are matched; and receiving the matched collected images, dynamically fusing data of visible light, infrared and other multi-modal images through a space-time attention mechanism, and realizing high-precision target recognition and dynamic environment self-adaption in a small sample scene. According to the method, unmanned aerial vehicle multi-source remote sensing data acquisition, feature fusion and deep reinforcement learning are combined, and the method is used for intelligently monitoring a dynamic environment.

The invention relates to the technical field of semiconductor manufacturing, and discloses a semiconductor wafer etching method with a detection function. The method comprises the following steps: acquiring initial image data of a wafer surface through an optical detection device, and extracting geometric features and defect distribution information; processing through a multi-scale feature fusion algorithm, identifying an abnormal region and classifying defect types; dynamically adjusting process parameters of etching equipment according to defect conditions, and planning a self-adaptive etching path; during etching, a real-time monitoring module is used for collecting data, and etching parameters are corrected through a feedback control mechanism; and after etching, the etching precision is secondarily detected and verified by means of a multispectral imaging technology. According to the method, defects can be accurately positioned, the etching process is optimized, the etching precision and quality are effectively improved, the rejection rate is reduced, and the efficiency and reliability of semiconductor wafer manufacturing are improved.

The invention provides a PCBA circuit board defect detection method, apparatus and device, and a storage medium. The method comprises the steps of obtaining three-dimensional point cloud data of the surface of a circuit board by projecting multispectral composite structured light; performing feature fusion on the multi-modal image of the circuit board according to the three-dimensional point cloud data to generate a fused multi-channel feature map; performing non-rigid registration on the acoustic impedance distribution data and the three-dimensional point cloud data to generate an acousto-optic fusion defect probability distribution diagram; performing multi-scale edge detection on the fused multi-channel feature map to generate an optimized binary edge map; and performing scattering transformation on the optimized binary edge graph, and determining the defect type of the circuit board according to the acousto-optic fusion defect probability distribution graph. Through implementation of the scheme, non-rigid registration is performed by using the acoustic impedance distribution data and the three-dimensional point cloud data, the acousto-optic fusion defect probability distribution diagram is generated, the surface three-dimensional information and the internal acoustic impedance data are combined, internal hidden defects are effectively identified, and comprehensive detection of surface and internal defects is realized.