Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

11559 results about "Visible spectrum" patented technology

The visible spectrum is the portion of the electromagnetic spectrum that is visible to the human eye. Electromagnetic radiation in this range of wavelengths is called visible light or simply light. A typical human eye will respond to wavelengths from about 380 to 740 nanometers. In terms of frequency, this corresponds to a band in the vicinity of 430–770 THz.

High-precision image processing method and system based on illumination adaptive compensation

The invention discloses a high-precision image processing method and system based on illumination adaptive compensation, and relates to the technical field of computer vision and image processing, and the method comprises the steps: inputting an original image, and dividing the image into a high-frequency edge layer, an intermediate-frequency texture layer and a low-frequency illumination layer through a multi-scale residual network; acquiring illumination intensity, color temperature and scene categories in real time by using an ambient light sensor and a scene semantic segmentation model, and generating dynamic compensation parameters; carrying out dynamic range expansion on a low-frequency illumination layer based on a physical illumination model, and adjusting the weight of highlight suppression and dark area enhancement through a self-adaptive S-shaped exposure curve; a double-branch generative adversarial network is adopted, noise suppression and super-resolution reconstruction are carried out on the high-frequency layer, and texture detail enhancement is carried out on the intermediate-frequency layer; aligning the data of the depth camera and the infrared sensor with the visible light image through a cross-modal fusion module; and performing tone mapping on the fused image based on human visual characteristics, and outputting an enhanced image with a high dynamic range and reserved details.
Owner:SHANXI UNIV

Unmanned aerial vehicle electric power inspection image intelligent analysis method and system based on deep learning and multi-modal fusion and medium of unmanned aerial vehicle electric power inspection image intelligent analysis method and system

The invention discloses an unmanned aerial vehicle electric power inspection image intelligent analysis method and system based on deep learning and multi-modal fusion and a medium thereof, and relates to the technical field of electric power equipment detection. The method comprises the following steps: planning an optimal inspection path by adopting an A * algorithm to realize multi-sensor synchronous data acquisition; adaptive histogram equalization and defogging processing are carried out on the visible light image, non-uniformity correction and temperature calibration are carried out on the infrared image, and filtering and registration are carried out on point cloud data; constructing a multi-scale feature fusion network based on improved VGGNet-16, and introducing deformable convolution and a cross-modal attention mechanism to realize multi-source data fusion; defect detection is carried out based on a three-level template library and a feature map cross-correlation algorithm, and the precision is improved in combination with non-maximum suppression and sub-pixel positioning; and finally generating a detection report containing defect types, positions and maintenance suggestions. According to the invention, the automation level and the detection precision of power inspection are obviously improved.
Owner:STATE GRID SICHUAN YAAN ELECTRIC POWER (GRP) CO LTD YUCHENG POWER SUPPLY CO +1

System and method for industrial risk assessment via computer vision

A device, system and method comprising computer vision techniques for fire prevention / detection and risk assessment, as well as for determining deviations from an ideal operational state. The present invention includes for example systems and methods which leverage data collected by camera systems composed of infrared and visible light sensors to detect and / or prevent a fire from starting, and additionally, use this data to determine a risk assessment for the building. The present invention also provides for example a system and method for monitoring and controlling safety risks in indoor industrial environments by determining deviations from an ideal operational state using computer vision techniques and game-theoretic competitive ranking frameworks.
Owner:INNOVIRE AG

Road crack detection method and system based on fused image

The invention relates to the technical field of road crack detection, in particular to a road crack detection method and system based on a fused image. The method comprises the following steps: acquiring road multi-source monitoring data including a visible light image, infrared thermal imaging data and laser radar point cloud data, and performing multi-modal image fusion and road three-dimensional point cloud reconstruction to generate a fused road image and road three-dimensional modeling data; performing crack curvature analysis based on the fused road image to generate crack curvature data; performing reflection crack contour recognition and positioning on the fused road image through the crack curvature data to generate reflection crack initial positioning data; obtaining road base material data; and performing reflection crack stress field reconstruction on the road area according to the reflection crack initial positioning data to obtain a reflection crack stress field. According to the invention, through multi-modal fusion, curvature identification, stress field modeling and crack channel analysis, the accuracy and strain of road reflection crack detection are improved.
Owner:BINHAI BAY BRANCH OF DONGGUAN CITY URBAN MANAGEMENT & COMPREHENSIVE LAW ENFORCEMENT BUREAU

Unmanned aerial vehicle identification early warning method and system

The invention provides an unmanned aerial vehicle identification early warning method and system. The method comprises the following steps: acquiring RGB image data, thermal radiation data and spectral data of an unmanned aerial vehicle no-fly zone through a visible light camera, an infrared thermal imager and a multispectral imager; performing transmission preprocessing on the RGB image data, the thermal radiation data and the spectral data, and adaptively adjusting multi-level fusion of a fusion weight based on real-time environmental parameters to generate target fusion data; based on a deep learning model and a tracking prediction algorithm, performing unmanned aerial vehicle identification early warning on the target fusion data, and generating early warning data; and transmitting the target fusion data and the corresponding abnormal event log to a cloud server, and updating the deep learning model by adopting the target fusion data and the abnormal event log. Through cooperative work of a multi-mode sensor, visible light, infrared, multispectral and other wave bands are covered, all-weather and full-scene unmanned aerial vehicle detection is achieved, the fusion weight is adjusted in real time based on real-time environment parameters, and the accuracy of the recognition result under the complex air situation is ensured.
Owner:GLOBAL GENERAL AVIATION (HANGZHOU) CO LTD

Multi-modal visual fusion complex scene small target detection tracking method and system

The invention discloses a multi-modal visual fusion complex scene small target detection tracking method and system, and relates to the technical field of unmanned aerial vehicle target tracking, and the method comprises the steps: employing a visible light camera, an infrared thermal imager and a laser radar sensor which are carried on an unmanned aerial vehicle platform, and synchronously collecting RGB images, thermal infrared images and point cloud data; the consistency of the multi-modal data is ensured through data preprocessing and space-time alignment; constructing a lightweight double-branch network to extract multi-scale features, generating a fusion feature map by adopting adaptive weighted fusion, and generating depth information by utilizing point cloud to assist in scale estimation; a small target detection head is designed based on the fusion feature map, and precise detection is realized in combination with a feature pyramid network, adaptive scale prediction and a context awareness suppression mechanism; furthermore, through multi-mode cooperative tracking, including target association, spatio-temporal context modeling, trajectory prediction and a re-detection mechanism, tracking continuity is ensured.
Owner:BEIJING INSTITUTE OF GRAPHIC COMMUNICATION

Underwater fish school monitoring statistical system based on image fusion

The invention relates to the technical field of underwater fish school monitoring, and discloses an underwater fish school monitoring statistical system based on image fusion. According to the system, underwater video streams and sonar reflection intensity data of different spectral bands are acquired through an underwater multi-source image acquisition module, and time-space synchronous multi-modal image data streams are generated through timestamp alignment; a fish school contour reconstruction module is used for segmenting a fish school contour boundary and fusing visible light texture and sonar geometric features to generate an underwater three-dimensional fish school distribution set; the dynamic track mapping module tracks the mass center displacement, calculates the movement rate and the direction deviation angle, and correlates the water area depth to generate a dynamic track topological graph; the behavior anomaly analysis module extracts environment data based on the track mutation node, and detects aggregation density change and direction dispersion to mark an anomaly feature cluster; and the population statistics output module integrates the data, performs classified statistics on population distribution, a quantity threshold value and a migration path overlap ratio, and finally generates a fish school quantity distribution statistics thermodynamic map.
Owner:福州海洋研究院

Artificial intelligence machine vision image acquisition system

The invention discloses an artificial intelligence machine vision image acquisition system, and the system comprises a multi-mode perception layer which integrates a self-adaptive optical module, inhibits metal reflection, captures a visible light to short wave infrared image, and captures a motion edge; the dynamic adaptive layer adopts an illumination compensation and motion compensation module to dynamically adjust camera parameters and micro displacement compensation, feeds back an illumination trend, outputs a motion vector to the cognitive layer, generates a confrontation sample through a GAN, simulates virtual defects in combination with a physical engine, and expands training data; the cognitive reasoning layer is used for deploying a dynamic routing network, distributing computing resources according to image complexity and optimizing feature extraction efficiency; reducing data deviation through anti-fact analysis, and generating a thermodynamic diagram to explain a detection basis; and the collaborative decision-making layer is used for rapidly screening samples by edge nodes, training a global model by cloud aggregated data, automatically triggering manual rechecking when the confidence coefficient of the model is insufficient, synchronously optimizing a training set and a causal reasoning module by a rechecking result, and improving the labeling efficiency through AR assistance.
Owner:南昌理工学院

PCCP welding quality intelligent real-time detection method and system

The invention provides an intelligent real-time detection method and system for PCCP welding quality, and relates to the technical field of online detection and intelligent evaluation of pipeline welding quality through machine learning. Light energy data and multi-light-source images of a spiral weld pool are collected, exposure parameters are dynamically adjusted through the energy difference of visible light near-infrared bands, and the real-time detection of the PCCP welding quality is achieved. Inhibiting strong light interference and generating a weld surface image; a stress concentration area is positioned by scanning a welding seam thermal deformation area and combining speckle pattern change, sound frequency change and the elastic characteristic of the thin-wall steel cylinder; inputting the surface image and the deformation data into a space-time convolutional neural network, fusing light energy change, image details and spatial features to construct a weld joint space structure diagram, and adaptively correcting the position of a sensor; and comparing the sinking depth of the three-dimensional point cloud reconstruction, analyzing the correlation between the sinking degree and the stress, and generating a probability thermodynamic diagram to output the pressure-bearing failure risk level, so that the probabilistic early warning of the pressure-bearing failure risk can be realized.
Owner:SHANDONG ELECTRIC POWER PIPELINE ENG +1

Egg surface microcrack detection system and method based on image analysis

The invention discloses an egg surface microcrack detection system and method based on image analysis, and relates to the field of surface defect nondestructive detection.The method comprises the steps that a process identification interface module obtains a processing process identifier of an egg in real time; the multi-angle annular light source module is provided with a multi-band annular light source array comprising visible light and near-infrared LED lamp beads which are independently controlled, a polaroid group and a beam splitter prism are integrated, and visible light polarization images and near-infrared polarization images on the surfaces of the eggs are synchronously collected; the thermal excitation enhancement unit obtains a thermal infrared image; the process filtering module extracts the axial elongation of the mechanical stress microcrack after graded transportation, and calculates the mesh fractal dimension of the thermal stress microcrack after UV disinfection; the multi-modal feature fusion module generates a dual-channel crack probability graph; and the dynamic feedback control module outputs a micro-crack risk grade and adjusts the rotating speed of the objective table and the light source intensity. The method has the advantages that accurate judgment of mechanical and thermal stress cracks is realized, and curved surface reflection interference is broken through.
Owner:HUIZHOU UNIV

Outer wall hollowing microwave reflection detection method based on multi-modal fusion

The invention belongs to the technical field of microwave measurement, and discloses an outer wall hollowing microwave reflection detection method based on multi-modal fusion, which comprises the following steps: carrying out multi-modal scanning on a building outer wall to be detected, obtaining visible light image data and infrared temperature distribution data of the outer wall surface, and carrying out space registration and coordinate mapping; a unified multi-modal fusion data set is formed; performing anomaly screening on the multi-modal fusion data set, and identifying a thermal anomaly region by analyzing infrared temperature distribution data; detecting a bump or crack area in combination with texture and morphology anomaly features of the visible light image data; performing information fusion on the thermal anomaly region and the bump or crack region, and extracting candidate detection regions of suspected hollowing; high-precision recognition and quantitative evaluation of the outer wall hollowing are achieved, and the precision and stability of outer wall hollowing detection are improved.
Owner:HEFEI HUIXIAO ROBOT TECHNOLOGY CO LTD

Infrared and visible light image fusion method based on cross-domain Transform

The invention relates to an infrared and visible light image fusion method based on a cross-domain Transform, and belongs to the field of computer image processing. The method comprises the following steps: respectively carrying out preprocessing operation on an infrared image and a visible light image to obtain a training data set; an end-to-end image generator network is designed, an encoder module is used for extracting deep semantic features of an infrared image and a visible light image, a fusion module introduces an axial attention mechanism to enhance the global modeling capability of the features, and feature fusion is carried out in combination with information of a spatial domain and a frequency domain; the fused features are gradually recovered to an image space through a decoder module, and a fused image is generated; constructing a fusion loss function module, and guiding the network to focus a significant feature difference between the source image and the fusion image based on a comparative learning idea; and finally, inputting the infrared and visible light image Y channel into the network model, generating a fusion image, completing a training process, and realizing unified optimization of fusion performance and visual quality.
Owner:FUZHOU UNIV

Mountain area tunnel construction safety intelligent monitoring and early warning method and system

The invention provides a mountainous area tunnel construction safety intelligent monitoring and early warning method and system, and relates to the technical field of construction safety monitoring, and the method comprises the steps: collecting visible light and depth images of tunnel surrounding rock, and carrying out the segmentation and extraction of crack features through a depth attention network after image preprocessing and data fusion; extracting parameter time sequence data based on the crack spatial position and the type feature; determining fracture evolution characteristics and critical state parameters by combining wavelet transform and stress-rate coupling analysis; and adopting deep reinforcement learning to calculate the instability probability and generate early warning information. According to the invention, intelligent identification, instability prediction and risk early warning of tunnel surrounding rock cracks are realized, and the safety monitoring accuracy and early warning timeliness are improved.
Owner:北京华宏工程咨询有限公司

Multi-modal image fusion method based on modal self-adaption and modal interaction compensation

The invention provides a multi-modal image fusion method based on modal self-adaption and modal interaction compensation, and the method comprises the following steps: S1, obtaining a multi-modal image fusion data set, and obtaining a training data set through preprocessing; S2, analyzing the modal difference characteristics of infrared and visible light images, and evaluating the correlation characteristics of image pairs in different scenes; s3, capturing a cross-modal feature dependency relationship through a self-attention mechanism; s4, a differential feature extraction strategy is adopted, model parameters are optimized through iterative training, and multi-modal image fusion is completed; s5, a modal interaction compensation module is additionally arranged, unit dynamic balance common features and modal exclusive features are fused, feature complementation is achieved in channel and space dimensions, parameters of the modal interaction compensation module are optimized, the model is made to learn the optimal fusion weight of the multi-modal features in a self-adaptive mode, and multi-modal fusion image generation optimization is achieved through the model; according to the invention, multi-modal image fusion can be accurately and effectively carried out.
Owner:FUZHOU UNIV

High-precision defect detection system for track inspection robot

The invention discloses a high-precision defect detection system for a track inspection robot, which relates to the technical field of track inspection and comprises a multi-mode visual acquisition module, a time sequence synchronization module, a data fusion processing module and a defect identification output module, by adopting a multi-modal visual fusion detection technology, various modal visual technologies of visible light vision, infrared vision and ultraviolet vision are combined, fusion processing is carried out on all modal image data, visual defects such as cracks and abrasion on the surface of a track can be clearly recognized through visible light vision, and the visual performance of the track is improved. The infrared vision can detect temperature abnormity of a track component to find out potential poor contact and other problems, the ultraviolet vision can be used for detecting corona discharge and other phenomena, track information is comprehensively obtained, the accuracy and reliability of defect recognition are effectively improved, defects which are difficult to find in a single mode can be detected, and the detection efficiency is improved. And powerful support is provided for safe operation and maintenance of the track.
Owner:SHANXI ZHONGKE WEIYE ELECTRIC TECH CO LTD

Multi-dimensional anti-bird intelligent identification method and system based on thermal imaging

The invention discloses a multi-dimensional anti-bird intelligent recognition method and system based on thermal imaging, and relates to the technical field of intelligent monitoring and ecological protection. Multi-modal data is collected through thermal imaging, visible light, millimeter wave radar and a voiceprint sensor, after PTP protocol synchronization and Kalman filtering preprocessing, 3-5-second tracks of birds are predicted by using an LSTM network, and the anti-bird intelligent recognition method and system based on the thermal imaging are obtained. And the cross-modal features are fused through a Transform architecture, so that 95% of classification accuracy is realized. A bird repelling strategy is generated in real time through edge calculation, and the model is updated through cloud federal learning. The system integrates an oil-electric hybrid unmanned aerial vehicle and a ground device, supports dynamic path planning based on a thermodynamic diagram and differentiated repelling of directional sound waves, laser stroboflash and the like, has the night recognition accuracy rate of 92% and the bird repelling response time of 0.8 second, and is suitable for scenes of electric power, airports and the like. Through multi-dimensional perception, dynamic modeling and eco-friendly expelling, the problems of poor environmental adaptability, single strategy and the like of a traditional scheme are solved, and the anti-bird efficiency and the ecological safety are improved.
Owner:STATE GRID JIANGSU ELECTRIC POWER CO LIANYUNGANG POWER SUPPLY CO

Visual Transform-based dynamic screening medical image target tracking method and device

The invention provides a dynamic screening medical image target tracking method and device based on visual Transform, and relates to the technical field of computer vision, and the method comprises the steps: standardizing near-infrared or visible light fundus video frames into uniform resolution, constructing a template-search frame pair, and then jointly mapping the two frames of images into a Token sequence; a dynamic local interaction module is embedded in front of each pruning layer of the whole network, a local context is captured by using depth separable convolution and point convolution, a dynamic convolution kernel generator is driven, and a neighborhood Token is adaptively weighted and aggregated. Next, the Token screening and the compression mechanism TSC are operated in the same pruning layer, only the Top-K key Token is reserved, the redundant Token is cut off, and the original index is recorded; the objective of the invention is to improve the positioning stability and reasoning efficiency of a focus area (such as an optic disc) in a complex operation video.
Owner:XIAMEN UNIV OF TECH

Multi-modal fusion perception smoke and fire identification system and method

The invention relates to the technical field of fire safety monitoring, in particular to a firework identification system and method based on multi-modal fusion perception, and the core of the scheme is a visible light, multispectral and temperature three-modal framework: feature extraction optimization of each modal, improved YOLOv8s for visible light branches, dynamic background modeling and flame color screening, and multi-modal fusion perception. False positive is rejected by a multispectral branch depending on a waveband ratio and an index, an error compensation algorithm is introduced into a thermopile branch, and finally, a final smoke and fire area and the confidence coefficient thereof are determined by associating a three-mode area through collaborative decision. According to the scheme, the complex environment adaptability and the recognition reliability can be improved, the false alarm risk is reduced, the extremely-early smoke and fire detection capability is enhanced, good real-time performance and deployment flexibility are achieved, and the method is suitable for various types of fire safety monitoring scenes.
Owner:SHENZHEN HOT WHEELS TECHNOLOGY CO LTD

Steel pipe surface defect intelligent identification system based on deep learning

The invention discloses an intelligent steel pipe surface defect recognition system based on deep learning, and particularly relates to the technical field of pipe surface defect analysis. An annular polarization light source array and a high-frame-rate CMOS sensor are adopted to synchronously collect visible light and near-infrared multi-polarization images; a surface normal is calculated based on Stokes parameters, mirror surface suppression and diffuse reflection enhancement are realized, a defect candidate area is generated by fusing multi-scale Laplacian pyramid residual error and Renyi entropy segmentation threshold positioning, multi-physical quantity registration is completed through white light interference and infrared thermal imaging, a six-channel feature cube is constructed, and a three-dimensional image is obtained. According to the method, space, spectrum and thermal characteristics are jointly extracted in the multi-head attention convolutional neural network, the confidence coefficient is evaluated in combination with Jensen-Shannon divergence, and the polarization angle and the focal length are dynamically adjusted according to the confidence coefficient, so that closed-loop parameter self-optimization is realized, and the micro-scale pitting corrosion and millimeter-scale crack detection precision is remarkably improved.
Owner:JIANGSU CHANGBAO STEELTUBE CO LTD

Visible light and infrared image combined photovoltaic defect detection method based on unmanned aerial vehicle

The invention relates to the technical field of image detection, in particular to a visible light and infrared image combined photovoltaic defect detection method based on an unmanned aerial vehicle, which comprises the following steps of: determining a photovoltaic power station detection area, carrying out synchronous aerial photography by using a visible light camera carried by the unmanned aerial vehicle and an infrared thermal imager, and carrying out local division to extract texture and temperature characteristics; the screening area performs fitting affine parameter generation on an extraction center point, corrects an infrared image to extract contour lines and texture change features, and screens a defect area to extract a positioning coordinate set; according to the method, through synchronously screening generated visible light and infrared image pairs, the resolution of an abnormal region is enhanced, a complex background and an abnormal target are accurately separated, fine-grained adaptive registration is realized through central point extraction and affine parameter derivation, and defect region characteristics are verified bidirectionally through a temperature contour closing proportion and a texture density variable quantity; thermal features and texture features are fused in the defect screening process, the recognition capability of weak anomalies is enhanced, and the defect positioning accuracy is improved.
Owner:SOUTHEAST UNIV CHENGXIAN COLLEGE

Multi-spectral fusion night low-illumination image enhancement and occlusion compensation method

The invention relates to the technical field of image processing, and discloses a multispectral fusion night low-illumination image enhancement and shielding compensation method, which comprises the following steps of: cooperatively acquiring multi-modal data through a visible light camera, an infrared sensor, a thermal imaging sensor and a millimeter wave radar; comprising a low-illumination basic image, dark light texture details, target temperature distribution and contour and motion information of an object behind the shelter; fusing visible light and infrared textures by adopting a multi-scale transformation algorithm to generate a transition fusion image, and performing illumination compensation based on temperature distribution; predicting texture details of the occlusion area through a u-Het deep learning network in combination with detection data of the millimeter wave radar; and filling the missing texture according to the shielding contour, and generating a final target image through edge optimization and illumination smoothing technologies. According to the invention, the definition of a night low-illumination image can be improved.
Owner:MINAMI ACOUSTICS LTD

Concrete crack depth detection method and system based on multi-modal data fusion

The invention discloses a concrete crack depth detection method and system based on multi-modal data fusion. The method comprises the following steps: synchronously obtaining a visible light image sequence and a thermal imaging image sequence of a concrete crack; the thermal imaging image sequence is obtained based on adjustable thermal excitation; and through a preset multi-modal data registration algorithm, according to the visible light image, predicting a registration displacement vector field to generate a pseudo-infrared image corresponding to the enhanced visible light image, and migrating a temperature field of the thermal imaging image at the same moment and under the same picture to the pseudo-infrared image to generate a fusion modal image, obtaining a fusion modal image sequence; and through a preset heat conduction inversion model and a temperature attenuation characteristic curve generated based on the fusion modal image sequence, obtaining crack depth data and generating a three-dimensional crack map so as to visually present concrete crack depth detection data. According to the invention, the universality and accuracy of concrete crack depth detection can be improved.
Owner:GUANGDONG OCEAN UNIVERSITY

Defect identification method and device for substation equipment and electronic equipment

The invention provides a defect identification method and device for substation equipment and electronic equipment, and relates to the field of image identification. According to the method, an infrared image, an electric field leakage map and a visible light image are obtained through a multi-channel imaging system deployed in a substation site, and a multi-channel image tensor is generated and input into a multi-channel recognition model to extract fusion features. And fusing the features, inputting the fused features into a YOLOv8 backbone network, constructing a joint attention domain in combination with an equipment prior structure, generating a high-confidence candidate box, and performing non-maximum suppression to obtain a detection result. And constructing an inter-frame residual tensor for a detection result to perform time sequence modeling, thereby improving the detection effect. And for equipment with complex shielding, complementing a structure contour through an edge prediction path, and finally outputting target boundary and defect positioning information. By implementing the technical scheme provided by the invention, defect identification of the substation equipment is facilitated.
Owner:HUBEI CENT CHINA TECH DEV OF ELECTRIC POWER

Insulator product surface defect nondestructive testing method based on AI identification

The invention relates to the field of insulator nondestructive testing, and discloses an insulator product surface defect nondestructive testing method based on AI identification, and the method comprises a data acquisition module, a preprocessing module, an AI analysis module, a decision output module, a self-optimization module, and an edge calculation node. Through multi-modal data fusion and a deep convolutional neural network technology, accurate detection of surface defects such as cracks, dirt and damage is realized, the omission ratio and the false detection rate are reduced, and the detection precision is improved compared with the traditional manual inspection efficiency; visible light, infrared thermal imaging, ultrasonic waves and hyperspectral data are combined, the surface and internal defects of the insulator are comprehensively covered, the detection rate of tiny cracks and hidden dirt is increased, and the technical limitation of a single sensor is broken through.
Owner:超创数能科技有限公司 +2

Intelligent detection method for outdoor power line fault detection

The invention discloses an intelligent detection method for fault detection of an outdoor power line, and the method comprises the following steps: 1, carrying out the collection and preprocessing of multi-modal data, and carrying out the collection and preprocessing of the multi-modal data through an unmanned plane cluster, a distributed optical fiber sensor, a laser radar and meteorological monitoring equipment; visible light image data, infrared image data, laser point cloud data, vibration waveforms, temperature distribution and environmental parameters of the power line are synchronously obtained, and multi-source image data are processed, namely the visible light image data, the infrared image data and the laser point cloud data are processed; and 2, intelligent fault diagnosis: inputting the data acquired in the step 1 into a multi-task neural network model, and outputting a fault positioning and type identification result. According to the novel detection method based on multi-modal data fusion, an intelligent algorithm and closed-loop optimization, the fault identification precision, the dynamic decision-making capability and the comprehensive protection efficiency are improved, and the intelligent operation and maintenance requirements of a modern power grid are met.
Owner:KUNMING UNIVERSITY

Converter station intelligent gateway image recognition system and equipment defect detection method

The invention discloses a converter station intelligent gateway image recognition system based on a YOLOv3 target detection algorithm, and the system employs a three-stage cooperative processing architecture design, and builds seamless connection of a multispectral image collection layer, an edge calculation gateway layer, and a cloud operation and maintenance management platform layer. The invention further provides an equipment defect detection method based on the system, bimodal image data are collected through the visible light camera and the thermal infrared imager, preprocessing operation is carried out, equipment positioning and defect classification are synchronously executed by utilizing the improved YOLOv3 network, a structured detection result is output, temperature field analysis is carried out on an infrared thermal image, and the equipment defect detection result is obtained. And an abnormal heating area is identified, when defects are detected, multi-level risk response early warning is generated, and a defect diagnosis report is pushed to the cloud operation and maintenance management platform layer. Real-time image analysis of converter station equipment can be realized, the method is suitable for automatic detection of typical fault defects of the equipment, and the operation and maintenance efficiency of a power grid is improved.
Owner:GUANGZHOU BUREAU CSG EHV POWER TRANSMISSION

Power transmission and transformation equipment state evaluation system based on multi-sensor fusion

The invention relates to the technical field of power transmission and transformation equipment state evaluation, in particular to a power transmission and transformation equipment state evaluation system based on multi-sensor fusion, which realizes accurate alignment of multi-modal data by acquiring temperature, current, infrared thermal images, visible light images and laser point cloud data and constructing a unified time and space coordinate system. Short-term fluctuation features, image hot spot and texture anomaly features and structure change features are extracted through time sequence modeling, image saliency extraction, point cloud residual clustering and other methods, a joint feature vector is generated through fusion, and integrity and collaboration of multi-modal information expression are enhanced. And on the basis of a fixed time period, calculating a joint feature difference value between adjacent periods to obtain a residual sequence, and carrying out normalization processing in a sliding time window to construct a multi-period state residual spectrum. And finally, the atlas is input into a pre-training classification model, dynamic identification and anomaly detection of the equipment operation state are realized, and the intelligent evaluation capability under complex working conditions is effectively improved.
Owner:GUANGZHOU JINYUAN TECH DEV CO LTD

Fan blade intelligent inspection method and system based on unmanned aerial vehicle

The invention provides an intelligent inspection method and system for fan blades based on an unmanned aerial vehicle. The method comprises the steps that a visible light camera, an infrared thermal imager and a laser radar are integrated on the unmanned aerial vehicle; generating a flight route covering the whole surface based on the fan blade three-dimensional model; when the unmanned aerial vehicle is controlled to fly along the flight route, visible light images, infrared temperature data and laser point clouds are synchronously collected; the visible light image, the infrared temperature data and the laser point cloud are input into a defect analysis model, the defect type and grade are identified through conjoint analysis, a temperature abnormal area is positioned, and geometric deformation is quantified; a health assessment report is generated, the health assessment report comprises a defect positioning map and a graded maintenance decision matched with defect grades, multi-source data are collected through integration of a visible light camera, an infrared thermal imager and a laser radar, and then fusion analysis and recognition are carried out, so that compared with a manual inspection mode, the intelligent level of fan blade inspection is improved, and the inspection efficiency is improved. And the inspection efficiency of the fan blade is also improved.
Owner:HAINANZHOU SHINENG PHOTOVOLTAIC POWER CO LTD

Power equipment defect identification and alarm method and system based on deep learning

The invention discloses an electrical equipment defect identification and alarm method and system based on deep learning. The method comprises the following steps: synchronously collecting and registering visible light and infrared thermal imaging images on the surface of power equipment, and constructing an instance segmentation network comprising a lightweight feature extraction network, a multi-scale feature fusion network and a frequency domain mask prediction branch; enhancing the diversity of training samples by adopting a generative adversarial strategy; based on the graph neural network, analyzing the incidence relation between the defects and the equipment topology and historical records, and deducing the defect causal relation and the risk level; generating interpretable alarm information including the thermodynamic diagram, the natural language report and the maintenance suggestion; real-time detection and deep analysis are realized by adopting an end-side cloud collaborative architecture; and the system performance is continuously improved through a closed-loop optimization mechanism. According to the method, high-precision defect detection under multi-modal data fusion is realized, the robustness and interpretability are high, and the operation and maintenance intelligence level of power equipment is remarkably improved.
Owner:JIANGSU POWER TRANSMISSION & DISTRIBUTION CO LTD

Laser - based targeting and object detection system

A pest control system is disclosed comprising an optical, computational, and monitoring subsystem, optionally mounted on a mobile platform. The optical system may include a neutralizing laser or multi-wavelength light source, discovery and detail cameras (optionally stereo), a beam-steering mechanism, tunable focus, and optional thermal or depth sensors. The processor, such as a GPU or FPGA, identifies insect or biological targets, adjusts laser focus by depth, and controls beam activation. A monitoring system verifies safety by detecting humans or other non-target entities using environmental and thermal cameras; if detected, laser firing is inhibited. The mobile platform may use wheels, propellers, tracks, or cables, with GPS and data links for remote control. A visible light pre-flash may induce a blink reflex before firing. In some embodiments, a scouting drone transmits target coordinates to the neutralization unit, enabling coordinated, efficient, and safe laser-based pest control.
Owner:REYNTJENS NICK