Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

16454 results about "Visible spectrum" patented technology

The visible spectrum is the portion of the electromagnetic spectrum that is visible to the human eye. Electromagnetic radiation in this range of wavelengths is called visible light or simply light. A typical human eye will respond to wavelengths from about 380 to 740 nanometers. In terms of frequency, this corresponds to a band in the vicinity of 430–770 THz.

Method for fusing infrared light and visible light images

The present invention relates to the technical field of image fusion. Disclosed is a method for fusing infrared light and visible light images. According to the present invention, design is carried out on the basis of a spatial channel attention mechanism and a gradient aggregation residual dense block, a strong texture and weak texture of a feature are retained by integrating Sobel and Laplacian operators while combining the advantages of ResNeXt and DenseNet, and channel information and spatial information of a feature map are refined by means of introducing a spatial and channel attention mechanism, thus the information capture capability of the feature map is increased, and refined spatial and channel feature maps are fused by using a pooled fusion block, to obtain a high-quality fusion feature.
Owner:CHONGQING UNIV OF TECH

Visible light and infrared image fusion method based on cross-modal dynamic collaboration

The invention discloses a visible light and infrared image fusion method based on cross-modal dynamic collaboration. The method comprises the following steps: respectively extracting texture detail features of a visible light image and thermal radiation features of an infrared image through a visible light encoder and an infrared encoder; spatial alignment and channel complementarity optimization of cross-modal features are realized by using a heterogeneous attention collaboration module; and performing layered fusion on deep semantics and shallow detail features through a dynamic gating multi-scale decoder to generate a high-resolution fusion image. According to the method, the problems of feature dislocation, detail loss and unreasonable fusion weight distribution caused by modal difference in the prior art are solved, the detail fidelity, the thermal target saliency and the complex scene adaptability of the fusion image can be remarkably improved, and a high-robustness fusion result is provided for low-illumination environment perception and multi-modal target recognition.
Owner:ZHEJIANG SCI-TECH UNIV

High-precision image processing method and system based on illumination adaptive compensation

The invention discloses a high-precision image processing method and system based on illumination adaptive compensation, and relates to the technical field of computer vision and image processing, and the method comprises the steps: inputting an original image, and dividing the image into a high-frequency edge layer, an intermediate-frequency texture layer and a low-frequency illumination layer through a multi-scale residual network; acquiring illumination intensity, color temperature and scene categories in real time by using an ambient light sensor and a scene semantic segmentation model, and generating dynamic compensation parameters; carrying out dynamic range expansion on a low-frequency illumination layer based on a physical illumination model, and adjusting the weight of highlight suppression and dark area enhancement through a self-adaptive S-shaped exposure curve; a double-branch generative adversarial network is adopted, noise suppression and super-resolution reconstruction are carried out on the high-frequency layer, and texture detail enhancement is carried out on the intermediate-frequency layer; aligning the data of the depth camera and the infrared sensor with the visible light image through a cross-modal fusion module; and performing tone mapping on the fused image based on human visual characteristics, and outputting an enhanced image with a high dynamic range and reserved details.
Owner:SHANXI UNIV

Defect detection method for high-voltage equipment based on deep learning and multispectral image fusion

The invention relates to a high-voltage equipment defect detection method based on deep learning and multispectral image fusion, and relates to the technical field of electric power high-voltage equipment state detection. The method comprises the following steps: acquiring an ultraviolet image, an infrared image and a visible light image of the surface of the high-voltage equipment; carrying out image pixel feature-based fusion processing on the ultraviolet image, the infrared image and the visible light image through an image fusion method; establishing a high-voltage equipment defect detection model, and training the high-voltage equipment defect detection model by using the fused image data to obtain a high-voltage equipment defect identification model based on the YOLO-STrans multispectral fusion network; and inputting the ultraviolet image, the infrared image and the visible light image of the outer surface of the power high-voltage equipment into a high-voltage equipment defect identification model to obtain a fault identification result of the to-be-detected power high-voltage equipment. The method can improve the recognition precision of the extremely early insulation degradation and temperature anomaly defects of the surface of the high-voltage power equipment.
Owner:ANHUI NANRUI JIYUAN POWER GRID TECH CO LTD

Photovoltaic panel surface defect detection method and system based on physical property analysis

The invention belongs to the technical field of photovoltaic panel surface defect detection, and discloses a photovoltaic panel surface defect detection method and system based on physical property analysis. The method comprises the following steps: firstly, acquiring a surface temperature distribution image, surface deformation data, ultrasonic echo data, a spectral image, spectral characteristic data and eddy current signal characteristic data of the photovoltaic panel by respectively utilizing an infrared thermal imager, a laser speckle interferometer, an ultrasonic flaw detector, a visible light multi-band imager and eddy current detection equipment; various abnormal regions such as temperature, deformation, ultrasonic echo, spectral characteristics and eddy current signals are determined; and then determining defect positions by integrating various abnormal regions, and determining the types and sizes of the surface defects of the photovoltaic panel by combining various data corresponding to the defect positions. According to the method, accurate positioning and identification of the surface defects of the photovoltaic panel are realized through a multi-physical property detection means, and the detection accuracy and reliability are effectively improved.
Owner:INNER MONGOLIA NORMAL UNIVERSITY

Early warning analysis method based on intelligent vision and server

The invention provides an early warning analysis method based on intelligent vision and a server, and the method comprises the steps: obtaining a multi-mode video stream containing a visible light and infrared thermal imaging image sequence through a vision collection device in a monitoring region, and carrying out the spatial-temporal feature extraction of the multi-mode video stream; the method comprises the steps of generating dynamic behavior sequence characteristics including a target object moving track, posture change and thermodynamic distribution characteristics, analyzing the dynamic behavior sequence characteristics through a preset abnormal behavior judgment model in a multi-dimensional matching mode, judging whether the target object triggers abnormal behavior characteristics or not, and if yes, generating a graded early warning signal in combination with an association weight. In addition, according to the spatial distribution and the time length of the abnormal behavior characteristics, the parameters of the acquisition equipment and the coverage range of the monitoring area are dynamically adjusted, and the subsequent video stream anomaly detection precision is optimized, so that intelligent and accurate early warning analysis is realized, and the security efficiency is improved.
Owner:LESHAN YONGXIN TECH CO LTD

Unmanned aerial vehicle multi-dimensional information fusion method and system based on acousto-optic-electric composite detection

The invention provides an unmanned aerial vehicle multi-dimensional information fusion method and system based on acousto-optic-electric composite detection. According to the method, acoustic frequency band signals, visible light image sequences and electromagnetic field intensity change data are collected, acoustic characteristic flow, optical characteristic flow and electrical characteristic flow are generated, and based on the time deviation between a low-frequency vibration mode and transient electromagnetic pulses, multi-channel dynamic calibration is carried out on an image distortion area in the optical characteristic flow. The method comprises the following steps: acquiring an acoustic feature flow, an optical feature flow and an electrical feature flow, correcting space-time coordinate parameters of the acoustic feature flow, the optical feature flow and the electrical feature flow, generating a calibration feature flow, carrying out anti-interference fusion processing on the calibration feature flow, extracting multi-dimensional coupling features, inputting the multi-dimensional coupling features into an unmanned aerial vehicle flight path planning model, and generating a three-dimensional space situation model; according to the invention, the physical space-time consistency alignment and noise suppression of the multi-modal data are realized, and the obstacle positioning precision and the dynamic trajectory prediction real-time performance are significantly improved.
Owner:ZHONGLIAN GOLDEN CROWN INFORMATION TECH (BEIJING) CO LTD

Improved YOLOv11s safety helmet wearing detection model and optimization method thereof

The invention provides an improved YOLOv11s safety helmet wearing detection model and an optimization method thereof, and relates to the technical field of computer vision target detection. According to the improved YOLOv11s safety helmet wearing detection model and the optimization method thereof, the improved YOLOv11s safety helmet wearing detection model comprises the following modules: a multi-modal fusion module, a space-time analysis module, a domain adaptation module, a topological optimization module and a dynamic architecture module; and the multi-modal fusion module is used for realizing feature decoupling by adopting channel separation convolution based on input RGB and near-infrared images, fusing visible light and thermal radiation features through a dynamic weight distribution algorithm, implementing affine transformation alignment on multi-scale features by utilizing a spatial transformation network, and generating a multi-modal feature graph. Through fusion of visible light and near infrared spectrum features and implementation of dynamic weight distribution, complementarity of target texture and thermal radiation features under a complex illumination condition is enhanced, and the problem of feature distortion of single-mode data in a strong backlight or low-illumination scene is solved.
Owner:SOUTHWEAT UNIV OF SCI & TECH

Outer wall thermal insulation defect diagnosis method and system based on artificial intelligence

The embodiment of the invention discloses an outer wall thermal insulation defect diagnosis method and system based on artificial intelligence, and the method comprises the steps: firstly obtaining an infrared thermal imaging and visible light image sequence of a target building outer wall, the former comprising continuous temperature distribution data, and the latter comprising textural feature data in time-space alignment with the latter; performing dynamic temperature gradient analysis on the infrared thermal imaging image sequence to generate a three-dimensional heat conduction abnormal map, extracting surface deformation characteristics from the visible light image sequence to generate a structure deformation distribution map, and performing multi-modal characteristic fusion on the two to obtain a joint defect characteristic matrix; performing defect type classification and region positioning on the matrix based on a pre-trained deep residual neural network model, outputting a defect type identifier and a corresponding region boundary coordinate, and finally generating a diagnosis report containing a repair priority score and a material matching suggestion according to the defect type identifier and the corresponding region boundary coordinate, and sending the diagnosis report to a user terminal for visual display. And efficient and accurate external wall thermal insulation defect diagnosis is realized.
Owner:CHINA OVERSEAS CONSTR LTD

Unmanned aerial vehicle electric power inspection image intelligent analysis method and system based on deep learning and multi-modal fusion and medium of unmanned aerial vehicle electric power inspection image intelligent analysis method and system

The invention discloses an unmanned aerial vehicle electric power inspection image intelligent analysis method and system based on deep learning and multi-modal fusion and a medium thereof, and relates to the technical field of electric power equipment detection. The method comprises the following steps: planning an optimal inspection path by adopting an A * algorithm to realize multi-sensor synchronous data acquisition; adaptive histogram equalization and defogging processing are carried out on the visible light image, non-uniformity correction and temperature calibration are carried out on the infrared image, and filtering and registration are carried out on point cloud data; constructing a multi-scale feature fusion network based on improved VGGNet-16, and introducing deformable convolution and a cross-modal attention mechanism to realize multi-source data fusion; defect detection is carried out based on a three-level template library and a feature map cross-correlation algorithm, and the precision is improved in combination with non-maximum suppression and sub-pixel positioning; and finally generating a detection report containing defect types, positions and maintenance suggestions. According to the invention, the automation level and the detection precision of power inspection are obviously improved.
Owner:STATE GRID SICHUAN YAAN ELECTRIC POWER (GRP) CO LTD YUCHENG POWER SUPPLY CO +1

Remote online monitoring method and system based on machine vision and artificial intelligence

The invention relates to the technical field of industrial intelligent monitoring, in particular to a remote online monitoring method and system based on machine vision and artificial intelligence, and the method comprises the following steps: synchronously collecting a visible light video stream, infrared thermal imaging data and three-dimensional vibration spectrum data through an edge calculation node, and forming a multi-modal sensing data set; performing cross-domain feature alignment processing on the data set to generate a space-time synchronous composite feature matrix; inputting the composite feature matrix into a cascaded deep learning model, and outputting a three-dimensional diagnosis vector which comprises an equipment health state, an abnormal region and a fault probability; and matching the three-dimensional diagnosis vector with a historical reference vector through a DTW and cosine similarity combination algorithm to generate a deviation index, and outputting a self-adaptive alarm threshold and a maintenance suggestion scheme according to the deviation index. The method has the advantages of high multi-modal fusion degree, light diagnosis model and intelligent and adjustable alarm mechanism, and is suitable for real-time remote operation and maintenance in a high-risk industrial scene.
Owner:TIANJIN RES INST FOR WATER TRANSPORT ENG M O T +1

Pump machine metal shell size detection method based on image analysis

The invention belongs to the technical field of industrial measurement, and discloses a pump machine metal shell size detection method based on image analysis, which comprises the following steps: synchronously acquiring image data of a pump machine metal shell in a visible light wave band and a near-infrared wave band; the contrast ratio of image data is optimized through a dynamic exposure control technology, and a high-dynamic-range multispectral image is obtained; three-dimensional geometric information of the pump machine metal shell is obtained, registration fusion is carried out on the three-dimensional geometric information and the high-dynamic-range multispectral image, a dense three-dimensional point cloud model with multispectral textures is constructed, and a multi-frequency heterodyne algorithm is adopted to process a high-reflection area in the dense three-dimensional point cloud model; the method comprises the following steps: collecting a multi-angle reflection image of a pump machine metal shell by rotating a linear polarizer, calculating a Stokes vector to extract a diffuse reflection component, carrying out diffuse reflection component constraint and brightness suppression on a high-reflection area based on a CIE-Lab color space, and outputting a dense three-dimensional point cloud model after texture enhancement; and the size detection precision of the pump machine metal shell is improved.
Owner:JINING ANTAI MINING EQUIP MFG CO LTD

System and method for industrial risk assessment via computer vision

A device, system and method comprising computer vision techniques for fire prevention / detection and risk assessment, as well as for determining deviations from an ideal operational state. The present invention includes for example systems and methods which leverage data collected by camera systems composed of infrared and visible light sensors to detect and / or prevent a fire from starting, and additionally, use this data to determine a risk assessment for the building. The present invention also provides for example a system and method for monitoring and controlling safety risks in indoor industrial environments by determining deviations from an ideal operational state using computer vision techniques and game-theoretic competitive ranking frameworks.
Owner:INNOVIRE AG

Intelligent photoelectric theodolite aerial target positioning and tracking system

The invention discloses an intelligent photoelectric theodolite aerial target positioning and tracking system, which relates to the technical field of photoelectric detection, and comprises a multi-mode photoelectric sensor module integrating visible light, infrared thermal imaging, a laser radar and a polarized light sensor and supporting spectrum adaptive switching; the dynamic noise suppression processing module is used for eliminating environmental interference based on a time-space domain hybrid filtering algorithm; the multi-target tracking control module adopts a time-sharing partition scanning strategy and a graph neural network data association algorithm; the anti-interference servo driving module is used for realizing stable tracking under strong disturbance through inertial navigation-visual fusion compensation; and the edge computing platform is used for deploying a lightweight deep learning model to complete target recognition and trajectory prediction. According to the invention, through interdisciplinary collaboration of quantum dot materials, graph neural networks and physical equation constraints, the bottleneck of a single technology is broken through; and through closed-loop optimization of dynamic anti-interference and edge intelligence, full-link enhancement of'perception-decision-execution 'is realized.
Owner:LUOYANG AIR ROUTE ELECTRONIC TECH CO LTD

Road crack detection method and system based on fused image

The invention relates to the technical field of road crack detection, in particular to a road crack detection method and system based on a fused image. The method comprises the following steps: acquiring road multi-source monitoring data including a visible light image, infrared thermal imaging data and laser radar point cloud data, and performing multi-modal image fusion and road three-dimensional point cloud reconstruction to generate a fused road image and road three-dimensional modeling data; performing crack curvature analysis based on the fused road image to generate crack curvature data; performing reflection crack contour recognition and positioning on the fused road image through the crack curvature data to generate reflection crack initial positioning data; obtaining road base material data; and performing reflection crack stress field reconstruction on the road area according to the reflection crack initial positioning data to obtain a reflection crack stress field. According to the invention, through multi-modal fusion, curvature identification, stress field modeling and crack channel analysis, the accuracy and strain of road reflection crack detection are improved.
Owner:BINHAI BAY BRANCH OF DONGGUAN CITY URBAN MANAGEMENT & COMPREHENSIVE LAW ENFORCEMENT BUREAU

High-speed rail part crack real-time detection method

The invention provides a high-speed rail part crack real-time detection method, and belongs to the technical field of image detection based on computer vision. Obtaining a hyperspectral image, a visible light image, three-dimensional point cloud data and eddy current signal data of the surface of the high-speed rail part; performing spatial registration on the high-spectral image and the visible light image on the surface of the high-speed rail part, and performing time registration on the three-dimensional point cloud data based on the eddy current signal data; feature enhancement and standardization processing are carried out; performing feature extraction and fusion on the obtained standardized multi-modal data based on a multi-modal feature fusion network to obtain a fusion feature map representing crack details of the high-speed rail parts; based on a self-adaptive crack segmentation method, a crack contour is extracted from the point cloud, and then whether the part has a crack or not and the length and depth of the crack are calculated. According to the invention, three kinds of modal data are creatively integrated, the information dimension limitation of single-modal detection is broken through, and all-weather and non-contact intelligent efficient diagnosis of submillimeter cracks is realized under complex working conditions.
Owner:QINGDAO NANYANG SANCHENG MASCH CO LTD

Infrared thermal imaging building facade defect intelligent diagnosis method based on multi-modal fusion

The invention provides an infrared thermal imaging building facade defect intelligent diagnosis method based on multi-modal fusion, and relates to the technical field of building detection.The method comprises the steps that infrared thermal imaging, visible light images and three-dimensional point cloud data are synchronously collected to construct a multi-modal data set; segmenting a hot spot region by adopting an improved morphological watershed algorithm and extracting contour and temperature features; recognizing a surface crack and peeling area based on a double-branch attention network to generate a texture defect feature map; curvature distribution and thermal deformation gradient are calculated through space registration constrained by a heat conduction equation; multi-source features are fused to calculate a hot spot form dispersion TSMD and a structure risk quantification factor SRQF; constructing a defect risk decision matrix to output defect types, positions and risk levels; and superposing the diagnosis result to a BIM model to generate a three-dimensional visual report and predicting a thermodynamic evolution trend. The multi-modal data collaborative analysis is realized, the defect risk is accurately quantified, and the problems of poor anti-interference performance, inaccurate segmentation and large registration error of a traditional method are solved.
Owner:SHAOXING MUNICIPAL DESIGN INST

Display defect detection method and device

The invention discloses a display defect detection method and device. According to the scheme, visible light image data and infrared thermal imaging data of a to-be-detected display are obtained, multi-modal feature extraction and fusion are performed, a fusion feature matrix is generated, and defect identification is performed based on the fusion feature matrix; according to the scheme, the visible light image data and the infrared thermal imaging data are acquired, and defect detection is performed by combining data of two modes, so that defect characteristics and the like of the display can be captured more comprehensively; the accuracy of defect detection can be effectively improved through the combination of two kinds of data; besides, through multi-modal feature extraction and fusion, the incidence relation between the edge feature and the heat distribution feature which can more accurately represent the pixel unit is generated, and defect detection is carried out based on a fusion feature matrix, so that false alarm and missing alarm of defect detection of the display can be reduced, and the reliability of defect detection is improved; and various types of defects can be effectively detected.
Owner:SHENZHEN HAILAN ELECTRONICS

PCB three-proofing coating quality detection method and system

The invention discloses a PCB three-proofing coating quality detection method and system. The method comprises the steps that a visible light reflection image of the surface of a PCB and scattering spectrum data of a near-infrared band are acquired; performing spatial filtering processing on the visible light reflection image to extract interface area pixels, calculating coating layer thickness gradient distribution based on Mie scattering characteristics in scattering spectrum data, and fusing to generate an edge gradient distribution map; and according to the gradient amplitude change rate in the edge gradient distribution map, segmenting the effective coverage area of the coating layer by adopting a self-adaptive dynamic threshold algorithm, and extracting curvature extreme point density and boundary fractal dimension parameters at the segmentation boundary. According to the invention, three technical barriers of difficult microdefect capture, unmeasurable interface performance and delayed failure risk in traditional detection are solved, and two-dimensional accurate diagnosis of the structural compactness and interface reliability of the coating layer is realized.
Owner:XIAN HONGGU HENGTONG ELECTRONIC TECH CO LTD

Assistant decision-making platform for water conservancy project operation and maintenance based on AI unmanned aerial vehicle

The invention relates to the technical field of hydraulic engineering intelligent operation and maintenance, and discloses an AI unmanned aerial vehicle-based auxiliary decision-making platform for hydraulic engineering operation and maintenance, and the platform comprises a data collection module which is used for obtaining multi-modal data of a water conservancy facility through an AI unmanned aerial vehicle, the multi-modal data comprises a visible light image, thermal imaging data, multispectral data and laser radar data; the data processing and fusion module is used for carrying out formatting processing, space-time alignment and feature fusion on the multi-modal data; the health assessment and prediction module is used for assessing the health state of the water conservancy facility based on the processed data and predicting the future change trend of the facility state; and the auxiliary decision-making module is used for generating inspection priority planning of the water conservancy facilities. According to the invention, through multi-source data fusion, dynamic risk assessment and intelligent optimization distribution, the effects of accurate monitoring, efficient operation and maintenance and risk visual management of the whole life cycle of the water conservancy facilities are realized.
Owner:TIANJIN RES INST FOR WATER TRANSPORT ENG M O T

Building appearance defect detection method and system based on unmanned aerial vehicle

The invention relates to the technical field of building appearance defect detection, in particular to a building appearance defect detection method and system based on an unmanned aerial vehicle, and the method comprises the steps: obtaining the building information of a target building, and generating a hierarchical scanning path and a three-dimensional obstacle avoidance flight path, a visible light image, an infrared thermodynamic diagram and laser radar point cloud information are collected for space-time alignment processing, and an attention mechanism neural network is used for extracting multi-scale features to generate a detection report containing defect three-dimensional coordinates, damage levels and safety risk assessment. The method achieves the purpose of efficiently and accurately detecting the building appearance defects, can adapt to complex building structures and environmental conditions, supports defect trend prediction and maintenance decision, and remarkably improves the building safety management efficiency.
Owner:ZHEJIANG NONFERROUS GEOPHYSICAL TECH APPL RES INST CO LTD

Unmanned aerial vehicle identification early warning method and system

The invention provides an unmanned aerial vehicle identification early warning method and system. The method comprises the following steps: acquiring RGB image data, thermal radiation data and spectral data of an unmanned aerial vehicle no-fly zone through a visible light camera, an infrared thermal imager and a multispectral imager; performing transmission preprocessing on the RGB image data, the thermal radiation data and the spectral data, and adaptively adjusting multi-level fusion of a fusion weight based on real-time environmental parameters to generate target fusion data; based on a deep learning model and a tracking prediction algorithm, performing unmanned aerial vehicle identification early warning on the target fusion data, and generating early warning data; and transmitting the target fusion data and the corresponding abnormal event log to a cloud server, and updating the deep learning model by adopting the target fusion data and the abnormal event log. Through cooperative work of a multi-mode sensor, visible light, infrared, multispectral and other wave bands are covered, all-weather and full-scene unmanned aerial vehicle detection is achieved, the fusion weight is adjusted in real time based on real-time environment parameters, and the accuracy of the recognition result under the complex air situation is ensured.
Owner:GLOBAL GENERAL AVIATION (HANGZHOU) CO LTD

Image fusion method and system based on depth adaptive channel-space attention

The invention provides an image fusion method and system based on depth adaptive channel-space attention, and belongs to the technical field of image processing. The method comprises the following steps: acquiring an infrared light image and a visible light image, inputting the infrared light image and the visible light image into a double-branch interactive encoder, and extracting initial features of the infrared light image and the visible light image; obtaining the weights of the initial features of the infrared light image and the visible light image by using a depth self-adaptive score module, and generating weighted features; combining the weighted features, and inputting the combined weighted features into a self-adaptive channel-space attention module to realize feature fusion; and inputting the fused features into a decoder for dimension reduction reconstruction, and mapping the fusion result back to the original representation. More complementary information can be obtained through interactive processing of two modal image input features and dynamic adjustment of fusion weight. A deep adaptive fusion module is used for evaluating the quality of input features, and weighted fusion is executed through a channel and space dual-attention mechanism, so that a better fusion effect is obtained.
Owner:BEIJING INFORMATION SCI & TECH UNIV

Intelligent monitoring system and method based on multi-modal remote sensing data and deep learning

The invention relates to the technical field of unmanned aerial vehicle remote sensing and artificial intelligence crossing, in particular to an intelligent monitoring system and method based on multi-modal remote sensing data and deep learning, and the system comprises an unmanned aerial vehicle cluster networking subsystem, a mixed feature matching subsystem and a multi-modal fusion and continuous learning subsystem. The method comprises the following steps: constructing an unmanned aerial vehicle cluster carrying a multispectral sensor and a laser radar LiDAR, and carrying out wireless networking among a plurality of unmanned aerial vehicles to realize sharing of acquired images; feature point extraction is carried out on collected images of different time phases, the extracted feature points are input into the generative adversarial network, and the feature points are matched; and receiving the matched collected images, dynamically fusing data of visible light, infrared and other multi-modal images through a space-time attention mechanism, and realizing high-precision target recognition and dynamic environment self-adaption in a small sample scene. According to the method, unmanned aerial vehicle multi-source remote sensing data acquisition, feature fusion and deep reinforcement learning are combined, and the method is used for intelligently monitoring a dynamic environment.
Owner:XINJIANG NORMAL UNIVERSITY

Substation equipment temperature measurement method and system based on visible light guidance

The invention relates to the technical field of mode recognition, in particular to a transformer substation equipment temperature measurement method and system based on visible light guidance. Firstly, a visible light image, an infrared thermogram and vibration spectrum data are synchronously collected, a dynamic compensation coefficient matrix is constructed through illumination intensity analysis, the dynamic compensation coefficient matrix is applied to the infrared thermogram, and illumination interference compensation is achieved. And then, inputting the corrected infrared thermogram and visible light image into a pre-trained heterogeneous atlas matching model, and identifying the category and three-dimensional coordinates of the target equipment. And based on the equipment category information, calling a standard temperature field template in the digital twin model library, establishing a heat conduction path model in combination with the vibration spectrum data, and generating a temperature field prediction reference map of the equipment. And finally, through pixel-by-pixel deviation analysis, inputting the temperature deviation value, the image features and the vibration data into the probability graphic model, and outputting equipment fault information. The method can realize high-precision temperature measurement and fault diagnosis.
Owner:NANCHANG POWER SUPPLY BRANCH OF STATE GRID JIANGXI ELECTRIC POWER CO LTD

Local feature optimization-based visible light and infrared pedestrian re-identification method

Disclosed in the present invention is a local feature optimization-based visible light and infrared pedestrian re-identification method. The method comprises: collecting a target area image, the target area image comprising a visible light-mode image and an infrared-mode image; and inputting the target area image into a pedestrian identification model to obtain a pedestrian identification result, wherein the pedestrian identification model comprises a local feature extraction module, a local feature alignment module and a feature collaborative learning module, the local feature extraction module extracts local features of the visible light mode and infrared mode, the local feature alignment module groups and aligns cross-modal local features, so as to establish cross-modal connections, and the feature collaborative learning module enhances each local feature and performs collaborative optimization on the global features and the local features. The present invention can adaptively mine cross-modal local features, directly establish rich alignment relationships for the cross-modal local features, and embed context relationships of global features into the local features, thus remarkably improving the accuracy of pedestrian identification.
Owner:SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI

Multi-modal visual fusion complex scene small target detection tracking method and system

The invention discloses a multi-modal visual fusion complex scene small target detection tracking method and system, and relates to the technical field of unmanned aerial vehicle target tracking, and the method comprises the steps: employing a visible light camera, an infrared thermal imager and a laser radar sensor which are carried on an unmanned aerial vehicle platform, and synchronously collecting RGB images, thermal infrared images and point cloud data; the consistency of the multi-modal data is ensured through data preprocessing and space-time alignment; constructing a lightweight double-branch network to extract multi-scale features, generating a fusion feature map by adopting adaptive weighted fusion, and generating depth information by utilizing point cloud to assist in scale estimation; a small target detection head is designed based on the fusion feature map, and precise detection is realized in combination with a feature pyramid network, adaptive scale prediction and a context awareness suppression mechanism; furthermore, through multi-mode cooperative tracking, including target association, spatio-temporal context modeling, trajectory prediction and a re-detection mechanism, tracking continuity is ensured.
Owner:BEIJING INSTITUTE OF GRAPHIC COMMUNICATION

Underwater fish school monitoring statistical system based on image fusion

The invention relates to the technical field of underwater fish school monitoring, and discloses an underwater fish school monitoring statistical system based on image fusion. According to the system, underwater video streams and sonar reflection intensity data of different spectral bands are acquired through an underwater multi-source image acquisition module, and time-space synchronous multi-modal image data streams are generated through timestamp alignment; a fish school contour reconstruction module is used for segmenting a fish school contour boundary and fusing visible light texture and sonar geometric features to generate an underwater three-dimensional fish school distribution set; the dynamic track mapping module tracks the mass center displacement, calculates the movement rate and the direction deviation angle, and correlates the water area depth to generate a dynamic track topological graph; the behavior anomaly analysis module extracts environment data based on the track mutation node, and detects aggregation density change and direction dispersion to mark an anomaly feature cluster; and the population statistics output module integrates the data, performs classified statistics on population distribution, a quantity threshold value and a migration path overlap ratio, and finally generates a fish school quantity distribution statistics thermodynamic map.
Owner:福州海洋研究院

High-precision AOI detection system and method for surface defects of complex industrial products

The invention relates to the technical field of automatic detection, and discloses a high-precision AOI detection system and method for complex industrial product surface defects, and the high-precision AOI detection system for complex industrial product surface defects comprises a multi-modal sensor module, an image processing and data fusion module, and a feature extraction and high-dimensional data analysis module. A deep learning detection module; the high-precision AOI detection method for the surface defects of the complex industrial product comprises the following steps: acquiring multi-dimensional image data of the surface of the product by using a multi-modal sensor module, and carrying out optimization, geometric correction and illumination correction on the multi-dimensional image data through an image processing and data fusion module. According to the method, a multi-mode sensor fusion technology is adopted, image data of visible light, infrared light, hyper-spectrum and a 3D depth sensor are comprehensively collected, surface defects of complex industrial products are comprehensively sensed, and the accuracy and robustness of defect detection are remarkably improved.
Owner:GREEN INTELLIGENT EQUIP (SHENZHEN) CO LTD

On-line quality detection method for nerve-calming and brain-nourishing liquid based on multispectral detection technology

The invention provides an online quality detection method of a nerve-soothing and brain-nourishing liquid based on multispectral fusion, and aims at solving the bottleneck problems of long offline time consumption, weak multi-index detection capability, poor dynamic adaptability and the like in the traditional detection technology, and realizing intelligent quality control of the whole process of the production technology. The device integrates an ultraviolet-visible spectrum module, a near-infrared spectrum module and a fluorescence spectrum module, constructs a multi-scale residual convolutional network to extract near-infrared spectrum characteristics, analyzes a fluorescence excitation-emission matrix through bidirectional LSTM, and cooperates with dynamic baseline correction of an ultraviolet spectrum, so that the icariin content detection precision is improved by 40% compared with that of a traditional HPLC method, the heavy metal residue detection lower limit reaches 0.05 ppm, and the detection accuracy is greatly improved. And an innovative solution is provided for intelligent production of traditional Chinese medicine preparations.
Owner:JIANGSU JURONG PHARM GRP CO LTD