Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

80954 results about "Imaging data" patented technology

Document Imaging from Data Dimensions converts paper and electronic documents into clear digital images to provide downstream systems and processes and authorized users with real-time access to images and data, anytime and from anywhere.

Variable frame rates for different imaging modalities

Video visualization systems with customizable image sensor frame rates to output multiple imaging modalities. A system includes an image sensor and an emitter. The system includes a controller that synchronizes operations of the emitter and the image sensor to output a video stream comprising data from one or more of a plurality of possible imaging modalities including color video imaging data, fluorescence video imaging data, and multispectral video imaging data. The controller selects a frame rate for the image sensor to output a video stream comprising two or more requested imaging modalities requested by a user, and further based on a minimum required frame rate for each of the two or more requested imaging modalities.
Owner:CILAG GMBH INTERNATIONAL

Machine learning based monitoring system

Systems and methods are provided for machine learning based monitoring. Image data from a camera is received. On the hardware accelerator, a person detection model based on the image data is invoked. The person detection model outputs first classification result. Based on the first classification result, a person is detected. Second image data is received from the camera. In response to detecting the person, a fall detection model is invoked on the hardware accelerator based on the second image data. The fall detection model outputs a second classification result. A potential fall based on the second classification result is detected. An alert is provided in response to detecting the potential fall.
Owner:MASIMO CORP

Three-dimensional target detection method based on multimodal fusion and depth attention mechanism

A 3D target detection method based on multimodal fusion and a depth attention mechanism includes the following steps: obtaining and preprocessing original point cloud data and original image data; inputting the preprocessed point cloud data and image data into a 3D target detection network based on multimodal fusion and the depth attention mechanism, where the 3D target detection network based on multimodal fusion and the depth attention mechanism includes a generation phase for 3D bounding box proposals and a refinement phase for 3D bounding boxes, and the network outputs parameters and classification confidence of a target bounding box; training the 3D target detection network based on multimodal fusion and the depth attention mechanism; and processing the collected lidar point cloud data and image data by using the trained detection network, and outputting 3D target information, to realize 3D target detection.
Owner:CHANGAN UNIV

Online adaptive multi-sensor fusion

This disclosure provides systems, methods, and devices that support image processing. In a first aspect, a method for multi-sensor fusion includes receiving first information indicative of a first set of BEV features of image data captured by an image sensor; receiving second information indicative of a second set of BEV features of non-image sensor data captured by a non-image sensor; and determining fused data that combines the image data and the non-image sensor data based on the first information, the second information, and third information indicative of differences between BEV features of training data and the first set of BEV features and the second set of BEV features. The BEV features of the training data include a third set of BEV features associated with the image sensor and a fourth set of BEV features associated with the non-image sensor. Other aspects and features are also claimed and described.
Owner:QUALCOMM INC

Ancient building risk prediction management and control method and system based on large model

The invention discloses an ancient building risk prediction management and control method and system based on a large model, and relates to the technical field of ancient building protection. An ancient building risk prediction management and control system based on a large model comprises a multi-source data acquisition module, a multi-modal data fusion module, a large model risk prediction module, a risk assessment and early warning module, a digital twinborn dynamic management and control module and a repair decision module. According to the method, the structure state data, the visual image data and the environment data are fused, so that the state of the historic building is comprehensively perceived; the self-supervised learning pre-trained ViT-GPT model is combined with the LSTM time sequence model, so that the time sequence analysis capability and the multi-modal data processing capability of risk prediction are remarkably improved, the future damage probability and the risk trend of the historic building can be accurately predicted, and the defects of the prior art in long-time span risk prediction are overcome.
Owner:PUTIAN UNIV

Small sample steel defect detection method based on attention feature pyramid mechanism

PCT designated stage expiredWO2025010883A1Image enhancementImage analysisEngineeringNetwork model
A small sample steel defect detection method based on an attention feature pyramid mechanism, comprising: first acquiring initial multi-scale feature maps by means of a convolutional neural network, then by means of a top-down and transverse connection mode, using an improved multi-scale attention network to process the initial multi-scale feature maps one by one to obtain intermediate multi-scale feature maps, then by means of a bottom-up and transverse connection mode, using the improved multi-scale attention network to process the intermediate multi-scale feature maps one by one to obtain final multi-scale feature maps, and finally outputting a final classification result; using a pseudo-label semi-supervised learning algorithm to train a detection network model, using a locally linear embedding algorithm to perform dimension reduction and visualization processing on high-level features of training output results, screening for mistakenly labeled and incorrectly labeled images and removing labels, then putting the images into unlabeled image data, and performing re-training to generate pseudo labels so as to expand a training set until the training requirement is met; and inputting an image to be detected into a trained detection network model for identification.
Owner:SHANGHAI NORMAL UNIVERSITY

Real scene three-dimensional modeling method and system fusing laser point cloud and image

The invention provides a real scene three-dimensional modeling method and system fusing laser point cloud and images, and belongs to the technical field of urban three-dimensional modeling. According to the method, laser point cloud data and multi-view image data of a target scene are acquired through a synchronous acquisition device, and joint calibration is performed on a laser radar and a camera to generate space-time synchronization parameters. And a dynamic weight registration algorithm is utilized to dynamically adjust the registration weight according to the point cloud density distribution and the image texture complexity so as to realize the multi-level registration of the laser point cloud and the image data. The registered data is used for constructing a three-dimensional geometric model and generating a seamless texture map, meanwhile, semantic-driven hole repairing is carried out on a model missing area, and finally a complete three-dimensional model is output. According to the real-scene three-dimensional modeling method and system fusing the laser point cloud and the image, the limitation of single data source modeling is solved, and real-scene three-dimensional modeling with high precision, high integrity and real-time updating is realized.
Owner:CHINA JK INST OF ENG INVESTIGATION & DESIGN

Dam safety monitoring system and method based on digital twinning

The invention discloses a dam safety monitoring system and method based on digital twinning, and belongs to the technical field of data processing, and the method comprises the steps: collecting dam surface acoustic emission signals and internal infrared thermal image data in real time through a multi-source sensor, and generating a multi-dimensional damage feature matrix; constructing a disaster node topology network in combination with density peak clustering and dynamic weight; on the basis of gravitational field intensity calculation and improved Monte Carlo simulation, a damage chain reaction path is accurately predicted; generating a dynamic risk thermodynamic diagram through space-time folding mapping and a bidirectional diffraction equation; and extracting hidden danger indexes by adopting multi-axis domain characteristic distillation, dynamically comparing a safety envelope function, and generating a flood discharge scheduling and reinforcing scheme on line. According to the method, cross-modal fusion, a gravitational field dynamic topology network and a time-space folding mapping technology are adopted, deep fusion of accurate simulation of a damage energy conduction path, carbonization-deformation bidirectional coupling prediction and intelligent risk hidden danger disposal decision can be realized, and the accuracy and initiative of dam safety early warning are improved.
Owner:JIANGXI ACAD OF WATER RESOURCES (JIANGXI PROVINCE DAM SAFETY MANAGEMENT CENT JIANGXI PROVINCE WATER RESOURCES MANAGEMENT CENT)

Three-dimensional reconstruction method integrating laser radar and oblique photography

PCT designated stage expiredWO2025036361A1Image enhancementImage analysisPoint cloudImage resolution
The present invention provides a three-dimensional reconstruction method integrating a laser radar and oblique photography, comprising: S1, acquiring an oblique image and image data and preprocessing same to obtain a first oblique image, wherein the image data comprises POS data; S2, acquiring coordinates of a ground control point and high-precision POS data; S3, correcting the oblique image to obtain a second oblique image; S4, performing aerotriangulation on the second oblique image, and obtaining an effective matching point pair by means of improved SIFT; S5, performing combined adjustment on the basis of the effective matching point pair and performing dense matching to obtain a dense point cloud; S6, acquiring a laser point cloud and preprocessing same; S7, unifying the coordinates of the laser point cloud and the dense point cloud, and using improved ICP to obtain a fused point cloud; and S8, constructing a triangulated irregular network and performing texture mapping to generate a three-dimensional model. In the present invention, on the basis of the advantages of high resolution and strong anti-interference capability of a laser radar, defects in an oblique photography three-dimensional model are mitigated, and meanwhile, an oblique image is corrected and an algorithm used in feature matching is improved, thereby improving the precision, integrity and efficiency of the three-dimensional model.
Owner:BEIJING DATA INTELLIGENCE INFORMATION TECH CO LTD

Land change detection method combining matrix decomposition and adaptive propagation, and system

The present invention belongs to the technical field of land change detection. Disclosed are a land change detection method combining matrix decomposition and adaptive propagation, and a system. A deep learning semantic segmentation model combining matrix decomposition and adaptive propagation is used for detecting a land change. The model is of a twin double-branch structure, which can receive both an input of a pre-temporal remote sensing image data set and an input of a post-temporal remote sensing image data set and can share network parameters, and which has the advantage of end-to-end feature learning. In the present invention, an attention method based on matrix decomposition is used to replace a conventional attention method based on manual design; moreover, in view of adaptive propagation technology for pixel offsets of neighboring points, a deep learning twin differential semantic segmentation network is established to realize automatic and precise land utilization / land coverage change detection on the basis of high-resolution optical data.
Owner:YANGTZE DELTA REGION INST OF UNIV OF ELECTRONIC SCI & TECH OF CHINA HUZHOU

Multisource remote sensing image semantic segmentation method based on Transform, Mama and diffusion model

The invention discloses a multi-source remote sensing image semantic segmentation method based on Transform, Mama and a diffusion model, belongs to the technical field of electric digital data processing, graphic data reading and image data processing, and is used for extracting image information of a remote sensing image. Comprising the following steps: acquiring remote sensing images, constructing an image information extraction network based on the remote sensing images, and respectively inputting the remote sensing images in a training set, a verification set and a test set into the constructed remote sensing image information extraction network based on Transform, Mama and diffusion models. According to the method, the RGB features and the depth features are subjected to Transform feature extraction, and a cross Mama method is provided to perform cross enhancement on the RGB features and the depth features; according to the method, a row and column pooling Transform module is used for replacing a traditional Transform module, and detail texture information and large-scale structure information of a feature map in the vertical direction and the horizontal direction are extracted at the same time; according to the invention, a cross Mama attention feature fusion module is used to replace a traditional Mama module, and the modeling capability for complex scenes and diversified targets is enhanced.
Owner:CHINA UNIV OF PETROLEUM (EAST CHINA)

Natural environment bird monitoring method based on multi-modal fusion deep learning and computer device

The invention relates to the field of bird monitoring, in particular to a natural environment bird monitoring method based on multi-modal fusion deep learning and a computer device. The scheme comprises the following steps: establishing a multi-modal bird data set; labeling the multi-modal bird data set; carrying out preprocessing on the marked data; the method comprises the following steps of: constructing a multi-modal trans-attention Transform network model; the method comprises the following steps of: training and optimizing a multi-modal trans-attention Transform network model; sound and image data in the multi-mode bird data set are subjected to conjoint analysis, a YOLOv8 target detection model is used, marked image data are trained, and rapid detection of a bird target is achieved; in combination with a DeepSORT tracking algorithm, the detected target is tracked, and the motion trail of the birds is obtained; and performing space-time synchronization on the sound source positioning information and the visual tracking result, and verifying the identity and the position of the bird. The bird monitoring device is suitable for monitoring birds in the natural environment.
Owner:SICHUAN AGRI UNIV

Systems and methods for automated data processing using machine learning for vehicle loss detection

A data processing system comprising: inputting a tiled image of a vehicle including four different angle views of the vehicle combined into a single image to a first machine learning model (e.g. CNN), the model trained based on historical image data to predict a first likelihood of total loss vehicle; inputting a multi-fusion of images each into a second set of machine learning models; the multi-fusion of images including a set of separate and distinct images for each of the views input separately into the second set of machine learning models, and extracting features to predict a second likelihood of total loss vehicle; inputting tabular data relating to the vehicle into a third machine learning model to predict a third likelihood of total loss vehicle for the vehicle; and aggregating the first, second and third likelihood of total loss vehicle to determine the overall likelihood of total loss.
Owner:THE TORONTO DOMINION BANK

Multi-modal sensing humanoid robot action self-adaptive control method and multi-modal sensing humanoid robot action self-adaptive control system

The invention discloses a multi-modal perception humanoid robot action adaptive control method and system, and belongs to the technical field of computers, and the method comprises the steps: obtaining first multi-modal data; the first multi-modal data comprises first image data, first point cloud data and first force sense data; performing data fusion on the first image data and the first point cloud data, and constructing a three-dimensional model of the scene in real time; generating an optimal path according to the real-time environment data of the three-dimensional model, converting the optimal path into a joint instruction of the humanoid robot, and generating an action control strategy; according to the action control strategy, arm movement of the robot is adjusted through visual servo control, and first operation data are obtained; the path and action of the robot are adjusted in a closed-loop control mode, and second operation data are obtained; and reinforcement learning and regular evaluation are carried out through a DDPG algorithm, and an action control strategy is continuously optimized. According to the invention, multi-modal sensing robot motion adaptive control with strong adaptive capability, high operation precision and good robustness can be realized.
Owner:广州里工实业有限公司

Decision-making method and system for multi-source information fusion

The invention relates to the technical field of data processing, in particular to a decision-making method and system for multi-source information fusion. The method comprises the following steps: obtaining hyperspectral image data, visible light image data and infrared image data collected by an unmanned aerial vehicle, and collecting ground environment monitoring data collected by a ground sensor; the hyperspectral image data, the visible light image data and the infrared image data are subjected to image preprocessing, so that a standardized multispectral data set is obtained, and image preprocessing comprises geometric correction, radiation correction and atmospheric correction; and color and texture feature extraction is carried out on the visible light image in the multispectral data set, and appearance feature and growth density identification of crops is carried out so as to obtain morphological feature data. Through integrated analysis of multi-source data, abnormal growth of crops and potential pest and disease damage risks can be identified more accurately, so that engineers are assisted to make irrigation and fertilization decisions.
Owner:FARMLAND IRRIGATION RES INST CHINESE ACAD OF AGRI SCI

Image segmentation system via graph or multiscale cascaded attention decoding

An exemplary image segmentation method and system that employs, in a deep neural network, (i) an attention gate that fuses features with skip connections and (ii) a graph or multi-scale convolutional attention module that enhances the long-range and local context. The segmented region or image data derived in part from the segmented region can be subsequently employed for diagnosis, controls, planning, assessment, or analysis of various diseases. The image data can be medical images (e.g., from medical instruments), sensor images or videos (e.g., from smart phones, cameras, satellites, etc.), as well as 3D objects or volume.
Owner:BOARD OF RGT THE UNIV OF TEXAS SYST

Skeleton detection and fall detection method based on improved spatio-temporal adaptive graph convolution

Disclosed in the present application is a skeleton detection and fall detection method based on improved spatio-temporal adaptive graph convolution. The method comprises the steps of: S1, collecting image data to acquire data of each image frame; S2: using a pre-trained yolov5 target person detection model to detect whether a target person is present in the data of each image frame, and if a target person is present, turning to step S3, and if no target person is present, ending the process; S3: for each detected target person, using a Deepsort target tracking algorithm to perform target tracking to obtain a tracking result, calculating the similarity to obtain the result of target association, and updating trajectory information of each target person; and S4: performing pose recognition on each target person on the basis of the trajectory information, using a spatio-temporal adaptive graph convolutional network to extract a feature vector of a pose, and using a classifier to perform human body behavior classification and recognition, in order to determine whether the target person has experienced a fall incident. The method achieves higher accuracy and robustness.
Owner:NANJING HOWSO TECH

Defect detection method for high-voltage equipment based on deep learning and multispectral image fusion

The invention relates to a high-voltage equipment defect detection method based on deep learning and multispectral image fusion, and relates to the technical field of electric power high-voltage equipment state detection. The method comprises the following steps: acquiring an ultraviolet image, an infrared image and a visible light image of the surface of the high-voltage equipment; carrying out image pixel feature-based fusion processing on the ultraviolet image, the infrared image and the visible light image through an image fusion method; establishing a high-voltage equipment defect detection model, and training the high-voltage equipment defect detection model by using the fused image data to obtain a high-voltage equipment defect identification model based on the YOLO-STrans multispectral fusion network; and inputting the ultraviolet image, the infrared image and the visible light image of the outer surface of the power high-voltage equipment into a high-voltage equipment defect identification model to obtain a fault identification result of the to-be-detected power high-voltage equipment. The method can improve the recognition precision of the extremely early insulation degradation and temperature anomaly defects of the surface of the high-voltage power equipment.
Owner:ANHUI NANRUI JIYUAN POWER GRID TECH CO LTD

Surveying and mapping area situation deduction method and system under multi-objective optimization

The invention provides a surveying and mapping area situation deduction method and system under multi-objective optimization, and relates to the technical field of surveying and mapping, and the method comprises the steps: obtaining the multi-source heterogeneous geographic information data of a surveying and mapping area, carrying out the feature extraction and semantic segmentation of the multi-source heterogeneous geographic information data through a deep learning algorithm, and obtaining the posture of the surveying and mapping area; generating a three-dimensional geographic scene model of the surveying and mapping area; constructing a multi-objective optimization model of surveying and mapping area situation deduction, and determining an optimal surveying and mapping equipment layout scheme set of the surveying and mapping area based on a simulation optimization algorithm; obtaining an optimal surveying and mapping equipment layout scheme based on each scheme in the optimal surveying and mapping equipment layout scheme set; in a three-dimensional geographic scene model, simulating a surveying and mapping operation process under the optimal surveying and mapping equipment layout scheme to obtain current three-dimensional situation information of a surveying and mapping area; and fusing the multi-temporal remote sensing image data and the geographic national condition census data, and predicting three-dimensional situation evolution information of the surveying and mapping area in different time periods in the future based on the current three-dimensional situation information.
Owner:BEIJING GENGTU TECH CO LTD

Railway anomaly detection method and system based on multi-modal data fusion

PCT designated stage expiredWO2025092018A1Image enhancementImage analysisFeature vectorPoint cloud
The present invention relates to a railway anomaly detection method and system based on multi-modal data fusion. The method comprises: separately encoding acquired modal data in a railway environment, and concatenating encoded modal data features, wherein the modal data comprises a one-dimensional vibration signal, two-dimensional image data, and 3D point cloud information; performing automatic weight classification on the concatenated multi-modal data features on the basis of an attention mechanism to obtain a weighted feature vector fused with multi-modal information; and adding a location code to the feature vector and using same as an input of an SAM encoder to obtain a segmentation result, and determining an anomaly condition of a railway on the basis of the segmentation result. The present invention achieves high monitoring accuracy, a real-time response capability, and specificity.
Owner:CRSC COMM & INFORMATION GRP CO LTD

Artificial intelligence-based crop yield prediction method and system

The invention provides a crop yield prediction method and system based on artificial intelligence, and relates to the technical field of artificial intelligence, and the method comprises the steps: obtaining continuous historical meteorological data, soil data, crop planting data and remote sensing image data of a designated region for many years, and carrying out the alignment according to a time sequence, and constructing a multi-dimensional spatio-temporal data cube; a fusion prediction model is trained, the fusion prediction model is used for extracting growth feature vectors in the crop growth and development process and carrying out yield prediction, and model parameters of the fusion prediction model are dynamically adjusted through an adaptive learning rate optimization algorithm; the method comprises the following steps: acquiring real-time meteorological data, soil data and remote sensing image data of a specified area, inputting the data into a pre-constructed fusion prediction model, introducing an agricultural knowledge graph into the fusion prediction model to restrain and correct a prediction result of the fusion prediction model, and reasoning to obtain crop growth and estimated yield of each grid of the specified area. And performing spatial interpolation on the estimated yield of each grid to generate a yield distribution diagram of the specified area.
Owner:KEXIN (TIANJIN) ECOLOGICAL AGRI TECH CO LTD

Scene understanding using language models for robotics systems and applications

In various examples, 3D object knowledge can be developed to extract diverse knowledge from large language models, and a part-grounding model can be trained to ground part semantics in terms of local shape features and spatial relations between parts. For example, knowledge that “the opening part of a mug that affords the pouring action is located on the top of the mug body and is often circular” can be grounded by identifying a previously unknown “opening” part based on its spatial relation to the known “body” part and its circular shape. A robotic system, for example, may use a model to identify an unlabeled part of a 3D object in imaging data. The model may be generated using natural language descriptions of relationships between parts of 3D objects, with descriptions generated using a language model that produces text in response to queries related to spatial relationships between the parts.
Owner:NVIDIA CORP

LED display defect prediction and process adjustment method and system based on multi-modal fusion

The invention relates to the technical field of LED display, solves the problem that the existing LED display defect detection and parameter adjustment technology is lack of multi-modal information fusion and intelligent process control capability and is difficult to meet the quality control requirement of a high-precision display product, and provides an LED display defect prediction and process adjustment method and system based on multi-modal fusion. The method comprises the following steps: performing multi-modal data fusion processing on optical image data, electrical test data and thermal infrared imaging data corresponding to a to-be-tested LED display screen to obtain fused data; inputting the fused data into a pre-trained defect recognition model to obtain a defect recognition result; according to a process parameter adjustment strategy corresponding to the defect identification result, adjusting the original process parameter to obtain a target process parameter; and according to the target process parameters, process flow correction processing is carried out, and a qualified LED display screen is produced. According to the method, the defect identification precision is improved, and the quality control requirement of high-precision LED display screen production is met.
Owner:XIAMEN PROD QUALITY SUPERVISION & INSPECTION INST +1

Systems and methods for automated data processing using machine learning for vehicle loss detection

A data processing system comprising: inputting a tiled image of a vehicle including four different angle views of the vehicle combined into a single image to a first machine learning model (e.g. CNN), the model trained based on historical image data to predict a first likelihood of total loss vehicle; inputting a multi-fusion of images each into a second set of machine learning models; the multi-fusion of images including a set of separate and distinct images for each of the views input separately into the second set of machine learning models, and extracting features to predict a second likelihood of total loss vehicle; inputting tabular data relating to the vehicle into a third machine learning model to predict a third likelihood of total loss vehicle for the vehicle; and aggregating the first, second and third likelihood of total loss vehicle to determine the overall likelihood of total loss.
Owner:THE TORONTO DOMINION BANK

Agricultural Vehicles Including an Imaging Controller, and Related Methods

An agricultural vehicle includes cameras and radars operably coupled to the agricultural vehicle, and an imaging controller operably coupled to the radars and the cameras. The imaging controller includes at least one processor, and instructions that cause the processor to receive image data from the cameras, receive radar data from the radars, combine the image data from a first camera with the image data from a second camera having a different field of view than the first camera to generate combined image data, and fuse the combined image data with the radar data to generate fused data. Related agricultural vehicles and methods are also disclosed.
Owner:AGCO INT GMBH +1

Visual identification method and device based on computer processing

The invention provides a visual identification method and device based on computer processing, and the method comprises the steps: S1, collecting image data based on a wafer generation line, carrying out the preprocessing and label judgment of the collected image data, and obtaining a wafer defect detection data set; s2, aiming at the wafer defect detection data set obtained in S1, constructing a feature extraction and feature enhancement network to obtain a multi-level feature map; s3, designing a wafer defect detection model based on the multi-level feature map obtained in the S2, thereby obtaining a semiconductor wafer defect detection model; s4, based on the semiconductor wafer defect detection model obtained in S3, constructing a training strategy combined with antagonism collaborative learning, and training to obtain a final wafer defect detection model; and S5, model deployment: deploying the wafer defect detection model obtained in the step S4 to a production process equipment vision module, and detecting and feeding back defect problems in real time. The method has the following beneficial effects that the detection accuracy and robustness are remarkably improved while the precision is maintained.
Owner:JINGDEZHEN UNIV

Unmanned aerial vehicle power inspection autonomous flight obstacle avoidance method and device based on laser radar, and storage medium

The invention discloses an obstacle avoidance method and device for unmanned aerial vehicle power inspection autonomous flight based on a laser radar and a storage medium, and relates to the technical field of unmanned aerial vehicle obstacle avoidance, and the method comprises the steps: configuring the laser radar and a visual sensor on an unmanned aerial vehicle, and collecting the three-dimensional point cloud data and image data of a flight environment in real time; optimizing the point cloud data to generate a three-dimensional environment model; and based on the three-dimensional environment model, classifying the obstacles into static obstacles and dynamic obstacles, if the obstacles are static obstacles, identifying the types of the obstacles through a CNN model and performing positioning, and if the obstacles are dynamic obstacles, clustering motion tracks through a K-Medoids clustering method. According to the invention, static obstacles can be identified and positioned, and motion trail prediction can be carried out on dynamic obstacles such as flying birds through a dynamic obstacle prediction technology, so that a preliminary flight path is generated, surrounding obstacles are sensed and avoided in real time in the flight process, and it is ensured that the unmanned aerial vehicle can be smoothly executed in an electric power inspection task.
Owner:国网四川省电力公司电力应急中心

House leakage identification method and system based on hyperspectrum and imaging technology

The invention relates to the technical field of leakage identification, and discloses a house leakage identification method and system based on a hyperspectral and imaging technology, which are used for realizing effective fusion of hyperspectral, thermal infrared and visible light multi-source data so as to remarkably improve the accuracy and quantitative evaluation capability of house leakage detection. The method comprises the following steps: carrying out spectrum correction processing on hyperspectral image data to obtain a reflectivity data cube and carrying out spectral index calculation to obtain a moisture related index set, carrying out smooth filtering processing on each pixel in the reflectivity data cube to obtain a noise reduction spectrum curve and carrying out spectral derivative feature extraction to obtain spectral derivative features; and carrying out multi-source data fusion on the moisture related index set, the spectral derivative features, the thermal infrared image and the visible light image to obtain multi-feature image data, carrying out multi-scale segmentation to obtain a spatial distribution diagram, and carrying out temperature anomaly degree calculation and surface damage area measurement to obtain a leakage degree quantitative data set and a multi-dimensional risk assessment report.
Owner:SHENZHEN MINGCHEN LEAKAGE DETECTION INTELLIGENT TECH CO LTD

Historical block scene three-dimensional reconstruction method and system based on Gaussian sputtering

The invention discloses a historical block scene three-dimensional reconstruction method and system based on Gaussian sputtering, and the method comprises the steps: collecting a historical block video sequence through a lightweight panorama camera, extracting a multi-frame panorama, and generating an image data set through a projection converter; monocular depth and normal estimation is carried out through a pre-training visual model, and a prior depth and normal graph data set of a historical block scene is constructed; sparse reconstruction is carried out on the multi-view image data set based on the SfM technology, initial point cloud and camera pose information are acquired, and a Gaussian ellipsoid is optimized in combination with prior depth and normal information; dynamically calculating the geometric width estimation value of the street, and guiding and adjusting the adaptive density of the Gaussian ellipsoids of the vertical surfaces on the two sides; rendering the optimized Gaussian ellipsoid through an improved rasterization renderer; and designing a multi-modal loss function and a regularization mechanism to optimize reconstruction and rendering results. According to the method, high-fidelity three-dimensional reconstruction of the historical block scene is realized, and the adaptability of the Gaussian sputtering method to the complex block scene is enhanced.
Owner:BEIJING UNIV OF CIVIL ENG & ARCHITECTURE

Layered contrast anti-fact learning method and system oriented to visual question and answer model

The invention discloses a hierarchical contrast anti-fact learning method and system for a visual question and answer model. The method comprises the steps of obtaining original image data and question text data, constructing multi-modal joint tensor data, calculating probability distribution based on a projection matrix, screening samples and dynamically adjusting weights. Constructing a multi-modal graph structure, performing modal alignment based on the feature enhancement matrix, and executing dynamic feature fusion; establishing a multi-level probability knowledge structure, generating an anti-fact sample, and executing knowledge fusion operation; constructing a multi-level distance measurement system, executing adaptive weight optimization, and performing spectral clustering optimization and boundary adjustment; and constructing a multi-dimensional evaluation index system, executing stability analysis and dynamic performance tracking, and obtaining final performance evaluation index data. According to the method, the performance of the visual question and answer model is improved through a hierarchical comparison anti-fact learning framework, and optimization of feature representation, dynamic adjustment of a knowledge structure and accurate evaluation of the model performance are realized.
Owner:NANJING ARTIFICIAL INTELLIGENCE CHIPS RES INST OF AUTOMATION CHINESE ACAD OF SCI