50105 results about "Imaging data" patented technology

The invention provides a real scene three-dimensional modeling method and system fusing laser point cloud and images, and belongs to the technical field of urban three-dimensional modeling. According to the method, laser point cloud data and multi-view image data of a target scene are acquired through a synchronous acquisition device, and joint calibration is performed on a laser radar and a camera to generate space-time synchronization parameters. And a dynamic weight registration algorithm is utilized to dynamically adjust the registration weight according to the point cloud density distribution and the image texture complexity so as to realize the multi-level registration of the laser point cloud and the image data. The registered data is used for constructing a three-dimensional geometric model and generating a seamless texture map, meanwhile, semantic-driven hole repairing is carried out on a model missing area, and finally a complete three-dimensional model is output. According to the real-scene three-dimensional modeling method and system fusing the laser point cloud and the image, the limitation of single data source modeling is solved, and real-scene three-dimensional modeling with high precision, high integrity and real-time updating is realized.

The invention discloses a dam safety monitoring system and method based on digital twinning, and belongs to the technical field of data processing, and the method comprises the steps: collecting dam surface acoustic emission signals and internal infrared thermal image data in real time through a multi-source sensor, and generating a multi-dimensional damage feature matrix; constructing a disaster node topology network in combination with density peak clustering and dynamic weight; on the basis of gravitational field intensity calculation and improved Monte Carlo simulation, a damage chain reaction path is accurately predicted; generating a dynamic risk thermodynamic diagram through space-time folding mapping and a bidirectional diffraction equation; and extracting hidden danger indexes by adopting multi-axis domain characteristic distillation, dynamically comparing a safety envelope function, and generating a flood discharge scheduling and reinforcing scheme on line. According to the method, cross-modal fusion, a gravitational field dynamic topology network and a time-space folding mapping technology are adopted, deep fusion of accurate simulation of a damage energy conduction path, carbonization-deformation bidirectional coupling prediction and intelligent risk hidden danger disposal decision can be realized, and the accuracy and initiative of dam safety early warning are improved.

The present invention belongs to the technical field of land change detection. Disclosed are a land change detection method combining matrix decomposition and adaptive propagation, and a system. A deep learning semantic segmentation model combining matrix decomposition and adaptive propagation is used for detecting a land change. The model is of a twin double-branch structure, which can receive both an input of a pre-temporal remote sensing image data set and an input of a post-temporal remote sensing image data set and can share network parameters, and which has the advantage of end-to-end feature learning. In the present invention, an attention method based on matrix decomposition is used to replace a conventional attention method based on manual design; moreover, in view of adaptive propagation technology for pixel offsets of neighboring points, a deep learning twin differential semantic segmentation network is established to realize automatic and precise land utilization / land coverage change detection on the basis of high-resolution optical data.

An exemplary image segmentation method and system that employs, in a deep neural network, (i) an attention gate that fuses features with skip connections and (ii) a graph or multi-scale convolutional attention module that enhances the long-range and local context. The segmented region or image data derived in part from the segmented region can be subsequently employed for diagnosis, controls, planning, assessment, or analysis of various diseases. The image data can be medical images (e.g., from medical instruments), sensor images or videos (e.g., from smart phones, cameras, satellites, etc.), as well as 3D objects or volume.

Disclosed in the present application is a skeleton detection and fall detection method based on improved spatio-temporal adaptive graph convolution. The method comprises the steps of: S1, collecting image data to acquire data of each image frame; S2: using a pre-trained yolov5 target person detection model to detect whether a target person is present in the data of each image frame, and if a target person is present, turning to step S3, and if no target person is present, ending the process; S3: for each detected target person, using a Deepsort target tracking algorithm to perform target tracking to obtain a tracking result, calculating the similarity to obtain the result of target association, and updating trajectory information of each target person; and S4: performing pose recognition on each target person on the basis of the trajectory information, using a spatio-temporal adaptive graph convolutional network to extract a feature vector of a pose, and using a classifier to perform human body behavior classification and recognition, in order to determine whether the target person has experienced a fall incident. The method achieves higher accuracy and robustness.

The invention relates to a high-voltage equipment defect detection method based on deep learning and multispectral image fusion, and relates to the technical field of electric power high-voltage equipment state detection. The method comprises the following steps: acquiring an ultraviolet image, an infrared image and a visible light image of the surface of the high-voltage equipment; carrying out image pixel feature-based fusion processing on the ultraviolet image, the infrared image and the visible light image through an image fusion method; establishing a high-voltage equipment defect detection model, and training the high-voltage equipment defect detection model by using the fused image data to obtain a high-voltage equipment defect identification model based on the YOLO-STrans multispectral fusion network; and inputting the ultraviolet image, the infrared image and the visible light image of the outer surface of the power high-voltage equipment into a high-voltage equipment defect identification model to obtain a fault identification result of the to-be-detected power high-voltage equipment. The method can improve the recognition precision of the extremely early insulation degradation and temperature anomaly defects of the surface of the high-voltage power equipment.

The present invention relates to a railway anomaly detection method and system based on multi-modal data fusion. The method comprises: separately encoding acquired modal data in a railway environment, and concatenating encoded modal data features, wherein the modal data comprises a one-dimensional vibration signal, two-dimensional image data, and 3D point cloud information; performing automatic weight classification on the concatenated multi-modal data features on the basis of an attention mechanism to obtain a weighted feature vector fused with multi-modal information; and adding a location code to the feature vector and using same as an input of an SAM encoder to obtain a segmentation result, and determining an anomaly condition of a railway on the basis of the segmentation result. The present invention achieves high monitoring accuracy, a real-time response capability, and specificity.

The invention relates to the technical field of LED display, solves the problem that the existing LED display defect detection and parameter adjustment technology is lack of multi-modal information fusion and intelligent process control capability and is difficult to meet the quality control requirement of a high-precision display product, and provides an LED display defect prediction and process adjustment method and system based on multi-modal fusion. The method comprises the following steps: performing multi-modal data fusion processing on optical image data, electrical test data and thermal infrared imaging data corresponding to a to-be-tested LED display screen to obtain fused data; inputting the fused data into a pre-trained defect recognition model to obtain a defect recognition result; according to a process parameter adjustment strategy corresponding to the defect identification result, adjusting the original process parameter to obtain a target process parameter; and according to the target process parameters, process flow correction processing is carried out, and a qualified LED display screen is produced. According to the method, the defect identification precision is improved, and the quality control requirement of high-precision LED display screen production is met.

A data processing system comprising: inputting a tiled image of a vehicle including four different angle views of the vehicle combined into a single image to a first machine learning model (e.g. CNN), the model trained based on historical image data to predict a first likelihood of total loss vehicle; inputting a multi-fusion of images each into a second set of machine learning models; the multi-fusion of images including a set of separate and distinct images for each of the views input separately into the second set of machine learning models, and extracting features to predict a second likelihood of total loss vehicle; inputting tabular data relating to the vehicle into a third machine learning model to predict a third likelihood of total loss vehicle for the vehicle; and aggregating the first, second and third likelihood of total loss vehicle to determine the overall likelihood of total loss.

An agricultural vehicle includes cameras and radars operably coupled to the agricultural vehicle, and an imaging controller operably coupled to the radars and the cameras. The imaging controller includes at least one processor, and instructions that cause the processor to receive image data from the cameras, receive radar data from the radars, combine the image data from a first camera with the image data from a second camera having a different field of view than the first camera to generate combined image data, and fuse the combined image data with the radar data to generate fused data. Related agricultural vehicles and methods are also disclosed.

The invention discloses a historical block scene three-dimensional reconstruction method and system based on Gaussian sputtering, and the method comprises the steps: collecting a historical block video sequence through a lightweight panorama camera, extracting a multi-frame panorama, and generating an image data set through a projection converter; monocular depth and normal estimation is carried out through a pre-training visual model, and a prior depth and normal graph data set of a historical block scene is constructed; sparse reconstruction is carried out on the multi-view image data set based on the SfM technology, initial point cloud and camera pose information are acquired, and a Gaussian ellipsoid is optimized in combination with prior depth and normal information; dynamically calculating the geometric width estimation value of the street, and guiding and adjusting the adaptive density of the Gaussian ellipsoids of the vertical surfaces on the two sides; rendering the optimized Gaussian ellipsoid through an improved rasterization renderer; and designing a multi-modal loss function and a regularization mechanism to optimize reconstruction and rendering results. According to the method, high-fidelity three-dimensional reconstruction of the historical block scene is realized, and the adaptability of the Gaussian sputtering method to the complex block scene is enhanced.

An example assistant system can use a multimodal multitask medical machine-learned model to perform image processing to answer natural language queries. A device can process speech data or other natural language inputs to obtain a query. The query can be processed alongside image data that provides context for the query. The example system can receive a query associated with a particular task domain; generate, based on the query, a query input that comprises query instruction data from a first modality and query context data from a second modality; generate a combined input comprising the query input and an exemplar input, wherein the exemplar input comprises exemplar instruction data from the first modality and an exemplar context placeholder in lieu of exemplar context data from the second modality; process the combined input with a multimodal machine-learned model to generate output data; and output a query response based on the output data.

An agricultural vehicle includes cameras and a LIDAR sensor operably coupled to the agricultural vehicle, and an imaging controller operably coupled to the LiDAR sensor and the cameras. The imaging controller includes at least one processor, and instructions that cause the processor to receive image data from the cameras, receive LiDAR data from the LiDAR sensor, analyze the image data from each of the cameras to generate labeled image data, analyze the LIDAR data to generate labeled LiDAR data, and fuse the labeled image data with the labeled LIDAR data. Related agricultural vehicles and methods are also disclosed.

The invention relates to the technical field of PCB detection, and discloses a PCB defect detection method and system, and the method comprises the steps: collecting multispectral imaging data through an image collection module, and generating an original image data set; the defect analysis server receives the synchronous imaging data to construct a three-dimensional surface topology matrix; in combination with the original image data set and the real-time imaging data, performing multi-scale decomposition on the three-dimensional surface topological matrix, extracting texture features, positioning a defect region, outputting defect type space distribution features through a layered recognition model, and updating the original image data set; and dynamically calibrating the detection parameters according to the feature categories. The system comprises an image acquisition module group, a data transmission module, a three-dimensional modeling module, a defect identification module and a parameter calibration module. According to the scheme, the accuracy, comprehensiveness and efficiency of defect detection are improved, and the detection requirements of modern PCB production are met.

An agricultural vehicle may include a propulsion system, a steering system, and a vehicle controller. An agricultural vehicle may include a camera sensor having a camera field of view (CFOV), a light detection and ranging (LiDAR) sensor having a LiDAR field of view (LFOV), and an imaging controller in operable communication with the camera sensor and the LiDAR sensor. The imaging controller may include a processor and at least one non-transitory computer-readable storage medium having instructions store thereon that, when executed by the at least one processor cause the imaging controller to, at least, receive image data, segment the image data, fuse LiDAR data and the image data, create a fused instance including depth information; and provide at least the fused instance to the vehicle controller, wherein the vehicle controller is configured to provide at least one navigational command based at least partially on the fused instance.

The invention discloses a multi-modal medical image data intelligent processing system, relates to the field of medical image analysis, and is applied to multi-modal medical image whole-process analysis of CT, MRI, PET, ultrasound and the like. According to the system, different modal image features are extracted and fused through a cross-modal manifold fusion network; a semantic guidance dynamic registration engine optimizes registration parameters to ensure that the registration error is less than or equal to 1.5 mm; the multi-task collaborative diagnosis network realizes multiple tasks such as disease classification; the clinical knowledge embedding and interpretable module generates a structured report and is in butt joint with an HIS system. Meanwhile, the model is optimized through a federated learning architecture, the adaptability of newly added data is improved by more than or equal to 20%, and intelligent processing and analysis of multi-modal medical images are realized.

The invention relates to a brilliance large-scale model culture knowledge generation and retrieval method combined with a knowledge graph. The method comprises the steps that entity extraction, relation modeling and dynamic completion processing are carried out according to multi-modal culture data, a culture knowledge graph is constructed in combination with a fuzzy time reasoning algorithm and a cross-modal alignment mechanism, and the multi-modal culture data comprises an unstructured culture text, image data and space-time metadata; the space-time metadata comprises text space-time metadata and image moment metadata; performing semantic alignment processing by combining a large model through a user query statement and a culture knowledge graph to obtain joint representation of cross-modal semantic alignment; and performing multi-modal retrieval-generation joint optimization based on the joint representation to obtain cultural knowledge description and associated multi-modal content. According to the method, through multi-modal data fusion, dynamic knowledge completion and fuzzy time reasoning, culture knowledge description can be accurately generated, associated multi-modal content can be retrieved, and the accuracy and the intelligent level of culture knowledge service are improved.

The invention belongs to the technical field of water conservancy and hydropower engineering, and discloses a water conservancy and hydropower engineering construction safety supervision system based on multi-source data fusion. The system comprises a multi-source sensing acquisition module, a heterogeneous data fusion processing module, a risk identification and early warning module, a safety behavior evaluation and feedback module, and a command scheduling and visualization module. According to the invention, by fusing multi-dimensional data such as image monitoring, environment sensing, personnel positioning, equipment state and the like, a space-air-ground three-dimensional sensing network is constructed, and in a high slope area, the distributed optical fiber strain sensors are linked with thermal imaging data of the unmanned aerial vehicle, so that millimeter-level deformation and temperature field abnormity can be captured in real time; a video stream is analyzed in real time by means of a YOLOv8 algorithm, illegal operation behaviors of personnel can be accurately identified, a cross-modal fusion model of a Transform architecture is combined, the system can dynamically capture potential correlation among data, and millisecond-level response to risks such as side slope landslide, equipment faults and personnel dangerous operation is achieved.

Systems and methods are disclosed for classifying objects using electro-optical and synthetic aperture radar images through multi-modal feature alignment and fusion. A computing system acquires and preprocesses image data, then aligns features across modalities using a multi-modal alignment engine. A cross-modal attention fusion network extracts and integrates complementary information using transformer-based attention mechanisms. A modality-specific feature extraction framework processes EO and SAR images through specialized branches, ensuring optimal feature representation. An adaptive fusion decision system dynamically determines the best fusion strategy based on image quality and confidence scores. A self-supervised consistency controller enforces alignment between EO and SAR features using contrastive learning. The fused representations are processed by a neural network to generate object classifications. This system improves accuracy and robustness in environments where one modality may be degraded or missing, enhancing applications such as remote sensing, surveillance, and autonomous navigation.

In a measurement processing apparatus for measuring a geometric feature of an object image: a measurement-reference-element setting unit automatically sets at least one first measurement reference element for use in measurement of the geometric feature of the object image, at at least one first position on the object image based on first image data representing the object image and position information indicating at least one second position of at least one second measurement reference element which is set on a measurement reference image corresponding to the object image; and a geometric-feature measurement unit measures the geometric feature of the object image based on the at least one first position of the at least one first measurement reference element.

The invention discloses a multi-modal knowledge graph rule reasoning method and device based on a large model, and the method comprises the steps: carrying out the feature extraction and cross-modal alignment of input text data and image data, and generating a multi-modal feature vector of a unified semantic space; performing knowledge graph storage on the emotion entities and the relationships by adopting an attribute graph model to complete construction of an emotion knowledge graph; generating an interpretable inference rule from the emotion knowledge graph by using a large language model, and eliminating a conflict rule in combination with logic verification; calculating the confidence coefficient of a reasoning path based on an attention mechanism, and carrying out quantitative evaluation on a rule reasoning result; the knowledge graph and the rule base are updated online according to user feedback, and the real-time performance and accuracy of the inference system are optimized through weight adjustment and a forgetting mechanism. According to the method, through innovative technologies such as multi-modal data integration, dynamic knowledge evolution and interpretability reasoning, the limitation of a traditional sentiment analysis method in the aspects of evidence dimension, adaptive capacity, interpretability and the like is broken through.

The invention discloses an electrical equipment fault diagnosis and prediction analysis system, which relates to the field of intelligent operation and maintenance of a power system and comprises an acquisition and preprocessing module, an extraction fusion module, a fault diagnosis modeling module, a prediction evaluation module and an update feedback module. According to the invention, through fusion of structured sensing data and unstructured image data, multi-modal depth feature joint representation is realized, and the accuracy and robustness of fault identification are significantly improved; a fusion time sequence prediction model is introduced, and a health degree scoring system is combined, so that accurate prediction of key parameter trends and quantitative estimation of the residual life of equipment are realized; a transfer learning and incremental learning mechanism is adopted, when a new fault or small sample data appears, model parameters can be quickly updated, and efficient adaptation to a new scene is achieved; a data alignment mechanism with time-space synchronization and an auto-encoder anomaly detection algorithm are constructed, and the multi-source heterogeneous data processing capacity and the real-time fault early warning capacity are remarkably improved.

Various embodiments of the present disclosure relate to operator assistance based on extracting natural language characters from one or more sensed objects. For instance, particular embodiments may generate a natural language utterance based on extracting natural language text in a nearby traffic sign. In an illustrative example, particular embodiments may detect, via object detection and within image data, one or more regions of the image data depicting the traffic sign. Particular embodiments can then extract one or more first natural language characters represented in the traffic sign based at least on performing optical character recognition within the one or more regions of the image data in response to detecting the one or more regions of the image data depicting the traffic sign.

The invention relates to the technical field of red tide anomaly detection, in particular to an ocean red tide anomaly detection method and system fusing multi-source remote sensing and a graph neural network. The method comprises the following steps: acquiring remote sensing image data, unmanned aerial vehicle image data and monitoring data of a monitoring point; performing data preprocessing on the acquired remote sensing image data and unmanned aerial vehicle image data; performing feature extraction and feature fusion on the remote sensing image and the unmanned aerial vehicle image to obtain remote sensing feature data; constructing a space-time diagram structure based on the monitoring data of the monitoring points to obtain diagram structure data; based on a cross-modal comparison self-supervised learning mechanism, carrying out consistency representation learning on a remote sensing feature mode and a graph structure feature mode; by introducing multi-source heterogeneous data and fusing a graph neural network modeling means, the limitation of a single data driving method in the aspects of coarse red tide recognition granularity, low space-time precision and the like is effectively broken through, and the meticulous property and global perception ability of red tide feature modeling are remarkably improved.

The invention discloses a rescue robot path planning method and system under industrial vision assistance, and relates to the field related to industrial vision, and the method comprises the steps: collecting three-dimensional space data of a rescue environment in real time, generating a dynamic environment point cloud data set, and constructing a three-dimensional semantic map of a rescue area; thermal imaging data updated in real time are called, path analysis is carried out in combination with the three-dimensional semantic map, and a path planning strategy set is obtained; and predicting the motion track of the dynamic obstacle based on the local dynamic obstacle avoidance strategy, optimizing the global path planning strategy according to obstacle prediction track data, and generating a motion control instruction of the rescue robot. The technical problem of poor real-time performance and adaptability of path planning caused by insufficient perception of environment dynamic information in path planning of an existing rescue robot is solved, the strong perception capability depending on industrial vision is achieved, the environment dynamic information is accurately captured in real time, and the real-time performance of path planning is improved. And the real-time response speed of path planning and the adaptability to a dynamic environment are improved.

The invention relates to the technical field of fault prediction, and provides a fault prediction method for a multi-modal cross-attention enhancement graph neural network, and the method comprises the steps: collecting the data of equipment; performing adaptive enhancement and normalization processing on the image data, performing sliding window segmentation, standardization and noise suppression on a time sequence numerical signal, and performing semantic vectorization coding on a maintenance log text; extracting low-dimensional spatial features of image data by using the pruned lightweight convolutional neural network, connecting time sequence features of modeling time sequence numerical signals in series, extracting context semantic expressions of maintenance log texts, integrating the features into multi-modal data, alternately taking each modal feature as Query and the other modal features as Key and Value, and obtaining multi-modal data; calculating attention weight and performing weighted fusion; constructing a modal node weighted graph, and performing inter-node feature propagation through a multi-layer graph attention network; and a residual service life regression prediction module and a degradation level classification module are deployed in parallel, and fault early warning is completed through multi-task joint optimization.

An example method can include providing a natural language instruction and user interface image data to a machine-learned sequence processing model that is configured to process image data and generate commands for controlling the target computing device, wherein the machine-learned sequence processing model has parameters learned using an interface recognition objective based on an evaluation of an interface recognition output generated based on processing a rendered training interface from a pre-training dataset and an interface navigation objective based on an evaluation of a user interface command generated based on processing a rendered training interface from a fine-tuning dataset; receiving, from the machine-learned sequence processing model, a command indicating an interaction with the user interface to implement the natural language instruction; and generating, based on the command, a control signal configured to initiate the interaction.

The invention provides a pressure-bearing equipment damage mode identification and risk assessment method and system, and relates to the technical field of safety engineering, and the method comprises the steps: collecting multi-source sensor data and image data, inputting the data into a deep neural network after preprocessing and feature extraction, extracting spatial features through a convolutional layer, and extracting time sequence features through a recurrent neural network. And using the attention mechanism to fuse the features to identify an injury pattern. And then, constructing a multi-level evaluation index system, performing combined weighting by adopting an analytic hierarchy process and an entropy weight method, inputting weights into an improved Bayesian network model based on a D-S evidence theory, dynamically updating a conditional probability table by the model by utilizing a deep neural network and a fuzzy inference rule, and finally obtaining a risk evaluation result. According to the invention, the damage mode of the pressure-bearing equipment can be effectively identified, risk assessment is carried out, and assessment precision and reliability are improved.

The invention discloses a data line surface defect rapid nondestructive detection method based on intelligent image recognition, relates to the technical field of image data processing, and aims to solve the technical problems of difficult defect feature separation and low detection accuracy under complex weaving texture noise interference, and the method comprises the following steps: S1, collecting a data line image and carrying out graying processing; s2, constructing a multi-scale image pyramid, accurately segmenting the image by adopting a self-adaptive threshold algorithm, and realizing rapid detection of surface defects of the data line in combination with Hough transform; s3, frequency domain separation of weaving texture and background noise is realized through Fourier transform, interference is filtered out in combination with a band-pass filtering technology, and then the defect contrast is enhanced through histogram equalization; according to the method, the three-layer Gaussian pyramid is constructed for multi-scale decomposition, and the band-pass filtering technology is combined, so that the weaving texture and the defect signal are effectively separated, the detection accuracy is greatly improved, and the problems of missing detection and misjudgment caused by frequency characteristic confusion are thoroughly solved.

The invention discloses an accounting data intelligent processing method and system for enterprise financial auditing, and relates to the technical field of accounting data intelligent processing, and the method comprises the steps: obtaining multi-mode enterprise financial data, and carrying out the preprocessing; carrying out multi-modal semantic understanding analysis on the unstructured text and image data; constructing an enterprise financial space-time knowledge graph containing time attributes; inputting into an anomaly analysis model, extracting spatial structure characteristics of the financial entity in the topological network, and extracting dynamic characteristics of the financial relationship evolved along with the time sequence; identifying an abnormal source, evaluating a systematic risk value and generating an abnormal propagation path; and integrating to generate a final audit report. According to the method, structured and bill images are fused, identifiers and time calibers are unified, abnormal source and propagation are positioned based on the space-time knowledge graph, closed-loop counter-knock and cross-period anomalies are identified, the auditing accuracy and coverage rate are remarkably improved, the workload of false report, missing report and manual recheck is reduced, and a traceable structured report is quickly generated.