51159 results about "Deep learning" patented technology

The invention relates to the technical field of intelligent operation and maintenance, and discloses an intelligent operation and maintenance method fusing multi-modal data and active learning, and the method comprises the steps: deploying a hierarchical Internet of Things equipment network in a target operation and maintenance region, collecting a heterogeneous operation and maintenance data set, and generating an operation and maintenance feature data set through employing a unified building operation and maintenance service framework cooperating with a plurality of MCPs; inputting the operation and maintenance feature data set and the user feedback information into a deep learning intention recognition model for intention recognition and demand analysis to obtain structured user demand data and an operation and maintenance task priority sequence; according to the operation and maintenance feature data set and the structured user demand data, performing real-time evaluation on the equipment operation state to obtain fault risk early warning data; autonomous decision analysis is carried out through an agent type artificial intelligence engine, an equipment maintenance scheme and a resource scheduling scheme are generated, and then the problems that in traditional operation and maintenance, fault prediction is single, the model adaptability is poor, and prediction results are difficult to convert into effective decisions are solved.

The invention relates to a dynamic data pipeline construction method based on artificial intelligence and multi-modal data processing, and belongs to the technical field of data fusion treatment and artificial intelligence. According to the method, a multi-modal deep learning model is adopted, semantic analysis is performed on business documents, user requirements and function specification instructions, and key indexes, data requirements and logic constraints are extracted; constructing a multi-modal knowledge graph, performing unified representation and feature extraction on structured and unstructured data resources, and performing embedded learning by using a graph neural network; based on a deep semantic matching model and a hybrid recommendation system, realizing accurate matching of business requirements and data resources; modeling generation of a data processing flow into a Markov decision process by adopting a reinforcement learning strategy, and automatically generating an optimized data processing workflow; the adaptability of the model to new business requirements is improved by utilizing a meta-learning algorithm; and dynamic scheduling and execution of tasks are realized through a workflow engine. According to the invention, the data processing efficiency can be improved.

The invention provides an industrial environment monitoring and accident prediction method fusing multi-modal data, and relates to the technical field of data processing, and the method comprises the steps: carrying out the semantic collection and causal association preprocessing of multi-modal heterogeneous data collected in real time through constructing a dynamic industrial knowledge graph; a customized deep learning model is adopted to extract deep abstract features of each mode, and weak signals and potential risks are accurately represented and uncertainty is quantified; a high-fidelity digital twin model is utilized to drive a deep reinforcement learning algorithm, and dynamic optimization and verification are performed to generate a multi-level and multi-target preventive intervention strategy combination; an intervention strategy is executed through an edge-end-cloud three-layer collaborative intelligent architecture, and online learning and system sustainable evolution are realized by using a closed-loop data feedback mechanism. According to the method, the sensing and early warning capability of the early weak and complex abnormal state of the industrial environment can be remarkably improved, the accident evolution path is accurately predicted, and credible explanation is provided.

The present disclosure generally relates to a two-stage system for detecting malicious nodes in Wireless Sensor Networks (WSNs), enhancing network security and resilience. The system employs a distributed approach, leveraging Cluster Heads (CHs) and a central server for efficient and accurate detection. Initially, sensor nodes are monitored for comprehensive node and network metrics, statistically ranked by significance in identifying malicious behavior. CHs perform a resource-aware first-stage detection based on their resource weight, filtering potential threats locally. Results are then aggregated at a server for a second-stage analysis using a hybrid Machine Learning (ML) and Deep Learning (DL) approach. This advanced analysis, combined with statistically relevant metrics, significantly improves detection accuracy. By integrating resource-conscious CH operation with powerful server-side ML / DL, this system offers a scalable, energy-efficient, and highly effective solution for securing WSNs against malicious node attacks, surpassing traditional detection methods in both speed and precision.

The invention relates to the technical field of equipment fault diagnosis, and discloses an equipment fault diagnosis and prediction method based on deep learning, and the method comprises the following steps: S1, collecting multi-modal data in real time through a plurality of sensors installed on equipment; s2, preprocessing the collected data; s3, constructing a hybrid deep learning model; s4, dynamic weighted fusion is performed on the features of different modal data by using an attention mechanism, and comprehensive feature representation is generated; s5, using the marked fault data and normal data to supervise and train the model; s6, inputting equipment operation data acquired in real time into the trained model, and judging the state of the equipment; and S7, generating a potential fault early warning signal based on a prediction result of the model. A piezoelectric vibration sensor and a thermal infrared imager are arranged on a motor bearing through vibration, temperature and sound sensors, vibration waveforms, thermal imaging slices and time-frequency diagrams are synchronously captured, and composite state characteristics such as mechanical wear and temperature anomaly of equipment are comprehensively reflected.

The invention discloses a territorial space planning environment influence monitoring method and device. The method comprises the following steps: collecting and preprocessing multi-source environment monitoring data; performing spatio-temporal feature extraction on the preprocessed multi-source environment monitoring data by using a self-supervised spatio-temporal diagram mask transfer attention network to obtain initial spatio-temporal features; performing fusion processing on the initial spatial-temporal characteristics based on a multi-mode diffusion converter to obtain fusion characteristics; calculating an environmental impact evaluation index based on the fusion feature; and based on a preset visualization template and an early warning rule, generating a dynamic monitoring result including a space-time evolution diagram, a trend analysis diagram and early warning information according to the environmental influence evaluation index. Through deep learning and multi-modal data fusion technologies, the precision and efficiency of environmental impact monitoring are improved, and accurate evaluation and timely early warning of environmental impact in the land space planning implementation process are realized.

The present invention belongs to the technical field of land change detection. Disclosed are a land change detection method combining matrix decomposition and adaptive propagation, and a system. A deep learning semantic segmentation model combining matrix decomposition and adaptive propagation is used for detecting a land change. The model is of a twin double-branch structure, which can receive both an input of a pre-temporal remote sensing image data set and an input of a post-temporal remote sensing image data set and can share network parameters, and which has the advantage of end-to-end feature learning. In the present invention, an attention method based on matrix decomposition is used to replace a conventional attention method based on manual design; moreover, in view of adaptive propagation technology for pixel offsets of neighboring points, a deep learning twin differential semantic segmentation network is established to realize automatic and precise land utilization / land coverage change detection on the basis of high-resolution optical data.

The invention discloses an underground pipe network leakage detection method fusing big data analysis and machine learning. The underground pipe network leakage detection method comprises the step of deploying an acoustic sensor, a pressure sensor and a flow sensor at preset positions of an underground pipe network. Performing noise reduction and standardization processing on the acquired operation data, extracting frequency domain, energy and time sequence characteristics of acoustic signals to generate acoustic characteristic vectors, and calculating initial space coordinates of a leakage position based on time difference of arrival of the acoustic signals and sensor arrangement; and generating a pressure feature vector, and analyzing the spatial-temporal correlation of the flow data to generate a flow feature vector. And fusing acoustic, pressure and flow feature vectors to form a multi-dimensional feature vector, inputting the multi-dimensional feature vector and the initial space coordinates into a pre-trained cascade deep learning model, and outputting the leakage probability and the leakage position of underground pipe network leakage. And when the leakage probability exceeds a preset threshold value, triggering an alarm mechanism. According to the invention, efficient detection and accurate positioning of underground pipe network leakage are realized, and high real-time performance and positioning accuracy are achieved.

An AI-based Cybersecurity System and Method enable real-time detection, analysis, and mitigation of cyber threats within computing networks using adaptive artificial intelligence. The system continuously monitors network traffic, extracts behavioral and contextual attributes, and applies deep learning-based inference to identify anomalous activities indicating security breaches. The method integrates several computational units, including a network monitoring unit, feature extraction unit, artificial intelligence processor, contextual reasoning processor, and decision synthesis unit, to compute a composite risk index quantifying threat likelihood and severity. A classification processor categorizes detected threats into types such as ransomware, phishing, or unauthorized access, while a mitigation control processor initiates automated response actions to isolate compromised nodes and restore network integrity. An adaptive learning processor updates AI models using feedback from confirmed incidents. This provides a scalable, self-evolving cybersecurity framework that minimizes human intervention and enhances resilience against dynamic and zero-day threats.

The invention relates to the technical field of deep learning algorithms, and provides an electromechanical system fault diagnosis system based on deep learning, and the system is characterized in that a data collection and preprocessing module collects the operation data of an electromechanical system in real time, and carries out the dynamic window length setting, cleaning, noise reduction and standardization processing on the operation data; the interpretable deep learning diagnosis module carries out feature screening and decoupling learning by means of causal gating and a double-branch network, extracts fault related features and generates a diagnosis result containing a causal path and an abnormal prompt, and the physical constraint fusion module obtains physical principle data of the electromechanical system and parameter data of the electromechanical system in normal work. Carrying out physical constraint on the interpretable deep learning diagnosis module through an electromechanical system physical principle; according to the method, causal feature screening, dynamic causal mask generation and path extraction, multi-physical field law modeling and physical constraint injection are fused, and time sequence instantaneous causal analysis is combined, so that causal dominant expression and physical logic consistency guarantee of fault diagnosis is realized.

The invention relates to the technical field of deep learning, and discloses an MES digital collaborative management method and system based on deep learning, and the method comprises the steps: collecting multi-source heterogeneous data, and constructing a dimensionless multi-dimensional data set; analyzing a dynamic association relationship among the data items through node feature embedding and edge relationship learning, and generating a production line operation dependency relationship graph; performing collaborative anomaly detection and root cause positioning in combination with the dynamic association weight between the data items to obtain causal association data between the abnormal event and the data parameters; constructing a digital twinborn simulation environment to simulate an influence path of heterogeneous data parameter intervention production disturbance on collaborative anomaly so as to evaluate an anomaly influence result; constructing an iterative scheduling model according to a deep learning framework, and iteratively generating a multi-objective optimized collaborative scheduling strategy to realize dynamic configuration and exception prevention among heterogeneous data; therefore, collaborative optimization management of production operation parameter configuration and abnormity prevention of multi-source heterogeneous data in large-scale production with high dimension, high complexity and dynamic change can be realized.

The present invention provides a facial recognition system using deep learning methodologies while integrating privacy-preserving capabilities. This system employs convolutional neural networks (CNNs) to extract and classify facial features, ensuring high accuracy in recognition tasks. Moreover, the system addresses privacy concerns by incorporating techniques such as facial feature encryption and anonymization, thereby enhancing user privacy and data security. This invention is applicable across various domains, including security, surveillance, access control, and personalized services, where facial recognition is utilized while preserving individual privacy.

The invention belongs to the technical field of earthquake disaster scene recognition, and discloses an earthquake disaster scene recognition method based on deep learning. The method comprises the following specific steps: S1, data acquisition and preprocessing; S1.1, multi-source heterogeneous data acquisition and establishment of a comprehensive database containing seismic waveform data, surface deformation data, building structure data, geographic information data and historical disaster record data; through fusion of a 3D convolutional network, a graph attention mechanism, a space-time LSTM and an adaptive cross-modal attention fusion technology, combined modeling of a seismic waveform space-time evolution law, an earth surface deformation space distribution characteristic, a building group topology vulnerability and disaster chain time sequence association is realized, the characterization capability of a complex nonlinear disaster mode is effectively improved, and the method has the advantages of high adaptability and high reliability. And disaster assessment response time is shortened to a sub-second level through mixed precision quantification and edge computing deployment, and high recognition accuracy is still kept in a scene with strong noise and data missing in combination with a multi-task classifier and a physical constraint verification mechanism.

The invention relates to the field of power equipment data processing, in particular to a biomass power generation combustion parameter deep learning method and system, and aims to solve the problem of phase mismatch caused by sampling frequency difference and clock reference offset of multi-source heterogeneous time sequence data. A parallel multi-scale convolution and bidirectional long-short-term memory network hybrid model is constructed, transient fluctuation and long-period trend features are extracted, and combustion stage feature weights are dynamically distributed through a gating attention mechanism. The optimization control module generates a multi-target constraint condition, an operation instruction is output in combination with a fuzzy inference engine, and a digital twin platform simulates an extreme working condition to enhance model robustness. A closed-loop feedback mechanism dynamically adjusts model parameters through combustion efficiency monitoring data and simulation results, and a two-stage fault-tolerant strategy realizes sensor abnormity compensation and historical control strategy backtracking. The problem of asynchronous data stream feature misalignment is effectively solved, and the combustion efficiency prediction precision and the control decision reliability are improved.

According to the PCB production line defect detection system and method based on image processing, a plurality of high-resolution cameras, an infrared thermal imaging camera and a 3D laser scanner are adopted, a dynamically-controlled annular LED light source, polarized light illumination and a structured light projection technology are combined, a foreground and a background are separated through a self-adaptive threshold Otsu method, and the defect detection accuracy is improved. A convolutional neural network denoising model and a frequency domain filtering technology are introduced, welding spot and line features are extracted from a preprocessed image, a coding scheme is designed, multi-modal features are fused, spatial-temporal feature analysis is introduced, fine classification and positioning are performed in combination with SVM preliminary screening and a YOLOv5 deep learning model, an online learning mechanism is introduced, model parameters are dynamically optimized, and a multi-modal image is obtained. An intelligent early warning mechanism is established, automatic grading and alarm sending are carried out, a statistical report is automatically generated, production process parameters are recorded, root cause analysis is carried out in combination with big data analysis, and potential defects are early warned in advance.

The invention provides a chemical industrial park major hazard source safety management method and system, and relates to the technical field of safety management, and the method comprises the steps: constructing a chemical industrial park hazard source knowledge graph, learning node features through employing a graph neural network, recognizing the potential correlation between hazard sources in combination with a pre-trained deep learning model, and constructing a hazard source propagation path. And then, calculating the risk probability of each propagation path, and generating a hidden danger risk assessment result. And finally, constructing a hazard source causal chain based on a knowledge graph inference engine, and generating a hidden danger traceability analysis report and a risk prediction report in combination with the risk probability. According to the invention, through the knowledge graph and the deep learning technology, intelligent safety management of the chemical industry park hazard source is realized, potential hazard association can be effectively identified, risks can be predicted, decision making can be assisted, and the safety level of the chemical industry park can be improved.

The present invention provides an automatic intelligent inspection system for the equipment, facilities and surrounding environment along a railway line, including an unmanned aerial vehicle (UAV), a movable ground base station, a remote server and a working computer, wherein the working computer includes an image processing module that is configured to detect an obtained image by using a deep learning network model trained with a database in advance, obtain any object that is suspected to involve a defect by analysis, and transmit the object for manual review while calculating for the specific geographic coordinate information of the defect, report for early warning after the defect is confirmed by the manual review, inform the operation and maintenance personnel, and store and record the defect. The present invention further provides a method for inspection by using the automatic intelligent inspection system for the equipment, facilities and surrounding environment along a railway.

The dynamic bandwidth allocation and resource scheduling method based on the 5G network comprises the steps that S1, a base station collects service requests, network loads and channel information of user equipment of the 5G network, and the services are divided into real-time services, big data services, key services and conventional services; s2, the real-time service calculates the bandwidth by using deep learning; the big data service is distributed according to the idle bandwidth and the data volume proportion; key service main and standby links distribute bandwidths; conventional businesses come first and then are subjected to service distribution; s3, the base station maps bandwidth resources by using a multi-carrier and dynamic subcarrier algorithm, and optimizes signal transmission in combination with a beam forming technology; s4, processing service data according to a priority scheduling queue, and verifying signal transmission according to a channel quality adjustment coding mode; and S5, updating the data and evaluating the effect according to the user feedback, and re-optimizing the scheduling strategy as required. Through intelligent dynamic bandwidth allocation and resource scheduling, efficient, flexible and reliable transmission of different types of services is realized, and the network resource utilization rate and the service quality are improved.

The invention provides a battery assembly process defect real-time detection and classification method and system, and relates to the technical field of intelligent manufacturing, and the method comprises the steps: carrying out the standardization preprocessing of collected battery surface images and three-dimensional point cloud data; a distributed edge computing architecture is adopted for feature extraction, the distributed edge computing architecture comprises a defect propagation prediction module based on a graph neural network, inter-process defect features are constructed into a dynamic graph structure, a defect evolution rule is learned through the graph network, and feature extraction parameters are dynamically adjusted; inputting the extracted features into a deep learning detection model, carrying out feature adaptive mapping and alignment through a multi-modal spatial-temporal feature coding layer, constructing a process association graph through a dynamic reasoning layer based on causal reasoning, and calculating a propagation influence degree; carrying out hierarchical precision detection on different defect evolution probability regions by a prediction perception detection layer with a self-adaptive threshold value, and outputting a defect detection result; and classifying defect detection results based on defect classification standards.

The invention discloses a Transform-based cross-modal fusion multi-modal emotion recognition method and device, which are used for solving the problems of modal isomerism, difficulty in time alignment and insufficient dynamic emotion modeling in a multi-modal emotion recognition task, and the method takes the accuracy and robustness of emotion recognition as performance evaluation indexes. Firstly, feature information of three modes of vision, voice and text is obtained, feature extraction is performed on each mode through a deep learning model, then features of different modes are fused by using a cross-mode Transform module, and a complex dependency relationship between the modes is dynamically modeled through a multi-head self-attention mechanism, so that more accurate emotion recognition is realized, and the emotion recognition efficiency is improved. And finally, performing emotion prediction on the fused features based on time sequence modeling and an emotion classification module. According to the method, the problems of modal isomerism, difficulty in time alignment and insufficient dynamic emotion modeling in multi-modal emotion recognition can be effectively solved.

A system and method for AI based user experience curation across multiple scenarios and finite time horizons of interest. The present invention integrates connectionist and symbolic AI techniques to generate coherent, relevant, and personalized content across various domains. The invention bridges the gap between connectionist AI and symbolic AI, enabling more adaptive, immersive, and engaging user experiences while prioritizing security and traceability and contextualization considerations behind recommendations or content generation. The platform furthers dynamic and tailored user interactions with digital systems across individual interactions, preferences, sequences and ongoing engagements across sessions by leveraging the power of analytics, deep learning, and AI to create truly intelligent, dynamic, and responsive user experiences enhanced with optimization and planning faculties.

The invention relates to a high-voltage equipment defect detection method based on deep learning and multispectral image fusion, and relates to the technical field of electric power high-voltage equipment state detection. The method comprises the following steps: acquiring an ultraviolet image, an infrared image and a visible light image of the surface of the high-voltage equipment; carrying out image pixel feature-based fusion processing on the ultraviolet image, the infrared image and the visible light image through an image fusion method; establishing a high-voltage equipment defect detection model, and training the high-voltage equipment defect detection model by using the fused image data to obtain a high-voltage equipment defect identification model based on the YOLO-STrans multispectral fusion network; and inputting the ultraviolet image, the infrared image and the visible light image of the outer surface of the power high-voltage equipment into a high-voltage equipment defect identification model to obtain a fault identification result of the to-be-detected power high-voltage equipment. The method can improve the recognition precision of the extremely early insulation degradation and temperature anomaly defects of the surface of the high-voltage power equipment.

The invention provides a marine ranch water quality parameter real-time correction and compensation method and system for a multi-source sensor, and relates to the technical field of multi-source sensors, and the method comprises the steps: constructing a double-layer edge computing network, and connecting a sensor through a micro-service architecture to collect water quality data. And carrying out data preprocessing in combination with wavelet transform. And establishing a sensor digital twinborn model, and calculating the real-time credibility. Establishing a multi-dimensional sensor association network, optimizing a weight coefficient by adopting federal learning, and establishing a self-evolution correction parameter matrix; and fusing the sensor data by using a multi-task deep learning model to generate an initial correction value. And calculating a theoretical reference value through a space-time sequence prediction model. A compensation coefficient is adaptively adjusted by adopting a fuzzy decision tree, hierarchical water quality parameter correction is realized, and a closed-loop self-optimization intelligent correction system is formed through verification of a digital twin model. The accuracy and reliability of marine ranch water quality monitoring data are effectively improved.

According to the research and development document processing method and device provided by the embodiment of the invention, unified processing of text, voice and image information is realized by constructing the multi-mode document analysis engine. Different types of data are converted into standardized feature representations through cross-modal preprocessing and a semantic alignment network. The system adopts a deep learning model to identify research and development elements, establishes a multi-modal relation graph, and realizes intelligent extraction and correlation analysis of various types of information in research and development documents. According to the method, the defects of the traditional technology in the aspects of multi-modal information fusion and knowledge system construction are effectively overcome, powerful support is provided for research and development process management and knowledge asset accumulation, and the standardized management level of research and development documents is remarkably improved.

The invention provides a BIM-based building energy consumption simulation analysis optimization method and system, and relates to the technical field of building energy consumption, and the method comprises the steps: building a building energy consumption digital twinborn model through integrating a building information model (BIM) and real-time operation data, such as indoor and outdoor temperature, equipment operation, electrical load and personnel density, collected by an Internet of Things sensor. An LSTM and GNN mixed deep learning algorithm is used to predict building energy consumption, and clustering analysis is used to identify an energy consumption abnormal mode and a peak period. And finally, based on a reinforcement learning algorithm, constructing an energy consumption optimization model taking total energy consumption minimization as a target and taking indoor thermal comfort and air quality as constraints, outputting equipment optimization operation parameters such as air conditioner temperature, fresh air volume, illumination brightness and the like, and realizing intelligent optimization control of building energy consumption, so that the building energy consumption is reduced, and the building operation efficiency is improved.

The invention relates to the technical field of battery monitoring, in particular to an electric vehicle battery state real-time monitoring system based on deep learning. Comprising a battery data acquisition module, a feature extraction module, a battery state prediction module, a fault monitoring module and a safety regulation and control module. The battery data acquisition module acquires battery parameters in real time, the feature extraction module extracts key features through deep learning, and the battery state prediction module predicts battery capacity, health state and performance degradation based on a neural network and a differential equation. The fault monitoring module adopts integrated learning to detect abnormity and output an alarm signal, and the safety regulation and control module optimizes a charging and discharging strategy through reinforcement learning and fuzzy control to guarantee safe and stable operation of the battery. According to the invention, accurate prediction and intelligent monitoring of the battery state are realized through the deep learning technology, comprehensive state evaluation and fault early warning are provided, and the accuracy and stability of battery state monitoring are effectively improved, so that the operation safety of the electric vehicle is improved, and the service life of the battery is prolonged.

The invention provides an industrial robot autonomous collaborative decision-making method and system based on multi-modal sensing and a medium, and belongs to the technical field of industrial robot intelligent control. The method comprises the steps of performing cross-modal space-time alignment to eliminate data space-time differences by collecting visual, tactile and auditory information, realizing multi-modal feature fusion in combination with a dynamic weight adjustment mechanism and an attention calculation model, and generating a joint decision strategy through a deep learning optimization model. The system dynamically allocates sensor weights according to task types, introduces a multi-objective optimization mechanism of energy consumption, precision and safety, and sets a fault-tolerant rule to automatically recover the weights or recalibrate the sensors. According to the method, the problems of rigid data fusion and single optimization dimension in traditional multi-modal decision making are solved, and the precision, the response speed and the environmental adaptability of collaborative operation of the industrial robot are remarkably improved.

The invention relates to the field of power equipment data processing, in particular to a steam turbine vibration fault diagnosis system fused with deep learning. Comprising a dynamic knowledge base construction module, a working condition adaptive data synchronization module, a knowledge-guided heterogeneous feature fusion module, a dynamic structure neural network module, an online self-optimization weight distribution module and a knowledge-enhanced coupling fault reasoning module. The dynamic knowledge base construction module updates the multi-modal knowledge graph through an incremental knowledge distillation mechanism, and generates an interpolation strategy template and a frequency band sensitivity matrix; the working condition self-adaptive data synchronization module dynamically calls an interpolation algorithm based on a rotating speed fluctuation mode to realize time sequence alignment optimization of multi-source sensor data; the system effectively solves the problems of time scale asynchronism and feature heterogeneity in multi-source heterogeneous data fusion through a knowledge-driven and data-driven closed-loop interaction mechanism, and realizes accurate diagnosis and early warning of steam turbine vibration faults under complex working conditions.

The invention discloses a smart road driving time prediction method based on multi-source data fusion and deep learning, and the method comprises the steps: constructing a multi-source data collection and fusion platform, developing a spatial-temporal feature deep learning model, deploying a real-time data processing and anomaly detection system, building a self-adaptive prediction optimization mechanism, and constructing a smart traffic application service platform. Comprehensive acquisition, deep analysis, real-time processing, accurate prediction and intelligent service of traffic data are realized. The method specifically comprises the following steps: deploying an Internet of Things sensor network to collect multi-source data, and designing an adaptive weighted fusion algorithm to construct a multi-dimensional dynamic traffic database; constructing an LSTM-GNN hybrid neural network architecture to extract spatio-temporal features; real-time data processing and anomaly detection are carried out by adopting a streaming computing framework and various technologies; designing a multi-objective optimization algorithm and a reinforcement learning model to realize adaptive prediction optimization; and developing a visual decision support system and a personalized navigation service. The system effectively improves the traffic management efficiency and the public travel experience.

The invention relates to the field of semiconductor packaging material defect detection, in particular to a semiconductor packaging material defect detection method based on deep learning, which comprises the following steps: acquiring a surface image, and extracting a two-dimensional contour and a feature point set; preprocessing the image, and separating a packaging material main body area; constructing a two-dimensional defect identification model based on Transform, and outputting a two-dimensional detection result; scanning suspected and unknown defect areas to obtain three-dimensional point cloud data, and extracting geometric and texture features; fusing two-dimensional and three-dimensional data through a space-time alignment model; utilizing the multi-modal fusion model to output defect positions and types; and evaluating the defect importance based on the material node connectivity and the stress distribution, and generating a visual detection report. According to the invention, high-precision detection of semiconductor packaging material defects is realized, the defect identification rate, the positioning precision and the detection efficiency are improved through multi-modal data fusion and a deep learning model, and a visual report can be generated based on material structure quantification defect importance.