2028 results about "Feature coding" patented technology

The invention provides a battery assembly process defect real-time detection and classification method and system, and relates to the technical field of intelligent manufacturing, and the method comprises the steps: carrying out the standardization preprocessing of collected battery surface images and three-dimensional point cloud data; a distributed edge computing architecture is adopted for feature extraction, the distributed edge computing architecture comprises a defect propagation prediction module based on a graph neural network, inter-process defect features are constructed into a dynamic graph structure, a defect evolution rule is learned through the graph network, and feature extraction parameters are dynamically adjusted; inputting the extracted features into a deep learning detection model, carrying out feature adaptive mapping and alignment through a multi-modal spatial-temporal feature coding layer, constructing a process association graph through a dynamic reasoning layer based on causal reasoning, and calculating a propagation influence degree; carrying out hierarchical precision detection on different defect evolution probability regions by a prediction perception detection layer with a self-adaptive threshold value, and outputting a defect detection result; and classifying defect detection results based on defect classification standards.

The invention discloses a campus green space ownership perception assessment method and system based on multi-modal learning, and the method specifically comprises the steps: inputting the output results of a visual feature coding network and an auditory feature coding network into an audio-visual modal feature fusion module for fusion processing, and obtaining an environment joint representation; inputting the physiological response data set and the psychological assessment data set into a physiological and psychological collaborative encoder for processing to obtain a physiological and psychological joint representation; inputting the environment joint characterization and the physiological and psychological joint characterization into a global fusion module for deep fusion to obtain a final fusion feature; and inputting the final fusion feature into a multi-task prediction channel for processing, and training and optimizing in combination with a loss function to obtain an environment comfort comprehensive scoring result and an explanatory decision basis. According to the invention, comprehensive assessment of campus green space perception is realized, the accuracy and scientificity of assessment are improved, and decision support is provided for optimization of campus space design.

The invention discloses a network threat multi-modal detection method based on a large model, and belongs to the technical field of network security, and the method comprises the steps: collecting three types of heterogeneous data of NetFlow flow of a network layer, a system call chain sequence of a host layer and a protocol load of an application layer, and carrying out the desensitization processing and feature coding to generate a unified tensor format; the method comprises the following steps: through network security threat intelligence and MITRE ATTamp; performing supervision fine tuning on the large model by using a CK attack chain sample, and constructing a network threat identification special model; cross-device behavior characteristics are extracted through a model self-attention mechanism, and a dynamic behavior map is constructed; and finally, comprehensively evaluating an attack mode matching degree, a node vulnerability mean value, historical alarm association and an attack path risk by adopting a weighted fusion algorithm, and triggering a high-confidence alarm when a comprehensive score exceeds 0.8. According to the method, through multi-modal data fusion and dynamic graph analysis, the detection precision and response efficiency of the complex attack chain are improved.

A three-dimensional point cloud semantic segmentation method based on graph convolution and a grouping vector attention mechanism adopts a network structure of a U-Net style, feature extraction and propagation are performed on point cloud through multi-level feature coding and decoding, each level firstly centralizes and standardizes local neighborhood features through a geometric affine module, and then the local neighborhood features are subjected to feature extraction and propagation; the capturing capability of the model on the diversity of the local region is enhanced; secondly, constructing a local neighborhood graph, and designing an asymmetric edge feature learning function to extract local topological information; deep edge features are further extracted in combination with a residual network; and finally, selectively fusing local features and global context information under the condition of low parameter quantity by using a grouping vector attention mechanism, and performing cross-level feature interpolation up-sampling to an original scale to complete point cloud segmentation. The method can significantly improve the point cloud segmentation precision, and is suitable for the perception of a mobile robot and other devices carrying a three-dimensional sensor on a complex scene.

The invention relates to the technical field of remote sensing monitoring, in particular to a remote sensing image ocean green tide monitoring method and system fusing physical prior and spatio-temporal evolution. The method comprises the following steps: acquiring a multi-modal remote sensing monitoring image; performing multi-modal feature extraction on the acquired image, wherein the multi-modal feature extraction comprises spectral reflectivity feature extraction, ocean dynamics feature extraction and feature alignment and unified representation; establishing a physical prior of a green tide characteristic wave band by using an ocean optical radiation transmission model; constructing a dynamic space-time diagram based on the extracted multi-modal features to obtain a node global feature vector and a dynamic adjacency matrix; carrying out adaptive graph convolution feature coding based on physical prior and a dynamic space-time diagram; through fusion of multi-spectral images of multiple platforms such as satellites and unmanned aerial vehicles and ocean dynamic data and combination of atmospheric correction and wave band resampling, consistency processing and high-precision extraction of multi-source features are realized, and comprehensiveness and reliability of green tide feature recognition are remarkably improved.

The invention relates to the technical field of multi-modal information processing, and provides a deep semantic collaborative fusion method for heterogeneous multi-modal data. The invention provides a dynamic adaptive fusion framework aiming at the problems that a modal interaction mechanism is rigid and semantic modeling is shallow in the prior art. The method comprises the following steps: carrying out feature coding and alignment on text, audio and video modal data to generate unified-dimension single-modal representation; dynamic interaction is realized through an enhanced multi-head gating fusion module, and double-path features are generated; and carrying out cross-modal depth modeling on the basis of a stacked Transform encoder, and outputting final fusion semantics. Wherein the multi-head attention path calculates cross-modal mapping by taking a text as a query vector and taking an audio / video as a key value vector; the gating path generates a dynamic weight through cosine similarity and a learnable temperature parameter; and the dual-path adaptive fusion adopts a balance factor alpha weighted combination. According to the method, the multi-modal data fusion precision and the system robustness are improved, and the method is suitable for government affair service, man-machine interaction and other scenes.

The invention relates to a multi-modal large model dynamic compression and reasoning optimization method based on a MoE architecture. The method comprises the following steps: establishing an edge computing system conforming to medical equipment specifications, constructing a medical image analysis network based on an improved hybrid expert MoE architecture, and adopting a three-layer cascade structure of a feature coding layer, a dynamic routing layer and an expert execution layer; executing expert module dynamic loading and video memory optimization; executing knowledge graph compensation and domain knowledge injection; executing hardware instruction level optimization and calculation acceleration; executing multi-expert feature fusion and decision weighting; performing diagnosis result generation and confidence evaluation; performing real-time data return and model iterative optimization; executing multi-device cooperation and load balancing; executing system security monitoring and exception handling; and generating a structured diagnostic report. The problem that the precision loss of a multi-modal large model is difficult to meet actual requirements is solved, and medical feature adaptive dynamic compression, medical hardware collaborative energy efficiency optimization and cross-modal compensation of medical knowledge enhancement are realized.

The invention provides a cross-modal remote sensing image-text retrieval method based on multistage semantic collaborative matching, which comprises the following steps of: extracting a region of interest by using a semantic segmentation algorithm through an image preprocessing module, segmenting a remote sensing image into a plurality of regions and generating image blocks; respectively extracting global features, regional features and pixel-level features of the image, and carrying out fine-grained coding on key regions such as fine-grained ground feature edges and the like; the text multi-level coding module is used for carrying out three-level feature coding of documents, sentences and words on texts based on a pre-training language model to ensure multi-level understanding of the texts; in the multi-level matching and fusion module, the similarity between the remote sensing image and the text description is calculated through a cross attention mechanism, weighted fusion is carried out on features of all levels, and finally a retrieval score is output. The method not only improves the accuracy and robustness of image-text retrieval, but also can be widely applied to the fields of remote sensing monitoring, environment change recognition, geographic information systems and the like.

The invention discloses a hyperspectral image classification method based on proxy attention and a VIT architecture, and belongs to the field of image classification, and the method comprises the following steps: preprocessing hyperspectral image data, and dividing the hyperspectral image data into a training set and a test set; constructing a hyperspectral image classification model based on proxy attention and a VIT architecture; training the hyperspectral image classification model by adopting the training set; and inputting the hyperspectral data in the test set into the trained hyperspectral image classification model, reasoning to obtain a prediction category, and evaluating the obtained prediction category through an evaluation index. According to the invention, the agent attention encoder based on agent attention is constructed, hierarchical feature extraction is carried out through the agent attention encoder of L-layer cascade, layer-by-layer fusion and enhancement of space-spectrum information in an initial feature coding matrix are realized, the calculation complexity is significantly reduced while the strong representation capability is maintained, and the method has the advantages of high efficiency, high resolution and the like. And good balance between the calculation efficiency and the feature expression capability is realized.

The invention belongs to the technical field of marine environment prediction, and discloses a ship navigation sea wave dynamic space-time prediction method and system based on deep learning. The method comprises the following steps: carrying out space-time alignment, missing value repair and standardization processing on acquired ship AIS data and an ERA5 reanalysis data set, and generating node feature vectors containing latitudes and longitudes, timestamps, wind speeds and significant wave heights; through node feature coding, centrality coding, space coding and time coding, ship trajectory node importance and time-space interaction relation are quantified. Constructing a SeaGraph model, and outputting an effective wave height prediction value of a target waypoint; and performing verification. According to the method, the space-time constraint of a traditional static modeling framework is broken through, the advantages of a self-attention mechanism and a graph network are integrated, the predictive modeling capability of dynamic evolution of a wave field in front of a ship navigation track is enhanced, and high-precision sea wave forecasting support is provided for intelligent ship navigation under complex sea conditions.

The invention discloses an opportunity network link prediction method based on a time sequence diagram neural network, and particularly relates to the technical field of the time sequence diagram neural network, and the method comprises the following steps: S1, data collection and network snapshot generation; s2, weighting feature coding clusters; s3, GAT and LSTM combined processing embedding is carried out; s4, the probability is calculated through a multi-layer perceptron; s5, constructing a loss function according to the link; s6, drawing sets and training parameters; and S7, multi-index evaluation of the optimal model. The method accurately captures the spatial-temporal characteristics of nodes, collaboratively operates embedding, coding and decoding layers, improves the accuracy and stability of link prediction, stabilizes the reliability of network communication and the success rate of data transmission, innovates a loss function and an optimization strategy, solves the problems of data sparseness and over-fitting, enhances the generalization ability, adapts the model to a multi-field network, and improves the data transmission efficiency. And links are accurately predicted in scenes such as intelligent traffic and disaster rescue, resource configuration and communication efficiency are optimized, and innovative development of multi-industry network application is powerfully promoted.

The invention relates to the technical field of recommendation, and provides a recommendation method and system based on multi-modal dynamic gating and hybrid coding. The method comprises the steps of obtaining user interaction behavior information and article attribute information, generating collaborative embedding and semantic embedding of articles through an ID-PCA encoder and an LLM encoder respectively, achieving alignment of collaborative signals and semantic signals through bidirectional multi-granularity cross attention, and achieving self-adaptive fusion of multi-expert features through a dynamic weight distribution mechanism; through heterogeneous feature coding, cross-modal dynamic alignment and multi-scale interest modeling, the semantic utilization bottleneck and long-tail generalization limitation in the prior art are broken through, and a new technical path is provided for personalized recommendation.

The invention belongs to the technical field of intelligent monitoring, and particularly relates to an urban underground pipe network real-time monitoring algorithm and system based on multi-source data fusion, and the method comprises the steps: obtaining multi-source heterogeneous monitoring data; performing multi-source data preprocessing; carrying out multi-source heterogeneous feature coding and fusion; carrying out real-time monitoring and anomaly detection on a pipe network state; fault diagnosis and prediction are carried out; and generating decision support information and early warning. The system comprises a data acquisition module, a data preprocessing module, a multi-source heterogeneous feature coding and fusion module, a pipe network state real-time monitoring and anomaly detection module, a fault diagnosis and prediction module and a decision support and early warning module. According to the scheme, multi-source heterogeneous data are integrated, spatial-temporal feature coding and fusion are carried out through deep learning, accurate sensing, early warning and intelligent fault diagnosis of the operation state of the pipe network are achieved, and the safe operation level and maintenance management efficiency of the urban underground pipe network are improved.

The invention relates to the technical field of electrical equipment fault diagnosis, and discloses an electrical equipment multi-modal fault diagnosis method based on dynamic self-adaption, and the method comprises the steps: obtaining an original multi-modal signal flow containing vibration, temperature and current signals, inputting the original multi-modal signal flow into a dynamic self-adaption diagnosis network, obtaining a fault feature matching result set, and determining each modal result. The network is trained by historical fault data, and the data comprises time domain, frequency domain and fusion feature parameters extracted from continuous multi-mode signals, and corresponding fault type labels and confidence coefficients. The network comprises a cross-modal feature fusion module, a spatial-temporal feature coding module and the like, and when the confidence coefficient of at least two modal results exceeds a dynamic threshold value, three-level early warning is triggered. The method improves the comprehensiveness, accuracy and real-time performance of diagnosis, and is suitable for fault diagnosis of electrical equipment.

The invention discloses an intelligent science and technology project matching and pre-scoring system based on a large model, and relates to the technical field of project matching evaluation, and the system comprises a data collection module which collects multi-source science and technology project information; the data preprocessing module is used for cleaning, converting and standardizing the data; the large model construction module comprises a feature coding layer, a matching decision layer and a pre-scoring prediction layer; the intelligent matching module outputs a matching degree and similar items; a pre-scoring module; and a user interaction module, a model updating module, a security module and a privacy protection module. The large model fuses multiple technical training, each module has a specific function and algorithm, accurate and efficient operation of the system is guaranteed, and data security privacy is protected. According to the method, a large number of science and technology projects can be efficiently processed, the evaluation period is shortened, the matching accuracy and the pre-scoring reliability are improved, multiple factors are considered, the subjective influence is reduced, the system can be dynamically updated, the knowledge graph is updated, the management monitoring function is perfected, intelligent development of science and technology project management is promoted, and resource configuration is optimized.

The invention provides a cross-department data collaborative modeling method and system based on federated learning in the cross technical field of federated learning and privacy computing, and the method comprises the steps: S1, carrying out desensitization operation on department data by each edge computing node, and coding the desensitization data to obtain a feature coding vector; s2, constructing a layered federated learning framework based on a department private feature extractor, a cross-department parameter collaborative aggregation layer and a global task header; s3, extracting data features from the feature coding vectors through a department private feature extractor so as to train the model and extract model parameters; s4, performing hierarchical quantization coding, encryption and compression on the model parameters to obtain compression parameters, and sharing the compression parameters by a cross-department parameter collaborative aggregation layer; and S5, the global task head reads the shared compression parameters to carry out collaborative modeling on the model. The cross-department data collaborative modeling method has the advantages that the precision and efficiency of cross-department data collaborative modeling are greatly improved on the premise that the safety is guaranteed.

The invention provides a traffic participant behavior analysis-based edge calculation signal lamp control method and system, and the method comprises the steps: obtaining video stream data of a target intersection, carrying out the frame-by-frame behavior state analysis of the video stream data through a spatial-temporal feature coding network, extracting the behavior state features of each traffic participant, and carrying out the analysis of the behavior state features of each traffic participant; and inputting the behavior state characteristics into a preset behavior matching model, generating a behavior triggering identifier of the traffic participant in the current time window, generating a signal lamp control instruction of an edge computing node according to the time sequence relevance between the behavior triggering identifier and the phase state of the current signal lamp, and sending the signal lamp control instruction to the edge computing node. And finally, a signal lamp phase switching time sequence of the target intersection is adjusted based on the signal lamp control instruction, so that the traffic participants meeting the traffic rule conflict condition obtain the traffic priority under the signal lamp phase switching time sequence. According to the method, the traffic accident risk is reduced, and meanwhile, the overall traffic efficiency of the intersection is optimized by dynamically adjusting the minimum response period and the phase duration parameters.

The invention discloses a feature attention and bilinear gating fused speech emotion recognition method and device, and the method comprises the following steps: 1, collecting an audio file, obtaining corresponding label information, generating audio waveform and time frequency representation data through preprocessing, and constructing an audio waveform mask and a time frequency mask to mark an effective information region; 2, constructing a dual-path feature extraction module which comprises a time-frequency feature extraction module and a pre-training acoustic feature coding module; wherein the time-frequency feature extraction module models emotion correlation through local convolution and a multi-dimensional attention mechanism, and performs global time sequence modeling based on a bidirectional gated loop network; the pre-training acoustic feature coding module extracts high-level speech representation with high expression ability for emotion distinguishing by using a pre-training model; and step 3, constructing a feature fusion module and an emotion classification module, and combining with a dual-path feature extraction module to form a speech emotion recognition model.

The invention discloses a remote sensing image semantic segmentation-oriented spatial spectrum context feature enhancement method and device. The method comprises the following steps of: constructing a neural network model based on an encoder-decoder architecture; inputting the preprocessed remote sensing image set into a feature coding block, and extracting hierarchical features; according to the model, spectrum attention and position self-attention mechanisms are integrated through a collaborative attention module, and the sensitivity of network spectrum and spatial context information is remarkably enhanced; the network coding module efficiently compresses and codes the features before entering a decoding stage; a cross fusion module is applied to intelligently fuse features between a coding block and a decoding block to ensure that information is not lost in a decoding process; the feature map is mapped into a pixel-level category label through a Softmax layer, precise semantic segmentation is achieved, and a high-quality classification result is obtained. According to the method, through collaborative modeling of the spectrum and the spatial context, high-frequency details are effectively reserved, and the precision of semantic segmentation is improved.

The invention discloses a robot hierarchical reinforcement learning variable impedance control method based on vision and touch, and belongs to the field of robot control. According to the method, an upper-layer planning system and a lower-layer variable impedance control system are included, the upper-layer planning system fuses information from a visual sensor and a tactile sensor, feature coding is conducted on a visual image through a variational self-coding model, tactile feedback and mechanical arm state information are combined, and an action strategy adapting to the current environment and corresponding impedance parameters are formulated. And the lower-layer variable impedance control system realizes variable impedance control of the robot based on a depth kinematics and dynamics model, and allows the robot to dynamically adjust the motion and contact force according to the sensed information when interacting with the environment, thereby improving the adaptability to the environment change and the task execution efficiency. According to the method, the success rate and execution efficiency of the robot for executing the complex assembly task in the unstructured environment are remarkably improved, and high robustness is shown.

The invention provides a virtual fitting method and device, multi-target personalized virtual fitting is realized through a multi-target and multi-mode virtual fitting model, and the virtual fitting device comprises a multi-mode feature interlaced learning attention module (MFILA) and a parallel denoising UNet module. Wherein the MFILA module realizes multi-modal condition feature coding through a multi-modal feature fusion module (MFF) and a multi-reference target texture feature extraction module (MRSTF), and the parallel denoising UNet module is mainly responsible for denoising generation. A user uploads a model clothes graph, a target fitting clothes style graph and corresponding text cues, and the system gradually generates a denoised virtual fitting result from pure noise through an MM-VTON model by taking the inputs as conditions. According to the method, the reality sense and the accuracy of virtual fitting are improved by utilizing an advanced image generation technology and multi-modal learning, meanwhile, the demand of computing resources is reduced, and the method has relatively high practical application value and a wide market prospect.

The invention provides a shield tunneling machine cutter cylinder state monitoring method based on a multi-sensor information fusion technology. The shield tunneling machine cutter cylinder state monitoring method comprises the steps that multi-physical field synchronous data collection is carried out; self-adaptive signal preprocessing: processing the multi-physics field time sequence signal to obtain multi-physics field synchronization time sequence data; multi-physics field feature space construction: processing the multi-physics field synchronization time sequence data to respectively obtain time domain feature data, frequency domain feature data and time-frequency domain feature data; deep collaborative feature extraction and state evolution modeling: obtaining a multi-physics field coupling feature sequence of the spatio-temporal context through multi-physics field collaborative perception feature coding; global space-time dependency collaborative modeling is adopted, and an enhanced space-time feature sequence is obtained; and state evolution trajectory interpretation and classification decision. According to the scheme, a traditional linear stacking mode of data acquisition-preprocessing-feature extraction-fusion classification is broken through, and a closed-loop intelligent sensing method with physical mechanism guidance, multi-modal data deep coupling and feature self-coevolution is constructed.

The invention provides a context understanding-based software operation prompt automatic optimization method and system, and relates to the technical field of artificial intelligence, and the method comprises the steps: collecting the multi-dimensional context feature data of user software operation, carrying out the feature coding through a multi-modal feature fusion network, modeling the time sequence dependence through a bidirectional long-short-term memory network, and carrying out the feature coding through the bidirectional long-short-term memory network. And a context semantic representation vector is generated based on a multi-head attention mechanism, and a prompt generation strategy is continuously optimized in combination with reinforcement learning. According to the method, personalized customization of software operation prompts can be realized, the accuracy and timeliness of prompt contents are improved, and the software use experience of a user is enhanced.

The invention relates to a place recommendation method based on a hypergraph neural network and a diffusion model, and the method comprises the steps: constructing an interest point recommendation model; the interest point recommendation model sequentially comprises a local trajectory flow hypergraph module, spatial-temporal feature coding, a multi-dimensional feature fusion network, a global hypergraph representation learning module, a feature optimization module, an aggregation layer, a frequency domain learning layer and a linear prediction layer. A long track of a user is analyzed and divided into space-time regions, three global hypergraphs are constructed, and the purpose is to comprehensively capture an overall behavior pattern of the user. In order to better optimize trajectory intention characterization, a feature optimization module based on an improved diffusion model is provided. A more stable and controllable reverse process is ensured by introducing multi-dimensional global representation, and an enhanced diffusion model is more suitable for a recommendation system by using a feature normalization and improved Transform network. And designing a loss function to train an interest point recommendation model, wherein the trained interest point recommendation model is used for recommending a next interest point to a new user.

The invention relates to the technical field of wireless communication, in particular to a wireless communication anti-interference enhancement system based on multi-mode signal fusion. Comprising an intelligent signal transceiving module, a signal sensing and preprocessing module, an interference feature coding and classification module, an interference suppression decision module, an interference suppression module, a signal fusion module, an interference suppression performance evaluation module, an interference feature library and an interference suppression strategy library, the interference feature coding and classification module adopts a three-layer progressive architecture of multi-dimensional manifold feature extraction, feature transformation and coding inspired by a group theory, and deep learning classification based on chaotic dynamics, extracts interference features from three dimensions of time domain, frequency domain and nonlinearity, and realizes accurate interference identification; the signal fusion module adopts a multi-level fusion strategy, and dynamically adjusts the fusion weight according to the signal quality; the interference suppression module selects an optimal suppression strategy according to the interference type, and executes frequency domain cancellation, space domain cancellation and time domain cancellation; and performance evaluation feedback forms a closed-loop optimization mechanism.

The invention relates to the technical field of electrical load management, and discloses an electrical load spatial-temporal distribution modeling and adaptive optimization regulation and control system. The system comprises a load monitoring module, an optimization decision-making module, an exception handling module, a communication coordination module and a data tracing module. The load monitoring module collects load data by using a space-time correlation analysis technology; the optimization decision-making module adopts a dynamic clustering algorithm to generate a regulation and control strategy; the exception handling module corrects load exception in a graded manner based on a multi-scale coordination mechanism; the communication coordination module realizes instruction interaction through a hierarchical routing protocol; and the data tracing module generates a topology storage index by using a multi-dimensional feature coding algorithm. The system can accurately collect load data, reasonably distribute power, effectively process load abnormity, guarantee communication stability, facilitate data tracing, improve the operation efficiency and reliability of an electric power system, and meet the requirement of a modern electric power system for electrical load management.

The invention discloses a transformer fault early warning method and system, and relates to the field of electrical equipment fault diagnosis, and the method comprises the steps: collecting multi-source operation data of a transformer through an infrared thermal image, visible light image, vibration voiceprint, electrical quantity and non-electrical quantity data collector, and carrying out the preprocessing; fusing the data into a spatio-temporal feature set by using spatio-temporal feature coding; a specific modal fault early warning expert model and a multi-modal hybrid expert model are initialized and trained, and the multi-modal hybrid expert model is optimized through dynamic weight balance loss; the trained model is applied to real-time data, and a fault early warning task is completed; according to the invention, the transformer fault diagnosis flexibility is improved; iterative parameters are reduced through gating parameters, the calculation complexity is reduced, the generalization ability is improved, and the system robustness is enhanced.

The invention provides an oil and gas pipeline defect three-dimensional contour determination method and device. Acquiring a three-axis magnetic flux leakage detection signal of a to-be-detected target oil and gas pipeline and corresponding space coordinate information of the three-axis magnetic flux leakage detection signal; constructing multi-channel input data according to the three-axis magnetic flux leakage detection signal and the space coordinate information; determining a defect contour prediction result of the target oil and gas pipeline according to the multi-channel input data by using a pre-trained defect contour inversion model; wherein the pre-trained defect contour inversion model comprises a multi-axis feature extraction and fusion module, a feature coding module and a multi-task decoding module; the defect contour prediction result is used for indicating whether the target oil and gas pipeline has defects or not, and the defect contour prediction result is further used for indicating the three-dimensional contour shape of the defects under the condition that the target oil and gas pipeline has the defects. Therefore, high-precision visual reconstruction of the defect position and the three-dimensional form of the oil and gas pipeline is realized, and the accuracy of defect identification and the reliability of evaluation are improved.

The invention discloses a time-space interaction vehicle trajectory prediction method based on speed perception, and the method comprises the steps: obtaining driving trajectory data of a target vehicle and surrounding vehicles in a perception range of the target vehicle, inputting the driving trajectory data into a pre-trained trajectory prediction model, and obtaining the trajectory data of the target vehicle in a prediction time period; the trajectory prediction model comprises an encoder module, a speed sensing interaction modeling module and a decoder module; in the encoder module, a spatial-temporal feature encoder is used for obtaining spatial-temporal feature codes based on the driving tracks of the target vehicle and other vehicles; the scene perception encoder is used for extracting a global spatial dependency relationship between vehicles to obtain a scene perception spatial code; the speed perception interaction modeling module is used for extracting space-time interaction features and scene interaction features of the target vehicle and surrounding vehicles by using a multi-head attention mechanism based on the space-time features and scene perception space codes, and further obtaining global interaction features; and the decoder module is used for obtaining a driving track of the target vehicle in the prediction time period based on the space-time interaction characteristics and the global interaction characteristics. According to the method, the vehicle-scene spatial dependency can be accurately captured, and the trajectory prediction accuracy is improved.

The invention discloses an ocean multi-mode environment perception and intelligent ship navigation decision-making method based on a double-branch vision-semantic encoder. The method comprises the following steps: S1, acquiring a multi-source data image containing a ship and a surrounding environment thereof from an existing public maritime data set or platform; s2, training a double-branch vision-semantic encoder by using the multi-source data image, and inputting a to-be-processed image extracted in real time into a multi-modal feature matrix in the trained double-branch vision-semantic encoder; s3, based on the multi-modal feature matrix, obtaining positioning information of the ship and surrounding environment elements, and constructing a dynamic security domain model; and S4, in combination with the dynamic security domain model and the multi-ship relative position relationship, carrying out quantitative evaluation on the navigation risk, and generating a self-adaptive navigation strategy based on an evaluation result. According to the invention, high-precision ship positioning and environment element identification under complex weather and illumination conditions are realized by using all-weather characteristics and multi-scale visual feature coding of SAR imaging.