42540results about "Internal combustion piston engines" patented technology

Provided is a road crack detection method, a medium and a product. The lightweight YOLO-MCS road crack detection model is constructed based on an improved yolov8 network. A method of improving the yolov8 network includes: replacing a feature extraction network backbone with a lightweight convolutional neural network MobileNetV3, and embedding a Coordinate Attention Mechanism (CA) module in the lightweight convolutional neural network MobileNetV3; adding a small target detection layer and a Squeeze and Excitation (SE) module at a neck end; and introducing a loss function of power Intersection over Union (IoU) into a head prediction structure. The road crack detection method overcomes the problem that the existing detection algorithm has low detection precision for small cracks and is difficult to be applied to edge devices with limited computing resources.

The invention provides a real scene three-dimensional modeling method and system fusing laser point cloud and images, and belongs to the technical field of urban three-dimensional modeling. According to the method, laser point cloud data and multi-view image data of a target scene are acquired through a synchronous acquisition device, and joint calibration is performed on a laser radar and a camera to generate space-time synchronization parameters. And a dynamic weight registration algorithm is utilized to dynamically adjust the registration weight according to the point cloud density distribution and the image texture complexity so as to realize the multi-level registration of the laser point cloud and the image data. The registered data is used for constructing a three-dimensional geometric model and generating a seamless texture map, meanwhile, semantic-driven hole repairing is carried out on a model missing area, and finally a complete three-dimensional model is output. According to the real-scene three-dimensional modeling method and system fusing the laser point cloud and the image, the limitation of single data source modeling is solved, and real-scene three-dimensional modeling with high precision, high integrity and real-time updating is realized.

The invention discloses a visible light and infrared image fusion method based on cross-modal dynamic collaboration. The method comprises the following steps: respectively extracting texture detail features of a visible light image and thermal radiation features of an infrared image through a visible light encoder and an infrared encoder; spatial alignment and channel complementarity optimization of cross-modal features are realized by using a heterogeneous attention collaboration module; and performing layered fusion on deep semantics and shallow detail features through a dynamic gating multi-scale decoder to generate a high-resolution fusion image. According to the method, the problems of feature dislocation, detail loss and unreasonable fusion weight distribution caused by modal difference in the prior art are solved, the detail fidelity, the thermal target saliency and the complex scene adaptability of the fusion image can be remarkably improved, and a high-robustness fusion result is provided for low-illumination environment perception and multi-modal target recognition.

The invention discloses a trajectory optimization method based on a multi-source heterogeneous positioning data fusion algorithm, and relates to the technical field of intelligent navigation and high-precision positioning, multi-modal data are acquired through a multi-modal sensor array, positioning redundancy of scenes such as tunnels and indoor scenes is enhanced, a weight distribution strategy is dynamically adjusted through an Actor-Critic network architecture, and the positioning accuracy is improved. The state space input comprises an environment semantic tag, a historical error sequence and a real-time noise variance, the output action space is continuous weight distribution of each data source, a multi-target reward function optimization strategy is combined, scene adaptability is realized, a local SLAM map, inertial navigation error parameters and a weight distribution strategy are shared in real time based on a V2X protocol, and the real-time performance of the system is improved. According to the method, a single device accumulative error is compensated by using adjacent vehicle data, a terminal locally trains an error compensation model, parameters are uploaded to a cloud end through differential privacy encryption, the cloud end adopts a FedAvg algorithm to aggregate a global model and issue the global model, the error difference between devices is inhibited, and dynamic road network updating and scene differentiation model distribution are supported at the same time.

The invention relates to a heterogeneous multi-unmanned aerial vehicle cooperative path planning method based on multi-agent deep reinforcement learning, and solves the problem that a traditional path planning algorithm is difficult to deal with a dynamic planning problem and an agent cooperation problem compared with the prior art. And the existing multi-unmanned aerial vehicle cooperative path planning algorithm has the defects of insufficient feature extraction capability, low experience learning efficiency and poor cooperative strategy flexibility in a dynamic uncertain environment. The method comprises the following steps: analyzing a multi-unmanned aerial vehicle cooperative path planning task; building an airspace reinforcement learning environment; introducing an unmanned aerial vehicle kinetic equation; modeling a multi-unmanned aerial vehicle decision model in multi-unmanned aerial vehicle cooperative path planning as a POMDP model; designing an MASAC-SEPR algorithm model to carry out path planning on multiple unmanned aerial vehicles, and generating a multi-agent collaborative path optimization network model; and training the multi-agent collaborative path optimization network model. According to the method, the efficiency and the accuracy of multi-unmanned-aerial-vehicle cooperative path planning are remarkably improved, and a reliable solution is provided for heterogeneous multi-unmanned-aerial-vehicle cooperative operation in a dynamic uncertain environment.

SOLUTION: A semi-supervised medical image segmentation method based on a visual language model includes the steps of: obtaining a medical image; inputting an unlabeled image and a text description into a visual language model, and obtaining a text-guided mask based on obtained dense image embedding and text embedding; inputting a labeled image into a student model, and calculating supervised loss by using obtained labeled image prediction; respectively inputting the unlabeled image into the student model and a teacher model to obtain unlabeled image prediction and a pseudo label, merging the text-guided mask with the pseudo label, and calculating semi-supervised loss by using the merged pseudo label and unlabeled image prediction; and performing medical image segmentation by using a trained student model on the basis of the supervised loss and the semi-supervised loss.EFFECT: A target segmentation region can be accurately identified by using advantages of text descriptions.SELECTED DRAWING: Figure 1

The invention discloses an intelligent driving multi-sensor fusion data processing system, which belongs to the technical field of fusion data processing and comprises a data preprocessing unit, a data fusion unit and a data post-processing unit. The data preprocessing unit normalizes the original data of the laser radar, the camera, the millimeter wave radar and the ultrasonic sensor through a standardization, cleaning, noise reduction and calibration synchronization module; the feature level fusion module deeply digs the characteristics of each sensor, and fuses geometric, visual, motion and close-range obstacle features by using a deep neural network; the decision-making level fusion module generates a driving instruction through weighted voting and fuzzy logic reasoning through classification and situation evaluation; and the data post-processing unit combines the vehicle and road condition optimization instruction, evaluates the risk, and stores the data feedback optimization system. The system can improve the sensing precision and decision reliability, enhances the expansion adaptability of the system, and provides guarantee for safe and efficient operation of intelligent driving.

The invention discloses a double-mechanical-arm adaptive motor neural network optimization system, and relates to the technical field of mechanical arm motion control, and the system is characterized in that a feature fusion sensing module synchronizes multi-sensor data through an FPGA, combines technologies such as YOLOv5s, Poi ntNet + + and Doppler frequency shift, achieves precise extraction and fusion of obstacle 2D / 3D features, and generates a real-time environment state matrix; the kinematic chain prediction module quantifies the obstacle motion probability based on historical trajectory clustering and Bayesian prediction, constructs a collision risk field, and dynamically evaluates the collision risk in the future 2 seconds; the planning module searches a low-risk path by adopting an improved A algorithm, optimizes a joint movement track in combination with quadratic programming, embeds kinematics and dynamics constraints, and ensures the feasibility and safety of the path; in addition, a correction mechanism and an energy consumption optimization mechanism are introduced, motion parameters are dynamically adjusted according to the real-time state of the mechanical arm and environment interference, and the obstacle avoidance performance and the operation efficiency of the mechanical arm are further improved.

A DA-YOLOv11-based unmanned aerial vehicle aerial image target detection method belongs to the technical field of unmanned aerial vehicle aerial image target detection, and comprises the following steps: S1, obtaining and preprocessing a disclosed unmanned aerial vehicle aerial image data set; s2, carrying out improvement on the basis of a YOLOv11 network model, and constructing a DA-YOLOv11 network model; s3, training an unmanned aerial vehicle aerial image target detection network based on DA-YOLOv11; and S4, inputting the test set for testing and evaluation. An expansion residual module is introduced, and a C3K2DWR module is provided, so that the receptive field of the model for a small target is enhanced, and the features of the small target are better captured; a self-adaptive pyramid pooling module is provided in combination with an improved context anchor point attention mechanism to enhance the expression of small target features, and global information interaction is enhanced at the same time; traditional bilinear up-sampling is replaced by a dynamic up-sampling operator, so that the feature fusion capability is enhanced; a WIoU loss function is adopted to adjust the shape and position information of a target frame, and the sensitivity of the model to a small target is improved.

The invention relates to the technical field of unmanned vehicle control, and discloses a smart city environmental sanitation unmanned vehicle path planning and real-time monitoring method. The method comprises the following steps: firstly, acquiring a multi-source environment sensing data set such as laser radar point cloud data, a camera image sequence and real-time traffic flow information; local road network features are extracted based on laser radar point cloud data, a dynamic target motion prediction map is generated according to a camera image sequence, and real-time traffic flow information is processed to generate a regional traffic efficiency evolution curve. And inputting the data into a path optimization model to generate an initial path sequence, dividing cleaning task priorities, fusing related data and generating a final path planning scheme through a reinforcement learning algorithm. In addition, operation state data of the unmanned vehicle are collected in real time, and a path correction instruction set is generated through an anomaly detection model to update the strategy network. According to the method, the rationality and the operation efficiency of the path planning of the environmental sanitation unmanned vehicle can be improved, real-time monitoring is realized, and the operation safety and the management intelligence level are enhanced.

The invention discloses a space-time adaptive matching system based on multi-objective reinforcement learning, and the system comprises a data fusion cleaning module, an intelligent path planning module, a multi-objective scheduling optimization module, an adaptive task optimization module, and a reinforcement learning driving module. Self-adaptive scheduling and path planning of the unmanned aerial vehicle in a three-dimensional space are achieved, intelligent aircraft task management is provided, operation safety in a complex airspace is guaranteed, multiple requirements of the low-altitude industry for safety and efficiency are met, meanwhile, dependence on static rules and expert experience is reduced, and the unmanned aerial vehicle route planning method is suitable for popularization and application. The method can dynamically adjust the strategy according to real-time feedback and environmental change, has high adaptability, and meets the core technical requirements of future low-altitude equipment in operation service, supervision and whole industry chain safety standardization systems.

A small-size vehicle detection deep learning model based on feature fusion of multi-scale modules is provided, which solves the problem of small-size vehicle image detection. The model includes a Backbone network, a Neck layer and a Head network, wherein a C2f_DCNv3 module based on the combination of deformable convolution v3 (DCNv3) and a cross stage feature fusion (C2f) module and an SPPF_LSKA module based on the combination of a spatial pyramid pooling fast (SPPF) layer and a large separable kernel attention (LSKA) module are introduced into the Backbone network; a C2f_SCConv module based on the combination of spatial and channel reconstruction convolution (SCConv) and a C2f module is introduced into the Neck layer; and a multi-scale kernel detection (MSK_Detect) module is introduced into the Head network.

The invention discloses an MRI medical image correction method and system based on a convolutional neural network and a computer readable storage medium, and the method comprises the steps: obtaining a brain MRI medical image, and carrying out the preprocessing; extracting lesion features of the brain lacuna infarction from the preprocessed MRI medical image through a convolutional neural network, and positioning a lesion area of the brain lacuna infarction; performing detail enhancement on the lesion area of the cerebral lacuna infarction, segmenting the lesion area and optimizing a segmentation result; and carrying out artifact restoration on the segmented image, and generating a three-dimensional focus visualization model based on the restored image. According to the method, through processing in multiple aspects such as quality evaluation, lesion recognition, segmentation, artifact repair and three-dimensional visualization of the MRI image, the lesion area can be recognized more efficiently and accurately, the image quality is improved, and an efficient and accurate brain lacuna infarction diagnosis auxiliary tool is provided.

The invention discloses a verification method and system of a chip simulation model, a medium and a program product, and relates to the technical field of chip verification, and the method comprises the steps: obtaining a simulation model and a performance parameter index of a to-be-verified chip; generating model training data based on the historical performance indexes, the corresponding historical use case set and the historical verification result, and performing model training based on the model training data to obtain a use case generation model; inputting the performance parameter indexes to a case generation model to obtain a test case set and a test verification expectation; executing a plurality of test cases in the test case set based on the simulation model, and recording an actual response result of the simulation model; based on the actual response result and the test verification expectation, generating a test log, and determining an abnormal mark in the test log; and marking the fault features corresponding to the exception, taking the test cases as newly added training data, and optimizing the case generation model based on the newly added training data. According to the invention, the chip verification efficiency can be improved.

The invention relates to an unmanned aerial vehicle intelligent dynamic path guidance method and system based on deep reinforcement learning. The method comprises the steps of obtaining three-dimensional terrain point cloud and obstacle information of a flight area, constructing an environment topological structure diagram, extracting features through a three-layer diagram convolutional network, and generating high-dimensional environment feature representation. And a deep reinforcement learning state space is constructed, and a multi-target reward function is designed. And initializing the deep reinforcement learning network by using [-0.1, 0.1] uniformly distributed random parameters to generate an initial path scheme. Optimizing through a dynamic planning algorithm, adjusting a node sequence according to a path length and a task dynamic threshold value, and calculating a target function value. And judging whether the current path scheme reaches the optimal balance point, if not, adjusting the weight of the reward function by using a gradient descent method, and regenerating the path scheme until the path scheme is optimal. And finally, converting the scheme into a waypoint coordinate and speed instruction, performing real-time monitoring during flight, and triggering re-planning when an obstacle exceeds a safety threshold, so as to achieve the purposes of safe flight of the unmanned aerial vehicle in a complex environment and the like.

The invention provides an intelligent traffic vehicle behavior modeling method and system based on collaborative learning, and relates to the technical field of unmanned driving, and the method comprises the steps: obtaining traffic data in a target region; performing data calibration processing according to the traffic data to obtain a collaborative perception data set; a vehicle space-time trajectory function is generated according to the collaborative perception data set, and a conflict domain space-time distribution diagram is obtained; according to the vehicle space-time trajectory function and the conflict domain space-time distribution diagram, probability distribution characteristics of the vehicle driving intention and a multi-workshop competition cooperation relation matrix are extracted, and a multi-dimensional interaction characteristic vector is obtained; and behavior modeling is carried out according to the multi-dimensional interaction feature vectors, and a vehicle behavior model representing interaction behavior rules and decision logic between vehicles is obtained. According to the method, through multi-vehicle cooperative sensing data calibration and dynamic fusion of road geometric constraints, the problems of single-vehicle sensor shielding and cross-vehicle data heterogeneity are effectively solved, and the global consistency of vehicle position and motion state estimation is remarkably improved.

The invention relates to the technical field of building information models, augmented reality, synchronous localization and map construction, and provides a deep learning-based SLAM-BIM augmented reality cooperative localization method and system, and the method comprises the steps: introducing a Transform time sequence feature extractor and a geometric relation graph, evaluating a dynamic distribution weight through combining with the confidence, achieving the cross-modal closed-loop detection, and obtaining an SLAM-BIM augmented reality cooperative localization result. A lightweight semantic segmentation network and a feature fusion module are utilized, a dense map with consistent geometric semantics is constructed, a space-time error propagation equation is constructed, online calibration is realized by means of BIM scale prior, an incremental fusion algorithm is designed, a global pose is optimized in combination with AR interaction, and the system fuses SLAM visual trajectory features and BIM semantic geometric features through a deep learning technology. According to the method, the problems that traditional SLAM accumulative errors are large and the BIM fusion precision is low are solved, robust positioning and map construction in a complex scene are achieved, the cooperation precision and real-time performance of SLAM and BIM are improved, and the method is suitable for AR scenes such as building construction and operation and maintenance.

The invention discloses a vehicle multi-modal trajectory prediction method based on an improved attention network, and belongs to the technical field of intelligent vehicle trajectory prediction, and the method comprises the steps: collecting historical trajectory data of a target vehicle and surrounding vehicles as an input sequence; secondly, constructing a vehicle multi-modal trajectory prediction model which comprises a motion feature extraction module, a space-time interaction module, a space-time fusion module and a trajectory output module; the motion feature extraction module uses a multi-scale convolution attention network and a gating circulation unit for processing, the space-time interaction module uses a dynamic graph attention network for extracting vehicle interaction information, and the space-time fusion module splices and fuses target vehicle motion features and space-time interaction features to obtain space-time fusion features; the track output module inputs the fusion features into a gating circulation unit, decodes the fusion features and then inputs the fusion features into a mixed density network, and multi-mode output of vehicle tracks is achieved; and finally, a proper loss function is selected for training, so that the prediction precision and the convergence speed of the model are improved.

The invention relates to the technical field of fault detection control, and discloses an automobile fault detection method and system fusing sensor data. The method comprises the following steps: modeling a multi-system sensor network through an automobile system topology mapping algorithm to obtain a sensor topology incidence matrix; performing synchronous processing on the sensor topological incidence matrix according to a vehicle dynamics constraint equation to obtain a synchronous multi-sensor data set; inputting the synchronous multi-sensor data set into a fault propagation path sensing network for fusion to obtain a vehicle system fault feature vector; detecting the fault feature vector based on an automobile physical model constraint optimizer to obtain a fault state recognition result; and tracing and controlling a fault state identification result according to the fault propagation atlas model to obtain a system adjustment control signal. According to the invention, the source identification accuracy of the complex coupling fault and the pertinence of control and adjustment are improved.

The invention discloses a road traffic flow prediction method based on a space-time mixed attention network, and the method breaks through the limitation of a conventional time sequence model and a single deep learning architecture based on the systematic analysis of urban road traffic flow space-time heterogeneity, periodic non-stationarity and road network topological relevance, constructs the space-time mixed attention network, and achieves the prediction of road traffic flow. Spatial heterogeneous correlation of road network nodes is captured through a graph convolution network, dynamic time sequence evolution characteristics of traffic flow are modeled by adopting a hybrid architecture, a residual attention mechanism is introduced to realize layer-by-layer refining of multi-scale spatio-temporal characteristics, and the overall architecture of the method has remarkable advantages in the aspects of spatial topology modeling and time dynamic capture compared with a traditional model. Feature decoupling learning is carried out on multi-source heterogeneous data such as weather and events, adaptive integration of environment sensitive features is realized through a parameterized gating fusion strategy, and the prediction error fluctuation amplitude in an extreme weather scene is reduced by 34.8%.

The invention discloses a self-adaptive control unmanned aerial vehicle flight path correction method and system, and relates to the technical field of unmanned aerial vehicle flight control, and the method comprises the steps: collecting flight environment data through a sensor group carried by an unmanned aerial vehicle, constructing a three-dimensional environment model, and dividing the three-dimensional environment model into space units, the real-time pose of the unmanned aerial vehicle is determined based on point cloud matching and pose estimation technologies, trajectory offset is predicted according to a preset flight path, flight trajectory deviation parameters are generated, and a triaxial compensation strategy of horizontal plane, vertical direction and lateral offset is analyzed through trend analysis of the deviation parameters. And finally performing dynamic compensation correction on the flight path of the unmanned aerial vehicle according to the three-axis adjustment amount. The technical problem that the real-time accurate correction efficiency of the flight path of an existing unmanned aerial vehicle in a complex environment is low is solved, and the technical effect of shortening the dynamic compensation response time of the flight path deviation of the unmanned aerial vehicle is achieved through an industrial automatic control system device manufacturing technology and an intelligent monitoring device.

The invention relates to the field of intelligent driving, in particular to a driver dangerous behavior intervention system and method based on a space-time diagram neural network, and the method comprises the steps: obtaining a physiological signal, a driving posture and control behavior data through a multi-modal data collection module; constructing a dynamic graph structure and evaluating a driver risk state by using a space-time diagram neural network risk perception engine; the intelligent intervention execution module adopts a tactile, visual or vehicle control intervention strategy according to the evaluation result; the closed-loop optimization module monitors an intervention effect and updates a risk model and a strategy; according to the system, millimeter wave radar and multi-channel visual analysis are fused, the recognition accuracy is improved to 98.6%, dangerous events are predicted 15-30 seconds in advance through physiological signals and micro-expression analysis, and sufficient response time is provided for a driver.

Disclosed herein are a system and a method for controlling multi-UAV cooperative tracking of a ground-moving target. The system includes UAVs, a processor, and a storage device. The UAVs are wirelessly communicatively connected to the processor. The processor is configured to generate a UAV command transmitted to the UAVs. The UAVs are configured to transmit tracking data to the processor. The processor includes a terrain building module, a flight simulation module, a UAV parameter generation module, a flight trajectory prediction module, a flight trajectory determination module, and a flight trajectory control module. The system provided in the embodiments of the present disclosure integrates Model Predictive Control (MPC) with an Improved Whale Optimization Algorithm (IWOA) to enhance the algorithm's convergence speed and precision, thereby improving the accuracy and stability of target tracking.

The invention proposes a bridge early warning method and system based on a physical information neural network and machine vision, and relates to the technical field of bridge early warning, and the method comprises the steps: setting a visual data collection system on a bridge; designing a known load calibration test, and collecting a preliminary calibration data set; collecting a preliminary random load data set; using an error correction algorithm to obtain a corrected random load data set; establishing a causal association database covering the dynamic response relationship between the vehicle and the bridge; constructing a physical information neural network model, and training a physical information neural network based on the causal association database to obtain a trained physical information neural network model; and acquiring bridge dynamic response data in real time, inputting the bridge dynamic response data into the trained physical information neural network model, performing online evaluation on the bridge operation state, checking abnormal response and generating an early warning signal. According to the method, the physical law and the machine learning algorithm are combined, and accurate online evaluation and anomaly detection of the bridge operation state are realized.

The invention discloses a traffic flow prediction method based on graph diffusion and dynamic graph fusion. The method comprises the following steps: S1, acquiring historical traffic flow time sequence data of each traffic node in a target road network; s2, preprocessing historical traffic flow time series data to obtain a road network node adjacency matrix; taking the historical traffic flow time sequence data and the road network node adjacency matrix as sample data, and dividing a training set, a verification set and a test set according to a preset proportion; s3, constructing a traffic flow prediction model based on graph diffusion and dynamic graph fusion; and S4, performing model training and verification on the traffic flow prediction model through the training set and the verification set to obtain an optimal traffic flow prediction model, and realizing traffic flow prediction of the test set through the optimal traffic flow prediction model. The problems that an existing method does not have the dynamic topology modeling capacity, the high heterogeneous feature fusion capacity and the self-adaptive space-time modeling capacity, and consequently the bottleneck problem of a current model in the aspects of prediction precision, stability and practicability cannot be effectively solved.

The invention provides a vehicle collision early warning method and system based on artificial intelligence, and the method comprises the steps: firstly obtaining a target vehicle multi-source sensor data set which comprises vehicle operation state, environment perception and driving behavior data sequences, each sequence is composed of standardized monitoring data, then carrying out the dynamic spatial-temporal feature extraction of the multi-source sensor data set, and carrying out the early warning of vehicle collision. The method comprises the following steps: generating dynamic space-time coding characteristics containing characteristics such as a vehicle movement trend, calling a pre-trained collision risk prediction model to carry out multi-dimensional risk association analysis on the dynamic space-time coding characteristics to obtain a risk prediction result containing a longitudinal collision risk level and the like, and constructing a real-time early warning strategy set based on the risk prediction result. And finally, deploying the set to a vehicle-mounted decision-making system, establishing a control instruction mapping relation with a vehicle execution mechanism, triggering real-time risk intervention operation, and realizing effective collision early warning and risk intervention.

The invention relates to an automatic driving large model training optimization method based on multi-scene data balance. Comprising the following steps: (1) constructing a real vehicle high-speed driving scene library; (2) constructing a visual language automatic driving large model, training by adopting an iterative training framework based on a real vehicle high-speed driving scene library, designing a multi-task joint loss function and a weight adaptive adjustment strategy, realizing multi-task target balance, and obtaining a trained visual language automatic driving large model; (3) dynamic simulation is carried out for the automatic driving working condition, and a high-fidelity simulation data test set is constructed based on simulation data; and (4) performing hyper-parameter optimization and lightweight processing on the trained visual language automatic driving large model according to the high-fidelity simulation data test set to obtain a scene data balanced automatic driving large model. According to the method, the large model reasoning speed is increased, and resource occupation is reduced, so that the judgment capability of the large model on dynamic working conditions and high-risk scenes is remarkably improved.

The invention discloses a visual language fused unmanned aerial vehicle aerial image open vocabulary semantic segmentation method, and relates to the technical field of multi-modal artificial intelligence. According to the method, a visual language fusion segmentation model is constructed based on multiple attention mechanisms, a multi-level fusion module and a dynamic adjustment mechanism, and it is ensured that high-precision and robust segmentation effects are achieved for known and unknown types of aerial images in a complex scene; global image information and local image details are extracted by using VIT and Mama models, dynamic balance of global and local features is realized by adopting adaptive weighted fusion, a local structure is enhanced by using deformable convolution, and accurate expression of whole scene semantics is ensured; a heterogeneous cross-modal graph fusion model is utilized to integrate a farther-distance cross-modal semantic relationship, and multi-dimensional information from vision, text and domain knowledge is continuously fused.

The invention relates to the technical field of signal devices, and discloses a traffic signal control method and system based on vehicle-road cloud multi-modal data fusion, and the method comprises the steps: collecting multi-modal traffic data synchronously in real time through a vehicle-end sensor, road-side sensing equipment and a cloud Internet platform; fusing the heterogeneous data by adopting a space-time alignment algorithm, and constructing a standardized space-time feature matrix; traffic flow prediction is carried out based on a multi-layer space-time diagram neural network trained by a federated learning mechanism, and a signal control instruction is generated through reinforcement learning and a multi-objective optimization model; and issuing the green wave parameter, the dynamic timing scheme and the cross-domain coordination strategy to a roadside signal machine through the cloud edge coordination architecture to execute control. The problems that in the prior art, low-delay private network communication cannot be achieved, the data fusion efficiency is low, unmanned driving is not supported, and the deployment cost is high are solved, and the purposes of low-delay communication, high reliability and low risk are achieved.

The invention relates to the technical field of highway engineering informatization, in particular to a geometric registration method and system based on a BIM model and an AR real scene. The method comprises the following steps: obtaining multi-source data of a construction site, and generating an AR real scene of the construction site according to the multi-source data; fusing multi-source data to obtain accurate parameters of the construction equipment; calculating a spatial transformation matrix of a construction site through accurate parameters of construction equipment, and obtaining an initial registration result of the BIM model and the AR real scene by combining engineering characteristics and the spatial transformation matrix; a dynamic error compensation mechanism is introduced, the initial registration result is corrected through the dynamic error compensation mechanism, and a local registration result is obtained; and constructing a global and local coordinate system mapping optimization model, and mapping the local registration result to a global coordinate system by using the global and local coordinate system mapping optimization model to obtain a global registration result. According to the method, a reliable spatial data basis is provided for highway engineering quality inspection, construction guidance and defect identification.