The invention discloses a traffic
large model construction and decision-making method and device based on multi-
modal two-way map reasoning, and the method comprises the steps: constructing a multi-
modal data set of a text, an image and a track, generating fusion features through spatial-temporal clustering and cross-
modal Transform coding, carrying out the two-way map reasoning in combination with a traffic knowledge map, and carrying out the decision-making of the traffic
large model. The method comprises the following steps: generating an embedded representation through a forward graph neural network, reversely mapping a
decision scheme generated by a
language model to a graph to verify consistency, outputting knowledge to enhance embedding, fusing multi-modal features and knowledge embedding by adopting an LoRA multi-task joint
fine tuning technology, adapting to traffic field tasks, deploying a real-time
inference engine, and carrying out real-time
inference on the traffic field. And
processing the
dynamic data flow through an aging
perception attention mechanism, and outputting traffic event identification, path planning and scene question and answer results in parallel. Compared with the prior art, the method has the advantages that the problems of insufficient multi-source heterogeneous data fusion, low knowledge utilization efficiency and poor real-time decision consistency can be solved, and the semantic understanding and decision accuracy of the traffic
large model is effectively improved.