Three-dimensional traffic guidance information publishing system and method based on multi-modal perception information decision and terminal

Abstract

The application discloses a three-dimensional traffic guide information publishing system and method based on multi-modal perception information decision and a terminal. The system collects multi-modal traffic environment data in real time, performs multi-modal fusion processing by an edge management and control cooperation unit, generates a traffic guide information publishing strategy, realizes three-dimensional space traffic guide information output of air-ground integration through a ground variable sign screen, an information board and a plurality of types of lamp control equipment, and optimizes and adjusts the publishing strategy by the edge management and control cooperation unit. The application can overcome defects of single guide dimension, obvious visual blind area, poor low-visibility visual recognition, lack of unified scheduling of lamp control and excessive dependence on manual monitoring, and realizes three-dimensional guide of air-ground integration and timely response, thereby significantly improving the fine management level and active safety protection capability of intersections and intelligent highways.

Description

Technical Field

[0001] This invention relates to the field of intelligent transportation, and in particular to a three-dimensional traffic guidance information dissemination system, method and terminal based on multimodal perception information decision-making. Background Technology

[0002] With the rapid development of LED display and Internet of Things (IoT) technologies, and the widespread application of Intelligent Transportation Systems (ITS), LED display equipment has become a core carrier for information dissemination and route guidance in modern transportation hubs. In current smart highway and intersection deployments, the system typically consists of a central station, roadside stations, and vehicle-mounted stations, using V2X technology to facilitate information exchange between vehicles and roads, and between vehicles and pedestrians. Traditional guidance methods mainly rely on aerial gantry-mounted information boards (VMS) and road signage, as well as mid-level traffic lights. These devices can provide good guidance under standard conditions, and some systems have achieved cluster control and asynchronous publishing, supporting the display of text, images, videos, and sensor data.

[0003] However, existing traffic guidance systems reveal significant problems in complex scenarios. First, guidance dimensions are limited, and high-position information boards have blind spots, especially in low-visibility weather conditions such as rain, snow, and fog, where drivers' ability to recognize close-range road guidance information decreases sharply. Second, flashing warning lights, low-position guidance lights, road marking lights, and traffic lights are controlled independently, without unified management and scheduling. Furthermore, the system lacks a robust security loop; the identification of unauthorized alteration or physical damage to screen content still relies excessively on manual monitoring, lacking a real-time anomaly verification and emergency response mechanism based on visual AI. Summary of the Invention

[0004] In view of the shortcomings of the prior art described above, the purpose of this invention is to provide a three-dimensional traffic guidance information release system, method and terminal based on multimodal perception information decision-making, to solve the problems of single guidance dimension, independent operation of various light control devices and lack of perfect safety closed loop in the existing traffic guidance system.

[0005] To achieve the above and other related objectives, a first aspect of the present invention provides a three-dimensional traffic guidance information dissemination system based on multimodal perception information decision-making, comprising: an environmental perception and data acquisition unit, an edge control and coordination unit, a remote monitoring unit, an information dissemination unit, a traffic light control unit, and a vehicle unit; the environmental perception and data acquisition unit is used to collect multimodal traffic environment data in real time; wherein the multimodal traffic environment data includes at least: lane perception information, road surface condition information, environmental parameter information, and equipment condition information; the edge control and coordination unit is communicatively connected to the environmental perception and data acquisition unit, used to perform multimodal fusion processing on the multimodal traffic environment data, generate a traffic guidance information dissemination strategy, and upload the traffic guidance information dissemination strategy to the remote monitoring unit; the remote monitoring unit is communicatively connected to the edge control and coordination unit, used to perform cloud-based monitoring of the entire road network equipment data, and to review the traffic guidance information dissemination strategy. The results are fed back to the edge control and coordination unit, which then sends the approved traffic guidance information release strategy to the information release unit, the lighting control unit, and the vehicle unit. The information release unit, which is communicatively connected to the edge control and coordination unit, is used to output the approved traffic guidance information release strategy in three-dimensional space. The lighting control unit, which is also communicatively connected to the edge control and coordination unit, is used to drive and control lighting and signal indication equipment according to the approved traffic guidance information release strategy. The vehicle unit, which is also communicatively connected to the edge control and coordination unit, is used to receive and display the approved traffic guidance information release strategy on the in-vehicle terminal to assist the vehicle in making corresponding driving decisions. The environmental perception and data acquisition unit is also used to monitor the three-dimensional spatial output results of the information release unit and send the monitoring results to the edge control and coordination unit in real time to optimize the traffic guidance information release strategy, thereby providing feedback and adjustment to the three-dimensional spatial output of the information release unit.

[0006] In some embodiments of the first aspect of the present invention, the environmental perception and data acquisition unit includes at least: a lane perception acquisition module, a road surface condition acquisition module, an environmental parameter acquisition module, an equipment status acquisition module, an environmental perception communication module, and an environmental perception processor module; wherein, the lane perception acquisition module acquires lane perception information based on multi-source perception data; the road surface condition acquisition module acquires road surface condition information based on road surface condition sensors; the environmental parameter acquisition module acquires environmental parameter information based on environmental sensors; the equipment status acquisition module acquires equipment status information; the environmental perception communication module aggregates data among the modules within the unit and interacts with the edge control and coordination unit; the environmental perception processor module preprocesses and annotates the data of each module within the unit acquired by the environmental perception communication module, and sends it to the edge control and coordination unit through the environmental perception communication module.

[0007] In some embodiments of the first aspect of the present invention, the edge control and coordination unit includes at least: a data backup module, an automatic work order and inspection module, an edge control ITS integrated communication module, an edge control communication module, and an edge control processor module; wherein, the data backup module is used for local storage and disaster recovery of key operational data at the intersection, and synchronizes the key operational data at the intersection to the remote monitoring unit; the automatic work order and inspection module generates maintenance work orders based on abnormal information and triggers the inspection terminal to verify the fault; the edge control ITS integrated communication module is used for vehicle-road cooperative data interaction between multiple nodes in the traffic system, and sends road condition information, abnormal warning information, and navigation data to the vehicle terminal in real time; the edge control communication module realizes data interaction within and between units based on multiple communication networks; the edge control processor module generates a traffic guidance information release strategy based on the multimodal fusion processing results, and uploads the traffic guidance information release strategy to the remote monitoring unit through the edge control communication module.

[0008] In some embodiments of the first aspect of the present invention, the remote monitoring unit includes at least: a cloud monitoring platform module, a traffic management platform module, and a remote monitoring ITS integrated communication module; wherein, the cloud monitoring platform module is used for cloud-based integrated management, data aggregation, remote release and review, and remote monitoring of all road network equipment; the traffic management platform module is used for connecting to an external traffic management system and receiving traffic control instructions; and the remote monitoring ITS integrated communication module is used for data exchange with the edge control collaboration unit.

[0009] In some embodiments of the first aspect of the present invention, the information publishing unit includes at least: a ground variable signage screen module, an information board display module, a blind spot detection display module, a road indication module, and an information publishing communication module; wherein, the ground variable signage screen module outputs an approved traffic guidance information publishing strategy based on the ground variable signage screen; the information board display module publishes real-time road condition information, guidance prompts, and weather warnings based on the approved traffic guidance information publishing strategy; the blind spot detection display module is used to monitor the vehicle status in the blind spot in real time and output collision prevention prompt information; the road indication module is used to control the lane indication screen to indicate the traffic status of each lane; and the information publishing communication module is used to receive control commands and data update commands from the edge control coordination unit to each module within the unit.

[0010] In some embodiments of the first aspect of the present invention, the light control unit includes at least: a road marking light control module and a light control communication module; wherein, the road marking light control module changes the road marking display status in real time based on an approved traffic guidance information release strategy; and the light control communication module is used to receive control commands from the edge control coordination unit.

[0011] In some embodiments of the first aspect of the present invention, the vehicle unit includes at least: an in-vehicle display module, a vehicle ITS integrated communication module, and a vehicle processor module; wherein, the in-vehicle display module is used to display the approved traffic guidance information release strategy; the vehicle ITS integrated communication module is used to interact with the edge control and coordination unit; and the vehicle processor module is used to process the approved traffic guidance information release strategy and output it to the in-vehicle display module.

[0012] In some embodiments of the first aspect of the present invention, the monitoring of the three-dimensional spatial output of the information publishing unit and the real-time transmission of the monitoring results to the edge control and coordination unit to optimize the traffic guidance information publishing strategy, so as to provide feedback adjustment to the three-dimensional spatial output of the information publishing unit, includes: the device status acquisition module monitoring the three-dimensional spatial output of the information publishing unit based on monitoring and telemetry equipment to obtain monitoring results; and the environmental perception communication module transmitting the monitoring results to the edge control and coordination unit in real time to optimize the traffic guidance information publishing strategy, so as to provide feedback adjustment to the three-dimensional spatial output of the information publishing unit.

[0013] To achieve the above and other related objectives, a second aspect of the present invention provides a method for disseminating three-dimensional traffic guidance information based on multimodal perception information decision-making, applicable to any of the three-dimensional traffic guidance information dissemination systems based on multimodal perception information decision-making as described above. The method includes: real-time acquisition of multimodal traffic environment data; wherein the multimodal traffic environment data includes at least: lane perception information, road surface condition information, environmental parameter information, and equipment condition information; multimodal fusion processing of the multimodal traffic environment data to generate a traffic guidance information dissemination strategy; reviewing the traffic guidance information dissemination strategy and disseminating the approved strategy; and monitoring the disseminated traffic guidance information dissemination strategy and optimizing the monitoring results.

[0014] To achieve the above and other related objectives, a third aspect of the present invention provides an electronic terminal, including a memory, a processor, and a computer program stored in the memory; the processor executes the computer program to implement the method described above.

[0015] As described above, the present invention has the following beneficial effects:

[0016] This invention discloses a three-dimensional traffic guidance information dissemination system, method, and terminal based on multimodal perception information decision-making. The system collects multimodal traffic environment data in real time, which is then fused by an edge control and coordination unit to generate a traffic guidance information dissemination strategy. This strategy is then implemented through ground-based variable message signs, information boards, and various traffic light control devices to output integrated air-ground three-dimensional spatial traffic guidance information. The edge control and coordination unit also optimizes and adjusts the dissemination strategy. This invention overcomes the shortcomings of traditional guidance methods, such as single-dimensional guidance, significant blind spots, poor visibility in low-visibility conditions, lack of unified traffic light control scheduling, and excessive reliance on manual monitoring. It achieves integrated air-ground, timely, three-dimensional guidance, significantly improving the level of refined management and proactive safety protection capabilities at intersections and on smart highways. Attached Figure Description

[0017] Figure 1 The diagram shown is a structural schematic of a three-dimensional traffic guidance information dissemination system based on multimodal perception information decision-making according to an embodiment of the present invention.

[0018] Figure 2 The diagram shown is a schematic representation of the internal structure of a three-dimensional traffic guidance information dissemination system based on multimodal perception information decision-making, according to an embodiment of the present invention.

[0019] Figure 3 This is a schematic diagram illustrating the execution flow of the deployment strategy by the ground variable signage screen module in one embodiment of the present invention.

[0020] Figure 4 The diagram shown is a flowchart illustrating a three-dimensional traffic guidance information dissemination method based on multimodal perception information decision-making in one embodiment of the present invention.

[0021] Figure 5 The diagram shown is a structural schematic of an electronic terminal according to an embodiment of the present invention. Detailed Implementation

[0022] The following specific examples illustrate the implementation of the present invention. Those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that, unless otherwise specified, the following embodiments and features described therein can be combined with each other.

[0023] In embodiments of the present invention, the terms "first" and "second" are used to distinguish identical or similar items with essentially the same function and effect. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and that the terms "first" and "second" do not necessarily imply that they are different.

[0024] It should be noted that in the embodiments of the present invention, the words "exemplary" or "for example" indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the present invention should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of the words "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0025] In this embodiment of the invention, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0026] Before providing a further detailed description of the present invention, the nouns and terms used in the embodiments of the present invention are explained, and the nouns and terms used in the embodiments of the present invention are subject to the following interpretations:

[0027] <1> Intelligent Transportation Systems (ITS) are comprehensive transportation systems that rely on modern information technology, communication, sensing, control, big data, artificial intelligence, and other advanced technologies to achieve integrated perception, analysis, scheduling, and management of all elements of roads, vehicles, pedestrians, and traffic facilities. Their core concept is to empower traditional transportation with technology, replacing and supplementing manual management to achieve collaborative operation among people, vehicles, roads, and the cloud.

[0028] <2> V2X, or Vehicle to Everything, is a core communication technology for intelligent transportation systems (ITS), vehicle-to-everything (V2X) systems, and autonomous driving. It means that vehicles can wirelessly exchange real-time, two-way data on location, speed, road conditions, and warnings with all other road users, overcoming the limitations of line-of-sight perception provided by onboard cameras and radar to achieve beyond-line-of-sight collaborative perception.

[0029] <3> VMS, or Variable Message Sign, is a core roadside field device of the ITS (Intelligent Transportation System) and a vehicle-to-infrastructure (V2I) interactive carrier. Using an outdoor high-brightness LED display screen, it receives remote commands from the traffic control center and dynamically switches between text, graphics, speed limits, and road condition prompts in real time, proactively providing drivers with road information ahead and enabling traffic guidance.

[0030] <4> VOC, or Volatile Organic Compound, is a commonly used term in my country's air quality monitoring system. It refers to all volatile organic compounds with a saturated vapor pressure >70 Pa at room temperature, a boiling point <260℃ at room pressure, or a vapor pressure ≥10 Pa at 20℃. In environmental contexts, it specifically refers to reactive organic compounds that can participate in atmospheric photochemical reactions and generate pollution.

[0031] <5> Disaster recovery refers to a comprehensive protection system that ensures uninterrupted business operations and data integrity when an information system encounters various disasters such as hardware and software failures, power outages, fires, floods, cyberattacks, and data center damage, through supporting hardware and software, multi-site redundancy, data backup, and failover technologies and management solutions.

[0032] To facilitate understanding of the embodiments of the present invention, firstly, in conjunction with Figure 1 Detailed explanation. Figure 1 This illustration shows a structural diagram of a three-dimensional traffic guidance information dissemination system based on multimodal perception information decision-making according to an embodiment of the present invention. The three-dimensional traffic guidance information dissemination system based on multimodal perception information decision-making in this embodiment mainly includes: an environmental perception and data acquisition unit 1, an edge control and coordination unit 2, a remote monitoring unit 3, an information dissemination unit 4, a traffic light control unit 5, and a vehicle unit 6.

[0033] The environmental perception and data acquisition unit 1 is used to acquire multimodal traffic environment data in real time; wherein, the multimodal traffic environment data includes at least: lane perception information, road surface condition information, environmental parameter information and equipment status information;

[0034] Edge control and coordination unit 2 is communicatively connected to environmental perception and data acquisition unit 1. It is used to perform multimodal fusion processing on the multimodal traffic environment data, generate a traffic guidance information release strategy, and upload the traffic guidance information release strategy to remote monitoring unit 3.

[0035] The remote monitoring unit 3 is communicatively connected to the edge control and coordination unit 2. It is used to monitor the data of the entire road network equipment in the cloud and to feed back the review results of the traffic guidance information release strategy to the edge control and coordination unit 2, so that the edge control and coordination unit 2 can send the approved traffic guidance information release strategy to the information release unit 4, the light control unit 5 and the vehicle unit 6.

[0036] Information publishing unit 4 is communicatively connected to the edge control and coordination unit and is used to output the approved traffic guidance information publishing strategy in three-dimensional space.

[0037] Lighting control unit 5 is communicatively connected to the edge control and coordination unit and is used to drive and control lighting and signal indication equipment according to the approved traffic guidance information release strategy.

[0038] The vehicle unit 6 is communicatively connected to the edge control and coordination unit and is used to receive and display the approved traffic guidance information release strategy on the in-vehicle terminal to assist the vehicle in making corresponding driving decisions.

[0039] The environmental perception and data acquisition unit 1 is also used to monitor the three-dimensional spatial output of the information release unit 4 and send the monitoring results to the edge control and coordination unit 2 in real time to optimize the traffic guidance information release strategy, so as to provide feedback and adjustment to the three-dimensional spatial output of the information release unit 4.

[0040] To facilitate understanding of the embodiments of the present invention, in conjunction with Figure 2 Detailed explanation. Figure 2 This illustration shows the internal structure of a three-dimensional traffic guidance information dissemination system based on multimodal perception information decision-making, according to an embodiment of the present invention.

[0041] In one embodiment, the environmental perception and data acquisition unit 1 includes at least: a lane perception acquisition module, a road surface condition acquisition module, an environmental parameter acquisition module, an equipment status acquisition module, an environmental perception communication module, and an environmental perception processor module; wherein, the lane perception acquisition module acquires lane perception information based on multi-source perception data; the road surface condition acquisition module acquires road surface condition information based on road surface condition sensors; the environmental parameter acquisition module acquires environmental parameter information based on environmental sensors; the equipment status acquisition module acquires equipment status information; the environmental perception communication module aggregates data from various modules within the unit and interacts with the edge control and coordination unit 2; the environmental perception processor module preprocesses and annotates the data from various modules within the unit acquired by the environmental perception communication module, and sends it to the edge control and coordination unit 2 through the environmental perception communication module.

[0042] In one embodiment, the monitoring of the three-dimensional spatial output of the information publishing unit 4 and the real-time transmission of the monitoring results to the edge control and coordination unit 2 to optimize the traffic guidance information publishing strategy, so as to provide feedback adjustment to the three-dimensional spatial output of the information publishing unit 4, includes: the device status acquisition module monitoring the three-dimensional spatial output of the information publishing unit 4 based on monitoring and telemetry equipment to obtain monitoring results; and the environmental perception communication module transmitting the monitoring results to the edge control and coordination unit 2 in real time to optimize the traffic guidance information publishing strategy, so as to provide feedback adjustment to the three-dimensional spatial output of the information publishing unit 4.

[0043] Specifically, the environmental perception and data acquisition unit 1 is deployed at the road network end, serving as the "tentacles" of the three-dimensional traffic guidance system, responsible for real-time acquisition of multimodal traffic environment data. Its main components include road network end-side lane driving perception devices, road surface condition acquisition devices, atmospheric environment acquisition devices, and end-side device status acquisition devices. Real-time data exchange is achieved with the edge control and coordination unit 2 through the environmental perception communication module.

[0044] The lane perception and data acquisition module utilizes technologies such as geomagnetism, radar, and video analytics to acquire lane perception information including traffic flow, abnormal lane occupancy, and traffic violations. Traffic flow information includes vehicle volume and average speed. Geomagnetic sensors are buried beneath the lanes, radar is installed on the roadside, and video cameras capture real-time traffic footage.

[0045] The road surface condition acquisition module collects road surface condition information, such as the road surface slip coefficient, the thickness of snow, ice, or water cover, and the road surface temperature, through road surface condition sensors. These sensors are installed on the road surface or roadside to monitor road conditions in real time, providing a basis for subsequent traffic guidance strategies.

[0046] The environmental parameter acquisition module uses environmental sensors to collect information on environmental parameters such as atmospheric pressure, wind speed, wind direction, temperature and humidity, noise, rainfall, VOCs, PM2.5, PM10, and visibility. These sensors are distributed at different locations in the road network to ensure the comprehensiveness and accuracy of the environmental data.

[0047] The equipment status acquisition module acquires equipment status information, such as electrical parameters, operating status, and fault information, of hardware like controllers, screens, and lights, through camera monitoring of text and image information and telemetry. The camera is installed near the equipment, while the telemetry device is embedded inside to ensure real-time monitoring of the equipment status. The equipment status acquisition module can also monitor the three-dimensional spatial output of the information publishing unit 4 based on the monitoring and telemetry equipment to obtain monitoring results. Specifically, the equipment status acquisition module monitors the display results of hardware such as screens and lights through camera monitoring of text and image information and telemetry to detect whether hardware failures are causing errors in the traffic guidance information publishing strategy.

[0048] The environmental perception and communication module employs multiple communication methods, including Ethernet, fiber optic, industrial bus, Bluetooth, wireless LAN, and 4G, to aggregate data from various modules within the unit and interact with the edge control and coordination unit 2. The environmental perception and communication module also transmits the monitoring results from the equipment status acquisition module to the edge control and coordination unit 2 in real time to optimize traffic guidance information dissemination strategies, thereby providing feedback and adjustments to the three-dimensional spatial output of the information dissemination unit 4.

[0049] The environmental perception processor module is responsible for preprocessing and multi-dimensional feature annotation of the data collected by various modules within the environmental perception and data acquisition unit 1, and then sending the processed data to the edge control and coordination unit 2 via the environmental perception communication module. The environmental perception processor module not only processes data but also performs fault monitoring and module management, serving as the control center of the environmental perception and data acquisition unit 1. The preprocessing and multi-dimensional feature annotation include: initial cleaning of the collected data, time stamping, device status stamping, and communication status stamping.

[0050] Preferably, each module of the environmental perception and data acquisition unit 1 automatically completes data acquisition, processing, and transmission according to predetermined procedures and rules. For example, during a typical traffic peak, the lane perception acquisition module monitors traffic flow and speed in real time, the road surface condition acquisition module monitors road conditions, the environmental parameter acquisition module collects current weather information, and the equipment status acquisition module checks the operating status of all equipment. After being processed and labeled by the environmental perception processor module, this data is promptly sent to the edge control and coordination unit 2, providing accurate and comprehensive data support for subsequent traffic guidance information dissemination.

[0051] In one embodiment, the edge control and coordination unit 2 includes at least: a data backup module, an automatic work order and inspection module, an edge control ITS integrated communication module, an edge control communication module, and an edge control processor module; wherein, the data backup module is used for local storage and disaster recovery of key intersection operation data, and synchronizes the key intersection operation data to the remote monitoring unit; the automatic work order and inspection module generates maintenance work orders based on abnormal information and triggers the inspection terminal to verify the fault; the edge control ITS integrated communication module is used for vehicle-road cooperative data interaction between multiple nodes in the traffic system, and sends road condition information, abnormal warning information, and navigation data to the vehicle terminal in real time; the edge control communication module realizes data interaction within and between units based on multiple communication networks; the edge control processor module generates a traffic guidance information release strategy based on the multimodal fusion processing results, and uploads the traffic guidance information release strategy to the remote monitoring unit through the edge control communication module.

[0052] Specifically, the edge control coordination unit 2, as the core control hub of the system, undertakes the key tasks of data processing, strategy generation, and global linkage. The edge control coordination unit 2 possesses local independent decision-making and multi-device linkage capabilities, and is internally configured with a data backup module, an automatic work order and inspection module, an edge control ITS integrated communication module, an edge control communication module, and an edge control processor module. Furthermore, the edge control coordination unit 2 optimizes the traffic guidance information dissemination strategy based on the monitoring results of the device status acquisition module, providing feedback adjustments to the three-dimensional spatial output of the information dissemination unit 4. The edge control coordination unit 2 coordinates with other units within the system to jointly realize the three-dimensional traffic guidance information dissemination based on multimodal perception information decision-making.

[0053] The edge control processor module includes a linkage strategy publishing module and a dynamic attribute adjustment module. The linkage strategy publishing module continuously monitors various specific conditions during system operation. When data reported by the environmental perception and data acquisition unit 1 indicates specific conditions such as a traffic accident, abnormal lane occupancy, or a smoke / fire alarm, the edge control processor module determines these abnormal events, and the linkage strategy publishing module automatically triggers the response mechanism. This module sends instructions to the designated display screen in the information publishing unit 4, for example, controlling the ground variable signage screen module or information board display module to play preset alarm programs, and simultaneously sending instructions to the traffic light control unit 5 to turn off the indicator lights of the corresponding lanes or adjust the traffic light status, thereby simultaneously implementing traffic intervention in both physical and display spaces.

[0054] The dynamic attribute adjustment module is primarily used to achieve flexible allocation of lane resources. Based on real-time traffic flow data acquired by the environmental perception and data acquisition unit 1, the edge control processor module calculates the optimal lane attribute and lane width configuration. The dynamic attribute adjustment module converts this configuration into control commands and synchronizes them to the information publishing unit 4. For example, during morning and evening rush hours, it automatically adjusts the attribute of a lane from straight to left turn and updates lane indicator signs on information boards, road sign screens, and other display devices to alleviate traffic congestion.

[0055] The data backup module is responsible for ensuring high availability and data security of the system. This module continuously stores and performs disaster recovery backups of key intersection operational data, multimodal traffic environment data, and generated traffic guidance information dissemination strategies locally. Simultaneously, the data backup module establishes a data synchronization link with the remote monitoring unit 3 through the edge control communication module, periodically or during network downtime, uploading key local data to the cloud monitoring platform module to ensure data consistency between the cloud and the edge, providing support for subsequent big data analysis.

[0056] The automatic work order and inspection module realizes an automated closed loop for system operation and maintenance. When the edge control processor module detects an anomaly in the system's equipment, or identifies anomalies in the displayed content of ground variable signage screens, landscape lighting, or information boards through video image analysis (such as illegal tampering or physical damage to the screen), the automatic work order and inspection module immediately generates an operation and maintenance work order and dispatches it to the management personnel terminal. Furthermore, this module can also dispatch drones or inspection robots deployed around the intersection to specific anomaly locations for detailed measurement and fault verification, and transmit the verification results back to the edge control collaboration unit 2 to update the equipment status.

[0057] The edge control ITS integrated communication module is a key data channel for realizing vehicle-road cooperation. This module is mainly responsible for the exchange of information between multiple nodes, including vehicles and pedestrians, vehicles and vehicles, and vehicles and roads. Through this module, the edge control coordination unit 2 sends real-time traffic information, abnormal warning information, navigation data, and guidance actions from traffic guidance information release strategies to the vehicle terminal of the vehicle unit 6 in real time, assisting the vehicle in making corresponding driving decisions. At the same time, this module also receives status information from vehicles and inputs it into the edge control processor module as part of the multimodal traffic environment data.

[0058] The edge control communication module, serving as the underlying network support, is primarily responsible for providing stable and reliable network services to various end-side units. This module includes wired uplinks such as fiber optics or Ethernet, as well as wireless uplink networks such as 5G base stations and access point (AP) hotspots. Through the edge control communication module, the system achieves internal network aggregation and management, ensuring high-speed data interaction between the environmental perception and data acquisition unit 1, information publishing unit 4, lighting control unit 5, and edge control collaboration unit 2, and providing a communication foundation for remote publishing and review by the remote monitoring unit 3.

[0059] As the computing hub at the edge, the edge control processor module undertakes the core functions of local edge computing and information collection and aggregation processing. This module receives multimodal traffic environment data from the environmental perception and data acquisition unit 1, performs multi-dimensional data processing such as time alignment, spatial mapping, anomaly removal, and missing data completion, and obtains multi-dimensional features such as data integrity rate, timeliness, equipment health, and historical errors. It calculates the credibility of each feature and merges data from the same lane, the same direction, or the same release area to form comprehensive status information such as traffic status, road risk, environmental risk, equipment availability, and event status.

[0060] Preferably, the formula for calculating the confidence level of each feature is as follows:

[0061] ;

[0062] in, Indicates the first The credibility of each feature in the current window; Indicates data integrity rate; Indicates the timeliness score; Indicates the health status of the equipment; Indicates historical error; Configurable weights.

[0063] The edge control processor module determines traffic conditions and identifies risks based on comprehensive status information: if it detects a decrease in average vehicle speed, an increase in lane occupancy, or an increase in queue length, it judges it as congestion or decreased traffic efficiency; if it detects abnormal parking, accidents blocking lanes, wrong-way driving, or littering, it judges it as lane abnormality or accident risk; if it detects decreased visibility, slippery road surface, water accumulation, snow accumulation, or ice, it judges it as environmental or road risk; if it detects communication abnormalities, display abnormalities, or controller malfunctions of the ground variable signage module, it judges it as equipment risk.

[0064] The linkage strategy publishing module and the dynamic attribute adjustment module generate traffic guidance information publishing strategies based on event type, risk level, lane status, traffic management constraints, equipment availability, and instructions from remote monitoring units. These publishing strategies include guidance actions, publishing locations, display duration, priority, coordinating units, and verification rules.

[0065] The guidance actions include at least left turn, straight ahead, right turn, no entry, deceleration, yielding, lane merging, maintaining distance, and restoring traffic flow. The release points are determined based on the installation location of the ground variable signage module, lane number, stop line location, diversion point location, and the scope of event impact. The display duration is determined based on the event duration, signal cycle, traffic flow changes, and instructions from the remote monitoring unit 3. If the event is resolved or the strategy expires, the edge control coordination unit 2 should cancel the corresponding release content or switch to the restored traffic flow content. The priority is determined according to the principle of safety priority. For example, safety events such as accidents, wrong-way driving, pedestrian intrusion, low visibility, road icing, signal anomalies, and display anomalies have higher priority than general congestion guidance and efficiency optimization strategies. The coordination unit identifier refers to the unit or module that works synchronously with the ground variable signage module, including the information board display module, road indication module, blind spot detection display module in the information release unit 4, as well as the lighting control unit and vehicle unit. The verification rules are used to define the expected display content, color, brightness, display area, refresh time, and communication status that the equipment status acquisition module needs to verify.

[0066] After the release strategy is generated, it is uploaded by the edge control processor module to the remote monitoring unit 3 for review through the edge control communication module, and the edge control collaboration unit 2 then collaboratively releases the approved traffic guidance information release strategy to each unit.

[0067] The edge control processor module is also used to optimize the traffic guidance information release strategy based on the monitoring results of the device status acquisition module, so as to perform closed-loop verification and correction of the actual display results of the information release unit 4.

[0068] Specifically, such as Figure 3 The diagram shown illustrates the execution flow of the information publishing strategy by the ground variable signage screen module in a specific embodiment. The edge control processor module performs closed-loop verification and correction of the actual display results of the information publishing unit 4, including:

[0069] Step S211: Verify the actual display results based on the monitoring results of the equipment status acquisition module; wherein, the actual display results include at least the guidance actions output by the ground variable signage screen module based on the traffic guidance information release strategy;

[0070] Step S212: If the verification is consistent, the edge control coordination unit 2 records the actual display result, verification result and traffic status change, and enters the next round of perception and release;

[0071] Step S213: If the verification is inconsistent, the edge control and coordination unit 2 shall perform corrective action according to the abnormal status; wherein, the abnormal status includes at least general abnormality, abnormality affecting guidance accuracy, abnormality affecting traffic safety, and abnormality suspected of illegal tampering or physical damage.

[0072] Furthermore, the corrective measures for each abnormal state include:

[0073] General anomalies: Automatic work orders and inspection modules generate work orders, remote monitoring unit 3 receives the anomaly status, and the system continues to monitor.

[0074] Abnormal impact on guidance accuracy: Edge control coordination unit 2 cancels the content published by the ground variable signage screen module, and replaces it with the information board display module, road indication module, light control unit 5 or vehicle unit 6.

[0075] Anomalies affecting traffic safety: Triggering the warning flashing light control module, the low-position guide light control module, or a V2X alarm; if necessary, requesting manual takeover from the remote monitoring unit 3.

[0076] Suspected illegal tampering or physical damage: The automatic work order and inspection module dispatch drones, inspection robots or manual inspections to verify the issue, and upload information such as screenshots of the anomaly, equipment number, location, time and handling records to the remote monitoring unit 3.

[0077] In one embodiment, the remote monitoring unit 3 includes at least: a cloud monitoring platform module, a traffic management platform module, and a remote monitoring ITS integrated communication module; wherein, the cloud monitoring platform module is used for cloud-based integrated management, data aggregation, remote release and review, and remote monitoring of all road network equipment; the traffic management platform module is used to connect to an external traffic management system and receive traffic control instructions; and the remote monitoring ITS integrated communication module is used for data exchange with the edge control collaboration unit 2.

[0078] Specifically, the remote monitoring unit 3, as a key component of the entire transportation system, is designed to achieve efficient management of all road network equipment and precise control of data. This unit includes at least a cloud-based monitoring platform module, a traffic management platform module, and a remote monitoring ITS integrated communication module. These three modules work together to ensure the stable operation and intelligent management of the transportation system.

[0079] The cloud-based monitoring platform module is the core component of remote monitoring unit 3, responsible for the integrated cloud management of all road network equipment. This module collects and aggregates data from various road sections and equipment in real time, analyzes and processes it, and then distributes the processed information and instructions to relevant equipment or departments through a remote release and review mechanism. Furthermore, the cloud-based monitoring platform module also has remote monitoring capabilities, enabling it to monitor the operational status of all road network equipment in real time, promptly identify and resolve potential problems, and ensure the normal operation of the system.

[0080] The traffic management platform module is used to interface with external traffic management systems. It receives traffic control instructions from higher-level traffic management departments and adjusts and synchronizes the status of traffic signals accordingly.

[0081] The remote monitoring ITS integrated communication module is a crucial component for V2X (vehicle-to-everything) information exchange. It facilitates data interaction between remote monitoring systems and roadside equipment, enabling information connectivity with onboard devices and forming a complete vehicle-to-everything network. Based on this module, vehicles can obtain real-time road condition information, traffic signal status, and other data, allowing them to make more informed driving decisions and improve road efficiency and safety.

[0082] In one embodiment, the information publishing unit 4 includes at least: a ground variable signage screen module, an information board display module, a blind spot detection display module, a road indication module, and an information publishing communication module; wherein, the ground variable signage screen module outputs approved traffic guidance information publishing strategies based on the ground variable signage screen; the information board display module publishes real-time road condition information, guidance prompts, and weather warnings based on the approved traffic guidance information publishing strategies; the blind spot detection display module is used to monitor the status of vehicles in blind spots in real time and output collision prevention prompts; the road indication module is used to control the lane indication screen to indicate the traffic status of each lane; and the information publishing communication module is used to receive control commands and data update commands from the edge control and coordination unit to each module within the unit.

[0083] Specifically, the information release unit 4, through the coordinated operation of the ground variable sign screen module, information board display module, blind spot detection display module, road indication module, and information release communication module, comprehensively and multi-dimensionally releases the traffic guidance information release strategy, providing drivers with timely and accurate traffic guidance, and effectively improving road traffic safety and traffic efficiency.

[0084] The variable signage module is mainly installed below the road surface and includes a variable signage display. Based on the guidance actions in the traffic guidance information dissemination strategy, it dynamically displays traffic arrow indicators such as left turn, straight ahead, and right turn, along with text, and the colors are controllable.

[0085] The information display module is mainly deployed above intersections and includes information boards, such as those deployed on the crossarms of integrated poles. It serves as a coordinating unit for the ground-based variable message sign module in executing traffic guidance information dissemination strategies. It can disseminate real-time traffic information, guidance prompts, and weather warnings according to the aforementioned traffic guidance information dissemination strategies.

[0086] The blind spot detection and display module is mainly deployed at roadside curves, such as the side of the right-turn waiting lane. As a cooperating unit with the variable message sign module, it collaboratively displays information such as localized conflicts. Simultaneously, it can monitor the status of non-motorized vehicles or vehicles in the oncoming lane in real time, displaying corresponding warning information to indicate and prevent blind spot collisions and other accidents. Furthermore, it can report detected blind spot anomalies to the edge control and coordination unit 2 via the information dissemination and communication module.

[0087] The road sign module is deployed above the intersection, typically located on the crossarm of the integrated pole. It also serves as a cooperating unit with the ground-based variable signage module in executing the traffic guidance information dissemination strategy. It controls the lane indicator screens on the integrated pole, displaying red crosses and green arrows, to indicate the traffic status of each lane, including whether it is on or off.

[0088] The information release and communication module mainly receives control and data update instructions from the edge management and coordination unit 2 for each module within the unit through communication methods such as Ethernet, fiber optic, 4G, and 5G.

[0089] In one embodiment, the light control unit 5 includes at least: a road marking light control module and a light control communication module; wherein, the road marking light control module changes the road marking display status in real time based on the approved traffic guidance information release strategy; and the light control communication module is used to receive control commands from the edge control coordination unit.

[0090] Specifically, the lighting control unit 5 also works in concert with the zebra crossing light control module, low-position guidance light control module, drone flight indicator module, traffic signal light control module, warning flashing light control module, landscape lighting control module and street light control module to achieve intelligent control of various lighting facilities and improve road traffic safety and efficiency.

[0091] The lane marking light control module is mainly used to drive the LED lane marking lights arranged along the lane lines to enhance visibility in complex weather or at night. It can change the display status or color of the lane markings in real time according to the traffic guidance information release strategy.

[0092] The zebra crossing light control module is mainly used for controlling the zebra crossing marking lights at intersections. It enhances visibility in complex weather conditions or at night, and can change the brightness and color of the markings according to real-time traffic signal indicators.

[0093] The low-position guide light control module is mainly used to drive LED guide lights installed at the low position of curbs, guardrails, or traffic islands. This module emits continuous or pulsed light signals to outline the road contours in low-visibility environments such as nighttime and foggy weather, guiding drivers' vision and preventing vehicles from deviating from their lanes.

[0094] The drone flight guidance module is mainly installed on the side wall and top of the light pole, providing visual navigation and path guidance for the drone. During takeoff and landing, the module can also alert pedestrians, ensuring flight safety.

[0095] The traffic signal control module is primarily responsible for the logic execution of traffic lights and lane indicators at intersections. It connects to the traffic management system via traffic signal controllers to synchronize content with ground-based variable message signs and information boards.

[0096] The warning flashing light control module is mainly responsible for providing high-frequency flashing alarms at intersections, traffic divergence points, or dangerous areas. This module can be linked with the environmental perception and data acquisition unit 1 to automatically trigger flashing warnings in designated areas when a traffic accident, visibility abnormality, or weather abnormality is detected.

[0097] The main function of the landscape lighting control module is to enhance the visual aesthetics of intersections and support the publishing of multimedia materials and multi-source synchronization.

[0098] The street light control module is primarily responsible for road lighting, enabling intelligent dimming and energy-saving management. Based on parameters collected by the environmental sensing and data acquisition unit 1, it can implement functions such as "lights turn on when people approach" and "lights turn on when vehicles approach."

[0099] The lighting control communication module mainly receives control and data update instructions from the edge management and coordination unit 2 for each module within the unit through communication methods such as Ethernet and fiber optics.

[0100] In one embodiment, the vehicle unit 6 includes at least: an in-vehicle display module, a vehicle ITS integrated communication module, and a vehicle processor module; wherein, the in-vehicle display module is used to display the approved traffic guidance information release strategy; the vehicle ITS integrated communication module is used to interact with the edge control and coordination unit 2; and the vehicle processor module is used to process the approved traffic guidance information release strategy and output it to the in-vehicle display module.

[0101] Specifically, the vehicle unit 6 is primarily used for road vehicles, serving as the recipient in the ITS system (such as autonomous vehicles or connected vehicles). It receives and processes V2X data from the roadside and displays the received road condition information, navigation suggestions, and traffic warnings on the in-vehicle terminal.

[0102] The in-vehicle display module, located inside the vehicle, displays various information, including but not limited to road condition details, navigation suggestions, and traffic warnings. Through this module, drivers can intuitively obtain current road conditions and driving recommendations.

[0103] The vehicle ITS integrated communication module is a key component of the vehicle unit, responsible for receiving and processing V2X data from the remote control unit 3 and the edge control coordination unit 2. This data includes various traffic conditions and corresponding countermeasures to assist the vehicle in making intelligent driving decisions. The vehicle ITS integrated communication module not only receives this information but also interacts with other relevant units to ensure accurate information transmission.

[0104] The primary responsibility of the vehicle processor module is to process vehicle-mounted data and ITS data, and then push the processed information to the vehicle-mounted display module. The ITS data includes at least V2X data.

[0105] For example, the vehicle ITS integrated communication module receives V2X data from the edge control and coordination unit 2, which is the guidance action in the traffic guidance information release strategy, and sends this data to the vehicle processor module. The vehicle processor module identifies and processes the data, analyzes the different traffic situations that may be involved, provides corresponding countermeasures, and sends the countermeasures to the vehicle display module, which displays them on the vehicle terminal to assist the vehicle in making appropriate driving decisions.

[0106] Figure 4 This is a flowchart illustrating the three-dimensional traffic guidance information dissemination method based on multimodal perception information decision-making provided in an embodiment of the present invention. Figure 4 As shown, the method includes:

[0107] Step S11: Collect multimodal traffic environment data in real time; wherein the multimodal traffic environment data includes at least: lane perception information, road surface condition information, environmental parameter information and equipment status information.

[0108] In one embodiment, the environmental perception and data acquisition unit 1 includes at least: a lane perception acquisition module, a road surface condition acquisition module, an environmental parameter acquisition module, an equipment status acquisition module, an environmental perception communication module, and an environmental perception processor module; wherein, the lane perception acquisition module acquires lane perception information based on multi-source perception data; the road surface condition acquisition module acquires road surface condition information based on road surface condition sensors; the environmental parameter acquisition module acquires environmental parameter information based on environmental sensors; the equipment status acquisition module acquires equipment status information; the environmental perception communication module aggregates data from various modules within the unit and interacts with the edge control and coordination unit 2; the environmental perception processor module preprocesses and annotates the data from various modules within the unit acquired by the environmental perception communication module, and sends it to the edge control and coordination unit 2 through the environmental perception communication module.

[0109] Step S12: Perform multimodal fusion processing on the multimodal traffic environment data to generate a traffic guidance information release strategy.

[0110] In one embodiment, the edge control and coordination unit 2 includes at least: a data backup module, an automatic work order and inspection module, an edge control ITS integrated communication module, an edge control communication module, and an edge control processor module; wherein, the data backup module is used for local storage and disaster recovery of key intersection operation data, and synchronizes the key intersection operation data to the remote monitoring unit; the automatic work order and inspection module generates maintenance work orders based on abnormal information and triggers the inspection terminal to verify the fault; the edge control ITS integrated communication module is used for vehicle-road cooperative data interaction between multiple nodes in the traffic system, and sends road condition information, abnormal warning information, and navigation data to the vehicle terminal in real time; the edge control communication module realizes data interaction within and between units based on multiple communication networks; the edge control processor module generates a traffic guidance information release strategy based on the multimodal fusion processing results, and uploads the traffic guidance information release strategy to the remote monitoring unit 3 through the edge control communication module.

[0111] Step S13: Review the traffic guidance information release strategy and release the approved traffic guidance information release strategy.

[0112] In one embodiment, the remote monitoring unit 3 includes at least: a cloud monitoring platform module, a traffic management platform module, and a remote monitoring ITS integrated communication module; wherein, the cloud monitoring platform module is used for cloud-based integrated management, data aggregation, remote release and review, and remote monitoring of all road network equipment; the traffic management platform module is used to connect to an external traffic management system and receive traffic control instructions; and the remote monitoring ITS integrated communication module is used for data exchange with the edge control collaboration unit 2.

[0113] In one embodiment, the information publishing unit 4 includes at least: a ground variable signage screen module, an information board display module, a blind spot detection display module, a road indication module, and an information publishing communication module; wherein, the ground variable signage screen module outputs the approved traffic guidance information publishing strategy based on the ground variable signage screen; the information board display module publishes road condition information, guidance prompts, and weather warnings in real time based on the approved traffic guidance information publishing strategy; the blind spot detection display module is used to monitor the vehicle status in blind spots in real time and output collision prevention prompts; the road indication module is used to control the lane indication screen to indicate the traffic status of each lane; and the information publishing communication module is used to receive control commands and data update commands from the edge control and coordination unit 2 to each module within the unit.

[0114] In one embodiment, the light control unit 5 includes at least: a road marking light control module and a light control communication module; wherein, the road marking light control module changes the road marking display status in real time based on the approved traffic guidance information release strategy; and the light control communication module is used to receive control commands from the edge control coordination unit 2.

[0115] In one embodiment, the vehicle unit 6 includes at least: an in-vehicle display module, a vehicle ITS integrated communication module, and a vehicle processor module; wherein, the in-vehicle display module is used to display the approved traffic guidance information release strategy; the vehicle ITS integrated communication module is used to interact with the edge control and coordination unit 2; and the vehicle processor module is used to process the approved traffic guidance information release strategy and output it to the in-vehicle display module.

[0116] Step S14: Monitor the published traffic guidance information publishing strategy and optimize the monitoring results.

[0117] In one embodiment, the monitoring of the three-dimensional spatial output of the information publishing unit 4 and the real-time transmission of the monitoring results to the edge control and coordination unit 2 to optimize the traffic guidance information publishing strategy, so as to provide feedback adjustment to the three-dimensional spatial output of the information publishing unit 4, includes: the device status acquisition module monitoring the three-dimensional spatial output of the information publishing unit 4 based on monitoring and telemetry equipment to obtain monitoring results; and the environmental perception communication module transmitting the monitoring results to the edge control and coordination unit 2 in real time to optimize the traffic guidance information publishing strategy, so as to provide feedback adjustment to the three-dimensional spatial output of the information publishing unit 4.

[0118] It should be understood that the specific process of each module performing the above-mentioned steps has been described in detail in the foregoing embodiments, and will not be repeated here for the sake of brevity.

[0119] It should also be understood that the module division in the embodiments of the present invention is illustrative and only represents one logical functional division; in actual implementation, there may be other division methods. Furthermore, the functional modules in the various embodiments of the present invention can be integrated into a single processor, exist as separate physical entities, or two or more modules can be integrated into a single module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0120] Figure 5 This is a schematic block diagram of an electronic terminal provided in an embodiment of the present invention. Figure 5 As shown, the electronic terminal 400 includes at least one processor 401, a memory 402, at least one network interface 403, and a user interface 405. The various components in the electronic terminal 400 are coupled together via a bus system 404. It is understood that the bus system 404 is used to implement communication between these components. In addition to a data bus, the bus system 404 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in… Figure 5 The general will label all buses as bus systems.

[0121] The user interface 405 may include a monitor, keyboard, mouse, trackball, clicker, button, touchpad, or touch screen.

[0122] It is understood that memory 402 can be volatile memory or non-volatile memory, or both. Non-volatile memory can be read-only memory (ROM) or programmable read-only memory (PROM), used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM) and synchronous static random access memory (SSRAM). The memories described in the embodiments of this invention are intended to include, but are not limited to, these and any other suitable categories of memory.

[0123] In this embodiment of the invention, the memory 402 is used to store various types of data to support the operation of the electronic terminal 400. Examples of this data include: any executable program for operation on the electronic terminal 400, such as the operating system 4021 and application program 4022; the operating system 4021 contains various system programs, such as the framework layer, core library layer, driver layer, etc., for implementing various basic services and handling hardware-based tasks. The application program 4022 may contain various applications, such as media players, browsers, etc., for implementing various application services. The method for publishing three-dimensional traffic guidance information based on multimodal perception information decision-making provided in this embodiment of the invention can be included in the application program 4022.

[0124] The methods disclosed in the above embodiments of the present invention can be applied to or implemented by processor 401. Processor 401 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware in processor 401 or by instructions in the form of software. The processor 401 may be a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Processor 401 can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of the present invention. General-purpose processor 401 may be a microprocessor or any conventional processor, etc. The steps of the three-dimensional traffic guidance information release method based on multimodal perception information decision-making provided in the embodiments of the present invention can be directly reflected as being executed by a hardware decoding processor, or being executed by a combination of hardware and software modules in the decoding processor. The software modules may be located in a storage medium, which is located in a memory. The processor reads the information in the memory and combines it with its hardware to complete the steps of the aforementioned method.

[0125] In an exemplary embodiment, the electronic terminal 400 may be used by one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), or complex programmable logic devices (CPLDs) to execute the aforementioned method.

[0126] In summary, this invention discloses a three-dimensional traffic guidance information dissemination system, method, and terminal based on multimodal perception information decision-making. The system collects multimodal traffic environment data in real time, which is then fused by an edge control and coordination unit to generate a traffic guidance information dissemination strategy. This strategy is then implemented through ground-based variable message signs, information boards, and various traffic light control devices to output integrated air-ground three-dimensional spatial traffic guidance information. The edge control and coordination unit further optimizes and adjusts the dissemination strategy. This invention overcomes the shortcomings of traditional guidance methods, such as single-dimensional guidance, significant blind spots, poor visibility in low-visibility conditions, lack of unified traffic light control scheduling, and excessive reliance on manual monitoring. It achieves integrated air-ground, timely, three-dimensional guidance, significantly improving the level of refined management and proactive safety protection capabilities at intersections and on smart highways.

[0127] Therefore, this invention effectively overcomes the various shortcomings of the prior art and has high industrial application value.

[0128] The above embodiments are merely illustrative of the principles and effects of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or alterations made by those skilled in the art without departing from the spirit and technical concept disclosed in the present invention should still be covered by the claims of the present invention.

Claims

1. A three-dimensional traffic guidance information dissemination system based on multimodal perception information decision-making, characterized in that, include: Environmental perception and data acquisition unit, edge control and coordination unit, remote monitoring unit, information release unit, lighting control unit and vehicle unit; An environmental perception and data acquisition unit is used to collect multimodal traffic environment data in real time; wherein, the multimodal traffic environment data includes at least: lane perception information, road surface condition information, environmental parameter information, and equipment status information; The edge control and coordination unit is connected to the environmental perception and data acquisition unit to perform multimodal fusion processing on the multimodal traffic environment data, generate a traffic guidance information release strategy, and upload the traffic guidance information release strategy to the remote monitoring unit. The remote monitoring unit is connected to the edge control and coordination unit for cloud-based monitoring of data from all road network devices and for feeding back the review results of traffic guidance information release strategies to the edge control and coordination unit, so that the edge control and coordination unit can send the approved traffic guidance information release strategies to the information release unit, the light control unit, and the vehicle unit. The information publishing unit is communicatively connected to the edge control and coordination unit and is used to output the approved traffic guidance information publishing strategy in three-dimensional space. The lighting control unit is communicatively connected to the edge control and coordination unit and is used to drive and control lighting and signal indication devices according to the approved traffic guidance information release strategy. The vehicle unit is communicatively connected to the edge control and coordination unit and is used to receive and display approved traffic guidance information release strategies on the in-vehicle terminal to assist the vehicle in making corresponding driving decisions. The environmental perception and data acquisition unit is also used to monitor the three-dimensional spatial output of the information release unit and send the monitoring results to the edge control and coordination unit in real time to optimize the traffic guidance information release strategy, so as to provide feedback and adjustment to the three-dimensional spatial output of the information release unit.

2. The three-dimensional traffic guidance information dissemination system based on multimodal perception information decision-making according to claim 1, characterized in that, The environmental perception and data acquisition unit includes at least: a lane perception acquisition module, a road surface condition acquisition module, an environmental parameter acquisition module, an equipment status acquisition module, an environmental perception communication module, and an environmental perception processor module; wherein, the lane perception acquisition module acquires lane perception information based on multi-source perception data; the road surface condition acquisition module acquires road surface condition information based on road surface condition sensors; the environmental parameter acquisition module acquires environmental parameter information based on environmental sensors; the equipment status acquisition module acquires equipment status information; the environmental perception communication module aggregates data from various modules within the unit and interacts with the edge control and coordination unit; the environmental perception processor module preprocesses and annotates the data from various modules within the unit acquired by the environmental perception communication module, and sends it to the edge control and coordination unit through the environmental perception communication module.

3. The three-dimensional traffic guidance information dissemination system based on multimodal perception information decision-making according to claim 1, characterized in that, The edge control and coordination unit includes at least: a data backup module, an automatic work order and inspection module, an edge control ITS integrated communication module, an edge control communication module, and an edge control processor module. The data backup module is used for local storage and disaster recovery of critical intersection operation data, and synchronizes the critical intersection operation data to the remote monitoring unit. The automatic work order and inspection module generates maintenance work orders based on abnormal information and triggers the inspection terminal to verify faults. The edge control ITS integrated communication module is used for vehicle-road cooperative data interaction between multiple nodes within the traffic system, and sends road condition information, abnormal warning information, and navigation data to the vehicle terminal in real time. The edge control communication module realizes data interaction within and between units based on multiple communication networks. The edge control processor module generates a traffic guidance information release strategy based on the multimodal fusion processing results and uploads the traffic guidance information release strategy to the remote monitoring unit through the edge control communication module.

4. The three-dimensional traffic guidance information dissemination system based on multimodal perception information decision-making according to claim 1, characterized in that, The remote monitoring unit includes at least: a cloud-based monitoring platform module, a traffic management platform module, and a remote monitoring ITS integrated communication module; wherein, the cloud-based monitoring platform module is used for cloud-based integrated management, data aggregation, remote release and review, and remote monitoring of all road network equipment; the traffic management platform module is used to connect to external traffic management systems and receive traffic control instructions; and the remote monitoring ITS integrated communication module is used for data exchange with the edge control collaboration unit.

5. The three-dimensional traffic guidance information dissemination system based on multimodal perception information decision-making according to claim 1, characterized in that, The information dissemination unit includes at least: a ground variable signage screen module, an information board display module, a blind spot detection display module, a road sign module, and an information dissemination communication module; wherein, the ground variable signage screen module outputs approved traffic guidance information dissemination strategies based on the ground variable signage screen; the information board display module disseminates real-time road condition information, guidance prompts, and weather warnings based on the approved traffic guidance information dissemination strategies; the blind spot detection display module is used to monitor the status of vehicles in blind spots in real time and output collision prevention prompts; the road sign module is used to control the lane sign screens to indicate the traffic status of each lane; and the information dissemination communication module is used to receive control commands and data update commands from the edge control and coordination unit to each module within the unit.

6. The three-dimensional traffic guidance information dissemination system based on multimodal perception information decision-making according to claim 1, characterized in that, The lighting control unit includes at least: a road marking light control module and a lighting control communication module; wherein, the road marking light control module changes the road marking display status in real time based on the approved traffic guidance information release strategy; and the lighting control communication module is used to receive control commands from the edge control and coordination unit.

7. The three-dimensional traffic guidance information dissemination system based on multimodal perception information decision-making according to claim 1, characterized in that, The vehicle unit includes at least: an in-vehicle display module, a vehicle ITS integrated communication module, and a vehicle processor module; wherein, the in-vehicle display module is used to display the approved traffic guidance information release strategy; the vehicle ITS integrated communication module is used to interact with the edge control and coordination unit; and the vehicle processor module is used to process the approved traffic guidance information release strategy and output it to the in-vehicle display module.

8. The three-dimensional traffic guidance information dissemination system based on multimodal perception information decision-making according to claim 2, characterized in that, The monitoring of the three-dimensional spatial output of the information publishing unit and the real-time transmission of the monitoring results to the edge control and coordination unit to optimize the traffic guidance information publishing strategy, in order to provide feedback and adjustment to the three-dimensional spatial output of the information publishing unit, includes: The equipment status acquisition module monitors the three-dimensional spatial output of the information release unit based on the monitoring and telemetry equipment to obtain the monitoring results; The environmental perception and communication module sends the monitoring results to the edge control and coordination unit in real time to optimize the traffic guidance information release strategy, so as to provide feedback and adjustment to the three-dimensional spatial output of the information release unit.

9. A method for disseminating three-dimensional traffic guidance information based on multimodal perception information decision-making, applied to a three-dimensional traffic guidance information dissemination system based on multimodal perception information decision-making as described in any one of claims 1-8, characterized in that, The method includes: Real-time acquisition of multimodal traffic environment data; wherein, the multimodal traffic environment data includes at least: lane perception information, road surface condition information, environmental parameter information, and equipment status information; The multimodal traffic environment data is subjected to multimodal fusion processing to generate a traffic guidance information dissemination strategy; The traffic guidance information release strategy is reviewed, and the approved traffic guidance information release strategy is released. Monitor the published traffic guidance information release strategy and optimize the monitoring results.

10. An electronic terminal, comprising a memory, a processor, and a computer program stored in the memory, characterized in that, The processor executes the computer program to implement the method as described in claim 9.

Images