Road traffic monitoring method based on digital base

Abstract

The embodiment of the invention discloses a road traffic monitoring method based on a digital base, and relates to the technical field of intelligent traffic. The method comprises the following steps: carrying out data integration on real data collected by a sensor cluster by a data management platform and storing the data in a database; after the data management platform performs data integration, the integrated data are transmitted to the data cockpit and displayed through a large display screen of the data cockpit; and the data management platform inputs the obtained vehicle information into a database, then triggers the Unity polling request interface to obtain the vehicle information, and then generates a corresponding vehicle model through the vehicle information. And then displaying the tunnel scene and the vehicles in the tunnel scene through a large display screen of the data cockpit. Therefore, real-time monitoring of tunnel traffic conditions is realized through a digital twinning means.

Description

Technical Field

[0001] The present invention relates to the field of intelligent transportation technology in smart cities, and in particular to a road traffic monitoring method based on a digital base. Background Art

[0002] In the current monitoring scheme for tunnel traffic conditions, traditional methods have deficiencies in real-time monitoring and feedback of physical entity status, lack the ability to intuitively display and deeply mine large-scale data, and fail to fully utilize data to drive the optimization of business processes and decisions. This leads to deficiencies in real-time data processing and feedback, and the timeliness of real-time data processing and feedback is insufficient. In addition, the existing schemes also have problems such as difficulty in interactive operation and lack of convenience in use.

[0003] Therefore, how to achieve real-time monitoring of tunnel traffic conditions through digital twins has become a topic that needs further research. Summary of the invention

[0004] An embodiment of the present invention provides a road traffic monitoring method based on a digital base, which can realize real-time monitoring of tunnel traffic conditions through digital twin means.

[0005] To achieve the above object, the embodiments of the present invention adopt the following technical solutions:

[0006] S1. The data management platform collects real data through a sensor cluster deployed in the tunnel, where the real data at least includes vehicle information and vehicle speed of vehicles traveling in the tunnel;

[0007] S2, the data management platform generates vehicle models and tunnel scenarios;

[0008] S3. Displaying the tunnel scene and the vehicles in the tunnel scene through the large display screen of the data cockpit.

[0009] In the road traffic monitoring method based on the digital base provided by the embodiment of the present invention, the real data collected by the sensor cluster is integrated by the data management platform and stored in the database. After the data management platform integrates the data, the integrated data is transmitted to the data cockpit and displayed on the large display screen of the data cockpit; the data management platform inputs the acquired vehicle information into the database, and then triggers the Unity polling request interface to obtain the vehicle information, and then generates the corresponding vehicle model through the vehicle information. Afterwards, the tunnel scene and the vehicles in the tunnel scene are displayed on the large display screen of the data cockpit. Thus, real-time monitoring of tunnel traffic conditions is achieved through digital twin means. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0011] Figure 1 A schematic diagram of the hardware architecture provided for an embodiment of the present invention;

[0012] Figure 2 A schematic diagram of a platform architecture provided by an embodiment of the present invention;

[0013] Figure 3 A schematic diagram of a twin traffic flow processing process provided by an embodiment of the present invention;

[0014] Figure 4 A schematic diagram of a tunnel scene provided by an embodiment of the present invention;

[0015] Figure 5 A schematic diagram of a protocol scenario provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0016] In order to enable those skilled in the art to better understand the technical solution of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. The embodiments of the present invention will be described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements with the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and cannot be interpreted as limiting the present invention. It can be understood by those skilled in the art that, unless specifically stated, the singular forms "one", "one", "said" and "the" used herein may also include plural forms. It should be further understood that the term "including" used in the specification of the present invention refers to the presence of the features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or their groups. It should be understood that when we say that an element is "connected" or "coupled" to another element, it can be directly connected or coupled to other elements, or there may also be intermediate elements. In addition, the "connection" or "coupling" used here may include wireless connection or coupling. The term "and / or" used herein includes any unit and all combinations of one or more associated listed items. It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical terms and scientific terms) used herein have the same meaning as generally understood by those of ordinary skill in the art to which the present invention belongs. It should also be understood that terms such as those defined in general dictionaries should be understood to have meanings consistent with the meanings in the context of the prior art, and will not be interpreted with idealized or overly formal meanings unless defined as herein.

[0017] A digital twin is a virtual entity or system that corresponds to a physical entity or system in the real world. It updates and reflects the status and behavior of the physical entity in real time through sensor data, real-time monitoring and simulation technology. The digital twin technology solution adopted in this embodiment includes at least three main parts: 1. Sensor: used to collect data of physical entities, such as real-time vehicle data, license plate number, vehicle speed, etc. 2. Data analysis and modeling: Process sensor data through machine learning, data analysis and modeling technology, simulate the behavior of physical entities, and make predictions and optimizations. 3. Real-time monitoring and feedback: By comparing the simulation results with the actual data, the status of the physical entity is monitored and fed back in real time, and adjustments and optimizations are made. Specifically, an embodiment of the present invention provides a road traffic monitoring method based on a digital base, comprising:

[0018] S1. The data management platform collects real data through a sensor cluster deployed in the tunnel, where the real data at least includes vehicle information and vehicle speed of vehicles traveling in the tunnel;

[0019] S2, the data management platform generates vehicle models and tunnel scenarios;

[0020] Among them, the data management platform is an integrated platform for collecting, storing, processing and managing various data resources within an organization, aiming to improve the availability, accessibility and manageability of data. Data integration refers to the integration of data from different data sources into a unified platform for unified management and analysis. Data storage refers to the use of various database technologies or data lake technologies to store large-scale data to ensure data security and scalability. Data processing and analysis refers to the provision of data processing and analysis tools, including functions such as data cleaning, conversion, analysis and visualization, to support data-driven decision making. Data security and compliance refers to the implementation of security measures and compliance standards to ensure the confidentiality, integrity and availability of data. The architecture of the data management platform in this embodiment is as follows: Figure 2 shown.

[0021] Specifically, a Unity server and an application server are established on the data management platform, and a web terminal is established on the data cockpit; a connection is established between the Unity server, the application server and the web terminal through the WebSocket protocol. Figure 1 As shown, the backend service websocket push streaming on the Linux server, and the push streaming service runs on the Windows server, pushing the Unity screen to the specified location port for display, thus forming a complete program framework of backend (java) + web (vue) + unity + push streaming, in which the backend is developed using the Java language, and the front end is developed using the HTML + CSS + Vue framework, while integrating Unity technology and push streaming functions. Through such an overall architectural design, we can achieve the system's backend logic processing, front-end interface display, and seamless integration with Unity technology, while also achieving the push streaming function. Such an overall architectural design can effectively integrate various modules to achieve efficient system operation and user experience.

[0022] S3. Displaying the tunnel scene and the vehicles in the tunnel scene through the large display screen of the data cockpit.

[0023] Specifically, Figure 4As shown, the sensor cluster includes three sensors, namely, a laser radar, a bayonet camera and a video camera, which are deployed in the tunnel. The sensor cluster can communicate with the outside world through optical fiber. The real data collected also includes: vehicle toll station entrance, license plate number, and vehicle location data; for example, the precise location of the vehicle is obtained through a GPS sensor for navigation, vehicle tracking and traffic management. After the data management platform receives the real data, it integrates the data and stores it in the database. The types of integration include not only the real data, but also timestamp information, tunnel identification information and sensor identification information.

[0024] Furthermore, after the data management platform integrates the data, it transmits the integrated data to the data cockpit and displays it on the large display screen of the data cockpit; the data management platform inputs the acquired vehicle information into the database, then triggers the Unity polling request interface to acquire the vehicle information, and then generates the corresponding vehicle model based on the vehicle information.

[0025] For example: the sensor data is transmitted to the data management platform, which is responsible for data integration, storage, processing and analysis, and generating vehicle models to travel on the road network. Specifically, timestamp: records the time of data collection. Tunnel identification: distinguishes which tunnel the data comes from (for example, Tunnel A Left or Tunnel A Right). Sensor identification: identifies the specific sensor or monitoring device from which the data comes. Vehicle information such as speed, license plate number, vehicle model, heading angle, longitude and latitude, license plate color, location distance, lane, vehicle type, etc. Data processing: real-time transmission, real-time analysis, and chart display of data. Data from different sources is received through kafka, FTPed into the server folder or data interface, and integrated into a database. Data storage: can store data for nearly a month. The data management platform transmits the processed data to the data cockpit, which uses existing visualization: using computer graphics and image processing technology to convert data into graphics or images and display them on the screen, and interactive processing theories, methods and technologies to display the real-time status of data and road networks. Vehicle model generation method: According to the radar scanning analysis results, the traffic information is placed in the database, the Unity polling request interface is used to obtain the traffic information, and then the corresponding vehicle model is generated locally based on the vehicle information. This specific method of generating the corresponding vehicle model based on vehicle information such as speed, license plate number, vehicle model, heading angle, longitude and latitude, license plate color, location distance, lane, vehicle type, etc., can also use existing technical means.

[0026] In this embodiment, the data cockpit includes a road cruise module and a data display module. The data display module is used to visualize the data corresponding to the vehicle model, and the visual display methods include: charts, graphs and dashboards; the driving operation module is used to accept driving operation instructions input by the user.

[0027] Among them, the data cockpit is an integrated visualization platform for displaying and analyzing various data within the organization to support decision-making and business operations. Specifically, data visualization refers to the use of visualization methods such as charts, graphs and dashboards to display data in an intuitive way to help users understand data and trends. Real-time data update refers to ensuring that the data in the data cockpit is updated in real time so that users can obtain the latest information and insights. Interactivity and customization refer to providing user interaction and customization functions, allowing users to customize dashboards and reports according to their needs. In the visualization process: the program will draw the traffic route in advance, including each lane of each road section. The twin traffic will obtain the traffic data through the interface request, including longitude and latitude, license plate number, vehicle type, speed and other information to accurately generate corresponding vehicles on the traffic line, and travel at a given speed. For example: such as Figure 3 As shown, the polling request interface is used every second to obtain the traffic data in the tunnel; then the corresponding traffic model is obtained according to the ID and vehicle type and a copy is generated; then the vehicle is generated at the corresponding position according to the vehicle's latitude and longitude information and lane number; finally, the driving speed is set for the vehicle, and the vehicle update speed has been generated.

[0028] Semi-twin traffic will roughly generate corresponding traffic between each gantry. The traffic information comes from the gantry traffic information, which is called once at each specified time and then generates vehicle information in batches. Driving operation instructions can be input by the operator through the input device, for example: Figure 3 As shown, an interface can be requested every three minutes to obtain the number of each type of vehicle, such as work vehicles, trucks, and buses; according to Unity performance, the maximum tolerable number of a single highway is configured for compression, wherein the compression process adopts the vehicle compression model: v≈x / y*t, x represents the number of vehicles returned by the specified type, y represents the total number of vehicles returned by all types, t represents the maximum tolerable value, and v specifies the number of vehicles after compression; according to the compressed data volume, the corresponding vehicles are generated every m seconds, and randomly assigned to each lane, and then the corresponding vehicle speed is configured, for example: the number of vehicles generated per round (every m seconds) is n, and the model for calculating n is f(n)=n<v%36? v / 36+1:v / 36, % represents the remainder operation, and in actual applications, m=5. f(n) is a ternary operator, and the grammatical format of the ternary operator is "a?b:c", where a is the judgment condition, if a is established, then the value of b is taken, if a is not established, then the value of c is taken.

[0029] The cockpit implements corresponding functions in the program by monitoring the keyboard and mouse events on the Web side, which currently mainly include events such as up, down, left, right, rotation, and click. This function can be operated independently for different users without affecting each other. However, when multiple users operate a unit at the same time, conflicts will occur.

[0030] In order to solve the problem of how to display the complex logical operations on Unity on the web side, realize the integration of web-unity, integrate the logic between the two, and establish communication between the two. That is, rendering the Unity scene to the web side and communicating with the web side, for the interface rendering and logical interaction between Unity and the web side, this embodiment adopts RenderStreaming technology, which is a technology that separates the graphics rendering task and sends it to the remote device for processing and rendering. By distributing the graphics rendering tasks to the remote device, the computing pressure of the local device can be effectively reduced, enabling it to handle more complex and high-fidelity graphics rendering tasks. At the same time, we also need to build a WebSocket server, which is used for data flow between the two ends.

[0031] Among them, the WebSocket protocol is an extension of the HTTP protocol. Figure 5 As shown, when establishing a WebSocket connection, the client sends an HTTP request to the server and sets the Upgrade header field in the HTTP request to "websocket", thereby indicating that it wishes to upgrade to the WebSocket protocol. After receiving this request, if the server supports the WebSocket protocol, it will return an HTTP response with a status code of 101 Switching Protocols and upgrade to a WebSocket connection through the Upgrade header field; after the upgrade is completed, the communication between the client and the server no longer follows the HTTP request-response mode, but two-way real-time communication is carried out through the WebSocket protocol. The client and the server can send messages directly to each other without waiting for the other party's request.

[0032] The connection between the Unity server and the web client is established through the WebSocket protocol. The tunnel scene generated in the Unity server is transmitted to the web client, and the internal logic of Unity is triggered by monitoring the operation events of the web client. At the same time, communication between the two ends can be established to realize two-way information transmission and reception.

[0033] In practical applications, the specific methods for performing RenderStreaming in this embodiment include:

[0034] (1) Interaction between client and server: The implementation of renderstreaming requires a client and a server to interact. The client is responsible for sending graphics rendering tasks to the server, and the server is responsible for receiving tasks and sending them to the remote device for processing and rendering.

[0035] (2) Graphics data transmission: The client transmits the graphics data to the server through the network. In order to ensure real-time and smoothness, the UDP protocol is usually used for data transmission because the UDP protocol has the characteristics of low latency and high throughput. In addition, in order to further reduce the amount of data, an image compression algorithm is usually used to compress the graphics data.

[0036] (3) Task delivery and rendering: After receiving the graphic data, the server sends the task to the remote device for processing and rendering. A renderer needs to be installed on the remote device to receive the task and perform real-time graphics rendering. The renderer can call hardware acceleration as needed to improve rendering speed and quality.

[0037] (4) Image stream transmission and display: The remote device transmits the rendered image stream back to the client. After receiving the image stream, the client displays it in the web browser through WebGL. WebGL provides rich rendering features and interfaces, which can perform real-time image processing and rendering.

[0038] Furthermore, in the process of generating a tunnel scene, the following is included: the Unity program running in the Unity server introduces a cut-out of the tunnel scene through a Cesium plug-in, the cut-out of the tunnel scene carries corresponding longitude and latitude information after being processed by CesiumLib, wherein the vehicle model is imported into the corresponding position of the tunnel scene through the longitude and latitude information. For example: Unity introduces a cut-out of the scene through a Cesium plug-in, and the cut-out carries corresponding longitude and latitude after being processed by CesiumLib, and the model can be imported into the correct position when used. About Cesium: Cesium For Unity is an extension for the Unity engine, which is used to integrate the functions of CesiumJS and geospatial data visualization in Unity. It can be used to display massive 3D model data, image data, terrain elevation data, vector data, etc. The 3D model format supports gltf, and the 3D tile model format supports 3d tiles. Vector data supports geojson and topojson formats. Image data supports wmts, etc. Elevation supports STK format. The data processed by CesiumLib is divided into compact files and hash files. The compact file needs to generate a link through the distribution service on CesiumLib, and can be directly imported locally. Among them, the hash file can be directly introduced through the URL path. Referring to the design of Cesium itself, the function of cropping and culling can be realized, that is, the invisible ones do not need to be loaded, so as to ensure the reasonable occupation of memory. However, our program needs to be a one-to-many mode, that is, a Unity program can be pushed to multiple users, resulting in each user may stay in a different position, so the cropping and culling function is not available. Based on this requirement, sufficient memory needs to be reserved on the host where the Unity program runs.

[0039] The latitude and longitude information of the key points of the tunnel scene are configured inside the Unity program. The key points include: gantries and toll booths; the key points also include: various real-time road event detection points, key points of major road assets, and the major road assets include: building assets such as toll booths, bridges and tunnels, and equipment assets include: gantries and radars. For example: the key points of the tunnel include the monitoring points of the tunnel entrance and the tunnel exit. Among them, when a message sent by the Web end is received, the camera perspective assigned to the user is switched to the key point closest to the vehicle model; the cruising route of the tunnel scene is configured inside the Unity program, and the camera perspective assigned to the user is translated along the cruising route. For example Figure 4 As shown in , the key points may be points 1-4 in the figure.

[0040] For example, the main logical functions implemented in the tunnel scene include: point jump, cruise, traffic, and mouse and keyboard logic processing. Specifically, point jump: The Unity program statically configures the latitude and longitude information of each key point (gantry, toll station), etc. When receiving the message from the Web end, the camera perspective assigned to the user can be directly switched to the point, and the Web end can display the scene after the jump. Cruise: The Unity program pre-draws the cruise route of each section of the road, and configures the tool class to make the camera pan along the pre-made route. You can use the Web command to cruise which route, and switch the cruise mode to drone mode and follow the mode to adjust the height of the camera. The Web end can see the cruise process. Traffic: The program will draw the traffic route in advance, including each lane of each section. The twin traffic will obtain the traffic data through the interface request, including latitude and longitude, license plate number, vehicle type, speed and other information to accurately generate the corresponding vehicle on the traffic line, and drive at the given speed. Semi-twin traffic will roughly generate corresponding traffic between each gantry. The traffic information comes from the gantry traffic information, which is called once at each specified time, and then generates vehicle information in batches. Mouse and keyboard logic processing: By monitoring the keyboard and mouse events on the Web side, the corresponding functions are implemented inside the program, which currently mainly include events such as up, down, left, right, rotation, and click. This function can be operated independently for different users without affecting each other. However, when multiple users operate a unit at the same time, conflicts will occur.

[0041] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The above is only a specific implementation method of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or replacements that can be easily thought of by any technician familiar with the technical field within the technical scope disclosed by the present invention should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A road traffic monitoring method based on a digital base, characterized in that: include: S1. The data management platform collects real data through a sensor cluster deployed in the tunnel, where the real data at least includes vehicle information and vehicle speed of vehicles traveling in the tunnel; S2, the data management platform generates vehicle models and tunnel scenarios; S3. Displaying the tunnel scene and the vehicles in the tunnel scene through the large display screen of the data cockpit.

2. The method according to claim 1, characterized in that The sensor cluster includes three sensors: a lidar, a bayonet camera and a video camera deployed in a tunnel.

3. The method according to claim 1, characterized in that: The real data also includes: vehicle toll station entrance, license plate number, and vehicle location data; After the data management platform receives the real data, it integrates the data and stores it in the database, wherein the types of data to be integrated include not only the real data, but also timestamp information, tunnel identification information and sensor identification information.

4. The method according to claim 3, characterized in that Also includes: After the data management platform integrates the data, the integrated data is transmitted to the data cockpit and displayed on the large display screen of the data cockpit; The data management platform inputs the acquired traffic flow information into the database, then triggers the Unity polling request interface to obtain the traffic flow information, and then generates a corresponding vehicle model based on the vehicle information.

5. The method according to claim 1, characterized in that The data cockpit includes a road cruise module and a data display module, wherein the data display module is used to visually display the data corresponding to the vehicle model, and the visual display method includes: charts, graphs and dashboards; The driving operation module is used to accept driving operation instructions input by a user.

6. The method according to claim 1, characterized in that Also includes: Establish a Unity server and an application server on the data management platform, and establish a web terminal in the data cockpit; A connection is established between the Unity server, application server and web client through the WebSocket protocol.

7. The method according to claim 6, characterized in that Also includes: When establishing a WebSocket connection, the client sends an HTTP request to the server and sets the Upgrade header field in the HTTP request to "websocket"; The server returns an HTTP response with status code 101 Switching Protocols and upgrades the connection to a WebSocket connection via the Upgrade header field. The connection between the Unity server and the web end is established through the WebSocket protocol, which transmits the picture of the tunnel scene generated in the Unity server to the Web end and monitors the operation events of the Web end.

8. The method according to claim 1, characterized in that The generating of the tunnel scene comprises: The Unity program running in the Unity server introduces a cut-out of the tunnel scene through a Cesium plug-in. The cut-out of the tunnel scene carries corresponding longitude and latitude information after being processed by CesiumLib. The vehicle model is imported into a corresponding position of the tunnel scene through the longitude and latitude information.

9. The method according to claim 8, characterized in that Also includes: The latitude and longitude information of the key points of the tunnel scene are configured in the Unity program, wherein the key points include: a gantry and a toll station; wherein when a message sent by the Web terminal is received, the camera perspective assigned to the user is switched to the key point closest to the vehicle model; The cruise route of the tunnel scene is configured within the Unity program, and the camera perspective assigned to the user is translated along the cruise route.

10. The method according to claim 9, characterized in that The key points also include: various real-time road event detection points, key points of major road assets, the major road assets include: construction assets toll stations, bridges and tunnels, equipment assets include: gantries and radars.

Images