Expressway interval digital twinborn safety management and control method

By setting up high-speed identification cameras at the entrances and exits of the highway interval, establishing a unique ID, and tracking the vehicle position within the interval to form a dynamic digital model, the problems of short distances of video surveillance and slow event positioning are solved, and the expressway is realized Real-time security control of intervals and signal system control reduce costs.

CN119007453APending Publication Date: 2024-11-22GUANGZHOU FENGXING INTELLIGENT TECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410954231.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-17
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

Video surveillance in highways has problems such as short distances, many blind spots, excessive video images, slow event positioning, and difficult control. The existing digital twin system lacks real-time reflection and control means of actual operating status, resulting in frequent accidents. , high cost.

Method used

By setting up high-speed identification cameras at the entrances and exits of the highway area, identifying vehicle characteristics in real time, establishing a unique ID, and tracking the vehicle position within the area, forming a dynamic digital model, performing video encoding and interactive tag settings, realizing the operation status of the vehicle Real-time monitoring and signal system control.

Benefits of technology

Real-time safety control of expressway areas is achieved, production costs are reduced, event positioning efficiency and control accuracy are improved, and intuitive reflection and management efficiency of vehicle operation status are enhanced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119007453A_ABST
    Figure CN119007453A_ABST
Patent Text Reader

Abstract

The invention discloses a highway interval digital twinborn safety control method, which comprises the following steps: S1, identifying the attribute of a moving target in real time at an interval entrance, and establishing a global unique ID; s2, calculating the real-time position of the moving target detected in the interval entrance range; s3, tracking the real-time position of the moving vehicle target in the detection range within the interval exit detection range; s4, mapping and restoring the actual dynamic target of the interval on the digital model to form a group of dynamic pictures; s5, performing video coding on the all-digital model obtained in the step S4 to facilitate storage, transmission and display; s6, docking the interaction label with a signal system, and setting an AR interaction function for the coded video; according to the invention, the more accurate digital model is established and the digital model is coded into the video with the interaction function, so that the highway operation interval can be more efficiently subjected to safety management and control.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of highway section control, and in particular to a highway section digital twin safety control method. Background Art

[0002] Generally speaking, the sections of expressways (tunnels, bridges, high slopes, long uphill and downhill sections and other key sections) are the focus of management by expressway management and operation units. The primary concern is to ensure the safe operation of vehicles in each driving section, to avoid abnormal events in the driving process of vehicles in each section that cannot be warned and discovered quickly in time, leading to frequent accidents, heavy casualties and property losses.

[0003] In various driving sections of the highway, multiple cameras are usually installed to monitor the key focus sections of the highway. This method has the problems of short video distance, many blind spots, many video images, lack of overall sense, slow event location, and great difficulty in control.

[0004] Since the highway section is in the shape of a long strip, the length is often several kilometers or even dozens of kilometers, and the monitoring area of ​​the camera can generally only monitor a few dozen meters, and the farthest distance is no more than 100 meters. If there is a bend in the section, the range that can be fully covered by the camera will be even shorter. If you want to cover the entire section with video surveillance, the cost will be very high, and there will be too many video images. Too many video images will lead to inefficient management.

[0005] In order to learn about the formation mechanism and development process of extreme events at a low cost, operators generally use emerging digital twin systems to simulate and present related processes. Digital twin is a concept that uses data and simulation technology to create virtual replicas of physical entities or systems. It obtains accurate real-time feedback and prediction results through digital modeling, simulation and data analysis of physical entities or systems. Therefore, the digital twin system can obtain actual operating data and intuitively and realistically present the situation of simulated destruction scenarios in the case of substantial destruction of real scenarios.

[0006] In the actual operation process, the factors that affect the system operation status include not only the vehicle's own factors, but also weather changes, traffic emergencies, the handling process of traffic incidents, and the control measures of the operating unit. The digital twin system needs to access this kind of information through a data interface to truly reflect the actual operation status of the highway. How to present the actual operation status data of the highway section in operation, and how to intuitively change the real operation status through the digital twin system, obtain real data and simulate the real evolution of events, requires an intuitive control method.

[0007] Moreover, radar detection technology is currently commonly used to detect the real-time driving trajectory of the detection vehicle. By deploying dense radar detection equipment, the real-time operation of the vehicle is monitored. Only when there are overlapping areas between the radar coverage areas can the running trajectory of each target be monitored in real time.

[0008] The coverage range of radar is usually within a radius of 500 meters and no more than 1 kilometer at most. In a 10-kilometer road range, a rough calculation shows that at least 10 radar detection devices need to be deployed to achieve overall coverage. Therefore, relying on radar equipment as a detection device to achieve vehicle target re-identification is costly.

[0009] In addition, the current digital twin system, especially the digital twin system for highway operating sections, only considers how to collect the actual operating vehicles in the current section and display them on the digital twin system. This method only realizes the collection and display of vehicle data in the section and the process from real to digital model. There is no means for the digital model to control the real scene in turn. Summary of the invention

[0010] The technical problem to be solved by the present invention is to provide a digital twin safety management and control method for highway sections, which can display the actual operating status of the highway sections in real time, conduct timely and effective safety management and control of each operating section, and reduce the overall production cost.

[0011] In order to solve the above technical problems, the technical solutions adopted by the present invention are as follows.

[0012] A highway section digital twin safety management and control method comprises the following steps:

[0013] S1, real-time identification of moving target attributes at the interval entrance, and establishment of a global unique ID;

[0014] S2, calculating the real-time position of the moving target detected within the range of the interval entrance;

[0015] S3, tracking the real-time position of the moving vehicle target within the detection range at the exit of the section;

[0016] S4, mapping and restoring the actual dynamic target of the interval on the digital model to form a set of dynamic pictures;

[0017] S5, performing video encoding on the full digital model obtained in step S4 to facilitate storage, transmission and display;

[0018] S6. Connect the interactive tag with the signal system and set the AR interactive function for the encoded video.

[0019] In the above-mentioned highway section digital twin safety management and control method, step S1 includes the following steps:

[0020] S11. A high-speed vehicle body recognition camera and a license plate recognition camera are installed at the entrance of the section to capture the vehicle target at the entrance of the section in real time, identify the basic features of the vehicle, and classify the vehicle features;

[0021] S12, the vehicle target information recognized by the vehicle body recognition camera and the license plate recognition camera is transmitted in real time to the edge computer 1 connected to the vehicle body recognition camera and the license plate recognition camera at the entrance;

[0022] S13. The edge computer 1 obtains the vehicle information based on the license plate recognition camera and the vehicle body recognition camera in step S12, and establishes a unique ID number for the vehicle.

[0023] In the above-mentioned highway section digital twin safety management and control method, the vehicle target information corresponding to the unique ID number includes five key features of the target, namely, license plate, body features, vehicle type, vehicle speed, and travel lane. Among them, the license plate, body features, and vehicle type can accurately identify the target vehicle, and the speed and lane information are important information for positioning the target vehicle.

[0024] In the above-mentioned highway section digital twin safety management and control method, step S2 comprises the following steps:

[0025] S21, after the edge computer 1 obtains the vehicle license plate and type, speed, lane and other information of the target vehicle in step S1, the specific position and time of the target vehicle's driving process are calculated according to the current speed and lane of the target vehicle;

[0026] S22, the edge computer 1 sends the calculated motion position information of the vehicle target, the unique ID corresponding to the target vehicle, and the license plate information, vehicle model information, and vehicle body color information corresponding to the unique ID to the system server;

[0027] In the above-mentioned highway section digital twin safety management and control method, in step S3, tracking the real-time position of the moving vehicle target in the detection range includes the following steps:

[0028] S31, edge computer 2 consumes vehicle information from edge computer 1 through message bus technology;

[0029] S32, the edge computer 2 obtains the vehicle target information within the detection range in real time through the license plate recognition camera and the body recognition camera, and generates unique ID information according to the license plate, body color characteristics, and body type of the vehicle target;

[0030] S33, comparing the vehicle information obtained from the edge computer 1 with the vehicle information detected within the exit detection range obtained by the edge computer 2 to determine whether the two target vehicles are the same target vehicle;

[0031] S34. When edge computer 1 finds the same target vehicle information sent from edge computer 2, edge computer 1 stops sending the relevant information of the target vehicle to the message bus.

[0032] In the above-mentioned highway section digital twin safety management and control method, in step S33, it is determined whether the two vehicle information are the same vehicle target, and the following steps are taken:

[0033] When the license plate information of two target vehicles is found to be the same, they are considered to be the same vehicle target;

[0034] When the vehicle target information of the consumer edge computer 1 shows that the license plate is inconsistent, the vehicle model is checked to distinguish, and if the vehicle models are the same, they are considered to be the same vehicle target;

[0035] When the edge computer 2 identifies the same vehicle target, it sends the unique ID and license plate, vehicle model, vehicle body color, and vehicle speed information of the vehicle target to the message bus server.

[0036] In the above-mentioned highway section digital twin safety management and control method, the principle of step S33 is to set up detection areas only at the section entrance and the section exit. However, there are only two dynamically changing entrances and exits in the section, and the target vehicle cannot pass through other forks. Therefore, by comparing the target vehicle information at the section entrance and the section exit one by one, it is possible to re-determine that the vehicle target reappears in the detection area at the rear exit.

[0037] In the above-mentioned highway section digital twin safety management and control method, step S4 comprises the following steps:

[0038] S41, the digital restoration model generates dynamic vehicle operation targets by consuming vehicle information sent by all edge computers of the message bus;

[0039] S42. The front and body of the target vehicle are obtained by using the front image and body image obtained from the edge computer. The vehicle position information is calculated by reading the vehicle speed information and displayed at the corresponding position of the digital model according to the vehicle position.

[0040] In the above-mentioned digital twin safety management and control method for highway sections, the interactive tag is related to the actual camera video at the corresponding position or other identification with important information. When the corresponding interactive tag in the video is clicked, the video screen shot by the corresponding actual camera will be superimposed on the video screen in real time, or the picture, text and other related information of the identification will pop up.

[0041] In the above-mentioned highway section digital twin safety management and control method, the interactive tag is also connected with the actual signal control system, such as lane traffic lights, variable information boards, and variable speed limit signs for signal connection. By modifying the content of lane traffic lights, variable information boards or variable speed limit signs in the interactive tag, the current actual vehicle operation status can be changed.

[0042] Due to the adoption of the above technical scheme, the technical progress achieved by the present invention is as follows.

[0043] The present invention provides a digital twin safety management and control method for a highway section. High-speed recognition cameras are set at both ends of a highway section without a fork, and key information such as the license plate, body features, and vehicle type of the vehicle at the entrance of the section is identified, and used as a unique ID to judge the target vehicle. At the same time, the vehicle is classified according to the identification information. By re-identifying the vehicle information at the exit of the section, the same target vehicle can be effectively identified and judged. Then, the initial vehicle speed and lane information of the target vehicle in the section are calculated, thereby calculating the movement trajectory of the target vehicle, so as to establish a more accurate digital model.

[0044] The present invention also encodes the established digital model into an easy-to-store video, which is convenient for retrieving and viewing the vehicle driving process in the section, and by setting interactive functions on the video, the monitoring video content and corresponding identification text, pictures, etc. on the highway section can be viewed. It can also control the modification of the signal system, such as modifying the lane traffic lights, variable information boards or variable speed limit signs, so as to change the current actual vehicle operating status, thereby realizing safety management and control of the section. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 It is a schematic diagram of the specific structure of the present invention;

[0046] Figure 2 This is a diagram showing the effect of the license plate recognition camera of the present invention after recognition;

[0047] Figure 3 This is a picture showing the effect of the vehicle body recognition camera of the present invention after recognition;

[0048] Figure 4 This is a restoration effect diagram of the digital model described in the present invention. DETAILED DESCRIPTION

[0049] The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0050] A digital twin safety management and control method for highway sections, such as Figures 1 to 4 As shown, the following steps are included:

[0051] S1. Identify the properties of the moving target in real time at the interval entrance and establish a globally unique ID.

[0052] Step S1 includes the following steps:

[0053] S11. A high-speed camera is installed at the entrance of the section to capture the vehicle target at the entrance of the section in real time, identify the basic features of the vehicle, and classify the vehicle features.

[0054] The high-speed cameras in step S11 include a license plate recognition camera facing the front side of the vehicle's traveling direction and a vehicle body recognition camera arranged on both sides of the road.

[0055] The license plate recognition camera has the function of license plate recognition. When a vehicle enters the section entrance, the high-speed license plate recognition camera can recognize the vehicle's license plate information in real time.

[0056] The license plate recognition camera can identify the vehicle type, body color, and special characters of the vehicle, making it easier to distinguish the target vehicle.

[0057] Vehicle types include passenger cars, vans, SUV cars, minibuses, buses, taxi trucks, box trucks, van-type trucks, trailers, vehicle transporters, hazardous chemicals trucks, cement transporters, engineering vehicles, trailers, road cleaning trucks, medical vehicles, fire trucks, etc.

[0058] S12, the vehicle target information recognized by the vehicle body recognition camera and the license plate recognition camera is transmitted in real time to the edge computer 1 connected to the vehicle body recognition camera and the license plate recognition camera at the entrance.

[0059] S13. The edge computer 1 obtains the vehicle information based on the license plate recognition camera and the vehicle body recognition camera in step S12, and establishes a unique ID number for the vehicle.

[0060] The vehicle target information corresponding to the unique ID number includes five key features of the target: license plate, body features, vehicle type, speed, and travel lane.

[0061] The license plate, body features, and vehicle type can accurately identify the target vehicle, while the speed and lane information are important information for locating the target vehicle.

[0062] S2. Calculate the real-time position of the moving target detected within the range of the interval entrance.

[0063] Step S2 includes the following steps:

[0064] S21. After the edge computer 1 obtains the vehicle target's license plate and type, speed, lane and other information, it calculates the specific location and time of its driving process according to the target vehicle's current speed and lane.

[0065] S22. The edge computer 1 sends the calculated motion position information of the vehicle target, the unique ID corresponding to the target vehicle, and the license plate information, vehicle model information, and vehicle body color information corresponding to the unique ID to the system server.

[0066] The edge computer 1 is installed with the client of the message bus, the system server provides the service end of the message bus, and the edge computer 1 transmits to the message bus service through the message queue client.

[0067] Edge computer 1 sends vehicle target information to the message bus server at a frequency of 50 milliseconds.

[0068] S3. Track the real-time position of the moving vehicle target within the detection range at the section exit.

[0069] In step S3, tracking the real-time position of the mobile vehicle target in the detection range includes the following steps:

[0070] S31 . The edge computer 2 consumes the vehicle information from the edge computer 1 through the message bus technology.

[0071] S32, the edge computer 2 obtains the vehicle target information within the detection range in real time through the license plate recognition camera and the body recognition camera, and generates unique ID information according to the license plate, body color characteristics, and body type of the vehicle target.

[0072] S33: Compare the vehicle information obtained from the edge computer 1 with the vehicle information detected within the exit detection range obtained by the edge computer 2 to determine whether the two target vehicles are the same target vehicle.

[0073] To determine whether two vehicle information are the same vehicle target, take the following steps:

[0074] When the license plate information of two target vehicles is found to be the same, they are considered to be the same vehicle target;

[0075] When the vehicle target information of the consumer edge computer 1 shows that the license plate is inconsistent, the vehicle model is checked to distinguish, and if the vehicle models are the same, they are considered to be the same vehicle target;

[0076] When the edge computer 2 identifies the same vehicle target, it sends the unique ID and license plate, vehicle model, vehicle body color, and vehicle speed information of the vehicle target to the message bus server.

[0077] S34. When edge computer 1 finds the same target vehicle information sent from edge computer 2, edge computer 1 stops sending the relevant information of the target vehicle to the message bus.

[0078] Since detection areas are only set at the section entrance and exit, there will be a process where the target's driving status cannot be detected between the section entrance and the section exit. However, there are only two dynamically changing entrances and exits in the section, and the target vehicle cannot pass through other forks. Therefore, by comparing the target vehicle information at the section entrance and the section exit one by one, it is possible to re-determine that the vehicle target reappears in the rear detection area.

[0079] S4. Map and restore the actual dynamic targets in the interval on the digital model to form a set of dynamic images.

[0080] Since the system server has installed the message bus service, multiple edge computers will send information to the message bus service in real time, with a frequency of 50 milliseconds.

[0081] Step S4 includes the following steps:

[0082] S41. The digital restoration model generates dynamic vehicle operation targets by consuming vehicle information sent by all edge computers of the message bus.

[0083] S42. The front and body of the target vehicle are obtained by using the front image and body image obtained from the edge computer. The vehicle position information is calculated by reading the vehicle speed information and displayed at the corresponding position of the digital model according to the vehicle position.

[0084] S5. Perform video encoding on the full digital model obtained in step S4 to facilitate storage, transmission and display.

[0085] This step is to perform video encoding on the dynamic picture generated by step S4. The encoding bit rate is determined by the performance of the system server and can be a 4K or higher video bit rate.

[0086] The resulting real-time video encoding picture can be provided to other managers as a video, which is helpful for other operation managers to realize other functions.

[0087] S6. Connect the interactive tag with the signal system and set the AR interactive function for the encoded video.

[0088] Corresponding interactive tags can be added on the encoded video screen corresponding to the location where the camera is installed.

[0089] The interactive tag can be associated with the actual camera video at the corresponding position or other tags with important information. When the corresponding interactive tag in the video is clicked, the video screen will be superimposed with the corresponding actual camera video in real time, or the image, text and other related information of the tag will pop up.

[0090] The interactive tags created in the video can also be connected to the actual signal control system, such as lane traffic lights, variable information boards, and variable speed limit signs. By modifying the content of lane traffic lights, variable information boards or variable speed limit signs in the interactive tags, the current actual vehicle operation status can be changed.

[0091] The present invention provides a digital twin safety management and control method for a highway section. High-speed recognition cameras are set at both ends of a highway section without a fork, and key information such as the license plate, body features, and vehicle type of the vehicle at the entrance of the section is identified, and used as a unique ID to judge the target vehicle. At the same time, the vehicle is classified according to the identification information. By re-identifying the vehicle information at the exit of the section, the same target vehicle can be effectively identified and judged. Then, the initial vehicle speed and lane information of the target vehicle in the section are calculated, thereby calculating the movement trajectory of the target vehicle, so as to establish a more accurate digital model.

[0092] The present invention also encodes the established digital model into an easy-to-store video, which is convenient for retrieving and viewing the vehicle driving process in the section, and by setting interactive functions on the video, the monitoring video content and corresponding identification text, pictures, etc. on the highway section can be viewed. It can also control the modification of the signal system, such as modifying the lane traffic lights, variable information boards or variable speed limit signs, so as to change the current actual vehicle operating status, thereby realizing safety management and control of the section.

Claims

1. A highway section digital twin safety management and control method, characterized by: The following steps are involved: S1, real-time identification of moving target attributes at the interval entrance, and establishment of a global unique ID; S2, calculating the real-time position of the moving target detected within the range of the interval entrance; S3, tracking the real-time position of the moving vehicle target within the detection range at the exit of the section; S4, mapping and restoring the actual dynamic target of the interval on the digital model to form a set of dynamic pictures; S5, performing video encoding on the full digital model obtained in step S4 to facilitate storage, transmission and display; S6. Connect the interactive tag with the signal system and set the AR interactive function for the encoded video.

2. According to claim 1, a highway section digital twin safety management and control method is characterized by: Step S1 includes the following steps: S11. A high-speed vehicle body recognition camera and a license plate recognition camera are installed at the entrance of the section to capture the vehicle target at the entrance of the section in real time, identify the basic features of the vehicle, and classify the vehicle features; S12, the vehicle target information recognized by the vehicle body recognition camera and the license plate recognition camera is transmitted in real time to the edge computer 1 connected to the vehicle body recognition camera and the license plate recognition camera at the entrance; S13. The edge computer 1 obtains the vehicle information based on the license plate recognition camera and the vehicle body recognition camera in step S12, and establishes a unique ID number for the vehicle.

3. According to claim 2, a highway section digital twin safety management and control method is characterized by: The vehicle target information corresponding to the unique ID number includes five key features of the target, namely, license plate, body features, vehicle type, vehicle speed, and travel lane. Among them, the license plate, body features, and vehicle type can accurately identify the target vehicle, and the speed and lane information are important information for locating the target vehicle.

4. According to claim 1, a highway section digital twin safety management and control method is characterized by: The step S2 comprises the following steps: S21, after the edge computer 1 obtains the vehicle license plate and type, speed, lane and other information of the target vehicle in step S1, the specific position and time of the target vehicle's driving process are calculated according to the current speed and lane of the target vehicle; S22. The edge computer 1 sends the calculated motion position information of the vehicle target, the unique ID corresponding to the target vehicle, and the license plate information, vehicle model information, and vehicle body color information corresponding to the unique ID to the system server.

5. According to claim 1, a highway section digital twin safety management and control method is characterized by: In step S3, tracking the real-time position of the mobile vehicle target in the detection range includes the following steps: S31, edge computer 2 consumes vehicle information from edge computer 1 through message bus technology; S32, the edge computer 2 obtains the vehicle target information within the detection range in real time through the license plate recognition camera and the body recognition camera, and generates unique ID information according to the license plate, body color characteristics, and body type of the vehicle target; S33, comparing the vehicle information obtained from the edge computer 1 with the vehicle information detected within the exit detection range obtained by the edge computer 2 to determine whether the two target vehicles are the same target vehicle; S34. When edge computer 1 finds the same target vehicle information sent from edge computer 2, edge computer 1 stops sending the relevant information of the target vehicle to the message bus.

6. A highway section digital twin safety management and control method according to claim 5, characterized in that: In step S33, it is determined whether the two pieces of vehicle information are the same vehicle target by taking the following steps: When the license plate information of two target vehicles is found to be the same, they are considered to be the same vehicle target; When the vehicle target information of the consumer edge computer 1 shows that the license plate is inconsistent, the vehicle model is checked to distinguish, and if the vehicle models are the same, they are considered to be the same vehicle target; When the edge computer 2 identifies the same vehicle target, it sends the unique ID and license plate, vehicle model, vehicle body color, and vehicle speed information of the vehicle target to the message bus server.

7. According to claim 5, a highway section digital twin safety management and control method is characterized by: The principle of step S33 is to set up detection areas only at the entrance and exit of the interval. However, there are only two dynamically changing entrances and exits in the interval, and the target vehicle cannot pass through other forks. Therefore, by comparing the target vehicle information at the entrance and exit of the interval one by one, it is possible to re-determine that the vehicle target reappears in the detection area at the rear exit.

8. A highway section digital twin safety management and control method according to claim 1, characterized in that: The step S4 comprises the following steps: S41, the digital restoration model generates dynamic vehicle operation targets by consuming vehicle information sent by all edge computers of the message bus; S42. The front and body of the target vehicle are obtained by using the front image and body image obtained from the edge computer. The vehicle position information is calculated by reading the vehicle speed information and displayed at the corresponding position of the digital model according to the vehicle position.

9. The method for safety management and control of a highway section digital twin according to claim 1 is characterized in that: The interactive tag is associated with the actual camera video at the corresponding position or other identification with important information. When the corresponding interactive tag in the video is clicked, the video screen shot by the corresponding actual camera will be superimposed on the video screen in real time, or related information such as pictures and texts of the identification will pop up.

10. A highway section digital twin safety management and control method according to claim 1, characterized in that: The interactive tag is also connected to the actual signal control system, such as lane traffic lights, variable information boards, and variable speed limit signs. By modifying the content of lane traffic lights, variable information boards or variable speed limit signs in the interactive tag, the current actual vehicle operation status can be changed.