Intelligent crossing early warning protection system
Through the intelligent road crossing warning and protection system, the combination of the central monitoring system, the road crossing control terminal, the area acquisition terminal and the vehicle terminal is used to realize the panoramic state perception of the unattended road crossing and the intelligent driving hazard identification, solving the problem of road crossing safety hazards, and realizing the "intrinsic safety" of the road crossing.
Patent Information
- Application Number
- CN202411266107.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-11
- Publication Date
- 2025-02-25
AI Technical Summary
The existing technology cannot realize unattended railway crossing panoramic state perception and intelligent driving hazard identification, resulting in hidden dangers in the safety of the crossing.
Design an intelligent road crossing warning and protection system, including a central monitoring system, road crossing control terminal, area acquisition terminal and vehicle terminal, through wireless communication and AI video recognition and analysis algorithms, real-time monitoring and remote control of road crossing video information is realized, and virtual electronic fences are set up for automatic early warning.
It has achieved safety warning and protection for unmanned crossings, ensured driving safety at crossings, and improved the "intrinsic safety" level of crossings.
Smart Images

Figure CN119502990A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of automatic control technology, and in particular to an intelligent crossing early warning protection system. Background Art
[0002] In recent years, the "bottleneck" problem of railway crossings in enterprises has become increasingly prominent, with dangerous signs and frequent traffic disputes, which have had a great impact on the safe production of enterprises. "Small crossings" seriously threaten the safe production of the railway system of enterprises. The beyond-line-of-sight intelligent crossing warning and protection system can realize the real-time monitoring of the crossing status and remote control of the crossing equipment by the monitoring center and the driver when the crossing is unmanned, and provide drivers and managers with the ability to perceive the panoramic status of the beyond-line-of-sight crossing and the ability to identify driving hazards at the intelligent crossing, achieving a leapfrog progress in the safety control of railway crossings and truly realizing the "intrinsic safety" of the crossings.
[0003] With the continuous development of the management model of industrial and mining enterprises, the automatic alarm and protection of the crossings in Chinese enterprises have been gradually realized through the application of technologies such as video monitoring, automatic sensor detection, and automatic control of crossing equipment. The management model has also evolved from the original manned crossing to an unmanned automated crossing, achieving the goal of "reducing staff and increasing efficiency". However, in the existing model, the video status of the crossing cannot be transmitted to the operating locomotive, and the driver's line of sight is limited, and it is impossible to grasp the on-site situation of the crossing ahead in advance. In case of special circumstances, such as the curved road ahead of the crossing and special weather, it is impossible to grasp the closure of the crossing in time, and it is impossible to fully implement effective safety protection measures, and it is impossible to achieve the "essential safety" of the crossing protection. There are certain safety hazards in the crossing safety.
[0004] Create a new level crossing management mode, use the wireless communication network to send the on-site video information of the level crossing ahead to the operating locomotive for display in advance, so that the driver can predict the status of the level crossing in advance; after the level crossing alarm, use the AI video recognition and analysis algorithm to intelligently analyze and identify whether there are pedestrians and vehicles in the safety protection area, and issue early warning prompts to the driver; the monitoring center and the driver can remotely control the level crossing equipment and remotely shout to assist in level crossing protection. Summary of the invention
[0005] The present invention provides an intelligent crossing early warning and protection system, which establishes a triple crossing early warning and protection mechanism of a central monitoring system, a crossing control terminal and a vehicle-mounted terminal, so as to grasp the status of crossing equipment and crossing video information in real time, realize safety early warning and protection of unmanned crossings, and comprehensively ensure driving safety at crossings.
[0006] In order to achieve the above object, the present invention adopts the following technical solutions:
[0007] An intelligent crossing warning and protection system comprises a central monitoring system, a crossing control terminal, a regional collection terminal and a vehicle-mounted terminal, wherein the crossing control terminal collects crossing information and transmits it wirelessly to the vehicle-mounted terminal, the vehicle-mounted terminal wirelessly transmits information to the crossing control terminal and the central monitoring system, the central monitoring system performs wired transmission with the crossing control terminal, and the regional collection terminal collects on-site equipment information and transmits it to the crossing control terminal;
[0008] The central monitoring system is used for monitoring, intelligent analysis and centralized control of road crossing information;
[0009] The crossing control terminal is used to execute automatic warning and stop reporting control commands;
[0010] The regional collection terminal is used to collect the status information of the on-site section and turnout equipment;
[0011] The vehicle-mounted terminal is arranged on the operating console of the locomotive cab and is used by the driver to operate and view the real-time situation of the crossing in real time. A virtual electronic fence is set. When the crossing alarm sounds, if a vehicle or pedestrian invades the electronic fence, it will be automatically captured and a warning signal will be issued. The locomotive driver can monitor the crossing status in real time.
[0012] Furthermore, the central monitoring system is used to monitor the crossing information, which includes the status of three-display signal lights, the status of traffic post signal lights, the status of blocking signal machines, the status of crossing guardrail signals, the train running speed, the distance to the crossing, the expected time of crossing, the video information of the ground crossing, the network status, and the equipment failure status.
[0013] Furthermore, the crossing acquisition terminal includes a PLC control system, a high-definition camera, a single-line infrared laser and a limit switch. The PLC control system is connected to the field control equipment and the central monitoring system. The high-definition camera collects crossing video information. The field control equipment status includes the section occupancy status, the switch fixed reverse position status, and the information machine development status. The single-line infrared laser collects the running position of the train when approaching the crossing, and automatically determines whether the train is in the crossing alarm zone. The limit switch collects the real-time running position of the crossing guardrail, including the upper and lower limits of the running. The high-definition camera is connected to the central monitoring system, and the single-line infrared laser and the limit switch are both connected to the PLC control system.
[0014] Furthermore, the regional acquisition terminal collects the status information of the on-site section and turnout equipment and transmits it to the PLC control system of the crossing acquisition terminal. When a network interruption or circuit failure occurs between the regional acquisition terminal and the crossing control terminal, and remote centralized control or automatic crossing alarm is impossible, the crossing control terminal automatically turns off the locomotive running lights to indicate that the crossing equipment is in a faulty state, and the central monitoring system issues a fault warning at the same time.
[0015] Furthermore, the on-board terminal is provided with a Beidou positioning system and a display terminal to collect the position of the locomotive in real time. After arriving at the designated position of the set crossing, the network transmission equipment is automatically triggered, automatic addressing is performed, a wireless network connection is established, and the collected crossing video is streamed and optimized in the central monitoring system and sent to the display terminal on the locomotive in real time.
[0016] Furthermore, the vehicle-mounted terminal is used to set up a virtual electronic fence, specifically including the following contents:
[0017] S1. Image acquisition and preprocessing: Acquire the video image frames at the crossing site and preprocess the images, such as noise reduction and contrast enhancement;
[0018] S2. Delineate the alarm area: Provide a user-defined operation interface. The user can draw or select a rectangular area as the alarm area on the crossing site video screen. The area is an electronic fence, and the coordinate information of the electronic fence alarm area is stored;
[0019] S3. Target detection:
[0020] S3.1, Feature extraction: The input image is adjusted to a fixed size, and then the target feature is extracted. The YOLO target detection algorithm is used to divide the input image into S×S grids. If the center point of an object falls into a grid cell, then the grid cell is responsible for predicting the object. A grid can only predict one object. Two prediction boxes are generated for one object and one grid. Each prediction box has four factors B (x, y, w, h), where:
[0021] B is the predicted bounding box, which is a value between 0 and 1;
[0022] W is the width of the prediction box, which is a value between 0 and 1;
[0023] H is the height of the prediction box;
[0024] X is the X-axis offset of the center coordinate of the prediction box compared to the upper left corner of the grid cell, between 0 and 1;
[0025] Y is the Y-axis offset of the center coordinate of the prediction box compared to the upper left corner of the grid cell, between 0 and 1;
[0026] S3.2, object detection: For each grid cell, filter out the bounding box with the highest confidence, and then remove duplicate detection results through non-maximum suppression;
[0027] S3.3, output results: output the detected target category and bounding box position;
[0028] S4, alarm judgment: for each detected target object, determine whether it is in the custom-set road crossing electronic fence alarm area. If the boundary box of the target object intersects with the alarm area, it is considered that the target has entered the alarm area.
[0029] When the target enters the alarm area, the alarm signal is triggered and a voice warning prompt is given.
[0030] Furthermore, the crossing control terminal is arranged next to an unmanned crossing, and includes an integrated crossing host, video surveillance equipment, a barrier machine, a pulley, lighting, and sound and light alarm lights. The crossing control terminal is connected to the integrated crossing host, the barrier machine, the pulley, and the sound and light alarm lights, and the video surveillance equipment is connected to the integrated crossing host.
[0031] Compared with the prior art, the present invention has the following beneficial effects:
[0032] 1) Set up a virtual electronic fence in the crossing area through the vehicle-mounted terminal, and automatically capture and analyze the features through target feature extraction, target tracking and target detection, so as to realize early warning and prompt of vehicles, pedestrians or other objects invading the electronic fence at the crossing, and ensure safe driving at the crossing;
[0033] 2) Ensure the centralized control and operation of all locomotives at unmanned crossings through information monitoring, intelligent analysis and centralized control of the central monitoring system;
[0034] 3) The locomotive position is located in real time through the Beidou positioning system of the on-board terminal, and is wirelessly sent to the central monitoring system. The driver can also be informed of the crossing status in advance through the display terminal installed on the operating console of the locomotive cab. After the crossing alarm, the virtual electronic fence is used to intelligently analyze and identify whether there are pedestrians and vehicles in the safety protection area, and the driver is warned. The monitoring center and the driver can remotely control the crossing equipment and remotely shout to assist in crossing protection.
[0035] 4) Realize safety protection of automatic level crossings, realize true safety of unmanned level crossings, and realize centralized control of rail locomotives. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] Figure 1 It is a schematic diagram of the structure of the present invention.
[0037] Figure 2 It is a schematic diagram of the installation position structure of the unmanned crossing equipment of the present invention.
[0038] In the picture: 1. High-definition camera 2. Sound and light alarm lamp 3. Lighting lamp 4. Barrier machine 5. Blocking signal machine 6. Crossing host DETAILED DESCRIPTION
[0039] The specific implementation of the present invention will be further described below in conjunction with the accompanying drawings:
[0040] See Figure 1 , is a schematic diagram of the structure of the present invention. The present invention provides an intelligent crossing warning and protection system, including a central monitoring system, a crossing control terminal, a regional acquisition terminal and a vehicle-mounted terminal, wherein the crossing control terminal collects crossing information and wirelessly transmits it to the vehicle-mounted terminal, the vehicle-mounted terminal wirelessly transmits information to the crossing control terminal and the central monitoring system, the central monitoring system performs wired transmission with the crossing control terminal, and the regional acquisition terminal collects on-site equipment information and transmits it to the crossing control terminal;
[0041] The central monitoring system is used for monitoring, intelligent analysis and centralized control of road crossing information;
[0042] The crossing control terminal is used to execute automatic warning and stop reporting control commands;
[0043] The regional acquisition terminal is used to collect crossing video information;
[0044] The vehicle-mounted terminal is arranged on the operating console of the locomotive cab and is used by the driver to operate and view the real-time situation of the crossing in real time. A virtual electronic fence is set. When the crossing alarm sounds, if a vehicle or pedestrian invades the electronic fence, it will be automatically captured and a warning signal will be issued. The locomotive driver can monitor the crossing status in real time.
[0045] The central monitoring system is responsible for monitoring the working status of all crossing equipment on the line, including the status of three-display signal lights, traffic post signal lights, the status of the blocking signal machine 5, the status of the crossing barrier signal, the train running speed, the distance to the crossing, the estimated time of crossing, the video information of the ground crossing, the network status, the equipment failure status, and remotely centrally controlling all locomotives, remotely controlling the opening and closing of the crossing equipment, and the raising and lowering of the crossing barrier machine 4;
[0046] During the centralized control process on the central monitoring system, clicking on the online crossing on the central monitoring system will pop up the crossing video information status, which can display the video information of each crossing in real time; the equipment status of each crossing can be displayed in the monitoring center interface, and the opening and closing of each crossing equipment can be controlled. The central monitoring system has a communication interface that can realize remote alarm voice transmission. The central monitoring system has online query and historical information archiving functions for crossing alarm information logs, crossing equipment fault warning information logs, and operation log information logs, and can perform historical playback of crossing operation conditions and equipment status.
[0047] See Figure 2The crossing control terminal is arranged beside an unmanned crossing, and includes an integrated crossing host 6, a video monitoring device, a wood barrier machine 4, a pulley, a lighting lamp 3, and an audible and visual alarm lamp 2. The crossing control terminal is connected to the integrated crossing host 6, the wood barrier machine 4, the pulley and the audible and visual alarm lamp 2. The video monitoring device is connected to the integrated crossing host 6 to form a trackside crossing status monitoring and control subsystem, transmit the crossing video and equipment status information, and receive the crossing control command and voice information from the vehicle-mounted and central equipment to realize the remote control function of the crossing. The ground crossing equipment functions include communication function, data acquisition function, control function and industrial camera monitoring function. The crossing control terminal integrated crossing host 6 has manual alarm and stop reporting functions, and has the ability to realize the control of the crossing equipment on site when the network conditions are interrupted;
[0048] The crossing control terminal communicates using wireless networks and wired networks. The crossing control terminal communicates wirelessly with the vehicle-mounted terminal, the vehicle-mounted terminal communicates wirelessly with the central monitoring system, and the crossing control terminal communicates wired with the central monitoring system. The crossing control terminal sends video information and audio information of the crossing area to the vehicle-mounted terminal and the central monitoring system, receives control commands from the vehicle-mounted equipment and the central equipment, and controls the crossing barrier 4. The crossing control terminal includes a PLC control system, a high-definition camera 1, a single-line infrared laser, and a limit switch. The high-definition camera 1 collects images of the crossing area in real time. The high-definition camera 1 has an infrared fill light function and can collect images clearly and stably in low light and night environments. The area acquisition terminal is interlocked with the on-site microcomputer system Through information communication, the status information of on-site sections, switches and other equipment can be obtained in real time. Through the intelligent alarm model of the crossing, the alarm and stop reporting status of the crossing can be automatically calculated, and the status information can be sent to the crossing control terminal to realize the automatic alarm function of the crossing. The status of the on-site control equipment includes the section occupancy status, the switch reverse position status, and the information machine development status. The single-line infrared laser collects the running position of the train when approaching the crossing, and automatically determines whether the train is in the crossing alarm zone. The limit switch collects the real-time running position of the crossing guardrail, including the upper and lower limits of running. The high-definition camera 1 is connected to the central monitoring system, and the single-line infrared laser and limit switch are both connected to the PLC control system; the PLC control system adopts Siemens PLC, and the equipment is safe and reliable.
[0049] The vehicle terminal uses AI intelligent algorithms to set up a virtual electronic fence in the safety area of the crossing, and issues intelligent warnings to people and objects that invade the electronic fence, prompting the driver to take safety precautions, specifically including the following steps:
[0050] S1. Image acquisition and preprocessing: Acquire the video image frames at the crossing site and preprocess the images, such as noise reduction and contrast enhancement;
[0051] S2. Delineate the alarm area: Provide a user-defined operation interface. The user can draw or select a rectangular area as the alarm area on the crossing site video screen. The area is an electronic fence, and the coordinate information of the electronic fence alarm area is stored;
[0052] S3. Target detection:
[0053] S3.1, Feature extraction: The input image is adjusted to a fixed size, and then the target feature is extracted. The YOLO target detection algorithm is used to divide the input image into S×S grids. If the center point of an object falls into a grid cell, then the grid cell is responsible for predicting the object. A grid can only predict one object. Two prediction boxes are generated for one object and one grid. Each prediction box has four factors B (x, y, w, h), where:
[0054] B is the predicted bounding box,
[0055] W is the width of the prediction box, which is a value between 0 and 1 compared to the ratio of 448 pixels. When the pixel is 300, the value is 300 / 448=0.67;
[0056] H is the height of the prediction box, which is a value between 0 and 1 compared to the ratio of 448 pixels. When the pixel is 300, the value is 300 / 448=0.67;
[0057] X is the X-axis offset of the center coordinate of the prediction box compared to the upper left corner of the grid cell, between 0 and 1;
[0058] Y is the Y-axis offset of the center coordinate of the prediction box compared to the upper left corner of the grid cell, between 0 and 1;
[0059] S3.2, object detection: For each grid cell, filter out the bounding box with the highest confidence, and then remove duplicate detection results through non-maximum suppression;
[0060] S3.3, output results: output the detected target category and bounding box position;
[0061] S4, alarm judgment: for each detected target object, determine whether it is in the custom set intersection electronic fence alarm area. If the boundary box of the target object intersects with the alarm area, it is considered that the target has entered the alarm area. When the target enters the alarm area, an alarm signal is triggered and a voice warning prompt is given;
[0062] The vehicle-mounted terminal is arranged on the operating console of the locomotive cab, which is convenient for the driver to operate and view the real-time situation of the crossing in real time, realize the remote control of the railing machine 4 of all the ground crossing trackside equipment and the video and voice monitoring of the crossing. The vehicle-mounted terminal also has the function of voice communication with the central monitoring system to realize the remote shouting function. The Beidou positioning system and display terminal are arranged on the vehicle-mounted terminal to collect the position of the locomotive in real time, have the real-time positioning function, obtain the real-time positioning information of the train, and send it to the central monitoring system through the wireless network. It can obtain the distance of the crossing in front of the train, the train running speed and other related information according to the line map information, and automatically trigger the network transmission equipment and perform automatic addressing after arriving at the specified position of the set crossing to establish a wireless network connection. , and the collected crossing video is streamed and optimized at the regional acquisition terminal, and sent to the display terminal on the locomotive in real time. The display terminal displays the real-time video, distance, and status information of the crossing. The on-board terminal is provided with an automatic switching function of the crossing video information, which can switch to the nearest next crossing video in real time, and automatically close the video information of leaving the crossing. The on-board terminal is also provided with real-time remote shouting, which can remotely communicate with the crossing and the central monitoring system in real time according to the on-site video information of the crossing, and can remotely operate the opening and closing of the front crossing barrier 4, and has an anti-mistouch function. The on-board terminal has status judgment, and has the function of intelligently detecting and displaying the current communication status and positioning status, and issues an alarm in case of abnormality.
[0063] The above embodiments are implemented based on the technical solution of the present invention, and detailed implementation methods and specific operation processes are given, but the protection scope of the present invention is not limited to the above embodiments. The methods used in the above embodiments are conventional methods unless otherwise specified.
Claims
1. An intelligent crossing warning and protection system, characterized in that: It includes a central monitoring system, a crossing control terminal, a regional collection terminal and a vehicle-mounted terminal. The crossing control terminal collects crossing information and transmits it wirelessly to the vehicle-mounted terminal. The vehicle-mounted terminal wirelessly transmits information to the crossing control terminal and the central monitoring system. The central monitoring system performs wired transmission with the crossing control terminal. The regional collection terminal collects on-site equipment information and transmits it to the crossing control terminal. The central monitoring system is used for monitoring, intelligent analysis and centralized control of road crossing information; The crossing control terminal is used to execute automatic warning and stop reporting control commands; The regional collection terminal is used to collect the status information of the on-site section and turnout equipment; The vehicle-mounted terminal is arranged on the operating console of the locomotive cab and is used by the driver to operate and view the real-time situation of the crossing in real time. A virtual electronic fence is set. When the crossing alarm sounds, if a vehicle or pedestrian invades the electronic fence, it will be automatically captured and a warning signal will be issued. The locomotive driver can monitor the crossing status in real time.
2. The intelligent crossing warning and protection system according to claim 1 is characterized in that: The central monitoring system is used to monitor the crossing information, which includes the status of three-display signal lights, traffic post signal lights, blocking signal machine status, crossing guardrail signal status, train running speed, distance to the crossing, expected crossing time, ground crossing video information, network status, and equipment failure status.
3. The intelligent crossing warning and protection system according to claim 1 is characterized in that: The crossing acquisition terminal includes a PLC control system, a high-definition camera, a single-line infrared laser and a limit switch. The PLC control system is connected to the field control equipment and the central monitoring system. The high-definition camera collects crossing video information. The field control equipment status includes the section occupancy status, the switch fixed reverse position status, and the information machine development status. The single-line infrared laser collects the running position of the train when approaching the crossing, and automatically determines whether the train is in the crossing alarm zone. The limit switch collects the real-time running position of the crossing guardrail, including the upper and lower limits of the running. The high-definition camera is connected to the central monitoring system, and the single-line infrared laser and the limit switch are both connected to the PLC control system.
4. The intelligent crossing warning and protection system according to claim 3 is characterized in that: The regional acquisition terminal collects the status information of the on-site section and turnout equipment and transmits it to the PLC control system of the crossing acquisition terminal. When a network interruption or circuit failure occurs between the regional acquisition terminal and the crossing control terminal, and remote centralized control or automatic crossing alarm is impossible, the crossing control terminal automatically turns off the locomotive running lights to indicate that the crossing equipment is in a faulty state, and the central monitoring system issues a fault warning at the same time.
5. The intelligent crossing warning and protection system according to claim 1 is characterized in that: The on-board terminal is equipped with a Beidou positioning system and a display terminal to collect the position of the locomotive in real time. After arriving at the specified position of the set crossing, it automatically triggers the network transmission equipment, performs automatic addressing, establishes a wireless network connection, and performs streaming media processing and optimization on the collected crossing video in the central monitoring system, and sends it to the display terminal on the locomotive in real time.
6. The intelligent crossing warning and protection system according to claim 1 is characterized in that: The vehicle-mounted terminal is used to set up a virtual electronic fence, which specifically includes the following contents: S1. Image acquisition and preprocessing: Acquire the video image frames at the crossing site and preprocess the images, such as noise reduction and contrast enhancement; S2. Delineate the alarm area: Provide a user-defined operation interface. The user can draw or select a rectangular area as the alarm area on the crossing site video screen. The area is an electronic fence, and the coordinate information of the electronic fence alarm area is stored; S3. Target detection: S3.1, Feature extraction: The input image is adjusted to a fixed size, and then the target feature is extracted. The YOLO target detection algorithm is used to divide the input image into S×S grids. If the center point of an object falls into a grid cell, then the grid cell is responsible for predicting the object. A grid can only predict one object. Two prediction boxes are generated for one object and one grid. Each prediction box has four factors B (x, y, w, h), where: B is the predicted bounding box, which is a value between 0 and 1; W is the width of the prediction box, which is a value between 0 and 1; H is the height of the prediction box; X is the X-axis offset of the center coordinate of the prediction box compared to the upper left corner of the grid cell, between 0 and 1; Y is the Y-axis offset of the center coordinate of the prediction box compared to the upper left corner of the grid cell, between 0 and 1; S3.2, object detection: For each grid cell, filter out the bounding box with the highest confidence, and then remove duplicate detection results through non-maximum suppression; S3.3, output results: output the detected target category and bounding box position; S4, alarm judgment: for each detected target object, determine whether it is within the custom-set intersection electronic fence alarm area. If the boundary box of the target object intersects with the alarm area, it is considered that the target has entered the alarm area. When the target enters the alarm area, an alarm signal is triggered and a voice warning prompt is given.
7. The intelligent crossing warning and protection system according to claim 1 is characterized in that: The crossing control terminal is arranged next to an unmanned crossing, and includes an integrated crossing host, a video surveillance device, a barrier machine, a pulley, a lighting lamp, and an audible and visual alarm lamp. The crossing control terminal is connected to the integrated crossing host, the barrier machine, the pulley, and the audible and visual alarm lamp, and the video surveillance device is connected to the integrated crossing host.
Citation Information
Cited By
Railway crossing personnel intrusion identification method and device, electronic equipment and storage medium
CN120766315A