Railway crossing intelligent safety management early warning system

Abstract

The present application relates to the technical field of radio wave signal transmission, and specifically discloses a railway crossing intelligent safety management early warning system, which is composed of a dispatching center device, a machine room device and a crossing device, and communicates, warns and controls information through an optical network switch, and the machine room device is provided with a track interlocking host computer, and further comprises an information acquisition processing and analysis module arranged in the machine room device and connected to the track interlocking host computer through a wireless communication connection of sensors, monitors and interphones arranged in the crossing device; the railway crossing intelligent safety management early warning system is arranged between the crossing device, the machine room device and the dispatching center device, and is used in combination with a crossing protection system platform software in the dispatching center device, image algorithm training and mask positioning technology are adopted to realize the railway crossing intelligent safety management function, and the time of train running in and out of the crossing is accurately calculated.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of radio wave signal transmission, and in particular to an intelligent safety management and early warning system for railway crossings. BACKGROUND

[0002] A crossing is a crossroad where a train track intersects with a road or a street. When a train arrives, the road is closed, and after the train passes, the road is opened, allowing motor vehicles and pedestrians to pass. During the operation of railway vehicles, locomotives, and work vehicles, whether in a section or a station, or on a main line, a station, or a yard, due to negligence or obstructed vision, accidents of trains colliding with pedestrians or motor vehicles often occur at level crossings or where staff are working on the track surface, causing immeasurable losses and harm to society and families. As everyone knows, life is more important than Mount Tai, and the significant social problem of causing harm to life cannot be tolerated. Therefore, safety is of the utmost importance when a train approaches a crossing to avoid harm to personnel.

[0003] With the rapid development of society, digitalization and intelligentization are the mainstream, and cost reduction and efficiency improvement are required by the trend. Existing train approach alarm systems are mainly divided into two types. One type is to install an alarm in a dangerous area, and a station or a dispatching staff manually broadcasts train approach information. This system requires manual intervention, involves a large amount of labor costs, and is a non-intelligent product, which has the problems of low practicality, incomplete early warning, and poor safety. The other type uses a track surface trigger to notify a dangerous area alarm to broadcast train approach information through wired or wireless communication. However, this system has not been widely used because it requires the laying of power supply and device connection cables, is limited by the construction environment, and requires a large amount of manpower and resources for construction and maintenance. In addition, the demand for early warning systems in track construction is large, which has the problems of high cost, low efficiency, and poor practicality. Since the track surface trigger for track early warning is still in the theoretical stage of textual summary and has not been put into practice for popularization and use, and at the crossing of the track operation, the safety management of the early warning system is not intelligent enough, leading to errors in early warning management, and there are drawbacks in the safety management of the railway early warning system.

[0004] Therefore, the present application provides an intelligent safety management and early warning system for railway crossings, which uses self-developed ultra-low power consumption technology to control the overall standby power consumption of the track surface trigger for track early warning to be in the microampere level. The system does not require trenching and wiring during installation, which reduces construction costs and improves installation and maintenance efficiency. In addition, the system uses image recognition technology in combination with a crossing protection system platform software to improve the intelligent safety management of railway crossings, ensuring the safety of track operation and practicality. SUMMARY

[0005] (I) Technical problems solved

[0006] In view of the deficiencies of the prior art, the present application provides a railway crossing intelligent safety management early warning system, which is set between crossing equipment, machine room equipment and dispatching center equipment, sets up a wheel sensor with wiring-free and ultra-low power consumption on the crossing equipment, adopts a car receiving trigger powered by solar energy, and is used in combination with a crossing protection system platform software in the dispatching center equipment, adopts image algorithm training and mask positioning technology, and solves the problems in the background technology.

[0007] (II) Technical scheme

[0008] To achieve the above object, the present application is implemented by the following technical scheme: a railway crossing intelligent safety management early warning system is composed of dispatching center equipment, machine room equipment and crossing equipment, and communicates, warns and controls information through an optical network switch, and the machine room equipment is provided with a track interlocking host, further comprising an information acquisition processing and analysis module arranged in the machine room equipment, which is wirelessly connected to the track interlocking host through sensors, monitors and interphones arranged on the crossing equipment, and the track interlocking host is wirelessly connected to a video encoder and a hard disk recorder for data transmission, storage and preprocessing, and the processed information is transmitted to a control host and a control display in the dispatching center equipment through the optical network switch for visual monitoring of the intelligent management;

[0009] A remote communication control module is connected to the optical network switch and transmits data through the optical fiber of the optical network switch, and is used for monitoring, managing and communicating the remote crossing equipment by the dispatching center equipment, and has the characteristics of high signal transmission speed, low delay and strong anti-interference ability;

[0010] A visual real-time monitoring module receives video and image information collected by the crossing equipment through the remote communication control module and transmits them to the control display in the dispatching center equipment, displays the entry and exit of the crossing locomotive by using 3D software and wireless network technology, and synchronizes the information to the intelligent safety management module for control, which is used for real-time monitoring and safety management of the railway crossing, and improves the safety of the crossing and the operation efficiency of the locomotive;

[0011] An intelligent safety management module is embedded in the analysis control host of the dispatching center equipment, receives data information of the information acquisition processing and analysis module, analyzes the safety performance in combination with the information of the visual real-time monitoring module, and transmits corresponding safety measure information to the early warning and control module for execution to realize safety management;

[0012] An early warning and control module receives intelligent safety management instructions of the intelligent safety management module, controls the crossing equipment through wireless communication to release the early warning signal of the locomotive driving to the crossing and the control gate of the crossing, which is used to ensure the safety of the locomotive driving process and the vehicles driving on the crossing.

[0013] Further, the intelligent safety management module includes a central control processing chip, a wireless transceiver, an image processor, and an AI prediction analysis unit. The central control processing chip is an integrated circuit chip embedded in the dispatch center device to analyze and control the internal host. The wireless transceiver and the image processor are connected by any one of a serial communication interface, a serial peripheral interface, or a communication protocol. Data transmission and reception are achieved through the connection interface or protocol, which has the characteristics of high efficiency and bidirectionality for data transmission, and is used to execute instructions of a computer program and control the operation of the computer. The wireless transceiver is a device that uses radio waves to achieve wireless data input and output. The image processor is a chip that uses high-performance image processing capabilities and specific image processing algorithm technology to process image data. It shares information with the central control processing chip and connects a computer display screen through an HDMI cable to display the intersection image in high definition. The image information processing includes image enhancement, image filtering, image compression, feature extraction and recognition, image synthesis and synthesis effect, and real-time image processing operation. Specifically, it collects and processes video monitoring information of the intersection real-time monitoring train. The AI prediction analysis unit uses artificial intelligence algorithms and high-performance hardware devices. It analyzes and models the intersection train trajectory data using AI algorithms such as machine learning and deep learning, and generates prediction results with high accuracy and reliability. The functions of the AI prediction analysis unit include data analysis and prediction, pattern recognition and classification, risk assessment and decision support, optimization and improvement, and automation and rapid decision-making.

[0014] Further, the visual real-time monitoring module includes a monitoring camera deployed in the intersection device, a hard disk video recorder equipped in the machine room device, and a visual intercom host and display screen in the dispatch center device. The monitoring camera is a high-definition camera installed on the entrance and exit roads of the intersection and on the railway train path. It is used to capture the situation of the railway intersection in real time and transmit the real-time video stream to the display screen for display, so that the track operator can monitor the situation of the railway intersection in real time and make necessary treatment and judgment. The hard disk video recorder is composed of a hard disk drive, a video compression encoder, a video input / output interface, and an operation management system. It is a device for recording, storing, and playing back video. It has the functions of video recording, storage, playback, remote access, event detection and alarm, and management and configuration, providing efficient and reliable video management technology for safety monitoring of railway intersections. The visual intercom host is a device that centrally manages and controls the functions of the intercom system. It can connect with several visual intercoms and provide voice and video communication, intercom system settings, and management functions. The display screen displays the video images of several high-definition cameras and real-time visual intercom video communication images.

[0015] Further, the remote communication control module comprises a visual intercom, an optical network switch, an audible and light alarm, and a signal line. The visual intercom is a device composed of a high-definition camera, a display screen, an audio device, and a dialing or calling button, which combines voice and video communication functions, and is used for two-way communication and real-time viewing of video image information of the other party by the personnel in the duty room. The optical network switch is an optical-electric conversion technology that can receive optical signals and perform forwarding processing, thereby realizing the exchange and transmission of data in the optical fiber network. The audible and light alarm is composed of a loudspeaker or a speaker and a flash, which is a safety device with sound alarm and flash warning functions, and is used to issue a loud sound and a visible light signal in the case of emergency when the train is running out of the railway crossing. It can be remotely controlled and managed by the intelligent safety management module. The signal line is used for data interaction between the field devices at the railway crossing in LORA wireless mode, and data transmission in 4G network wired mode.

[0016] Further, the early warning and control module comprises a crossing control box and a barrier control button. The crossing control box comprises a crossing controller, a power adapter, a PDU, an optical network switch, and a serial network converter. The barrier control button comprises a communication button and an emergency button, which are used to control the opening and closing state of the barrier lifting and lowering.

[0017] Further, the information collection processing and analysis module comprises a wheel sensor, a solar power supply panel, a vehicle receiving trigger, a crossing control alarm, an LED reminder screen, and a crossing video monitoring device installed in the crossing device. The wheel sensor has the functions of wiring-free and ultra-low power consumption, and can use wireless communication technology to monitor the running state, tire pressure, and temperature parameters of the wheel in real time, and provide real-time data and reminders for the train entering and leaving the crossing. The solar power supply panel is an equipment that receives solar energy and converts it into electrical energy, which is stored to provide power for the wheel sensor and the vehicle receiving trigger. It has the characteristics of independent power supply, high efficiency, energy saving, long-term stability, simplified maintenance, and expandable flexibility. The vehicle receiving trigger is a device installed at both ends of the railway crossing to automatically detect the arrival of the train. The crossing control alarm provides a warning signal when the train is running out of the railway crossing. The LED reminder screen uses light emitting diode technology to display different colors, numbers, characters, or icons for warning. The crossing video monitoring device installs a high-definition camera at the crossing to monitor and record the train running out of the crossing in real time.

[0018] Further, the dispatch center device comprises a display, an analysis control host, a visual intercom host, a PDU and an HDMI; the analysis control host is installed with a crossing protection system platform software, which is used for acquiring video information of track interlocking encoders in the equipment room in real time, performing image recognition analysis, collecting and counting crossing vehicle information logs in real time, sending a gate lifting and falling instruction according to train approaching information, and configuring a periodic time; the PDU is installed in a cabinet, connected to a power supply or an UPS through a power plug, and has a plurality of power sockets, which can provide a plurality of power output channels, and the output channels can be monitored and controlled through a power management function, so that the PDU is used for managing and distributing power to computer equipment, servers and network equipment in the dispatch center device and the equipment room, and can provide overload protection and power control functions to ensure the stability and safety of power supply, and has a network management function to remotely monitor and manage power distribution through a network; the HDMI is an interface device connecting the display and the analysis control host, which is used for transmitting high-quality audio and video signals to avoid loss of analog signal conversion and provide clearer and more accurate image and audio effects.

[0019] Further, the equipment room device comprises a video encoder, a hard disk video recorder, a track interlocking host, an HDMI or a VGA, the video encoder is used for compressing and encoding original video signals for more efficient transmission, storage and processing of video data; the hard disk video recorder is used for recording and storing video signals collected by the video monitoring of the crossing device, and has the functions of video recording, video storage, video management, remote access and monitoring, security and monitoring, data analysis and application; the track interlocking host is a centralized system for railway train dispatching and control, which is responsible for train dispatching and control, signal control and route management, train interval and speed adjustment, centralized monitoring and alarm, and data recording and analysis, and is used for real-time monitoring and control of train operation on the railway track to ensure safe, efficient and on-time train operation; the VGA is used for connecting a computer and a display to transmit analog video signals; the crossing device comprises a gate, a visual intercom, a video monitoring, a communication button, an emergency button and a crossing control box, the gate is a control device installed at the crossing, which is used for controlling the opening and closing of the crossing, limiting the passage of vehicles, non-vehicle and pedestrians through the railway crossing track, and has the functions of traffic control, safety protection, prompt and illegal monitoring.

[0020] Further, the crossing protection system platform software is a software integrating voice communication system, visual monitoring system, GPS positioning system, data processing and management system and early warning dispatching system, adopts image algorithm training and mask positioning technology, trains and compares and identifies the picture information of the train passing through the crossing, so as to extract the signal lights, switches and track conditions of each track of each crossing, judge whether the train will pass through the crossing, and provide the functions of real-time monitoring, communication cooperation, position tracking, data processing and decision support of the train driving out of the railway crossing, help the duty room dispatcher to efficiently manage and control the operation of the railway crossing safety dispatching, specifically including real-time acquisition of track interlocking encoder video information in the machine room and image recognition analysis; collecting and counting crossing vehicle information logs; sending barrier lifting and falling instructions according to train approach information after a certain time; remotely manually controlling the barrier lifting and falling; and real-time display of crossing video monitoring information.

[0021] Further, the image algorithm training and mask positioning technology is a machine learning and computer vision technology based on image recognition, which first acquires the whole display picture information output by HDMI, and then trains, registers and compares and identifies, the specific steps are as follows:

[0022] A1, prepare data as a training set: a large number of images labeled with correct masks are needed as a training set, which contains the region of interest and the corresponding mask information for labeling the region;

[0023] A2, establish a training image algorithm model: use machine learning or deep learning algorithm to train the prepared training data, the goal of the algorithm model is to learn the features and patterns of the region of interest, so as to accurately segment and locate the target in the image, define the feature extraction method and select the appropriate model architecture during the training process, and continuously adjust the model parameters through optimization algorithm;

[0024] A3, evaluation and optimization of the trained image algorithm model: after training, evaluate the performance of the model with part of the unseen test data, measure the effect of the model by calculating evaluation indicators, including accuracy, recall rate, F1 score, etc.; if the model does not meet the expectation, further adjust the model architecture, training parameters or data enhancement for optimization;

[0025] A4, mask positioning: use the trained model to perform mask positioning on new images, first through image preprocessing, then convert the input image into a format acceptable to the model; input the image into the model for inference to obtain the mask of the region of interest; wherein the mask is a binary image, the position value of the region of interest is marked as 1, and the other regions are 0; finally, according to the mask information, extract, crop or process the region of interest;

[0026] A5, post-processing of results: according to the requirements of the railway crossing identification picture, the results of mask positioning are filtered, corrected or interpolated after processing, and then processed.

[0027] The present application provides a railway crossing intelligent safety management early warning system, which has the following beneficial effects:

[0028] The present application sets up a railway crossing intelligent safety management early warning system between crossing equipment, machine room equipment and dispatching center equipment, and uses it in combination with crossing protection system platform software in the dispatching center equipment, adopts image algorithm training and mask positioning technology, realizes the function of railway crossing intelligent safety management, achieves accurate calculation of the time of train running in and out of the crossing, improves the accuracy of early warning and safety management effect, and through laying of wiring-free and ultra-low power consumption wheel sensors in the crossing equipment and the use of solar-powered car triggering structure, realizes no need of construction trenching and wiring during installation, reduces construction cost and improves installation and maintenance efficiency. BRIEF DESCRIPTION OF DRAWINGS

[0029] Figure 1 It is a railway crossing intelligent safety management early warning system block diagram of the present application.

[0030] Figure 2 It is an intelligent safety management module diagram of the present application.

[0031] Figure 3 It is a visual real-time monitoring module diagram of the present application.

[0032] Figure 4 It is a remote communication control module diagram of the present application.

[0033] Figure 5 It is a warning and control module diagram of the present application.

[0034] Figure 6 It is a collection information processing and analysis module diagram of the present application.

[0035] Figure 7 It is a railway crossing intelligent safety management early warning system composition structure flow chart of the present application.

[0036] Figure 8 It is a railway crossing intelligent safety management early warning system composition equipment structure schematic diagram of the present application.

[0037] Figure 9 It is a crossing equipment electrical connection diagram of the present application.

[0038] Figure 10 It is a crossing equipment deployment structure schematic diagram of the present application. DETAILED DESCRIPTION

[0039] With reference to the accompanying drawings, the technical solutions in the embodiments of the present application will be described clearly and completely. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of the present application.

[0040] Embodiment 1

[0041] Please refer to Figure 1 The present application provides an intelligent safety management and early warning system for a railway crossing, which is composed of a dispatching center device, a machine room device and a crossing device, and communicates information, gives early warning and control through an optical network switch, and the machine room device is provided with a track interlocking host computer, and further comprises an information acquisition, processing and analysis module, which is arranged in the machine room device, and is connected to the track interlocking host computer through a wireless communication connection of sensors, monitors and interphones arranged in the crossing device, and the track interlocking host computer is connected to a video encoder and a hard disk recorder through a wired connection for data transmission, storage and preprocessing, and the processed information is transmitted to a control host and a control display in the dispatching center device through the optical network switch for visual monitoring of the intelligent management.

[0042] A remote communication control module is connected to the optical network switch and transmits data through the optical fiber of the optical network switch, and is used for monitoring, managing and communicating the remote crossing device by the dispatching center device, and has the characteristics of high signal transmission speed, low delay and strong anti-interference ability.

[0043] A visual real-time monitoring module receives video and image information collected by the crossing device through the remote communication control module and transmits the information to the control display in the dispatching center device, displays the entry and exit of the crossing locomotive through the wireless network technology of the 3D software, and synchronizes the information to the intelligent safety management module for management and control, and is used for real-time monitoring and safety management of the railway crossing, and improves the safety of the crossing and the operation efficiency of the locomotive.

[0044] An intelligent safety management module is embedded in the analysis and control host of the dispatching center device, receives data information of the information acquisition, processing and analysis module, analyzes the safety performance in combination with the information of the visual real-time monitoring module, and transmits corresponding safety measure information to the early warning and control module for execution to realize safety management.

[0045] An early warning and control module receives intelligent safety management instructions of the intelligent safety management module, controls the crossing device through wireless communication to release the early warning signal of the locomotive driving to the crossing and the control gate of the crossing, and is used for ensuring the safety of the locomotive driving process and the driving vehicles and flowing personnel of the crossing.

[0046] Embodiment 2

[0047] Please refer to Figures 2-6 The present application provides a railway crossing intelligent safety management early warning system, which is further disclosed and supplemented based on the content of embodiment 1. The intelligent safety management module includes a central control processing chip, a wireless transceiver, an image processor, and an AI prediction analysis unit. The central control processing chip is an integrated circuit chip embedded in the analysis and control host of the dispatch center device. It is connected to the wireless transceiver and the image processor using any of serial communication interface, serial peripheral interface, or communication protocol. Data transmission and reception are achieved through the connection interface or protocol, which has the characteristics of high efficiency and bidirectionality of data transmission, and is used to execute instructions of computer programs and control operations of computers in computers. The wireless transceiver is a device that uses radio waves to realize wireless data input and output. It is used with intelligent sensors to realize data collection, transmission, and monitoring. It is used with remote control devices to realize remote control and remote operation functions. The wireless transceiver uses wireless communication technology to transmit data to remote or hard-to-wire places, providing flexibility and convenience. The image processor is a chip that uses high-performance image processing capabilities and specific image processing algorithm technology to process image data. It shares information with the central control processing chip and connects to the computer display screen through an HDMI cable to display the crossing image in high definition. Image processing includes image enhancement, image filtering, image compression, feature extraction and recognition, image synthesis and synthesis effect, and real-time image processing operations. Specifically, it collects and processes real-time monitoring train video monitoring information at the crossing. The AI prediction analysis unit uses artificial intelligence algorithms and high-performance hardware devices. It uses AI algorithms such as machine learning and deep learning to analyze and model crossing train trajectory data and generate prediction results with high accuracy and reliability. The functions of the AI prediction analysis unit include data analysis and prediction, pattern recognition and classification, risk assessment and decision support, optimization and improvement, and automation and rapid decision-making.

[0048] In a preferred embodiment, the real-time visual monitoring module includes surveillance cameras deployed within the level crossing equipment, a hard disk recorder (HDD) equipped in the equipment room, and a video intercom host and display screen installed in the dispatch center equipment. The surveillance cameras are high-definition cameras installed on the entrance and exit roads of the level crossing and along the tracks where trains travel, used to capture the situation at the railway level crossing in real time and transmit the real-time video stream to the display screen for display, allowing track operators to monitor the situation at the railway level crossing in real time and perform necessary processing and judgment. The HDD consists of a hard disk drive, a video compression encoder, a video input / output interface, and an operation management system, used for recording, storing, and playing back video. It has functions of video recording, storage, playback, remote access, event detection and alarm, as well as management and configuration, providing efficient and reliable video management technology for the safety monitoring of railway level crossings. The video intercom host is a device for centralized management and control of the intercom system functions. It can connect to several video intercoms and provide voice and video communication, intercom system settings, and management functions. The display screen displays the video images from several high-definition cameras and allows real-time viewing of the video communication images from the video intercoms.

[0049] In a preferred embodiment, the remote communication control module includes a video intercom, an optical network switch, an audible and visual alarm, and signal lines. The video intercom is a device consisting of a high-definition camera, a display screen, audio equipment, and dial or call buttons. It combines voice and video communication functions for personnel in the duty room to conduct two-way communication and view video images of the other party in real time. The optical network switch uses photoelectric conversion technology to receive and forward optical signals, thereby realizing data exchange and transmission in the fiber optic network. The audible and visual alarm consists of a horn or loudspeaker and a flashing light, providing both audible alarm and flashing light warning functions for emergency situations such as trains approaching or exiting railway crossings. In situations requiring alerts, it emits strong sound and visible light signals, and can be remotely controlled and managed through an intelligent safety management module; the signal line uses LoRa wireless mode for data interaction between field devices at railway crossings, and also uses 4G wired network mode for data transmission; LoRa wireless mode is based on the Low Power Wide Area Network (LPWAN) protocol for long-distance communication, featuring long-distance transmission, low power consumption, high anti-interference, tolerant network topology, and support for large-scale deployment; the 4G wired network mode is a wired broadband network using 4G mobile communication technology as the access method, connecting the 4G network to computers, routers, and server room equipment via wired connections.

[0050] In a preferred embodiment, the pre-warning and control module includes a crossing control box and a barrier gate control button; the crossing control box includes a crossing controller, a power adapter, a PDU, an optical network switch and a serial network converter, specifically, the PDU power line distribution is connected with the video monitoring, the visual intercom and the barrier gate through the power adapter for providing power to make the equipment run normally, the data information is input and output through the network cable, the wireless communication data is transmitted to the intelligent safety management module for background data processing, the equipment failure is real-time self-checked for alarm and pre-warning of abnormality of crossing protection failure, the crossing controller controls the opening and closing of the barrier gate stand through the optical network switch and the serial network converter by issuing instructions; the barrier gate control button includes a communication button and an emergency button for controlling the opening and closing state of the barrier gate stand.

[0051] In a preferred embodiment, the information collection processing and analysis module includes a wheel sensor, a solar power supply panel, a vehicle triggering device, a crossing control alarm, an LED reminder screen and a crossing video monitoring device arranged in the crossing equipment; the wheel sensor has the functions of wiring-free and ultra-low power consumption, can use wireless communication technology to monitor the running state, tire pressure and temperature parameters of the wheel in real time, and is used to provide real-time data and reminders for the train entering and leaving the crossing; the solar power supply panel is a device that receives solar energy and converts it into electrical energy, which is stored to provide power for the wheel sensor and the vehicle triggering device, and has the characteristics of independent power supply, high efficiency, energy saving, durability, stability, simplified maintenance and expandable flexibility; the vehicle triggering device is a device installed at both ends of the railway crossing to automatically detect the arrival of the train; the crossing control alarm provides a warning signal when the train travels out of the railway crossing; the LED reminder screen uses light emitting diode technology to display different colors, numbers, words or icons for warning; the crossing video monitoring device installs a high-definition camera at the crossing to monitor and record the train running out of the crossing in real time; the specific information collection process is as follows: at a distance of 5000 meters from the crossing, a wheel sensor with ultra-low power consumption and wiring-free and a wireless wheel vehicle triggering device are laid on the side of the track, and a solar power supply panel is used to provide power for them; when the train touches the track and triggers the wireless wheel vehicle triggering device, the wheel sensor receives the information of the train entering and leaving the crossing at the same time, transmits the information to the intelligent safety management module through the optical network switch for data processing, and the train entering and leaving the station starts the crossing control alarm and the LED reminder screen to sound and light, the crossing video monitoring device shoots the real-time video of the train entering and leaving the road and transmits it to the visual real-time monitoring module, and the display screen of the dispatching center equipment is used for display, and the barrier gate sensor and the barrier gate stand trigger are controlled by the intelligent safety management module after data processing and analysis.

[0052] Embodiment 3

[0053] Please refer to Figures 7-10The application provides a railway crossing intelligent safety management early warning system, which is further disclosed and supplemented based on the content of embodiment 2. The dispatching center device comprises a display, an analysis control host, a visual intercom host, a PDU and an HDMI. The analysis control host is internally installed with a crossing protection system platform software, which is used for acquiring track interlocking encoder video information in the machine room device in real time, performing image recognition analysis, collecting and counting crossing vehicle information logs in real time, sending a gate lifting and falling instruction according to train approaching information, and configuring a periodic time. The PDU is installed in a cabinet and connected to a power supply or an UPS through a power plug. The PDU has a plurality of power sockets and can provide a plurality of power output channels. The output channels can be monitored and controlled through a power management function. Therefore, the PDU is used for managing and distributing power to computer devices, servers and network devices in the dispatching center device and the machine room device. The PDU can also provide overload protection and power control functions to ensure the stability and safety of power supply. In addition, the PDU has a network management function, which can remotely monitor and manage power distribution through a network. The HDMI is an interface device connecting the display and the analysis control host, which is used for transmitting high-quality audio and video signals to avoid the loss of analog signal conversion and provide clearer and more accurate image and audio effects.

[0054] In a preferred embodiment, the machine room device comprises a video encoder, a hard disk video recorder, a track interlocking host, an HDMI or a VGA. The video encoder is used for compressing and encoding original video signals to transmit, store and process video data more effectively. The hard disk video recorder is used for recording and storing video signals collected by the video monitoring of the crossing device, and has the functions of video recording, video storage, video management, remote access and monitoring, security and monitoring, data analysis and application. The track interlocking host is a centralized system for railway train dispatching and control, which is responsible for train dispatching and control, signal control and route management, train interval and speed adjustment, centralized monitoring and alarm, and data recording and analysis. It is used for real-time monitoring and control of train operation on the railway track to ensure safe, efficient and punctual train operation. The VGA is used for connecting computers and displays to transmit analog video signals. The crossing device comprises a gate, a visual intercom, a video monitoring, a communication button, an emergency button and a crossing control box. The gate is a control device installed at the crossing, which is used for controlling the opening and closing of the crossing to restrict vehicles and pedestrians from passing through the railway crossing track. It has the functions of traffic control, safety protection, prompt and violation monitoring.

[0055] In a preferred embodiment, the crossing protection system platform software is a software integrating a voice communication system, a visual monitoring system, a GPS positioning system, a data processing and management system, and a pre-warning dispatching system. Image algorithm training and mask positioning technology are used to train and compare the image information of the train passing through the crossing, so as to extract the signal lights, switches and track conditions of each track of the crossing, and determine whether a train is about to pass through the crossing, thereby providing real-time monitoring, communication cooperation, position tracking, data processing and decision support functions for the train passing through the crossing, and helping the duty room dispatcher to efficiently manage and control the operation of the railway crossing safety dispatching. Specifically, it includes real-time acquisition of track interlocking encoder video information in the machine room and image recognition analysis; collection and statistics of crossing vehicle information logs; sending of gate lifting and falling instructions according to train approach information after a certain time; remote manual control of gate lifting and falling; and real-time display of crossing video monitoring information.

[0056] In a preferred embodiment, the image algorithm training and mask positioning technology is a machine learning and computer vision technology based on image recognition. After obtaining the entire display image information output by HDMI, training and comparison recognition are performed. The specific steps are as follows:

[0057] A1, Prepare data as a training set: a large number of image data labeled with correct masks are needed as a training set, which contains the region of interest and the corresponding mask information for labeling the region;

[0058] A2, Establish a training image algorithm model: use machine learning or deep learning algorithms to train the prepared training data. The goal of the algorithm model is to learn the features and patterns of the region of interest, so as to accurately segment and locate the target in the image. During the training process, define the feature extraction method and select the appropriate model architecture, and continuously adjust the model parameters through optimization algorithms;

[0059] A3, Evaluation and optimization of the trained image algorithm model: after training, evaluate the performance of the model using part of the unseen test data. Calculate the evaluation indicators to measure the effect of the model, including accuracy, recall rate, F1 score, etc. If the model does not meet the expectations, further adjust the model architecture, training parameters or data enhancement for optimization;

[0060] A4, Mask positioning: use the trained model to perform mask positioning on new images. First, perform image preprocessing, then convert the input image into a format acceptable by the model. Perform inference on the image input model to obtain the mask of the region of interest. The mask is a binary image, where the position value of the region of interest is marked as 1, and other regions are 0. Finally, extract, crop or process the region of interest according to the mask information.

[0061] A5、Result post-processing: according to the requirements of the railway crossing identification picture, the mask positioning result is filtered, corrected or interpolated after processing; wherein, the training registration is to use machine learning technology, specifically, a large number of training is carried out on the dot array information of the whole picture, the feature vectors of the image are extracted, the points with rich information are contained, and these point information is extracted in the form of description coding as the basis for point matching, and then the points with matching description information in the image are matched in pairs, and the other unmatched points are transformed by interpolation algorithm, so that through training registration, the image position of each crossing is accurately positioned; the comparison and identification is to compare and identify the feature quantity after the registration and positioning of the crossing and the track, the color state of the signal lamp, the turnout and the track can be identified, according to the color information characteristics of the running track signal lamp, turnout and track display, whether a train will pass through can be indicated and judged; specifically, when the identification area displays a white line, it is compared successfully with the mask area, indicating that a train will pass through the crossing, and the red line indicates that the train is passing through the crossing, after the red line disappears, the crossing can be unsealed, the barrier is lifted, and the railway crossing is restored.

[0062] The above embodiments can be realized by software, hardware, firmware or any combination thereof, in whole or in part. When realized by software, the above embodiments can be realized in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable devices. The computer instructions can be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired (such as infrared, wireless, microwave, etc.) mode. The computer readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center and the like containing one or more available medium sets. The available medium can be a magnetic medium (such as a floppy disk, a hard disk, a magnetic tape), an optical medium (such as a DVD) or a semiconductor medium. The semiconductor medium can be a solid state disk.

[0063] The technical solution of the present application can be embodied in the form of a software product, which is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in the various embodiments of the present application. The aforementioned storage medium includes a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0064] Finally, the units and algorithm steps described in the above examples of the disclosed embodiments of the present application can be realized in the form of electronic hardware or a combination of computer software and electronic hardware, and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made by any person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application.

Claims

1. A railway crossing intelligent safety management early warning system, which is composed of a dispatching center device, a machine room device and a crossing device, and communicates, warns and controls information through an optical network switch, and the machine room device is provided with a track interlocking host, characterized in that: It also includes a collection information processing analysis module, which is arranged in the equipment room, including a wireless wheel sensor and a wireless vehicle receiving trigger arranged on the side of the rail crossing, independently powered by a solar power supply panel, the wheel sensor and the vehicle receiving trigger are deployed in a wiring-free manner, used to directly trigger and generate train approaching / arrival information when the train wheels pass, and transmitted to the dispatching center equipment through the crossing equipment wireless communication optical network switch for visual monitoring and intelligent management; ​ A remote communication control module connected to the optical network switch for data transmission through the optical fiber of the optical network switch, used for the dispatching center equipment to monitor, manage and communicate with the remote crossing equipment; A visual real-time monitoring module receives video and image information collected by the crossing equipment and transmits them to the control display in the dispatching center equipment, and uses the crossing protection system platform software integrated with image algorithm training and mask positioning technology arranged in the analysis control host to analyze the whole station representation picture obtained from the HDMI output port of the track interlocking host in real time, and extract the signal lamp color state and switch position state of each track through training registration and comparison identification to determine whether each crossing has a train passing through, and synchronize the information to the intelligent safety management module for control, used for real-time monitoring and safety management of the railway crossing; An intelligent safety management module with an AI prediction analysis unit, which receives data information from the collection information processing analysis module, analyzes the safety performance in combination with the information from the visual real-time monitoring module, and transmits corresponding safety measure information to the early warning and control module for execution; An early warning and control module receiving intelligent safety management instructions from the intelligent safety management module, and releasing warning signals and control gate signals of the crossing to the track to the crossing equipment through wireless communication control.

2. The intelligent safety management and early warning system for railway crossings according to claim 1, characterized in that: The intelligent safety management module includes a central control processing chip, a wireless transceiver, an image processor, and an AI prediction analysis unit, the central control processing chip is an integrated circuit chip embedded in the analysis control host inside the dispatching center equipment, connected with the wireless transceiver and the image processor through any one of serial communication interface, serial peripheral interface or communication protocol, used to execute instructions of computer programs and control operations of the computer in the computer; The wireless transceiver is a device that realizes wireless data input and output through radio waves; The image processor is a chip that uses high-performance image processing capabilities and specific image processing algorithm technology to process image data, shares information with the central control processing chip, and connects the computer display screen through HDMI cable for crossing image high-definition display; the AI prediction analysis unit uses artificial intelligence algorithms and high-performance hardware devices, analyzes and models the crossing train trajectory data through AI algorithms of machine learning and deep learning, and generates prediction results with high accuracy and reliability.

3. The intelligent safety management and early warning system for railway crossings according to claim 1, characterized in that: The visual real-time monitoring module comprises a monitoring camera arranged in the crossing device, a hard disk video recorder arranged in the machine room device, and a visual intercom host and a display screen arranged in the dispatch center device, the monitoring camera is a high-definition camera installed on the entrance and exit roads of the crossing and the road where the train runs, for capturing the situation of the railway crossing in real time, the hard disk video recorder is composed of a hard disk drive, a video compression encoder, a video input / output interface and an operation management system, for recording, storing and playing back video, the visual intercom host is a device for centralized management and control of the intercom system function; The display screen is a display screen that displays the video pictures of several high-definition cameras and watches the video communication image of the visual intercom in real time.

4. The intelligent safety management and early warning system for railway crossings according to claim 1, characterized in that: The remote communication control module comprises a visual intercom, an optical network switch, an audible and visual alarm and a signal line; the visual intercom is combined with voice and video communication functions, for two-way communication and real-time viewing of video image information of the other party by the staff in the duty room; the optical network switch can receive optical signals and perform forwarding processing; The audible and visual alarm is composed of a loudspeaker or a speaker and a flash, for emitting strong sound and visible light signals in the case of emergency when the train drives in and out of the railway crossing, which can be remotely controlled and managed by the intelligent safety management module; the signal line is used for data interaction between the field devices at the railway crossing in LORA wireless mode, and data transmission in 4G network wired mode.

5. The intelligent safety management and early warning system for railway crossings according to claim 1, characterized in that: The early warning and control module comprises a crossing control box and a barrier gate control button; the crossing control box comprises a crossing controller, a power adapter, a PDU, an optical network switch and a serial network converter; the barrier gate control button comprises a communication button and an emergency button, for controlling the opening and closing state of the barrier gate lifting rod.

6. The intelligent safety management and early warning system for railway crossings according to claim 1, characterized in that: The information acquisition processing and analysis module comprises a wheel sensor, a solar power supply panel, a vehicle receiving trigger, a crossing control alarm, an LED reminder screen and a crossing video monitoring arranged in the crossing device; the wheel sensor can use wireless communication technology to monitor the running state, tire pressure and temperature parameters of the wheel in real time, for providing real-time data and reminders of the train entering and leaving the crossing; The solar power supply panel is an equipment that receives solar energy and converts it into electric energy, which is stored to provide electric energy for the wheel sensor and the vehicle receiving trigger; The vehicle receiving trigger is a device installed at both ends of the railway crossing for automatically detecting the arrival of the train driving in and out; The crossing control alarm provides a warning signal when the train drives in and out of the railway crossing; the LED reminder screen uses light emitting diode technology to display different colors, numbers, characters or icons for warning; the crossing video monitoring installs a high-definition camera at the crossing to monitor and record the train running in and out of the crossing in real time.

7. The intelligent safety management and early warning system for railway crossing according to claim 1, characterized in that: The dispatch center device includes a display, an analysis control host, a visual intercom host, a PDU and an HDMI; the analysis control host is internally installed with a crossing protection system platform software; the PDU is installed in a cabinet and connected to a power supply or an UPS through a power plug, for managing and distributing power supply to computer equipment, servers and network equipment; the HDMI is an interface device connecting the display and the analysis control host, for transmitting high-quality audio and video signals.

8. The intelligent safety management and early warning system for railway crossings according to claim 1, characterized in that: The computer room equipment includes a video encoder, a hard disk video recorder, a track interlocking host, an HDMI or a VGA; the video encoder is used for compressing and encoding original video signals, for more effective transmission, storage and processing of video data; the hard disk video recorder is used for recording and storing video signals collected by the crossing equipment; the track interlocking host is a centralized system for railway train dispatching and control, responsible for tasks of train dispatching and control, signal control and route management, train interval and speed adjustment, centralized monitoring and alarm, and data recording and analysis; the VGA is used for connecting a computer and a display, for transmitting analog video signals; the crossing equipment includes a barrier gate, a visual intercom, a video monitoring, a communication button, an emergency button and a crossing control box; the barrier gate is a control device installed at a crossing, for controlling opening and closing of the crossing, limiting vehicles and pedestrians passing through the railway crossing track.

9. The intelligent safety management and early warning system for railway crossing according to claim 7, characterized in that: The crossing protection system platform software is a software integrating a voice communication system, a visual monitoring system, a GPS positioning system, a data processing and management system and a pre-warning dispatching system; image algorithm training and mask positioning technology are adopted to train and compare and identify the picture information of the train passing through the crossing, so as to extract the signal lights, switches and track conditions of each track of each crossing, to determine whether a train is about to pass through each crossing, for providing functions of real-time monitoring of train driving in and out of the railway crossing, communication cooperation, position tracking, data processing and decision support.

10. The intelligent safety management and early warning system for railway crossing according to claim 9, characterized in that: The image algorithm training and mask positioning technology is a machine learning and computer vision technology based on image recognition; after the whole display picture information output by the HDMI is acquired, training, registration and comparison and identification are performed; the specific steps are as follows: A1, prepare data as a training set; A2, establish a training image algorithm model; A3, evaluate and optimize the training image algorithm model; A4, mask positioning; A5, result post-processing.

Images