A train monitoring method, device and rail transit system

By deploying cameras on train stations to take real-time shooting of train and platform display screens, image recognition technology is used to automatically obtain train monitoring data, solving the time lag caused by manual detection and improving data accuracy and passenger experience.

CN115723819BActive Publication Date: 2025-07-22BYD CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202110992327.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-08-26
Publication Date
2025-07-22
Estimated Expiration
2041-08-26

AI Technical Summary

Technical Problem

In the prior art, time lag caused by abnormal train data is detected manually, which affects passengers' experience of riding.

Method used

By deploying cameras in the train station platform, shooting trains and platform displays in real time, using image recognition technology to extract actual and planned arrival information, and automatically analyze and obtain train monitoring data, real-time data acquisition without manual monitoring is achieved.

Benefits of technology

It improves the effectiveness and accuracy of train monitoring data, reduces labor costs, and ensures the smoothness of passenger ride experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115723819B_ABST
    Figure CN115723819B_ABST
Patent Text Reader

Abstract

The present application provides a train monitoring method, device and rail transit system, belonging to the technical field of rail transit. The method includes: photographing a train through a camera deployed on a train platform to obtain a train image, and photographing a passenger service information image of a platform display screen; extracting actual arrival information from the train image, and extracting planned arrival information from the passenger service information image; analyzing the actual arrival information according to the planned arrival information to obtain train monitoring data. In this way, without manual monitoring of the train and the platform display screen, train monitoring data can be obtained in a timely manner, which not only saves labor costs, but also ensures the effectiveness of the train monitoring data, so as not to affect the riding experience of passengers.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application belongs to the technical field of rail transit, and particularly relates to a train monitoring method, device, and rail transit system. Background Art

[0002] With the rapid development of domestic rail transit, many cities are building urban rail transit networks to solve urban congestion problems (such as light rails and subways) and shorten the distance between cities (such as high-speed rails). Compared with traditional systems, the fully automated driving system of rail transit has the characteristics of high automation, integration, high efficiency, low operating cost, and high safety. Therefore, the fully automated driving system of rail transit has become the development trend of domestic urban rail transit systems. Accordingly, the experience of passengers taking rail transit trains has attracted increasing attention.

[0003] Currently, platforms are often set up in urban rail transit networks. The platforms are equipped with a Passenger Information System (PIS). Through the platform PIS display screen in the PIS, passenger information can be provided to passengers, such as information about trains passing through the platform in the rail transit network (such as train identity (Identity document, ID), arrival time, station location, etc.), as well as arrival information and weather information on the running route of the train.

[0004] In related technologies, if the information provided by the platform PIS display screen to passengers is incorrect, it is often only discovered after passengers file a complaint feedback after missing the train they need to take, which seriously affects the passengers' riding experience. Summary of the Invention

[0005] In view of this, this application provides a train monitoring method, device, and rail transit system to solve the technical problem in related technologies that the detection of train data by manual means lags in discovering abnormal train data, resulting in an impact on the passengers' riding experience.

[0006] In a first aspect, an embodiment of this application provides a train monitoring method, including:

[0007] Taking a train image by a camera deployed on a train platform and taking a passenger service information image of the platform display screen;

[0008] Extracting actual arrival information from the train image and extracting planned arrival information from the passenger service information image;

[0009] Analyzing the actual arrival information according to the planned arrival information to obtain train monitoring data.

[0010] In a second aspect, an embodiment of the present application provides a train monitoring device, including:

[0011] a processor, a memory, and a program or instruction stored on the memory and executable on the processor, and when the program or instruction is executed by the processor, the steps of the train monitoring method described in the first aspect are implemented.

[0012] In a third aspect, an embodiment of the present application provides a rail transit system, including the train monitoring device described in the second aspect.

[0013] The beneficial effects brought by the technical solution provided by the embodiment of the present application at least include:

[0014] A train monitoring method, device, and rail transit system provided by an embodiment of the present application can automatically obtain a train image by deploying a camera in a train platform to take pictures of the train in real time, without manual monitoring of the train, and can automatically obtain an image of the passenger service information displayed on the platform display screen by taking pictures of the platform display screen in real time; extract the actual arrival information from the train image, extract the planned arrival information from the passenger service information image, and can analyze the actual arrival information according to the planned arrival information to obtain train monitoring data in a timely manner, ensuring the effectiveness of the train monitoring data and avoiding affecting the riding experience of passengers.

[0015] The above description is only an overview of the technical solution of the present application. In order to be able to understand the technical means of the present application more clearly, it can be implemented according to the content of the specification. And in order to make the above and other purposes, features, and advantages of the present application more obvious and understandable, the following specifically describes the embodiments of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] By reading the following detailed description of the preferred embodiments, various other advantages and benefits will become clear to those of ordinary skill in the art. The drawings are only for the purpose of showing the preferred embodiments and are not considered to be a limitation of the present invention. And throughout the drawings, the same reference numerals are used to represent the same components. In the drawings:

[0017] Figure 1 is a schematic diagram of a train platform provided by the related art;

[0018] Figure 2 is a structural diagram of a train monitoring system provided by an embodiment of the present invention;

[0019] Figure 3 is a flowchart of the steps of a train monitoring method provided by an embodiment of the present invention;

[0020] Figure 4It is a flowchart of steps of another train monitoring method provided by an embodiment of the present invention;

[0021] Figure 5 It is another schematic diagram of a train platform provided by an embodiment of the present invention;

[0022] Figure 6 It is a schematic diagram of a train identification mark provided by an embodiment of the present invention;

[0023] Figure 7 It is a schematic diagram of obtaining train monitoring data provided by an embodiment of the present invention;

[0024] Figure 8 It is another schematic diagram of obtaining train monitoring data provided by an embodiment of the present invention;

[0025] Figure 9 It is another schematic diagram of obtaining train monitoring data provided by an embodiment of the present invention;

[0026] Figure 10 It is a flowchart of steps of another train monitoring method provided by an embodiment of the present invention;

[0027] Figure 11 It is another schematic diagram of obtaining train monitoring data provided by an embodiment of the present invention;

[0028] Figure 12 It is another schematic diagram of obtaining train monitoring data provided by an embodiment of the present invention;

[0029] Figure 13 It is a structural block diagram of a train monitoring device provided by an embodiment of the present invention. Detailed implementation manners

[0030] Hereinafter, exemplary embodiments of the present invention will be described in more detail with reference to the accompanying drawings. Although the exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided so that the present invention can be more thoroughly understood and the scope of the present invention can be fully conveyed to those skilled in the art.

[0031] To make the purpose, technical solutions and advantages of the present invention clearer, the embodiments of the present invention will be further described in detail below with reference to the accompanying drawings.

[0032] The passenger riding experience is of utmost importance to the operation quality of urban rail transit. For the passenger riding experience of passengers waiting on the platform for the train to arrive, it is often reflected by the quality of the Passenger Information System (PIS) on the platform. The quality of PIS can refer to the accuracy of the information pushed to passengers, and the passenger information includes weather, time, arrival information, etc. The quality of PIS also includes the operational reliability of the platform electronic devices installed with PIS. For example, the platform PIS electronic device is the platform display screen. If the platform display screen appears in fault states such as black screen, colored screen, blue screen, serious lags, and crashes, the platform display screen in these fault states cannot provide effective services to passengers normally, which will seriously affect the passenger riding experience on the platform. In addition, train monitoring data such as the train's parking accuracy and the train's operation punctuality rate are all important factors affecting the passenger riding experience on the platform.

[0033] Currently, these abnormal train monitoring data are all discovered through the platform inspections by operation personnel or the feedback from passenger complaints. This has problems such as low efficiency in discovering abnormal train monitoring data, a time lag in discovering abnormal train monitoring data, and the PIS system being unable to automatically adjust train monitoring data.

[0034] Technically speaking, the Closed-Circuit Television (CCTV) system on the platform can monitor the information of the platform PIS electronic devices through cameras, but there are the following problems in the actual application process:

[0035] 1. Regarding the application situation of the accuracy of the information of the platform PIS electronic devices, the CCTV system is an external system relative to the PIS system on the train platform. The CCTV can only collect and identify information, but cannot make logical judgments on whether the information is correct. The CCTV cannot receive the passenger service information from the Automatic Train Supervision (ATS) system. The CCTV does not have corresponding interface and protocol modules and cannot communicate directly with the ATS system. In this way, it is impossible to adjust the current state through the ATS system. If the collected information is sent back to the platform server of the passenger information PIS system, there is also no corresponding transmission channel. If forced to add, in addition to increasing a large amount of costs, it will also cause the instability of the PIS system and cannot avoid the reliability risks brought by the interference in the long-distance and complex transmission link of the information, which does not conform to the design rules.

[0036] 2. The platform CCTV has dedicated functions, mainly responsible for detecting whether the passengers on the platform are safe during boarding and whether there are any abnormal behaviors of the passengers on the train platform. It generally operates 24 hours a day, so there is no idle state in terms of function, and there is no way to spare resources for image recognition monitoring. In addition, the installation angle and shooting angle of the CCTV are designed for the whole train platform to have no blind spots, and the angle and focal length cannot meet the requirements for dedicated monitoring and recognition accuracy of the platform PIS electronic equipment and the train car body.

[0037] To solve the above problems, the present application proposes a train monitoring method, device and rail transit system. According to the installation characteristics of the platform display screen, by using the emergency intercom camera set on the platform display screen for emergency alarm video intercom, through an image recognition algorithm, the up-platform display screen and the down-platform display screen monitor each other. By this method, the test resource cost is saved, and there is no need to use any additional external test resources for testing; in addition, since both the up-platform display screen and the down-platform display screen belong to the PIS system, the PIS system simultaneously sends the up and down information to the up-platform display screen and the down-platform display screen. In this way, the information collection and recognition performed on the platform display screen can quickly perform logical judgment and comparison between the recognition information result and the information source received by the platform display screen, which greatly improves the test efficiency, avoids interference during information transmission, improves the test accuracy, and realizes the rapid self-check of the system.

[0038] The preparations before the test include referring to Figure 1 the test environment layout and configuration shown in Figure 2 to build a test system, install train recognition identification pictures in the emergency intercom camera, configure the test upper computer software, debug the image recognition function of the emergency intercom camera, and obtain and update the train operation schedule. Figure 2 The measurement and control upper computer inside contains measurement and control software, which is responsible for the control of the entire test process, the implementation of test logic, the determination of test results and the generation of test reports; the passenger information system platform server is the control core of the PIS system, responsible for the management and control of all PIS information terminals (such as platform display screens) and the push of passenger information and streaming media. When the platform display screen enters the test mode, the PIS platform server simultaneously sends the planned arrival information of the up-train and the down-train to the up-platform display screen and the down-platform display screen.

[0039] Figure 3 The following is a step flowchart of a train monitoring method provided by an embodiment of the present invention. The method includes:

[0040] Step 101: Take a train image by a camera deployed on the train platform and take a passenger service information image of the platform display screen.

[0041] In the embodiments of the present application, a train platform is an area set on the running line path of a train for passengers to get on and off. There are usually at least two train platforms in the running line path of the train, which can be determined according to actual needs and are not limited here.

[0042] In the embodiments of the present application, a platform display screen is a terminal for the platform passenger information service system PIS to display information, which provides passengers with relevant information about the train, arrival information on the running line path of the train, weather information and other passenger information. While being responsible for displaying platform passenger information, it also has the function of emergency video alarm for platform passengers; the platform display screen at least includes: an up-platform display screen and a down-platform display screen with a relative position relationship, which can be determined according to actual needs and are not limited here.

[0043] In the embodiments of the present application, refer to Figure 1 As shown, the camera can be a high-definition emergency intercom camera set on the platform display screen for the function of emergency video alarm for platform passengers. The camera angle of view of this emergency intercom camera is 45° - 60°. The camera can also be a 360° panoramic camera set at the center of the train platform, which can be determined according to actual needs and are not limited here.

[0044] In the embodiments of the present application, the measurement and control host computer or the PIS platform server takes pictures of the down-train arriving at the train platform through the emergency intercom camera of the up-platform display screen to obtain the train image of the down-train, and takes pictures of the up-train arriving at the train platform through the emergency intercom camera of the down-platform display screen to obtain the train image of the up-train; the measurement and control host computer or the PIS platform server also takes pictures of the down-platform display screen through the emergency intercom panoramic camera of the up-platform display screen to obtain the passenger service information image of the down-platform display screen, and takes pictures of the up-platform display screen through the emergency intercom panoramic camera of the down-platform display screen to obtain the passenger service information image of the up-platform display screen.

[0045] Exemplarily, refer to Figure 1As shown, the width of the train platform area can be 8 meters to 10 meters. An up-platform display screen and a down-platform display screen are arranged on both sides of the running line path of the train in the train platform area. To protect the safety of passengers, platform shielding protection is provided between the up-platform display screen and the up-train, and between the down-platform display screen and the down-train to prevent passengers from approaching the up-train. In order to be able to capture the train identification mark of the down-train through the emergency intercom camera of the up-platform display screen, the up-platform display screen is arranged opposite to the train identification mark of the down-train. Similarly, the down-platform display screen is arranged opposite to the train identification mark of the up-train. The train image obtained by shooting the down-train through the emergency intercom camera of the up-platform display screen, and the train image obtained by shooting the up-train through the emergency intercom camera of the down-platform display screen; the relatively arranged up-platform display screen and down-platform display screen capture each other through the emergency intercom camera to obtain the passenger service information image.

[0046] Step 102: Extract the actual arrival information from the train image and extract the planned arrival information from the passenger service information image.

[0047] In the embodiment of the present application, the actual arrival information refers to the information of the train during the actual operation process, and the planned arrival information refers to the information of the train given in the train operation schedule.

[0048] In the embodiment of the present application, the emergency intercom cameras of the up-platform display screen and the down-platform display screen have built-in image recognition modules. The image recognition module is used to analyze and compare the images collected by the emergency intercom cameras, which can be determined according to actual needs and are not limited here.

[0049] In the embodiment of the present application, the measurement and control host computer or the PIS platform server extracts the actual arrival information from the train image and extracts the planned arrival information from the passenger service information image through the image recognition algorithm in the image recognition module.

[0050] Exemplarily, referring to Figure 2 As shown, the emergency intercom cameras of the up-platform display screen and the down-platform display screen both have built-in image recognition modules. The measurement and control host computer or the PIS platform server extracts the actual arrival information from the train image and extracts the planned arrival information from the passenger service information image through the image recognition algorithm in the image recognition module.

[0051] Step 103: Analyze the actual arrival information according to the planned arrival information to obtain train monitoring data.

[0052] In the embodiment of the present application, the train monitoring data refers to the data obtained by the measurement and control host computer or the PIS platform server during the actual operation process of the train.

[0053] In the embodiments of the present application, the measurement and control host computer or the PIS platform server may compare the obtained planned arrival information and the actual arrival information, and use the comparison result as train monitoring data.

[0054] Exemplarily, refer to Figure 2 As shown, the measurement and control host computer obtains and records the planned arrival information. The measurement and control host computer or the PIS platform server compares the obtained planned arrival information and the actual arrival information, and uses the comparison result as train monitoring data; during the test process, it is the measurement and control host computer that compares the obtained planned arrival information and the actual arrival information, and uses the comparison result as train monitoring data.

[0055] Step 104: Adjust the train or platform display screen according to the train monitoring data.

[0056] In the embodiments of the present application, the measurement and control host computer or the PIS platform server issues an instruction for adjusting the train or platform display screen to the central communication switch according to the train monitoring data, and the central communication switch forwards the instruction to the communication switch at the corresponding train platform, and then the communication switch at the train platform forwards it to the train or platform display screen.

[0057] Exemplarily, refer to Figure 2 As shown, the measurement and control host computer or the PIS platform server issues an instruction for adjusting the up-platform display screen of Train Platform 1 to the central communication switch according to the train monitoring data, and the central communication switch forwards the instruction to the Train Platform 1 communication switch, and then the Train Platform 1 communication switch forwards it to the up-platform display screen at Train Platform 1 to control the up-platform display screen to be adjusted according to the instruction.

[0058] A train monitoring method, device and train provided by the embodiments of the present application can automatically obtain train images of a train by deploying a camera in the train platform to photograph the train in real time without manual monitoring of the train, and can automatically obtain images of passenger service information displayed on the platform display screen by photographing the platform display screen in real time without manual monitoring of the platform display screen; extract the actual arrival information from the train images, extract the planned arrival information from the passenger service information images, and can analyze the actual arrival information according to the planned arrival information to obtain train monitoring data in a timely manner, ensuring the effectiveness of the train monitoring data so as not to affect the riding experience of passengers.

[0059] Figure 4 It is a step flowchart of another train monitoring method provided by the embodiments of the present invention, and the method includes:

[0060] Step 201: Photograph the train through the emergency intercom camera of the up-platform display screen to obtain train images, and photograph the down-platform display screen to obtain passenger service information images.

[0061] In the embodiment of the present application, the measurement and control host computer or the PIS platform server takes pictures of the down-bound train arriving at the train platform through the emergency intercom camera of the up-bound platform display screen to obtain the train image of the down-bound train. The measurement and control host computer or the PIS platform server also takes pictures of the down-bound platform display screen through the emergency intercom camera of the up-bound platform display screen to obtain the passenger service information image of the down-bound platform display screen.

[0062] Exemplarily, refer to Figure 2 As shown, the train image obtained by taking pictures of the down-bound train through the emergency intercom camera of the up-bound platform display screen, and the passenger service information image obtained by taking pictures of the picture displayed on the down-bound platform display screen through the emergency intercom camera of the up-bound platform display screen.

[0063] Step 202: Take pictures of the train through the emergency intercom camera of the down-bound platform display screen to obtain the train image, and take pictures of the up-bound platform display screen to obtain the passenger service information image.

[0064] In the embodiment of the present application, the measurement and control host computer or the PIS platform server takes pictures of the up-bound train arriving at the train platform through the emergency intercom camera of the down-bound platform display screen to obtain the train image of the up-bound train. The measurement and control host computer or the PIS platform server takes pictures of the up-bound platform display screen through the emergency intercom panoramic camera of the down-bound platform display screen to obtain the passenger service information image of the up-bound platform display screen.

[0065] Exemplarily, refer to Figure 2 As shown, the train image obtained by taking pictures of the up-bound train through the emergency intercom camera of the down-bound platform display screen, and the passenger service information image obtained by taking pictures of the picture displayed on the up-bound platform display screen through the emergency intercom camera of the down-bound platform display screen.

[0066] In the embodiment of the present application, the emergency intercom cameras of the up-bound platform display screen and the down-bound platform display screen are used to monitor each other, without the need to additionally use any external devices, saving resources and costs. In addition, since both the up-bound platform display screen and the down-bound platform display screen belong to the PIS system, the PIS system simultaneously sends the up and down information to both the up-bound platform display screen and the down-bound platform display screen. In this way, the information collection and recognition performed on the platform display screen can quickly perform logical judgment and comparison on the recognition information result and the information source received by the platform display screen, greatly improving the efficiency, avoiding interference during the information transmission process, improving the accuracy, and realizing the quick self-check of the PIS system.

[0067] Step 203. The actual arrival information includes the train status, and the train image includes a picture of the train identification mark. When the similarity between the pictures of the train identification marks within the target time interval is less than the similarity threshold, the train status is determined to be the stationary state.

[0068] In the embodiments of the present application, the train status refers to the running status of the train during the actual operation; the train identification mark refers to the text or two-dimensional code used to identify the train ID set at a fixed position on each train (for example, at the door or window outside the train); the picture of the train identification mark refers to the image obtained by photographing the train identification mark; the stationary state refers to the state of the train when no change is recognized in the picture of the train identification mark within 6 consecutive seconds.

[0069] In the embodiments of the present application, the target time interval and the similarity threshold can be default values (for example: 5 seconds, 0), or can be the values set in the PIS system (for example: 6 seconds, 1), which can be specifically determined according to actual needs and are not limited herein.

[0070] In the embodiments of the present application, the train identification mark is set at the external window of the train, and the emergency intercom camera on the platform display screen photographs the train identification mark to obtain the picture of the train identification mark. The built-in image recognition module in the emergency intercom camera is used to recognize the pictures of the train identification mark within the target time interval. When there is no change in the vehicle identification picture, the train status is determined to be the stationary state.

[0071] Exemplarily, referring to Figure 5 As shown, a text or two-dimensional code with a width of 30 cm and a length of 40 cm is set at the upper part of the window of the train as the train identification mark. After the emergency intercom camera photographs the train identification mark, the picture of the train identification mark is obtained. The built-in image recognition module in the emergency intercom camera is set to recognize the similarity between 2 pictures of the train identification mark, and the obtained similarity values are 0 and 1. When the similarity between each picture of the train identification mark is less than the similarity threshold 1 within 6 consecutive seconds, the train status is determined to be the stationary state.

[0072] Step 204. Identify the position of the reference line in the picture of the train identification mark through an image recognition algorithm.

[0073] In the embodiments of the present application, the reference line can refer to the center line of the train identification mark, or can refer to the special line given in the train identification mark, which can be specifically determined according to actual needs and are not limited herein.

[0074] In the embodiments of the present application, the center line of the train identification mark is used as the reference line, and the standard position of the train identification mark is set in the image recognition module of the emergency intercom camera. The center line of the train identification mark at the standard position of the train identification mark is the standard reference line. The up-platform display screen collects the train identification mark picture after the down-train stops through the emergency intercom camera, and the down-platform display screen collects the train identification mark picture after the up-train stops through the emergency intercom camera. Then, the measurement and control host computer or the PIS platform server identifies the train identification mark picture through the image recognition module of the emergency intercom camera to determine the position of the center line in the train identification mark picture (for example: in the middle, to the left, to the right).

[0075] Exemplarily, referring to Figure 6 and 7 As shown, since the size of the train identification mark is fixed, assumed to be a 40cm * 40cm square, there is a reference line in the center of the train identification mark picture. The emergency intercom camera records the train identification mark picture at the actual train stop position, and then determines whether the reference line position in the center of the actually recorded train identification mark picture is to the left or right of the standard reference line through the image recognition module to determine whether the train identification mark is left-offset or right-offset.

[0076] Step 205: When the distance between the reference line and the standard reference line is less than or equal to the distance threshold, determine that the train state is the accurate stop state.

[0077] In the embodiments of the present application, the standard reference line is the reference position for calculating the parking accuracy, which refers to the standard position of the reference line in the train identification mark picture when the train stops accurately and the record is saved; the accurate stop state refers to the accurate state where the train identification mark picture enters the specified range area.

[0078] In the embodiments of the present application, the distance threshold can be a default value (for example: 20cm), or a value set in the PIS system (for example: 15cm), which can be specifically determined according to actual requirements and is not limited here.

[0079] In the embodiments of the present application, the measurement and control host computer or the PIS platform server obtains the distance between the standard reference line and the reference line in the train identification mark picture captured by the emergency intercom camera, and then determines that the train state is the accurate stop state when the distance is less than or equal to the distance threshold.

[0080] Exemplarily, referring to Figure 6 and 7As shown, the upper computer for measurement and control or the PIS platform server calculates the offset pixel distance between the two by comparing the standard reference line and the reference line in the train identification logo picture captured by the emergency intercom camera (for example: the center line of the left offset position of the train identification logo, the center line of the right offset position of the train identification logo), that is, the offset pixel distance of the center line of the train identification logo. Then, by comparing this offset pixel distance with the pixels occupied by the actual length (width) of the train identification logo, the actual offset distance of the train can be calculated, that is, the parking offset degree of the train. Taking this actual offset distance as the distance between the two, when this distance is less than or equal to the distance threshold, the train status is determined to be the accurate stop status.

[0081] In the embodiment of the present application, as shown in Figure 7, the platform display screen sends the parking offset degree of each train at each train platform to the ATS in real time. The ATS fine-tunes and calibrates the train parking control parameters according to the actual train parking position, gradually improving the train parking accuracy and reducing the parking offset degree.

[0082] Step 206: The actual arrival information also includes the actual arrival time of the train; when the train status is the stable stop status and the accurate stop status, the time when the train identification logo picture is obtained is used as the actual arrival time.

[0083] In the embodiment of the present application, the actual arrival time refers to the absolute timestamp recorded at that time when the upper computer for measurement and control or the platform server determines that the train has arrived and is in the stable stop status and the accurate stop status by identifying the train identification logo picture during the actual operation of the train.

[0084] In the embodiment of the present application, the time of shooting is recorded while the emergency intercom camera captures the train identification logo picture of the train, that is, each train identification logo picture has a shooting time. When the train status is the stable stop status and the accurate stop status, the shooting time of the train identification logo picture used to determine the train status is used as the actual arrival time.

[0085] Exemplarily, referring to Figure 5 and 6 As shown, the emergency intercom camera continuously identifies for 6 seconds. The train identification logo picture does not change at all, and the train identification logo picture enters the specified range area. When the distance between the reference line and the standard reference line is less than or equal to the distance threshold of 20 cm, the upper computer for measurement and control records the absolute timestamp at that time as the actual arrival time of the vehicle.

[0086] In the embodiment of the present application, by identifying the similarity between train identification logo pictures within a target time interval, it is possible to automatically determine whether the train has come to a complete stop; by identifying the distance between the reference line in the train identification logo picture and the standard reference line, it is possible to automatically determine whether the train has stopped accurately; thus, the time when the train has come to a complete stop and stopped accurately can be used as the actual arrival time. That is, by detecting the train identification logo, the absolute time of the actual arrival of the train corresponding to the train identification logo can be determined, avoiding manual monitoring of the train, and ensuring the accuracy of the obtained actual arrival time, ensuring the effectiveness of train monitoring data, so as not to affect the riding experience of passengers.

[0087] Step 207: The planned arrival information includes the expected arrival time displayed on the platform display screen, and the train monitoring data includes the punctuality error; the difference between the actual arrival time and the expected arrival time is used as the punctuality error.

[0088] In the embodiment of the present application, the expected arrival time is the arrival time of each train planned in the train operation plan schedule in the train operation plan table. The punctuality error is the error used to statistically calculate the punctuality rate during the operation of a single train.

[0089] In the embodiment of the present application, the difference between the actual arrival time of a train and the expected arrival time of the train is used as the punctuality error of the train.

[0090] Exemplarily, referring to Figure 8 As shown, the actual arrival time of the train is 10:10, and the expected arrival time of the train is 10:01. Then the punctuality error of the train is 9 minutes. That is, the actual arrival time of this train is inconsistent with the arrival time planned for this train in the train operation plan table. The measurement and control host computer determines that this test is unqualified. The platform display screen takes the difference between the calculated actual arrival time of this train and the expected arrival time in the train operation plan schedule as the punctuality error and sends it to the ATS. The ATS adjusts the speed of the train operation within a safe range for the preset interval (for example: the next train, the next two trains) according to the punctuality error to improve the punctuality rate during the train operation. The actual arrival time of the train is 10:10, and the expected arrival time of the train is 10:10. Then the punctuality error of the train is 0 minutes. That is, the actual arrival time of this train is consistent with the arrival time planned for this train in the train operation plan table. The measurement and control host computer determines that this test is qualified. The measurement and control host computer needs to perform a cyclic test on multiple trains and multiple stations to statistically calculate the punctuality rate of the train during operation. Punctuality rate = number of punctual train arrivals / total number of train arrivals.

[0091] In the embodiment of the present application, through the actual arrival time and the expected arrival time, it is possible to determine whether there is a punctuality error in the train, so as to determine whether the system can be quickly adjusted, so as not to affect the riding experience of passengers.

[0092] Step 208: The actual arrival information further includes the actual departure time of the train; the actual stop time of the train is determined by the difference between the actual arrival time and the actual departure time.

[0093] In the embodiment of the present application, similar to the process of monitoring the actual arrival time of the train, the platform display screen continuously monitors whether the train departs. The actual departure time refers to the absolute timestamp recorded when the PIS system continues to monitor until the upper computer for measurement and control or the PIS platform server recognizes that the train identification logo picture starts to change after determining that the train arrives and is in a stable and accurate stop state during the actual operation of the train.

[0094] In the embodiment of the present application, once the PIS system monitors that the train identification logo picture starts to change, it records the absolute timestamp at that time as the actual departure time, and determines the actual stop time of the train by the difference between the actual arrival time and the actual departure time.

[0095] Exemplarily, refer to Figure 9 As shown, the actual stop time of the train is calculated based on the absolute actual arrival time and the absolute actual departure time.

[0096] Step 209: The planned arrival information includes the expected stop time of the train displayed on the platform display screen, and the train monitoring data includes the stop error of the train; the difference between the actual stop time and the expected stop time is calculated as the stop error.

[0097] In the embodiment of the present application, the expected stop time refers to the stop time planned for each train in the train operation plan schedule in the train operation plan. The stop error is used to statistically calculate the on-time rate of multiple train platforms in the PIS system.

[0098] In the embodiment of the present application, the difference between the actual stop time and the expected stop time of a train at a train platform is used as the stop error of the train at the train platform, and this stop error will affect the on-time error of the train at the next train platform.

[0099] Exemplarily, refer to Figure 9 As shown, when the actual stop time of the train exceeds the planned stop time in the train operation plan by 15 s, or stops 15 s in advance, the platform display screen within the preset section (for example, the next 1 or 2 train platforms) updates the expected arrival time of the train, and the PIS continuously monitors the whole process until the train departs.

[0100] In the embodiment of the present application, the actual stop time of the train can be automatically determined through the difference between the actual arrival time and the actual departure time; according to the actual stop time and the predicted stop time, it can be determined whether there is a stop error for the train, so as to determine whether the system needs to be quickly adjusted to avoid affecting the riding experience of passengers.

[0101] Step 210: The planned arrival information includes the first display time when the platform display screen shows the arrival of the train, and the train monitoring data includes the screen display error; the difference between the actual arrival time and the first display time is used as the screen display error.

[0102] In the embodiment of the present application, when the train arrives at the station (the train status is the accurate stop state and the stable stop state), the platform display screen will update and display the arrival of the train. At this time, the absolute time is the first display time, and the screen display error is the error used to statistically analyze the accuracy rate of the planned arrival time of the train displayed on the platform display screen.

[0103] In the embodiment of the present application, the absolute value of the difference between the actual arrival time and the first display time is used as the screen display error, that is, the screen display error = |actual arrival time - first display time|.

[0104] Exemplarily, at 10:10, the platform display screen shows the arrival of the train, that is, the first display time is 10:10, and the actual arrival time is 10:09, then the screen display error is 1 minute.

[0105] In the embodiment of the present application, through the actual arrival time and the first display time, it can be determined whether there is a screen display error on the platform display screen, so as to determine whether the system needs to be quickly adjusted to avoid affecting the riding experience of passengers.

[0106] Step 211: The planned arrival information includes at least one remaining arrival time displayed on the platform display screen and the second display time corresponding to the displayed remaining arrival time; calculate the time difference between the actual arrival time and each second display time.

[0107] In the embodiment of the present application, the remaining arrival time refers to how much time is left for the train to arrive at the train platform as displayed on the platform display screen at a train platform, and the remaining arrival time will be continuously updated. The second display time refers to the absolute time when the platform display screen updates the display of the remaining arrival time. Therefore, the second display time and the remaining arrival time are in one-to-one correspondence.

[0108] In the embodiment of the present application, calculate the difference between the actual arrival time of the train and each second display time to obtain the error between each second display time and the actual arrival time, which is used as the time difference.

[0109] For example, the planned arrival information displayed on the platform display screen at 10:10 is updated, and it shows that Train 1 will arrive in 5 minutes. Then the time to arrival is 5 minutes, and the second display time is 10:10. The planned arrival information displayed on the platform display screen at 10:12 is updated, and it shows that Train 1 will arrive in 2 minutes. Then the time to arrival is 2 minutes, and the second display time is 10:12. The actual arrival time of the train is 10:14. Then the differences between the actual arrival time and each second display time are: 4 minutes and 2 minutes. That is, there are 2 time differences: 4 minutes and 2 minutes.

[0110] Step 212: The train monitoring data includes the distance-time error. The difference between the time difference and the distance to arrival time corresponding to the second display time is used as the distance-time error.

[0111] In the embodiment of the present application, the distance-time error is an error used to statistically calculate the accuracy rate of the planned arrival time information of the train during the train operation.

[0112] In the embodiment of the present application, the differences between each time difference and the distance to arrival time corresponding to the second display time used to calculate the time difference are respectively used as the distance-time error.

[0113] For example, as shown in Figure 8 As shown, the time difference of the second display time at 10:10 is 4 minutes, and the time difference of the second display time at 10:12 is 2 minutes. The distance to arrival time corresponding to the second display time at 10:10 is 5 minutes, and the distance to arrival time corresponding to the second display time at 10:12 is 2 minutes. Then the distance-time errors include: 5 minutes - 4 minutes = 1 minute, 2 minutes - 2 minutes = 0 minute. That is, for the train distance to arrival time of 5 minutes updated and displayed on the 10:10 platform display screen, it is inconsistent with the difference between the actual arrival time of the train at 10:14 and the absolute time of 10:10 when the train planned arrival information is updated. The measurement and control host computer can determine that this test is unqualified. The platform display screen will send the time difference error between the actual arrival time of this train calculated and the second display time of the distance to arrival time displayed in the PIS system to the ATS. The ATS will calibrate and adjust the time parameter in the calculated train planned arrival information according to the time difference to improve the display accuracy of the train arrival time of the train platform PIS system. For the train distance to arrival time of 2 minutes updated and displayed on the 10:12 platform display screen, it is consistent with the difference between the actual arrival time of the train at 10:14 and the absolute time of 10:12 when the train planned arrival information is updated. The measurement and control host computer can determine that this test is qualified. The measurement and control host computer needs to perform multiple loop tests on multiple trains to statistically calculate the accuracy rate of the time display in the train planned arrival information. The accuracy rate = the number of correct displays / the total number of displays.

[0114] In the embodiments of the present application, by calculating the time difference between the actual arrival time and each second display time, it is possible to automatically determine whether there is a difference between this time difference and the remaining arrival time corresponding to the second display time, so as to determine whether there is a distance-time error in the platform display screen, and thus determine whether the system needs to be quickly adjusted to avoid affecting the passengers' riding experience.

[0115] Step 213: When the train monitoring data is the on-time error, adjust the vehicle speed within a preset section or the expected arrival time displayed on the platform display screen according to the on-time error.

[0116] In the embodiments of the present application, when the train monitoring data is the on-time error, that is, it is determined that the train arrives at the train platform late or in advance, the on-time error is sent to the ATS. The ATS adjusts the speed of the train operation within a preset section (for example, the next train, the next two trains) according to the on-time error to improve the on-time rate during the train operation. Or, the ATS adjusts the expected arrival time displayed on the platform display screen of the target section (for example, the next train platform, the next two train platforms) according to the on-time error to improve the on-time rate during the train operation.

[0117] Exemplarily, referring to Figure 8 As shown, when the on-time error in the train monitoring data is -2 (that is, 2 minutes late), the platform display screen sends the on-time error to the ATS. The ATS adjusts the speed of the next two trains to increase within the safe range according to the on-time error. Or, the ATS adjusts the expected arrival time displayed on the platform display screen of the next train platform to increase (delay) by 2 minutes.

[0118] Step 214: When the train monitoring data is the stop error, adjust the expected arrival time of the second train displayed on the platform display screen according to the stop error.

[0119] In the embodiments of the present application, when the train monitoring data is the stop error, that is, it is determined that the train leaves the train platform in advance or later, the platform display screen adjusts the expected arrival time of the second train (for example, the next train, the next two trains) at this train platform according to the stop error.

[0120] Exemplarily, when the stop error in the train monitoring data is -2 (that is, leaves the train platform 2 minutes later), the platform display screen increases (delays) the expected arrival time of the next two trains at this train platform by 2 minutes according to the stop error.

[0121] Step 215: Obtain the unexpected error time of the first train.

[0122] In the embodiments of the present application, the unexpected error time refers to the time spent on dealing with an unexpected situation that occurs to the train.

[0123] In the embodiments of the present application, if an accident occurs to a train, the time spent on handling the accident will cause the train to be late or early. At this time, the train sends the time for handling the accident to the ATS, and the ATS forwards it to the PIS.

[0124] Exemplarily, refer to Figure 9 As shown, similar to the process of monitoring the actual arrival time of the train, when the platform display screen detects that the train departs, it immediately sends the actual departure time T0 of the train to the PIS. If an accident occurs to the train, causing the train to be late or early, the late time or early time T1 is sent to the PIS.

[0125] Step 216: Adjust the vehicle speed or the expected arrival time of the second train according to the accidental error time.

[0126] In the embodiments of the present application, the PIS adjusts the vehicle speed of the second train (for example, the next train, the next two trains) and / or the expected arrival time of the target section (for example, the next train platform, the next two train platforms) according to the accidental error time.

[0127] Exemplarily, refer to Figure 9 As shown, the PIS appropriately adjusts the running speed of the train between each train platform of the current train platform and the next two train platforms according to the time when the train is late or early due to an accident, that is, the accidental error time, and adjusts the expected arrival time of the train at each train platform. In this way, through each train platform, the expected arrival time and the expected departure time of the up-train and the down-train are repeatedly counted to continuously calibrate and improve the on-time arrival rate and operation on-time rate of the train.

[0128] In the embodiments of the present application, by obtaining the accidental error time of the first train, the vehicle speed or the expected arrival time of the train can be automatically adjusted according to the accidental error time, so that the information provided to passengers will not be lagged, so as not to affect the riding experience of passengers.

[0129] Step 217: Adjust the first display time according to the screen display error when the train monitoring data is the screen display error.

[0130] In the embodiments of the present application, when the train monitoring data is the screen display error, that is, it is determined that the planned arrival information displayed on the platform display screen is inaccurate, the platform display screen adjusts the time for displaying the train arrival according to the screen display error, that is, the first display time.

[0131] Exemplarily, when the screen display error of the train monitoring data is -1 (that is, the train arrival is displayed 1 minute late), the platform display screen advances (reduces) the time for displaying the train arrival by 1 minute according to the screen display error.

[0132] Step 218: Adjust the expected arrival time according to the distance-time error when the train monitoring data is the distance-time error.

[0133] In the embodiments of the present application, when the train monitoring data is the distance-time error, that is, it is determined that the train arrives at the train platform late or in advance, the distance-time error is sent to the ATS, and the ATS calibrates and adjusts the parameters (for example: the estimated arrival time, the estimated departure time) for calculating the time in the train planned arrival information according to the distance-time error.

[0134] Exemplarily, referring to Figure 8 As shown, the platform display screen sends the time difference error between the calculated actual arrival time of this train and the second display time of the distance to the arrival time displayed in the PIS system to the ATS. The ATS calibrates and adjusts the parameters of the time in the train planned arrival information according to the time difference, improving the display accuracy of the train arrival time of the train platform PIS system.

[0135] By setting corresponding adjustment schemes for different train monitoring data in the embodiments of the present application, the reliability of the system can be improved, and the effectiveness of the passenger information provided by the system can be ensured, so as not to affect the passenger riding experience.

[0136] Another train monitoring method provided by the embodiments of the present application can automatically obtain train images and passenger service information images without manual monitoring of the train by using the emergency intercom camera installed on the platform display screen to take pictures of the train or the platform display screen in real time. Then, through the method of video image recognition, the actual arrival information is automatically extracted from the train image, and the planned arrival information is extracted from the passenger service information image. Since the up-platform display screen and the down-platform display screen monitor each other, the train identification mark can be recognized through the emergency intercom camera to obtain train monitoring data. Compared with the traditional method of manual patrol monitoring, it has the advantages of high efficiency and low cost. By setting corresponding adjustment schemes for different train monitoring data, the reliability of the system can be improved, and the effectiveness of the passenger information provided by the system can be ensured, so as not to affect the passenger riding experience.

[0137] Figure 10 is the step flowchart of another train monitoring method provided by the embodiments of the present invention. The method includes:

[0138] Step 301, use the emergency intercom camera of the up-platform display screen to take pictures of the down-platform display screen to obtain passenger service information images.

[0139] This step can refer to the detailed description of step 201 and will not be elaborated here.

[0140] Step 302, use the emergency intercom camera of the down-platform display screen to take pictures of the up-platform display screen to obtain passenger service information images.

[0141] This step can refer to the detailed description in step 202 and will not be elaborated here.

[0142] Step 303: Extract the display status of the platform display screen from the passenger service information image;

[0143] In the embodiment of the present application, the display status refers to the status of the platform display screen in the PIS system, including the normal status and the abnormal status.

[0144] In the embodiment of the present application, the built-in image recognition module in the emergency intercom camera is used to recognize the information displayed on the platform display screen in the passenger service information image to determine the display status of the platform display screen.

[0145] Exemplarily, the emergency intercom camera of the platform display screen takes pictures of the platform display screen to obtain N passenger service information images. Through the built-in image recognition module in the emergency intercom camera, the information displayed on the platform display screen can be recognized, and the display status of the platform display screen is the normal status.

[0146] Step 304: When the display status is the abnormal status, control the platform display screen to restart and save the occurrence time of the passenger service information image and the display status.

[0147] In the embodiment of the present application, the abnormal status is one or more of the blue screen status, black screen status, flower screen status, freezing status, and crashing status. The blue screen status refers to the status where the platform display screen shows a blue screen, the black screen status refers to the status where the platform display screen shows a black screen, the flower screen status refers to the status where the platform display screen shows a flower screen, the freezing status refers to the status where the platform display screen freezes, and the crashing status refers to the status where the platform display screen crashes.

[0148] In the embodiment of the present application, once the platform display screen shows one or more of the blue screen, black screen, flower screen, freezing, and crashing, it is determined that the display status of the platform display screen is the abnormal status. The PIS platform server is used to control the platform display screen in the abnormal status to restart and check whether the display status returns to the normal status. Each platform display screen can be restarted a preset number of times (for example: 1 time, 2 times).

[0149] Exemplarily, as shown in Figure 11 When the platform display screen shows abnormalities such as blue screen, black screen, flower screen, freezing, and crashing, it is determined that the display status of the platform display screen is the abnormal status. The video or photo information taken by the emergency intercom camera at the time of the abnormality is saved, and the time point of the abnormality occurrence is recorded. The PIS platform server is used to control the platform display screen in the abnormal status to restart and check whether the abnormality is restored. If there is no abnormality, the PIS continuously monitors and records the fault-free time, and checks whether the fault-free time within the continuous target duration (such as 1 week, 1 month) reaches the product quality target value (such as 120 hours, 700 hours).

[0150] Step 305: Obtain the restart display status of the restarted passenger service information image.

[0151] In the embodiments of the present application, the restart display status refers to the status of the platform display screen in the PIS system after restart, including the normal status and the abnormal status. The abnormal status is one or more of the blue screen status, the black screen status, the colored screen status, the stuck status, and the deadlock status.

[0152] In the embodiments of the present application, an image recognition module built in the emergency intercom camera is used to recognize the information displayed on the platform display screen in the passenger service information image of the restarted platform display screen to determine the restart display status.

[0153] Exemplarily, after the up-platform display screen is restarted, the emergency intercom camera of the down-platform display screen re-shoots the up-platform display screen to obtain the restarted passenger service information image. Through the image recognition module built in the emergency intercom camera, the information displayed on the restarted up-platform display screen can be recognized, and the restart display status of the restarted platform display screen is the normal status.

[0154] Step 306: When the restart display status is the abnormal status, record the number of irrecoverable restarts of the platform display screen and issue a warning to remind the user to repair the platform display screen.

[0155] In the embodiments of the present application, the number of irrecoverable restarts refers to the number of times that the platform display screen remains in the abnormal status after restart. The number of recoverable restarts refers to the number of times that the platform display screen remains in the normal status after restart.

[0156] In the embodiments of the present application, when the restart display status is the abnormal status, record the number of irrecoverable restarts of the platform display screen and issue a warning through broadcast or text to remind the user to repair the platform display screen.

[0157] Exemplarily, as shown in Figure 11 If the restart display status is the normal status after the platform display screen is restarted, that is, the restart anomaly is recoverable, record the cumulative number of recoverable restarts of each platform display screen. If the restart display status is the abnormal status after the platform display screen is restarted, that is, the restart anomaly is irrecoverable, record the cumulative number of irrecoverable restarts of each platform display screen. And issue an alarm to the operation module included in the PIS system through the PIS platform server, requesting to arrange manpower for repair. Statistically, within the target duration (e.g., 240 hours, one year), whether the number of recoverable restarts is greater than the recoverable restart threshold (e.g., 1 time, 2 times), and whether the number of irrecoverable restarts is greater than the irrecoverable restart number (e.g., 2 times, 5 times). For example, if the number of recoverable restarts is less than 1 time, the test is qualified; otherwise, the test is unqualified.

[0158] In the embodiment of the present application, the emergency intercom camera in the platform display screen is used to take pictures of the platform display screen in real time, so that it is possible to automatically obtain the image of the passenger service information displayed on the platform display screen without manual monitoring of the platform display screen, and extract the display information of the platform display screen from the image of the passenger service information; then when the display state is an abnormal state, the platform display screen is automatically controlled to restart to improve the processing efficiency, and the occurrence time of the image of the passenger service information and the display state is saved for subsequent tracking; by obtaining the restart display state of the restarted passenger service information image of the platform display screen; when the restart display state is an abnormal state, record the number of times that the platform display screen cannot be restored after restart for statistical analysis, and send a warning to remind the user to repair the platform display screen in time to avoid affecting the riding experience of passengers.

[0159] Step 307: Display the planned arrival information of the platform display screen with an abnormal restart display state on the platform display screen with a normal display state through a preset display method.

[0160] In the embodiment of the present application, the preset display method includes one or more of a temporary scrolling information bar and voice broadcast. The temporary scrolling information bar means that a dialog box is set on the platform display screen, and the information is displayed in the dialog box in a scrolling manner.

[0161] In the embodiment of the present application, when it is detected through the platform display screen that the display state or the restart display state of the up-platform display screen or the down-platform display screen is an abnormal state, an alarm message is sent to the PIS platform server, and the PIS platform server displays the planned arrival information displayed on the up-platform display screen or the down-platform display screen with a fault on the platform display screen with a normal state.

[0162] Exemplarily, refer to Figure 12 As shown, when it is detected through the platform display screen that the display state of the up-platform display screen is an abnormal state, control the up-platform display screen to restart. The restart display state of the restarted up-platform display screen is an abnormal state. Send an alarm message to the PIS platform server, and the PIS platform server displays the planned arrival information displayed on the up-platform display screen with a fault on the down-platform display screen with a normal display state. At the same time, the planned arrival information displayed on the up-platform display screen with a fault is scrolled and broadcasted through the speaker of the down-platform display screen without a fault to temporarily replace the key function of the up-platform display screen with a fault and meet the basic needs of passengers.

[0163] In the embodiment of the present application, by displaying the planned arrival information of the platform display screen with an abnormal restart display status on the platform display screen with a normal display status in a preset display manner, it is avoided that passengers cannot know the planned arrival information of the platform display screen with an abnormal status and affect their trips, and it can be ensured that the platform display screen can meet the basic needs of passengers.

[0164] Another train monitoring method provided by the embodiment of the present application can automatically obtain the image of the passenger service information displayed on the platform display screen by using the emergency intercom camera in the platform display screen to take pictures of the platform display screen in real time without manual monitoring of the platform display screen, and extract the display information of the platform display screen from the image of the passenger service information; then when the display status is abnormal, automatically control the restart of the platform display screen to improve the processing efficiency, and save the image of the passenger service information and the occurrence time of the display status for subsequent tracking; obtain the restart display status of the restarted passenger service information image; when the restart display status is abnormal, record the number of times the platform display screen fails to restart for recovery for statistical analysis, and issue a warning to remind the user to repair the platform display screen in time to avoid affecting the passengers' riding experience. By displaying the planned arrival information of the platform display screen with an abnormal restart display status on the platform display screen with a normal display status in a preset display manner, it is avoided that passengers cannot know the planned arrival information of the platform display screen with an abnormal status and affect their trips, and it can be ensured that the platform display screen can meet the basic needs of passengers.

[0165] See Figure 12 As shown, the embodiment of the present application also provides a train monitoring device. The device 40 includes:

[0166] A processor 401, a memory 402, and a program or instruction stored on the memory 402 and executable on the processor 401. When the program or instruction is executed by the processor 401, the steps of the above train monitoring method are implemented.

[0167] Optionally, the processor 401 is further configured to: take pictures of the train through a camera deployed on the train platform to obtain a train image, and take pictures of the platform display screen to obtain an image of the passenger service information; extract the actual arrival information from the train image, and extract the planned arrival information from the image of the passenger service information; analyze the actual arrival information according to the planned arrival information to obtain train monitoring data. The memory 402 is further configured to: store the train image and the image of the passenger service information.

[0168] Optionally, the camera is an emergency intercom camera set on the platform display screen. The platform display screen at least includes: an up-platform display screen and a down-platform display screen with a relative position relationship; the processor 401 is further configured to:

[0169] Taking pictures of the train through the emergency intercom camera on the upper platform display screen to obtain a train image, and taking pictures of the passenger service information image on the lower platform display screen; or, taking pictures of the train through the emergency intercom camera on the lower platform display screen to obtain a train image, and taking pictures of the passenger service information image on the upper platform display screen.

[0170] Optionally, the actual arrival information includes the train status and the actual arrival time of the train, and the train image includes a train identification logo picture; the processor 401 is further configured to:

[0171] When the similarity between the train identification logo pictures within the target time interval is less than the similarity threshold, determining that the train status is the stationary state; identifying the position of the reference line in the train identification logo picture through an image recognition algorithm; when the distance between the reference line and the standard reference line is less than or equal to the distance threshold, determining that the train status is the accurate stop state; when the train status is the stationary state and the accurate stop state, taking the time when the train identification logo picture is acquired as the actual arrival time.

[0172] Optionally, the planned arrival information includes the estimated arrival time displayed on the platform display screen, and the train monitoring data includes the punctuality error; the processor 401 is further configured to: taking the difference between the actual arrival time and the estimated arrival time as the punctuality error.

[0173] Optionally, the actual departure information further includes the actual departure time of the train, the planned arrival information includes the estimated stop time of the train displayed on the platform display screen, and the train monitoring data includes the stop time error of the train; the processor 401 is further configured to:

[0174] Determining the actual stop time of the train through the difference between the actual arrival time and the actual departure time; calculating the difference between the actual stop time and the estimated stop time as the stop time error.

[0175] Optionally, the planned arrival information includes the first display time, and the train monitoring data includes the screen display error; the processor 401 is further configured to: taking the difference between the actual arrival time and the first display time as the screen display error.

[0176] Optionally, the planned arrival information includes at least one time to arrival and the second display time corresponding to the displayed time to arrival on the platform display screen, and the train monitoring data includes the distance-time error; the processor 401 is further configured to:

[0177] Calculating the time difference between the actual arrival time and each second display time; taking the difference between the time difference and the time to arrival corresponding to the second display time as the distance-time error.

[0178] Optionally, the processor 401 is further configured to: adjust the train or platform display screen according to the train monitoring data.

[0179] Optionally, the train includes a first train and at least one second train; the actual arrival information includes the train speed, and the processor 401 is further configured to:

[0180] When the train monitoring data is the on-time error, adjust the train speed within a preset section or the expected arrival time displayed on the platform display screen according to the on-time error; when the train monitoring data is the stop error, adjust the expected arrival time of the second train displayed on the platform display screen according to the stop error; when the train monitoring data is the screen display error, adjust the first display time according to the screen display error; when the train monitoring data is the distance-time error, adjust the expected arrival time according to the distance-time error.

[0181] Optionally, the processor 401 is further configured to: obtain the accidental error time of the first train; adjust the train speed or the expected arrival time of the second train according to the accidental error time.

[0182] Optionally, the processor 401 is further configured to:

[0183] Extract the display status of the platform display screen from the passenger service information image; when the display status is an abnormal status, control the platform display screen to restart, and save the passenger service information image and the occurrence time of the display status; the abnormal status is one or more of a blue screen status, a black screen status, a flower screen status, a freezing status, and a crashing status; obtain the restart display status of the restarted passenger service information image; when the restart display status is an abnormal status, record the number of times the platform display screen fails to restart and issue a warning to remind the user to repair the platform display screen.

[0184] Optionally, the processor 401 is further configured to: display the planned arrival information of the platform display screen with an abnormal restart display status on the platform display screen with a normal display status through a preset display method; the preset display method includes one or more of a temporary scrolling information bar and a voice broadcast.

[0185] A train monitoring device provided by an embodiment of the present invention can automatically obtain a train image of a train without manual monitoring of the train by shooting the train in real time through a camera deployed on a train platform, and can automatically obtain a passenger service information image displayed on the platform display screen without manual monitoring of the platform display screen by shooting the platform display screen in real time; extract the actual arrival information from the train image and extract the planned arrival information from the passenger service information image, and can analyze the actual arrival information according to the planned arrival information, obtain the train monitoring data in a timely manner, and ensure the effectiveness of the train monitoring data so as not to affect the riding experience of passengers.

[0186] An embodiment of the present invention further provides a rail transit system, including the above-mentioned train monitoring device.

[0187] It should be noted that in this document, the term "absolute time" refers to the system time, such as the time in the PIS system. The terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements not only includes those elements, but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or system. Without further limitation, an element defined by the statement "including one..." does not exclude the existence of additional identical elements in the process, method, article or device including that element. In addition, it should be pointed out that the methods in the embodiments of the present application are not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the reverse order according to the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0188] It should be noted that the above embodiments illustrate the present invention rather than limit the present invention, and those skilled in the art can design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in the claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention can be implemented by means of hardware including several different elements and by means of a suitably programmed computer. The use of the words first, second, and third, etc. does not denote any order. These words can be interpreted as names.

[0189] The embodiments of the present application have been described above in conjunction with the accompanying drawings, but the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Those of ordinary skill in the art, under the inspiration of the present application and without departing from the purpose of the present application and the scope protected by the claims, can also make many forms, all of which fall within the protection scope of the present application.

Claims

1. A train monitoring method, characterized in that, Including: Taking pictures of the train through a camera deployed on the train platform to obtain a train image, and taking pictures of the platform display screen to obtain a passenger service information image; Extracting the actual arrival information from the train image, and extracting the planned arrival information from the passenger service information image; Analyzing the actual arrival information according to the planned arrival information to obtain train monitoring data; Adjusting the train or the platform display screen according to the train monitoring data.

2. The method according to claim 1, wherein The camera is an emergency intercom camera set on the platform display screen, and the platform display screen at least includes: an up-platform display screen and a down-platform display screen with a relative position relationship; The taking pictures of the train through a camera deployed on the train platform to obtain a train image, and taking pictures of the platform display screen to obtain a passenger service information image includes: Taking pictures of the train through the emergency intercom camera of the up-platform display screen to obtain a train image, and taking pictures of the down-platform display screen to obtain a passenger service information image; Or, taking pictures of the train through the emergency intercom camera of the down-platform display screen to obtain a train image, and taking pictures of the up-platform display screen to obtain a passenger service information image.

3. The method according to claim 1, wherein The actual arrival information includes the train status and the actual arrival time of the train, and the train image includes a train identification logo picture; The extracting the actual arrival information from the train image includes: When the similarity between the train identification logo pictures is less than a similarity threshold within a target time interval, determining that the train status is a stationary state; Identifying the position of a reference line in the train identification logo picture through an image recognition algorithm; When the distance between the reference line and a standard reference line is less than or equal to a distance threshold, determining that the train status is a correctly parked state; When the train status is a stationary state and a correctly parked state, taking the time when the train identification logo picture is obtained as the actual arrival time.

4. The method according to claim 3, wherein The planned arrival information includes the estimated arrival time displayed on the platform display screen, and the train monitoring data includes the punctuality error; The analyzing the actual arrival information according to the planned arrival information to obtain train monitoring data includes: Taking the difference between the actual arrival time and the estimated arrival time as the punctuality error.

5. The method according to claim 3, wherein The actual arrival information further includes the actual departure time of the train, the planned arrival information includes the estimated stop time of the train displayed on the platform display screen, and the train monitoring data includes the stop error of the train; The analyzing the actual arrival information according to the planned arrival information to obtain train monitoring data includes: Determining the actual stop time of the train through the difference between the actual arrival time and the actual departure time; Calculating the difference between the actual stop time and the estimated stop time as the stop error.

6. The method according to claim 3, characterized in that The planned arrival information includes a first display time, and the train monitoring data includes a screen display error; The analyzing the actual arrival information according to the planned arrival information to obtain train monitoring data includes: Take the difference between the actual arrival time and the first display time as the screen display error.

7. The method according to claim 3, characterized in that, The planned arrival information includes at least one remaining arrival time displayed on the platform display screen and a second display time corresponding to the remaining arrival time, and the train monitoring data includes a distance-time error; The analyzing the actual arrival information according to the planned arrival information to obtain train monitoring data includes: Calculate the time difference between the actual arrival time and each of the second display times; Take the difference between the time difference and the remaining arrival time corresponding to the second display time as the distance-time error.

8. The method according to claim 7, wherein The train includes a first train and at least one second train; the actual arrival information includes the vehicle speed of the train. Adjusting the train or the platform display screen according to the train monitoring data includes: When the train monitoring data is a punctuality error, adjust the vehicle speed or the expected arrival time displayed on the platform display screen within a preset section according to the punctuality error; When the train monitoring data is a stop error, adjust the expected arrival time of the second train displayed on the platform display screen according to the stop error; When the train monitoring data is a screen display error, adjust the first display time according to the screen display error; When the train monitoring data is a distance-time error, adjust the expected arrival time according to the distance-time error.

9. The method according to claim 8, characterized in that, After adjusting the expected arrival time of the second train displayed on the platform display screen according to the stop error when the train monitoring data is a stop error, the method further includes: Obtain the accidental error time of the first train; Adjust the vehicle speed or the expected arrival time of the second train according to the accidental error time.

10. The method according to claim 1, wherein After extracting the actual arrival information from the train image and extracting the planned arrival information from the passenger service information image, the method further includes: Extract the display state of the platform display screen from the passenger service information image; When the display state is an abnormal state, control to restart the platform display screen, and save the passenger service information image and the occurrence time of the display state; the abnormal state is one or more of a blue screen state, a black screen state, a colored screen state, a stuck state, and a crashed state; Obtain the restart display state of the restarted passenger service information image; When the restart display state is an abnormal state, record the non-recoverable restart times of the platform display screen, and issue a warning to remind the user to repair the platform display screen.

11. The method according to claim 10, wherein After recording the non-recoverable restart times of the platform display screen and issuing a warning to remind the user to repair the platform display screen when the restart display state is an abnormal state, the method further includes: Display the planned arrival information of the platform display screen with the restart display state being abnormal on the platform display screen with the display state being normal through a preset display method; the preset display method includes one or more of a temporary scrolling information bar and voice broadcast.

12. A train monitoring device, characterized in that, Include: A processor, a memory, and a program or instructions stored on the memory and executable on the processor, the steps of the train monitoring method according to any one of claims 1-11 being implemented when the program or instructions are executed by the processor.

13. A rail transit system, characterized in that, Comprising the train monitoring device according to claim 12.

Citation Information

Patent Citations

  • BRT passenger traveling information acquisition and guiding scheme publishing system and method

    CN106023582A

  • Train running deviation situation analysis method and system

    CN108945004A

  • Train position checking and interval early warning system based on train instrument image analysis

    CN110481604A

  • Train platform parking detection device

    CN209904778U