Train interior monitoring system and train interior monitoring method

Abstract

A train interior monitoring system (40) comprises: an onboard video storage unit (12) that stores, as image information, parameter information together with video data captured by monitoring cameras (11) that capture images of the interior of trains (10a, 10b); an onboard control unit (14) that controls the operation of devices installed in the trains (10a, 10b); an onboard display unit (15) that carries out display under the control by the onboard control unit (14); an onboard communication unit (13) that, under the control by the onboard control unit (14), transmits image information stored in the onboard video storage unit (12) in a state in which the trains (10a, 10b) are stopped; and a video analysis server (33) that uses the image information to determine whether an item has been forgotten on the trains (10a, 10b), and that generates a forgotten item notification indicating that an item has been forgotten when a forgotten item has been detected. The onboard display unit (15) displays details of the forgotten item notification under the control of the onboard control unit (14).

Description

[Technical field]

[0001] The present disclosure relates to an in-train monitoring system and an in-train monitoring method for monitoring the inside of a train. [Background technology]

[0002] Conventionally, the inside of a moving train is monitored using cameras, etc. For example, Patent Document 1 discloses a technology in which a local system mounted on the train uses multiple cameras to take pictures of the inside of the train, transmits the taken images, etc. to a host system installed on the ground, and the host system on the ground controls the magnification, shooting direction, etc. of the cameras as necessary to detect the occurrence of items left behind on the train, etc. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2001-285842 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, according to the above-mentioned conventional technology, during normal train operation, the local system of the train transmits images captured by a plurality of cameras to a ground host system in real time, and the ground host system transmits control signals for controlling the magnification and shooting direction of the cameras to the local system of the train. Therefore, there is a problem that the amount of communication data between the local system of the train and the ground host system becomes huge during normal train operation. In particular, in a system in which the train and ground equipment perform wireless communication to control the operation of the train, if a delay occurs in the wireless communication while the train is running, it may affect the normal operation of the train, so it is preferable that the amount of communication data that does not directly affect the operation of the train is small.

[0005] The present disclosure has been made in consideration of the above, and aims to provide an in-train monitoring system that is capable of detecting items left behind on a train while reducing the amount of data communicated while the train is moving. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the object, the in-train monitoring system of the present disclosure includes an on-board video storage unit that stores video data captured by a monitoring camera capturing the interior of a train as image information together with parameter information indicating the situation in which the video data was captured, an on-board control unit that controls the operation of equipment mounted on the train, an on-board display unit that performs display based on the control of the on-board control unit, an on-board communication unit that transmits the image information stored in the on-board video storage unit to a ground communication unit when the train is stopped based on the control of the on-board control unit, a ground communication unit that receives the image information transmitted from the on-board communication unit, and a video analysis server that uses the image information received by the ground communication unit to determine whether or not an item has been left behind on the train. When the video analysis server detects that an item has been left behind, it generates a lost item notification indicating that an item has been left behind, the ground communication unit transmits the lost item notification to the on-board communication unit, the on-board communication unit receives the lost item notification, and the on-board display unit displays the content of the lost item notification received by the on-board communication unit based on the control of the on-board control unit. Effect of the Invention

[0007] The in-train monitoring system of the present disclosure has the advantage of being able to detect items left behind on a train while reducing the amount of data communicated while the train is moving. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing a configuration example of an in-train monitoring system according to a first embodiment; [Diagram 2] A flowchart showing the operation of the in-train monitoring system according to the first embodiment. [Diagram 3]FIG. 1 is a diagram showing an example of a configuration of a processing circuit in a train monitoring system according to a first embodiment when the processing circuit is realized by a processor and a memory. [Figure 4] FIG. 1 is a diagram showing an example of the configuration of a processing circuit in a train monitoring system according to a first embodiment when the processing circuit is realized by dedicated hardware. [Diagram 5] A flowchart showing the operation of the in-train monitoring system according to the second embodiment. [Figure 6] A flowchart showing the operation of the in-train monitoring system according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an in-train monitoring system and an in-train monitoring method according to embodiments of the present disclosure will be described in detail with reference to the drawings.

[0010] Embodiment 1 FIG. 1 is a diagram showing an example of the configuration of an in-train monitoring system 40 according to the first embodiment. The in-train monitoring system 40 includes trains 10a and 10b, a ground-to-car network 20, and a ground base station 30. The trains 10a and 10b have the same configuration. In the following description, when there is no need to distinguish between the trains 10a and 10b, they may be referred to as trains 10. In the example of FIG. 1, the in-train monitoring system 40 includes two trains 10, but is not limited to this. The number of trains 10 included in the in-train monitoring system 40 may be one, or three or more.

[0011] First, we will explain the configuration and operation of the train 10. As shown in Fig. 1, the train 10 is equipped with multiple surveillance cameras 11, an on-board video storage unit 12, an on-board communication unit 13, an on-board control unit 14, and an on-board display unit 15.

[0012] The surveillance camera 11 is mounted on each vehicle constituting the train 10 and captures the interior of the train 10, i.e., the inside of the vehicle. In the example of FIG. 1, the train 10 is configured with three cars, and two surveillance cameras 11 are mounted on each car, but the present invention is not limited to this. The number of surveillance cameras 11 mounted on each car of the train 10 may be one or three or more. The train 10 is equipped with surveillance cameras 11 whose installation positions, shooting directions, etc. are adjusted so that no blind spots occur in the shooting range. Therefore, in the train 10, the number of surveillance cameras 11 mounted on each car may differ depending on the car, depending on the seat layout of each car. Each surveillance camera 11 is given identification information for identifying each surveillance camera 11. In addition, each surveillance camera 11 is given information on the car number for identifying the car in which each surveillance camera 11 is installed. Each surveillance camera 11 captures images of the interior of the train 10 at a prescribed period, and outputs the captured image data to an on-board image storage unit 12 together with identification information and car number information.

[0013] The on-board video storage unit 12 stores the video data captured by the surveillance camera 11 and acquired from the surveillance camera 11 as image information together with parameter information indicating the situation in which the video data was captured. The parameter information includes the above-mentioned identification information and car number information of the surveillance camera 11, as well as information on the time of capture. Regarding the information on the time of capture, information on the time when each surveillance camera 11 actually captured the interior of the train 10 may be output to the on-board video storage unit 12 together with the identification information and the car number information as the information on the time of capture, or the on-board video storage unit 12 may store the information acquired from the surveillance camera 11 by adding the information on the time of capture as the information on the time of capture. Note that the example of FIG. 1 shows a case where each train 10 has one on-board video storage unit 12, but this is not limited thereto. When the train 10 has a long formation, such as a formation of 16 cars, the train 10 may have multiple on-board video storage units 12, or each car may have an on-board video storage unit 12. An on-board video storage unit 12 installed in each vehicle may add information on the vehicle number to the information acquired from the surveillance camera 11 and store the information.

[0014] The on-board communication unit 13 communicates with a ground communication unit 31 (described later) provided in a ground base station 30 installed on the ground, via a ground-to-vehicle network 20. The ground-to-vehicle network 20 may be a dedicated network of the railway company that operates the train 10, or may be a public network such as the Internet.

[0015] The on-board control unit 14 controls the operation of devices mounted on the train 10. Devices mounted on the train 10 include, but are not limited to, the multiple surveillance cameras 11, the on-board video storage unit 12, the on-board communication unit 13, and the on-board display unit 15 shown in Fig. 1. The on-board control unit 14 controls the operation of devices related to the running of the train 10, such as brakes (not shown) equipped on the train 10, doors (not shown) equipped on the train 10, air conditioners, etc.

[0016] The on-board display unit 15 performs display based on the control of the on-board control unit 14. The on-board display unit 15 is a display device that is installed in the driver's cab of the train 10, and allows the driver, conductor, etc. on board the train 10 to check the display content.

[0017] In the first embodiment, the on-board control unit 14 controls the transmission of image information stored in the on-board image storage unit 12 when the train 10 is stopped from the on-board communication unit 13 to the ground communication unit 31 of the ground base station 30 installed on the ground via the ground-to-vehicle network 20. That is, the on-board communication unit 13 transmits image information stored in the on-board image storage unit 12 when the train 10 is stopped to the ground communication unit 31 of the ground base station 30 installed on the ground under the control of the on-board control unit 14. In the first embodiment, the state in which the train 10 is stopped is a state in which the operation of the train 10 has ended, the train 10 has all passengers disembarked, and the train 10 has an operation type such as non-operation and returns to a depot or the like. As described above, the on-board control unit 14 controls the operation of the equipment mounted on the train 10, and therefore, for example, the timing when the operation of the train 10 has ended can be recognized by changing the destination display displayed on the leading car of the train 10 to non-operation. In this case, based on the control of the on-board control unit 14, the on-board communication unit 13 transmits image information stored in the on-board video memory unit 12 from the time the train 10 starts operation to the time it ends operation to the ground communication unit 31 equipped in the ground base station 30.

[0018] For example, if the train 10 transmits image information including video data captured by the monitoring camera 11 to the ground base station 30 installed on the ground in real time every time the monitoring camera 11 captures the image, the image data will be transmitted even while the train 10 is running. In this case, the more monitoring cameras 11 the train 10 has, the larger the amount of image information transmitted from the train 10 to the ground base station 30 installed on the ground while the train 10 is running. If the train 10 is running in a system in which the train 10 and the ground base station 30 communicate wirelessly with each other to control the operation of the train 10, the image information transmitted by the train 10 may cause communication congestion between the train 10 and the ground base station 30, which may affect the running of the train 10. Therefore, in the first embodiment, the on-board control unit 14 controls the transmission of image information stored in the on-board image storage unit 12 from the on-board communication unit 13 to the ground base station 30 installed on the ground via the ground-to-vehicle network 20 while the train 10 is stopped. This allows the on-board control unit 14 to avoid a situation in which communication congestion between the train 10 and the ground base station 30 occurs.

[0019] In addition, the in-train monitoring system 40 assumes that a plurality of trains 10 transmit image information to the ground base station 30. For this reason, the trains 10 may include train number information capable of identifying each train 10 in the parameter information of the image information, or when the on-board communication unit 13 transmits image information, the image information may be appended with train number information capable of identifying the train 10 that transmitted the image information and then transmitted to the ground base station 30.

[0020] Next, we will explain the configuration and operation of the terrestrial base station 30. As shown in Fig. 1, the terrestrial base station 30 includes a terrestrial communication unit 31, a terrestrial video storage unit 32, a video analysis server 33, and a lost property management server 34.

[0021] The ground communication unit 31 receives image information transmitted from the on-board communication unit 13 of the train 10 via the ground-to-vehicle network 20. The ground communication unit 31 outputs the received image information to the ground image storage unit 32.

[0022] The ground video storage unit 32 stores the image information received by the ground communication unit 31. Since the ground communication unit 31 acquires image information from a plurality of trains 10, the ground video storage unit 32 stores the image information for each train 10. Note that if the amount of data of the image information transmitted from the on-board communication unit 13 of the train 10 and received by the ground communication unit 31 is an amount of data that the video analysis server 33 can acquire and handle at one time, the ground base station 30 does not need to include the ground video storage unit 32. In this case, the ground communication unit 31 outputs the received image information to the video analysis server 33.

[0023] The video analysis server 33 uses the image information received by the ground communication unit 31 and stored in the ground image storage unit 32 to determine whether or not an item has been left behind on the train 10. When the ground base station 30 does not have the ground image storage unit 32 as described above, the video analysis server 33 uses the image information received by the ground communication unit 31 and acquired from the ground communication unit 31 to determine whether or not an item has been left behind on the train 10. The video analysis server 33 is assumed to have been trained in advance by machine learning or the like so as to be able to detect passenger luggage or the like placed on a seat, luggage rack, or the like of the train 10 as a lost item. Examples of items that may be considered lost items include, but are not limited to, bags, luggage in a paper bag, and umbrellas. In addition, the machine learning method for the video analysis server 33 may be a general learning method and is not particularly limited. When the video analysis server 33 detects a lost item, it generates a lost item notification indicating that the item has been left behind, and causes the ground communication unit 31 to transmit the generated lost item notification to the on-board communication unit 13 of the corresponding train 10 via the ground-to-vehicle network 20. That is, the ground communication unit 31 transmits the lost item notification generated by the video analysis server 33 to the on-board communication unit 13 of the corresponding train 10 via the ground-to-car network 20. The lost item notification includes, among the parameter information corresponding to the video data in which the lost item was captured, information on the car number indicating the car constituting the train 10 in which the location of the lost item can be identified. The lost item notification may further include the video data in which the lost item was captured. Furthermore, when the video analysis server 33 detects a lost item, it outputs image information corresponding to the lost item to the lost item management server 34.

[0024] The lost-item management server 34 stores image information corresponding to the lost item. The lost-item management server 34 stores the image information corresponding to the lost item at least until the lost item is picked up by the passenger or until a specified storage period has elapsed without the lost item being picked up by the passenger. The lost-item management server 34 may delete the image information corresponding to the lost item based on a regulation when the lost item is picked up by the passenger or when a specified storage period has elapsed without the lost item being picked up by the passenger.

[0025] In the train 10, the on-board communication unit 13 receives the lost-item notice transmitted from the ground communication unit 31 of the ground base station 30 via the ground-to-vehicle network 20 and outputs it to the on-board control unit 14. The on-board control unit 14 causes the on-board display unit 15 to display the contents of the lost-item notice received by the on-board communication unit 13. That is, the on-board display unit 15 displays the contents of the lost-item notice received by the on-board communication unit 13 on the driver's cab or the like under the control of the on-board control unit 14. If the on-board display unit 15 has a function for outputting sound, it may output a sound such as an alarm to notify the driver and the conductor on board the train 10 that the lost-item notice has been received. In this way, at least one of the driver and the conductor on board the train 10 can recognize that the lost-item notice is in the car indicated by the information on the car number included in the lost-item notice by checking the display contents of the on-board display unit 15 without having to check whether there is any lost item in each car of the train 10 after the operation is over, and can immediately retrieve the lost item. As a result, the in-train monitoring system 40 can reduce the effort required by at least one of the driver and conductor on board the train 10 to inspect each car of the train 10 after operations have ended.

[0026] In addition, the train 10 may perform an operation indicating that at least one of the driver and the conductor on board the train 10 has acknowledged the lost-item notice, and may return a notice indicating that the lost-item notice has been acknowledged to the video analysis server 33 of the ground base station 30. This allows the video analysis server 33 to know that the lost-item notice has been acknowledged. In addition, if the video analysis server 33 does not receive a reply from the train 10 indicating that the lost-item notice has been acknowledged within a specified period of time, the video analysis server 33 may cause the ground communication unit 31 to resend the lost-item notice. This allows the video analysis server 33 to improve the probability that the driver and the conductor on board the train 10 will acknowledge the lost-item notice.

[0027] The operation of the in-train monitoring system 40 will be described using a flowchart. FIG. 2 is a flowchart showing the operation of the in-train monitoring system 40 according to the first embodiment. In the train 10, the monitoring camera 11 captures the interior of the train 10 at a specified period (step S1). The on-board video storage unit 12 stores the video data captured by the monitoring camera 11 as image information together with parameter information indicating the situation in which the image was captured (step S2). The on-board control unit 14 judges whether the operation of the train 10 has ended (step S3). If the operation of the train 10 has not ended (step S3: No), the in-train monitoring system 40 returns to the operation of step S1. If the operation of the train 10 has ended (step S3: Yes), the on-board control unit 14 controls the on-board communication unit 13 to transmit the image information stored in the on-board video storage unit 12 to the ground communication unit 31 of the ground base station 30. That is, the on-board communication unit 13 of the train 10 transmits the image information stored in the on-board image storage unit 12 to the ground communication unit 31 of the ground base station 30 (step S4).

[0028] In the ground base station 30, the ground communication unit 31 receives the image information transmitted from the on-board communication unit 13 of the train 10 via the ground-to-vehicle network 20 (step S5). The ground video storage unit 32 stores the image information received by the ground communication unit 31 (step S6). The video analysis server 33 uses the image information stored in the ground video storage unit 32 to determine whether or not an item has been left behind on the train 10 (step S7). If an item has not been left behind (step S7: No), the in-train monitoring system 40 ends the operation of the flowchart shown in FIG. 2. If an item has been left behind (step S7: Yes), the video analysis server 33 generates a lost item notification indicating that an item has been left behind (step S8). The ground communication unit 31 of the ground base station 30 transmits the lost item notification generated by the video analysis server 33 to the on-board communication unit 13 of the train 10 (step S9).

[0029] In the train 10, the on-board communication unit 13 receives the lost-item notification transmitted from the ground communication unit 31 of the ground base station 30 via the ground-to-vehicle network 20 (step S10). The on-board control unit 14 causes the on-board display unit 15 to display the contents of the lost-item notification received by the on-board communication unit 13. That is, the on-board display unit 15 displays the contents of the lost-item notification under the control of the on-board control unit 14 (step S11).

[0030] Next, the hardware configuration of the in-train monitoring system 40 according to the first embodiment will be described. In the in-train monitoring system 40, the monitoring camera 11 is a sensor. In the in-train monitoring system 40, the other components are realized by a processing circuit. The processing circuit may be a memory that stores a program and a processor that executes the program stored in the memory, or may be dedicated hardware. The processing circuit is also called a control circuit.

[0031] FIG. 3 is a diagram showing an example of the configuration of the processing circuit 90 in the in-train monitoring system 40 according to the first embodiment, when the processing circuit is realized by a processor 91 and a memory 92. The processing circuit 90 shown in FIG. 3 is a control circuit and includes a processor 91 and a memory 92. When the processing circuit 90 is configured by the processor 91 and the memory 92, each function of the processing circuit 90 is realized by software, firmware, or a combination of software and firmware. The software or firmware is described as a program and stored in the memory 92. In the processing circuit 90, each function is realized by the processor 91 reading and executing the program stored in the memory 92. That is, the processing circuit 90 includes the memory 92 for storing a program that results in the processing of the in-train monitoring system 40 being executed. This program can also be said to be a program for causing the in-train monitoring system 40 to execute each function realized by the processing circuit 90. This program may be provided by a storage medium in which the program is stored, or may be provided by other means such as a communication medium.

[0032] The program includes a first step in which the on-board video storage unit 12 stores video data captured by the monitoring camera 11 capturing the interior of the train 10 as image information together with parameter information indicating the situation in which the video data was captured; a second step in which the on-board communication unit 13 transmits the image information stored in the on-board video storage unit 12 to the ground communication unit 31 while the train 10 is stopped, based on the control of the on-board control unit 14 that controls the operation of the equipment mounted on the train 10; a third step in which the ground communication unit 31 receives the image information transmitted from the on-board communication unit 13; It can also be said to be a program that causes the in-train monitoring system 40 to execute the following steps: a fourth step of determining whether or not an item has been left behind on the train 10 using the image information received by the communication unit 31; a fifth step of the video analysis server 33 generating a lost item notification indicating that an item has been left behind if it detects that an item has been left behind; a sixth step of the ground communication unit 31 sending the lost item notification to the on-board communication unit 13; a seventh step of the on-board communication unit 13 receiving the lost item notification; and an eighth step of the on-board display unit 15 displaying the contents of the lost item notification received by the on-board communication unit 13 based on the control of the on-board control unit 14.

[0033] Here, the processor 91 is, for example, a CPU (Central Processing Unit), a processing device, an arithmetic device, a microprocessor, a microcomputer, or a DSP (Digital Signal Processor), etc. Also, the memory 92 is, for example, a non-volatile or volatile semiconductor memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable ROM), an EEPROM (Electrically EPROM), a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, or a DVD (Digital Versatile Disc), etc.

[0034] Fig. 4 is a diagram showing an example of the configuration of the processing circuit 93 in the in-train monitoring system 40 according to the first embodiment when the processing circuit is realized by dedicated hardware. The processing circuit 93 shown in Fig. 4 corresponds to, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination of these. The processing circuit 93 may be partially realized by dedicated hardware and partially realized by software or firmware. In this way, the processing circuit 93 can realize each of the above-mentioned functions by dedicated hardware, software, firmware, or a combination of these.

[0035] As described above, according to this embodiment, in the in-train monitoring system 40, the on-board communication unit 13 of the train 10, under the control of the on-board control unit 14, transmits the image information stored in the on-board video storage unit 12 to the ground base station 30 after the operation of the train 10 ends, assuming that the train 10 is stopped. In the ground base station 30, the video analysis server 33 uses the image information transmitted from the on-board communication unit 13 of the train 10 and received by the ground communication unit 31 of the ground base station 30 to determine whether or not an item has been left behind on the train 10. When the video analysis server 33 detects a lost item, the ground communication unit 31 of the ground base station 30 transmits a lost item notification generated by the video analysis server 33 to the train 10. In the train 10, the on-board display unit 15 displays the contents of the lost item notification received by the on-board communication unit 13 under the control of the on-board control unit 14. As a result, at least one of the driver and conductor on board the train 10 can recognize that an item has been left behind in the car indicated by the car number information included in the lost-item notice by checking the display content of the on-board display unit 15, and can retrieve the item. Furthermore, since the in-train monitoring system 40 does not transmit image information from the train 10 to the ground base station 30 while the train 10 is running, and does not transmit a lost-item notice from the ground base station 30 to the train 10, it is possible to detect items left behind on the train 10 while reducing the amount of communication data while the train 10 is running.

[0036] Embodiment 2 In the first embodiment, the train 10 transmits image information stored in the on-board video storage unit 12 to the ground base station 30 after the train 10 has finished operating, assuming that the train 10 is in a stopped state. In the second embodiment, a case will be described in which the train 10 transmits image information stored in the on-board video storage unit 12 to the ground base station 30 when the train 10 is stopped at a station, assuming that the train 10 is in a stopped state.

[0037] In the second embodiment, the configuration of the in-train monitoring system 40 is similar to the configuration of the in-train monitoring system 40 in the first embodiment shown in Fig. 1. Fig. 5 is a flowchart showing the operation of the in-train monitoring system 40 according to the second embodiment. The flowchart of the second embodiment shown in Fig. 5 is obtained by replacing step S3 with step S21 in the flowchart of the first embodiment shown in Fig. 2.

[0038] After the operation of step S2, in the second embodiment, the on-board control unit 14 judges whether the train 10 is stopped at a station (step S21). As described above, the on-board control unit 14 controls the operation of the devices mounted on the train 10, and therefore, for example, when the doors of the train 10 are open, it can recognize that the train 10 is stopped at a station. If the train 10 is not stopped at a station (step S21: No), the in-train monitoring system 40 returns to the operation of step S1. If the train 10 is stopped at a station (step S21: Yes), the on-board control unit 14 controls the on-board communication unit 13 to transmit the image information stored in the on-board video storage unit 12 to the ground communication unit 31 of the ground base station 30. That is, the on-board communication unit 13 of the train 10 transmits the image information stored in the on-board video storage unit 12 to the ground communication unit 31 of the ground base station 30 (step S4). Specifically, the on-board communication unit 13 of the train 10 transmits image information stored in the on-board video storage unit 12 during the period from when the train 10 arrived at the previous station to when the train 10 arrives at the current station, to the ground communication unit 31 of the ground base station 30, under the control of the on-board control unit 14. In the second embodiment, other operations of the in-train monitoring system 40 are similar to those of the in-train monitoring system 40 in the first embodiment. However, unlike the first embodiment, the in-train monitoring system 40 transmits and receives image information and determines whether any item has been left behind every time the train 10 stops at a station, and therefore repeatedly executes the flowchart shown in Fig. 5 while the train 10 is in operation.

[0039] For example, if the train 10 is a type of train that operates long distances and a passenger who boards the train 10 near the starting station leaves his / her baggage on the train 10, the in-train monitoring system 40 will detect the lost item at the distant terminal station if it performs the operation of the first embodiment. Therefore, it will take time and effort whether the passenger goes to retrieve the lost item or the railway company operating the train 10 carries the lost item to the station the passenger desires.

[0040] In contrast, when the train 10 is a type of train that operates long distances and a passenger who boards the train 10 near the starting station leaves his / her luggage on the train 10, the in-train monitoring system 40 can detect the lost item at a station not far from the station where the passenger got off by performing the operation of the second embodiment. In this case, the in-train monitoring system 40 can also detect the lost item at a station where the lost item can be collected by sending a lost item notification to a station where the lost item can be collected, so that even if the driver and conductor of the train 10 cannot collect the lost item, a station attendant who confirms the lost item notification can collect the lost item left on the train 10. Therefore, in either case where the passenger goes to collect the lost item or where the railway company operating the train 10 carries the lost item to the station desired by the passenger, time and effort can be reduced compared to the first embodiment.

[0041] As described above, according to this embodiment, in the in-train monitoring system 40, the on-board communication unit 13 of the train 10, under the control of the on-board control unit 14, assumes that the train 10 is in a stopped state and transmits image information stored in the on-board video storage unit 12 to the ground base station 30 when the train 10 stops at a station. This makes it possible for the in-train monitoring system 40 to retrieve lost items at a station relatively close to the location where the item was left behind, compared to the first embodiment.

[0042] In the in-train monitoring system 40, the train 10 transmits image information to the ground base station 30 every time the train stops at a station, but this is not limited to the above. In the in-train monitoring system 40, the train 10 may transmit image information to the ground base station 30 when a large number of passengers are expected to get on and off at a transfer station to another line, etc., and the stop time at the station is longer than a specified time. In other words, the train 10 does not need to transmit image information to the ground base station 30 when the stop time at the station is shorter than a specified time.

[0043] Embodiment 3 In the first embodiment, the train 10 transmits image information stored in the on-board video storage unit 12 to the ground base station 30 after the train 10 has finished operating, assuming that the train 10 is in a stopped state, and the video analysis server 33 of the ground base station 30 uses the image information to determine whether any property has been left behind. In this case, the video analysis server 33 of the ground base station 30 can also detect passengers left behind on the train 10 after the train has finished operating, by a similar operation.

[0044] In the third embodiment, the configuration of the in-train monitoring system 40 is similar to the configuration of the in-train monitoring system 40 in the first embodiment shown in Fig. 1. Fig. 6 is a flowchart showing the operation of the in-train monitoring system 40 according to the third embodiment. The flowchart of the second embodiment shown in Fig. 6 is obtained by replacing steps S7 to S11 with steps S31 to S35 in the flowchart of the first embodiment shown in Fig. 2.

[0045] After the operation of step S6, in the third embodiment, the video analysis server 33 uses the image information stored in the ground video storage unit 32 to determine whether or not there are any passengers who have not disembarked from the train 10 (step S31). If there are no passengers who have not disembarked (step S31: No), the in-train monitoring system 40 ends the operation of the flowchart shown in FIG. 6. If there are passengers who have not disembarked (step S31: Yes), the video analysis server 33 generates a passenger notification indicating that there are passengers who have not disembarked (step S32). The contents of the passenger notification are the same as the contents of the lost property notification described in the first embodiment. The ground communication unit 31 of the ground base station 30 transmits the passenger notification generated by the video analysis server 33 to the on-board communication unit 13 of the train 10 (step S33).

[0046] In the train 10, the on-board communication unit 13 receives the passenger notification transmitted from the ground communication unit 31 of the ground base station 30 via the ground-to-vehicle network 20 (step S34). The on-board control unit 14 causes the on-board display unit 15 to display the contents of the passenger notification received by the on-board communication unit 13. That is, the on-board display unit 15 displays the contents of the passenger notification under the control of the on-board control unit 14 (step S35). If the on-board display unit 15 has a function of outputting sound, it may output a sound such as an alarm to make the driver and the conductor on board the train 10 aware that the passenger notification has been received. In the third embodiment, other operations of the in-train monitoring system 40 are the same as those of the in-train monitoring system 40 in the first embodiment. However, in the third embodiment, in FIG. 1, "lost item notification" becomes "passenger notification", and "image information corresponding to lost item" becomes "image information corresponding to passenger". The in-train monitoring system 40 performs the operation of the flowchart according to the third embodiment shown in FIG. 6 in parallel with the operation of the flowchart according to the first embodiment shown in FIG.

[0047] In addition, the train 10 may perform an operation indicating that at least one of the driver and the conductor on board the train 10 has confirmed the passenger notification, and return a notification indicating that the passenger notification has been confirmed to the video analysis server 33 of the ground base station 30. This allows the video analysis server 33 to know that the passenger notification has been confirmed. Furthermore, if the video analysis server 33 does not receive a reply from the train 10 indicating that the passenger notification has been confirmed within a specified period of time, the video analysis server 33 may generate a passenger notification again and resend it from the ground communication unit 31. This allows the video analysis server 33 to improve the probability that the driver and the conductor on board the train 10 will recognize the passenger notification.

[0048] As described above, according to this embodiment, in the in-train monitoring system 40, the video analysis server 33 of the ground base station 30 uses image information transmitted from the on-board communication unit 13 of the train 10 and received by the ground communication unit 31 of the ground base station 30 to determine whether or not there are passengers who have not disembarked on the train 10. When the video analysis server 33 detects a passenger who has not disembarked, the ground communication unit 31 of the ground base station 30 transmits a passenger notification generated by the video analysis server 33 to the train 10. In the train 10, the on-board display unit 15 displays the contents of the passenger notification received by the on-board communication unit 13 under the control of the on-board control unit 14. As a result, at least one of the driver and the conductor on board the train 10 can recognize that a passenger is present in the car indicated by the car number information included in the passenger notification by checking the display contents of the on-board display unit 15, and can protect passengers left behind on the train 10.

[0049] The configurations shown in the above embodiments are merely examples, and may be combined with other known technologies, or the embodiments may be combined with each other. Also, parts of the configurations may be omitted or modified without departing from the spirit of the invention. [Explanation of symbols]

[0050] 10a, 10b train, 11 surveillance camera, 12 on-board image storage unit, 13 on-board communication unit, 14 on-board control unit, 15 on-board display unit, 20 ground-to-vehicle network, 30 ground base station, 31 ground communication unit, 32 ground image storage unit, 33 image analysis server, 34 lost property management server, 40 in-train surveillance system, 90, 93 processing circuit, 91 processor, 92 memory.

Claims

1. an on-board image storage unit that stores image data captured by a surveillance camera that captures the interior of a train as image information together with parameter information that indicates the circumstances under which the image data was captured; an on-board control unit that controls the operation of equipment mounted on the train; an on-board display unit that performs display based on the control of the on-board control unit; an on-board communication unit that transmits the image information stored in the on-board image storage unit to a ground communication unit under control of the on-board control unit while the train is stopped; the ground communication unit receiving the image information transmitted from the on-board communication unit; a video analysis server that uses the image information received by the ground communication unit to determine whether an item has been left behind on the train; Equipped with When the video analysis server detects the occurrence of the lost item, it generates a lost item notification indicating that the lost item has occurred; The ground communication unit transmits the lost item notification to the on-board communication unit, The on-board communication unit receives the lost item notification, The on-board display unit displays the contents of the lost item notification received by the on-board communication unit under the control of the on-board control unit. A train monitoring system.

2. The state in which the train is stopped is a state in which the operation of the train has ended, The on-board communication unit transmits the image information stored in the on-board image storage unit during a period from when the train starts operation to when the train ends operation, to the ground communication unit, based on control by the on-board control unit.

2. The in-train monitoring system according to claim 1.

3. The state in which the train is stopped is a state in which the train is stopped at a station, The on-board communication unit transmits, to the ground communication unit, the image information stored in the on-board image storage unit during the period from when the train arrived at a station where the train had previously stopped until when the train arrived at a station where the train is currently stopped, based on the control of the on-board control unit.

2. The in-train monitoring system according to claim 1.

4. The lost item notification includes, among the parameter information corresponding to the video data in which the lost item is captured, information on a car number indicating a car constituting the train that can identify the location of the lost item.

2. The in-train monitoring system according to claim 1.

5. The lost item notification further includes the video data of the lost item.

5. The in-train monitoring system according to claim 4.

6. moreover, a lost property management server that stores the image information corresponding to the lost property; 6. The in-train monitoring system according to claim 1, further comprising:

7. The video analytics server further determines whether there are any passengers who have not disembarked on the train, and if there are any passengers who have not disembarked, generates a passenger notification indicating the presence of the passengers who have not disembarked; The ground communication unit transmits the passenger notification to the on-board communication unit; The on-board communication unit receives the passenger notification, The on-board display unit displays the content of the passenger notification received by the on-board communication unit under the control of the on-board control unit.

3. The in-train monitoring system according to claim 2.

8. a first step in which an on-board image storage unit stores image data captured by a surveillance camera capturing an image of the interior of a train as image information together with parameter information indicating a situation in which the image data was captured; a second step in which an on-board communication unit transmits the image information stored in the on-board image storage unit to a ground communication unit while the train is stopped, based on control by an on-board control unit that controls operation of equipment mounted on the train; a third step of receiving the image information transmitted from the on-board communication unit by the ground communication unit; a fourth step of a video analysis server determining whether or not an article has been left behind on the train by using the image information received by the ground communication unit; A fifth step of generating a notice of the loss of the item when the video analysis server detects that the item has been left behind; a sixth step of transmitting the lost item notification to the on-board communication unit by the ground communication unit; A seventh step of the on-board communication unit receiving the lost item notification; an eighth step of displaying the contents of the lost property notification received by the on-board communication unit under the control of the on-board control unit by an on-board display unit; A method for monitoring inside a train, comprising:

9. The state in which the train is stopped is a state in which the operation of the train has ended, In the second step, the on-board communication unit transmits, under control of the on-board control unit, the image information stored in the on-board image storage unit during a period from when the train starts to when the train ends its operation, to the ground communication unit.

9. The in-train monitoring method according to claim 8.

10. The state in which the train is stopped is a state in which the train is stopped at a station, In the second step, the on-board communication unit transmits, under control of the on-board control unit, the image information stored in the on-board image storage unit during a period from when the train arrived at a station where the train had previously stopped until when the train arrived at a station where the train is currently stopped, to the ground communication unit.

9. The in-train monitoring method according to claim 8.

11. The lost item notification includes, among the parameter information corresponding to the video data in which the lost item is captured, information on a car number indicating a car constituting the train that can identify the location of the lost item.

9. The in-train monitoring method according to claim 8.

12. The lost item notification further includes the video data of the lost item. The in-train monitoring method according to claim 11.

13. moreover, a ninth step in which the lost property management server stores the image information corresponding to the lost property; 13. The method for monitoring inside a train according to claim 8, further comprising:

14. moreover, a tenth step in which the video analytics server determines whether there are any passengers who have not disembarked from the train; an eleventh step of the video analytics server generating a passenger notification indicating the presence of the passengers who have not alighted, if the passengers have not alighted; a twelfth step of the ground communication unit transmitting the passenger notification to the on-board communication unit; a thirteenth step of the on-board communication unit receiving the passenger notification; a fourteenth step in which the on-board display unit displays the content of the passenger notification received by the on-board communication unit under the control of the on-board control unit; 10. The method of claim 9, further comprising:

Images