TRAIN INTERIOR MONITORING SYSTEM AND TRAIN INTERIOR MONITORING PROCEDURES

Abstract

A train interior monitoring system (40) comprises an on-board video storage unit (12) that stores, as image information, video data and parameter information, the video data being obtained by capturing an interior of a train (10a, 10b) using a monitoring camera (11); an on-board control unit (14) that controls operations of devices installed on or connected to the train.are installed in the trains (10a, 10b); an on-board display unit (15) that provides a display under control of the on-board control unit (14); an on-board communication unit (13) that, under control of the on-board control unit (14), transmits the image information stored in the on-board video storage unit (12) when the corresponding one of the trains (10a, 10b) is in a stopped state; and a video analysis server (33) that determines whether there is an abandoned article in each of the trains (10a, 10b) using the image information, and that, when the video analysis server detects the presence of an abandoned article, generates an article abandoned notification indicating that there is an abandoned article. The on-board display unit (15) displays contents of the article abandoned notification under control of an on-board control unit (14).

Description

Area

[0001] The present disclosure relates to a train interior monitoring system and a train interior monitoring method, each for monitoring a train interior. background

[0002] Conventionally, a train interior is monitored using a device such as a camera in a moving train. For example, Patent Literature 1 discloses a technology in which a local system installed on a train captures images of a train interior using multiple cameras and sends the captured images and the like to a host system installed on the ground. The host system on the ground controls the magnification, image capture direction, and the like of the cameras to detect a situation such as the presence of an abandoned article on the train. Citation listPatent literature

[0003] Patent Literature 1: Japanese Patent Laid-Open No. 2001-285842 Summary of the inventionProblem to be solved by the invention

[0004] However, according to the conventional technology described above, during normal train operation, the local system sends images captured by multiple cameras and the like to the host system on the ground in real time, while the host system on the ground sends a control signal for controlling the magnification, image pickup direction, and the like of the cameras to the local system on the train. This poses a problem in that a significantly large amount of communication data is generated between the local system on the train and the host system on the ground during normal train operation. In particular, a system that controls train operation using wireless communication between the train and a device on the ground may be subject to a delay or the like in wireless communication during train running, which may affect regular train running.A smaller amount of communication data is therefore preferred, which has no direct impact on the running of the train.

[0005] The present disclosure has been made in view of the above, and it is an object of the present disclosure to provide a train interior monitoring system capable of detecting an abandoned article located in a train while reducing the amount of communication data during a train run. Means of solving the problem

[0006] To solve the problems described above and achieve the object, a train interior monitoring system according to the present disclosure includes: an onboard video storage unit for storing, as image information, video data and parameter information, the video data obtained by shooting an interior of a train using a monitoring camera, the parameter information representing a situation of obtaining the video data by shooting; an onboard control unit for controlling an operation of a device installed in the train; an onboard display unit for providing a display under control of the onboard control unit; an onboard communication unit for transmitting, under control of the onboard control unit, the image information stored in the onboard video storage unit to a ground communication unit when the train is in a stop state;the ground communication unit for receiving the image information sent from the onboard communication unit; and a video analysis server for determining whether there is an abandoned article in the train using the image information received by the ground communication unit. When the video analysis server detects the presence of the abandoned article, the video analysis server generates an abandoned article notification indicating that the abandoned article exists. The ground communication unit sends the abandoned article notification to the onboard communication unit. The onboard communication unit receives the abandoned article notification. The onboard display unit, under control of the onboard control unit, displays a content of the abandoned article notification received by the onboard communication unit. Effects of the invention

[0007] A train interior monitoring system according to the present disclosure enables an advantage in a capability of detecting an abandoned article located in a train while reducing the amount of communication data during a train run. Short description of the drawings Fig. 1 is a diagram illustrating an exemplary configuration of a train interior monitoring system according to a first embodiment. Fig. 2 is a flowchart illustrating an operation of the train interior monitoring system according to the first embodiment. Fig. 3 is a diagram illustrating an example of a configuration of a processing circuit of the train interior monitoring system according to the first embodiment when the processing circuit is implemented by a processor and a memory. Fig. 4 is a diagram illustrating an example of a configuration of the processing circuit of the train interior monitoring system according to the first embodiment when the processing circuit is implemented in a dedicated hardware element. Fig. 5 is a flowchart illustrating an operation of the train interior monitoring system according to a second embodiment. Fig. 6 is a flowchart illustrating an operation of the train interior monitoring system according to a third embodiment. Description of embodiments

[0008] A train interior monitoring system and a train interior monitoring method according to embodiments of the present disclosure will be described in detail below with reference to the figures. First embodiment.

[0009] Fig. 1 is a diagram illustrating an exemplary configuration of a train interior monitoring system 40 according to a first embodiment. The train interior monitoring system 40 includes trains 10a and 10b, a ground-to-vehicle network 20, and a ground base station 30. The trains 10a and 10b are configured similarly to each other. The trains 10a and 10b could each be referred to as train 10 here if no distinction is to be made between them. Although the train interior monitoring system 40 monitors two of the trains 10 in the example of Fig. 1, its configuration is not limited thereto. The number of trains 10 included in the train interior monitoring system 40 could be one or three or more.

[0010] A configuration and operation of train 10 will be described first. As in Fig. 1, each of the trains 10 (hereinafter simply referred to as train 10) includes a plurality of monitoring cameras 11 (or security cameras), an on-board video storage unit 12, an on-board communication unit 13, an on-board control unit 14, and an on-board display unit 15.

[0011] The surveillance cameras 11 are installed in each of the vehicles that make up the train 10 to record the interior, ie the vehicle interior, of the train 10. The example of the Fig. 1 illustrates an example where the train 10 is a three-car train, and two of the surveillance cameras 11 are installed in each car. However, the configuration thereof is not limited to this. The number of surveillance cameras 11 installed in each car of the train 10 may be one or three or more. The train 10 includes the surveillance cameras 11 in each car, whose installation positions, image pickup directions, and the like have been adjusted to eliminate a blind spot in the pickup area. Thus, the number of surveillance cameras 11 in the train 10 installed in each car may differ depending on the car according to factors such as the seating arrangement of the car. Each of the surveillance cameras 11 is provided with identification information to identify the corresponding one of the surveillance cameras 11.Each of the surveillance cameras 11 is also provided with car number information to identify the vehicle in which the corresponding one of the surveillance cameras 11 is installed. Each of the surveillance cameras 11 records an interior of the train 10 for a predetermined duration and outputs video data obtained by recording the interior of the train 10 to the on-board video storage unit 12 along with the identification information and the car number information.

[0012] The on-board video storage unit 12 stores, as image information, the video data obtained by recording using the surveillance cameras 11, along with parameter information representing the situation of obtaining the video data by recording. The parameter information includes recording time information and the like, as well as the identification information and car number information of each of the surveillance cameras 11 described above.The recording time information may be information about the time at which each of the monitoring cameras 11 actually records an interior of the train 10, which is output to the onboard video storage unit 12 as the recording time information together with the identification information and the car number information, or may be the time of acquisition of the video data from each of the monitoring cameras 11 by the onboard video storage unit 12, the information of which is processed in such a manner that the onboard video storage unit 12 regards such acquisition time as the recording time information, adds the recording time information to the information obtained from the corresponding one of the monitoring cameras 11, and stores the resulting information. It should be noted that the example of the . Fig. 1 illustrates a case where each of the trains 10 includes a single onboard video storage unit 12, but the configuration thereof is not limited thereto. In a case where the train 10 has a long formation, such as when the train 10 is formed by 16 cars, the train 10 could include multiple onboard video storage units 12, wherein each vehicle of the train 10 could include an onboard video storage unit 12. The onboard video storage unit 12 installed in each vehicle could add the car number information to the information obtained from the corresponding one of the monitoring cameras 11 and store the resulting information.

[0013] The on-board communication unit 13 communicates with a ground communication unit 31, which will be described later, comprised of the ground base station 30 installed on the ground, via the ground-to-vehicle network 20. The ground-to-vehicle network 20 could be a private network of a railway company that operates the trains 10 or a public network, such as the Internet.

[0014] The on-board control unit 14 controls operations of devices installed in the train 10. The devices installed in the train 10 include, but are not limited to, the plurality of surveillance cameras 11, the on-board video storage unit 12, the on-board communication unit 13, and the on-board display unit 15 installed in Fig. 1, and the like. The onboard control unit 14 controls operations of devices related to running of the train 10, such as a brake (not illustrated) included in the train 10, and operations of doors, an air conditioner (not illustrated), and the like included in the train 10.

[0015] The on-board display unit 15 provides a display under control of the on-board control unit 14. The on-board display unit 15 is a display device installed in a driver's cab of the train 10 and / or the like to enable the driver, conductor, and others working on the train 10 to check display contents.

[0016] In the first embodiment, the on-board control unit 14 performs control to transmit the image information stored in the on-board video storage unit 12 from the on-board communication unit 13 to the ground communication unit 31 included in the ground-installed ground base station 30 via the ground-to-vehicle network 20 when the train 10 is in a stopped state. That is, the on-board communication unit 13, under control of the on-board control unit 14, transmits the image information stored in the on-board video storage unit 12 to the ground communication unit 31 included in the ground-installed ground base station 30 when the train 10 is in a stopped state.In the first embodiment, the stop state of the train 10 is a state at a time after an operation of the train 10 is completed and all passengers have disembarked from the train 10, and when the train 10 has returned to a location such as a railway shed in an operation mode such as "off-duty." Since the on-board control unit 14 controls operations of devices installed in the train 10 as described above, the on-board control unit 14 can recognize the time of termination of the operation of the train 10 based on an operation such as a change in the destination symbol displayed on the leading vehicle of the train 10 or the like, such as "off-duty."In this case, the on-board communication unit 13, under control of the on-board control unit 14, transmits the image information stored in the on-board video storage unit 12 during a period from the start of operation to the end of operation of the train 10 to the ground communication unit 31 included in the ground base station 30.

[0017] For example, if the train 10 transmits in real time the image information including video data obtained by recording using each of the surveillance cameras 11 to the ground base station 30 installed on the ground, each time a video is recorded by one of the surveillance cameras 11, video data would also be transmitted during a run of the train 10. In this case, the larger the number of surveillance cameras 11 included in the train 10, the larger the amount of image information data would be transmitted from the train 10 to the ground base station 30 installed on the ground while the train 10 is running.In a case where the train 10 is operated in a system that controls the operation of the train 10 using wireless communication between the train 10 and the ground base station 30, there will be a possibility that image information transmitted by the train 10 could cause a communication jam between the train 10 and the ground base station 30, thereby affecting the running of the train 10. Accordingly, in the first embodiment, the on-board control unit 14 performs control to transmit the image information stored in the on-board video storage unit 12 from the on-board communication unit 13 to the ground base station 30 installed on the ground via the ground-to-vehicle network 20 when the train 10 is in a stopped state. This allows the on-board control unit 14 to avoid a situation such as a communication jam between the train 10 and the ground base station 30.

[0018] It should be noted that the train interior monitoring system 40 assumes that multiple trains 10 send image information to the ground base station 30. Thus, each of the trains 10 could include train number information enabling identification of the one of the trains 10 in the parameter information in the image information, or could add train number information enabling identification of the transmitting train 10 to the image information when the on-board communication unit 13 sends the image information, and send the resulting information to the ground base station 30.

[0019] A configuration and operation of the ground base station 30 will be described next. As in Fig. 1, the ground base station 30 includes the ground communication unit 31, a ground video storage unit 32, a video analysis server 33, and a lost item management server 34.

[0020] The ground communication unit 31 receives image information transmitted from the on-board communication unit 13 of the train 10 via the ground-to-vehicle network 20. The ground communication unit 31 outputs the received image information to the ground video storage unit 32.

[0021] The ground video storage unit 32 stores the image information received by the ground communication unit 31. Since the ground communication unit 31 receives the image information from the plurality of trains 10, the ground video storage unit 32 stores the image information on a per-train-10 basis. Note that if the image information transmitted from the onboard communication unit 13 of the train 10 and received by the ground communication unit 31 has a data volume that can be obtained and processed at once by the video analysis server 33, the ground base station 30 does not need to include the ground video storage unit 32. In this case, the ground communication unit 31 outputs the received image information to the video analysis server 33.

[0022] The video analysis server 33 determines whether there is an abandoned article in the train 10 using the image information received by the ground communication unit 31 and stored in the ground video storage unit 32. If the ground base station 30 does not include the ground video storage unit 32 as described above, the video analysis server 33 determines whether there is an abandoned article in the train 10 using the image information received by the ground communication unit 31 and obtained from the ground communication unit 31. It is assumed that the video analysis server 33 has already been trained using machine learning or the like to detect things or the like belonging to a passenger that have been left on a seat, an overhead shelf, or the like of the train 10 as an abandoned article when such an article exists.Possible examples of the abandoned article include, but are not limited to, a bag, a thing in a paper bag, an umbrella, and the like. Furthermore, the machine learning technique used for the video analysis server 33 may be a generally used learning method and is not particularly limited. When the video analysis server 33 detects an abandoned article, the video analysis server 33 generates an abandoned article notification indicating that there is an abandoned article, and has the ground communication unit 31 send the generated abandoned article notification to the onboard communication unit 13 of the corresponding one of the trains 10 via the ground-to-vehicle network 20.This means that the ground communication unit 31 sends the article-left notification generated by the video analysis server 33 to the onboard communication unit 13 of the corresponding one of the trains 10 via the ground-to-vehicle network 20. The article-left notification includes car number information indicating the vehicle constituting the train 10 to enable identification of the location of the left article, in the parameter information corresponding to video data of the left article that has been captured. The article-left notification may further include the video data of the left article that has been captured. When the video analysis server 33 detects an abandoned article, the video analysis server 33 also outputs image information corresponding to the left article to the lost article management server 34.

[0023] The lost item management server 34 stores the image information corresponding to the left-behind article. The lost item management server 34 stores the image information corresponding to the left-behind article at least until the left-behind article is picked up by a passenger, or until a predetermined storage period has expired if the left-behind article is not picked up by a passenger. When the left-behind article is picked up by a passenger, or when a predetermined storage period has expired if the left-behind article is not picked up by a passenger, the lost item management server 34 may delete the image information corresponding to the left-behind article according to an applicable rule.

[0024] In the train 10, the onboard communication unit 13 receives an article abandonment notification sent from the ground communication unit 31 of the ground base station 30 via the ground-to-vehicle network 20 and outputs the article abandonment notification to the onboard control unit 14. The onboard control unit 14 causes the onboard display unit 15 to display the contents of the article abandonment notification received by the onboard communication unit 13. This means that the onboard display unit 15, under control of the onboard control unit 14, displays the contents of the article abandonment notification received from the onboard communication unit 13 in a driver's cab or the like.If the on-board display unit 15 is capable of outputting a sound, the on-board display unit 15 could output a sound, such as an alarm, to alert the driver and the conductor working on the train 10 that an article-left notification has been received. This allows at least the driver or the conductor working on the train 10 to recognize that there is an article left in the vehicle indicated by the car number information included in the article-left notification by checking display contents on the on-board display unit 15, without inspecting whether there is an article left with respect to each vehicle of the train 10 that has completed operation. This thus allows the article left to be collected immediately.As a result, the train interior monitoring system 40 can reduce an additional inspection work for each vehicle of the train 10 that has finished an operation, which must be performed by at least the driver or the conductor working in the train 10.

[0025] It should be noted that, on train 10, at least the driver or the conductor working on train 10 could perform an operation to report that at least the driver or the conductor has verified the article-abandoned notification, thereby causing train 10 to return an acknowledgment indicating that the article-abandoned notification has been verified to the video analysis server 33 of ground base station 30. This allows video analysis server 33 to recognize that the article-abandoned notification has been verified. If no acknowledgment indicating that the article-abandoned notification has been verified is returned from train 10 within a predetermined period, video analysis server 33 could also cause ground communication unit 31 to resend the article-abandoned notification.This allows the video analysis server 33 to increase the likelihood that the driver or conductor working on train 10 will recognize the article abandonment notification.

[0026] An operation of the train interior monitoring system 40 will next be described with reference to a flowchart. Fig. 2 is a flowchart illustrating an operation of the train interior monitoring system 40 according to the first embodiment. In the train 10, each of the monitoring cameras 11 periodically records an interior of the train 10 during a predetermined time cycle (step S1). The onboard video storage unit 12 stores, as image information, video data obtained by recording using the monitoring cameras 11, along with parameter information representing the situation of obtaining images by recording (step S2). The onboard control unit 14 determines whether an operation of the train 10 is finished (step S3). If an operation of the train 10 is not finished (step S3: No), the train interior monitoring system 40 returns to the process of operation in step S1.When an operation of the train 10 is completed (step S3: Yes), the on-board control unit 14 controls the on-board communication unit 13 to transmit the image information stored in the on-board video storage unit 12 to the ground communication unit 31 of the ground base station 30. This means that the on-board communication unit 13 of the train 10 transmits the image information stored in the on-board video storage unit 12 to the ground communication unit 31 of the ground base station 30 (step S4).

[0027] In the ground base station 30, the ground communication unit 31 receives the image information sent from the onboard communication unit 13 of the train 10 via the ground-to-vehicle network 20 (step S5). The ground video storage unit 32 stores the image information received by the ground communication unit 31 (step S6). The video analysis server 33 determines whether there is an abandoned article in the train 10 using the image information stored in the ground video storage unit 32 (step S7). If there are no abandoned articles (step S7: No), the train interior monitoring system 40 terminates the operation of the Fig. 2. If there is an abandoned article (step S7: Yes), the video analysis server 33 generates an abandoned article notification indicating that there is an abandoned article (step S8). The ground communication unit 31 of the ground base station 30 transmits the abandoned article notification generated by the video analysis server 33 to the onboard communication unit 13 of the train 10 (step S9).

[0028] In train 10, the onboard communication unit 13 receives the article abandonment notification sent from the ground communication unit 31 of the ground base station 30 via the ground-to-vehicle network 20 (step S10). The onboard control unit 14 has the onboard display unit 15 display the contents of the article abandonment notification received by the onboard communication unit 13. This means that the onboard display unit 15 displays the contents of the article abandonment notification under control of the onboard control unit 14 (step S11).

[0029] Next, a hardware configuration of the train interior monitoring system 40 according to the first embodiment will be described. In the train interior monitoring system 40, the monitoring cameras 11 are sensors. In the train interior monitoring system 40, other components are implemented in a processing circuit. The processing circuit may be a combination of a memory that stores a program and a processor that executes a program stored in the memory, or it may be a dedicated hardware element. The processing circuit is also called a control circuit.

[0030] Fig. Fig. 3 is a diagram illustrating an example of a configuration of a processing circuit of the train interior monitoring system 40 according to the first embodiment, when a processing circuit 90 is implemented by a processor 91 and a memory 92. The processing circuit 90 shown in Fig. 3 is a control circuit and includes a processor 91 and a memory 92. When the processing circuit 90 includes the processor 91 and the memory 92, each functionality of the processing circuit 90 is implemented by software, firmware, or a combination of software and firmware. The software or firmware is written in the form of a program and stored in the memory 92. The processing circuit 90 implements each functionality in such a way that the processor 91 reads and executes a program stored in the memory 92. This means that the processing circuit 90 includes the memory 92 for storing a program that causes the train interior monitoring system 40 to perform processing.It can also be said that this program is a program for causing the train interior monitoring system 40 to perform any functionality to be implemented in the processing circuit 90. This program could be provided using a storage medium that stores the program or using another means, such as a communication medium.

[0031] It can also be said that the foregoing program causes the train interior monitoring system 40 to perform: a first step in which the onboard video storage unit 12 stores, as image information, video data obtained by shooting an interior of the train 10 using the monitoring cameras 11 for shooting the interior of the train 10, together with parameter information representing a situation of obtaining the video data by shooting; a second step in which the onboard communication unit 13, under control of the onboard control unit 14, sends the image information stored in the onboard video storage unit 12 to the ground communication unit 31 when the train 10 is in a stop state, the onboard control unit 14 controlling operations of devices installed in the train 10;a third step in which the ground communication unit 31 receives the image information sent from the onboard communication unit 13; a fourth step in which the video analysis server 33 determines whether there is an abandoned article in the train 10 using the image information received from the ground communication unit 31; a fifth step in which, when the video analysis server 33 detects the presence of an abandoned article, the video analysis server 33 generates an article abandoned notification indicating that there is an abandoned article; a sixth step in which the ground communication unit 31 sends the article abandoned notification to the onboard communication unit 13; a seventh step in which the onboard communication unit 13 receives the article abandoned notification;and an eighth step in which the on-board display unit 15, under control of the on-board control unit 14, displays contents of the article abandonment notification received by the on-board communication unit 13;

[0032] In this regard, the processor 91 is, for example, a central processing unit (CPU), a processing unit, a computing unit, a microprocessor, a microcomputer, a digital signal processor (DSP), or the like. Furthermore, the memory 92 is, for example, a non-volatile or volatile semiconductor memory such as a random access memory (RAM), a read-only memory (ROM), a flash memory, an erasable programmable ROM (EPROM), or an electrically erasable programmable ROM (EEPROM) (registered trademark); a magnetic disk, a floppy disk, an optical disk, a compact disk, a mini disk, a digital versatile disk (DVD), or the like.

[0033] Fig. Fig. 4 is a diagram illustrating an example of a configuration of the processing circuit of the train interior monitoring system 40 according to the first embodiment when a processing circuit 93 is implemented in a dedicated hardware element. The processing circuit 93 shown in Fig. 4 is, for example, a single circuit, a set of multiple circuits, a programmed processor, a parallel-programmed processor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or a combination thereof. Processing circuitry 93 may be implemented partially in a dedicated hardware element and partially by software or firmware. Thus, processing circuitry 93 may implement each functionality described above in a dedicated hardware element through software, firmware, or a combination thereof.

[0034] As described above, the train interior monitoring system 40 according to the present embodiment operates in such a manner that the onboard communication unit 13 of the train 10, under the control of the onboard control unit 14, transmits image information stored in the onboard video storage unit 12 to the ground base station 30 after the end of the operation of the train 10, which duration corresponds to the stop state of the train 10. In the ground base station 30, the video analysis server 33 determines whether there is an abandoned article in the train 10 using the image information transmitted from the onboard communication unit 13 of the train 10 and received by the ground communication unit 31 of the ground base station 30. If the video analysis server 33 detects an abandoned article, the ground communication unit 31 of the ground base station 30 transmits an article abandoned notification generated by the video analysis server 33 to the train 10.In train 10, the on-board display unit 15, under control of the on-board control unit 14, displays the contents of the article-left notification received by the on-board communication unit 13. This allows at least the driver or the conductor working in train 10 to recognize that there is an abandoned article in the vehicle indicated by car number information included in the article-left notification by checking the display contents on the on-board display unit 15, and thereby collect the abandoned article. Furthermore, during a run of train 10, the train interior monitoring system 40 does not transmit image information from train 10 to the ground base station 30, nor does it transmit the article-left notification from the ground base station 30 to train 10.Thus, the train interior monitoring system 40 can detect an abandoned article present in the train 10 while reducing the amount of communication data during a run of the train 10. Second embodiment.

[0035] In the first embodiment, each of the trains 10 (hereinafter simply referred to as the train 10) transmits image information stored in the onboard video storage unit 12 to the ground base station 30 after an operation of that train 10, which duration corresponds to a stop state of the train 10. A second embodiment will be described with respect to a case where the train 10 transmits image information stored in the onboard video storage unit 12 to the ground base station 30 when the train 10 makes a stop at a station, which duration corresponds to a stop state of the train 10.

[0036] In the second embodiment, the train interior monitoring system 40 is configured similarly to the train interior monitoring system 40 in the first embodiment, which is shown in Fig. 1 is illustrated. Fig. 5 is a flowchart illustrating an operation of the train interior monitoring system 40 according to the second embodiment. The flowchart of the second embodiment shown in Fig. 5 is different from that shown in Fig. 2 illustrated flowchart of the first embodiment in that a step S3 is replaced by a step S21.

[0037] In the second embodiment, after the process of step S2, the on-board control unit 14 determines whether the train 10 is making a stop at a station (step S21). As described above, the on-board control unit 14 controls operations of devices installed in the train 10. Accordingly, if, for example, the doors of the train 10 are open, the train interior monitoring system 40 can detect that the train 10 is making a stop at a station. If the train 10 is not making a stop at a station (step S21: No), the train interior monitoring system 40 returns to the process of operation in step S1. If the train 10 is making a stop at a station (step S21: Yes), the on-board control unit 14 controls the on-board communication unit 13 to transmit the image information stored in the on-board video storage unit 12 to the ground communication unit 31 of the ground base station 30.This means that the onboard communication unit 13 of the train 10 transmits the image information stored in the onboard video storage unit 12 to the ground communication unit 31 of the ground base station 30 (step S4). More specifically, this means that the onboard communication unit 13 of the train 10 transmits, to the ground communication unit 31 of the ground base station 30, the image information stored in the onboard video storage unit 12 during a period from arrival at a station of a previous stop to arrival at a station of a current stop of the train 10, under control of the onboard control unit 14. In the second embodiment, the train interior monitoring system 40 performs other operations similar to the train interior monitoring system 40 in the first embodiment.However, unlike the first embodiment, the train interior monitoring system 40 performs transmission and reception of image information, determination of whether there is an abandoned article, and the like every time the train 10 makes a stop at a station, which means that the train interior monitoring system 40 performs the operation of the method shown in FIG. Fig. 5 is repeated during operation of the train 10.

[0038] For example, in a case where train 10 is a long-distance train and a passenger who boarded at a station near the starting station of train 10 has left an item of their own on train 10, the train monitoring system 40 implementing the operation of the first embodiment will detect the left-behind article at the terminal station far from the starting station. This will take time and require additional labor in both cases where the passenger himself goes and collects the left-behind article and where the railway company operating trains 10 transports the left-behind article to a station where the passenger requests it.

[0039] On the other hand, in the second embodiment, even in a case where the train 10 is a long-distance train and a passenger who boarded the train 10 at a station near the starting station of the train 10 has left one of their items in the train 10, the train in-vehicle monitoring system 40 can detect the left-apart article at a station not far from the station where the passenger disembarked by performing the operation of the second embodiment. In this case, sending the article-abandoned notification by the train in-vehicle monitoring system 40 also to a station where the left-abandoned article can be collected allows a station employee who has verified the article-abandoned notification to collect the left-abandoned article in the train 10, even if the driver or conductor of the train 10 fails to collect the left-abandoned article.This can reduce the time and the extra labor compared to the case of the first embodiment in both cases where the passenger himself goes and collects the abandoned article and where the railway company operating the trains 10 transports the abandoned article to a station where the passenger wants it.

[0040] As described above, according to the present embodiment, the train interior monitoring system 40 operates in such a manner that the onboard communication unit 13 of the train 10, under control of the onboard control unit 14, transmits the image information stored in the onboard video storage unit 12 to the ground base station 30 when the train 10 has made a stop at a station, which duration corresponds to the stop state of the train 10. Thus, the train interior monitoring system 40 makes it possible to collect the abandoned article at a station relatively close to the location where the abandoned article was left, compared to the case of the first embodiment.

[0041] It should be noted that the train interior monitoring system 40 has been described such that the train 10 sends image information to the ground base station 30 each time the train 10 makes a stop at a station, but the operation is not limited thereto. In the train interior monitoring system 40, the train 10 could be configured to send image information to the ground base station 30 when a large number of passengers are expected to board and disembark at a station, such as a transfer station for another railway line, and when the stop time at that station is longer than a predetermined period of time. This means that the train 10 does not need to send image information to the ground base station 30 when the stop time at the station is shorter than a predetermined period of time. Third embodiment.

[0042] In the first embodiment, the train 10 transmits image information stored in the onboard video storage unit 12 to the ground base station 30 after the train 10 stops operating, which duration corresponds to the stop state of the train 10. The video analysis server 33 of the ground base station 30 determines whether there is an abandoned article using the image information. In this case, the video analysis server 33 of the ground base station 30 can further detect a passenger remaining on the train 10 that has finished operating through an operation similar to the previous operation.

[0043] In the third embodiment, the train interior monitoring system 40 is configured similarly to the train interior monitoring system 40 in the first embodiment, which is shown in Fig. 1 is illustrated. Fig. Fig. 6 is a flowchart illustrating an operation of the train interior monitoring system 40 according to the third embodiment. The flowchart of the second embodiment shown in Fig. 6 is different from the flowchart of the first embodiment shown in Fig. 2, in that steps S7 to S11 are replaced by steps S31 to S35.

[0044] In the third embodiment, after the process of step S6, the video analysis server 33 determines whether there is a passenger who has not yet disembarked from the train 10 using the image information stored in the ground video storage unit 32 (step S31). If there is no passenger who has not yet disembarked (step S31: No), the train interior monitoring system 40 terminates the operation of the Fig. 6. If there is a passenger who has not yet disembarked (step S31: Yes), the video analysis server 33 generates a passenger notification indicating that there is a passenger who has not yet disembarked (step S32). The passenger notification has contents similar to the contents of the article abandonment notification described in connection with the first embodiment. The ground communication unit 31 of the ground base station 30 transmits the passenger notification generated by the video analysis server 33 to the onboard communication unit 13 of the train 10 (step S33).

[0045] In train 10, the onboard communication unit 13 receives the passenger notification transmitted from the ground communication unit 31 of the ground base station 30 via the ground-to-vehicle network 20 (step S34). The onboard control unit 14 has the onboard display unit 15 display the contents of the passenger notification received by the onboard communication unit 13. This means that the onboard display unit 15 displays the contents of the passenger notification under the control of the onboard control unit 14 (step S35). If the onboard display unit 15 has a function of outputting a sound, the onboard display unit 15 may output a sound, such as an alarm, to alert the driver or conductor working in train 10 that a passenger notification has been received.In the third embodiment, the train interior monitoring system 40 performs other operations similar to the train interior monitoring system 40 in the first embodiment. However, in the third embodiment, the term "article abandonment notification" in . Fig. 1 as “passenger notification” and the sentence “image information corresponding to an abandoned article” in Fig. 1 is to be understood or read as “image information corresponding to a passenger.” The train interior monitoring system 40 performs the operation of the flowchart according to the third embodiment shown in Fig. 6, in parallel with the operation of the flowchart according to the first embodiment shown in Fig. 2 is illustrated.

[0046] It should be noted that, on train 10, at least the driver or the conductor working on train 10 could perform an operation to report that at least the driver or the conductor has verified the passenger notification, thereby causing train 10 to return an acknowledgment indicating that the passenger notification has been verified to the video analysis server 33 of ground base station 30. This allows video analysis server 33 to detect that the passenger notification has been verified. Furthermore, if no acknowledgment indicating that the passenger notification has been verified is returned from train 10 within a predetermined period of time, video analysis server 33 could generate a passenger notification again and cause ground communication unit 31 to transmit the passenger notification again.This allows the video analysis server 33 to increase the probability that the passenger notification will be recognized by the driver or conductor working on train 10.

[0047] As described above, the train interior monitoring system 40 according to the present embodiment operates in such a manner that the video analysis server 33 of the ground base station 30 determines whether there is a passenger who has not yet disembarked from the train 10 using the image information transmitted from the onboard communication unit 13 of the train 10 and received by the ground communication unit 31 of the ground base station 30. When the video analysis server 33 detects a passenger who has not yet disembarked, the ground communication unit 31 of the ground base station 30 transmits the passenger notification generated by the video analysis server 33 to the train 10. In the train 10, the onboard display unit 15, under control of the onboard control unit 14, displays contents of the passenger notification received by the onboard communication unit 13.This enables at least the driver or the conductor working in the train 10 to recognize that there is a passenger in the vehicle indicated by the car number information included in the passenger notification by checking display contents on the on-board display unit 15, and thereby protect the passenger left behind in the train 10.

[0048] The configurations described in the preceding embodiments are merely examples. These configurations could be combined with other known technologies, and the configurations of the different embodiments could be combined with each other. Furthermore, some of such configurations could be omitted and / or modified without departing from the spirit. List of reference symbols

[0049] 10a, 10b Train; 11 Surveillance camera; 12 On-board video storage unit; 13 On-board communication unit; 14 On-board control unit; 15 On-board display unit; 20 Ground-to-vehicle network; 30 Ground base station; 31 Ground communication unit; 32 Ground video storage unit; 33 Video analysis server; 34 Lost article management server; 40 Train interior surveillance system; 90, 93 Processing circuitry; 91 Processor; 92 Memory. QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] JP 2001-285842

[0003]

Claims

[1] Train interior monitoring system comprising: an onboard video storage unit for storing, as image information, video data and parameter information, the video data obtained by shooting an interior of a train using a surveillance camera, the parameter information representing a situation of obtaining the video data by shooting; an on-board control unit for controlling an operation of a device installed in or on the train; an on-board display unit for providing a display under control of the on-board control unit; an on-board communication unit for transmitting, under control of the on-board control unit, the image information stored in the on-board video storage unit to a ground communication unit when the train is in a stop state; the ground communication unit for receiving the image information sent from the onboard communication unit; and a video analysis server for determining whether there is an article left behind in the train using the image information received by the ground communication unit, wherein if the video analytics server detects a presence of the abandoned item, the video analytics server generates an abandoned item notification indicating that the abandoned item exists, the ground communication unit sends the article abandonment notification to the onboard communication unit, the on-board communication unit receives the item abandonment notification, and the on-board display unit, under control of the on-board control unit, displays a content of the article abandonment notification received by the on-board communication unit. [2] Train interior monitoring system according to claim 1, wherein the stop state of the train is a state in which an operation of the train has ended, and the on-board communication unit, under control of the on-board control unit, sends the image information stored in the on-board video storage unit during a period from a start of operation of the train to an end of operation of the train to the ground communication unit. [3] Train interior monitoring system according to claim 1, wherein the stop state of the train is a state in which the train makes a stop in a station, and the on-board communication unit, under control of the on-board control unit, sends the image information stored in the on-board video storage unit during a period from an arrival at a station of a previous stop of the train to an arrival at a station of a current stop of the train to the ground communication unit. [4] The train interior monitoring system according to any one of claims 1 to 3, wherein the article abandonment notification includes car number information indicating a vehicle constituting the train to enable identification of a location of the abandoned article in the parameter information corresponding to the video data of the abandoned article that has been captured. [5] The train interior monitoring system according to claim 4, wherein the article abandonment notification further comprises the video data of the abandoned article that was recorded. [6] Train interior monitoring system according to one of claims 1 to 5, further comprising: a lost item management server to store image information corresponding to the item left behind. [7] Train interior monitoring system according to claim 2, wherein the video analysis server further determines whether there is a passenger who has not yet disembarked from the train, and, if there is the passenger who has not yet disembarked from the train, the video analysis server generates a passenger notification indicating that there is the passenger who has not yet disembarked, the ground communication unit sends the passenger notification to the on-board communication unit, the on-board communication unit receives the passenger notification, and the on-board display unit, under control of the on-board control unit, displays a content of the passenger notification received by the on-board communication unit. [8] Train interior monitoring system comprising: a first step of storing, by an onboard video storage unit, as image information, video data and parameter information, the video data being obtained by shooting an interior of a train using a surveillance camera, the parameter information representing a situation of obtaining the video data by shooting; a second step, by an on-board communication unit, of transmitting, under control of an on-board control unit, the image information stored in the on-board video storage unit to a ground communication unit when the train is in a stop state, wherein the on-board control unit controls an operation of a device installed in or on the train; a third step, by the ground communication unit, of receiving the image information sent from the onboard communication unit; a fourth step, by a video analysis server, of determining whether there is an article left behind in the train using the image information received by the ground communication unit; a fifth step, by the video analysis server, of generating an item abandonment notification indicating that the abandoned item exists when the video analysis server detects a presence of the abandoned item; a sixth step, by the ground communication unit, of sending the article abandonment notification to the onboard communication unit; a seventh step, through the on-board communication unit, of receiving the article abandonment notification; and an eighth step, by an on-board display unit, of displaying, under control of the on-board control unit, a content of the article abandonment notification received by the on-board communication unit. [9] Train interior monitoring method according to claim 8, wherein the stop state of the train is a state in which an operation of the train has ended, and in the second step, the on-board communication unit, under control of the on-board control unit, sends the image information stored in the on-board video storage unit during a period from a start of operation of the train to an end of operation of the train to the ground communication unit. [10] Train interior monitoring method according to claim 8, wherein the stop state of the train is a state in which the train makes a stop in a station, and in the second step, the on-board communication unit, under control of the on-board control unit, sends the image information stored in the on-board video storage unit during a period from an arrival at a station of a previous stop of the train to an arrival at a station of a current stop of the train to the ground communication unit. [11] The train interior monitoring method according to any one of claims 8 to 10, wherein the article abandonment notification includes car number information indicating a vehicle constituting the train to enable identification of a location of the abandoned article in the parameter information corresponding to the video data of the abandoned article that has been captured. [12] The train interior monitoring method according to claim 11, wherein the article abandonment notification further comprises the video data of the abandoned article that has been recorded. [13] Train interior monitoring method according to one of claims 8 to 12, further comprising: a ninth step, through a lost item management server to store the image information corresponding to the abandoned item. [14] The train interior monitoring method according to claim 9, further comprising: a tenth step, by the video analysis server, to determine whether there is a passenger who has not yet disembarked from the train; an eleventh step, by the video analysis server, if there is the passenger who has not yet disembarked from the train, of generating a passenger notification indicating that there is the passenger who has not yet disembarked; a twelfth step, by the ground communication unit, of sending the passenger notification to the onboard communication unit; a thirteenth step, by the on-board communication unit, for receiving the passenger notification; and a fourteenth step, by the on-board display unit, of displaying, under control of the on-board control unit, a content of the passenger notification received by the on-board communication unit.

Images