Monitoring system, monitoring device, monitoring method, and program

Abstract

To provide a technique for enabling a user to appropriately recognize a state of a predetermined area of a monitoring object as an imaging range.SOLUTION: A monitoring system 1 includes: a monitoring camera 10 for photographing a platform of a station ST being a monitoring object; an acquisition section (e.g., information processing section 42, image analysis section 44, image analysis section 220, or image analysis section 48) for acquiring notification information 40 related to a state of the platform of the station ST; a display section 120 for displaying an image which expresses the state of the platform of the station ST based on the latest image to be output from the monitoring camera 10; and a notification section (e.g., display section 120, notification section 60, or sound output section 150) for notifying a user of the display section 120 of the notification information 40 to be acquired by the acquisition section.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to monitoring systems and the like. [Background technology]

[0002] For example, a monitoring system is known that has a display unit that displays an image from an imaging unit that captures an image of a predetermined area to be monitored (for example, a train platform) (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7045532 Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, for example, there are cases where an image of a specified area to be monitored is acquired from an imaging unit, notification information regarding the status of the specified area is acquired, and the notification information is superimposed on the image of the specified area and displayed.

[0005] However, depending on the time required for the process of acquiring the notification information, for example, the image of the predetermined area displayed on the display unit may lag behind the latest situation.

[0006] In view of the above-mentioned problems, an object of the present invention is to provide a technology that allows a user to properly grasp the situation of a predetermined area to be monitored as an imaging range. [Means for solving the problem]

[0007] In order to achieve the above object, in one embodiment of the present disclosure, an imaging unit that captures an image of a predetermined area to be monitored; an acquisition unit that acquires notification information regarding the status of the predetermined area; a display unit that displays an image representing the situation of the predetermined area based on the latest image output from the imaging unit; a notification unit that notifies a user of the display unit of the notification information acquired by the acquisition unit, A monitoring system is provided.

[0008] In another embodiment of the present disclosure, an acquisition unit that acquires notification information regarding the status of a predetermined area to be monitored; a first control unit that causes a display unit to display an image representing a situation of the predetermined area based on a latest image output from an imaging unit that images the predetermined area; a second control unit that notifies a user of the display unit of the notification information acquired by the acquisition unit through a notification unit; A monitoring device is provided.

[0009] In still another embodiment of the present disclosure, an acquisition step in which the monitoring device acquires notification information regarding the status of a predetermined area to be monitored; a first control step in which the monitoring device causes a display unit to display an image representing a situation in the predetermined area based on the latest image output from an imaging unit that images the predetermined area; a second control step of notifying a user of the display unit of the notification information acquired in the acquisition step through a notification unit, A monitoring method is provided.

[0010] In still another embodiment of the present disclosure, In the information processing device, an acquisition step of acquiring notification information regarding the status of a predetermined area to be monitored; a first control step of displaying an image representing a situation of the predetermined area on a display unit based on a latest image output from an imaging unit that images the predetermined area; a second control step of notifying a user of the display unit through a notification unit of the notification information acquired in the acquisition step; Programs are offered. [Effects of the Invention]

[0011] According to the above-described embodiment, it is possible to allow the user to properly understand the situation of a predetermined area to be monitored as an imaging range. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 illustrates a first example of a monitoring system. [Figure 2] FIG. 10 is a diagram illustrating a first example of a configuration for obtaining notification information. [Figure 3] FIG. 10 is a diagram illustrating a second example of a configuration for obtaining notification information. [Figure 4] FIG. 10 is a diagram illustrating a third example of a configuration for obtaining notification information. [Figure 5] FIG. 10 is a diagram illustrating a fourth example of a configuration for obtaining notification information. [Figure 6] 10A and 10B are diagrams showing specific examples of display contents on a display unit. [Figure 7] FIG. 10 is a diagram illustrating a second example of a monitoring system. [Figure 8] FIG. 10 is a diagram illustrating an example of a method for generating a display image. [Figure 9] FIG. 10 is a diagram illustrating a third example of a monitoring system. [Figure 10] FIG. 10 is a diagram illustrating a fourth example of a monitoring system. [Figure 11] FIG. 10 is a diagram illustrating a fifth example of a monitoring system. [Figure 12] FIG. 10 is a diagram illustrating a sixth example of a monitoring system. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, an embodiment will be described with reference to the drawings.

[0014] [First example of a monitoring system] A first example of a monitoring system 1 according to this embodiment will be described with reference to FIG.

[0015] FIG. 1 is a diagram illustrating a first example of a monitoring system 1. As shown in FIG.

[0016] The monitoring system 1 is used to monitor the status of the station ST (for example, the platform) and the status of the railway vehicle 100 entering the platform.

[0017] As shown in FIG. 1, the surveillance system 1 includes a surveillance camera 10, an encoder 12, a hub 14, an image generation unit 20, a communication unit 30, a communication unit 110, and a display unit 120.

[0018] The surveillance camera 10 is installed at station ST, captures images of the platform at station ST where the railcar 100 enters, and acquires images showing the state of the platform. The surveillance camera 10 is, for example, a monocular analog camera installed on the ceiling of the platform and outputs analog images. The surveillance camera 10 acquires images showing the state of the platform at station ST within its imaging range at predetermined imaging intervals (for example, approximately 1 / 30 seconds) during the business hours of station ST, and outputs the images to the encoder 12.

[0019] For example, as shown in Fig. 1, a plurality of surveillance cameras 10 are provided for a platform to be monitored. Alternatively, only one surveillance camera 10 may be provided for a platform to be monitored.

[0020] Encoder 12 is installed at station ST and converts analog images sequentially output from surveillance cameras 10 into digital images and outputs them to hub 14. When multiple surveillance cameras 10 are installed, an encoder 12 is installed for each surveillance camera 10, for example. Two or more surveillance cameras 10 may be connected to one encoder 12, and the encoder 12 may convert the analog images of each of the two or more surveillance cameras 10 into digital images. In this case, the number of encoders 12 installed is fewer than the number of surveillance cameras 10. The digital images output from encoder 12 are taken into image generation unit 20 via hub 14.

[0021] The image generation unit 20 is provided in the station ST, and generates an image to be displayed on the display unit 120 (hereinafter referred to as a "display image") at each predetermined processing cycle. The processing cycle of the image generation unit 20 is predetermined based on, for example, the refresh rate of the display unit 120. Specifically, when notification information 40 is input, the image generation unit 20 generates the display image by superimposing the notification information 40 on an image showing the status of the platform of the station ST (hereinafter referred to as a "platform status image") based on the latest output image of the encoder 12. On the other hand, when notification information 40 is not input, the image generation unit 20 outputs the latest platform status image as the display image.

[0022] When there is only one monitoring camera 10, the platform situation image is an output image of the encoder 12. When there are multiple monitoring cameras 10, the platform situation image is an output image of the encoder 12 corresponding to one or more monitoring cameras 10 selected from the multiple monitoring cameras 10. The monitoring camera 10 is selected, for example, through an input unit that is provided in the railway vehicle 100 and is capable of receiving input from a crew member of the railway vehicle 100. When two or more monitoring cameras 10 are selected, the platform situation image is, for example, a composite image in which the output images of the encoders 12 corresponding to each of the two or more monitoring cameras 10 are arranged in a predetermined format. When two or more monitoring cameras 10 are selected, the notification information 40 corresponding to the imaging range of each monitoring camera 10 is displayed superimposed on the portion of the platform situation image that corresponds to the output image of the encoder 12 corresponding to the target monitoring camera 10.

[0023] The functions of the image generation unit 20 may be realized by any hardware or any combination of hardware and software. The image generation unit 20 is mainly configured with a computer (information processing device) including, for example, a central processing unit (CPU), a memory device, an auxiliary storage device, and an input / output interface. As a result, the image generation unit 20 can realize predetermined functions by loading various programs installed in the auxiliary storage device into the memory device and executing them on the CPU. The information processing device may also include a high-speed arithmetic unit that operates in conjunction with the CPU. The high-speed arithmetic unit includes, for example, a graphics processing unit (GPU), a field-programmable gate array (FPGA), an application-specific integrated circuit (ASIC), etc.

[0024] The notification information 40 is information for notifying the user of the status of the platform within the imaging range of the monitoring camera 10 and of a predetermined location adjacent to the platform that is a blind spot within the imaging range of the monitoring camera 10. The predetermined location adjacent to the platform is, for example, a connecting passageway, stairs, ticket gates, etc. that lead to the platform within the premises of station ST. The notification information 40 will be described in detail later (see FIGS. 2 to 5).

[0025] The image generating unit 20 outputs the generated display image as an analog image or a digital image to the communication unit 30 in accordance with the communication standard for data transmission and reception in the communication units 30 and 110 at the subsequent stage.

[0026] The communication unit 30 is provided at the station ST and is communicatively connected to the communication unit 110 of the railway vehicle 100 via a predetermined communication line. The predetermined communication line is, for example, a short-range communication line based on a wireless communication standard such as WiFi or Bluetooth (registered trademark). The communication unit 30 transmits the display image output from the image generation unit 20 to the communication unit 110 of the railway vehicle 100.

[0027] The communication unit 110 is provided in the railway vehicle 100 and is communicably connected to the communication unit 30 of the station ST via a predetermined communication line. The communication unit 110 receives a display image transmitted from the communication unit 30 of the station ST.

[0028] Display unit 120 is provided on railway vehicle 100 so as to be visible to the crew of railway vehicle 100 (e.g., the driver or conductor), and displays display images sequentially received by communication unit 110. For example, display unit 120 displays the display images sequentially received by communication unit 110 as moving images based on a predetermined refresh rate. This allows the crew of railway vehicle 100 to check the latest state of the platform of station ST shown in the display image, and also to check notification information 40 included in the display image. Therefore, the crew of railway vehicle 100 can more appropriately perform tasks related to the operation of railway vehicle 100 while checking the display content of display unit 120 while railway vehicle 100 is stopped.

[0029] The display unit 120 is, for example, a monitor installed in the driver's cab or the conductor's cab of the railway vehicle 100. The display unit 120 may also be a portable terminal that is brought onto the railway vehicle 100 by a crew member such as the driver or conductor of the railway vehicle 100. The portable terminal is, for example, a tablet terminal. In this case, the portable terminal may include not only the display unit 120 but also the communication unit 110. This eliminates the need to introduce a new railway vehicle 100 equipped with the display unit 120 or to modify an existing railway vehicle 100, thereby reducing the introduction cost of the monitoring system 1.

[0030] As described above, in this example, the monitoring system 1 displays, via the display unit 120, a platform situation image based on the latest image output from the monitoring camera 10 and a display image including the notification information 40. This allows the monitoring system 1 to present the platform situation image based on the latest image output from the monitoring camera 10 to the crew of the railway vehicle 100, regardless of, for example, the time required for processing to acquire the notification information 40. This prevents a situation in which a delay in the platform situation image occurs due to the time required for processing to acquire the notification information 40, such as when the display image is generated after acquisition of both the output image from the monitoring camera 10 and the notification information 40 has been completed. Therefore, the monitoring system 1 allows the crew of the railway vehicle 100 to appropriately grasp the situation of the platform within the imaging range of the monitoring camera 10.

[0031] Furthermore, in this example, the monitoring system 1 displays, via the display unit 120 provided in the driver's cab of the railway vehicle 100, a display image including a platform status image based on the latest image output from the monitoring camera 10 and the notification information 40. This allows the driver of the railway vehicle 100 to check both the latest platform status and the notification information 40 via the display unit 120. Therefore, the monitoring system 1 can prevent the driver of the railway vehicle 100 from overlooking various pieces of notification information 40, compared to, for example, a case where the latest platform status and the notification information 40 need to be checked separately. Furthermore, the monitoring system 1 can reduce the monitoring burden on the driver of the railway vehicle 100 from the time the railway vehicle 100 stops at the platform until it departs. This is particularly suitable for a case where the railway vehicle 100 is operated by a single driver.

[0032] [First example of configuration for obtaining notification information] Next, a first example of a configuration for acquiring the notification information 40 will be described with reference to FIG.

[0033] FIG. 2 is a diagram showing a first example of a configuration for acquiring the notification information 40. As shown in FIG.

[0034] As shown in FIG. 2, in this example, the monitoring system 1 includes an information processing unit .

[0035] In this example, the notification information 40 includes information (message information) 40A representing messages from station staff at station ST, workers in the operation control room that operates the railway vehicle 100, etc. (hereinafter, for convenience, referred to as "station staff, etc.") regarding the platform within the imaging range of the surveillance camera 10.

[0036] The message information 40A includes, for example, information that assistance will be provided to users who use white canes or wheelchairs to get on and off the railway vehicle 100. The message information 40A may also include information that the interior of the railway vehicle 100 will be cleaned. The message information 40A may also include information that a person who has suddenly fallen ill will be rescued from the railway vehicle 100.

[0037] The information processing unit 42 is provided in the station ST, receives input of messages from station staff or the like, and outputs message information 40A corresponding to the input content. The information processing unit 42 may also be provided in a facility outside the station ST where a train control room for the railway vehicle 100 is provided. Messages from the station staff or the like are input, for example, through an input unit (e.g., a keyboard, a mouse, a touch panel, etc.) connected to or mounted on the information processing unit 42. Messages from the station staff or the like may also be input from a mobile terminal (e.g., a smartphone or a tablet terminal) carried by the station staff or the like, and the input content may be taken into the information processing unit 42 through a predetermined communication line (e.g., a short-range communication line based on a communication standard such as WiFi or Bluetooth).

[0038] The functions of the information processing unit 42 may be realized by any hardware or any combination of hardware and software. The information processing unit 42 is mainly configured with a computer (information processing device) including, for example, a CPU, a memory device, an auxiliary storage device, and an input / output interface. As a result, the information processing unit 42 can realize predetermined functions by loading various programs installed in the auxiliary storage device into the memory device and executing them on the CPU.

[0039] In this way, in this example, the monitoring system 1 can notify the user of the display unit 120, that is, the crew of the railway vehicle 100, of the message information 40A.

[0040] [Second example of configuration for obtaining notification information] Next, a second example of the configuration for acquiring the notification information 40 will be described with reference to FIG.

[0041] FIG. 3 is a diagram showing a second example of the configuration for acquiring the notification information 40. In FIG.

[0042] As shown in FIG. 3, in this example, the monitoring system 1 includes an image analysis unit 44.

[0043] In this example, the notification information 40 includes information 40B relating to a signal from a station staff member to a train crew member of the railway vehicle 100 (station staff signal information).

[0044] A signal from a station staff member is, for example, an action of the station staff member raising and waving a hand flag, a signal light, or the like above their head to the crew of the railway vehicle 100. The station staff signal information 40B includes, for example, information indicating whether or not a signal has been given from the station staff member to the crew of the railway vehicle 100. The station staff signal information 40B may also include information indicating the content (type) of a signal from the station staff member to the crew of the railway vehicle 100.

[0045] The image analysis unit 44 sequentially receives the output images of the encoder 12 (i.e., the output images of the surveillance camera 10 digitized by the encoder 12) via the hub 14. The image analysis unit 44 attempts to recognize a station staff signal from the latest output image of the encoder 12 at every predetermined processing cycle, and outputs station staff signal information 40B.

[0046] For example, the image analysis unit 44 recognizes a signal from a station staff member to a train crew member of the railway vehicle 100 from the output image of the surveillance camera 10 digitized by the encoder 12 through a series of processes (1) to (4) below.

[0047] (1) Human recognition processing The image analysis unit 44 performs processing to recognize people from the output image of the encoder 12.

[0048] For example, the image analysis unit 44 applies the trained model LM1 based on local features obtained from the image data and the image data itself to recognize a person in the image and estimate the area on the image that contains that person.

[0049] The trained model LM1 is obtained, for example, by performing machine learning (i.e., supervised learning) on ​​the base learning model M1 using the training data set TRD1. The trained model LM1 may be generated by performing machine learning on the learning model M1 in the image analysis unit 44, or may be generated by performing machine learning on the learning model M1 in an information processing device separate from the image analysis unit 44. For example, each piece of training data included in the training data set TRD1 is a combination of local features obtained from image data or the image data itself as input data, and data specifying an image portion containing a person in the image as output data. As a result, the trained model LM1 can recognize a person in the image using the local features obtained from the image data or the image data itself as input, and output data of a region (e.g., a rectangular region) containing the person in the image. For example, the trained model LM1 is mainly configured using a deep neural network (DNN), and the efficiency of DNN machine learning is improved by applying backpropagation (error backpropagation) based on the training data. The trained model LM1 may also include a U-Net capable of recognizing people from image data using image data as input.

[0050] Furthermore, the image analysis unit 44 may apply a rule-based algorithm such as pattern matching based on feature points and local feature amounts of image data to recognize people in the image.

[0051] (2) Person classification processing The image analysis unit 44 classifies people recognized by the person recognition processing. Specifically, the image analysis unit 44 may classify people recognized by the person recognition processing as either "station staff" or "people other than station staff." People other than station staff include, for example, general passengers as well as workers such as cleaners.

[0052] For example, the image analysis unit 44 applies the trained model LM2 based on local features obtained from the data of the image portion corresponding to the area including a person in the image and the data of that image portion to estimate which of multiple types of attributes the person included in the image portion corresponds to. The trained model LM2 corresponds to a classifier that classifies the person in the image portion as either a "station staff member" or a "person other than a station staff member."

[0053] The trained model LM2 is obtained, for example, by performing machine learning (i.e., supervised learning) on ​​the base learning model M2 using the training data set TRD2. The trained model LM2 may be generated by performing machine learning on the learning model M2 in the image analysis unit 44, or may be generated by performing machine learning on the learning model M2 in an information processing device separate from the image analysis unit 44. For example, each piece of training data included in the training data set TRD2 is a combination of local features obtained from image portion data containing a person or the image portion data itself as input data, and label data representing the attributes of the person included in the image portion as output data. As a result, the trained model LM2 can estimate the attributes of the person included in the image portion using the image features obtained from the image portion data containing a person or the image portion data itself as input, and output label data representing the attributes of the person included in the image portion. For example, the trained model LM2 is mainly configured using a DNN, and the efficiency of DNN machine learning is improved by applying backpropagation based on the training data. The trained model LM2 may also be a support vector machine (SVM).

[0054] Furthermore, the image analysis unit 44 may apply a rule-based algorithm such as pattern matching based on feature points and local feature amounts of data of a partial image including a person, to classify the attributes of people included in the partial image.

[0055] (3) Posture estimation processing The image analysis unit 44 estimates the posture state of a person based on the data of the image portion that includes the person classified as a "station staff" by the person classification process.

[0056] For example, the image analysis unit 44 estimates the position and orientation of each body part in an image portion that includes a person classified as a "station staff member" by the person classification process. The image analysis unit 44 may also estimate which of a plurality of predefined types of posture states the posture state of the person classified as a "station staff member" by the person classification process corresponds to.

[0057] For example, the image analysis unit 44 applies the trained model LM3 to estimate the posture state of a person included in the partial image data based on the local features obtained from the data of the image portion containing a person classified as a "station staff member" by the person classification process and the data of that image portion.

[0058] The trained model LM3 is obtained, for example, by performing machine learning (i.e., supervised learning) on ​​the base learning model M3 using the training data set TRD3. The trained model LM3 may be generated by performing machine learning on the learning model M3 in the image analysis unit 44, or may be generated by performing machine learning on the learning model M3 in an information processing device separate from the image analysis unit 44. For example, each piece of training data included in the training data set TRD3 is a combination of local features obtained from image data containing a person as input data or the image data itself, and data representing the posture of the person included in the image as output data. As a result, the trained model LM3 can estimate the posture of a person included in an image using the local features obtained from the image data containing a person or the image data itself as input, and output data representing the posture of the person. For example, the trained model LM3 is mainly configured using a DNN, and the efficiency of DNN machine learning is improved by applying backpropagation based on the training data. Furthermore, the trained model LM3 may be an SVM as a classifier when estimating which of multiple predefined postures the posture of a person included in an image corresponds to.

[0059] In addition, the image analysis unit 44 may apply a rule-based algorithm based on feature points, local features, etc. of data of an image including a person, to estimate which of multiple predefined types of posture states the posture state of a person included in the image corresponds to.

[0060] (4) Signal Recognition Processing The image analysis unit 44 recognizes the signaling behavior of the person classified as "station staff" toward the crew of the railway vehicle 100 based on the estimation result of the posture estimation process. The signaling behavior toward the crew of the railway vehicle 100 is, for example, the behavior of waving a flag or a signal light at a position higher than the shoulders or head. Specifically, the image analysis unit 44 recognizes the specific behavior of the person by determining whether the posture state of the person classified as "station staff" and changes over time represent the behavior of signaling toward the crew of the railway vehicle 100 based on the data representing the posture state of the person, which is the estimation result of the posture estimation process.

[0061] For example, the image analysis unit 44 determines whether or not a person classified as a "station staff" has signaled to the crew of the railway vehicle 100 based on a comparison between data representing the posture state of the person classified as a "station staff" and reference data representing posture states corresponding to signals given to the crew of the railway vehicle 100. The image analysis unit 44 may also determine whether or not a person has signaled to the crew of the railway vehicle 100 based on a comparison between data representing time-series changes in the posture state of the person classified as a "station staff" and reference data representing time-series changes in the posture state corresponding to signals given by the station staff to the crew of the railway vehicle 100. The image analysis unit 44 may also determine whether or not a signal has been given for each type of signal using reference data that is predefined for each type of signal. This allows the image analysis unit 44 to acquire the station staff signal information 40B.

[0062] The functions of the image analysis unit 44 may be realized by any hardware or any combination of hardware and software. The image analysis unit 44 is mainly configured with a computer (information processing device) including, for example, a CPU, a memory device, an auxiliary storage device, and an input / output interface. As a result, the image analysis unit 44 can realize its own functions by loading various programs installed in the auxiliary storage device into the memory device and executing them on the CPU. The information processing device may also include a high-speed arithmetic unit that operates in conjunction with the CPU. The high-speed arithmetic unit includes, for example, a GPU, an FPGA, an ASIC, etc.

[0063] In this way, in this example, the monitoring system 1 can notify the user of the display unit 120, that is, the train crew of the railway vehicle 100, of the station staff signal information 40B.

[0064] Furthermore, in this example, it may take a relatively long time to acquire the station staff signal information 40B based on the image output from the surveillance camera 10. Therefore, for example, if a display image is generated after acquisition of both the output image from the surveillance camera 10 and the station staff signal information 40B is completed, a delay may occur in the platform situation image in the display image due to the influence of the time required for processing to acquire the station staff signal information 40B.

[0065] In response to this, the monitoring system 1, as described above, displays, via the display unit 120, a platform status image based on the latest image output from the monitoring camera 10 and a display image including the notification information 40. This allows the monitoring system 1 to present the platform status image based on the latest image output from the monitoring camera 10 to the crew of the railway vehicle 100, regardless of, for example, the time required for processing to acquire the notification information 40. Therefore, the monitoring system 1 allows the crew of the railway vehicle 100 to appropriately understand the status of the platform within the imaging range of the monitoring camera 10.

[0066] [Third example of configuration for obtaining notification information] Next, a third example of the configuration for acquiring the notification information 40 will be described with reference to FIG.

[0067] FIG. 4 is a diagram showing a third example of a configuration for acquiring the notification information 40. In FIG.

[0068] As shown in FIG. 4, the monitoring system 1 includes a communication unit 46, a communication unit 210, and an image analysis unit 220.

[0069] In this example, unlike the second example (FIG. 3) described above, the station staff signal information 40B is generated in an external facility 200 of the station ST.

[0070] The communication unit 46 is provided in the station ST and is configured to be able to communicate bidirectionally with the communication unit 210 of the external facility 200 via a predetermined communication line. The predetermined communication line includes, for example, a mobile communication network, a satellite communication network, the Internet, etc. The communication unit 46 sequentially receives the output images of the encoder 12, specifically, the output images of the surveillance camera 10 digitized by the encoder 12, via the hub 14, and sequentially transmits the output images of the encoder 12 to the external facility 200. The communication unit 46 also receives station staff signal information 40B returned from the communication unit 210 of the external facility 200, and outputs the information to the image generation unit 20.

[0071] The communication unit 210 is configured to be able to communicate bidirectionally with the communication unit 46 of the station ST through a predetermined communication line. The communication unit 210 receives output images of the encoder 12 that are sequentially transmitted from the communication unit 46 of the station ST. The communication unit 210 also transmits station staff signal information 40B output from the image analysis unit 220 to the communication unit 46 of the station ST.

[0072] The image analysis unit 220 attempts to recognize a signal from a station staff member from the latest output image of the encoder 12, which is acquired from the communication unit 210, at each predetermined processing cycle, and outputs station staff signal information 40B. The function of the image analysis unit 220 is the same as that of the image analysis unit 44, and therefore a description of the function will be omitted.

[0073] The functions of the image analysis unit 220 may be realized by any hardware or any combination of hardware and software. The image analysis unit 220 is configured, for example, mainly with a computer (information processing device) including a CPU, a memory device, an auxiliary storage device, and an input / output interface. As a result, the image analysis unit 220 can realize predetermined functions by loading various programs installed in the auxiliary storage device into the memory device and executing them on the CPU. The information processing device may also include a high-speed calculation device that operates in conjunction with the CPU. The high-speed calculation device includes, for example, a GPU, an FPGA, an ASIC, etc. The image analysis unit 220 is, for example, a server device. The server device is, for example, an on-premise server or a cloud server. The server device may also be an edge server.

[0074] The external facility 200 does not have to be a specific facility. For example, if the image analysis unit 220 is a cloud server, the data center where the actual processing is performed may differ depending on the timing of the processing.

[0075] In this way, in this example, the monitoring system 1 can notify the user of the display unit 120, that is, the crew of the railway vehicle 100, of the station staff signal information 40B, similarly to the second example described above.

[0076] Furthermore, in this example, similar to the second example described above, it may take a relatively long time to acquire the station staff signal information 40B based on the image output from the monitoring camera 10. In particular, in this example, due to delays in communication between the station ST and the external facility 200, it may take even longer than in the second example described above to acquire the station staff signal information 40B.

[0077] In response to this, the monitoring system 1, as described above, displays a display image including a platform status image based on the latest image output from the monitoring camera 10 and the station staff signal information 40B through the display unit 120. In this way, the monitoring system 1 allows the crew of the railway vehicle 100 to properly understand the status of the platform within the imaging range of the monitoring camera 10.

[0078] [Fourth example of configuration for obtaining notification information] Next, a fourth example of the configuration for acquiring the notification information 40 will be described with reference to FIG.

[0079] FIG. 5 is a diagram showing a fourth example of the configuration for acquiring the notification information 40. In FIG.

[0080] As shown in FIG. 5, in this example, the surveillance system 1 includes a surveillance camera 16, an encoder 18, and an image analysis unit .

[0081] In this example, the notification information 40 includes information 40C relating to people rushing to board a train from a blind spot of the monitoring camera 10 (rushing boarding information).

[0082] The last-boarding information 40C includes information indicating whether or not there is a possibility of a person running onto a train from a blind spot of the monitoring camera 10. The last-boarding information 40C may also include information on a predicted value of the time required for a person who may run onto a train from a blind spot of the monitoring camera 10 to complete boarding the train 100 (hereinafter referred to as "predicted boarding completion time").

[0083] The surveillance camera 16 captures an image of a predetermined location adjacent to the platform PF within the imaging range of the surveillance camera 10, and acquires an image showing the state of the predetermined location. The surveillance camera 16 is, for example, a monocular analog camera that is installed on the ceiling of the predetermined location and outputs analog images. The surveillance camera 16 acquires an image showing the state of the predetermined location within its imaging range at a predetermined imaging interval (for example, approximately 1 / 30 seconds) during the business hours of the station ST, and outputs the image to the encoder 18.

[0084] The predetermined location in the imaging range of the surveillance camera 16 is, for example, a connecting passageway, staircase, ticket gate, etc. adjacent to the platform in the imaging range of the surveillance camera 10, as described above.

[0085] 5, a plurality of surveillance cameras 16 are provided for a platform that is the object of monitoring by the surveillance camera 10. Alternatively, only one surveillance camera 16 may be provided for a platform that is the object of monitoring by the surveillance camera 10.

[0086] The encoder 18 converts analog images sequentially output from the surveillance camera 16 into digital images and outputs them to the hub 14. When multiple surveillance cameras 16 are installed, an encoder 18 is provided for each surveillance camera 16. The digital images output from the encoder 18 are taken into the image analysis unit 48 via the hub 14.

[0087] The image analysis unit 48 attempts to recognize people based on the latest output image of the encoder 18 at each predetermined processing cycle. The method of recognizing people from image data may be the same as that of the image analysis unit 44 described above. Furthermore, when the image analysis unit 48 recognizes a person, it applies a known object tracking technique to track the time-series movement of the recognized person within the image capture range and obtains the movement direction D and movement speed V of the recognized person. Then, based on the movement direction D and movement speed V, the image analysis unit 48 detects from among the recognized people who are likely to run onto a train.

[0088] For example, the image analysis unit 48 determines that there is a possibility of a person rushing onto a train if the movement direction D of a person at a predetermined location adjacent to the platform within the imaging range of the monitoring camera 10 indicates that the person is heading toward the railcar 100 on the platform and the movement speed V is equal to or greater than a threshold value Vth. The threshold value Vth is predefined as a lower limit of the movement speed expected when a passenger rushes onto the train from a predetermined location adjacent to the platform within the imaging range of the monitoring camera 10. The threshold value Vth may be a fixed value or a variable value that can be set according to the situation or that can be changed by the user. Thus, the image analysis unit 48 can detect people who may rush onto a train from a predetermined location adjacent to the platform by evaluating the movement direction D and movement speed V of each person detected at a predetermined location adjacent to the platform within the imaging range of the monitoring camera 10. Therefore, the image analysis unit 48 can acquire rush-on boarding information 40C, including whether or not a person has rushed onto a train from a blind spot of the monitoring camera 10, based on the detection result of a person who may rush onto a train.

[0089] Furthermore, when there is a person who is likely to rush onto the railway vehicle 100 from a predetermined location adjacent to the platform within the imaging range of the surveillance camera 10, the image analysis unit 48 may calculate a predicted value of the time required for the person to complete their boarding (predicted boarding completion time) based on the moving speed V. This allows the image analysis unit 48 to acquire rushing boarding information 40C including the predicted boarding completion time of a person who is likely to rush onto the railway vehicle 100 from a blind spot of the surveillance camera 10.

[0090] In this way, in this example, the monitoring system 1 can notify the user of the display unit 120, i.e., the crew of the railway vehicle 100, of the rush-on boarding information 40C. This makes it possible for the monitoring system 1 to prevent the occurrence of an incident in which, for example, the crew of the railway vehicle 100 closes the doors without noticing the rush-on boarding, resulting in a passenger getting caught in the doors.

[0091] In addition, in this example, it may take a relatively long time to acquire the rush-boarding information 40C based on the image output from the monitoring camera 16.

[0092] In response to this, the monitoring system 1 displays a display image including the platform status image based on the latest image output from the monitoring camera 10 and the last-minute boarding information 40C, as described above. This allows the monitoring system 1 to allow the crew of the railway vehicle 100 to properly understand the status of the platform within the imaging range of the monitoring camera 10.

[0093] [Another example of configuration for obtaining notification information] Next, another example of the configuration for obtaining the notification information 40 will be described.

[0094] The configuration for obtaining the notification information 40 described above may be modified or changed as appropriate.

[0095] For example, the notification information 40 may include all or some of the contact information 40A, the station staff signal information 40B, and the rush-to-board information 40C. Therefore, the monitoring system 1 may selectively apply components suited to the information included in the notification information 40 from the first to fourth examples of the configurations for acquiring the notification information 40 described above.

[0096] In addition, in the third example of the configuration for acquiring the notification information 40 described above, the function of the encoder 12 may be arranged in the external facility 200. In this case, the analog image output from the surveillance camera 10 is transmitted from the communication unit 46 to the communication unit 210, and the analog image output from the surveillance camera 10 is converted into a digital image by the encoder arranged in the external facility 200.

[0097] In addition, in the fourth example of the configuration for acquiring the notification information 40 described above, the function of the image analysis unit 48 may be transferred to an external facility of the station ST, similar to the image analysis unit 220 in the third example. In this case, similar to the modified example of the third example described above, the function of the encoder 12 may be provided in the external facility.

[0098] [Example of what is displayed on the display] Next, a specific example of the display content of the display unit 120 will be described.

[0099] Fig. 6 is a diagram showing a specific example of the display content of display unit 120. Specifically, Fig. 6 includes Figs. 6A and 6B showing one example and another example of the display content of display unit 120.

[0100] <Station staff signal information> As shown in Figure 6A, in this example, the display unit 120 displays a platform status image 600 showing the latest state of the platform 602 at station ST based on the latest image from the surveillance camera 10, and images 610 and 612 corresponding to station staff signal information 40B superimposed on the platform status image 600.

[0101] The platform status image 600 shows a platform 602 at station ST, platform doors 604 installed on the platform 602, a railway vehicle 100 that has entered the platform 602 and is stopped there, and a station employee 606 on the platform 602. In this example, the station employee 606 is raising his hand above his shoulder to signal to the crew of the railway vehicle 100.

[0102] Image 610 is a rectangular frame representing the portion of the image in which station staff 606 is recognized by image analysis unit 44 within the imaging range of surveillance camera 10. This allows the crew of railway vehicle 100 to reliably recognize the presence of station staff 606 who is signaling.

[0103] Image 612 shows text information indicating that station staff 606 is signaling the crew of railway vehicle 100. In this example, the text information "Station staff signal" is drawn on image 612. This allows the crew of railway vehicle 100 to recognize that station staff 606 is signaling.

[0104] In this way, in this example, the crew of the railway vehicle 100 can grasp the latest situation of the platform 602 through the platform status image 600 on the display unit 120, and can also reliably grasp the signals of the station staff 606 through the images 610 and 612 on the display unit 120.

[0105] <Last-minute boarding information> As shown in FIG. 6B, in this example, the display unit 120 displays a platform status image 620 showing the latest state of the platform 622 at station ST based on the latest image from the surveillance camera 10, and an image 630 corresponding to the last-minute boarding information 40C superimposed on the platform status image 620.

[0106] The platform status image 620 shows a platform 622 at station ST, platform doors 624 installed on the platform 622, and a railway vehicle 100 that has entered the platform 622 and is stopped there.

[0107] Image 630 shows text information indicating that there is a possibility of someone rushing onto the train from a blind spot of surveillance camera 10. In this example, the text information "rushing onto the train" is drawn on image 630. This allows the crew of railway vehicle 100 to reliably recognize that there is a possibility of someone rushing onto the train from a blind spot that is not captured in platform status image 620.

[0108] In this way, in this example, the crew of the railway vehicle 100 can grasp the latest situation of the platform 622 from the platform status image 620 on the display unit 120, and can also reliably grasp the possibility of someone rushing to board the train from a blind spot of the platform status image 620 from the image 630 on the display unit 120.

[0109] [Second example of a monitoring system] Next, a second example of the monitoring system 1 according to this embodiment will be described with reference to FIG.

[0110] In the following, in this example, the same symbols will be used for configurations that are the same as or correspond to the first example of the monitoring system 1 described above, and the explanation will focus on the parts that are different from the first example described above, and explanations of the parts that are the same as or correspond to the first example described above may be omitted.

[0111] FIG. 7 is a diagram illustrating a second example of the monitoring system 1. As shown in FIG.

[0112] As shown in FIG. 7, in this example, the monitoring system 1 differs from the first example described above mainly in that an analog-digital (A / D) converter 13 and an image generating unit 50 are added.

[0113] The analog-to-digital converter 13 is provided at the station ST, and converts analog images sequentially output from the surveillance camera 10 into digital images and outputs them to the image generation unit 20. When multiple surveillance cameras 10 are provided, an analog-to-digital converter 13 is provided for each surveillance camera 10.

[0114] The image generation unit 50 generates, at each predetermined processing cycle, an image for chromakey compositing for superimposing the notification information 40 on a home status image based on the latest output image of the surveillance camera 10, and outputs the generated image as a digital image. The image for chromakey compositing is generated by superimposing an image representing the notification information 40 on a monochrome background. The image generation unit 50 may generate the image for chromakey compositing only when the notification information 40 is input, or may generate the image for chromakey compositing regardless of whether the notification information 40 is input. In the latter case, when the notification information 40 is not input, the image generation unit 50 generates an image for chromakey compositing with only a monochrome background.

[0115] The functions of the image generation unit 50 may be realized by any hardware or any combination of hardware and software. The image generation unit 50 is mainly configured with a computer (information processing device) including, for example, a CPU, a memory device, an auxiliary storage device, and an input / output interface. This allows the image generation unit 50 to realize predetermined functions by loading various programs installed in the auxiliary storage device into the memory device and executing them on the CPU. The information processing device may also include a high-speed arithmetic unit that operates in conjunction with the CPU. The high-speed arithmetic unit includes, for example, a GPU, an FPGA, an ASIC, etc.

[0116] As in the first example described above, the image generation unit 20 generates a display image at each predetermined processing cycle. In this example, the image generation unit 20 generates and outputs a display image by combining the latest digital image output from the analog-digital converter 13 with the latest chromakey compositing image output from the image generation unit 50. Specifically, the image generation unit 20 can generate a display image similar to that of the first example described above by combining the latest digital image output from the analog-digital converter 13 into the monochrome background portion of the chromakey compositing image. Furthermore, if the image generation unit 50 does not output a chromakey compositing image, the image generation unit 20 outputs the latest digital image output from the analog-digital converter 13 as the display image.

[0117] In this way, in this example, the monitoring system 1 converts the analog image of the monitoring camera 10 into a digital image at higher speed using the analog-to-digital converter 13. This allows the monitoring system 1 to further reduce delays in the image showing the latest state of station ST that is displayed on the display unit 120.

[0118] [How to generate images for display] Next, a method for generating a display image by the image generating unit 20 will be described with reference to FIG.

[0119] In the following, in this example, a method for generating a display image will be described on the premise that the second example of the monitoring system 1 is used.

[0120] Fig. 8 is a diagram illustrating an example of a method for generating a display image. Specifically, Fig. 8 includes Figs. 8A to 8C. Fig. 8A shows a digital image 800 output from the analog-to-digital converter 13. Fig. 8B shows a chromakey image 810 generated by the image generation unit 50. Fig. 8C shows a display image 820 generated by the image generation unit 20.

[0121] As shown in Fig. 8A, digital image 800 is a platform status image that shows the latest state of platform 802 within the imaging range of surveillance camera 10. Digital image 800 shows platform 802 at station ST, platform doors 804 installed on platform 802, railway vehicle 100 that has entered and is stopped at platform 802, and station staff 806 on platform 802. In this example, station staff 806 is raising his hand above his shoulder to signal to the crew of railway vehicle 100, as in the case of Fig. 6 described above.

[0122] As shown in FIG. 8B, a chromakey image 810 includes images 812 and 814 superimposed on a monochrome background image 811.

[0123] Image 812 is a rectangular frame that represents the image portion in which station employee 806 is recognized by image analysis unit 44 within the imaging range of surveillance camera 10.

[0124] Image 814 shows text information indicating that station staff 806 is signaling to the crew of railway vehicle 100. In this example, image 814 depicts the text information "Station staff signal."

[0125] Display image 820 is generated by combining digital image 800 with background image 811 of chromakey image 810. As a result, image generation unit 20 can generate display image 820 in the form of superimposing images 812 and 814 corresponding to station staff signal information 40B on digital image 800 showing the latest state of platform 802 of station ST, which is based on the latest output image of surveillance camera 10, as in the first example (FIG. 6A) described above.

[0126] [Third example of a monitoring system] Next, a third example of the monitoring system 1 according to this embodiment will be described with reference to FIG.

[0127] In the following, in this example, the same symbols will be used for configurations that are the same as or correspond to the first and second examples of the monitoring system 1 described above, and the explanation will focus on the parts that are different from the first and second examples described above, and explanations of the parts that are the same as or correspond to the first and second examples described above may be omitted.

[0128] FIG. 9 is a diagram illustrating a third example of the monitoring system 1. As shown in FIG.

[0129] As shown in FIG. 9, the monitoring system 1 differs from the second example described above mainly in that the monitoring camera 10 outputs digital images and the analog-to-digital converter 13 is omitted.

[0130] The surveillance camera 10 sequentially outputs digital images to the image generating unit 20 .

[0131] In the same manner as in the second example described above, the image generation unit 20 generates an image for display by combining the latest digital image output from the surveillance camera 10 with the latest digital image for chromakey generation output from the image generation unit 50. Furthermore, if the image for chromakey compositing is not output from the image generation unit 50, the image generation unit 20 outputs the latest digital image output from the surveillance camera 10 as the image for display.

[0132] In this way, in this example, the monitoring system 1 can display a platform status image showing the latest state of the platform at station ST on the display unit 120 without converting from analog format to digital format. This allows the monitoring system 1 to further reduce delays in the platform status image displayed on the display unit 120.

[0133] [Fourth example of a monitoring system] Next, a fourth example of the monitoring system 1 according to this embodiment will be described with reference to FIG.

[0134] In this example, the same or corresponding configurations as those in the first to third examples of the monitoring system 1 described above will be given the same symbols, and the explanation will focus on the parts that differ from the first to third examples described above, and explanations of the parts that are the same or corresponding to those in the first to third examples described above may be omitted.

[0135] FIG. 10 is a diagram illustrating a fourth example of the monitoring system 1. As shown in FIG.

[0136] As shown in FIG. 10, in this example, the monitoring system 1 differs from the first example described above mainly in that a notification unit 60 and a notification control unit 62 are added.

[0137] The notification unit 60 is provided in the station ST, and presents the notification information 40 under the control of the notification control unit 62. The notification unit 60 is, for example, a display or an electronic bulletin board. Specifically, the notification unit 60 is placed within the imaging range of the surveillance camera 10, with the display surface of the notification information 40 facing the lens of the surveillance camera 10. This allows the notification information 40 presented by the notification unit 60 to be included in the output image of the surveillance camera 10.

[0138] 10, for example, if there are multiple surveillance cameras 10, a notification unit 60 is provided for each surveillance camera 10. This allows the notification unit 60 to present notification information 40 regarding the imaging range of the corresponding surveillance camera 10, and to display the notification information 40 in the output image of the target surveillance camera 10.

[0139] The notification control unit 62 is provided in the station ST, controls the notification unit 60, and causes the notification unit 60 to display the notification information 40 input from outside. For example, if there are multiple surveillance cameras 10, the notification unit 60 corresponding to the surveillance camera 10 whose imaging range includes the platform area that is the target of the notification information 40 displays the notification information 40.

[0140] The image generation unit 20 generates a home situation image based on the output image of the encoder 12, which is input via the hub 14, and outputs the home situation image as an image for display. The home situation image includes the notification information 40 presented by the notification unit 60, which is installed within the imaging range of the surveillance camera 10. This allows the display unit 120 to display the home situation image including the notification information 40 presented by the notification unit 60.

[0141] As described above, in this example, the notification unit 60 is disposed within the imaging range of the monitoring camera 10 with its presentation surface facing the lens of the monitoring camera 10, and the notification unit 60 presents the notification information 40. This allows the monitoring system 1 to display, via the display unit 120, the latest platform status image including the notification information 40 presented by the notification unit 60. This prevents a situation in which a delay occurs in the platform status image due to the influence of the time required for processing to acquire the notification information 40, such as when a display image is generated after acquisition of both the output image of the monitoring camera 10 and the notification information 40 has been completed. Therefore, the monitoring system 1 allows the crew of the railway vehicle 100 to appropriately understand the status of the platform within the imaging range of the monitoring camera 10.

[0142] Furthermore, in this example, an existing system can be used for the components for displaying the output image of the surveillance camera 10 on the display unit 120. Therefore, the introduction cost of the surveillance system 1 can be reduced.

[0143] [5th ​​example of a monitoring system] Next, a fifth example of the monitoring system 1 according to this embodiment will be described with reference to FIG.

[0144] Hereinafter, in this example, the same symbols will be used for configurations that are the same as or correspond to the first to fourth examples described above, and the explanation will focus on the parts that are different from the first to fourth examples described above, and explanations of the parts that are the same as or correspond to the first to fourth examples described above may be omitted.

[0145] FIG. 11 is a diagram illustrating a fifth example of the monitoring system 1. As shown in FIG.

[0146] As shown in FIG. 11, in this example, the monitoring system 1 is different from the first example described above mainly in that a notification unit 60 and a notification control unit 62 are added, similar to the fourth example described above.

[0147] Unlike the fourth example described above, the notification unit 60 is installed on the platform within the imaging range of the monitoring camera 10, in a location visible to the crew inside the railway vehicle 100 (for example, the driver 130 in the driver's cab). This allows the crew of the railway vehicle 100, such as the driver 130, to check the latest platform status image through the display unit 120, while also checking the notification information 40 through the notification unit 60 installed on the platform.

[0148] As described above, in this example, the notification unit 60 is disposed on the platform within the imaging range of the monitoring camera 10 in a location visible to crew members such as the driver 130 inside the railway vehicle 100, and the notification unit 60 presents the notification information 40. This allows the monitoring system 1 to present the latest platform status image and the notification information 40 to the crew members of the railway vehicle 100 via the display unit 120 and the notification unit 60, respectively. This prevents a situation in which a delay occurs in the platform status image due to the influence of the time required for processing to acquire the notification information 40, such as when a display image is generated after acquisition of both the output image of the monitoring camera 10 and the notification information 40 has been completed. Therefore, the monitoring system 1 allows the crew members of the railway vehicle 100 to appropriately understand the status of the platform within the imaging range of the monitoring camera 10.

[0149] Furthermore, in this example, as in the fourth example described above, an existing system can be used for the components for displaying the output image of the surveillance camera 10 on the display unit 120. Therefore, the introduction cost of the surveillance system 1 can be reduced.

[0150] [Example 6 of a monitoring system] Next, a sixth example of the monitoring system 1 according to this embodiment will be described with reference to FIG.

[0151] Hereinafter, in this example, the same symbols will be used for configurations that are the same as or correspond to the first to fifth examples described above, and the explanation will focus on the parts that are different from the first to fifth examples described above, and explanations of the parts that are the same as or correspond to the first to fifth examples described above may be omitted.

[0152] FIG. 12 is a diagram illustrating a sixth example of the monitoring system 1. In FIG.

[0153] As shown in FIG. 12, in this example, the monitoring system 1 differs from the first example described above mainly in that a notification control unit 70, a communication unit 72, a communication unit 140, and a sound output unit 150 are added.

[0154] The notification control unit 70 is provided at the station ST and controls the sound output unit 150 of the railway vehicle 100 to output the notification information 40 input from the outside as sound from the sound output unit 150. Specifically, the notification control unit 70 generates sound data for outputting the notification information 40 as sound from the sound output unit 150, and outputs the sound data to the communication unit 72.

[0155] The sound data is, for example, audio data that uses sound to represent the content of the notification information 40. The sound data may also be sound data that represents the content of the notification information 40 by using different types of sound (for example, different types of alarms).

[0156] The communication unit 72 is provided at the station ST and is communicatively connected to the communication unit 140 of the railway vehicle 100 via a predetermined communication line. The predetermined communication line is, for example, a short-range communication line based on a wireless communication standard such as WiFi or Bluetooth (registered trademark). The communication unit 72 transmits sound data output from the notification control unit 70 to the communication unit 140 of the railway vehicle 100.

[0157] The communication unit 140 is provided in the railway vehicle 100 and is communicably connected to the communication unit 72 of the station ST via a predetermined communication line. The communication unit 140 receives sound data transmitted from the communication unit 72 of the station ST.

[0158] The sound output unit 150 is provided in the railway vehicle 100 and is configured to be able to output a sound that can be reliably heard by the crew of the railway vehicle 100 who is viewing the display unit 120. The sound output unit 150 is a speaker, alarm, buzzer, or the like. The sound output unit 150 acquires sound data received from the station ST by the communication unit 140, and outputs the notification information 40 by sound based on the sound data. This allows the crew of the railway vehicle 100 to check the notification information 40 by sound from the sound output unit 150 while checking the latest platform status image through the display unit 120.

[0159] As described above, when the display unit 120 is a mobile terminal, the function of the sound output unit 150 may be realized by a speaker or the like of the mobile terminal. The mobile terminal may also include the communication unit 140 in addition to the sound output unit 150. This eliminates the need to introduce a new railway vehicle 100 equipped with the sound output unit 150 or to modify an existing railway vehicle 100, thereby reducing the introduction cost of the monitoring system 1.

[0160] As described above, in this example, the railway vehicle 100 is provided with the sound output unit 150, which outputs the notification information 40 by sound to the crew of the railway vehicle 100. This allows the monitoring system 1 to present the latest platform status image to the crew of the railway vehicle 100 via the display unit 120, and also notify the crew of the railway vehicle 100 of the notification information 40 by sound via the sound output unit 150. This makes it possible to prevent a situation in which a delay occurs in the platform status image due to the influence of the time required for processing to acquire the notification information 40, such as when a display image is generated after acquisition of both the output image of the monitoring camera 10 and the notification information 40 has been completed. Therefore, the monitoring system 1 allows the crew of the railway vehicle 100 to appropriately understand the status of the platform within the imaging range of the monitoring camera 10.

[0161] Furthermore, in this example, as in the fourth and fifth examples described above, an existing system can be used as the component for displaying the output image of the surveillance camera 10 on the display unit 120. Therefore, the introduction cost of the surveillance system 1 can be reduced.

[0162] [Other embodiments] Next, another embodiment will be described.

[0163] The above-described embodiment may be modified or changed as appropriate. Hereinafter, examples in which the above-described embodiment is modified or changed may be referred to as "modified examples" for convenience.

[0164] For example, in the fourth to sixth examples of the monitoring system 1 described above, the encoder 12 may be replaced with the analog-to-digital converter 13, similar to the third example described above.

[0165] Also, in the above embodiment, the encoder 18 may be replaced by an analog-to-digital converter.

[0166] In the fourth to sixth examples of the above-described surveillance system 1 and their variations, the surveillance camera 10 may be a digital camera capable of outputting digital images. In this case, components such as the encoder 12 that convert analog images of the surveillance camera 10 into digital images are omitted.

[0167] In the above-described embodiment and its variations, the surveillance camera 16 may be a digital camera capable of outputting digital images. In this case, components such as the encoder 18 that convert analog images from the surveillance camera 16 into digital images are omitted.

[0168] Furthermore, in the above-described embodiment and their variations, image generation unit 20 may receive an analog image output from surveillance camera 10 as input, generate an analog display image, and display the analog display image on display unit 120. In this case, components for converting the analog image from surveillance camera 10, such as encoder 12 and analog-to-digital converter 13, into a digital image are omitted. In this case, in the second and third examples of surveillance system 1 described above and their variations, image generation unit 50 generates an analog image and outputs it to image generation unit 20.

[0169] In the above-described embodiment and its modifications, an image based on the output image of the surveillance camera 16 may be displayed on the display unit 120, showing the situation of a predetermined location that is in the blind spot of the surveillance camera 10.

[0170] Furthermore, in the first to third examples of the above-described monitoring system 1 and their variations, the functions of the information processing unit 42, image analysis unit 44, and image analysis unit 48 and the functions of the image generation unit 20 may be realized by a single computer (information processing device).

[0171] In the second and third examples of the monitoring system 1 described above and their modifications, the functions of the image generating unit 50 and the image generating unit 20 may be realized by one computer (information processing device).

[0172] Furthermore, in the first to fourth examples of the monitoring system 1 described above and their modified examples, a display unit having the same functions as the display unit 120 may be installed on the platform of station ST instead of or in addition to the display unit 120. In this way, the monitoring system 1 allows station staff and the like on the platform to properly understand the situation on the platform within the imaging range of the monitoring camera 10 through the display unit installed on the platform.

[0173] Furthermore, in the fifth example of the monitoring system described above and its variations, instead of or in addition to the display unit 120 and the notification unit 60, a display unit having the same functions as the display unit 120 may be installed on the platform of station ST, and a notification unit having the same functions as the notification unit 60 may be installed in a position visible from a position where the display unit on the platform is viewed by station staff or the like. In this way, the monitoring system 1 allows station staff or the like on the platform to properly understand the situation on the platform within the imaging range of the monitoring camera 10 through the display unit and notification unit installed on the platform.

[0174] Furthermore, in the sixth example of the monitoring system described above and its variations, a display unit and a sound output unit having the same functions as the display unit 120 and the sound output unit 150 may be installed on the platform of station ST instead of or in addition to the display unit 120 and the sound output unit 150. In this way, the monitoring system 1 allows station staff and the like on the platform to properly understand the situation on the platform within the imaging range of the monitoring camera 10 through the display unit and the sound output unit installed on the platform.

[0175] Furthermore, in the second and third examples and their variations of the above-mentioned monitoring system 1, when the notification information 40 includes station staff signal information 40B or rush-to-board information 40C, the function of the image generation unit 50 may be transferred to an external facility 200 where the image analysis unit 220 is installed or an external facility where an image analysis unit corresponding to the image analysis unit 48 is installed.

[0176] Furthermore, the technical concept of the monitoring system 1 of the above-described embodiment and its variations may be applied to a monitoring system that allows a user to monitor a specific area based on images from a monitoring camera that captures the specific area other than the platform of station ST.

[0177] [Effect] Next, the operations of the monitoring system, monitoring device, monitoring method, and program according to this embodiment will be described.

[0178] In a first aspect of this embodiment, the surveillance system includes an imaging unit, an acquisition unit, a display unit, and a notification unit. The surveillance system is, for example, the above-described surveillance system 1. The imaging unit is, for example, the above-described surveillance camera 10. The acquisition unit is, for example, the above-described information processing unit 42, image analysis unit 44, image analysis unit 220, communication unit 46, or image analysis unit 48. The display unit is, for example, the above-described display unit 120. The notification unit is, for example, the above-described display unit 120, notification unit 60, or sound output unit 150. Specifically, the imaging unit captures an image of a predetermined area of ​​the surveillance target. The predetermined area of ​​the surveillance target is, for example, the platform of the above-described station ST. The acquisition unit acquires notification information regarding the status of the predetermined area. The notification information is, for example, the above-described notification information 40. The display unit displays an image representing the status of the predetermined area based on the latest image output from the imaging unit. The notification unit then notifies the user of the display unit of the notification information acquired by the acquisition unit.

[0179] In addition, in a first aspect of this embodiment, the monitoring device may include an acquisition unit, a first control unit, and a second control unit. The first control unit is, for example, the image generation unit 20 described above. The second control unit is, for example, the image generation unit 20, the notification control unit 62, or the notification control unit 70 described above. The acquisition unit acquires notification information regarding the status of a predetermined area of ​​the monitoring target. The first control unit causes a display unit to display an image representing the status of the predetermined area based on the latest image output from an imaging unit that captures the predetermined area. The second control unit then notifies the user of the display unit of the notification information acquired by the acquisition unit through the notification unit.

[0180] In addition, in a first aspect of this embodiment, a monitoring device may execute a monitoring method. Specifically, the monitoring method includes an acquisition step, a first control step, and a second control step. More specifically, in the acquisition step, the monitoring device acquires notification information regarding the status of a predetermined area of ​​a monitoring target. Furthermore, in the first control step, the monitoring device displays an image representing the status of the predetermined area on a display unit based on the latest image output from an imaging unit that captures the predetermined area. Then, in the second control step, the notification information acquired in the acquisition step is notified to a user of the display unit via a notification unit.

[0181] In addition, in a first aspect of this embodiment, a program may be executed by an information processing device. Specifically, the program causes the information processing device to execute an acquisition step, a first control step, and a second control step. More specifically, in the acquisition step, notification information regarding the status of a predetermined area of ​​a monitoring target is acquired. Furthermore, in the first control step, an image representing the status of the predetermined area is displayed on a display unit based on the latest image output from an imaging unit that captures the predetermined area. Then, in the second control step, the notification information acquired in the acquisition step is notified to a user of the display unit via a notification unit.

[0182] For example, when an image of a specified area is output from the imaging unit and notification information is superimposed on the image of the specified area after acquisition of the notification information is completed, depending on the time required for the process of acquiring the notification information, the image of the specified area displayed on the display unit may be delayed relatively significantly from the latest situation.

[0183] In contrast to this, in this embodiment, a monitoring system, monitoring device, or information processing device (hereinafter referred to as "monitoring system, etc.") can display an image showing the latest status of a predetermined area on a display unit, while notifying a user of the display unit of notification information regarding the status of the predetermined area. Therefore, the monitoring system, etc. can allow a user to appropriately grasp the status of the predetermined area of ​​the monitoring target as an imaging range.

[0184] In a second aspect of this embodiment, based on the first aspect described above, the notification unit may be the same as the display unit. The display unit may simultaneously display an image representing the status of the predetermined area based on the latest image output from the imaging unit and the notification information acquired by the acquisition unit. In other words, the second control unit may be the same as the first control unit, and the first control unit may simultaneously display on the display unit an image representing the status of the predetermined area based on the latest image output from the imaging unit and the notification information acquired by the acquisition unit.

[0185] This allows the monitoring system or the like to present to the user, via the display unit, an image showing the latest status of the specified area and notification information regarding the status of the specified area as the imaging range of the imaging unit.

[0186] Furthermore, in a third aspect of this embodiment, based on the second aspect described above, the monitoring system or the like may include an image generation unit that generates an image by superimposing notification information acquired by the acquisition unit on an image representing the status of the predetermined area based on the latest image output from the imaging unit. The image generation unit is, for example, the image generation unit 20 described above. The display unit may display the image output from the image generation unit. In other words, the first control unit may generate an image by superimposing notification information acquired by the acquisition unit on an image representing the status of the predetermined area based on the latest image output from the imaging unit, and display the image on the display unit.

[0187] This allows the monitoring system or the like to present to the user, via the display unit, the latest image output from the imaging unit and notification information regarding the status of a predetermined area as the imaging range of the imaging unit.

[0188] In addition, in a fourth aspect of this embodiment, based on the second aspect described above, the monitoring system or the like may include an image synthesis unit. The image synthesis unit is, for example, the image generation unit 20 described above. Specifically, the image synthesis unit may synthesize an image including notification information acquired by the acquisition unit with an image representing the status of the predetermined area based on the latest image output from the imaging unit. Then, the display unit may display the image output from the image synthesis unit. In other words, the first control unit may synthesize an image including notification information acquired by the acquisition unit with an image representing the status of the predetermined area based on the latest image output from the imaging unit, and display the synthesized image on the display unit.

[0189] This allows the monitoring system or the like to present to the user, via the display unit, the latest image acquired by the imaging unit and notification information regarding the status of a predetermined area as the imaging range of the imaging unit.

[0190] In addition, in a fifth aspect of this embodiment, based on the fourth aspect described above, the imaging unit may output an analog image. The image composition unit may then combine the analog image including the notification information acquired by the acquisition unit with the latest analog image output from the imaging unit. In other words, the first control unit may combine the analog image including the notification information acquired by the acquisition unit with the latest analog image output from the imaging unit, and display the combined image on the display unit.

[0191] This eliminates the need for the monitoring system to convert the analog image from the imaging unit into a digital image, thereby reducing the delay between the image output from the imaging unit and its display on the display unit. This allows the monitoring system to more appropriately grasp the situation in the specified area of ​​the monitoring target, which serves as the imaging range.

[0192] In a sixth aspect of the present embodiment, based on the first aspect described above, the notification unit may be disposed within the imaging range of the imaging unit. The notification unit is, for example, the notification unit 60 described above (see FIG. 10).

[0193] This allows the monitoring system or the like to output an image of a predetermined area showing notification information from the imaging unit, and therefore the monitoring system or the like can present to the user, via the display unit, the latest image acquired by the imaging unit and notification information relating to the status of the predetermined area as the imaging range of the imaging unit.

[0194] In addition, in a seventh aspect of the present embodiment, based on the first aspect described above, the notification unit may be installed in a location visible to a user of the display unit and display the notification information acquired by the acquisition unit. The notification unit is, for example, the above-mentioned notification unit 60 (see FIG. 11).

[0195] This allows the monitoring system, etc. to present the latest image output from the imaging unit and notification information regarding the status of a specified area as the imaging range of the imaging unit to the user via the display unit and notification unit, respectively.

[0196] In an eighth aspect of the present embodiment, based on the first aspect described above, the notification unit may notify the user of the display unit of the notification information acquired by the acquisition unit by sound. The notification unit is, for example, the sound output unit 150 described above.

[0197] This allows the monitoring system or the like to display the latest image output from the imaging unit on the display unit, while notifying the user of the display unit of notification information regarding the status of a specified area by sound.

[0198] In a ninth aspect of the present embodiment, based on any one of the first to eighth aspects described above, the acquisition unit may acquire notification information regarding the status of the predetermined area based on the latest image output from the imaging unit. The acquisition unit is, for example, the image analysis unit 44, the image analysis unit 220, or the image analysis unit 48 described above.

[0199] When notification information is acquired based on the latest image acquired from the imaging unit, it may take some time to process the notification information. Therefore, for example, when an image of a predetermined area output from the imaging unit is acquired, notification information is acquired from the image, and the notification information is displayed superimposed on the image of the predetermined area, the image of the predetermined area displayed on the display unit may be delayed relatively significantly from the latest situation.

[0200] In contrast to this, in this embodiment, the monitoring system or the like can display the latest image output from the imaging unit on the display unit while notifying the user of the display unit of notification information regarding the status of a predetermined area, so that the monitoring system or the like can allow the user to appropriately understand the status of the predetermined area of ​​the monitoring target as the imaging range.

[0201] In a tenth aspect of the present embodiment, based on any one of the first to ninth aspects described above, the imaging unit may capture an image of a station platform as the predetermined area. The display unit may be mounted on or carried into a driver's seat of a railway vehicle stopped at the station platform. The railway vehicle is, for example, the railway vehicle 100 described above.

[0202] This allows the monitoring system etc. to assist the driver of the railway vehicle in understanding the situation on the platform of station ST. In particular, the monitoring system etc. can more suitably assist the driver of the one-man operated railway vehicle 100 in understanding the situation on the platform of station ST.

[0203] Although the embodiments have been described in detail above, the present disclosure is not limited to such specific embodiments, and various modifications and variations are possible within the scope of the gist described in the claims. [Explanation of symbols]

[0204] 1. Surveillance System 10. Surveillance Cameras 12 Encoders 13 Analog-to-Digital Converter 14 Hub 16. Surveillance Cameras 18 Encoders 20 Image generation unit 30 Communications Department 40 Notification Information 40A Notice Information 40B Station staff signal information 40C Last-minute boarding information 42 Information Processing Department 44 Image analysis unit 46 Communications Department 48 Image Analysis Unit 50 Image generation unit 60 Notification Department 62 Notification control section 70 Notification control section 72 Communications Department 100 railcars 110 Communications Department 120 Display section 130 Driver 140 Communications Department 150 Sound output unit 200 External Facilities 210 Communications Department 220 Image Analysis Unit

Claims

1. an imaging unit that captures an image of a predetermined area to be monitored; an acquisition unit that acquires notification information regarding the status of the predetermined area; a display unit that displays an image representing the situation of the predetermined area based on the latest image output from the imaging unit; a notification unit that notifies a user of the display unit of the notification information acquired by the acquisition unit, Surveillance system.

2. the notification unit is the same as the display unit, the display unit simultaneously displays an image showing the situation of the predetermined area based on the latest image output from the imaging unit and the notification information acquired by the acquisition unit. The monitoring system of claim 1 .

3. an image generating unit that generates an image by superimposing notification information acquired by the acquiring unit on an image that represents a situation of the predetermined area based on the latest image output from the imaging unit, The display unit displays the image output from the image generation unit. The monitoring system of claim 2 .

4. an image combining unit that combines an image including the notification information acquired by the acquisition unit with an image representing a situation of the predetermined area based on a latest image output from the imaging unit, the display unit displays the image output from the image synthesis unit. The monitoring system of claim 2 .

5. the imaging unit outputs an image in analog format; the image synthesis unit synthesizes an analog image including the notification information acquired by the acquisition unit with the latest image output from the imaging unit. The monitoring system of claim 4.

6. the notification unit is disposed within an imaging range of the imaging unit; The monitoring system of claim 1 .

7. the notification unit is installed in a location visible to a user of the display unit, and displays the notification information acquired by the acquisition unit. The monitoring system of claim 1 .

8. the notification unit notifies the user of the display unit of the notification information acquired by the acquisition unit by sound. The monitoring system of claim 1 .

9. the acquisition unit acquires notification information regarding a situation in the predetermined area based on the latest image output from the imaging unit. A monitoring system according to any one of claims 1 to 8.

10. The imaging unit captures an image of a station platform as the predetermined area, The display unit is mounted on or brought into a driver's seat of a railway vehicle stopping at a platform of the station. A monitoring system according to any one of claims 1 to 8.

11. an acquisition unit that acquires notification information regarding the status of a predetermined area to be monitored; a first control unit that causes a display unit to display an image representing a situation of the predetermined area based on a latest image output from an imaging unit that images the predetermined area; a second control unit that notifies a user of the display unit of the notification information acquired by the acquisition unit through a notification unit; Monitoring equipment.

12. an acquisition step in which the monitoring device acquires notification information regarding the status of a predetermined area to be monitored; a first control step in which the monitoring device causes a display unit to display an image representing a situation in the predetermined area based on the latest image output from an imaging unit that images the predetermined area; a second control step of notifying a user of the display unit of the notification information acquired in the acquisition step through a notification unit, Monitoring method.

13. In the information processing device, an acquisition step of acquiring notification information regarding the status of a predetermined area to be monitored; a first control step of displaying an image representing a situation of the predetermined area on a display unit based on a latest image output from an imaging unit that images the predetermined area; a second control step of notifying a user of the display unit through a notification unit of the notification information acquired in the acquisition step; program.

Images