Monitoring device, monitoring method, and program

JPWO2023209782A5Active Publication Date: 2025-01-06NEC CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2024517635
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-10-17
Publication Date
2025-01-06
Estimated Expiration
2042-04-25

AI Technical Summary

Technical Problem

Current monitoring technologies for unmanned public transportation stations do not effectively ensure the safety and security of passengers, particularly in preventing criminal acts and managing passenger flow efficiently.

Method used

A monitoring device and method that acquires the estimated arrival time of public transportation and uses this information to control camera settings and image processing frequency at boarding stations, adjusting monitoring intensity based on passenger presence and arrival times to enhance security and safety.

Benefits of technology

This approach efficiently and effectively ensures the safety and security of passengers at unmanned stations by dynamically adjusting monitoring intensity, reducing costs while improving response to potential threats and managing passenger flow.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

This monitoring apparatus (100) comprises: a timetable acquisition unit (102) which acquires an estimated arrival time of a public transportation means at a station for said public transportation means; and a control unit (104) which, using the acquired estimated arrival time, controls a camera installed at the station and / or the processing frequency of a first image generated by said camera.
Need to check novelty before this filing date? Find Prior Art

Description

Monitoring device, monitoring method, and recording medium

[0001] The present invention relates to a monitoring device, a monitoring method, and a recording medium.

[0002] In recent years, labor-saving measures have been implemented at public transportation platforms, creating a need to ensure the safety and security of passengers at these platforms. Patent Document 1 describes a support device for ensuring operational safety, including monitoring station platforms and responding to falls, which were previously the work of station staff. The device in this document is equipped with an infrared sensor on the tracks, and when a passenger falls from a platform, a special light-emitting signal is activated to warn the driver of an approaching train of the danger. A push button is also installed on the platform, which can also be used to light up the special light-emitting signal from the platform to warn of the danger.

[0003] Patent Document 2 describes a remote station monitoring system that reduces the time and effort required by operators to start and stop station equipment and enables reliable remote operation. In this system, item files indicating the start and end of shift control for each piece of equipment (automatic ticket gates, automatic ticket vending machines, automatic fare adjustment machines, elevators, escalators, electric shutters, etc.) at an unmanned station are associated with times on a day-by-day basis and stored as schedule data in a control terminal at a central station. When the time set in the schedule data arrives, the control terminal controls the equipment corresponding to that time in accordance with the schedule data. This control is performed by transmitting operation codes not only to the equipment within the station itself but also to various equipment at local stations via a local area network (LAN). The system then monitors whether the control has been performed as specified in the schedule data, and if not, retries the operation.

[0004] Patent Document 3 describes a monitoring system that displays images of unmanned stations captured by a monitoring camera on a monitor of a central operating device. In normal mode, the images of each station are automatically switched at predetermined time intervals, and in conjunction with an event corresponding to the arrival of a train at the unmanned station, the image of that station is switched and displayed on the monitor, and after a certain period of time, the display returns to normal switching mode. This makes it possible to automatically display images around the time of the arrival of a train, which is particularly important for the center to monitor closely.

[0005] Japanese Patent Application Laid-Open No. 2002-362365 Japanese Patent Application Laid-Open No. 2000-217162 Japanese Patent Application Laid-Open No. 2002-238046

[0006] The technologies described in the above-mentioned patent documents relate to safe train operation, such as detecting objects that have fallen onto the tracks, controlling equipment at unmanned stations, and strengthening surveillance before and after train arrival. For this reason, the technologies described in the above-mentioned patent documents are not intended to protect passenger safety from criminal acts in the space known as an "unmanned station." In response to this, the present inventor has considered ways to ensure the safety and security of passengers at unmanned stations.

[0007] In view of the above-mentioned problems, one example of an object of the present invention is to provide a monitoring device, a monitoring method, and a recording medium that ensure the safety and security of users of unmanned boarding and alighting stations efficiently and effectively at low cost.

[0008] According to one aspect of the present invention, there is provided a monitoring device comprising: a timetable acquisition means for acquiring the estimated arrival time of a public transportation means at a stop for the public transportation means; and a control means for using the estimated arrival time to control at least one of a camera installed at the stop and a processing frequency of a first image generated by the camera.

[0009] According to one aspect of the present invention, there is provided a monitoring method in which one or more computers obtain the estimated arrival time of a public transportation means at a stop for the public transportation means, and use the estimated arrival time to control at least one of a camera installed at the stop and a processing frequency of a first image generated by the camera.

[0010] According to one aspect of the present invention, there is provided a computer-readable recording medium storing a program for causing a computer to execute the following steps: a procedure for obtaining the estimated arrival time of a public transportation means at a stop for the public transportation means; and a procedure for using the estimated arrival time to control at least one of a camera installed at the stop and a processing frequency of a first image generated by the camera.

[0011] Another aspect of the present invention may be a program that causes at least one computer to execute the method of the above aspect, or a computer-readable recording medium having such a program recorded thereon. This recording medium includes a non-transitory tangible medium. This computer program includes computer program code that, when executed by a computer, causes the computer to implement the monitoring method on a monitoring device.

[0012] Any combination of the above components, and any transformation of the present invention into a method, device, system, recording medium, computer program, etc., are also valid aspects of the present invention.

[0013] Furthermore, the various components of the present invention do not necessarily have to be independent entities, but may be formed as a single member by multiple components, one component may be formed from multiple components, one component may be part of another component, or part of one component may overlap with part of another component, etc.

[0014] Furthermore, although the method and computer program of the present invention describe a number of steps in a sequential order, the order in which the steps are described does not limit the order in which the steps are executed. Therefore, when implementing the method and computer program of the present invention, the order of the steps can be changed as long as it does not cause any problems in terms of the content.

[0015] Furthermore, the multiple steps of the method and computer program of the present invention are not limited to being executed at different times, and therefore, a step may occur while another step is being executed, or the execution timing of a step may partially or completely overlap with the execution timing of another step, etc.

[0016] According to one aspect of the present invention, a monitoring device, a monitoring method, and a recording medium are provided that ensure the safety and security of users of unmanned boarding and alighting stations efficiently and effectively at low cost.

[0017] 1 is a diagram illustrating an overview of a monitoring device according to an embodiment. FIG. 2 is a flowchart illustrating an example of operation of the monitoring device according to the embodiment. FIG. 3 is a diagram conceptually illustrating the system configuration of a monitoring system 1 according to an embodiment. FIG. 4 is a block diagram illustrating an example of the hardware configuration of a computer that realizes the monitoring device according to an embodiment. FIG. 5 is a diagram illustrating an example of the data structure of camera information. FIG. 6 is a diagram illustrating an example of control of the timing of imaging of a camera by a control unit of the monitoring device according to an embodiment. FIG. 7 is a functional block diagram illustrating an example of the logical configuration of the monitoring device according to an embodiment. FIG. 8 is a diagram illustrating an example of a monitoring screen displayed on a display device. FIG. 9 is a flowchart illustrating an example of operation of the monitoring device according to an embodiment. FIG. 10 is a flowchart illustrating an example of detailed steps of control processing by a control unit of the monitoring device according to an embodiment. FIG. 11 is a functional block diagram illustrating an example of the logical configuration of the monitoring device according to an embodiment. FIG. 12 is a diagram conceptually illustrating the system configuration of a monitoring system 1 according to an embodiment. FIG. 13 is a flowchart illustrating an example of detailed steps of control processing by a control unit of the monitoring device according to an embodiment. FIG. 14 is a functional block diagram illustrating an example of the logical configuration of the monitoring device according to an embodiment. It is a diagram showing an example of a display of a monitoring screen.It is a diagram showing an example of a display of a monitoring screen.It is a diagram showing an example of a data structure of priority order information and level-based control information ...

[0018] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all drawings, similar components are designated by similar reference numerals, and their description will be omitted as appropriate. In addition, in the following drawings, configurations of parts that are not related to the essence of the present invention are omitted and are not shown.

[0019] In the embodiments, "acquisition" includes at least one of the following: a device going to retrieve data or information stored in another device or storage medium (active acquisition); and inputting data or information output from another device into the device (passive acquisition). Examples of active acquisition include making a request or inquiry to another device and receiving a response, and accessing and reading information from another device or storage medium. Examples of passive acquisition include receiving information that is distributed (or transmitted, push notification, etc.). Furthermore, "acquisition" may also mean selecting and acquiring data or information from received data or information, or selecting and receiving distributed data or information.

[0020] <Minimum Configuration Example> Fig. 1 is a diagram showing an overview of a monitoring device 100 according to an embodiment. The monitoring device 100 includes a timetable acquisition unit 102 and a control unit 104. The timetable acquisition unit 102 acquires the estimated arrival time of a public transportation means at a stop for the public transportation means. The control unit 104 uses the estimated arrival time to control at least one of a camera installed at the stop and a processing frequency of an image (first image) generated by the camera.

[0021] Here, the first image is an image generated by the camera 5a at a certain station 30a, and the second image described in the embodiment below is an image generated by the camera 5b at another station 30b. Hereinafter, unless there is a need to distinguish between them, they will simply be referred to as "images."

[0022] 2 is a flowchart showing an example of operation of the monitoring device 100 according to this embodiment. The timetable acquisition unit 102 acquires the estimated arrival time of the public transportation at the stop (step S101). The control unit 104 uses the estimated arrival time to control at least one of the camera installed at the stop and the frequency of processing the image (first image) generated by the camera (step S103).

[0023] The monitoring device 100 can ensure the safety and security of passengers at public transportation stops efficiently and effectively at low cost.

[0024] A detailed example of the monitoring device 100 will be described below.

[0025] (First embodiment) <System overview> Fig. 3 is a diagram conceptually illustrating the system configuration of a monitoring system 1 according to an embodiment. The monitoring system 1 includes a monitoring device 100 and cameras 5a and 5b (hereinafter, when there is no particular need to distinguish between them, they will also be simply referred to as "cameras 5") installed at stations 30a and 30b (hereinafter, when there is no particular need to distinguish between them, they will also be simply referred to as "stations 30").

[0026] Camera 5 is equipped with an imaging element such as a lens and a CCD (Charge Coupled Device) image sensor, and is, for example, a network camera such as an IP (Internet Protocol) camera. The network camera has, for example, a wireless LAN (Local Area Network) communication function, and is connected to monitoring device 100 via a relay device (not shown) such as a router of communication network 3. Camera 5 may also be equipped with a mechanism for controlling the orientation of the camera body and lens, zooming, focusing, etc., in accordance with the movement of the monitored object.

[0027] The images generated by the camera 5 are preferably taken in real time and transmitted to the monitoring device 100. However, the images transmitted to the monitoring device 100 do not have to be transmitted directly from the camera 5, but may be images delayed by a predetermined time. The images captured by the camera 5 may be temporarily stored in another storage device (not shown), and the monitoring device 100 may read them out from the storage device sequentially or at predetermined intervals. Furthermore, the images transmitted to the monitoring device 100 are preferably moving images, but may also be frame images transmitted at predetermined intervals or still images.

[0028] The monitoring device 100 is a server computer or the like. The monitoring device 100 includes a storage device 120. The storage device 120 may be provided inside the monitoring device 100 or may be provided externally. In other words, the storage device 120 may be hardware that is integrated with the monitoring device 100, or may be hardware that is separate from the monitoring device 100.

[0029] The display device 20 is provided in the monitoring center 10. Images transmitted from the cameras 5 at each station 30 are displayed on the display device 20 by the monitoring device 100. The display device 20 is, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display. The display device 20 may be hardware that is integrated with the monitoring device 100, or may be hardware that is separate from the monitoring device 100. Furthermore, the monitoring device 100 may be a computer provided outside the monitoring center 10, and the display control of the display device 20 in the monitoring center 10 may be performed remotely.

[0030] Station 30 is, for example, a so-called "unmanned station" where there is no station staff on duty or there are times when there are no station staff present. In FIG. 3 , the public transportation is assumed to be a train, and therefore the boarding and alighting point is station 30. Public transportation is not limited to trains and includes vehicles such as buses. In this case, the boarding and alighting point is a bus stop. Furthermore, the multiple boarding and alighting points within the route of the public transportation may include a staffed boarding and alighting point.

[0031] At least one camera 5 is provided in each station 30. It is preferable to install the camera 5 at a location that requires monitoring depending on the structure of the station 30.

[0032] <Hardware Configuration Example> Fig. 4 is a block diagram illustrating the hardware configuration of a computer 1000 that realizes the monitoring device 100 in Fig. 1 and Figs. 7, 11, 14, 16, and 19 described below. The operation terminal 60 and control device 40 in Fig. 20 described below are also realized by the computer 1000. Furthermore, the monitoring device 100 may be realized by multiple computers 1000.

[0033] The computer 1000 has a bus 1010 , a processor 1020 , a memory 1030 , a storage device 1040 , an input / output interface 1050 , and a network interface 1060 .

[0034] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to bus connection.

[0035] The processor 1020 is implemented by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.

[0036] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

[0037] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read-only memory (ROM), or the like. The storage device 1040 stores program modules that realize each function of the monitoring device 100 (e.g., the timetable acquisition unit 102 and control unit 104 in FIG. 1 , the processing unit 106 in FIG. 7 described later, the detection result acquisition unit 108 in FIG. 11 , the identification unit 110 in FIG. 14 , the person determination unit 112 in FIG. 16 , and the event determination unit 114 in FIG. 19 ). The processor 1020 loads and executes each of these program modules into the memory 1030, thereby realizing each function corresponding to the program module. The storage device 1040 may also store each data of the storage device 120 of the monitoring device 100.

[0038] The program module may be recorded on a recording medium. The recording medium on which the program module is recorded may include a non-transitory, tangible medium usable by the computer 1000, and the program code readable by the computer 1000 (processor 1020) may be embedded in the medium.

[0039] The input / output interface 1050 is an interface for connecting the computer 1000 with various input / output devices. The input / output interface 1050 also functions as a communication interface for performing short-range wireless communication such as Bluetooth (registered trademark) and NFC (Near Field Communication).

[0040] The network interface 1060 is an interface for connecting the computer 1000 to a communication network. This communication network may be, for example, a local area network (LAN) or a wide area network (WAN). The network interface 1060 may connect to the communication network wirelessly or by wire.

[0041] The computer 1000 is then connected to necessary equipment (e.g., a camera 5, a display device 20, a sensor 7 described later, a speaker 42, a display device 44, a lighting device 46, a keyboard, operation buttons, a mouse, a speaker, a microphone, a printer, etc. of the monitoring device 100, which are not shown) via the input / output interface 1050 or the network interface 1060.

[0042] The components of the monitoring device 100 of each embodiment shown in Figure 1 and Figures 7, 11, 14, 16, and 19 described below are realized by any combination of hardware and software of the computer 1000 of Figure 4. Those skilled in the art will understand that there are various variations in the realization methods and devices. The functional block diagrams showing the monitoring device 100 of each embodiment show logical functional blocks rather than a hardware-based configuration.

[0043] <Example of Functional Configuration> An example of the functional configuration of the monitoring device 100 according to the embodiment will be described below with reference to Fig. 1. The timetable acquisition unit 102 acquires the estimated arrival time of a public transportation means at a stop for the public transportation means. As described above, the public transportation means is, for example, a train or a bus. The stop is a station when the vehicle is a train, and a bus stop when the vehicle is a bus.

[0044] The timetable acquisition unit 102 may acquire timetable information for each station 30 from the website of the public transportation facility, or may read a data file of timetable information provided by the public transportation facility.

[0045] The control unit 104 uses the estimated arrival time to control at least one of the cameras 5 installed at the boarding and alighting stations and the processing frequency of images generated by the cameras 5. Control of the cameras 5 includes changing the frequency of taking pictures (for example, how many times per hour to take pictures), changing the time to take pictures and the time interval between stopping taking pictures (for example, taking pictures for 30 seconds and stopping for 5 minutes), changing the direction or location of taking pictures (switching the platform or track to take pictures from), changing the resolution of the images to be taken (switching between high-definition mode and normal mode), changing the angle of view to take pictures (switching between wide-angle and normal angle of view), and the like.

[0046] Control of the processing frequency of images generated by camera 5 includes at least one of changing the frequency of image processing, changing the frame rate or resolution of the images to be processed, and changing at least one of the display interval, display time, number of times of display, display area size, and display position for displaying images on display device 20. However, the processing frequency may differ depending on the processing content.

[0047] 5 is a diagram showing an example data structure of camera information 300. Camera information 300 includes identification information (station ID) of station 30 where camera 5 is installed, the name of station 30, identification information (camera ID) of camera 5, and information indicating the installation location. The identification information of camera 5 may be, for example, an IP address of camera 5. The information indicating the installation location may be position information on a map within station 30.

[0048] The monitoring device 100 can acquire images transmitted from the camera 5 at each station 30 by, for example, specifying the IP address of the camera 5, and can therefore identify which camera 5 transmitted the received image based on the IP address.

[0049] <Operation Example> An operation example of the monitoring device 100 of the embodiment will be described below with reference to Fig. 2 and Fig. 6. Fig. 6 is a diagram showing an example of control of the image capturing timing of the camera 5 by the control unit 104. First, the timetable acquisition unit 102 acquires estimated arrival times ta1, tb1, ... of the public transportation means at the boarding and alighting stations of the public transportation means (step S101).

[0050] Then, the control unit 104 uses the estimated arrival times ta1, tb1, ... to control at least one of the cameras 5 installed at the boarding and disembarking stations and the processing frequency of images generated by the cameras 5 (step S103).

[0051] In this example, for example, the control unit 104 controls the imaging frequency (number of images taken N2 / minute) of the camera 5 to be lower during the period (Δt) from times ta2, tb2, ..., a predetermined time before the estimated arrival times ta1, tb1, ..., to the estimated arrival times ta1, tb1, ..., compared to the imaging frequency (number of images taken N1 / minute) of the camera 5 during other periods (for example, the period from time ta1 to time tb2 in FIG. 6 ). Here, the number of images taken N1 is greater than N2.

[0052] The predetermined time is, for example, 10 minutes before. Multiple predetermined times may be set, and different imaging frequencies may be set for two periods, for example, 10 minutes before and 5 minutes before. For example, the imaging frequency of the camera 5 may be controlled to be lower 5 minutes before the scheduled arrival time than 10 minutes before. The reason for this is that, since multiple users visit the station 30 before the arrival time of the public transportation means, the monitoring system by the camera 5 at the station 30 may be relaxed.

[0053] By analyzing the image from the camera 5, the usage status of the station 30 can be identified, and the time when multiple users gather at the station 30 can be identified, and the identified time can be set as the predetermined time.

[0054] The set value of the predetermined time may also be changed depending on the time of day. For example, the predetermined time may be 10 minutes before during the commute to work or school, and 5 minutes before during other times. The set value of the predetermined time may also be changed depending on the day of the week. For example, the predetermined time may be 5 minutes before on weekdays and 10 minutes before on weekends. The predetermined time may also be set according to a combination of these conditions.

[0055] The processing frequency may also be set for each condition. For example, the processing frequency may be set lower during the commuting hours compared to other times.

[0056] As described above, according to this embodiment, the monitoring device 100 includes a timetable acquisition unit 102 and a control unit 104. The timetable acquisition unit 102 acquires the estimated arrival time of a public transportation means at a stop for the public transportation means. The control unit 104 uses the estimated arrival time to control at least one of the camera installed at the stop and the frequency of processing images generated by the camera.

[0057] With this configuration, since a plurality of users gather at station 30 a predetermined time before the arrival time of public transportation, at least one of the camera 5 and the processing frequency of images generated by camera 5 is lowered. In other words, the monitoring system of station 30 is strengthened during this period. When no users are present at station 30, at least one of the camera 5 and the first processing frequency of images generated by camera 5 is increased. In other words, the monitoring system of station 30 is strengthened during this period. In this way, with this monitoring device 100, the safety and security of passengers at public transportation boarding and disembarking stations can be ensured efficiently and effectively at low cost.

[0058] Second Embodiment Fig. 7 is a functional block diagram showing an example of the logical configuration of a monitoring device 100 according to an embodiment. This embodiment is similar to the above-described embodiments, except that it has a configuration in which monitoring video is displayed on the display device 20 and the frequency of display processing of the monitoring video is controlled. The monitoring device 100 in Fig. 7 further includes a processing unit 106 in addition to the configuration of the monitoring device 100 in Fig. 1. Note that the configuration of this embodiment may be combined with at least one of the configurations of the other embodiments to the extent that no contradiction occurs.

[0059] <Example of Functional Configuration> The processing unit 106 displays images generated by the camera 5 on the display device 20. Fig. 8 is a diagram showing an example of a monitoring screen 200 displayed on the display device 20. In the example of Fig. 8, the monitoring screen 200 is divided into a plurality of areas 210. The processing unit 106 displays images (P1 to P9) generated by each camera 5 in the plurality of areas 210, respectively. However, the processing unit 106 may also display images from at least one camera 5 on the monitoring screen 200.

[0060] The processing unit 106 causes the display device 20 to display images from the multiple cameras 5 in the multiple areas 210 in sequence for a predetermined display time and at a predetermined display interval.

[0061] 6 described in the above embodiment can also be interpreted as the timing at which images generated by each camera 5 in the station 30 are displayed on the display device 20. In other words, the control unit 104 changes the processing frequency at which images are displayed on the display device 20 between a predetermined time before the arrival time of the public transportation means and other periods. Specifically, the control unit 104 lowers the display frequency for the period from a predetermined time before the scheduled arrival time to the scheduled arrival time compared to other periods.

[0062] The processing unit 106 displays the images generated by the camera 5 on the display device 20 at a display frequency controlled by the control unit 104. The processing unit 106 also processes the images generated by the camera 5. The image processing will be described in detail in the following embodiments, but includes processes such as detecting people in the images, identifying attributes of people, and detecting events.

[0063] The processing unit 106 then displays the processing results of the image on the display device 20. The processing results include information about the person or event detected in the image, and the attributes of the identified person.

[0064] <Operation Example> Fig. 9 is a flowchart showing an operation example of the monitoring device 100 according to the embodiment. The flow in Fig. 9 includes step S105 in addition to the flow in Fig. 2. After at least one of the camera 5 controlled by the control unit 104 and the processing frequency of the image generated by the camera 5 is controlled in step S103, the processing unit 106 causes the display device 20 to display the image or the image processing result (step S105).

[0065] Processing unit 106 controls the display on display device 20 according to the camera 5 or image processing frequency controlled in step S103. For example, the control content of the display on display device 20 includes, for example, the number of times an image is displayed (for example, the number of times per minute), the display time of an image (for example, 30 seconds), the display position of an image when images from multiple cameras 5 are displayed on one screen, the frame rate and resolution of the image to be displayed, etc.

[0066] The camera 5 or image processing frequency controlled by the control unit 104 and the image display control on the display device 20 by the processing unit 106 may or may not be consistent with each other.

[0067] For example, the processing unit 106 may cause the display device 20 to display an image at a processing frequency controlled by the control unit 104. Alternatively, the processing unit 106 may cause the display device 20 to display an image at a processing frequency different from the processing frequency controlled by the control unit 104.

[0068] FIG. 10 is a flowchart showing an example of detailed steps of the control process (step S103 in FIG. 2 ) performed by the control unit 104 of the monitoring device 100 according to the embodiment. First, the control unit 104 sets the image capture and image processing frequency to N1 / min in the normal mode (step S111). For example, the processing frequency is three times per minute. The control unit 104 determines whether the public transportation mode is within a predetermined time (for example, 10 minutes) before the scheduled arrival time (step S113). If the arrival time is within the predetermined time (YES in step S113), the control unit 104 sets the image capture and image processing frequency to N2 / min in the relaxed mode (step S115). For example, the processing frequency is one time per minute. In other words, the processing frequency N2 / min in the relaxed mode is set lower than the processing frequency N1 / min in the normal mode.

[0069] Before the scheduled arrival time of the public transportation means, the monitoring system using the cameras 5 is relaxed because people gather at the station 30, and at other times, the monitoring system is strengthened because the station 30 is deserted. In this way, according to the monitoring device 100 of the embodiment, the control unit 104 controls the camera 5 or the processing frequency of the images generated by the camera 5 as described above, so that the monitoring system can be switched between a predetermined period before the scheduled arrival time of the public transportation means and other periods. This makes it possible to ensure the safety and security of passengers at public transportation boarding and disembarking stations efficiently and effectively at low cost, just like the above embodiment.

[0070] It is also possible to control the display process on the display device 20. That is, the display frequency is reduced during a predetermined period before the scheduled arrival time of the public transportation means, and the display frequency is increased during other periods, thereby strengthening the monitoring system for the station 30 that is deserted except before the scheduled arrival time of the public transportation means.

[0071] Third Embodiment Fig. 11 is a functional block diagram showing an example of the logical configuration of a monitoring device 100 according to an embodiment. This embodiment is similar to any of the above-described embodiments, except that it has a configuration in which detection results from sensors installed at boarding and alighting stations are acquired and the detection results are used to control the camera 5 or the image generated by the camera 5. Fig. 11 further includes a detection result acquisition unit 108 in addition to the configuration of the monitoring device 100 in Fig. 1. However, this may be combined with at least one of the configurations of the second embodiment in Fig. 7 and other embodiments described below, as long as no contradiction occurs.

[0072] <Example of Functional Configuration> The detection result acquisition unit 108 acquires the detection results of the sensors installed at the boarding and alighting stations. The control unit 104 further uses the detection results of the sensors 7 to control at least one of the camera 5 and the frequency of image processing.

[0073] <System Configuration Example> Fig. 12 is a diagram conceptually illustrating the system configuration of the monitoring system 1 according to the embodiment. In addition to the system configuration of the monitoring system 1 in Fig. 3, the monitoring system 1 further includes sensors 7 provided at each station 30. Furthermore, the monitoring system 1 includes an image processing device 130 that processes images generated by the cameras 5.

[0074] The sensor 7 includes, for example, at least one of a human presence sensor (e.g., an infrared sensor) that detects the presence of people within the station 30 premises, a depth sensor that detects foreign objects on the tracks, and a sensor that detects pinching in the platform gate.

[0075] The image processing device 130 detects the presence of people within the station 30 or the presence of foreign objects on the tracks by processing the images generated by the camera 5. Therefore, the sensor 7 may include the camera 5.

[0076] The image processing device 130 may be provided inside or outside the monitoring device 100. In other words, the image processing device 130 may be hardware that is integrated with the monitoring device 100, or may be hardware that is separate from the monitoring device 100.

[0077] <Operation Example> Figure 13 is a flowchart showing a detailed example of the control procedure of the control unit 104 of the monitoring device 100 according to the embodiment. Before this flow, the detection result acquisition unit 108 acquires a detection result from the sensor 7. The control unit 104 then determines whether the detection result from the sensor 7 acquired by the detection result acquisition unit 108 indicates the detection of a predetermined event, such as the presence of a person, the presence of a foreign object, or the occurrence of entrapment in a gate (step S121). If there is detection by the sensor 7 (YES in step S121), the control unit 104 increases the processing frequency of the camera 5 and the images generated by the camera 5 (step S123).

[0078] If there is no detection by the sensor 7 (NO in step S121), step S123 is bypassed and the processing ends without changing the processing frequency.

[0079] For example, if the sensor 7 detects the presence of a person during a period other than the predetermined time before the arrival time of the public transportation in the first embodiment, the control unit 104 further increases the processing frequency. If the sensor 7 detects the presence of a person during the predetermined time before the arrival time of the public transportation in the first embodiment, the control unit 104 may or may not increase the processing frequency. This is because, for example, in the embodiment described below, it is possible to decrease the processing frequency when multiple people are detected.

[0080] Furthermore, regardless of whether it is within a specified time before the arrival time of the public transportation means in the first embodiment, if the detection result of the sensor 7 indicates the presence of a foreign object on the tracks or the occurrence of pinching in the gate, the control unit 104 increases the processing frequency.

[0081] Furthermore, when combined with the second embodiment, if the processing frequency is increased, the processing unit 106 also increases the frequency with which images generated by the camera 5 of the station 30 are displayed on the display device 20.

[0082] As described above, in the monitoring device 100 of this embodiment, the detection result acquisition unit 108 acquires the detection results of the sensors installed at the boarding and alighting stations, and the control unit 104 further controls at least one of the camera 5 and the image processing frequency using the detection results of the sensor 7. For example, the processing speed can be increased when a person is detected by the sensor 7, when a foreign object is detected on the tracks, or when a person is detected to be trapped in a platform gate.

[0083] In this way, the monitoring device 100 of this embodiment not only achieves the same effects as the above-described embodiment, but also makes it possible to strengthen or relax the monitoring system using the detection results of the sensor 7, thereby more effectively ensuring the safety and security of passengers at public transportation boarding and disembarking stations.

[0084] (Fourth embodiment) Fig. 14 is a functional block diagram showing an example of the logical configuration of a monitoring device 100 according to an embodiment. This embodiment is similar to any of the above embodiments, except that it has a configuration in which attributes of people in the images are identified by processing images generated by a camera 5, and the processing frequency is determined using the attributes. The monitoring device 100 of Fig. 14 further includes an identification unit 110 in addition to the monitoring device 100 of Fig. 1. Note that the configuration of this embodiment may be combined with at least one of the configurations of the other embodiments to the extent that no contradiction occurs.

[0085] <Example of Functional Configuration> The identification unit 110 identifies attributes of a person in an image by processing an image generated by the camera 5. The control unit 104 further uses the identified attributes of the person when determining the processing frequency of the camera 5 or an image generated by the camera 5.

[0086] In detail, the identification unit 110 causes the image processing device 130 to process the image generated by the camera 5 and identify the attributes of the person in the image. The identified attribute of the person is an attribute that is subject to enhanced monitoring. The attribute may include, for example, one of the following: an advanced age, or a child (e.g., an infant). Furthermore, the attribute may include one of the following: the person is carrying a white cane, is in a wheelchair, or is carrying a stroller. Furthermore, the attribute may include gender, or may include being female.

[0087] When the attributes of the person are identified, the control unit 104 performs control to increase the processing frequency of the camera 5 or the images generated by the camera 5 .

[0088] <Operation Example> Fig. 15 is a flowchart showing an operation example of the monitoring device 100 according to the embodiment. This flow may be executed in parallel with the flow of Fig. 2. First, the identification unit 110 processes an image generated by the camera 5 to identify the attributes of the person in the image (step S131). If the attributes of the monitoring target have been identified (YES in step S133), the control unit 104 increases the processing frequency of the camera 5 and the images generated by the camera 5 (step S135). If the attributes of the monitoring target have not been identified (NO in step S133), the process returns to step S131 and repeats the process.

[0089] For example, if it is determined that a person included in an image generated by the camera 5 is an elderly person, the control unit 104 increases the processing frequency of the camera 5 and the images generated by the camera 5 .

[0090] Furthermore, when combined with the second embodiment, if the processing frequency is increased, the processing unit 106 also increases the frequency with which images generated by the camera 5 of the station 30 are displayed on the display device 20 .

[0091] As described above, in the monitoring device 100 of this embodiment, the identification unit 110 processes the image generated by the camera 5 to identify the attributes of the person in the image, and the control unit 104 further uses the identified attributes of the person when determining the processing frequency of the camera 5 or the image generated by the camera 5. For example, if the attributes of the person in the image are identified as elderly, carrying a white cane, carrying a stroller, child, woman, etc., the processing frequency can be increased.

[0092] In this way, the monitoring device 100 of this embodiment not only achieves the same effects as the above-described embodiment, but also makes it possible to strengthen or relax the monitoring system using the attributes of people in the image identified by image processing, thereby more effectively and efficiently ensuring the safety and security of passengers at public transportation stops.

[0093] Fifth Embodiment Fig. 16 is a functional block diagram showing an example of the logical configuration of a monitoring device 100 according to an embodiment. This embodiment is similar to any of the above embodiments, except that it has a configuration in which an image generated by a camera 5 is processed to determine whether people included in the image belong to a group, and the processing frequency is determined using the determination result. The monitoring device 100 of Fig. 16 further includes a person determination unit 112 in addition to the monitoring device 100 of Fig. 1. Note that the configuration of this embodiment may be combined with at least one of the configurations of the other embodiments to the extent that no contradiction occurs.

[0094] <Example of Functional Configuration> The person determination unit 112 processes an image to determine whether people included in the image belong to a group. The control unit 104 further uses the determination result by the person determination unit 112 when determining the processing frequency.

[0095] In detail, the person determination unit 112 causes the image processing device 130 to process the image generated by the camera 5 and determines whether the people included in the image are a group. For example, when multiple people are recognized in the image, the person determination unit 112 determines whether the multiple people are acquaintances (a group) or strangers (one person) based on whether the people are having a conversation, whether the distance between the people is within a threshold, etc.

[0096] For example, if the people present are a group, the monitoring system may be relaxed, whereas if the people present are strangers, the monitoring system may be strengthened.

[0097] Therefore, when the person determination unit 112 determines that the people included in the image are a group, the control unit 104 reduces the processing frequency of the camera 5 and the images generated by the camera 5. Alternatively, when the person determination unit 112 determines that the people included in the image are not a group, the control unit 104 increases the processing frequency of the camera 5 and the images generated by the camera 5. At least one of the above two processes can be performed.

[0098] In another example, the number of people entering station 30 may be counted using the detection results of a human presence sensor installed at a ticket gate or the like, and if it is detected that a predetermined number of people or more have entered, control unit 104 may reduce the frequency of processing cameras 5 and images generated by cameras 5. Alternatively, if the number of people entering is small, less than the predetermined number, the frequency of processing cameras 5 and images generated by cameras 5 may be increased.

[0099] <Operation Example> Fig. 17 is a flowchart showing an operation example of the monitoring device 100 according to the embodiment. This flow may be executed in parallel with the flow of Fig. 2. It may also be combined with the flow of Fig. 15. First, the person determination unit 112 processes an image to determine whether the people included in the image are a group (step S141). If the control unit 104 determines that the people are not a group (NO in step S143), it increases the frequency of capturing images by the camera 5 and processing images generated by the camera 5 (step S145). If the control unit 104 determines that the people are a group (YES in step S143), it returns to step S141 and repeats the process.

[0100] For example, if it is determined that multiple people included in an image generated by the camera 5 are not a group, the control unit 104 increases the processing frequency of the camera 5 and the images generated by the camera 5 .

[0101] As described above, if it is determined in step S143 that the people are a group (YES in step S143), the control unit 104 may reduce the frequency of capturing images by the camera 5 and processing the images generated by the camera 5.

[0102] Furthermore, when combined with the second embodiment, if the processing frequency is increased, the processing unit 106 increases the display frequency of the images generated by the cameras 5 of the stations 30 on the display device 20. On the other hand, if the processing frequency is decreased, the processing unit 106 may also decrease the display frequency of the images generated by the cameras 5 of the stations 30 on the display device 20.

[0103] As described above, in the monitoring device 100 of this embodiment, the person determination unit 112 processes an image to determine whether or not the people included in the image are a group, and the control unit 104, when determining the processing frequency, further uses the determination result by the person determination unit 112. For example, if the multiple people included in the image are not a group, the processing frequency can be increased.

[0104] In this way, the monitoring device 100 of this embodiment not only achieves the same effects as the above-described embodiment, but also makes it possible to strengthen or relax the monitoring system using the results of image processing to determine whether multiple people included in an image are a group, thereby more effectively and efficiently ensuring the safety and security of passengers at public transportation stops.

[0105] Sixth Embodiment This embodiment is similar to the above-described embodiments, except that it has a configuration in which the processing frequency is changed depending on the time until arrival time, the time period, etc. Here, the description will be made using Fig. 1. However, the configuration of this embodiment may be combined with at least one of the configurations of the other embodiments to the extent that no contradiction occurs.

[0106] <Example of Functional Configuration> As the time until the scheduled arrival time of the public transportation means increases, the control unit 104 increases the frequency of processing the cameras 5 and the images generated by the cameras 5. This is because the closer the scheduled arrival time gets, the more users will gather at the station 30, making it possible to relax the monitoring system. On the other hand, the longer the time until the scheduled arrival time gets, the more irregular it becomes for users to be at the station 30, making it necessary to strengthen the monitoring system.

[0107] Furthermore, a time period during which the processing frequency should be increased may be set in advance, and the control unit 104 controls the processing frequency to the value set for that time period.

[0108] The time period may be, for example, a time period with few users (e.g., daytime or late night), or a predetermined period (10 minutes before) before the arrival time of the public transportation means, as described in the above embodiment.

[0109] For example, by analyzing and processing the images from the camera 5 and taking past statistics, it is possible to identify and set the time (how many minutes before the arrival time) or time period in which passengers of that train formation at that stop tend to arrive. The processing frequency is set to be high until that time or time period arrives (i.e., when not many passengers gather).

[0110] Furthermore, the time periods during which the processing frequency should be increased may be set for each public transportation formation. That is, different time periods may be set depending on the destination of the public transportation, whether it is an express train or a local train. That is, it is expected that express trains will have more passengers than local trains regardless of the time period, while local trains may have fewer passengers regardless of the time period. Therefore, it is preferable to set time periods during which the processing frequency should be increased according to different criteria for each formation.

[0111] In the above embodiment, the processing frequency is controlled under various conditions, but the processing frequency may be set by combining these conditions.

[0112] <Operation Example> As the time until the scheduled arrival time of the public transportation becomes longer, the control unit 104 increases the processing frequency of the camera 5 and the images generated by the camera 5. Fig. 18 is a diagram showing an example of control of the image capturing timing of the camera 5 by the control unit 104. The processing frequency is set higher as the time until the scheduled arrival time becomes longer for the period Δt1 from times ta2, tb2, ... before the scheduled arrival times ta1, tb1, ... of the public transportation, the period Δt2 from times ta3 (not shown), tb3, ... before the times ta2, tb2, ..., the period Δt3 from times ta4 (not shown), tb4, ... before the times ta3 (not shown), tb3, ..., and the period Δt4 before times ta4 (not shown), tb4, ....

[0113] In this way, as the time until the scheduled arrival of the public transport means increases, the cameras 5 and the images generated by them can be processed more frequently, thereby increasing surveillance during more deserted times.

[0114] The control unit 104 also acquires a time period during which the processing frequency should be increased, and increases the processing frequency for that time period. The time period during which the processing frequency should be increased is a time period during which there are fewer users (e.g., daytime or late at night).

[0115] As described above, in the monitoring device 100 of this embodiment, the control unit 104 increases the processing frequency of the cameras 5 and the images generated by the cameras 5 as the time until the scheduled arrival time of the public transportation becomes longer. Also, time periods during which the processing frequency should be increased may be set in advance, and the control unit 104 controls the processing frequency to the value set for the time period. Furthermore, the time periods during which the processing frequency should be increased may be set for each formation of the public transportation.

[0116] In this way, the monitoring device 100 of this embodiment not only achieves the same effects as the above-described embodiment, but also increases the processing frequency according to the need for higher processing frequency, thereby more effectively and efficiently ensuring the safety and security of passengers at public transportation boarding and disembarking stations.

[0117] Seventh Embodiment Fig. 19 is a functional block diagram showing an example of the logical configuration of a monitoring device 100 according to an embodiment. This embodiment is similar to any one of the above embodiments, except that it has a configuration that determines whether a specific event exists and executes a predetermined process when it is determined that the specific event exists. The monitoring device 100 of Fig. 19 further includes an event determination unit 114 in addition to the configuration of the monitoring device 100 of Fig. 7. The configuration of this embodiment may be combined with at least one of the configurations of the other embodiments to the extent that no contradiction occurs.

[0118] <System Configuration Example> Fig. 20 is a diagram conceptually illustrating the system configuration of a monitoring system 1 according to an embodiment. In addition to the system configuration of the monitoring system 1 in Fig. 12, the monitoring system 1 in Fig. 20 further includes a control device 40, a lighting device 9, a speaker 42, and a display device 44, which are provided at each station 30. Furthermore, in addition to the monitoring system 1 in Fig. 12, the monitoring system 1 in Fig. 20 further includes a manned station 30c. A station attendant 32 is present at the manned station 30c.

[0119] The monitoring system 1 may further include at least one of a reporting device (not shown) of the vehicle 50 and an operating terminal 60 operated by the crew 52 of the vehicle 50 as a reporting destination when the monitoring device 100 detects the occurrence of an incident that requires reporting.

[0120] In recent years, it has become difficult to ensure the safety and convenience of users as it has become more difficult to allocate costs to maintenance and repair of unmanned stations. As the consolidation and closure of stations progresses, there is a desire to ensure the safety and convenience of the few remaining unmanned stations.

[0121] In this context, a system is desired that allows local businesses, local governments, and residents to respond together when an incident requiring reporting occurs at an unmanned station. Therefore, in this embodiment, the monitoring system 1 may include, as a reporting destination when a reporting incident is detected, at least one of an operation terminal 60 operated by a person in charge 72 of a taxi company 70, an operation terminal 60 operated by a person in charge 82 of a local government 80, and an operation terminal 60 operated by a registered supporter 90 such as a local resident.

[0122] The operation terminal 60 is, for example, a computer 1000 ( FIG. 4 ) such as a smartphone, a personal computer, or a tablet terminal. The control device 40 may also be realized by the computer 1000 of FIG. 4 . The control device 40 includes, for example, a control unit (not shown) that controls the sensor 7, the lighting device 9, the speaker 42, and the display device 44 according to instructions from the monitoring device 100, and a communication unit (not shown) that transmits the status of each device to the monitoring device 100. Note that the control device 40 may be a communication device such as a gateway, and the sensor 7, the lighting device 9, the speaker 42, and the display device 44 may each have an IP address and operate directly according to instructions from the monitoring device 100.

[0123] The lighting devices 9 are provided at the entrances, platforms, etc. of the station 30, and may, for example, be turned on when the sensor 7 detects the presence of a person, or turned off a predetermined time after the public transportation means departs, or may be controlled to turn on and off according to a predetermined lighting schedule. These on / off operations may be functions of the lighting devices 9 themselves, or may be realized by the control of the control device 40 or the monitoring device 100.

[0124] The speaker 42 is provided at the entrance to the station 30, on the platform, or elsewhere. For example, when the sensor 7 detects the presence of a person, it may output a voice message greeting the user, such as "Good morning," "Hello," "Good evening," or "Welcome." This message can inform the user that the monitoring system 1 has recognized the presence of a person. For example, this message is expected to give a user who is alone in a deserted station 30 a sense of security that they are being watched. On the other hand, this message is expected to make criminals aware that they are being monitored and to deter them from committing crimes.

[0125] The voice messages output from the speaker 42 include various messages, such as a message informing passengers that the public transportation means is scheduled to arrive soon before its scheduled arrival time, a message calling for caution to avoid getting caught in the platform doors or falling off the platform, a message informing passengers of the location of the report button, etc. These voice output operations are realized by the control of at least one of the control device 40 and the monitoring device 100.

[0126] The display device 44 is provided at the entrance or platform of the station 30, and may be, for example, a signage such as an LCD display or an organic EL (Electro-Luminescence) display, or may be an electronic bulletin board made up of LED (Light Emitting Diode) displays.

[0127] The display device 44 may display an image containing a message similar to the message output as voice, or, if an abnormality is detected, may display a video or image showing the situation in which the abnormality is occurring. These display operations are realized by the control of at least one of the control device 40 and the monitoring device 100.

[0128] When an incident that requires reporting is detected, a notification is sent to the reporting device of the vehicle 50, as well as to the operating terminal 60 operated by the driver 52, the person in charge 72 of the taxi company 70, the person in charge 82 of the local government 80, and the registered supporter 90.

[0129] The notification includes information indicating the date and time of the incident that should be reported, the location of the incident (the station name, detailed information indicating the location within the station), and the details of the incident (a fall from the platform, an item dropped onto the tracks, someone getting caught in a platform door, someone suddenly falling ill, a fight, a purse snatcher, a kidnapping, a molester, etc.).

[0130] The notification method may be, for example, to install a specified application in advance on the operation terminal 60 and notify from the application, or to send a message to a specified email address.

[0131] <Example of Functional Configuration> The event determination unit 114 determines whether or not a specific event has occurred. When it is determined that an event has occurred, the processing unit 106 executes a predetermined process.

[0132] In detail, the event determination unit 114 determines whether or not a specific event has occurred by having the image processing device 130 process the image generated by the camera 5. Alternatively, the event determination unit 114 may determine whether or not a specific event has occurred using the detection results of the sensor 7 acquired by the detection result acquisition unit 108 in the above embodiment. Alternatively, the event determination unit 114 may perform audio analysis processing on sounds collected by a microphone (not shown) installed in the station 30 to detect shouts, screams, cries, and words uttered in dangerous situations, such as "help," "danger," and "run away," thereby identifying the occurrence of an abnormal situation and determining that the relevant event has occurred. Note that the camera 5 may have a microphone, and in that case, audio may be generated by the camera 5 along with the video.

[0133] A specific event is the occurrence of an incident that should be reported, and includes at least one of the following: a fall from a platform, something dropped onto the tracks, someone getting caught in a platform door, someone suddenly falling ill, a fall (and a person who remains motionless after falling), a fight, a purse snatching, a suspicious object, kidnapping, abandonment, molestation, an incident, a suspicious person entering or staying, or the intrusion of a dangerous animal (such as a wild boar, deer, bear, monkey, or snake).

[0134] The predetermined processing includes processing for notifying the driver or crew member 52 of the public transportation vehicle 50 scheduled to arrive next at the boarding / alighting station where a specific event has been determined to have occurred that the event has occurred.

[0135] That is, the processing unit 106 outputs an alert to any one of a speaker (not shown), a display (not shown), and a display unit (not shown) of a notification device of the public transportation vehicle 50 that is scheduled to arrive next at the stop where it has been determined that a specific event has occurred. Alternatively, the processing unit 106 may transmit a notification message to at least one of the operation terminal 60 of the crew member 52, the operation terminal 60 of the station staff 32 of the other manned station 30a, the operation terminal 60 operated by the person in charge 72 of the taxi company 70, the operation terminal 60 operated by the person in charge 82 of the local government 80, and the operation terminal 60 operated by the registered supporter 90 such as a local resident, to output an alert.

[0136] The predetermined process may also include causing the speaker 42 and display device 44 of the station 30 to output a message or alert notifying that an emergency has occurred. Alternatively, the predetermined process may include closing a ticket gate to prohibit entry into the station 30. For example, the gate of an automatic ticket gate entrance may be controlled to close and not open. Alternatively, a signal light such as a patrol lamp at the entrance to the station 30 may be activated. The predetermined process may also include causing the display device 44 (e.g., an electronic bulletin board) of the station 30 to display information indicating that the gate is closed.

[0137] However, the alert output may have a means for accepting cancellation by at least one of the crew member 52 who visits the unmanned station 30 in response to the report, the station staff 32 at another manned station 30a, the person in charge 72 of the taxi company 70, the person in charge 82 of the local government 80, and the registered supporter 90 such as a local resident. For example, the alert may be cancelled by accepting the pressing of an operation button displayed on the operation terminal 60 that accepts an operation to cancel the alert.

[0138] Furthermore, the event determination unit 114 may determine that the presence of a person is detected by the sensor 7 as a specific event. In this case, the predetermined process includes outputting a message from the speaker 42 that greets the user, such as "Good morning," "Hello," "Good evening," and "Welcome."

[0139] When the sensor 7 detects that a person has entered the station 30, the processing unit 106 outputs the above message by voice from the speaker 42. This message notifies the user that the monitoring system 1 has recognized the presence of a person. For example, this message is expected to give a user who is alone in a deserted station 30 a sense of security that they are being watched. On the other hand, this message is expected to make criminals aware that they are being watched, and to deter them from committing a crime.

[0140] As described above, the predetermined processing may include processing for displaying an image generated by the camera 5 or a processing result of the image on the display device 20. The processing unit 106 causes the display device 20 to display, together with a first image generated by the camera 5a in a certain station 30a or a processing result of the first image, a second image generated by a camera 5b installed in at least one other station 30b, which is a boarding / alighting stop, or a processing result of the second image. Furthermore, the processing unit 106 controls the display ratio of the first image and the second image to display them.

[0141] 21 and 22 are diagrams showing display examples of the monitoring screen 200. The processing unit 106 causes the display device 20 to display the monitoring screen 200 including images generated by the cameras 5 of each station 30, including an image in which the occurrence of a specific event is detected by the event determination unit 114.

[0142] The example of FIG. 21 shows a state in which a region 210 of an image P1 of a camera 5, which generated an image in which the occurrence of a specific event was detected by the event determination unit 114, is highlighted 220. The highlighting 220 includes, for example, highlighting the region 210 of the image P1 by changing the color of the frame around the region 210 or by making it glow (blink). Furthermore, the monitoring screen 200 may include a details display button 222. When the details display button 222 is pressed, a screen displaying detailed information about the specific event is displayed. The detailed information may include, for example, the name of the station where the event occurred, its location within the station, the date and time of the occurrence (e.g., the date and time of the image frame in which the event was identified), the content of the event that occurred, the degree of danger, and so on.

[0143] The example of FIG. 22 shows an image P1 of the camera 5 that generated the image in which the occurrence of a specific event was detected, displayed in an enlarged and highlighted display 230. The enlarged and highlighted display 230 may further include an occurrence location display section 232 and a map display button 234. The enlarged and highlighted display 230 has a larger area than the areas 210 of the other images P3, P6, etc. Also, as in FIG. 21 , the frame of the display area may be highlighted. The occurrence location display section 232 displays information indicating the station name and location within the station where the event occurred. The occurrence location display section 232 may further include information such as the date and time of the occurrence (e.g., the date and time of the image frame in which the event was identified), the content of the event that occurred, and the degree of danger.

[0144] When the map display button 234 is pressed, the processing unit 106 displays a map of the station premises including information indicating the location where the event occurred. The map display screen may be displayed in a window separate from the monitoring screen 200, may be displayed by switching with the monitoring screen 200, or may be displayed in a partial area of ​​the monitoring screen 200. The display format of the map display screen may be changeable by an operation by the operator 12.

[0145] The processing unit 106 may also set display priorities for images generated by multiple cameras 5. The higher the priority of an image, the longer the display time on the monitoring screen 200, the higher the display frequency, the larger the display ratio (wider the display area), and the more prominent the display position, and the lower the priority of an image, the shorter the display time on the monitoring screen 200, the lower the display frequency, the smaller the display ratio (narrower the display area), and the more inconspicuous the display position, and the lower the display frequency.

[0146] 23 is a diagram showing an example of the data structure of the display order information 310 and the level-based control information 320. The display order information 310 and the level-based control information 320 are stored in the storage device 120.

[0147] 23A, the display order information 310 associates a camera ID with a level indicating the priority order for each camera 5. Furthermore, the display order information 310 may further include information indicating the time when the level setting was changed (setting time).

[0148] 23(b), each level indicating the priority level is associated with information indicating the display area within the monitoring screen 200, the display frequency (how many times per minute to display, etc.), the display time, etc. For example, at level 1, which has the highest priority level, the image display positions are P1, P2, and P4, which are the upper left area within the monitoring screen 200, the display frequency is set to three times per minute, which is higher than the other levels, and the display time is set to 15 seconds, which is longer than the other levels.

[0149] At level 4, which has the lowest priority, the image is displayed at P6, P8, and P9 in the lower right area of ​​the monitoring screen 200, with a display frequency of once per minute, which is lower than at other levels, and a display time of three seconds, which is shorter than at other levels. Note that at level 1, as described above, the display proportion may be set larger than that of other images, and the level-specific control information 320 may further include a display area enlargement rate (or display area ratio, etc.) for each level.

[0150] For example, the processing unit 106 refers to the display order information 310 and the level-specific control information 320, and controls the display position, display frequency, and display time of the image on the display device 20 according to the level of each camera 5, thereby displaying the image of each camera 5 on the monitoring screen 200.

[0151] When combined with the other embodiments described above, the control unit 104 may increase or decrease this level depending on the conditions for increasing or decreasing the processing frequency in each embodiment, or may increase or decrease the display frequency based on the processing frequency set at the set level. Alternatively, the processing unit 106 may increase the display time or increase the display ratio when increasing the processing frequency, or may shorten the display time or decrease the display ratio when decreasing the processing frequency.

[0152] As described above, in the monitoring device 100 of this embodiment, the event determination unit 114 determines whether a specific event has occurred, and the processing unit 106 executes a predetermined process when it determines that an event has occurred based on at least one of the detection results of the sensor 7 and image processing of the image generated by the camera 5. For example, when it is determined that a specific event has occurred, such as a fall from a platform, an object dropped onto the tracks, someone getting caught in a platform door, a person suddenly falling ill, a fight, a purse snatching, a kidnapping, a molester, or the intrusion of a dangerous animal, the processing unit 106 performs a process to notify the driver or crew member 52 of the next public transportation vehicle 50 scheduled to arrive that the specific event has occurred. Alternatively, the processing unit 106 may increase the display frequency, the display time, or the display ratio of an image displayed on the display device 20.

[0153] In addition, the processing unit 106 performs processing to notify the notification device of the vehicle 50, as well as the driver 52, the person in charge 72 of the taxi company 70, the person in charge 82 of the local government 80, and the operating terminal 60 operated by the registered supporter 90 that a specific event has occurred.

[0154] In this way, the monitoring device 100 of this embodiment not only achieves the same effects as the above-described embodiment, but also more effectively and efficiently ensures the safety and security of passengers using public transportation boarding and disembarking stations.

[0155] While the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various other configurations may be adopted. For example, in the above embodiment, the monitoring screen 200 is displayed on the display device 20 installed in the monitoring center 10, but for example, a display device 20 may also be installed in a nearby manned station 30c (FIG. 20), and the processing unit 106 may perform display processing of the monitoring images generated by the cameras 5 of each station 30.

[0156] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. Note that when information about users is acquired and used in the present invention, this must be done lawfully.

[0157] In addition, although the flowcharts used in the above description show multiple steps (processes) in a sequential order, the order of steps executed in each embodiment is not limited to the order shown. In each embodiment, the order of the steps shown in the drawings can be changed as long as it does not cause any problems in terms of content. Furthermore, the above-described embodiments can be combined as long as the content is not contradictory.

[0158] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. 1. A monitoring device comprising: a timetable acquisition means for acquiring an estimated arrival time of a public transportation means at a stop for the public transportation means; and a control means for controlling at least one of a camera installed at the stop and a processing frequency of a first image generated by the camera using the estimated arrival time. 2. The monitoring device described in 1., further comprising: a detection result acquisition means for acquiring a detection result of a sensor installed at the stop, wherein the control means further uses the detection result of the sensor to control at least one of the camera and the processing frequency of the first image. 3. The monitoring device described in 2., wherein the sensor includes at least one of a human presence sensor that detects the presence of a person, a depth sensor that detects foreign objects on the tracks, a sensor that detects entrapment at a gate, and a camera that generates images. 4. The monitoring device described in 1. to 3. 5. The monitoring device described in any one of items 1. to 4., further comprising an identification means for processing the first image to identify attributes of people in the first image, wherein the control means further uses the attributes when determining the processing frequency. 5. The monitoring device described in any one of items 1. to 4., further comprising a person determination means for processing the first image to determine whether people included in the first image are a group, wherein the control means further uses the determination result by the person determination means when determining the processing frequency. 6. The monitoring device described in any one of items 1. to 5., wherein the control means increases the processing frequency as the time until the estimated arrival time becomes longer. 7. The monitoring device described in any one of items 1. to 6., wherein a time period during which the processing frequency should be increased is set, and the control means controls the processing frequency to the value set for the time period. 8. The monitoring device described in item 7., wherein the time period is further set for each formation. 9. The monitoring device described in item 1. to 8. The monitoring device according to any one of the above, further comprising: an event determination means for determining whether or not a specific event has occurred; and a processing means for executing a predetermined process when it is determined that the event has occurred.10. The monitoring device described in 9., wherein the predetermined processing includes notifying the driver of the next public transportation vehicle scheduled to arrive at the boarding / alighting station where it has been determined that the event has occurred of the occurrence of the event. 11. The monitoring device described in 9. or 10., wherein the predetermined processing includes displaying the first image or a processing result of the first image on a display, and the processing means further displays on the display, together with the first image or the processing result of the first image, a second image or a processing result of the second image generated by a camera installed at at least one other boarding / alighting station, and the processing means controls the display ratio of the first image and the second image.

[0159] 12. A monitoring method in which one or more computers acquire the estimated arrival time of a public transportation means at a stop for the public transportation means, and use the estimated arrival time to control at least one of a camera installed at the stop and the processing frequency of a first image generated by the camera. 13. The monitoring method described in 12., in which one or more computers further acquire detection results of a sensor installed at the stop, and use the detection results of the sensor to control at least one of the camera and the processing frequency of the first image. 14. The monitoring method described in 13., in which the sensor includes at least one of a human presence sensor that detects the presence of a person, a depth sensor that detects foreign objects on the tracks, a sensor that detects entrapment at a gate, and a camera that generates an image. 15. The monitoring method described in any one of 12. to 14., in which one or more computers further process the first image to identify attributes of a person in the first image, and further use the attributes when determining the processing frequency. 16. The monitoring method described in any one of 12. to 15., wherein one or more computers further process the first image to determine whether people included in the first image are a group, and further use the result of the determination when determining the processing frequency. 17. The monitoring method described in any one of 12. to 16., wherein one or more computers, when performing the control, increase the processing frequency as the time until the estimated arrival time becomes longer. 18. The monitoring method described in any one of 12. to 17., wherein a time period during which the processing frequency should be increased is set, and one or more computers, when performing the control, control to the processing frequency set for the time period. 19. The monitoring method described in 18., wherein the time period is further set for each formation. 20. The monitoring method described in 12. to 19. 2. The monitoring method according to claim 1, wherein the one or more computers further determine whether or not a specific event has occurred, and when it is determined that the event has occurred, execute a predetermined process.21. The monitoring method described in 20., wherein the predetermined processing includes processing for notifying the driver of the next public transportation vehicle scheduled to arrive at the boarding / alighting station where it has been determined that the event has occurred, of the occurrence of the event. 22. The monitoring method described in 20. or 21., wherein the predetermined processing includes processing for displaying the first image or a processing result of the first image on a display, and wherein one or more computers further display on the display, together with the first image or the processing result of the first image, a second image or a processing result of the second image generated by a camera installed at at least one other boarding / alighting station, and wherein the display ratios of the first image and the second image are controlled.

[0160] 23. A computer-readable recording medium storing a program for causing a computer to execute the following steps: acquiring the estimated arrival time of a public transportation means at a stop for the public transportation means; and controlling at least one of a camera installed at the stop and the processing frequency of a first image generated by the camera using the estimated arrival time. 24. A recording medium described in 23., wherein the program further causes the computer to execute the step of acquiring detection results from a sensor installed at the stop, and wherein the control step further uses the detection results from the sensor to control at least one of the camera and the processing frequency of the first image. 25. A recording medium described in 24., wherein the sensor includes at least one of a human presence sensor that detects the presence of a person, a depth sensor that detects foreign objects on the tracks, a sensor that detects entrapment at a gate, and a camera that generates an image. 26. A recording medium described in 23. to 25. 27. A recording medium according to any one of claims 23 to 26, wherein the program causes a computer to execute a procedure of processing the first image to identify attributes of people in the first image, and the controlling procedure in the program further uses the attributes when determining the processing frequency. 27. A recording medium according to any one of claims 23 to 26, wherein the program further causes a computer to execute a procedure of processing the first image to determine whether people included in the first image belong to a group, and the controlling procedure further uses a determination result from the determining procedure when determining the processing frequency. 28. A recording medium according to any one of claims 23 to 27, wherein the controlling procedure in the program increases the processing frequency as the time until the estimated arrival time becomes longer. 29. A recording medium according to any one of claims 23 to 28, wherein a time period during which the processing frequency should be increased is set, and the controlling procedure in the program controls the processing frequency to the frequency set for the time period.30. The recording medium described in 29., wherein the time period is further set for each train formation. 31. The recording medium described in any one of 23. to 30., wherein the program further causes a computer to execute the steps of determining whether or not a specific event has occurred, and the step of executing predetermined processing when it is determined that the event has occurred. 32. The recording medium described in 31., wherein the predetermined processing includes notifying the driver of the public transportation vehicle that is scheduled to arrive next at the boarding / alighting point where it has been determined that the event has occurred, of the occurrence of the event. 33. The recording medium described in 31. or 32., wherein the predetermined processing includes displaying the first image or the processing result of the first image on a display, and wherein in the program, the processing step further displays, on the display, a second image or the processing result of the second image generated by a camera installed at at least one other boarding / alighting point, together with the first image or the processing result of the first image, and the processing step controls the display ratio of the first image and the second image.

[0161] REFERENCE SIGNS LIST 1 Monitoring system 3 Communication network 5, 5a, 5b Camera 7 Sensor 10 Monitoring center 12 Operator 20 Display device 30, 30a, 30b Station (unmanned station) 30c Manned station 32 Station staff 40 Control device 42 Speaker 44 Display device 46 Lighting device 50 Vehicle 52 Crew member 60 Operation terminal 70 Taxi company 72 Person in charge 80 Local government 82 Person in charge 90 Registered supporter 100 Monitoring device 102 Timetable acquisition unit 104 Control unit 106 Processing unit 108 Detection result acquisition unit 110 Identification unit 112 Person determination unit 114 Event determination unit 120 Storage device 130 Image processing device 200 Monitoring screen 210 Area 220 Highlighting 222 Detail display button 230 Highlighted enlarged display 232 Occurrence position display section 234 Map display button 300 Camera information 310 Display order information 320 Level-based control information 1000 Computer 1010 Bus 1020 Processor 1030 Memory 1040 Storage device 1050 Input / output interface 1060 Network interface

Claims

1. A timetable acquisition means for acquiring a scheduled arrival time of the public transportation means at a boarding / alighting station of the public transportation means; a control means for controlling at least one of a camera installed at the station and a processing frequency of a first image generated by the camera using the estimated arrival time; A monitoring device comprising:

2. 2. The monitoring device according to claim 1, The vehicle further includes a detection result acquisition means for acquiring a detection result of a sensor installed at the boarding / deboarding station, The control means further uses the detection result of the sensor to control at least one of the camera and the processing frequency of the first image.

3. 3. The monitoring device according to claim 1, An identification unit is further provided for identifying attributes of a person in the first image by processing the first image, The control means further uses the attribute when determining the processing frequency.

4. 3. The monitoring device according to claim 1, a person determining unit that determines whether or not a person included in the first image is a group by processing the first image, The control means, when determining the processing frequency, further uses a determination result by the person determination means.

5. 3. The monitoring device according to claim 1, The control means increases the processing frequency as the time until the estimated arrival time becomes longer.

6. 3. The monitoring device according to claim 1, An event determination means for determining whether or not a specific event exists; The monitoring device further comprises a processing means for executing a predetermined process when it is determined that the event has occurred.

7. 7. The monitoring device according to claim 6, The specified processing includes a process of notifying the driver of the public transportation vehicle that is next scheduled to arrive at the boarding / alighting station where the event has been determined to have occurred of the occurrence of the event, in the monitoring device.

8. 7. The monitoring device according to claim 6, the predetermined processing includes processing for displaying the first image or a processing result of the first image on a display; The processing means further displays, on the display, a second image or a processing result of the second image generated by a camera installed at at least one other boarding / alighting station together with the first image or the processing result of the first image, and The processing means controls the display ratio of the first image and the second image to display the first image and the second image.

9. One or more computers Obtaining the estimated arrival time of the public transportation means at the boarding and alighting point of the public transportation means; A surveillance method, comprising: controlling at least one of a camera installed at the station and a processing frequency of a first image generated by the camera using the estimated arrival time.

10. On the computer, obtaining an estimated arrival time of a public transport means at a stop of the public transport means; using the estimated arrival time to control at least one of a camera installed at the station and a processing frequency of a first image generated by the camera; A program for executing the above.