Monitoring system, monitoring device, and monitoring method

Abstract

The present invention makes it possible to equalize the load of monitoring operations among a plurality of monitoring personnel. A state analysis unit (112) analyzes the state of each of a plurality of monitoring targets on the basis of sensor data received from the plurality of monitoring targets, and determines whether or not a prescribed event has occurred in any of the monitoring targets. A monitoring personnel assignment unit (114) determines, from among the plurality of monitoring personnel, monitoring personnel to handle monitoring operations for monitoring targets for which it has been determined that a prescribed event has occurred, said determination being made on the basis of the prescribed event which has occurred and a load index indicating the monitoring operation labor by the monitoring personnel.

Description

[Technical field]

[0001] The present disclosure relates to a monitoring system, a monitoring device, and a monitoring method. [Background technology]

[0002] As a related technique, Patent Document 1 discloses a remote control system for a work vehicle. The remote control system described in Patent Document 1 has a vehicle control device mounted on each of a plurality of work vehicles, and a remote operation device located outside the work vehicles. The work vehicles are configured to be able to switch between an autonomous driving mode and a remotely controlled driving mode. In the autonomous driving mode, the vehicle control device causes the work vehicles to autonomously drive along a set driving route. In the remotely controlled driving mode, the vehicle control device causes the work vehicles to drive according to instructions including steering control received from the remote operation device.

[0003] The remote control device controls the travel mode of each of the multiple work vehicles in accordance with the operation of the remote operator. The remote control device controls the setting of the travel mode so that two or more of the multiple work vehicles are not set to the remotely controlled travel mode at the same time. For example, when one work vehicle is set to the remotely controlled travel mode, the remote control device disables the operation of selecting other work vehicles and does not transmit an instruction to set the remotely controlled travel mode to the other work vehicles.

[0004] As another related technique, Patent Document 2 discloses an information processing system used for monitoring vehicles. In the information processing system described in Patent Document 2, a server acquires vehicle information from a vehicle that is the subject of monitoring by a monitor. Based on the acquired vehicle information, the server determines a monitoring priority according to the degree to which the monitor needs to monitor the vehicle. The monitoring priority is indicated in three stages, for example, "high," "medium," and "low." The server generates presentation information for monitoring the vehicle based on the monitoring priority, and displays the presentation information on a display device. For example, the server displays an image acquired from a vehicle with a high monitoring priority in a larger area than an image acquired from another vehicle with a lower monitoring priority than the vehicle. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent Publication No. 2021-36796 [Patent Document 2] JP 2020-61120 A Summary of the Invention [Problem to be solved by the invention]

[0006] In Patent Document 1, a remote operator can monitor multiple work vehicles, for example, four work vehicles, and remotely operate one of them. However, in Patent Document 1, multiple work vehicles are fixedly assigned to each remote operator. In Patent Document 1, only one of the multiple work vehicles can be set to remote control mode. For this reason, when a remote operator is remotely operating a work vehicle in remote control mode, even if an event that requires action occurs in another work vehicle, the remote operator cannot remotely operate that work vehicle.

[0007] Patent Document 2 describes that when there are multiple monitors, a monitor is selected depending on the situation that occurs in the vehicle. For example, it is assumed that monitor A has a greater track record of dealing with situations such as "accident occurrence" than monitor B. In this case, the server sets the priority of "accident occurrence" for monitor A higher than the priority of "accident occurrence" for monitor B. In this case, of monitors A and B, monitor A, who is more capable of smoothly dealing with vehicle situation information, can be made to monitor the vehicle.

[0008] However, in Patent Document 2, if an "accident occurrence" situation occurs consecutively, monitor A will take measures against the "accident occurrence". For this reason, in Patent Document 2, it is considered that monitoring work with a high monitoring load will be concentrated on a specific monitor. The above problem can occur not only in monitoring vehicles, but also in monitoring other monitoring targets.

[0009] In consideration of the above circumstances, the present disclosure aims to provide a monitoring system, monitoring device, and monitoring method that can appropriately distribute the load of monitoring work among multiple monitors when determining which monitor from among multiple monitors will be responsible for detailed monitoring work of a specific monitoring target. [Means for solving the problem]

[0010] In order to achieve the above object, the present disclosure provides, as a first aspect, a monitoring device, which includes an information receiving means for receiving one or more sensor data from each of a plurality of monitoring targets, a status analysis means for analyzing the status of each of the plurality of monitoring targets based on the sensor data and determining the occurrence of a predetermined event in each monitoring target, a monitor status management means for managing a load index indicating the labor of a monitoring task for each of a plurality of monitors monitoring at least one of the plurality of monitoring targets, and a monitor assignment means for, when the status analysis means determines that the predetermined event has occurred in one or more monitoring targets, determining, based on the occurred predetermined event and the load index, a monitor among the plurality of monitors to be in charge of the monitoring task of the monitoring target in which it has been determined that the predetermined event has occurred.

[0011] The present disclosure provides a monitoring system as a second aspect. The monitoring system includes a monitoring device used to monitor multiple monitoring targets, and multiple sensors that obtain sensor data of the multiple monitoring targets. The monitoring device includes information receiving means for receiving sensor data from the multiple sensors, status analysis means for analyzing the status of each of the multiple monitoring targets based on the sensor data and determining the occurrence of a predetermined event in each monitoring target, monitor status management means for managing a load index indicating the labor of monitoring work for each of multiple monitors monitoring at least one of the multiple monitoring targets, and monitor assignment means for determining, when the status analysis means determines that the predetermined event has occurred in one or more monitoring targets, a monitor among the multiple monitors to be in charge of the monitoring work of the monitoring target in which it is determined that the predetermined event has occurred, based on the predetermined event that has occurred and the load index.

[0012] The present disclosure provides, as a third aspect, a monitoring method, which includes receiving one or more sensor data from each of a plurality of monitoring targets, analyzing a state of each of the plurality of monitoring targets based on the sensor data, determining whether or not a predetermined event has occurred in each of the monitoring targets, and, when it is determined that the predetermined event has occurred in one or more monitoring targets, determining, based on the predetermined event that has occurred and a load index indicating the workload of the monitoring task of the monitor, a monitor who is in charge of monitoring the monitoring target in which it has been determined that the predetermined event has occurred, among a plurality of monitors monitoring at least one of the plurality of monitoring targets. Effect of the Invention

[0013] The monitoring system, monitoring device, and monitoring method according to the present disclosure can appropriately distribute the load of monitoring work among multiple monitors. [Brief description of the drawings]

[0014] [Figure 1] FIG. 1 is a block diagram showing a monitoring system according to a first embodiment of the present disclosure. [Diagram 2]FIG. 2 is a block diagram showing an example of the configuration of a monitoring device. [Diagram 3] FIG. 4 is a diagram showing an example of information about each supervisor managed by a supervisor status management unit. [Figure 4] FIG. 13 is a diagram showing another example of information about each supervisor managed by the supervisor status management unit. [Diagram 5] 4 is a flowchart showing an operation procedure in the monitoring device. [Figure 6] FIG. 11 is a block diagram showing a monitoring system according to a second embodiment of the present disclosure. [Figure 7] FIG. 1 is a block diagram showing an example of the configuration of a moving body. [Figure 8] FIG. 2 is a block diagram showing an example of the configuration of a remote monitoring device. [Figure 9] FIG. 13 is a diagram showing an example of an overall monitoring screen in the second embodiment. [Figure 10] FIG. 13 is a diagram showing an example of a detailed monitoring screen in the second embodiment. [Figure 11] FIG. 11 is a block diagram showing a monitoring system according to a third embodiment of the present disclosure. [Figure 12] FIG. 2 is a block diagram showing an example of the configuration of a monitoring device. [Figure 13] FIG. 13 is a diagram showing an example of an overall monitoring screen in the third embodiment. [Figure 14] FIG. 13 is a diagram showing an example of a detailed monitoring screen in the third embodiment. [Figure 15] FIG. 1 is a block diagram showing an example of the configuration of a computer device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, an embodiment of the present disclosure will be described in detail with reference to the drawings. Note that the following description and drawings are omitted and simplified as appropriate for clarity of explanation. In addition, in each of the following drawings, the same elements and similar elements are given the same reference numerals, and duplicate explanations are omitted as necessary.

[0016] 1 shows a monitoring system according to a first embodiment of the present disclosure. The monitoring system 100 includes a monitoring device 110 and a plurality of sensors 130. The monitoring device 110 is a device used to monitor a plurality of monitoring targets. The monitoring targets may be, for example, moving objects such as automobiles, buses, construction equipment, or work vehicles, or may be sites such as roads or construction sites. In this embodiment, the number of monitors may be less than the number of monitoring targets.

[0017] Each of the multiple monitored objects has one or more sensors 130. Each sensor 130 acquires sensor data of the monitored object. Each sensor 130 is connected to the monitoring device 110 via, for example, a wireless communication network, a wired communication network, or a combination thereof. Each sensor 130 outputs sensor data to the monitoring device 110. The sensor 130 may include an imaging device such as a camera that acquires an image. The sensor 130 may include a sensor that outputs status information of the monitored object. For example, in the case of a moving object to be monitored, the multiple sensors 130 may include an imaging device mounted on the moving object and a sensor for measuring the speed, acceleration, and steering angle of the moving object. The sensor 130 may be an imaging device that outputs an image of the monitored object as a subject.

[0018] 2 shows an example of the configuration of the monitoring device 110. The monitoring device 110 has an information receiving unit 111, a status analyzing unit 112, a monitor status management unit 113, and a monitor allocation unit 114. The monitoring device 110 can be configured as a computer device including hardware including, for example, one or more processors and one or more memories. At least a part of the function of each unit in the monitoring device 110 can be realized by the one or more processors operating in accordance with a program read from the one or more memories.

[0019] The information receiving unit (information receiving means) 111 receives sensor data from a plurality of sensors 130 (see FIG. 1). In other words, the information receiving unit 111 receives one or more pieces of sensor data from each of a plurality of monitoring targets. For example, when the monitoring targets are moving objects, the information receiving unit 111 receives images captured by an imaging device from each moving object. The information receiving unit 111 also receives information on speed, acceleration, and steering angle from each moving object. The plurality of monitoring targets may include an autonomous driving vehicle that runs autonomously. In that case, the information receiving unit 111 may receive information on automatic driving. When the monitoring target is a construction site, the information receiving unit 111 may receive images of the work target site. The monitoring target may be a work vehicle such as a heavy machine at a construction site, and in that case, the information receiving unit 111 may receive images including the work vehicle as a subject.

[0020] The state analysis unit (state analysis means) 112 analyzes the state of each of the multiple monitoring targets based on the received sensor data, and determines whether a predetermined event has occurred in each monitoring target. The predetermined event includes, for example, an event that requires detailed monitoring by a monitor. The predetermined event may include an event that requires a response by a monitor. For example, when the monitoring target is a moving object, the state analysis unit 112 determines whether an event that requires careful monitoring of the moving object has occurred. When the moving object is a vehicle capable of autonomous driving, the state analysis unit 112 may determine whether an event that requires a response (instruction) from the monitor has occurred in the moving object. Examples of events that require a response from the monitor include events that are difficult for the vehicle to drive on its own judgment, such as when an autonomous vehicle overtakes another vehicle or when the vehicle resumes driving from a temporary stop. When the monitoring target is a construction site, the state analysis unit 112 may determine whether an event that requires careful monitoring of the construction site has occurred. For example, the state analysis unit 112 may determine whether a person is approaching a work vehicle at a construction site. Furthermore, the state analyzing unit 112 may determine whether the work is being performed in a predetermined order, or whether the work is being performed by a predetermined number of people or more.

[0021] The state analysis unit 112 may further calculate the monitoring importance of a predetermined event that occurs in the monitored object. The monitoring importance is, for example, an index indicating the importance of monitoring. For example, in monitoring a predetermined event, if a monitor does not monitor carefully, a serious accident may occur or an immediate response is required, the monitoring importance is set high. On the other hand, if a serious accident does not occur as a result of some oversight, or if a waiting time until a response is not a problem, the monitoring importance is set low. The state analysis unit 112 determines the monitoring importance according to a predetermined event that occurs in the monitored object, for example. For example, if the event that occurs is overtaking a vehicle, the monitoring importance may be set high. On the other hand, if the event that occurs is resuming driving from a temporary stop, the monitoring importance may be set low. The monitoring importance may be calculated, for example, from a score that is previously associated with the event. For example, the monitoring importance may be previously determined as 1 point for resuming driving from a temporary stop, 3 points for crosswalks, and 5 points for overtaking, and may be determined from the score corresponding to the event that occurs. The state analysis unit 112 may change the monitoring importance depending on the situation of the monitored object when a predetermined event occurs. For example, the monitoring importance may be predefined as 5 points when the event occurs on a road with many people, and 1 point when the event occurs on a straight road with good visibility, and may be calculated by adding the points to the score determined depending on the event. For example, when the monitored object is a mobile object, the state analysis unit 112 may calculate the monitoring importance depending on the number of passengers riding on the mobile object, the condition of the road on which the mobile object is traveling (main road, residential area, etc.), or a combination thereof. For example, when the event that occurs is an overtaking of a vehicle and occurs on a road with a lot of pedestrian traffic, the monitoring importance may be set high. On the other hand, when the event that occurs is an overtaking of a vehicle and occurs on a straight road with good visibility, the monitoring importance may be set slightly lower.

[0022] The monitor status management unit (monitor status management means) 113 manages a load index indicating the labor of the monitoring task for each of multiple monitors who monitor at least one of multiple monitoring targets. The monitor status management unit 113 manages the labor of the monitoring task for a given period, such as the day when monitoring is performed or one week, as a load index. The load index can be determined according to, for example, the total amount of time that the monitor was responsible for detailed monitoring tasks (total monitoring time), the number of times that the monitor was responsible for detailed monitoring tasks (total number of times), the total amount of monitoring importance of the detailed monitoring tasks that the monitor was responsible for (total monitoring importance), or a combination of these.

[0023] Each of the load index standards may be managed by a unit corresponding to the standard (number of times, time, etc.), or may be managed as a level by predetermining a range of values. For example, the ranges may be set as follows: 1-3 hours of total monitoring time is "low", 4-6 hours is "medium", and 7 hours or more is "high", and if monitor A's total monitoring time is 4 hours, the level of monitor A's total monitoring time may be managed as "medium". Alternatively, the ranges may be set as follows: 1-10 times is "low", 11-20 times is "standard", and 21 times or more is "high", and if monitor B's total number of times is 15, the level of monitor B's total number of times may be managed as "standard".

[0024] Furthermore, the level may be assigned for each criterion, or may be determined by a combination of criteria. For example, if monitor C's total monitoring time is "high" and the total number of times of responsibility is "high," the load index of monitor C may be managed as "high," and if monitor D's total monitoring time is "low" and the total number of times of responsibility is "low," the load index of monitor C may be managed as "low."

[0025] When the state analysis unit 112 determines that a predetermined event has occurred in one or more monitoring targets, the monitor allocation unit (monitor allocation means) 114 determines a monitor to be in charge of detailed monitoring of the monitoring targets in which it has been determined that the predetermined event has occurred. At that time, the monitor allocation unit 114 determines which of the multiple monitors will be in charge of detailed monitoring, based on the predetermined event that has occurred and the load index of each monitor.

[0026] The monitor allocation unit 114 determines which monitors will be in charge of detailed monitoring tasks so that, for example, detailed monitoring tasks are appropriately distributed among multiple monitors and the load index is leveled. In other words, the monitor allocation unit 114 determines which monitors will be in charge of detailed monitoring tasks so that detailed monitoring tasks are not concentrated on a specific monitor. For example, the monitor allocation unit 114 may compare the total monitoring times of multiple monitors and assign detailed monitoring tasks to a monitor with a short total monitoring time. Alternatively, the monitor allocation unit 114 may assign detailed monitoring tasks to a monitor with a small total number of times of assignment. The monitor allocation unit 114 may assign detailed monitoring tasks to a monitor with a small value of total monitoring importance.

[0027] When it is determined that a predetermined event has occurred in multiple monitoring targets, the monitor allocation unit 114 may determine a monitor in charge of monitoring tasks in descending order of monitoring importance. For example, assume that two predetermined events with different monitoring importance have occurred. In this case, the monitor allocation unit 114 first determines a monitor in charge of detailed monitoring tasks for the predetermined event with high monitoring importance. For example, the monitor allocation unit 114 assigns detailed monitoring tasks with high monitoring importance to a monitor with the shortest total monitoring time. Next, the monitor allocation unit 114 determines a monitor in charge of detailed monitoring tasks for the predetermined event with low monitoring importance. For example, the monitor allocation unit 114 assigns detailed monitoring tasks with low monitoring importance to a monitor with the second shortest total monitoring time.

[0028] The monitor status management unit 113 may further manage the monitoring tasks that each monitor can handle. For example, the monitor status management unit 113 manages information that a certain monitor can handle detailed monitoring tasks when an event A occurs and detailed monitoring tasks when an event B occurs. The monitor status management unit 113 also manages information that another monitor can handle detailed monitoring tasks when an event B occurs and detailed monitoring tasks when an event C occurs. The monitor allocation unit 114 may use the information on the monitoring tasks that each monitor can handle to identify one or more monitors among the multiple monitors who can handle the monitoring tasks of a monitoring target in which a predetermined event is determined to have occurred. The monitor allocation unit 114 may determine a monitor who will handle detailed monitoring tasks among the one or more identified monitors based on the predetermined event that has occurred and the load index of each monitor.

[0029] FIG. 3 shows an example of information about each monitor managed by the monitor status management unit 113. The monitor status management unit 113 manages information about each monitor, such as "presence status," "monitoring vehicle," "total monitoring time," "load index," and "responsibility." "Presence status" indicates whether the monitor is present or not, that is, whether the monitor is able to perform monitoring tasks. "Monitoring vehicle" indicates a moving object where the monitor is performing detailed monitoring tasks. "Total monitoring time" indicates the time during which the monitor performed detailed monitoring tasks. "Load index" indicates the load index of the monitoring tasks. "Responsibility" indicates the monitoring tasks that the monitor can be responsible for. For example, when an incident that requires a response occurs at a crosswalk, the monitor allocation unit 114 determines that of monitors B and C who are able to be responsible for the incident at the crosswalk, monitor C, who has the lower load index, is the person in charge of the incident at the crosswalk.

[0030] The monitor status management unit 113 may further manage the response capability of each monitor to a specific event in the detailed monitoring task described above. For example, for each monitor, the monitor status management unit 113 manages the response time indicating the time from the start of the detailed monitoring task to the end of the task for each specific event as the response capability. Specifically, for monitor A, the monitor status management unit 113 may manage the time from the start of the detailed monitoring task for event A by monitor A to the end of the task for event A as the response capability for event A. Alternatively, the monitor status management unit 113 may manage the number of times detailed monitoring tasks are assigned to each monitor for each specific event as the response capability. The monitor allocation unit 114 may determine the monitor in charge of the detailed monitoring task based on the response capability of each monitor in addition to the load index of each monitor. In this case, the monitor allocation unit 114 may assign, for example, a monitor who can quickly respond to a certain event as the person in charge of the detailed monitoring task.

[0031] FIG. 4 shows another example of information about each monitor managed by the monitor status management unit 113. The monitor status management unit 113 manages information about each monitor, such as "occupancy status," "monitored vehicle," "total monitoring time," "load index," and "response ability." In FIG. 4, "response ability" indicates the time from when each monitor starts detailed monitoring work for a specific event to when the monitor finishes dealing with the specific event. For example, when an event occurs that requires action to make a right or left turn, the monitor allocation unit 114 determines that, of monitors B and D who are available to handle the event, monitor D, who has handled the event relatively quickly in the past, is the person in charge of the event that requires action to make a right or left turn.

[0032] In the above description, it has been described that in determining a monitor who will be in charge of detailed monitoring of a monitoring target in which a predetermined event has been determined to have occurred, the monitor allocation unit 114 determines a monitor according to any one of pieces of information and a load index held by the monitor status management unit 113. However, this embodiment is not limited to this. For example, the monitor allocation unit 114 may determine a monitor who will be in charge of detailed monitoring of a monitoring target according to a plurality of pieces of information and a load index held by the monitor status management unit 113. For example, the monitor allocation unit 114 may determine a monitor who will be in charge of monitoring according to the type of detailed monitoring task of the monitoring target (e.g., crosswalk, bus stop), response capability, and total monitoring time.

[0033] In the above description, values ​​are described for the information managed by the monitor status management unit 113, but this embodiment is not limited to this. For example, the monitor status management unit 113 may manage each item by dividing it into a standard, high level, and low level.

[0034] The monitoring device 110 may further have a monitoring screen display unit (monitoring screen display means). The monitoring screen display unit controls screen display on multiple display devices (not shown) used by multiple monitors. The monitor allocation unit 114 notifies the monitoring screen display unit of information on the monitor determined as the monitor in charge of monitoring operations. The monitor allocation unit 114 notifies the screen display unit of information on the determined monitor, such as the monitor's name, identification information (ID), seat number, identification number of the display device used by the monitor, and IP (Internet Protocol) address.

[0035] The monitoring screen display unit displays one or more pieces of sensor data received from the monitoring target in which it is determined that a predetermined event has occurred, on a display device to be used by a monitor determined by the monitor allocation unit 114 among the multiple display devices. The monitoring screen display unit displays, for example, an image of the monitoring target on the display device. The monitor performs detailed monitoring of the monitoring target in which it is determined that a predetermined event has occurred while watching the image displayed on the display device. The monitor remotely controls the monitoring target as necessary.

[0036] When a monitor performs detailed monitoring work, the monitor status management unit 113 updates the load index of that monitor according to the monitoring importance calculated by the status analysis unit 112. For example, the monitor status management unit 113 updates the load index of the monitor who performed detailed monitoring work by adding a value according to the monitoring importance to the load index of the monitor who performed detailed monitoring work. In addition, when a monitor performs detailed monitoring work, the monitor status management unit 113 updates items related to the monitoring work, such as response capability (the time required to respond to the monitoring work, etc.) and total monitoring time.

[0037] The monitoring screen display unit may be capable of displaying on the display device a first monitoring screen for overall monitoring of multiple monitoring targets and a second monitoring screen for detailed monitoring of a monitoring target where a predetermined event has occurred. The first monitoring screen may include an area for displaying sensor data received from multiple monitoring targets. The first monitoring screen may include an area for notifying a predetermined event determined to have occurred by the state analysis unit 112. The second monitoring screen includes an area for displaying sensor data received from a specific monitoring target. For example, only the sensor data received from the specific monitoring target is displayed on the second monitoring screen. Alternatively, on the second monitoring screen, the sensor data of the specific monitoring target may be displayed in a relatively larger area than the sensor data of the other monitoring targets.

[0038] The monitoring screen display unit may display a first monitoring screen on a display device when the state analysis unit 112 has not determined that a predetermined event has occurred in one or more monitoring targets. For example, the monitoring screen display unit may display the first monitoring screen on each of one or more display devices used individually by each monitor, and have the multiple monitors monitor the multiple monitoring targets. Alternatively, the monitoring screen display unit may display the first monitoring screen on a large display device used in common by multiple monitors, and have the multiple monitors monitor the multiple monitoring targets.

[0039] When it is determined that a predetermined event has occurred and the monitor allocation unit 114 has determined a monitor who will be in charge of detailed monitoring tasks, the monitoring screen display unit may display a second monitoring screen on one or more display devices used individually by that monitor. The monitor performs detailed monitoring tasks for the monitoring target by viewing video of the monitoring target in which it has been determined that a predetermined event has occurred, which is displayed on the display device. The monitoring screen display unit may display the first monitoring screen on display devices used by other monitors, and have the other monitors monitor multiple monitoring targets.

[0040] Next, the operation procedure will be described. Fig. 5 shows the operation procedure (monitoring method) in the monitoring device 110. In the monitoring device 110, the information receiving unit 111 receives one or more pieces of sensor data from each of the multiple monitoring targets (step S1). The status analyzing unit 112 analyzes the status of each of the multiple monitoring targets based on the received sensor data (step S2), and determines whether or not a predetermined event has occurred in each monitoring target (step S3).

[0041] If it is determined in step S3 that a predetermined event has occurred, the monitor allocation unit 114 determines, from among the multiple monitors, a monitor who will be in charge of monitoring the monitoring target for which it is determined that a predetermined event has occurred, based on the predetermined event that has occurred and the load index of each monitor (step S4). The monitoring screen display unit may display a detailed monitoring screen (second monitoring screen) of the monitoring target for which it is determined that a predetermined event has occurred, on a display device used by the monitor determined in step S4, from among the multiple display devices.

[0042] As described above, according to this embodiment, when determining which of multiple monitors will be responsible for detailed monitoring tasks of a specific monitoring target, it is possible to make an appropriate allocation among the multiple monitors.

[0043] For example, detailed monitoring work when a certain event occurs does not require much effort, whereas detailed monitoring work when a different event occurs may take time to deal with and may place a high burden on the monitoring work. In this embodiment, when a specific event occurs in a monitoring target, the monitoring personnel in charge of the detailed monitoring work is determined using the load index of the monitoring work that each monitor has been in charge of in the past. Therefore, in this embodiment, when determining a monitor from multiple monitors to be in charge of detailed monitoring work for a specific monitoring target, the monitoring work load can be appropriately distributed among the multiple monitors.

[0044] A second embodiment of the present disclosure will be described. Fig. 6 shows a monitoring system (remote monitoring system) according to the second embodiment of the present disclosure. In this embodiment, a remote monitoring system 200 has a remote monitoring device 210, a plurality of moving objects 230, and a monitoring screen display device 250. In this embodiment, the monitoring system 100 described in the first embodiment is applied to remote monitoring of a plurality of moving objects 230.

[0045] The remote monitoring device 210 is a device for remotely monitoring a plurality of mobile objects 230. The remote monitoring device 210 is connected to the mobile objects 230 via a network 270. The network 270 includes a wireless communication network using a communication line standard such as LTE (Long Term Evolution). The network 270 may include a wireless communication network such as WiFi (registered trademark) or a fifth generation mobile communication system. The remote monitoring device 210 may be capable of remotely controlling the mobile objects 230. The remote monitoring device 210 corresponds to the monitoring device 110 shown in FIG. 1.

[0046] The monitoring screen display device 250 is a display device for displaying information used for monitoring the mobile object 230 to the monitor (operator). The monitoring screen display device 250 does not necessarily need to be a device independent of the remote monitoring device 210, and may be a part of the remote monitoring device 210. The monitoring screen display device 250 includes a display device such as a liquid crystal display device. The monitoring screen display device 250 may include a display device used individually by each monitor. Each monitor may use two or more display devices individually. The monitoring screen display device 250 may include a display device used commonly by multiple monitors.

[0047] Each moving body 230 is remotely monitored by the remote monitoring device 210. The moving body 230 is configured as a land vehicle such as an automobile, a bus, a taxi, or a truck. The moving body 230 may be an object that moves underwater or on water, such as an underwater drone, or an object that moves in the air, such as an airborne drone. The moving body 230 may be configured to be capable of automatic driving (autonomous driving) based on information from a sensor mounted on the moving body. The moving body 230 may be configured to be switchable between automatic driving and manual driving by a driver in the vehicle. The moving body 230 may be switched from manual driving to automatic driving or from automatic driving to manual driving, for example, in response to an instruction transmitted from the remote monitoring device 210. The moving body 230 may be a train, a ship, or an aircraft, or may be a mobile robot such as an AGV (Automated Guided Vehicle).

[0048] 7 shows a configuration example of a moving object 230. The moving object 230 has a surroundings monitoring sensor 231, a vehicle sensor 232, a vehicle control ECU (Electric Control Unit) 233, an automatic driving ECU 234, and a communication device 235. In the moving object 230, these components are configured to be able to communicate with each other via an in-vehicle LAN (Local Area Network) or a CAN (Controller Area Network), etc.

[0049] The periphery monitoring sensor 231 is a sensor that monitors the surrounding conditions of the moving body 230. In the following description, the periphery monitoring sensor 231 will be described taking a camera as an example, but is not limited to this. The periphery monitoring sensor 231 includes, for example, a camera, a depth camera, a radar, and a LiDAR (Light Detection and Ranging). The periphery monitoring sensor 231 may include, for example, a plurality of cameras that capture images of the front, rear, right side, and left side of the vehicle. The periphery monitoring sensor 231 may include a camera that captures images of the inside of the moving body 230.

[0050] The vehicle sensor 232 is a sensor for detecting various states of the moving body 230. The vehicle sensor 232 includes, for example, a vehicle speed sensor for detecting the vehicle speed, a steering sensor for detecting the steering angle, an accelerator pedal position sensor for detecting the accelerator pedal position, and a brake pedal pressure sensor for detecting the amount of depression of the brake pedal. The vehicle sensor 232 may include a position information sensor for acquiring position information of the moving body 230. At least one of the periphery monitoring sensor 231 and the vehicle sensor 232 corresponds to the sensor 130 shown in FIG. 1.

[0051] The vehicle control ECU 233 is an electronic control device that performs driving control of the mobile object 230. In general, an electronic control device has a processor, a memory, an I / O (Input / Output), and a bus connecting these. Based on sensor information output by the vehicle sensor 232, the vehicle control ECU 233 performs various controls such as control of the fuel injection amount, control of the engine ignition timing, and control of the amount of assist of the power steering.

[0052] The autonomous driving ECU 234 is an electronic control device that controls autonomous driving of the mobile object 230. The autonomous driving ECU 234 acquires sensor information from the surrounding monitoring sensor 231 and the vehicle sensor 232, and controls autonomous driving of the mobile object 230 based on the acquired sensor information.

[0053] The communication device 235 is configured as a device that performs wireless communication between the mobile object 230 and the network 270 (see FIG. 6). The communication device 235 includes, as a hardware configuration, an antenna for wireless communication, a transmitter, and a receiver. The communication device 235 also has a processor, a memory, an I / O, and a bus connecting these. The functions of each part in the communication device 235 are realized, for example, by executing a control program stored in the memory by the processor.

[0054] The communication device 235 acquires camera images captured by the periphery monitoring sensor 231, and transmits the acquired camera images (image data) to the remote monitoring device 210 via the network 270. The communication device 235 also acquires sensor information such as vehicle speed information from the vehicle sensor 232, and transmits the acquired sensor information to the remote monitoring device 210 via the network 270.

[0055] The communication device 235 can receive information related to the control of the moving body 230 from the remote monitoring device 210 via the network 270. The communication device 235 can receive, for example, control information indicating the control content (e.g., control command) for the automatic driving performed in the moving body 230 from the remote monitoring device 210. The control content includes, for example, "stop", "overtake", "slow down", and "start". The communication device 235 may receive information such as parameters set in the automatic driving ECU 234 from the remote monitoring device 210. The communication device 235 transmits the received information to the automatic driving ECU 234 via an in-vehicle LAN or the like. The automatic driving ECU 234 controls the traveling of the moving body 230 according to the received control content. In addition, the automatic driving ECU 234 performs automatic driving of the moving body 230 using the received parameters and the like.

[0056] The communication device 235 may receive remote control information, which is information for remotely controlling the moving object 230, from the remote monitoring device 210. The remote control information includes information indicating, for example, the accelerator opening, the operation amount of the steering wheel, and the depression amount of the brake pedal. When the communication device 235 receives the remote control information, it transmits the received remote control information to the vehicle control ECU 233 via an in-vehicle LAN or the like. The vehicle control ECU 233 controls the moving object 230 based on the received remote control information.

[0057] FIG. 8 shows a configuration example of the remote monitoring device 210. The remote monitoring device 210 includes a vehicle information receiving unit 211, a vehicle state analyzing unit 212, an importance calculating unit 213, a vehicle state managing unit 214, a monitor state managing unit 215, a monitor allocating unit 216, a monitoring screen display unit 217, and an operating unit 218. The vehicle information receiving unit 211 receives information transmitted from a communication device 235 (see FIG. 7) of each moving body 230. The information received by the vehicle information receiving unit 211 may include images captured by a plurality of cameras mounted on the moving body 230. The vehicle information receiving unit 211 receives, for example, images of the front, rear, right side, and left side of the moving body 230. The vehicle information receiving unit 211 may receive sensor information acquired by a vehicle sensor 232 from the moving body 230. The vehicle information receiving unit 211 corresponds to the information receiving unit 111 shown in FIG. 2.

[0058] The vehicle state analysis unit 212 analyzes the state of the moving object 230 by using the information received by the vehicle information receiving unit 211. For example, the vehicle state analysis unit 212 performs a video analysis on the video received by the vehicle information receiving unit 211, and analyzes the state of the moving object 230 based on the result of the video analysis. The vehicle state analysis unit 212 analyzes the state of each of the multiple moving objects 230 to determine whether a predetermined event has occurred in each moving object 230.

[0059] In this embodiment, the vehicle state analysis unit 212 issues an alert in response to the detection of a predetermined event. The alerts issued by the vehicle state analysis unit 212 may include, for example, "approaching on-street parking," "entering an intersection," "approaching a crosswalk," "entering a dangerous area," and "approaching a bus stop." The vehicle state analysis unit 212 recognizes a stopped vehicle ahead from a change in distance of an object on a driving lane, using, for example, an analysis engine for object detection, lane detection, and distance estimation. For example, the vehicle state analysis unit 212 issues an alert of "approaching on-street parking" when a stopped vehicle is recognized on a driving lane. The vehicle state analysis unit 212 recognizes that the moving body will turn right or left from, for example, route information of the moving body stored as the external information 220, information such as a turn signal acquired from the moving body 230, a current position, and at least one of a designated position or a road marking. When the vehicle state analysis unit 212 recognizes that the moving body will turn right or left, it issues an alert of "entering an intersection."

[0060] The vehicle state analysis unit 212 recognizes that the moving body is approaching a crosswalk, for example, from map information stored as external information 220, the moving body's current position, and a designated position or road markings. When the vehicle state analysis unit 212 recognizes that the moving body is approaching a crosswalk, it issues an alert of "approaching crosswalk." The vehicle state analysis unit 212 may also issue an alert of "approaching crosswalk" when it recognizes that the moving body is approaching a crosswalk and there are people around the crosswalk.

[0061] The vehicle state analysis unit 212 judges whether the mobile object has entered a preset area where accidents are likely to occur, for example, from map information stored as the external information 220 and the current position of the mobile object. When the mobile object has entered an area where accidents are likely to occur, the vehicle state analysis unit 212 issues an alert of "entering dangerous area". When the mobile object has approached a bus stop, the vehicle state analysis unit 212 judges whether the mobile object is approaching a bus stop, from route information of the mobile object stored as the external information 220 and the current position of the mobile object. When the mobile object has approached a bus stop, the vehicle state analysis unit 212 issues an alert of "approaching bus stop". The vehicle state analysis unit 212 may refer to operation plan information of the mobile object stored as the external information 220, and issue an alert of "approaching bus stop" when the current time is close to the time when the mobile object arrives at the bus stop or the time when the mobile object departs from the bus stop.

[0062] The vehicle state analysis unit 212 stores the analyzed vehicle state for each of the multiple moving bodies in the vehicle state management unit 214. For example, for an issued alert, the vehicle state management unit 214 stores the occurrence time, type, and importance (priority) of the alert itself. The importance of the alert itself is set higher, for example, for an alert that is more likely to endanger human life. For example, the importance of the alerts themselves for "entering intersection," "approaching pedestrian crossing," and "entering dangerous area" is set to high importance. The vehicle state management unit 214 further stores the current location of the moving body, the number of passengers, the predicted arrival time and target arrival time at the next destination (bus stop), the vehicle speed, the person in charge of monitoring, and the monitoring importance.

[0063] When the vehicle state analysis unit 212 issues an alert, in other words, when a predetermined event occurs in the mobile object 230, the importance calculation unit 213 calculates the monitoring importance of the mobile object 230. The importance calculation unit 213 may calculate the monitoring importance according to, for example, the importance of the issued alert itself, the elapsed time from the occurrence of the alert, the vehicle speed of the mobile object, the road conditions (main road, residential area, etc.), and the time until the limit of the response. When the mobile object is a vehicle such as a bus, for example, the importance calculation unit 213 may calculate the importance according to the number of passengers and a difference value (delay time) from the scheduled operation. The difference value from the scheduled operation is represented, for example, by the difference between the predicted arrival time at the next destination and the scheduled arrival time at the destination.

[0064] Specifically, the importance calculation section 213 may calculate the importance using the following formula, for example, with α being a predetermined coefficient greater than 1. Importance = α x (importance of the alert itself) + (number of passengers) x (difference from scheduled operation) In this case, the monitoring importance can be changed according to the difference from the scheduled operation and the number of passengers while placing importance on the priority of the alert itself. The importance calculation unit 213 stores the calculated monitoring importance in the vehicle state management unit 214. The vehicle state analysis unit 212 and the importance calculation unit 213 correspond to the state analysis unit 112 shown in FIG. 2.

[0065] The monitor status management unit 215 stores information on multiple monitors. For example, for each of the multiple monitors, the monitor status management unit 215 stores the accumulated monitoring time, the identifier (ID) of the display device used for monitoring, the seating flag, the vehicle in charge, and the monitoring load index. The monitor status management unit 215 may further store information indicating which detailed monitoring work related to which alert each monitor can be in charge of. For example, the monitor status management unit 215 stores information indicating that a certain monitor can be in charge of detailed monitoring work when "entering intersection" and "approaching pedestrian crossing" are issued. The monitor status management unit 215 corresponds to the monitor status management unit 113 shown in FIG. 2.

[0066] When an alert is issued by the vehicle state analysis unit 212, the monitor allocation unit 216 determines a monitor who will be responsible for detailed monitoring of the mobile object for which the alert was issued. In this case, the monitor allocation unit 216 determines which monitor will be responsible for detailed monitoring from among multiple monitors, based on the issued alert and the load index of each monitor stored in the monitor state management unit 215. When the alerts that each monitor can handle are determined, the monitor allocation unit 216 determines which monitor will be responsible for detailed monitoring from among the monitors who can handle detailed monitoring of the issued alert. The monitor allocation unit 216 corresponds to the monitor allocation unit 114 shown in FIG. 2.

[0067] The monitor allocation unit 216 notifies the monitoring screen display unit 217 of information about the monitor determined as the monitor in charge of the monitoring task. The monitor allocation unit 216 notifies the monitoring screen display unit 217 of information about the determined monitor, such as the name, identification information (ID), seat number, identification number, and IP address of the monitor used by the monitor.

[0068] The monitoring screen display unit 217 controls the screen display on the monitoring screen display device 250. When the vehicle state analysis unit 212 has not issued an alert, the monitoring screen display unit 217 causes the monitoring screen display device 250 to display an overall monitoring screen (first monitoring screen) for monitoring multiple moving objects. When the monitor allocation unit 216 has determined a monitor who will be in charge of detailed monitoring of the moving object for which an alert has been issued, the monitoring screen display unit 217 causes the display device used by that monitor to display a detailed monitoring screen (second monitoring screen) of the moving object 230 for which an alert has been issued.

[0069] FIG. 9 shows an example of an overall monitoring screen. In the example of FIG. 9, the overall monitoring screen includes areas displaying information on a total of 10 mobile objects 230. The areas for each mobile object 230 include an image display area, an alert occurrence status display area, and a map information display area. The image display area is an area for displaying an image received from the mobile object. The alert occurrence status display area is an area for notifying an alert issued in the mobile object. The map information display area is an area for displaying a location where the mobile object is traveling. In the overall monitoring screen, the border of the area displaying information on a mobile object for which an alert has occurred may be displayed in a predetermined color, for example, red, or may be highlighted. In the example of FIG. 9, an alert has occurred in a mobile object with the number "03", and the area displaying information on the mobile object is surrounded by a thick border.

[0070] FIG. 10 shows an example of a detailed monitoring screen. For example, the detailed monitoring screen displays information about one moving object 230 that the monitor is in charge of. The detailed monitoring screen includes areas in which images of the front, rear, right side, and left side of the moving object 230 are displayed. In the detailed monitoring screen, information about the moving object for which an alert has been issued is displayed in an enlarged manner compared with the information about the moving object in the overall monitoring screen shown in FIG. 9. The monitor determined as the person in charge can perform detailed monitoring of the moving object for which an alert has been issued by viewing the detailed monitoring screen. In the image display area, the object that caused the issued alert, such as another vehicle or a pedestrian, may be surrounded by a figure such as a rectangle. In this case, the monitor can know the position of the object that caused the issued alert on the screen.

[0071] In the above, an example has been shown in which information on one moving object managed by the monitor is displayed on the detailed monitoring screen, but the present embodiment is not limited to this. When information on a plurality of moving objects 230 is displayed on the detailed monitoring screen, the area in which information on the moving object managed by the monitor is displayed may be highlighted. For example, on a detailed monitoring screen in which information on a plurality of moving objects is displayed, information on the moving object managed by the monitor may be displayed in a larger size than information on other moving objects. In other words, information on the moving object managed by the monitor may be displayed enlarged, and information on other moving objects may be displayed reduced.

[0072] Returning to FIG. 8, the operation unit 218 accepts input of control information for the moving object 230. The operation unit 218 includes input devices such as a touch panel and a mouse. A monitor in charge of detailed monitoring of a moving object for which an alert has been generated judges the situation around the moving object 230 by viewing the image displayed on a detailed monitoring screen (see FIG. 10). The monitor inputs control information for the moving object 230 to the operation unit 218 as a response to the alert. Possible responses to the alert include, for example, "no response required," "stop," "start command," "automatic overtaking command," and "switch to remote driving." The operation unit 218 can also accept control information for any moving object 230 from a monitor who monitors multiple moving objects 230 using an overall monitoring screen.

[0073] The operation unit 218 transmits a control signal indicating the control information input by the monitor to the mobile object 230 via the network 270 (see FIG. 6). The communication device 235 (see FIG. 7) of the mobile object 230 receives the control signal from the remote monitoring device 210. In the mobile object 230, the automatic control ECU 234 controls the mobile object 230 according to the control content indicated by the received control signal. The operation unit 218 may transmit information for remotely controlling the mobile object 230 to the mobile object 230. The operation unit 218 includes equipment for remotely operating the vehicle, such as a steering wheel, an accelerator pedal, and a brake pedal. The monitor (remote driver) can operate the steering wheel and the like while watching the image displayed on the detailed monitoring screen. The operation unit 218 transmits information indicating the operation amount of the steering wheel and the like to the mobile object 230.

[0074] In this embodiment, when the vehicle state analysis unit 212 has not issued an alert, the multiple moving objects 230 are monitored by multiple monitors. Some of the multiple monitors may be devices using AI (Artificial Intelligence). When the number of monitors is less than the number of moving objects 230 to be monitored, the monitoring of the moving objects 230 can be performed efficiently. When the vehicle state analysis unit 212 issues an alert, the monitor allocation unit 216 determines a monitor who will perform detailed monitoring of the moving object 230 for which the alert has been issued from among the multiple monitors. At that time, the monitor allocation unit 216 determines a monitor who will perform detailed monitoring using the load index of the past monitoring work of each monitor. The monitor determined as the person in charge performs detailed monitoring of the moving object 230 for which the alert has been issued. In this embodiment, the monitor in charge of detailed monitoring is determined using the load index of the monitoring work that was previously performed, so that the load of the monitoring work can be leveled among the multiple monitors. Therefore, this embodiment can prevent monitoring work requiring a large amount of effort from being concentrated on a specific monitor.

[0075] A third embodiment of the present disclosure will be described. FIG. 11 shows a monitoring system according to the third embodiment of the present disclosure. In this embodiment, the monitoring system 300The present embodiment includes a monitoring device 310, a plurality of sites 330, and a monitoring screen display device 350. In this embodiment, the monitoring system 100 described in the first embodiment is applied to monitoring a plurality of sites 330.

[0076] The monitoring device 310 is a device for monitoring a plurality of sites 330. In FIG. 11, the monitoring device 310 is used to remotely monitor a site A 330 and a site B 330. The site A and the site B do not necessarily have to be sites in different locations. For example, the site A and the site B may be imaging data and sensor information of cameras in different areas of the same site, or imaging data and sensor information of cameras capturing images of the same site from different locations. The monitoring device 310 is connected to the plurality of sites 330 via a network 370. The network 370 includes, for example, a wireless communication network, a wired communication network, or a combination thereof. The monitoring device 310 corresponds to the monitoring device 110 shown in FIG. 1. The monitoring screen display device 350 is a display device for displaying information used for monitoring the site 330 to a monitor (operator). The monitoring screen display device 350 corresponds to the monitoring screen display device 250 shown in FIG. 6.

[0077] Each site 330 is monitored by the monitoring device 310. Each site 330 may be a site where a work vehicle such as heavy machinery is operating, such as a construction site. Each site 330 has a site information transmission unit 331 and one or more cameras 332. The camera 322 may be a fixed camera or a camera mounted on the work vehicle. The site information transmission unit 331 transmits images captured by each camera 332 to the monitoring device 310 via the network 370. The site information transmission unit 331 may transmit sensor data of the work vehicle to the monitoring device 310. The sensor data of the work vehicle includes information such as the angle of the bucket and the angle of the arm. The camera 332 corresponds to the sensor 130 shown in FIG. 1.

[0078] 12 shows an example of the configuration of a monitoring device 310. The monitoring device 310 has a site information receiving unit 311, a site state analyzing unit 312, an importance calculating unit 313, a site state managing unit 314, a monitor state managing unit 315, a monitor allocating unit 316, a monitoring screen display unit 317, and an operation unit 318. The site information receiving unit 311 receives information transmitted from a site information transmitting unit 331 (see FIG. 11) of each site 330. The site information receiving unit 311 receives an image captured by a camera 332 from each site 330. The site information receiving unit 311 corresponds to the information receiving unit 111 shown in FIG. 2.

[0079] The site state analysis unit 312 analyzes the state of the site 330 using the information received by the site information receiving unit 311. For example, the site state analysis unit 312 performs a video analysis on the video received by the site information receiving unit 311, and analyzes the state of the site 330 based on the result of the video analysis. The site state analysis unit 312 analyzes the state of each of the multiple videos of the multiple sites 330, thereby determining whether or not a predetermined event has occurred within the shooting range of the camera 332 of each site 330.

[0080] In this embodiment, the site condition analysis unit 312 issues an alert when a predetermined event is detected. The alerts issued by the site condition analysis unit 312 may include, for example, "unsafe behavior" and "work error." For example, the site condition analysis unit 312 performs human detection, human skeleton detection, and related equipment object detection on the image of the camera 332. For example, the site condition analysis unit 312 detects a work vehicle such as an excavator and a worker from the image of the camera 332. If the distance between the work vehicle and the worker is within a predetermined distance, the site condition analysis unit 312 issues an alert of "unsafe behavior."

[0081] For example, the site condition analysis unit 312 may identify a scaffold for high-altitude work from the image of the camera 332 and determine whether or not a worker working on the scaffold for high-altitude work is wearing a safety hook. When the site condition analysis unit 312 determines that a worker working on the scaffold for high-altitude work is not wearing a safety hook, it issues an alert for "unsafe behavior."

[0082] The site condition analysis unit 312 analyzes the progress of work, for example, from the image captured by the camera 332. If the work is not being performed in accordance with a predetermined work procedure, the site condition analysis unit 312 issues an alert of "work error." As an example, the site condition analysis unit 312 analyzes the status of compaction work performed by a compactor. If the number of compactions does not reach a predetermined number, the site condition analysis unit 312 issues an alert of "work error."

[0083] The site state analysis unit 312 stores the analyzed site state for each of the multiple sites in the site state management unit 314. The site state management unit 314 stores, for example, the occurrence time, type, and importance of the alert itself for the issued alert. The importance of the alert itself is set higher, for example, for an alert with a higher possibility of causing an accident. For example, the importance of an "unsafe behavior" alert itself is set to a high importance. The site state management unit 314 may store the type of object and the number of objects included in the video of the camera 332.

[0084] The importance calculation unit 313 calculates the monitoring importance of the predetermined event that occurred at the site when it is determined that a predetermined event has occurred within the shooting range of each camera 332. The importance calculation unit 313 may calculate the monitoring importance according to, for example, the importance of the issued alert itself, the distance between the relevant equipment and the person, and whether or not the event has been dealt with. When multiple types of objects exist within the shooting range of the camera 332, the importance calculation unit 313 may calculate the monitoring importance according to the number of objects of each type.

[0085] Specifically, the importance calculation unit 313 sets α to a predetermined coefficient greater than 1, and i The importance may be calculated using the following formula, where x is a predetermined coefficient for object i: Severity = α × (importance of the alert itself) + Σ[β i × (number of objects i)] In this case, the monitoring importance can be changed according to the number of objects of each type while placing importance on the priority of the alert itself. The importance calculation unit 313 stores the calculated monitoring importance in the site status management unit 314. The site status analysis unit 312 and the importance calculation unit 313 correspond to the status analysis unit 112 shown in FIG.

[0086] The monitor status management unit 315 stores information on multiple monitors. For each of the multiple monitors, the monitor status management unit 315 stores, for example, the accumulated monitoring time, an identifier (ID) of the display device used for monitoring, a presence flag, a site (camera) in charge, and a monitoring load index. The monitor status management unit 315 may further store information indicating which alert each monitor is capable of taking charge of detailed monitoring tasks related to. The monitor status management unit 315 corresponds to the monitor status management unit 113 shown in FIG. 2.

[0087] When an alert is issued by the site status analysis unit 312, the monitor allocation unit 316 determines a monitor who will be responsible for detailed monitoring of the camera video for which the alert was issued. In this case, the monitor allocation unit 316 determines which monitor will be responsible for the detailed monitoring work from among multiple monitors, based on the issued alert and the load index of each monitor stored in the monitor status management unit 315. When the alerts that each monitor can handle are determined, the monitor allocation unit 316 determines which monitor will be responsible for the detailed monitoring work from among the monitors who can handle the detailed monitoring work for the issued alert. The monitor allocation unit 316 corresponds to the monitor allocation unit 114 shown in FIG. 2.

[0088] The monitoring screen display unit 317 controls the screen display on the monitoring screen display device 350. When the site state analysis unit 312 has not issued an alert, the monitoring screen display unit 317 causes the monitoring screen display device 350 to display an overall monitoring screen for monitoring multiple sites. When the monitor allocation unit 316 has determined a monitor to be in charge of detailed monitoring of the site where an alert has been issued, the monitoring screen display unit 317 causes the display device used by that person to display a detailed monitoring screen of the site where the alert has occurred.

[0089] FIG. 13 shows an example of an overall monitoring screen. In the example of FIG. 13, the overall monitoring screen includes areas displaying images from a total of four sites (cameras). On the overall monitoring screen, the border of the area displaying the image from the camera for which an alert has occurred may be displayed in a predetermined color, for example, red, or may be highlighted. In the example of FIG. 13, an alert has occurred in the camera CAM2, and the area displaying the image from that camera is surrounded by a thick border. The overall monitoring screen may display the notification history of the alert, or may display information such as the operation or process of the target captured in each image.

[0090] FIG. 14 shows an example of a detailed monitoring screen. For example, the detailed monitoring screen displays an image from one camera that the monitor is in charge of. In the detailed monitoring screen, the image from the camera where the alert occurred is displayed in an enlarged manner compared to the image from that camera in the overall monitoring screen shown in FIG. 13. The monitor who has been determined as the person in charge can perform detailed monitoring of the site where the alert was issued by viewing the detailed monitoring screen. In the image display area, an object that caused the issued alert, such as heavy machinery or a person, may be surrounded by a figure such as a rectangle. In this case, the monitor can know the position of the object that caused the issued alert on the screen.

[0091] Returning to Fig. 12, the operation unit 318 accepts input of control information for the site 330. A monitor in charge of detailed monitoring of the site where an alert has occurred judges the situation at the site by viewing the image displayed on the detailed monitoring screen (see Fig. 14). The monitor inputs control information for issuing a warning to the operation unit 318 as a response to the alert. If the work vehicle can be remotely controlled, the monitor can input control information for the work vehicle as a response to the alert.

[0092] The operation unit 318 transmits a control signal indicating the control information input by the supervisor to the site 330 via a network 370 (see FIG. 6). At the site 330, a notification unit such as a speaker or lamp (not shown) issues an alert to a person working at the site. If the control signal includes control information for the work vehicle, the work vehicle operates in accordance with the control information.

[0093] In this embodiment, when the site state analysis unit 312 does not issue an alert, the multiple sites 330 are monitored by multiple supervisors. When the number of supervisors is less than the number of sites 330 to be monitored, the monitoring of the sites 330 can be performed efficiently. When the site state analysis unit 312 issues an alert, the supervisor allocation unit 316 determines a supervisor who will perform detailed monitoring work of the site 330 where the alert was issued from among the multiple supervisors. In this case, the supervisor allocation unit 316 determines a supervisor who will perform detailed monitoring work using the load index of past monitoring work of each supervisor. The supervisor determined as the supervisor performs detailed monitoring work of the site 330 where the alert was issued. In this embodiment, the supervisor who will perform detailed monitoring work is determined using the load index of the monitoring work that was previously handled, so that the load of the monitoring work can be leveled among the multiple supervisors. Therefore, in this embodiment as well, as in the second embodiment, it is possible to prevent a particular supervisor from being concentrated with monitoring work that requires a lot of effort.

[0094] In the above second and third embodiments, an example has been described in which a red border is used on the overall monitoring screen (see Figs. 9 and 13) to highlight a monitoring target for which an alert has occurred. However, the present disclosure is not limited to this. The display color of the border is not limited to red, and may be blue or green. The border may be displayed in a blinking manner to highlight a monitoring target for which an alert has occurred.

[0095] Alternatively or in addition to the above, on the overall monitoring screen, the brightness of the display of a monitoring target for which an alert has occurred may be changed from that of a monitoring target for which an alert has not occurred, thereby emphasizing the monitoring target for which an alert has occurred. For example, on the overall monitoring screen, the display brightness of a monitoring target for which an alert has not occurred may be lowered, and a monitoring target for which an alert has occurred may be displayed relatively brightly.

[0096] On the overall monitoring screen, the manner of highlighting may be changed depending on the monitoring importance of the monitoring target for which an alert has occurred. For example, on the overall monitoring screen, for a monitoring target with the highest monitoring importance, a red frame may be displayed flashing around the area displaying information about that monitoring target. On the overall monitoring screen, for a monitoring target with a less high monitoring importance, the area displaying information about that monitoring target may be surrounded by a frame of a color other than red, for example, blue. In this case, when situations with different monitoring importance occur in multiple monitoring targets, the monitor can easily recognize the monitoring target in which a situation with high monitoring importance has occurred.

[0097] In the present disclosure, the monitoring device 110 may be configured as a computer device (server device). Fig. 15 shows an example of the configuration of a computer device that may be used as the monitoring device 110. The computer device 500 has a control unit (CPU: Central Processing Unit) 510, a storage unit 520, a ROM (Read Only Memory) 530, a RAM (Random Access Memory) 540, a communication interface (IF: Interface) 550, and a user interface 560. The computer device 500 may be used as the remote monitoring device 210 or the monitoring device 310.

[0098] The communication interface 550 is an interface for connecting the computer device 500 to a communication network via a wired communication means or a wireless communication means, etc. The user interface 560 includes a display unit such as a display, and an input unit such as a keyboard, a mouse, and a touch panel.

[0099] The storage unit 520 is an auxiliary storage device that can hold various data. The storage unit 520 does not necessarily need to be a part of the computer device 500, and may be an external storage device or a cloud storage connected to the computer device 500 via a network.

[0100] The ROM 530 is a non-volatile storage device. For example, a semiconductor storage device having a relatively small capacity, such as a flash memory, is used for the ROM 530. The programs executed by the CPU 510 may be stored in the storage unit 520 or the ROM 530. The storage unit 520 or the ROM 530 stores various programs for implementing the functions of each unit in the remote monitoring device 210, for example.

[0101] The program includes a set of instructions (or software code) that, when loaded into a computer, causes the computer to perform one or more functions described in the embodiments. The program may be stored in a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, the computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, Compact Disc (CD), digital versatile disc (DVD), Blu-ray® disk or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, the transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0102] The RAM 540 is a volatile storage device. Various semiconductor memory devices such as a dynamic random access memory (DRAM) or a static random access memory (SRAM) are used for the RAM 540. The RAM 540 can be used as an internal buffer for temporarily storing data and the like. The CPU 510 loads a program stored in the storage unit 520 or the ROM 530 into the RAM 540 and executes it. The CPU 510 executes the program, thereby realizing the functions of each unit in the remote monitoring device 210. The CPU 510 may have an internal buffer for temporarily storing data and the like.

[0103] Although the embodiments of the present disclosure have been described in detail above, the present disclosure is not limited to the above-described embodiments, and changes and modifications to the above-described embodiments that do not deviate from the spirit of the present disclosure are also included in the present disclosure.

[0104] For example, some or all of the above embodiments may be described as, but are not limited to, the following supplementary notes.

[0105] [Appendix 1] An information receiving means for receiving one or more pieces of sensor data from each of a plurality of monitoring targets; a state analysis means for analyzing a state of each of the plurality of monitored objects based on the sensor data and determining the occurrence of a predetermined event in each monitored object; a supervisor status management means for managing a load index indicating a workload of a supervisor for each of a plurality of supervisors who supervises at least one of the plurality of monitoring targets; a monitor assignment means for determining, when the status analysis means determines that the specified event has occurred in one or more monitored objects, which monitor is to be assigned to monitor the monitored objects for which the specified event has occurred, based on the specified event that has occurred and the load index, from among the multiple monitors.

[0106] [Appendix 2] The state analysis means further calculates a monitoring importance of a predetermined event that occurs in the monitoring target, The monitoring device according to claim 1, wherein the monitor status management means updates a load index of a monitor determined by the monitor allocation means in accordance with the monitoring importance when the monitor performs the monitoring task.

[0107] [Appendix 3] The monitoring device described in Appendix 2, wherein the monitor assignment means, when it is determined that a specified event has occurred in the multiple monitored objects, determines a monitor to be in charge of the monitoring task in order of the monitoring importance.

[0108] [Appendix 4] the monitoring target is a moving object, The monitoring device described in Appendix 2 or 3, wherein the condition analysis means calculates the monitoring importance based on the number of occupants in the moving body, the condition of the road on which the moving body is traveling, or a combination thereof.

[0109] [Appendix 5] The supervisor status management means further manages the supervisory tasks that each of the multiple supervisors can handle; The monitoring device described in any one of Appendices 1 to 4, wherein the monitor allocation means identifies one or more monitors among the multiple monitors who can be responsible for monitoring the monitoring target for which it is determined that the specified event has occurred, and determines which of the identified one or more monitors will be responsible for the monitoring task based on the specified event that has occurred and the load index.

[0110] [Appendix 6] The monitor status management means further manages the response capabilities of each of the plurality of monitors to the predetermined event in the monitoring task, 6. The monitoring device according to claim 1, wherein the monitor allocation means further determines a monitor to be in charge of the monitoring task based on the response capability.

[0111] [Appendix 7] The method further comprises a monitoring screen display means for displaying, on a display device used by the determined monitor, one or more pieces of sensor data received from the monitor target in which it is determined that the predetermined event has occurred, The monitoring device described in any one of appendixes 1 to 6, wherein the monitoring screen display means is capable of displaying, on the display device, a first monitoring screen for monitoring the multiple monitoring targets and a second monitoring screen for monitoring the monitoring target in which it is determined that the specified event has occurred, and when the status analysis means has not determined that the specified event has occurred in one or more monitoring targets, has the monitor use the first monitoring screen to monitor the multiple monitoring targets, and when the monitor assignment means has determined a monitor to be in charge of monitoring the monitoring target in which it is determined that the specified event has occurred, displays the second monitoring screen on a display device used by the determined monitor, and has the monitor monitor the monitoring target in which it is determined that the specified event has occurred.

[0112] [Appendix 8] A monitoring device used to monitor a plurality of monitoring targets; a plurality of sensors for acquiring sensor data of the plurality of monitored objects; The monitoring device includes: an information receiving means for receiving sensor data from the plurality of sensors; a state analysis means for analyzing a state of each of the plurality of monitored objects based on the sensor data and determining the occurrence of a predetermined event in each monitored object; a supervisor status management means for managing a load index indicating a workload of a supervisor for each of a plurality of supervisors who supervises at least one of the plurality of monitoring targets; a monitor assignment means for determining, when the status analysis means determines that the specified event has occurred in one or more monitored objects, one of the multiple monitors to be in charge of monitoring the monitored objects for which it is determined that the specified event has occurred, based on the occurred specified event and the load index.

[0113] [Appendix 9] The state analysis means further calculates a monitoring importance of a predetermined event that occurs in the monitoring target, The monitoring system of claim 8, wherein the monitor status management means updates a load index of a monitor determined by the monitor allocation means according to the monitoring importance when the monitor performs the monitoring task.

[0114] [Appendix 10] The monitoring system of claim 9, wherein the monitor assignment means, when it is determined that a specified event has occurred in the multiple monitored objects, determines a monitor to be in charge of the monitoring task in order of the monitoring importance.

[0115] [Appendix 11] the monitoring target is a moving object, The monitoring system described in Appendix 9 or 10, wherein the condition analysis means calculates the monitoring importance depending on the number of occupants in the moving body, the condition of the road on which the moving body is traveling, or a combination thereof.

[0116] [Appendix 12] The supervisor status management means further manages the supervisory tasks that each of the multiple supervisors can handle; The monitoring system described in any one of Appendices 8 to 11, wherein the monitor allocation means identifies one or more monitors from among the multiple monitors who can be responsible for monitoring the monitoring target for which it is determined that the specified event has occurred, and determines which of the identified one or more monitors will be responsible for the monitoring task based on the specified event that has occurred and the load index.

[0117] [Appendix 13] The monitor status management means further manages the response capabilities of each of the plurality of monitors to the predetermined event in the monitoring task, 13. The monitoring system according to claim 8, wherein the monitor allocation means further determines a monitor to be in charge of the monitoring task based on the response capability.

[0118] [Appendix 14] the monitoring device further comprises a monitoring screen display means for displaying, on a display device used by the determined monitor, one or more pieces of sensor data received from the monitoring target in which it has been determined that the predetermined event has occurred; The monitoring system described in any one of Appendices 8 to 13, wherein the monitoring screen display means is capable of displaying, on the display device, a first monitoring screen for monitoring the multiple monitoring targets and a second monitoring screen for monitoring the monitoring target in which it is determined that the specified event has occurred, and when the status analysis means has not determined that the specified event has occurred in one or more monitoring targets, has the monitor use the first monitoring screen to monitor the multiple monitoring targets, and when the monitor assignment means has determined a monitor to be in charge of monitoring the monitoring target in which it is determined that the specified event has occurred, displays the second monitoring screen on a display device used by the determined monitor, and has the monitor monitor the monitoring target in which it is determined that the specified event has occurred.

[0119] [Appendix 15] receiving one or more pieces of sensor data from each of a plurality of monitored objects; Analyzing a state of each of the plurality of monitored objects based on the sensor data and determining the occurrence of a predetermined event in each monitored object; A monitoring method which, when it is determined that a specified event has occurred in one or more monitored objects, determines a monitor who is in charge of monitoring the monitored object in which it is determined that the specified event has occurred, from among multiple monitors monitoring at least one of the multiple monitored objects, based on the specified event that has occurred and a load index that indicates the workload of the monitor.

[0120] [Appendix 16] Calculating a monitoring importance of a predetermined event occurring in the monitoring target; The monitoring method according to claim 15, further comprising updating a load index of the determined monitor according to the monitoring importance when the determined monitor performs the monitoring task.

[0121] [Appendix 17] 17. The monitoring method according to claim 16, further comprising the steps of: when it is determined that a specified event has occurred in the plurality of monitored objects, determining a monitor to be in charge of the monitoring task in order of the monitoring importance.

[0122] [Appendix 18] the monitoring target is a moving object, A monitoring method as described in Appendix 16 or 17, wherein the monitoring importance is calculated based on the number of occupants on the moving body, the condition of the road on which the moving body is traveling, or a combination thereof.

[0123] [Appendix 19] The monitoring method described in any one of Appendices 15 to 18, wherein determining the monitor to be in charge of the monitoring task includes identifying one or more monitors among the multiple monitors who are capable of performing the monitoring task of the monitoring target for which it is determined that the specified event has occurred, and determining which of the identified one or more monitors is in charge of the monitoring task based on the specified event that has occurred and the load index.

[0124] [Appendix 20] 20. The monitoring method according to any one of appendixes 15 to 19, wherein determining a monitor to be in charge of the monitoring task includes determining a monitor to be in charge of the monitoring task based on the monitor's ability to respond to the specified event in the monitoring task.

[0125] [Appendix 21] The method further includes displaying, on a display device used by the determined monitor, one or more pieces of sensor data received from the monitor target in which it has been determined that the predetermined event has occurred; A monitoring method as described in any one of Appendices 15 to 20, wherein, when it is not determined that the specified event has occurred in the monitored object, the monitor is made to monitor the multiple monitored objects using a first monitoring screen for monitoring the multiple monitored objects, and when a monitor to be responsible for monitoring the monitored object in which it is determined that the specified event has occurred is determined, a second monitoring screen for monitoring the monitored object in which it is determined that the specified event has occurred is displayed on a display device used by the determined monitor, and the monitor is made to monitor the monitored object in which it is determined that the specified event has occurred. [Explanation of symbols]

[0126] 100: Surveillance system 110: Monitoring device 111: Information receiving unit 112: Status analysis unit 113: Monitor status management unit 114: Supervisor Allocation Department 130: Sensor 200: Remote monitoring system 210: Remote monitoring device 211: Vehicle information receiving unit 212: Vehicle condition analysis unit 213: Importance calculation part 214: Vehicle status management department 215: Monitor status management unit 216: Supervisor Allocation Department 217: Monitoring screen display section 218:Operation unit 230: Mobile 231: Periphery monitoring sensor 232: Vehicle sensor 233: Vehicle control ECU 234:Autonomous driving ECU 235:Communication equipment 250: Monitoring screen display device 270: Network 300: Surveillance system 310: Monitoring device 311: On-site information receiving unit 312: On-site condition analysis department 313: Importance calculation part 314: Site Condition Management Department 315: Monitor status management unit 316: Supervisor Allocation Department 317: Monitoring screen display section 318:Operation unit 330: On-site 331: On-site information transmission department 332: Camera 350: Monitoring screen display device 370: Network 500: Computer equipment 510:CPU 520: Storage section 530:ROM 540:RAM 550: Communication interface 560: User Interface

Claims

1. An information receiving means for receiving one or more pieces of sensor data from each of a plurality of monitoring targets; a state analysis means for analyzing a state of each of the plurality of monitored objects based on the sensor data and determining the occurrence of a predetermined event in each monitored object; a supervisor status management means for managing a load index indicating a workload of a supervisory task and a response capability of each of the supervisors regarding a time required for issuing instructions for the predetermined event, for each of the supervisors who supervise at least one of the plurality of monitoring targets; a monitoring device comprising: a monitor assignment means for determining, when the status analysis means determines that the specified event has occurred in one or more monitored objects, which monitor among the multiple monitors will be responsible for monitoring the monitored objects in which it is determined that the specified event has occurred, based on the specified event that has occurred, the load index, and the response capability.

2. The state analysis means further calculates a monitoring importance of a predetermined event that occurs in the monitoring target, 2. The monitoring device according to claim 1, wherein the supervisor status management means updates a load index of a supervisor determined by the supervisor allocation means according to the monitoring importance when the supervisor performs the monitoring task.

3. 3. The monitoring device according to claim 2, wherein the monitor allocation means, when it is determined that a predetermined event has occurred in the plurality of monitoring targets, determines a monitor to be in charge of the monitoring task in descending order of monitoring importance.

4. the monitoring target is a moving object, 4. The monitoring device according to claim 2, wherein the condition analysis means calculates the monitoring importance level according to a number of occupants in the moving object, a condition of a road on which the moving object is traveling, or a combination thereof.

5. The supervisor status management means further manages the supervisory tasks that each of the multiple supervisors can handle; 5. The monitoring device according to claim 1, wherein the monitor assignment means identifies one or more monitors among the plurality of monitors who are capable of performing the monitoring task of the monitoring target for which it is determined that the specified event has occurred, and determines which of the one or more identified monitors will be responsible for the monitoring task based on the specified event that has occurred and the load index.

6. The method further comprises a monitoring screen display means for displaying, on a display device used by the determined monitor, one or more pieces of sensor data received from the monitor target in which it has been determined that the predetermined event has occurred, 6. The monitoring device according to claim 1, wherein the monitoring screen display means is capable of displaying, on the display device, a first monitoring screen for monitoring the multiple monitoring targets and a second monitoring screen for monitoring the monitoring target in which it is determined that the specified event has occurred, and when the status analysis means has not determined that the specified event has occurred in one or more monitoring targets, has the monitor use the first monitoring screen to monitor the multiple monitoring targets, and when the monitor assignment means has determined a monitor to be in charge of monitoring the monitoring target in which it is determined that the specified event has occurred, displays the second monitoring screen on a display device used by the determined monitor, and has the monitor monitor the monitoring target in which it is determined that the specified event has occurred.

7. A monitoring device used to monitor a plurality of monitoring targets; a plurality of sensors for acquiring sensor data of the plurality of monitored objects; The monitoring device includes: an information receiving means for receiving sensor data from the plurality of sensors; a state analysis means for analyzing a state of each of the plurality of monitored objects based on the sensor data and determining the occurrence of a predetermined event in each monitored object; a supervisor status management means for managing a load index indicating a workload of a supervisory task and a response capability of each of the supervisors regarding a time required for issuing instructions for the predetermined event, for each of the supervisors who supervise at least one of the plurality of monitoring targets; a monitor assignment means for determining, when the status analysis means determines that the specified event has occurred in one or more monitored objects, which of the multiple monitors will be responsible for monitoring the monitored objects in which it is determined that the specified event has occurred, based on the specified event that has occurred, the load index, and the response capability.

8. The state analysis means further calculates a monitoring importance of a predetermined event that occurs in the monitoring target, 8. The monitoring system according to claim 7, wherein the monitor status management means updates a load index of a monitor determined by the monitor allocation means according to the monitoring importance when the monitor performs the monitoring task.

9. 9. The monitoring system according to claim 8, wherein the monitor assignment means, when it is determined that a predetermined event has occurred in the plurality of monitoring targets, determines a monitor to be in charge of the monitoring task in descending order of monitoring importance.

10. the monitoring target is a moving object, 10. The monitoring system according to claim 8, wherein the condition analysis means calculates the monitoring importance level according to the number of occupants in the vehicle, the condition of a road on which the vehicle is traveling, or a combination thereof.

11. The supervisor status management means further manages the supervisory tasks that each of the multiple supervisors can handle; 11. The monitoring system according to claim 7, wherein the monitor allocation means identifies one or more monitors among the plurality of monitors who are capable of performing the monitoring task of the monitoring target for which it is determined that the specified event has occurred, and determines which of the one or more identified monitors will be responsible for the monitoring task based on the specified event that has occurred and the load index.

12. the monitoring device further comprises a monitoring screen display means for displaying, on a display device used by the determined monitor, one or more pieces of sensor data received from the monitoring target in which it has been determined that the predetermined event has occurred; 12. The monitoring system according to claim 7, wherein the monitoring screen display means is capable of displaying on the display device a first monitoring screen for monitoring the multiple monitoring targets and a second monitoring screen for monitoring the monitoring target in which it is determined that the specified event has occurred, and when the status analysis means has not determined that the specified event has occurred in one or more monitoring targets, has the monitor use the first monitoring screen to monitor the multiple monitoring targets, and when the monitor assignment means has determined a monitor to be in charge of monitoring the monitoring target in which it is determined that the specified event has occurred, displays the second monitoring screen on a display device used by the determined monitor, and has the monitor monitor the monitoring target in which it is determined that the specified event has occurred.

13. A computer receives one or more pieces of sensor data from each of a plurality of monitored objects; The computer analyzes a state of each of the plurality of monitored objects based on the sensor data and determines the occurrence of a predetermined event in each monitored object; When the computer determines that the specified event has occurred in one or more monitored targets, the monitoring method determines, from among multiple monitors monitoring at least one of the multiple monitored targets, a monitor to be in charge of monitoring the monitored target in which it has been determined that the specified event has occurred, based on the specified event that has occurred, a load index indicating the effort of the monitor's monitoring work, and the monitor's response ability regarding the time it takes to give instructions for the specified event.

14. The computer calculates a monitoring importance of a predetermined event that occurs in the monitored object, 14. The monitoring method according to claim 13, further comprising, when the determined monitor performs the monitoring task, the computer updating a load index of the monitor in accordance with the monitoring importance.

15. 15. The monitoring method according to claim 14, wherein, when it is determined that a predetermined event has occurred in the plurality of monitoring targets, the computer determines a monitor who will be in charge of the monitoring task in descending order of the monitoring importance.

16. the monitoring target is a moving object, The monitoring method according to claim 14 or 15, wherein calculating the monitoring importance level includes calculating the monitoring importance level depending on the number of occupants in the moving body, the condition of the road on which the moving body is traveling, or a combination thereof.

17. 17. The monitoring method according to claim 13, wherein determining the monitor to be in charge of the monitoring task includes identifying one or more monitors among the plurality of monitors who are capable of performing the monitoring task of the monitoring target in which it is determined that the specified event has occurred, and determining which of the identified one or more monitors is in charge of the monitoring task based on the specified event that has occurred and the load index.

18. The method further comprises the computer displaying, on a display device used by the determined monitor, one or more sensor data received from the monitored object in which it has been determined that the predetermined event has occurred; 18. The monitoring method according to claim 13, wherein, when it is not determined that the specified event has occurred in the monitoring target, the computer has the monitor monitor the multiple monitoring targets using a first monitoring screen for monitoring the multiple monitoring targets, and when a monitor to be responsible for monitoring the monitoring target in which it is determined that the specified event has occurred has been determined, the computer displays a second monitoring screen for monitoring the monitoring target in which it is determined that the specified event has occurred on a display device used by the determined monitor, and has the monitor monitor the monitoring target in which it is determined that the specified event has occurred.

Images