Program, monitoring apparatus, and monitoring method

Abstract

To disclose a monitoring system that can detect and react to abnormal events in real-time.SOLUTION: An information processing system comprises: a specification unit that on the basis of sensor data, specifies an event position at which an event is generated; a selection unit that on the basis of the specified event position and performance of a camera drive unit, selects a camera to be controlled; and a control unit that controls a direction of the selected camera so as to contain the event.SELECTED DRAWING: Figure 14

Description

Technical Field

[0001] The present invention relates to a technique for processing information.

Background Art

[0002] For example, the above real-time analysis techniques such as video analysis and audio analysis can detect abnormal events at the scene. Generally, an administrator manually analyzes data from sensors located near the event to recognize the situation or learn the details of the event. The administrator manually selects relevant information from periodic or continuous sensor data to better recognize the situation or learn more details of the event. Since the analysis results and the sensor data used in the above analysis may be insufficient for making a decision regarding the event, this procedure causes a delay in the administrator's reaction to the abnormal event.

Summary of the Invention

Problems to be Solved by the Invention

[0003] There is a need for a system that can automatically select and control sensors so as to show details of the event, including a view that provides a more detailed look and an overview that provides a broader view of the event as it unfolds. This is to enable the administrator to respond immediately based on the information within the provided view. Further, other desirable features and characteristics will become apparent from the following detailed description and the appended claims in conjunction with the accompanying drawings and the background of this disclosure.

[0004] In view of the above, a main object of the present invention is to provide a monitoring system or the like that can detect and react to abnormal events in real time.

Means for Solving the Problems

[0005] An information processing system according to an aspect of the present disclosure includes a specifying means for specifying an event position where an event has occurred based on sensor data, a selecting means for selecting a camera to be controlled based on the specified event position and the performance of a camera driving unit, and a controlling means for controlling the direction of the selected camera so as to include the event.

[0006] An information processing method according to an aspect of the present disclosure specifies an event position where an event has occurred based on sensor data, selects a camera to be controlled based on the specified event position and the performance of a camera driving unit, and controls the direction of the selected camera so as to include the event.

[0007] A program according to an aspect of the present disclosure causes a computer to execute a specifying process for specifying an event position where an event has occurred based on sensor data, a selecting process for selecting a camera to be controlled based on the specified event position and the performance of a camera driving unit, and a controlling process for controlling the direction of the selected camera so as to include the event.

Advantages of the Invention

[0008] According to the present invention, it is possible to provide a monitoring system or the like that can detect and react to abnormal events in real time.

Brief Description of the Drawings

[0009] The accompanying drawings, which are incorporated in and constitute a part of this specification, together with the following detailed description, illustrate various embodiments of the present invention and serve to explain the various principles and advantages of the present invention. The features and advantages of the present invention will become apparent from the following detailed description when taken in conjunction with the accompanying drawings.

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13A

Figure 13B

Figure 14

Figure 15

[0010] Those skilled in the art will recognize that the elements in the above figures are shown simply and clearly and are not necessarily drawn to scale. For example, the dimensions of some of the elements in the above figures showing integrated circuit configurations may be shown larger relative to other elements to aid in understanding the present embodiment and other embodiments.

Best Mode for Carrying Out the Invention

[0011] The following detailed description is merely a factual example and is not intended to limit the invention or its uses and applications. Also, there is no intention to be limited by any theory presented in the background of the invention described above or in the following detailed description.

[0012] First, the basic concept of an embodiment of the present invention will be described. Referring to FIG. 1, a sensor used in a monitoring system of the related art is shown. The system detects an abnormal event position 10 in an event area 12 by a first sensor (microphone) 30 and selects a camera 32 that is the closest camera to the abnormal event position 10. However, the closest camera 32 captures only a part of the abnormal event position 10, and the administrator can receive only limited information (information within the camera screen 34) regarding the abnormal event position 10 from the camera 32. In this case, since the closest camera 32 captures some of the surrounding people instead of the people lying on the floor, the administrator does not recognize the person or people lying on the floor. The administrator can try to learn the situation by manually operating some of the sensors around the abnormal event position 10. However, it takes time to learn what is happening and respond to the event, for example, by calling a medical worker. In some cases, the delay in response can be fatal.

[0013] Referring to FIG. 2, a sensor used in a monitoring system according to an embodiment of the present invention is shown. The monitoring system detects an abnormal event position 10 with a first sensor 30 and estimates the abnormal event position 10 within an event area 12. The monitoring system selects other sensors (camera 42 and other sensors) located near the abnormal event position 10. The monitoring system covers the entire event area 12 with a combination of the FOV (Field of View) for the directional fixed sensors of the other sensors and / or the FOR (Field of Regarding) for the omnidirectional or movable sensors. The monitoring system controls the selected sensors (microphone 30, microphone 40 and / or camera 42) to sense the detected abnormal event position 10. At this time, the selected sensor (camera 42) captures the entire event area image 46 (by the camera 42). Thereafter, the administrator can recognize a person (or people) lying on the floor without manual operation. Since the administrator can learn and respond to the situation without delay, it may be possible to handle the situation before it becomes fatal.

[0014] According to an embodiment of the present invention, it is possible for an administrator to recognize an event by learning the details of the event with the appearance of the event with a wider display as well as a closer display of the event. This is because the monitoring system can select and control sensors as described below. Due to this advantage, the administrator can immediately respond to the event.

[0015] Referring to FIGS. 3 and 4, a block diagram and a flowchart according to an embodiment of the present invention are disclosed. A monitoring system 1000 receives sensor data continuously from a sensor (not shown) at a sensor data receiving unit 100 (step 200). The sensor data receiving unit 100 transmits the received data to a coverage analysis unit 102. The coverage analysis unit 102 performs a coverage analysis that analyzes the coverage information of the sensor by comparing the coverage information with event-related data such as, for example, the size of the event and / or the movement of the event. The coverage analysis unit 102 identifies the best sensor for observing the abnormal event at the abnormal event position 10 (step 202). A sensor selection unit 104 selects one or more sensors (the best sensors) based on the coverage analysis by the coverage analysis unit 102 (step 204). A sensor driving unit 106 drives one or more sensors in response to a signal from the sensor selection unit 104 (step 206). Therefore, it can be understood that the system of FIG. 3 operates according to the method of FIG. 4 to automatically select and drive the best sensor for observing the abnormal event as it unfolds. In this way, the administrator can advantageously glance at the development of the event and be able to initiate an appropriate and timely response.

[0016] Referring to FIGS. 5 and 6, a block diagram and a flowchart according to another embodiment are disclosed. The monitoring system 2000 according to another embodiment continuously receives sensor data from a sensor (not shown) at the sensor data receiving unit 100 (step 200), and analyzes the received data by the data analysis unit 108 (step 208). When the data received by the sensor data receiving unit 100 is transmitted to the data analysis unit 108, the data analysis unit 108 analyzes the received data to identify event-related information. The data analysis unit 108 identifies event-related information, that is, the abnormal event position 10 and the magnitude of the event, and transfers this event-related information to the coverage analysis unit 102 (step 208). In this way, the data analysis unit 108 continuously examines the data received from the sensor data receiving unit 100. When the data analysis unit 108 determines that an event of interest to the administrator has occurred, the data analysis unit 108 determines the abnormal event position 10 of interest and the magnitude of the event. Then the data analysis unit 108 transfers the event-related information to the coverage analysis unit 102, which serves as a trigger for the event coverage operation (coverage analysis) of the coverage analysis unit 102. The coverage analysis unit 102 then performs a coverage analysis to identify the best sensor to observe the event as it unfolds (step 202). The sensor selection unit 104 receives information identifying the best sensor to observe the event and selects a sensor to drive according to the information from the coverage analysis (step 204). The sensor driving unit 106 drives the sensor so that the administrator can advantageously track the event with the best coverage available from the system (step 206).

[0017] The coverage analysis unit 102 analyzes the coverage of each sensor and identifies a suitable sensor for observing the detected event. The coverage analysis unit 102 analyzes the sensor coverage information by comparing the coverage information with event-related data such as, for example, the size of the event and / or the movement of the event. Thereafter, the coverage analysis unit 102 transmits the result to the sensor selection unit 104. This is to enable the sensor selection unit 104 to select the sensor closest to the detected event that has a FOV (Field Of View) of a directional fixed sensor and a FOR (Field of Regarding) of an omnidirectional or movable sensor that is large enough to capture the event.

[0018] The coverage analysis by the coverage analysis unit 102 may include analysis based on the type of event. There are several types of monitored events, and the information useful to the administrator varies for each type of event. The coverage analysis unit 102 according to the present embodiment is customized according to the type of event and provides information useful to the administrator for each event.

[0019] In a certain scenario, for abandoned objects in a public area, the administrator may be concerned because they may pose a safety risk. For example, in an object tracking system at a railway station, it is possible to determine an object that remains stationary and then select a camera that can observe the object closely. In another scenario, the administrator may be concerned about congestion. To monitor a congestion event, in some parts of the event scene, it may be insufficient for the administrator to make a decision and respond immediately. Therefore, a camera that can observe the event in a panoramic display is selected.

[0020] The coverage analysis by the coverage analysis unit 102 may take into account map information. The map information includes information on walls or other spaces that define the structure. In actual situations, the coverage of sensors tends to be obstructed by various objects. The coverage analysis unit 102 according to the present embodiment takes into account, for example, objects that are other spaces defining walls or structures when determining the optimal FOV and / or FOR.

[0021] In a certain scenario, there is a wall between the event location and the camera, and the event cannot be photographed by the camera. To provide useful information to the administrator, from the list of sensor selections, cameras that cannot photograph the event due to the wall are excluded, and a camera that can photograph the event is selected. If there is no camera that can directly photograph the event area, then at that time, a microphone that can capture the area is selected.

[0022] Also, the coverage analysis by the coverage analysis unit 102 may include an analysis based on the performance of the sensor driving unit. The sensor driving unit 106 can change the sensor settings, for example, pan-tilt-zoom (PTZ), based on the information from the sensor selection unit 104. Also, the sensor driving unit 106 can change the direction of the sensor. By taking into account these performances of the sensor driving unit 106 and the sensor, the coverage of each sensor is specified, and the best sensor for capturing an event is specified by the coverage analysis 202 according to the present embodiment.

[0023] (First Embodiment) Referring to FIG. 7, a first embodiment of the present invention is disclosed. In this first embodiment, a monitoring system (monitoring system 2000) selects a sensor suitable for observing the detected event. For example, a multi-sensory combined monitoring device, which is a monitoring camera with a microphone, is arranged in the monitoring area. The camera configuration in the illustrated monitoring area is shown as fixed cameras (32, 42, 52, 62, and 72) with microphones (30, 40, 50, 60, and 70). For example, a fixed camera without a microphone or a single sensor device that is just a microphone may also be used. The sensor data receiving unit 100 receives data from these sensor devices and passes the data to the data analysis unit 108. The sensor data receiving unit 100 may perform media conversion processes such as decoding, encoding, transcoding, and resolution conversion if necessary.

[0024] The data analysis unit 108 analyzes the data from the sensor devices. The data may include abnormal group behavior such as a group that gathers and disperses, detected by a certain camera. The data may also include abnormal sounds such as screams or breaking sounds, detected by a certain microphone. The data analysis unit 108 can analyze the data detected by a single sensor or multiple sensors. The data analysis unit 108 passes the result of the data analysis to the coverage analysis unit 102. The data analysis unit 108 can pass metadata about the detected event, such as the location of the event, the possibility of the same type of event, the time of the event, a list of possible events, and candidates for the next possible event.

[0025] Referring to FIG. 8, it discloses the first situation of the sensors used in the monitoring system 2000 of the first embodiment of the present invention. The coverage analysis unit 102 identifies the sensors that are suitable for observing the events detected by the data analysis unit 108. The coverage analysis unit 102 identifies, for each sensor, the sensor coverage information that is, for example, the FOV (field of view) of a directional fixed sensor or the FOR (field of regard) of an omnidirectional or movable sensor. In one example, the coverage analysis unit 102 identifies the sensors having an FOV or FOR that overlaps with the position of the detected event. Regarding the event detected by the microphone 60, the coverage analysis unit 102 identifies the camera 32 instead of the camera 52 or the camera 62, because the FOV 36 of the camera 32 has the FOV that overlaps the most with the FOR 68 of the microphone 60. Also, regarding the event detected by the camera 62, the coverage analysis unit 102 identifies the camera 32 instead of the camera 52. This is because the FOV 36 of the camera 32 has a coverage area that overlaps more with the FOV 66 of the camera 62 compared to the FOV of the camera 52.

[0026] Referring to FIG. 9, it discloses the second situation of the first embodiment of the present invention. The coverage analysis unit 102 identifies the camera having an FOV or FOR that covers the size of the event estimated by the data analysis unit 108. Regarding the event detected by the microphone 60, the coverage analysis unit 102 identifies the camera 52 instead of the camera 32 or the camera 62. This is because while the FOV of the camera 62 partially covers the event, the FOV 56 of the camera 52 covers the entire estimated event area of the abnormal event position 10. Also, the camera 52 is closer to the abnormal event position 10 compared to the camera 32. Therefore, the coverage analysis unit 102 identifies the camera 52.

[0027] Referring to FIG. 10, the third situation of the first embodiment of the present invention is disclosed. The coverage analysis unit 102 identifies the camera based on the map information including the wall or other spaces defining the structure. If there are other spaces defining the wall or structure within the coverage of the sensor, the coverage analysis 202 takes into account the other spaces defining the wall or structure. Regarding the event detected by the microphone 40, the coverage analysis unit 102 identifies the microphones 40 and 30 instead of the camera 52 because the display of the camera 52 is blocked by the wall 20. Since other spaces defining the wall or structure can have a significant impact on the identification of the sensor, taking the map information into account in the coverage analysis helps to provide accurate information to the administrator.

[0028] In another example, the coverage analysis unit 102 may identify the camera based on the installation configuration of the sensor. There are various types of administrator requests. The administrator may, in a certain situation, desire to obtain information regarding the surroundings of an event rather than the event itself. In such a situation, the coverage analysis 202 based on the installation configuration of the sensor will be useful to the administrator. The coverage analysis unit 102 can determine one or more of a plurality of sensors capable of capturing an object or a person leaving the event location according to the installation configuration of the sensor and the event-related data. Also, the coverage analysis unit 102 can determine one or more of a plurality of sensors capable of monitoring the unfolding event. One or more of such a plurality of sensors include at least one of a plurality of sensors that capture most of the spaces defined within the range of the space defining the structure in the map information.

[0029] According to the first embodiment of the present invention, the monitoring system can detect and respond to abnormal events in real time. This is because the coverage analysis unit 102 analyzes data according to a rule-based algorithm method, a machine learning algorithm method, and / or a geographical map-based algorithm. Also, information on other spaces that define a wall or structure may be included in the FOV information rather than the map information.

[0030] The coverage analysis unit 102 can further analyze data by combining one or more algorithm methods according to a Boolean formula, calculate the results of one or more of these algorithm methods according to the scores of the results of one or more of these algorithm methods, and / or prioritize the results by the algorithm method according to the predetermined priorities of one or more of these algorithm methods. The coverage analysis unit 102 may analyze data according to a machine learning algorithm method, and the machine learning algorithm method is based on AdaBoost that regards these algorithm methods as weak learners. Further, the coverage analysis unit 102 may analyze data according to a clustering algorithm to divide a plurality of sensors into one or more suitable sensor clusters and one or more unsuitable sensor clusters.

[0031] The coverage analysis unit 102 passes the information of the specified sensor to the sensor selection unit 104. The sensor selection unit 104 selects a sensor and transmits the information of the selected sensor to the sensor driving unit 106. The sensor selection unit 104 can pass, for example, metadata that is event information to the sensor driving unit 106. The sensor selection unit 104 can also pass the sensor list and metadata to the application system to present them to the administrator and prompt the administrator to monitor the selected sensors. The sensor selection unit 104 may also select more than one sensor. When the sensor selection unit 104 selects a plurality of sensors, the sensor selection unit 104 can output a sensor list with a sensor priority score indicating the priority or ranking of the optimal sensors.

[0032] If necessary, the sensor driving unit 106 can change the sensor settings based on the information from the sensor selection unit 104. In order to capture local events and observe the events closely, the sensor driving unit 106 can change the sensor settings by changing the volume, resolution, or PTZ zoom settings for optimal coverage of the event position. Also, in order to capture wide-area events and observe the entire scene of the event, the sensor driving unit 106 changes the sensor settings by changing the volume, resolution, or PTZ zoom settings for optimal wide-area coverage of the event position.

[0033] (Second Embodiment) In the second embodiment of the present invention, the monitoring system does not select a suitable sensor. Instead, it lists candidates for various viewings. The viewings include, but are not limited to, various displays surrounding the event. The monitoring system captures the area of the event from a zoomed-out camera and learns what is happening around the event. Alternatively, the monitoring system captures the exit of the room when an event occurs indoors. The viewings can also include viewings near the subjects of the event. The monitoring system captures the event closely to learn the subject or cause of the event.

[0034] The coverage analysis unit 102 determines one or more of a plurality of sensors capable of monitoring the unfolding event and outputs selection data to the sensor selection unit 104. The sensor selection unit 104 includes the identification of one or more of a plurality of sensors capable of monitoring the unfolding event.

[0035] Referring to FIG. 11, the coverage analysis unit 102 identifies sensors for various fields of view. For example, the field of view includes identifying a camera based on the coverage of the FOV or FOR of an event. In this example, the coverage analysis unit 102 identifies the camera 32 that displays the area around the abnormal event position 10 as detected by the microphone 60, because the FOV of the camera 32 covers the area around the abnormal event position 10. Also, the coverage analysis unit 102 identifies the camera 52 that displays the subject of the event as detected nearby by the microphone 60. This is because the FOV of the camera 52 covers the abnormal event position 10 and the camera 52 is closer to the abnormal event position 10 compared to the camera 32. Therefore, the system lists the cameras 32 and 52 along with their fields of view (e.g., proximity, wide area) so that the administrator can select each display based on the desired field of view.

[0036] Referring to FIG. 12, the field of view also includes identifying a camera based on the coverage of the FOV and / or FOR. In this example, the coverage analysis unit 102 identifies the camera 32 that displays the area around the event detected by the microphone 60, because the FOV of the camera 32 has the FOV that overlaps the most with the FOR of the microphone 60. Also, the coverage analysis unit 102 identifies the camera 52 that closely displays the subject of the event detected by the microphone 60. This is because the FOV of the camera 52 has coverage that overlaps with the FOR of the microphone 60 and the camera 52 is close to the microphone 60. Therefore, in this example, the system lists the cameras 32 and 52 so that the administrator can select each display based on the desired field of view.

[0037] The coverage analysis unit 102 passes the result to the sensor selection unit 104. The sensor selection unit 104 passes the information including the field of view information to the sensor drive unit 106. The sensor selection unit 104 passes the list of sensors and the metadata to the application system that presents information to the user / administrator, and can prompt the user to monitor one or more of the selected sensors. The sensor drive unit 106 can change the sensor settings based on the field of view information from the sensor selection unit 104 if necessary. The sensor selection unit 104 selects one or more of the plurality of sensors according to the selection data monitored by the administrator. The selection data includes a sensor priority score. The sensor selection unit selects more than one of the plurality of sensors according to the selection data monitored by the administrator according to the sensor priority score. The sensor selection unit further outputs a list for one or more of the plurality of sensors, together with the corresponding sensor priority score for the proposed optimal monitoring by the administrator.

[0038] According to the second embodiment of the present invention, the monitoring system can detect and react to abnormal events in real time. This is because the administrator can select each display based on the list candidates for various fields of view. The field of view includes various displays surrounding the event, although not limited to them. The monitoring system captures the event area from the zoom-out camera and learns what is happening around the event.

[0039] (Third Embodiment) In the third embodiment of the present invention, the coverage analysis unit 102 can use map information for sensor coverage analysis and sensor identification. In this third embodiment, there are a plurality of sections in the monitoring field, and each section has one or more cameras and / or microphones. Sound can be detected not only by the microphone in one of the sections, but also by the microphones in the adjacent sections. Therefore, a system is required that can identify the event location and select the camera in the section where the event occurred.

[0040] Referring to FIGS. 13A and 13B, one of the plurality of sensors is a microphone. The sensor data receiving unit 100 receives event-related data including the direction of voice input from the microphone. The coverage analysis unit 102 uses such direction information from a plurality of microphones. If the sound is from inside a certain section, then the system subsequently selects a camera within the section. In the case of FIG. 13A, the system selects camera 42 because the microphone 40 detected that the sound was from inside the section containing camera 42. Also, the other microphones 30, 50, and 60 detected the direction of the sound such that the coverage analysis unit 102 could interpret that the sound was from the section monitored by camera 42.

[0041] On the other hand, if all the sounds are from outside the section, then the system subsequently selects a camera that captures the outside of the section. In the case of FIG. 13B, the system selects camera 72 because all of the microphones 30, 40, 50, and 60 detected that the sounds were all from outside the section.

[0042] According to the third embodiment of the present invention, the monitoring system can detect and respond to abnormal events in real time. This is because the coverage analysis unit 102 can use map information for sensor coverage analysis and sensor identification.

[0043] (Fourth Embodiment) Referring to FIG. 14, the monitoring system 1 in the fourth embodiment of the present invention is described. The monitoring system 1 of the fourth embodiment includes a receiving unit 2, a coverage analysis unit 3, and a sensor selection unit 4.

[0044] The receiving unit 2 receives event-related data from a plurality of sensors. The coverage analysis unit 3 analyzes predetermined data and event-related data from the receiving unit, and the predetermined data includes map information and sensor coverage information. The sensor selection unit 4 is connected to the coverage analysis unit 3 and selects one or more of the plurality of sensors based on the analysis by the coverage analysis unit 3.

[0045] According to the fourth embodiment of the present invention, the monitoring system 1 can detect and respond to abnormal events in real time. This is because the coverage analysis unit 3 analyzes predetermined data and event-related data from selectable receiving units and shows details of events including desired displays.

[0046] It should be further recognized that the embodiments are merely examples and are not intended to limit the scope, applicability, importance, or configuration of the present invention in any way. Rather, the foregoing detailed description will provide a convenient way for those skilled in the art to implement certain embodiments of the present invention. It is understood that various changes may be made to the functions, arrangements, and manufacturing methods of the elements described in certain embodiments without departing from the scope of the present invention as set forth in the appended claims.

[0047] As an example, FIG. 15 shows the configuration of an information processing apparatus 900 (computer) capable of implementing a monitoring system according to an embodiment of the present invention. That is, FIG. 15 shows the configuration of a computer (information processing apparatus) capable of implementing the systems in FIGS. 2 and 7 to 13B, and represents a hardware environment capable of implementing individual functions in the embodiments.

[0048] The information processing apparatus 900 shown in FIG. 15 includes the following as components.

[0049] - CPU 901 (Central Processing Unit) - ROM 902 (Read Only Memory) - RAM903 (Random Access Memory) - Hard Disk 904 (Storage Device) - Communication Interface to External Device 905 (Interface: hereinafter referred to as "I / F") - Reader / Writer 908 capable of reading and writing data stored in Storage Medium 907 such as CD-ROM (Compact Disc Read Only Memory) - Input / Output Interface 909

[0050] The information processing device 900 is a general computer in which these components are connected via a bus 906 (communication line).

[0051] The present invention described in the embodiments taken as examples provides the information processing device 900 shown in FIG. 15 with a computer program, and then reads the computer program into the CPU 901 in such hardware, interprets it, and achieves it by executing it. The computer program can implement the functions shown in the block diagrams (FIGS. 3, 5, 14) or flowcharts (FIGS. 3, 5) referred to in the description of these embodiments. The computer program provided to the device can be stored in a volatile read / write memory (RAM 903) or a non-volatile storage device such as a hard disk 904.

[0052] Also, in the case described, here, it is possible to provide a computer program to such hardware using normal procedures. These procedures include, for example, installing a computer program to the device via any of various storage media 907 such as a CD-ROM, or downloading a computer program from an external source via a communication line such as the Internet. In these cases, the present invention can be understood as being composed of the code forming such a computer program, or of the storage medium 907 storing the code.

[0053] This application claims the benefit of priority based on Singapore Patent Application No. 201407100-0 filed on October 30, 2014, the disclosure of which is hereby incorporated by reference in its entirety.

[0054] The foregoing description of the embodiments is provided to enable a person skilled in the art to make and use the invention. Further, various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles and specific examples defined herein may be applied to other embodiments without the use of inventive faculty. Accordingly, the invention is not intended to be limited to the embodiments described herein, but is accorded the widest scope defined by the claims and the equivalents thereof. Further, it should be noted that even if the claims are amended during the prosecution of the application, the intention of the inventor is to maintain all equivalents of the invention described in the claims.

Description of Reference Numerals

[0055] 10 Abnormal event position 12 Event area 14 Direction of sound 20 Wall 30 Microphone 32 Camera 34 Image by camera 32 36 FOV of camera 32 40 Microphone 42 Camera 44 FOV of camera 42 46 Image by camera 42 50 Microphone 52 Camera 56 FOV of camera 52 60 Microphone 62 Camera 66 FOV of camera 62 68 FOR of microphone 60 70 Microphone 72 Camera 100 Sensor data receiving unit 102 Coverage Analysis Unit 104 Sensor Selection Unit 106 Sensor Driving Unit 108 Data Analysis Unit 200 Sensor Data Reception 202 Coverage Analysis 204 Sensor Selection 206 Sensor Driving 208 Data Analysis

Claims

1. At least one memory for storing commands, At least one processor connected to the memory, Comprising: Based on the commands, the processor Determines the event position and size of an event based on first camera information obtained from a first camera, and Controls the zoom of a second camera to photograph the event at a predetermined size based on the event position and size, A monitoring control system that executes the above.

2. The monitoring control system according to claim 1, wherein the process further includes a process of listing cameras capable of photographing an image of the event so that an administrator can select one from the list of the cameras.

3. The monitoring control system according to claim 2, further including, in the listing of the cameras, a process of identifying the cameras based on map information including other spaces defining walls or structures.

4. Determining an event position and size of an event based on first camera information obtained from a first camera, and Controlling the zoom of a second camera to photograph the event at a predetermined size based on the event position and size, A monitoring control method including the above.

5. The monitoring control method according to claim 4, further including a process of listing cameras capable of photographing an image of the event so that an administrator can select one from the list of the cameras.

6. The monitoring control method according to claim 5, further including, in the listing of the cameras, a process of identifying the cameras based on map information including other spaces defining walls or structures.

7. Determines the event position and size of an event based on first camera information obtained from a first camera, and Controls the zoom of a second camera to photograph the event at a predetermined size based on the event position and size, A non-transitory computer-readable recording medium storing a program for causing a computer to execute the above.

8. The non-transitory computer-readable recording medium according to claim 7, wherein the process further includes a process of listing cameras capable of photographing an image of the event so that an administrator can select one from the list of the cameras.

9. The non-transitory computer-readable recording medium according to claim 8, further including a process of identifying the camera based on map information including a wall or other space defining a structure in the listing of the cameras.

10. The monitoring control system according to claim 1, further including a process of controlling the zoom of the second camera so as to include the whole of the event based on the event position and the size of the event.

11. The monitoring control method according to claim 4, further including a step of controlling the zoom of the second camera so as to include the whole of the event based on the event position and the size of the event.

12. The non-transitory computer-readable recording medium according to claim 7, further including a process of controlling the zoom of the second camera so as to include the whole of the event based on the event position and the size of the event.

13. The monitoring control system according to claim 1, wherein the event occurs in relation to at least one of two persons.

14. The monitoring control method according to claim 4, wherein the event occurs in relation to at least one of two persons.

15. The non-transitory computer-readable recording medium according to claim 7, wherein the event occurs in relation to at least one of two persons.

Images