Program, video monitoring method, and video monitoring system

Abstract

To provide a technique for efficiently monitoring with a plurality of imaging devices.SOLUTION: A video monitoring system includes detection means that detects a predetermined event on the basis of an image captured with a first imaging device, and control means that controls a second imaging device to image a predetermined position after the predetermined event is detected.SELECTED DRAWING: Figure 13

Description

Technical Field

[0001] The present invention relates to video surveillance technology.

Background Art

[0002] There are surveillance systems using a plurality of surveillance (security) cameras. Patent Document 1 below proposes a surveillance method in which a plurality of cameras including a rotating camera capable of pan-tilt-zoom control are coordinated to enlarge and display an intruding object without dead angles using the minimum number of cameras. In this method, while no intruder is detected in the surveillance space, two rotating cameras are each made to photograph the wide area of the surveillance space in a form that compensates for each other's dead angles. When an intruder is detected in the surveillance space in the image captured by one camera, the coordinates of the intruder on the surveillance space are calculated, and the other camera is controlled to perform a zoom-in shooting in the direction of those coordinates.

[0003] Patent Document 2 below proposes a surveillance camera system in which a master camera and a slave camera are interlocked to photograph a target object, which is a person having fun. In this system, when the target object is photographed by the master camera, the photographing direction of the slave camera is calculated based on the photographing direction of the master camera and the position information of the master camera and the slave camera. Then, by directing the photographing direction of the slave camera in the calculated direction, the master camera and the slave camera can be interlocked to photograph the target object.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] The above-described proposed methods for causing cameras (imaging devices) to cooperate with each other capture a person with a plurality of cameras so that a person such as an intruder can be monitored without dead angles. That is, each proposed method is a method of directing another imaging device in the direction of the person when a person such as an intruder is detected by a certain imaging device. However, such a method has a reduced monitoring efficiency in a scene where a plurality of people come and go. That is, when each proposed method is applied to a scene where a plurality of people come and go, it reacts to all of the large number of people coming and going, and each camera is controlled one by one, resulting in a reduced monitoring efficiency.

[0006] The present invention has been made in view of such circumstances, and provides a technique for efficiently monitoring with a plurality of imaging devices.

Means for Solving the Problems

[0007] In each aspect of the present invention, in order to solve the above-described problems, the following configurations are respectively adopted.

[0008] The first aspect relates to a video surveillance system Program Thereof. The first aspect Program is (1) A storage process of associating and storing a plurality of monitoring positions and camera parameters for imaging the plurality of monitoring positions; (2) A detection process of detecting the intrusion of a person into a predetermined position which is a part of the video imaged by the first camera; (3) A control process of controlling the imaging direction of the second camera based on the camera parameters so that the second camera images the detected predetermined position, are executed by a computer.

[0009] The second aspect relates to a video surveillance method executed by at least one computer. The video surveillance method according to the second aspect (1) Associate and store a plurality of monitoring positions and camera parameters for imaging the plurality of monitoring positions; (2) Detect the intrusion of a person into a predetermined position which is a part of the video imaged by the first camera; (3) Control the imaging direction of the second camera based on the camera parameters so that the second camera images the detected predetermined position , including the matter.

[0010] A third aspect relates to a video surveillance system. The video surveillance system according to the third aspect includes: (1) Storage means for associating and storing a plurality of monitoring positions and camera parameters for imaging the plurality of monitoring positions; (2) Detection means for detecting the intrusion of a person into a predetermined position which is a part of the video imaged by the first camera; (3) Control means for controlling the imaging direction of the second camera based on the camera parameters so that the second camera images the detected predetermined position. In addition, as another aspect of the present invention, it may be a computer-readable recording medium recording the program of the above 1 aspect of . This recording medium includes a non-temporary tangible medium.

Effects of the Invention

[0011] According to each of the above aspects, it is possible to provide a technique for efficiently monitoring with a plurality of imaging devices.

Brief Description of the Drawings

[0012] The above-described object, as well as other objects, features, and advantages, will become further apparent from the preferred embodiments described below and the accompanying drawings.

[0013]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Best Mode for Carrying Out the Invention

[0014] First, to facilitate understanding of the embodiments of the present invention, the background of the present invention will be described. There is a monitoring system that controls other monitoring cameras when a certain monitoring camera detects an object such as a person or a vehicle. According to such a monitoring system, a plurality of monitoring cameras can cooperate with each other to comprehensively monitor intruders and the like. However, since such a monitoring system is originally assumed to be applied to a prohibited area where people are prohibited from entering or a scene where the appearance of people is limited to a certain extent, simply detecting a person starts the control of other cameras. Therefore, for example, in scenes where a large number of people come and go, such as on the streets of cities, large-scale commercial facilities, airports, terminal stations, platforms and other important facilities, leisure facilities, sports facilities, stadiums, etc., or crowds are formed, the monitoring cameras will be controlled one by one with the detection of people, and the monitoring operations cannot be carried out efficiently.

[0015] According to the embodiments of the present invention described below, the above problems can be solved and the monitoring operations can be carried out efficiently. However, each of the embodiments listed below is an example, and the present invention is not limited to the configurations of the following embodiments.

[0016] [First Embodiment] [System Configuration] FIG. 1 conceptually shows an example of the hardware configuration of a video monitoring system 1 (hereinafter, may also be abbreviated as system 1) in the first embodiment. The system 1 includes a monitoring control device 10, a plurality of monitoring cameras 9(#1), 9(#2) to 9(#n), etc.

[0017] A plurality of surveillance cameras 9(#1), 9(#2) to 9(#n) includes at least one movable camera whose imaging direction can be changed. For this movable camera, as long as the imaging direction can be changed, its movable direction can be changed only vertically, or only horizontally. In the following description, it is assumed that the surveillance camera 9(#1) is a PTZ (Pan-Tilt-Zoom) camera. The other surveillance cameras 9(#2) etc. are fixed or movable cameras. Hereinafter, unless it is necessary to distinguish individual surveillance cameras, each surveillance camera is denoted as "surveillance camera 9".

[0018] Each surveillance camera 9 is installed at a different location so that its imaging area overlaps with at least one other surveillance camera 9. Each surveillance camera 9 sends a video signal (image frame) to the communication unit 5. The transmission rate of the image frame sent by each surveillance camera 9 to the communication unit 5 is not restricted. If the transmission rate of the image frame is high, the surveillance control device 10 can acquire more image frames per unit time, and thus can perform high-precision surveillance control. The transmission rate of the image frame may be determined according to the frame rate specifications of each surveillance camera 9, the communication capacity between the surveillance control device 10 and each surveillance camera 9, the accuracy required by the video surveillance system 1, etc. Also, as long as each surveillance camera 9 can output a video signal, its performance and functions are not restricted.

[0019] The surveillance control device 10 is a so-called computer, and has, for example, a CPU (Central Processing Unit) 2, a memory 3, an input / output interface (I / F) 4, a communication unit 5, etc. that are connected by a bus. The number of each hardware element is not restricted respectively, and these hardware elements can also be collectively referred to as an information processing circuit. The hardware configuration of the surveillance control device 10 is not limited to the example shown in FIG. 1.

[0020] The CPU 2 may also include an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a graphics processing unit (GPU), etc. The memory 3 is a random access memory (RAM), a read-only memory (ROM), and an auxiliary storage device (such as a hard disk).

[0021] The input / output I / F 4 can be connected to user interface devices such as a display device 7, an input device 8, a printer (not shown), and a projection device (not shown). The display device 7 is a device that displays a screen corresponding to the rendering data processed by the CPU 2, a GPU (Graphics Processing Unit) (not shown), etc., such as an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube) display. The display device 7 may display an image obtained from the video signal sent from each monitoring camera 9. The input device 8 is a device that receives user operations such as a keyboard and a mouse. Further, the monitoring control device 10 may be implemented as a computer of a mobile device (such as a smartphone or a tablet), and a touch panel in which the display device 7 and the input device 8 are integrated may be connected to the input / output I / F 4.

[0022] The communication unit 5 exchanges signals with other computers and devices by wired communication or wireless communication. In this embodiment, the communication unit 5 communicates with a plurality of monitoring cameras 9. The communication method between the communication unit 5 and each monitoring camera 9 is not limited. For example, the communication unit 5 acquires video signals from each monitoring camera 9 and sends an instruction signal to the monitoring camera 9. Also, a portable recording medium or the like may be connected to the communication unit 5.

[0023] 〔Processing configuration〕 FIG. 2 is a diagram conceptually showing an example of the processing configuration of the monitoring control device 10 in the first embodiment. As shown in FIG. 2, the monitoring control device 10 includes an acquisition unit 11, an image storage unit 12, a detection unit 13, a camera control unit 14, a correspondence storage unit 15, an output processing unit 16, an input unit 17, a calculation unit 18, and the like. Each of these processing modules is realized, for example, by executing a program stored in the memory 3 by the CPU 2. Further, the program may be installed from a portable recording medium such as a CD (Compact Disc), a memory card, or the like, or from another computer on the network via the input / output I / F 4 or the communication unit 5, and stored in the memory 3.

[0024] The acquisition unit 11 acquires image data captured by each monitoring camera 9 from each monitoring camera 9. Specifically, the acquisition unit 11 sequentially acquires image data from the video signals sent from each monitoring camera 9. At this time, the acquisition unit 11 may acquire image data by capturing the input video signal at an arbitrary timing. The acquisition unit 11 stores the acquired image data in the image storage unit 12 in association with the identification information of the monitoring camera 9 that captured the image. The acquisition unit 11 acquires an image via the communication unit 5, for example.

[0025] The acquisition unit 11 further acquires camera parameters that can specify the imaging direction of the monitoring camera 9, and further associates the camera parameters with the image data and the identification information of the monitoring camera 9 and stores them in the image storage unit 12. These camera parameters indicate, for example, the posture of the monitoring camera 9 such as the position and imaging direction of the monitoring camera 9, the zoom value, etc. (including internal parameters), and may be acquired from each monitoring camera 9 or from the camera control unit 14. Hereinafter, image data may also be referred to as an image.

[0026] The input unit 17 receives an input of setting of a monitoring position for detecting a predetermined event by a user. The "monitoring position" is defined as an arbitrary static point, line, plane, or space in a common coordinate system or a camera coordinate system. The "monitoring position" is, for example, the "position of a video monitoring line" or the "position of a monitoring area". The common coordinate system is coordinates that are commonly recognized among a plurality of monitoring cameras 9 and among the images captured by each monitoring camera 9. As the common coordinate system, for example, a GPS (Global Positioning System) coordinate system, a coordinate system defined on a floor map in a facility, or the like can be used. The camera coordinate system is coordinates set on an image captured by a certain monitoring camera 9.

[0027] That is, the input unit 17 may receive the setting of the monitoring position in the camera coordinate system of a predetermined monitoring camera 9 or in the common coordinate system. When the monitoring position is set in the camera coordinate system, the input unit 17 converts the monitoring position into the common coordinate system based on the above-described camera parameters. Various known methods can be applied to the conversion between the common coordinate system and the camera coordinate system using the camera parameters.

[0028] The input unit 17 outputs the information of the common coordinate system of the received monitoring position to the calculation unit 18 together with the identification information of the monitoring position. Note that the input unit 17 receives the setting of the monitoring position input by the user operating the input device 8 illustrated in FIG. 1 via the input / output I / F 4.

[0029] Here, the video monitoring line and the monitoring area in the "position of the video monitoring line" or the "position of the monitoring area", which are specific examples of the monitoring position, will be described. The "video monitoring line" is a line superimposed on a monitoring image or the like specified by the user, and is a line for detecting an object that crosses (passes through) or touches the line. The "monitoring area" is a partial area of a monitoring image or the like set by the user, and is an area for detecting a predetermined event. The monitoring area is also called AOI (Area Of Interest), ROI (Region Of Interest), a sensing area, a restricted area, or the like.

[0030] Figure 3 is a diagram showing the relationship between the imaging area of the surveillance camera and the set surveillance area. In the example of Figure 3, the surveillance cameras 9(#1) and 9(#2) are installed so that their imaging areas overlap. Also, the surveillance area AM is set to partially overlap the imaging area where the two imaging areas overlap. In the example of Figure 3, the surveillance area AM is set in a planar area on the common coordinate system, that is, a planar area on the floor (ground) of the real world. In the present embodiment, it is assumed that the surveillance camera 9 is installed as shown in Figure 3 and the surveillance area AM is set.

[0031] The calculation unit 18 calculates, for each surveillance camera 9 capable of imaging the surveillance position, the camera parameters for imaging the surveillance position from the surveillance position represented in the common coordinate system and output from the input unit 17. The method by which the calculation unit 18 calculates the camera parameters is not limited, and various known methods may be used. For example, in addition to the storage information described later, the correspondence storage unit 15 may preliminarily hold, for each surveillance camera 9, the correspondence between the imaging range of each surveillance camera 9 in the common coordinate system and the group of camera parameters for imaging that range. In that case, the calculation unit 18 can determine the camera parameters so that a certain position (surveillance position) on the common coordinate system can be imaged using the correspondence stored in the correspondence storage unit 15. The calculation unit 18 may calculate the camera parameters so that the video surveillance line is imaged at the center of the viewing angle. Also, for example, the calculation unit 18 may calculate the camera parameters so that the ratio of the surveillance area occupying the entire viewing angle is about half. The calculation unit 18 outputs to the correspondence storage unit 15 information in which the identification information (ID) of each surveillance position, the coordinate information of the common coordinate system of each surveillance position, and the camera parameters capable of imaging the surveillance position for each surveillance camera 9 capable of imaging the surveillance position are associated.

[0032] The detection unit 13 detects a predetermined event at the monitoring position included in the image captured by each monitoring camera 9. The detection unit 13 can identify the monitoring position in the image based on the camera parameters of the monitoring camera 9 when the image is captured and the common coordinates of the monitoring positions stored in the corresponding storage unit 15. As the camera parameters of the monitoring camera 9 when the image is captured, those associated with the image and stored in the image storage unit 12 may be used. For example, the detection unit 13 can convert the camera coordinate system on the image to the common coordinate system based on the correspondence between the imageable range of each monitoring camera 9 in the common coordinate system and the group of camera parameters for imaging that range, and the camera parameters when the image is captured. The said correspondence is, for example, held in advance in the corresponding storage unit 15 as described above. Thereby, the detection unit 13 can determine whether the monitoring position is included in the image from the relationship between the range of the common coordinate system shown in the image and the common coordinates of the monitoring position. When the monitoring position is included in the image, the detection unit 13 can convert the common coordinates of the monitoring position to the camera coordinates of the monitoring camera 9. The detection unit 13 detects a predetermined event at the monitoring position (the monitoring position in the image) represented in the camera coordinate system. However, the method for identifying the monitoring position of the detection unit 13 is not limited.

[0033] The predetermined events detected by the detection unit 13 are various situations to be monitored in this system 1. For example, the detection unit 13 detects a predetermined situation caused by an object as the said predetermined event. The "object" is part or all of a predetermined object such as a person, an animal, a vehicle such as a car, or a suitcase. For example, the predetermined event includes the passing of the object through the video monitoring line, a predetermined situation (intrusion, departure, appearance, disappearance, quarrel, stay, wandering, fall, getting up, sitting down, change in moving direction, reverse running, shoplifting, detour, damage, taking away, abandonment, graffiti, etc.) of the object in the monitoring area, the movement of the object along a specific route defined by a line segment, etc.

[0034] Further, the detection unit 13 may detect that a predetermined situation has occurred with a predetermined number or more of objects as a predetermined event. The "object" is as described above. The predetermined situation is a situation that can be caused by the object, and includes, for example, the situations exemplified above, such as the passage of the video monitoring line and the intrusion in the monitoring area. The predetermined event detected in this case can also be denoted as an "abnormal state" as a situation that requires particular attention. For example, when the object is a person, if multiple people stay in the monitoring area, a crowd will be formed. The detection unit 13 detects the state in which the crowd is formed as an abnormal state. Further, the detection unit 13 may particularly detect, as an "abnormal state", the case where the above-described predetermined situation has occurred with a predetermined number or more of objects at substantially the same time. For example, when the object is a person, if multiple people sit down simultaneously in the monitoring area, it is considered that an abnormal situation such as a person suddenly firing a firearm has occurred. The detection unit 13 detects the state in which a large number of people sit down simultaneously as an abnormal state. Note that the video monitoring line may have an attribute of direction (from right to left, from left to right, both directions, etc.), and may be designed to be detected as a predetermined event only when an object in the direction designated by the user passes. Also, it may be designed to be detected as a predetermined event when the number of people passing the video monitoring line per unit time exceeds a predetermined number. Further, it may be designed to be detected as an abnormal state.

[0035] The detection unit 13 detects an object from the acquired image in order to detect a predetermined event. The detection unit 13 detects the object using various existing methods. For example, the detection unit 13 detects the object from the acquired image by the background subtraction method. In that case, the detection unit 13 constructs a model representing the background information from a plurality of images input along the time series, and uses the model to detect a moving object. Most simply, the detection unit 13 defines, as the background model, a background image generated by averaging the information of the stationary regions of the images over a plurality of frames. The detection unit 13 calculates the difference between the target image and the background image, and detects, as the object, the region where the difference is large. The detection unit 13 may directly detect using a model of an object such as a person without using the background model. The model used here may be, for example, in the case of a person, a model representing the whole person or a model representing a part of the person. For example, the detection unit 13 may detect a face or a head by using a face detector or a head detector that models and detects a face or a head as a part of a person. Alternatively, the detection unit 13 may detect the object by using a detector that detects a part of a person region such as the upper body or the lower body.

[0036] Also, the detection unit 13 detects a predetermined event using various existing methods. For example, the detection unit 13 detects that the object changes to a predetermined state while tracking (tracking) the detected object among a plurality of images. The predetermined state after the change may be retained in advance as an image feature amount. Well-known methods may be used for the method of tracking the object between images and the method of detecting the state change of the object. Alternatively, the detection unit 13 may detect an event corresponding to the predetermined state by detecting the predetermined state using the image feature amount of the object in the predetermined state.

[0037] The detection unit 13 detects a predetermined event at the monitoring position in the image by converting the common coordinates of the monitoring positions stored in the corresponding storage unit 15 into the camera coordinate system. Therefore, when the detection unit 13 detects a predetermined event, it can identify the ID of the monitoring position where the predetermined event or abnormal state has been detected based on the information stored in the corresponding storage unit 15. The ID of the monitoring position where the predetermined event or abnormal state has been detected is used, for example, by the camera control unit 14 described later.

[0038] After the detection unit 13 detects a predetermined event, the camera control unit 14 selects a monitoring camera 9 capable of imaging the monitoring position (for example, the position of the video monitoring line or the position of the monitoring area) from among the plurality of monitoring cameras 9, and controls the selected monitoring camera 9 to image the monitoring position where the predetermined event has been detected. The camera control unit 14 excludes the unselected monitoring cameras 9 from the control targets at the time of detection of the predetermined event. In the present embodiment, the camera control unit 14 selects, as the control target, a monitoring camera 9 other than the monitoring camera 9 that has captured the image in which the predetermined event has been detected among the plurality of monitoring cameras 9 and that is capable of imaging the monitoring position where the predetermined event has been detected. For example, the camera control unit 14 selects the monitoring camera 9 to be controlled by referring to the correspondence relationship information stored in the corresponding storage unit 15 illustrated in FIG. 4.

[0039] FIG. 4 is a diagram showing an example of correspondence information stored in the corresponding storage unit 15. As illustrated in FIG. 4, the corresponding storage unit 15 stores information indicating a plurality of correspondence relationships between the identification information (camera ID) of the monitoring camera 9, the identification information (monitoring position ID) of the monitoring position, the common coordinates of the monitoring position, and camera parameters. The camera parameters included in the correspondence information indicate the parameters for the monitoring camera 9 specified by the camera ID to image the monitoring position specified by the monitoring position ID, and indicate the posture, zoom value, etc. of the monitoring camera 9. The common coordinates of the monitoring position may be defined by a line segment such as a video monitoring line or by a region such as a monitoring area. In the case of a line segment, the coordinates of both ends of the line segment are shown. In the case of a region, for example, the coordinates of the lower left vertex and the upper right vertex of a region defined by a rectangle are shown. In FIG. 4, an example is shown in which the common coordinates are defined by the X-axis and Y-axis set on a map of a certain street corner.

[0040] The camera control unit 14 acquires the identification information (ID) of the monitoring position where a predetermined event is detected from the detection unit 13. Alternatively, the camera control unit 14 may directly refer to the correspondence information stored in the corresponding storage unit 15 to identify the ID of the monitoring position where a predetermined event is detected. That is, the camera control unit 14 can identify the ID of the monitoring position using the camera parameters acquired together with the image captured by the monitoring camera 9 (#1). For example, the camera control unit 14 selects parameters closer to the camera parameters acquired together with the image in which a predetermined event is detected from the "parameter 01" and "parameter 02" associated with the ID "001" of the monitoring camera 9 (#1). The camera control unit 14 can identify the monitoring position specified by the ID "002" associated with the selected "parameter 02" as the monitoring position where a predetermined event is detected.

[0041] When the camera control unit 14 identifies the ID of the monitoring position where a predetermined event has been detected, it can obtain from the corresponding storage unit 15 the ID of the monitoring camera 9 (control target) other than the monitoring camera 9 that captured the image where the predetermined event was detected, which is associated with the ID of the identified monitoring position, and the camera parameters. The camera control unit 14 controls the monitoring camera 9 specified by the obtained ID using the obtained camera parameters. As a result of this control, the monitoring camera 9 other than the monitoring camera 9 that captured the image where the predetermined event was detected will capture the monitoring position where the predetermined event was detected. The camera control unit 14 can control the monitoring camera 9 by sending the camera parameters to the monitoring camera 9 so that the obtained camera parameters are set in the monitoring camera 9 to be controlled. Also, the camera control unit 14 may send a control signal to the monitoring camera 9 so that the posture or zoom value indicated by the obtained camera parameters is obtained. The camera control unit 14 may change the imaging direction of the monitoring camera 9, or may change other parameters (such as the zoom value) of the monitoring camera 9, or may change both. As long as the monitoring camera 9 that could not capture the monitoring position where the predetermined event was detected is controlled to be able to capture it, the specific control method is not limited.

[0042] The method for selecting the monitoring camera 9 to be controlled and the method for controlling the monitoring camera 9 are not limited to the above example, and various known methods may be used. In the corresponding storage unit 15, other information that enables the monitoring camera 9 to capture the monitoring position may be associated with the camera ID and the ID of the monitoring position instead of the camera parameters. Also, the correspondence relationship information stored in the corresponding storage unit 15 may be information that associates the identification information of a plurality of monitoring cameras 9 that can capture the same monitoring position with the respective camera parameters for those monitoring cameras 9 to capture that monitoring position.

[0043] Furthermore, the correspondence information stored in the correspondence storage unit 15 may not include information used to control the imaging direction of the surveillance camera 9 to be controlled. In this case, the camera control unit 14 may control the surveillance camera 9 to be controlled and sequentially check the images obtained from the surveillance camera 9 after the control until the target surveillance position is included. When the camera control unit 14 confirms that the target surveillance position is included, it stops the control of the surveillance camera 9.

[0044] The output processing unit 16 causes the display device 7 to display the images captured by the respective surveillance cameras 9 and stored in the image storage unit 12. Further, the output processing unit 16 may cause the display device 7 to display the images acquired by the acquisition unit 11. For example, the output processing unit 16 may constantly display the videos captured by the respective surveillance cameras 9 on the display device 7. When a predetermined event is detected by the detection unit 13, the output processing unit 16 can also display the image in which the predetermined event is detected on the display device 7 with greater emphasis than other images. Further, when a predetermined event is detected, the output processing unit 16 can also output to other output devices (printer, audio output device, LED (Light Emitting Diode), etc.) other than the display device 7. In the present embodiment, the output form of the images captured by the respective surveillance cameras 9 is not limited.

[0045] 〔Operation Example〕 Hereinafter, the video surveillance method in the first embodiment will be described with reference to FIGS. 5 and 6. FIG. 5 is a flowchart showing an operation example of the surveillance control device 10 in the first embodiment. As shown in FIG. 5, the video surveillance method in the first embodiment is executed by at least one computer (CPU 2) such as the surveillance control device 10. Since each step is the same as the processing content of each of the above-described processing modules included in the surveillance control device 10, the details of each step will be omitted as appropriate.

[0046] The monitoring and control device 10 receives an input for setting a monitoring position by the user (S51). For example, the monitoring and control device 10 receives the setting of the monitoring position in the camera coordinate system or the common coordinate system of a predetermined monitoring camera 9. When the monitoring position is set in the camera coordinate system, the monitoring and control device 10 converts the monitoring position into the common coordinate system based on the camera parameters of the camera that captured the image in which the camera coordinate system is set.

[0047] Subsequently, the monitoring and control device 10 calculates, for each monitoring camera 9 capable of imaging the monitoring position, the camera parameters for imaging the monitoring position from the common coordinates of the monitoring position obtained from the input received in (S51) (S52). The calculation method of this camera parameter is as described above.

[0048] The monitoring and control device 10 determines the ID of the monitoring position for the monitoring position set by the input received in (S51), and associates and stores the ID of the monitoring position, the common coordinates of the monitoring position, and the camera parameters for each monitoring camera 9 calculated in (S52) in the correspondence storage unit 15 (S53). As a result, in the correspondence storage unit 15, for the monitoring position input by the user, the identification information (ID), the common coordinates, and the camera parameters for imaging with the monitoring camera 9 capable of imaging the monitoring position are associated and stored.

[0049] The monitoring and control device 10 respectively acquires the image data of the images captured by each monitoring camera 9 from each monitoring camera 9 (S54). The monitoring and control device 10 stores the acquired image data in the image storage unit 12 in association with the identification information of the monitoring camera 9 that captured the image. At this time, the monitoring and control device 10 further acquires the camera parameters of the monitoring camera 9 that captured the image, and further associates the camera parameters with the image data and the identification information of the monitoring camera 9 and stores them in the image storage unit 12.

[0050] The monitoring control device 10 identifies the monitoring position (for example, the position of the video monitoring line or the position of the monitoring area) in the image acquired in (S51) or the image extracted from the image storage unit 12 (S55). In this identification, the camera parameters acquired in (S54) and the common coordinates of the monitoring position stored in the corresponding storage unit 15 are used. The specific method for identifying the monitoring position from the image is as described above. Note that the process of S55 is executed each time the PTZ of the monitoring camera is controlled (each time the imaging range changes).

[0051] The monitoring control device 10 detects a predetermined event at the monitoring position identified in (S55) (S56). The monitoring control device 10 detects, for example, as a predetermined event, any one or more of the passage of an object through the video monitoring line, a predetermined situation of the object in the monitoring area, the movement of the object along a specific route defined by a line segment, etc. Further, the monitoring control device 10 may detect an abnormal state as a predetermined event. The content of the predetermined event and the detection method of the predetermined event are as described above.

[0052] When a predetermined event is detected at the monitoring position, the monitoring control device 10 selects, from among the plurality of monitoring cameras 9, a monitoring camera 9 other than the monitoring camera 9 that captured the image acquired in (S54) and that is capable of imaging the monitoring position identified in (S55) (S57). The selection method of the monitoring camera 9 is also as described above.

[0053] The monitoring control device 10 controls the monitoring camera 9 selected in (S57) to image the monitoring position identified in (S55) (S58). For example, the monitoring control device 10 changes the imaging direction of the monitoring camera 9 selected in (S57) so that the monitoring position can be imaged. The control method of the monitoring camera 9 is also as described above.

[0054] FIG. 6 conceptually shows an example of the control of the surveillance camera 9. In the example of FIG. 6, the surveillance control device 10 receives an input for setting the position of the surveillance area AM (S51). This input may be performed by a user's range specifying operation on the image captured by the surveillance camera 9 (#2). The surveillance control device 10 calculates the common coordinates of the surveillance area AM. Then, the surveillance control device 10 calculates the camera parameters for imaging the position of the surveillance area AM in the surveillance cameras 9 (#1) and (#2) capable of imaging the position of the surveillance area AM, respectively (S52). If the camera parameters of the surveillance camera 9 (#2) are fixed, the surveillance control device 10 may hold the camera parameters in advance. The surveillance control device 10 associates and stores in the correspondence storage unit 15 the ID of the position of the surveillance area AM, the common coordinates of the surveillance area, the camera parameters of the surveillance camera 9 (#1), and the camera parameters of the surveillance camera 9 (#2) (S53).

[0055] In (S54), the surveillance control device 10 acquires the data of the image captured by the surveillance camera 9 (#2) and the camera parameters at the time of imaging. If the camera parameters of the surveillance camera 9 (#2) are fixed, the surveillance control device 10 may hold the camera parameters in advance. The surveillance control device 10 specifies the position of the surveillance area AM in the image (S55) and detects that a human OB1 has entered the position of the surveillance area AM as a predetermined event (S56). At this time, the surveillance camera 9 (#1) is imaging in the imaging direction D1 and cannot image the position of the surveillance area AM. When a predetermined event is detected, the surveillance control device 10 selects the surveillance camera 9 (#1) other than the surveillance camera 9 (#2) as a surveillance camera capable of imaging the position of the surveillance area AM (S57). Then, the surveillance control device 10 controls the selected surveillance camera 9 (#1) to image the position of the surveillance area AM (S58). That is, the surveillance control device 10 controls the imaging direction of the surveillance camera 9 (#1) to change from D1 to D2. As a result, the position of the surveillance area AM can be imaged by both the surveillance cameras 9 (#1) and (#2), and images of the surveillance area AM captured from different directions can be obtained.

[0056] [Operation and Effects of the First Embodiment] As described above, in the first embodiment, at a monitoring position (for example, the position of a video monitoring line or the position of a monitoring area) included in an image captured by a certain monitoring camera 9, a predetermined event is detected. In response to this detection, monitoring cameras 9 other than the monitoring camera 9 that captured the image in which the predetermined event was detected are controlled to capture the predetermined position. As a result, the monitoring position where the predetermined event is detected is captured by two or more monitoring cameras 9. Therefore, according to the first embodiment, the state of the monitoring position (for example, the position of the video monitoring line or the position of the monitoring area) when the predetermined event occurs, and the state of the occurred predetermined event can be monitored in detail from multiple directions.

[0057] Furthermore, in the first embodiment, the monitoring camera 9 is controlled in response to the detection of a predetermined event, such as the passage of the video monitoring line of an object, a predetermined situation in the monitoring area of the object, or the movement of an object along a specific route defined by a line segment. Therefore, compared with a method in which monitoring cameras are individually controlled with the detection of a person, the monitoring operation can be efficiently performed even in a scene where a large number of people come and go or a crowd is formed. Also, in the first embodiment, it is detected that a predetermined situation has occurred with a predetermined number or more of objects, and based on this detection, the monitoring camera 9 is controlled. According to this, since the monitoring camera 9 is controlled only by the occurrence of an event that should be particularly noted, such as an abnormal state, the efficiency of the monitoring operation can be further improved.

[0058] Also, in the first embodiment, a movable monitoring camera 9, such as a PTZ camera, is included, and the movable monitoring camera 9 is controlled to capture the monitoring position where the predetermined event is detected. Therefore, by using the movable monitoring camera 9, a wide area can be comprehensively monitored with a small number of monitoring cameras, and in conjunction with the detection of a predetermined event, a monitoring position such as the position of the video monitoring line or the position of the monitoring area can be preferentially monitored.

[0059] [Second Embodiment] In the above-described first embodiment, when a predetermined event is detected at the monitoring position in the captured image of a certain monitoring camera 9, other monitoring cameras 9 are controlled to capture the monitoring position. In the second embodiment, when an event is detected in the captured image of a certain monitoring camera 9, other monitoring cameras 9 are controlled to capture a position different from the position where the event is detected. Hereinafter, the video monitoring system 1 in the second embodiment will be described focusing on the content different from the first embodiment. In the following description, the same content as in the first embodiment will be omitted as appropriate.

[0060] 〔Processing Configuration〕 The processing configuration of the monitoring control device 10 in the second embodiment is the same as that in the first embodiment (see FIG. 2). The processing content shown below is different from that in the first embodiment.

[0061] The detection unit 13 detects a predetermined event at a predetermined position included in the image captured by a certain surveillance camera 9. The camera control unit 14 controls another surveillance camera 9 to capture an image of another position corresponding to the predetermined position at which the detection unit 13 has detected the predetermined event. Hereinafter, the predetermined position for detecting a predetermined event from the image of a certain surveillance camera 9 is referred to as a "detection target position", and the position monitored by one or more other controlled surveillance cameras 9 is referred to as a "monitoring target position". That is, the detection unit 13 detects a predetermined event at a detection target position different from the monitoring target position included in the image captured by a certain surveillance camera 9. The "detection target position" is a position determined in advance for detecting a predetermined event and is a position that can be imaged by at least one surveillance camera 9. The "monitoring target position" is a position to be monitored provided in association with one or more "detection target positions" and is a position that can be imaged by at least one surveillance camera 9. The "detection target position" and the "monitoring target position" are set at arbitrary static points, lines, planes, or spaces in the real world. The "detection target position" corresponds to, for example, the "video surveillance line position" or the "monitoring area position" in the first embodiment. The "monitoring target position" is an arbitrary position on a line segment or in a region. The common coordinates of the detection target position and the monitoring target position are respectively obtained from user input received by the input unit 17. In the second embodiment, the correspondence storage unit 15 stores the correspondence between the ID of the detection target position, the common coordinates of the detection target position, the ID of the monitoring target position corresponding to the detection target position, and the camera parameters for imaging the monitoring target position for each surveillance camera 9 capable of imaging the monitoring target position.

[0062] The predetermined event detected by the detection unit 13 is as described above. However, since what is monitored by the control of the surveillance camera 9 is the monitoring target position, the occurrence of a predetermined event at the detection target position serves as a trigger (bait) for the need to monitor the monitoring target position. Therefore, for example, based on such a relationship, the detection target position and the content of the predetermined event to be detected with respect to the monitoring target position are determined. For example, the detection target position is set at a position where a person heading towards the monitoring target position is likely to pass. In this case, the detection unit 13 detects, as a predetermined event, the state in which a person moves in the direction of the monitoring target position (passing in a predetermined direction of the video monitoring line) or the state of a person's stay at the detection target position. As another example, the monitoring target position is set in an area along the track of a certain station's platform, and the detection target position is set in a part of the track around the station. In this case, the detection unit 13 detects, as a predetermined event, the state in which a train moves in the direction of the monitoring target position (the station) at the detection target position. Note that for subsequent control, for example, the surveillance camera 9 installed on the platform and monitoring the escalator is controlled to monitor the area along the track, which is the monitoring target position. The monitoring target position, the detection target position, and the content of the detected predetermined event are not limited to the examples described above.

[0063] The detection unit 13 can identify the detection target position in the image by the same method as the monitoring position in the first embodiment. The detection unit 13 detects a predetermined event at the detection target position in the image by converting the common coordinates of the detection target position stored in the corresponding storage unit 15 into the camera coordinate system. Therefore, when the detection unit 13 detects a predetermined event, it can identify the ID of the detection target for which the predetermined event is detected based on the information stored in the corresponding storage unit 15. The ID of the detection target position where the predetermined event is detected is used, for example, by the camera control unit 14 described later.

[0064] FIG. 7 is a diagram showing the relationship among the imaging area of the surveillance camera, the surveillance target position, and the detection target position. In the example of FIG. 7, the surveillance target position is set in a planar area on the floor (ground) in the real world, and the detection target position is set as a line segment on the floor (ground) in the real world. The surveillance cameras 9(#1), 9(#3), and 9(#4) can image the surveillance target position, and the surveillance camera 9(#2) can image the detection target position. In this case, the detection unit 13 detects a predetermined event at the detection target position included in the image captured by the surveillance camera 9(#2).

[0065] The correspondence storage unit 15 stores the following correspondence relation information. The correspondence storage unit 15 stores a plurality of correspondence relation information including the identification information of the surveillance camera 9, the identification information of the detection target position that can be imaged by the surveillance camera 9, the common coordinates of the detection target position, the identification information of the surveillance target position corresponding to the detection target position, and the camera parameters for imaging the surveillance target position with the surveillance camera 9.

[0066] FIG. 8 is a diagram showing an example of the correspondence relation information stored in the correspondence storage unit 15. In the example of FIG. 8, the correspondence relation information stored in the correspondence storage unit 15 shows a plurality of correspondence relations among the camera ID of the surveillance camera 9, the ID of the detection target position, the common coordinates of the detection target position, the ID of the surveillance target position corresponding to the detection target position, and the camera parameters for imaging the surveillance target position with the surveillance camera 9. These camera parameters indicate the parameters for the surveillance camera 9 specified by the camera ID to image the surveillance target position specified by the ID of the surveillance target position, and indicate the posture, zoom value, etc. of the surveillance camera 9.

[0067] According to the example of FIG. 8, it shows that the surveillance camera 9 with camera ID "001" can image both the detection target position "001" and the corresponding surveillance target position "001". The surveillance camera 9 with camera ID "002" shows that it can image the surveillance target position "001". Also, the surveillance camera 9 with camera ID "003" can image the surveillance target position "001" and the detection target position "002", indicating that it cannot image the surveillance target position "002" corresponding to the detection target position "002" (it can be understood that it holds the camera parameter "03" for imaging the surveillance target position "001" and the common coordinates of the detection target position "002", but does not hold the camera parameter for imaging the surveillance target position "002"). The surveillance camera 9 with camera ID "004" shows that it can image the surveillance target position "002". Note that the information stored in the correspondence storage unit 15 is stored by receiving the settings of the detection target position and the surveillance target position input by the user at the input unit as described above. The camera parameters capable of imaging the surveillance target position are calculated for each surveillance camera 9 by the calculation unit 18 based on the common coordinates of the surveillance target position input by the user.

[0068] After the detection unit 13 detects a predetermined event, the camera control unit 14 refers to the correspondence relationship information stored in the correspondence storage unit 15 to identify the surveillance camera 9 capable of imaging the predetermined surveillance target position corresponding to the predetermined detection target position where the predetermined event is detected.

[0069] For example, as described above, the camera control unit 14 acquires, from the detection unit 13, the identification information (ID) of the detection target position where a predetermined event has been detected. The camera control unit 14 specifies, from the correspondence relationship information stored in the correspondence storage unit 15, the identification information (ID) of the monitoring target position corresponding to the ID of the acquired detection target position and the camera ID of the monitoring camera 9 capable of imaging the monitoring target position. The camera control unit 14 can acquire camera parameters capable of imaging the monitoring target position for each of the specified camera IDs of the monitoring camera 9. Here, in the example of FIG. 8, it is assumed that a predetermined event has been detected at the detection target position specified by the ID "001" of the detection target position of the monitoring camera 9 specified by the camera ID "001". In this case, the camera control unit 14 acquires the ID "001" of the monitoring target position corresponding to the detection target position ID "001", and further acquires the camera IDs "001", "002", and "003" of the monitoring cameras corresponding to the ID "001" of the monitoring target position. Further, the camera control unit 14 acquires camera parameters for each of the acquired camera IDs. The camera control unit 14 controls the monitoring camera 9 specified by the acquired ID using the acquired camera parameters. For example, the camera control unit 14 controls the monitoring camera 9 with the camera ID "001" using the camera parameter "01", controls the monitoring camera 9 with the camera ID "002" using the camera parameter "02", and controls the monitoring camera 9 with the camera ID "003" using the camera parameter "03". In this example, the monitoring camera 9 itself with the camera ID "001" that has acquired the image in which the predetermined event has been detected is also controlled to face the direction of the monitoring target position.

[0070] 〔Operation Example〕 Hereinafter, the video monitoring method in the second embodiment will be described with reference to FIGS. 9 and 10. FIG. 9 is a flowchart showing an operation example of the monitoring control device 10 in the second embodiment. As shown in FIG. 9, the video monitoring method in the second embodiment is executed by at least one computer (CPU2) such as the monitoring control device 10. Since each step is the same as the processing content of each of the above-described processing modules included in the monitoring control device 10, the details of each step are appropriately omitted.

[0071] The monitoring and control device 10 receives an input for setting a detection target position and a monitoring target position by the user (S91). For example, the monitoring and control device 10 receives the setting of the detection target position and the monitoring target position in the camera coordinate system or the common coordinate system of a predetermined monitoring camera 9. When the detection target position and the monitoring target position are set in the camera coordinate system, the monitoring and control device 10 converts the detection target position and the monitoring target position into the common coordinate system respectively based on the camera parameters of the camera that captured the image in which the camera coordinate system was set.

[0072] Subsequently, the monitoring and control device 10 calculates camera parameters for imaging the monitoring target position for each monitoring camera 9 capable of imaging the monitoring target position from the common coordinates of the monitoring target position obtained from the input received in (S91) (S92). The calculation method of this camera parameter is as described in the first embodiment.

[0073] For the detection target position and the monitoring target position set by the input received in (S91), the monitoring and control device 10 determines the IDs of the detection target position and the monitoring target position respectively, and associates and stores the IDs of the detection target position and the monitoring target position, the common coordinates of the detection target position, and the camera parameters for each monitoring camera 9 calculated in (S92) in the correspondence storage unit 15 (S93). Thereby, in the correspondence storage unit 15, the correspondence relationship between the detection target position and the monitoring target position input by the user, the common coordinates of the detection target position, and the camera parameters for imaging the monitoring target position corresponding to the detection target position by the monitoring camera 9 capable of imaging are associated and stored.

[0074] The monitoring control device 10 acquires the image data captured by each monitoring camera 9 from each of the monitoring cameras 9 (S94). The monitoring control device 10 stores the acquired image data in the image storage unit 12 in association with the identification information of the monitoring camera 9 that captured the image. At this time, the monitoring control device 10 further acquires the camera parameters of the monitoring camera 9 that captured the image, and further associates the camera parameters with the image data and the identification information of the monitoring camera 9 and stores them in the image storage unit 12.

[0075] The monitoring control device 10 identifies the detection target position set in (S91) within the image acquired in (S94) or the image extracted from the image storage unit 12 (S95). In this identification, the camera parameters acquired in (S94) and the common coordinates of the detection target positions stored in the corresponding storage unit 15 are used. The method of identifying the detection target position from the image is the same as the method of identifying the monitoring position in the first embodiment. Note that the process of S95 is executed every time the PTZ of the monitoring camera is controlled (every time the imaging range changes).

[0076] The monitoring control device 10 detects a predetermined event at the detection target position identified in (S95) (S96). The monitoring control device 10 detects, for example, as the predetermined event, any one or more of the passage of the video monitoring line of the object, the predetermined situation of the object in the monitoring area, the movement of the object along a specific route defined by a line segment, etc. Also, the monitoring control device 10 may detect an abnormal state as the predetermined event. The content of the predetermined event and the method of detecting the predetermined event are as described in the first embodiment.

[0077] When a predetermined event is detected at the detection target position, the monitoring control device 10 selects a monitoring camera 9 that can image the monitoring target position corresponding to the detection target position identified in (S95) from among the plurality of monitoring cameras 9 (S97). The method of selecting the monitoring camera 9 is also as described above.

[0078] The monitoring control device 10 controls the monitoring camera 9 selected in (S97) (S98) so as to image the monitoring target position corresponding to the detection target position specified in (S95). For example, the monitoring control device 10 changes the imaging direction of the monitoring camera 9 selected in (S97) so that the monitoring target position can be imaged. The control method of the monitoring camera 9 is also as described above.

[0079] FIG. 10 is a diagram conceptually showing an example of the control of the monitoring camera 9. The monitoring control device 10 receives the input of the setting of the detection target position (video monitoring line) and the monitoring target position (S91). This input may be performed by the user's line segment designation operation and range designation operation on each image captured by each monitoring camera 9. The monitoring control device 10 calculates the common coordinates of the detection target position and the monitoring target position. Then, the monitoring control device 10 calculates the camera parameters for imaging the monitoring target position in the monitoring cameras 9 (#1), 9 (#3), and 9 (#4) that can image the monitoring target position, respectively (S92). If the camera parameters of any one of the monitoring cameras 9 are fixed, the monitoring control device 10 may hold the camera parameters in advance.

[0080] The monitoring control device 10 stores the following correspondence information in the correspondence storage unit 15 (S93). For the monitoring camera 9 (#2), the monitoring control device 10 stores the correspondence information between the camera ID, the ID of the detection target position (video monitoring line), and the ID of the monitoring target position corresponding to the detection target position. For the monitoring camera 9 (#1), the monitoring control device 10 stores the correspondence information between the camera ID, the ID of the monitoring target position, and the camera parameters for imaging the monitoring target position. For the monitoring camera 9 (#3), the monitoring control device 10 stores the correspondence information between the camera ID, the ID of the monitoring target position, and the camera parameters for imaging the monitoring target position. For the monitoring camera 9 (#4), the monitoring control device 10 stores the correspondence information between the camera ID, the ID of the monitoring target position, and the camera parameters for imaging the monitoring target position.

[0081] In (S94), the monitoring and control device 10 acquires the data of the image captured by the monitoring camera 9 (#2) and the camera parameters at the time of imaging. When the camera parameters of the monitoring camera 9 (#2) are fixed, the monitoring and control device 10 may hold the camera parameters in advance. The monitoring and control device 10 identifies the detection target position (video monitoring line) within the image (S95), and detects that a person has passed through the video monitoring line as a predetermined event (S96). At this time, as shown in FIG. 7, it is assumed that the monitoring cameras 9 (#1), 9 (#3), and 9 (#4) cannot image the monitoring target positions respectively.

[0082] When a predetermined event is detected, the monitoring and control device 10 selects the monitoring cameras 9 (#1), 9 (#3), and 9 (#4) as the monitoring cameras capable of imaging the monitoring target position corresponding to the detection target position based on the correspondence information stored in the corresponding storage unit 15 (S97). Then, the monitoring and control device 10 controls the selected monitoring cameras 9 (#1), 9 (#3), and 9 (#4) using the respective camera parameters included in the correspondence information so as to image the monitoring target position (S98). As a result, as shown in FIG. 10, the monitoring target position is imaged by the monitoring cameras 9 (#1), 9 (#3), and 9 (#4).

[0083] 〔Operations and Effects of the Second Embodiment〕 As described above, in the second embodiment, the detection target position and the monitoring target position indicating different positions are acquired by user input. A predetermined event is detected at the detection target position within the captured image of a certain monitoring camera 9, and the other monitoring cameras 9 are controlled to image the monitoring target position corresponding to the detection target position where the predetermined event is detected.

[0084] According to the second embodiment, for example, it becomes possible to capture a sign that something is about to happen at the monitoring target position by detecting a predetermined event at the detection target position, and to place the monitoring target position under monitoring at the stage of the sign. For example, it is assumed that a video monitoring line is set on the passage leading to the escalator, and an event is set to be detected when an abnormal state occurs if the number of people passing per unit time exceeds a predetermined number. By detecting such an event, a sign of an accident is captured, and the monitoring control device 10 in the second embodiment gives an alert and controls a plurality of monitoring cameras 9 installed around the escalator to intensively monitor the entrances and exits of the escalator. In this way, by controlling the monitoring camera 9 in advance before something happens at the monitoring target position, it is possible to surely monitor the situation occurring at the monitoring target position without missing it.

[0085] [Modification Example] In the above-described first embodiment, the camera parameters for imaging the monitoring position are automatically calculated for each monitoring camera 9 capable of imaging the monitoring position from the common coordinates of the monitoring position output by the input unit 17 (calculation unit 18). Then, in the corresponding storage unit 15, for each monitoring position, the identification information (ID), the coordinate information in the common coordinate system, and the camera parameters are stored respectively. However, in the above-described first embodiment, the common coordinates of the monitoring position may not be used.

[0086] For example, the input unit 17 receives an input for setting one monitoring position that can be imaged by two movable monitoring cameras 9. In this case, the user performs an operation of designating the monitoring position for each of the images captured by the two monitoring cameras 9. The input unit 17 acquires the camera coordinate information (in-image coordinates) of the monitoring position designated by the user input for the image of one of the monitoring cameras 9 and the camera parameters at the time of imaging of that image. Further, the input unit 17 acquires the camera coordinate information (in-image coordinates) of the monitoring position designated by the user input for the image of the other monitoring camera 9 and the camera parameters at the time of imaging of that image. In the corresponding storage unit 15, the ID of the monitoring position, the camera IDs of the two monitoring cameras 9, the camera parameters for each monitoring camera 9 for imaging the monitoring position, and the camera coordinate information of the monitoring position are stored in an associated manner. The detection unit 13 can detect a predetermined event at the monitoring position for the images of the respective monitoring cameras 9 using this stored information. In this case, the change in the camera parameters of each movable monitoring camera 9 is allowed within the range including the camera parameters stored in the corresponding storage unit 15. The camera control unit 14 can control each monitoring camera 9 to image the monitoring position where a predetermined event is detected using this stored information.

[0087] Similarly, the second embodiment can be modified in the same way. That is, in the second embodiment, the common coordinates of the detection target position and the monitoring target position may not be used. In this case, the input unit 17 acquires the camera parameters of each monitoring camera 9 when imaging the monitoring target position. Further, the input unit 17 acquires the camera coordinate information (in-image coordinates) of the detection target position for each monitoring camera 9 capable of imaging the detection target position, and further acquires the association information between the detection target position and the monitoring target position. In the corresponding storage unit 15, the correspondence relationship (ID pair) between the detection target position and the monitoring target position, the camera ID of the monitoring camera 9 capable of imaging the detection target position or the monitoring target position, and the correspondence relationship information of the camera parameters for imaging the monitoring target position are stored.

[0088] Further, when the position of the monitoring area is set by the user in the input unit 17, instead of the coordinate information of the monitoring area, the input unit 17 may acquire the image feature amount of the monitoring area. In this case, the detection unit 13 detects an area similar to the image feature amount of the monitoring area in the acquired image, and specifies the detected area as the monitoring area. In that case, the image feature amount of the monitoring area input by the user may be stored in the corresponding storage unit.

[0089] [Third Embodiment] Hereinafter, the video surveillance system and the video surveillance method in the third embodiment will be described with reference to FIGS. 11, 12, and 13. Further, the third embodiment may be a program for causing at least one computer to execute this video surveillance method, or may be a computer-readable recording medium recording such a program.

[0090] FIG. 11 is a diagram conceptually showing a processing configuration example of the video surveillance system 100 in the third embodiment. As shown in FIG. 11, the video surveillance system 100 includes a detection unit 101 and a control unit 102. The video surveillance system 100 shown in FIG. 11 can be realized as the above-described monitoring control device 10 shown in FIG. 1. In this case, the video surveillance system 100 has the same hardware configuration as the monitoring control device 10 shown in FIG. 1.

[0091] FIG. 12 is a diagram conceptually showing a hardware configuration example of the video surveillance system 100 in the third embodiment. As shown in FIG. 12, the video surveillance system 100 may be realized as a surveillance camera 9(#n). In this case, the video surveillance system 100 (surveillance camera 9(#n)) includes a CPU 2, a memory 3, an input / output interface (I / F) 4, a communication unit 5, etc., and the surveillance camera 9(#n) controls itself and other surveillance cameras 9. The surveillance camera 9(#n) in this case is a so-called intelligent camera. The hardware configuration of the video surveillance system 100 in the third embodiment is not limited to the examples of FIGS. 1 and 12, and the video surveillance system 100 may be realized by both the monitoring control device 10 and the surveillance camera 9(#n).

[0092] The detection unit 101 and the control unit 102 are realized, for example, by executing a program stored in the memory 3 by the CPU 2. Further, the program may be installed via the input / output I / F 4 or the communication unit 5 from a portable recording medium such as a CD, a memory card, or the like, or another computer on the network, and stored in the memory 3. When the video monitoring system 100 is realized by both the monitoring control device 10 and the monitoring camera 9(#n), the detection unit 101 may be realized by the monitoring control device 10, and the control unit 102 may be realized by the monitoring camera 9(#2).

[0093] The detection unit 101 detects a predetermined event based on an image captured by the first imaging device (for example, the monitoring camera 9(#2)). The detection unit 101 corresponds to the above-described detection unit 13. The content of the predetermined event and the method for detecting the predetermined event are as described above and are not limited. Further, the first imaging device may be a fixed monitoring camera 9 or a movable monitoring camera 9.

[0094] After the detection unit 101 detects a predetermined event, the control unit 102 controls the second imaging device so that the second imaging device (for example, the monitoring camera 9(#1)) captures a predetermined position. The "predetermined position" is a predetermined monitoring position and is set to an arbitrary static point, line, plane, or space in the real world. The control unit 102 corresponds to the above-described camera control unit 14. The method for controlling the second imaging device is as described above and is not limited.

[0095] As shown in FIG. 11, the video monitoring system 100 in the third embodiment does not necessarily have the acquisition unit 11, the image storage unit 12, the correspondence storage unit 15, and the output processing unit 16 shown in FIG. 2. These processing modules that the video monitoring system 100 does not have are provided by other computers, and the video monitoring system 100 can cooperate with these processing modules by communicating with the other computers.

[0096] FIG. 13 is a flowchart showing an operation example of the video surveillance system 100 in the third embodiment. As shown in FIG. 13, the video surveillance method in the third embodiment is executed by at least one computer such as the video surveillance system 100. For example, each illustrated step is executed by each processing module included in the video surveillance system 100.

[0097] The video surveillance method in the present embodiment detects a predetermined event based on an image captured by a first imaging device (e.g., surveillance camera 9(#2)) (S131), and after detecting the predetermined event (S132; YES), controls the second imaging device so that the second imaging device (e.g., surveillance camera 9(#1)) captures a predetermined position (S133).

[0098] According to the third embodiment, the same operational effects as those of the above-described first and second embodiments can be obtained.

[0099] [Examples] Hereinafter, application examples of the video surveillance systems 1 and 100 (hereinafter, collectively referred to by reference numeral 1) in the above-described embodiments are shown. However, the application of each of the above-described embodiments is not limited to the following examples.

[0100] FIG. 14 is a conceptual diagram of a stadium to which the video surveillance system 1 is applied. For example, the above-described video surveillance system 1 is applied to a stadium where a large number of people gather as shown in FIG. 14. In this case, a plurality of surveillance cameras 9 are installed at positions where they can image the auditorium, aisles, entrances and exits, etc., and a plurality of areas where a large number of people may be present are set as surveillance areas respectively. The surveillance control device 10 (detection unit 13) detects that a plurality of persons (crowd) have changed their states simultaneously in the surveillance area as a predetermined event. In this embodiment, the predetermined event is treated as an abnormal state. For example, the surveillance control device 10 detects as a predetermined event (abnormal state) that the crowd shown in the image of the surveillance camera 9 imaging the auditorium has simultaneously run outwards centering on a certain point.

[0101] FIG. 15 is a diagram showing a specific example of a predetermined event. In the example of FIG. 15, a state where a person D1 is brandishing a weapon is shown. In this case, the monitoring control device 10 detects, as a predetermined event, that a plurality of persons captured in the image have run out in a direction away from the center around the person D1.

[0102] The monitoring control device 10 (camera control unit 14) is installed in the vicinity of the monitoring area where the predetermined event (abnormal state) has been detected, and simultaneously controls all the monitoring cameras 9 capable of imaging the monitoring area to image the monitoring area. Thereby, the cause of the abnormal state, for example, a person who suddenly brandishes a weapon (see FIG. 15) can be imaged from multiple aspects, and the offender can be easily identified even in post - verification.

[0103] As another example, a plurality of areas where a large number of people may exist are respectively set as detection target areas, and a plurality of monitoring target areas corresponding to these detection target areas are set. For example, the area around the seats is set as a detection target area, and a plurality of entrances and exits are respectively set as monitoring target areas. The monitoring control device 10 (detection unit 13) detects, as a predetermined event (abnormal state), that a plurality of persons (crowd) have simultaneously changed their states in the detection target area. As in the example of FIG. 15, the monitoring control device 10 detects, as a predetermined event (abnormal state), that the crowd captured in the image of the monitoring camera 9 that images the seats has simultaneously run out toward the outside around a certain point.

[0104] The monitoring control device 10 (camera control unit 14) selects a plurality of monitoring cameras 9 capable of imaging the monitoring target area (entrance / exit) corresponding to the detection target area where the predetermined event (abnormal state) has been detected. The monitoring control device 10 simultaneously controls all of the selected plurality of monitoring cameras 9 to image the monitoring target area (entrance / exit). Thereby, even if a suspicious person runs out from the point (detection target area) where the weapon was brandished, at that time, since all the plurality of entrances and exits are already under monitoring, the appearance of the suspicious person can be surely confirmed.

[0105] In the plurality of flowcharts used in the above description, a plurality of steps (processes) are described in sequence. However, the execution order of the steps executed in each embodiment is not limited to the order of the description. In each embodiment, the order of the steps shown can be changed within a range that does not substantially affect the content. Also, the above-described embodiments can be combined within a range where the content does not conflict with each other.

[0106] Part or all of the above content can also be specified as follows. However, the above content is not limited to the following description.

[0107] 1. Detection means for detecting a predetermined event based on an image captured by a first imaging device; Control means for controlling a second imaging device to capture a predetermined position after detection of the predetermined event; A video surveillance system comprising the above. 2. After detection of the predetermined event, the control means selects a movable imaging device capable of imaging the predetermined position from among a plurality of movable imaging devices whose imaging direction can be changed, controls the selected movable imaging device, and excludes the unselected movable imaging devices from the control targets at the time of detection of the predetermined event. The video surveillance system according to 1. 3. The detection means detects the predetermined event at the predetermined position included in the image captured by the first imaging device. The video surveillance system according to 1. or 2. 4. The detection means detects the predetermined event at another predetermined position different from the predetermined position included in the image captured by the first imaging device. The video surveillance system according to 1. or 2. 5. A correspondence storage unit for storing a plurality of correspondence relationship information between a predetermined detection target position at which the predetermined event is detected and a predetermined surveillance target position corresponding to the predetermined detection target position among a plurality of predetermined surveillance target positions; further comprising After detecting the predetermined event, the control means refers to the correspondence information to identify the second imaging device capable of imaging the predetermined monitoring target position corresponding to the predetermined detection target position where the predetermined event is detected. The video surveillance system according to 4. 6. The detection means detects, as the predetermined event, the passage of an object through the video surveillance line or a predetermined situation in the monitoring area of the object. The video surveillance system according to any one of 1. to 5. 7. The detection means detects, as the predetermined event, that the passage of an object through the video surveillance line or a predetermined situation in the monitoring area of the object has occurred for a plurality of objects within a predetermined time interval. The video surveillance system according to 6.

[0108] 8. In a video surveillance method executed by at least one computer, detect a predetermined event based on an image captured by a first imaging device, after detecting the predetermined event, control a second imaging device so that the second imaging device captures a predetermined position. A video surveillance method including this. 9. Select a movable imaging device capable of imaging the predetermined position from among a plurality of movable imaging devices whose imaging directions can be changed, exclude the non-selected movable imaging devices from the control targets at the time of detection of the predetermined event. further including this, the control of the second imaging device controls the selected movable imaging device as the second imaging device. The video surveillance method according to 8. 10. The detection of the predetermined event detects the predetermined event at the predetermined position included in the image captured by the first imaging device. The video surveillance method according to 8. or 9. 11. The detection of the predetermined event detects the predetermined event at another predetermined position different from the predetermined position included in the image captured by the first imaging device. The video surveillance method according to 8. or 9. 12. Refer to a correspondence storage unit that stores a plurality of correspondence relationship information between a predetermined detection target position where the predetermined event is detected and a predetermined surveillance target position corresponding to the predetermined detection target position among a plurality of predetermined surveillance target positions, Identify the second imaging device capable of imaging the predetermined surveillance target position corresponding to the predetermined detection target position where the predetermined event is detected, The video surveillance method according to 11., further comprising this. 13. The detection of the predetermined event is to detect, as the predetermined event, the passage of the video surveillance line of the object or a predetermined situation in the surveillance area of the object, The video surveillance method according to any one of 8. to 12. 14. The detection of the predetermined event is to detect, as the predetermined event, that the passage of the video surveillance line of the object or a predetermined situation in the surveillance area of the object has occurred for a plurality of objects within a predetermined time interval, The video surveillance method according to 13.

[0109] 15. A program for causing at least one computer to execute the video surveillance method according to any one of 8. to 14.

Claims

1. A storage process of associating and storing a plurality of monitoring positions and camera parameters for imaging the plurality of monitoring positions; A setting process of setting a predetermined area within the imaging area of the first camera based on an input to the video imaged by the first camera; A detection process of detecting that a person within the imaging area of the first camera has entered the predetermined area; A control process of controlling the imaging direction of the second camera so that the second camera images the predetermined area based on the camera parameters when an intrusion of the person into the predetermined area is detected; To be executed by a computer, The predetermined area is a part of the imaging area, Program.

2. A display control process of simultaneously displaying the video imaged by the first camera and the video imaged by the second camera on a display screen; The program according to Claim 1, further to be executed by a computer.

3. The program according to Claim 1 or 2, wherein the camera parameters include the attitude information of the second camera for imaging the monitoring position.

4. In a video monitoring method executed by at least one computer, Associating and storing a plurality of monitoring positions and camera parameters for imaging the plurality of monitoring positions; Setting a predetermined area within the imaging area of the first camera based on an input to the video imaged by the first camera; Detecting that a person within the imaging area of the first camera has entered the predetermined area; When an intrusion of the person into the predetermined area is detected, controlling the imaging direction of the second camera so that the second camera images the predetermined area based on the camera parameters; Including, The predetermined area is a part of the imaging area, Video monitoring method.

5. The at least one computer, Simultaneously displaying the video imaged by the first camera and the video imaged by the second camera on a display screen, The video monitoring method according to Claim 4, further including this.

6. The video monitoring method according to Claim 4 or 5, wherein the camera parameters include the attitude information of the second camera for imaging the monitoring position.

7. A storage means for associating and storing a plurality of monitoring positions and camera parameters for imaging the plurality of monitoring positions; A setting means for setting a predetermined area within the imaging area of the first camera based on an input to the video imaged by the first camera; Detection means for detecting that a person within the imaging area of the first camera has invaded the predetermined area; Control means for controlling the imaging direction of the second camera so that the second camera images the predetermined area based on the camera parameters when the invasion of the person into the predetermined area is detected; Comprising: The predetermined area is a part of the imaging area. Video surveillance system.

8. Further comprising display control means for simultaneously displaying on a display screen the video imaged by the first camera and the video imaged by the second camera. The video surveillance system according to claim 7.

9. The video surveillance system according to claim 7 or 8, wherein the camera parameters include attitude information of the second camera for imaging the monitoring position.

Images