Program, method, and device for controlling photographing range of camera

Abstract

To provide a monitoring system that captures an abnormal event within a monitoring region at an appropriate magnitude for the abnormal event.SOLUTION: A video image monitoring system 100 includes a sensor data analysis part 104, an event size estimation part 108, and a camera control part 110. The sensor data analysis part 104 receives sensor data 102 captured by a sensing device and detects an abnormal event with related information including a detection time in a monitoring region. The event size estimation part 108 is connected to the sensor data analysis part 104, and estimates the magnitude of an entire detection event using a time-series detection event and detection device information including a device position stored in a detection device information database 106. A camera control part 110 controls (e.g., zooms in, zooms out, changes camera orientation) a monitoring camera based on the estimated magnitude of the entire detected event.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to monitoring systems, and more particularly to systems for monitoring event-related data. [Background technology]

[0002] Surveillance systems, such as video surveillance systems, have been used for periodic monitoring and event detection in several domains, where abnormal events such as terrorism, riots, theft, fights, fires, car accidents, etc. are captured by such surveillance systems.

[0003] However, in some situations, surveillance cameras cannot capture an abnormal event in a surveillance area large enough to adequately cover the event, and therefore users, including security guards and police officers, cannot adequately understand the incident because the surveillance camera captures only a portion of the entire event.

[0004] Therefore, what is needed, and what is an object of this disclosure, is to provide an improved monitoring system that captures abnormal events within a monitored area that is sized appropriately for the abnormal event. Additionally, other desirable features and characteristics will become apparent from the following detailed description and the appended claims, taken in conjunction with the accompanying drawings and this background of the disclosure. Summary of the Invention

[0005] A program according to one aspect of the present disclosure is a program for controlling a camera's shooting range, the program causing a computer to execute a process for changing the camera's shooting range based on the number of sensors that detect an event.

[0006] One aspect of the present disclosure provides a method for controlling a camera's coverage area, where the camera's coverage area is changed based on the number of sensors that detect an event.

[0007] An apparatus according to one aspect of the present disclosure is an apparatus for controlling a camera's coverage area, and includes means for changing the camera's coverage area based on the number of sensors that detect an event.

[0008] The accompanying drawings, in which identical or functionally similar elements are designated by like reference numerals throughout the separate views, and which, together with the following detailed description, are incorporated into and form a part of the specification, serve to illustrate various embodiments and explain various principles and advantages of the present invention. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 shows a block diagram of a video monitoring system according to the first embodiment. [Figure 2] FIG. 2 shows an example of adjusting the imaging range (zooming out) based on sound according to the first embodiment. [Figure 3] FIG. 3 shows an example of image capture range adjustment (zoom-in and camera direction control) based on sound according to the first embodiment. [Figure 4] FIG. 4 shows an example of imaging range adjustment (zoom out) based on the type of sound event according to the first embodiment. [Figure 5] FIG. 5 shows an example of imaging range adjustment (zoom out) using the odor sensor and infrared sensor according to the first embodiment. [Figure 6] FIG. 6 shows a flowchart of a method for monitoring event-related data according to the first embodiment. [Figure 7] FIG. 7 shows a display showing the estimated size of the entire detection event on a map according to a first embodiment. [Figure 8] FIG. 8 shows a look-up table for the alarm notification system according to the first embodiment. [Figure 9] FIG. 9 shows a block diagram of a system according to the second embodiment. [Figure 10] FIG. 10 shows a computer system for implementing the event-related data monitoring method according to the first and second embodiments.

[0010] Those skilled in the art will appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions of some of the elements in the schematic drawings or steps in the flowcharts may be exaggerated relative to other elements to help improve understanding of the embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0011] The following detailed description is merely exemplary in nature and is not intended to limit the invention or the application and uses of the invention. It is also not intended to be bound by any theory presented in the preceding background of the invention or the following detailed description. The following embodiments are intended to present an improved method for monitoring event-related data.

[0012] First Embodiment FIG. 1 shows a block diagram of a video surveillance system 100 according to this embodiment. The video surveillance system 100 includes a sensor data analysis unit 104, an event size estimation unit 108, and a camera control unit 110. The sensor data analysis unit 104 receives sensor data 102 captured by a detection device and detects abnormal events within a surveillance area, including associated information such as the detection time. The event size estimation unit 108 is connected to the sensor data analysis unit 104 and estimates the overall size of the detected event using the time series of the detected events and detection device information, including the device location, stored in a detection device information database 106. The camera control unit 110 controls the surveillance camera (e.g., zooms in, zooms out, or changes the camera direction) based on the estimated overall size of the detected event. Alternatively, a display 112 may display information based on the estimated overall size of the detected event. An alarm notification system 114 may send an alarm to a predetermined destination based on the estimated overall size of the detected event. In one example, the system 100 may include one or more of the following predetermined devices: a camera control unit 110, a display 112, and an alarm notification system 114.

[0013] The event size estimation unit 108 advantageously estimates an appropriate size of the entire detected event. The driving unit then drives a predetermined detection device to facilitate understanding of the situation. In one example, a surveillance camera captures the entire event, making it easier for security personnel to quickly understand the situation. Alternatively, a display device displays the estimated size of the entire detected event on a map, helping security personnel quickly understand the situation. A user may customize a predetermined device to operate in a predetermined manner in response to the detection of a predetermined situation.

[0014] Furthermore, the estimation of the overall size of the detected event is based on the type of event detected by the sensor data analysis unit 104. For example, if the type of detected event is an explosion, the overall size of the detected event is considered to be large. Therefore, the driving unit drives a predetermined device taking into account the large overall size of the detected event. Therefore, the surveillance camera or other device automatically adjusts based on the size of the incident (abnormal event) to capture the entire picture of the event, allowing users, including security guards and police officers, to properly understand the incident. This embodiment enables users to quickly and appropriately respond to the incident. Users may customize the size of the event depending on the type of event. Users can also investigate the incident using appropriate video footage after the incident.

[0015] 2 illustrates sound-based field of view adjustment (zoom out) 200 according to the present embodiment. A timeline 202 illustrates four steps (A to D) involved in field of view adjustment 200. In step A, a field of view 206 of a camera and microphone array 208 is set to an initial field of view 204. In step B, the camera and microphone array 208 captures the sound of glass breaking 210 from a direction of arrival 212. In step C, the camera and microphone array 208 also captures the sound of screaming 214 from a direction of arrival 216. In step D, the event size estimation unit 108 estimates the size of the event by calculating the maximum angle of the field of view to the left and right of the camera and microphone array 208 within the camera direction and within a predetermined time span. The camera control unit 110 then controls the camera of the camera and microphone array 208 to zoom out to an adjusted imaging range 218 by comparing the current setting of the camera with the maximum angle and the estimated size of the event configured in the field of view 206 of the camera and microphone array 208.

[0016] FIG. 3 illustrates sound-based field of view adjustment (zoom-in and camera direction control) 300. A timeline 302 illustrates three steps (A to C) for field of view adjustment 300. In step A, the field of view 306 of the camera and microphone array 308 is set to an initial adjustment field of view 304. In step B, the camera and microphone array 308 captures the sound of a fight 310 from an arrival direction 312. In step C, the event size estimation unit 108 estimates the size of the event by calculating the maximum angle to the left and right of the field of view within the direction of the camera and microphone array 308 and within a predetermined time span. The camera control unit 110 then compares the current camera setting with the estimated size of the event configured with the maximum angle, thereby controlling the camera and microphone array 308 to rotate and zoom in to an adjusted field of view 314, causing the camera and microphone array 308 to control the camera direction and field of view.

[0017] FIG. 4 illustrates a method for adjusting (zooming out) the camera range 400 based on the type of sound event. A timeline 402 shows three steps (A to C) involved in the adjustment of the camera range 400. In step A, the field of view 406 of the camera and microphone array 408 is set to an initial adjustment range 404. In step B, the camera and microphone array 408 captures the sound of an explosion 410 from an arrival direction 412. In step C, the event size estimation unit 108 estimates the size of the event based on the type of event (e.g., when the sensor data analysis unit 104 detects a large-scale event such as an explosion 410, the event size estimation unit 108 determines that the size of the event is “large”). The camera control unit 110 then controls the surveillance camera 408 according to the received event size. If the size is “large,” the camera control unit 110 zooms out the camera to a predetermined setting (the widest setting). The camera control unit 110 then controls the direction and field of view of the camera 408 to zoom out to an adjusted camera range 414. When the sensor data analysis unit 104 detects a small-scale event, such as a theft, the event size estimation unit 108 can determine that the size of the event is "small." When the sensor data analysis unit 104 detects a medium-scale event, such as a fire, the event size estimation unit 108 can determine that the size of the event is "medium."

[0018] 5 illustrates imaging range adjustment (zoom out) 500 using an odor sensor and an infrared sensor. A timeline 502 illustrates four steps (A to D) for imaging range adjustment 500. In step A, the field of view 508 of the camera and microphone array 512 is set to an initial adjustment range 510. The sensor data analysis unit 104 can receive sensor data captured by any sensing device, such as the odor sensor 504 and the infrared sensor 506, to detect abnormal events.

[0019] In step B, an unusual odor 514 is detected by the odor sensor 504 within a detection time. In step C, an abnormal crowd 516 is detected by the infrared sensor 506. In step D, the event size estimation unit 108 uses the sensor's position information to estimate the size of the event by calculating the maximum angle on both the left and right sides of the field of view within the camera direction and within a predetermined time span. The camera control unit 110 then controls the surveillance camera by comparing the camera's current settings with the estimated size of the event configured by the maximum angle. The camera control unit 110 then controls the camera and microphone array 512 to zoom out to an adjusted imaging range 518.

[0020] 6 shows a flowchart 600 of the event-related data monitoring method according to this embodiment. The sensor data analysis unit detects an event based on sensor data (S602). The entire magnitude of the detected event is estimated based on the event-related data of the detected event (S604). Then, a predetermined device is driven based on the estimated entire magnitude of the detected event (S606).

[0021] 7 shows a display 700 showing the estimated size of the entire detected event on a map according to this embodiment. In this embodiment, the sound of glass breaking 702 is detected by a sensor, for example, a microphone. Next, a crowd of people 704 is detected by a sensor, for example, an infrared sensor. After that, the sound of a fight 706 is detected by a sensor, for example, a microphone. Based on this event-related data, the geographic size of the entire detected event 708 is estimated by the event size estimator 108. The display 700 is driven to show the estimated size of the entire detected event on a map.

[0022] FIG. 8 shows a lookup table 800 for the alarm notification system 114 according to this embodiment. In this embodiment, one or more events are detected by one or more sensors. Based on event-related data from the sensors, an event size estimation unit estimates the overall size of the detected events. A driving unit drives the alarm notification system 114 to select a notification destination based on the estimated overall size of the detected events. For example, if the estimated overall size of the detected events is "small," the alarm notification system 114 refers to the lookup table 800 and selects "Police" as the notification destination. The alarm notification system 114 then sends an alert to "Police." Alternatively, if the estimated overall size of the detected events is "medium" or "large," the alarm notification system 114 selects "Fire Department" or "Anti-Terrorism Action Group" as the notification destination based on the lookup table 800. A user can customize the notification destination and the overall size of the detected events using the lookup table 800.

[0023] 9 shows a block diagram of a system 850 according to a second embodiment. The system 850 includes a sensor data analysis unit 860, an event analysis unit 870, and a driving unit 880. The sensor data analysis unit 860 detects an event based on sensor data. The event analysis unit 870 is connected to the sensor data analysis unit 860 and estimates the magnitude of the entire detected event based on event-related data of the detected event from the sensor data analysis unit 860. The driving unit 880 is connected to the sensor data analysis unit 860 and the event analysis unit 870 and drives a predetermined device based on the estimated magnitude of the entire detected event.

[0024] The sensor data analysis unit 860 includes the sensor data analysis unit 104 of the first embodiment. The event analysis unit 870 and the driving unit 880 include the event size estimator 108 of the first embodiment.

[0025] With the above-described configuration, according to the second embodiment, it is possible to provide an improved system that can detect abnormal events in a monitoring area with a size appropriate for the abnormal event.

[0026] The method and system of the described embodiments can be implemented on a computer system 900, shown generally in Figure 10. It can be implemented as software, such as a computer program, that runs within the computer system 900 and directs the computer system 900 to perform the method of the embodiments.

[0027] Some portions of the description that follow are explicitly or implicitly presented in terms of algorithms and functional or symbolic representations of operations on data within a computer memory. These algorithmic descriptions and functional or symbolic representations are the means used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. An algorithm is here, and generally, conceived to be a self-consistent sequence of steps leading to a desired result. The steps require physical manipulations of physical quantities, such as electrical, magnetic, or optical signals, that can be stored, transmitted, combined, compared, and otherwise manipulated.

[0028] Unless specifically indicated otherwise and unless apparent from below, it will be recognized that throughout this specification, discussions using terms such as "scanning," "calculating," "determining," "replacing," "generating," "initializing," "outputting," etc., refer to the operations and processes of a computer system or similar electronic device, transmission, or display that manipulates and transforms data represented as physical quantities within a computer system into other data that is also represented as physical quantities within a computer system or other information store.

[0029] This specification also discloses apparatus for performing the method operations. Such apparatus may be specially constructed for the required purposes, or may include a general-purpose computer or other device selectively enabled or reconfigured by a computer program stored in the computer. The algorithms and displays presented herein are not inherently related to any particular computer or other apparatus. Various general-purpose machines may be used with programs in accordance with the teachings herein. Alternatively, the construction of more specialized apparatus to perform the required method steps may be appropriate. The structure of a conventional general-purpose computer will become apparent from the description below.

[0030] Furthermore, this specification also implicitly discloses a computer program, and it will be apparent to those skilled in the art that the individual steps of the methods described herein may be embodied in computer code. The computer program is not intended to be limited to any particular programming language and its implementation. It will be recognized that a variety of programming languages ​​and their encodings can be used to implement the teachings of the disclosure contained herein. Also, the computer program is not intended to be limited to any particular control flow. There are many other different computer programs that can use various control flows without departing from the spirit or scope of the present invention.

[0031] Also, one or more steps of a computer program may be executed in parallel rather than sequentially. Such a computer program may be stored on any computer-readable medium. Computer-readable media may include storage devices, such as magnetic or optical disks, memory chips, or other storage devices suitable for interfacing with a general-purpose computer. Computer-readable media may also include wired media, such as the Internet system, or wireless media, such as the GSM (Global System for Mobile Communications) mobile phone system. When loaded and executed on such a general-purpose computer, the computer program effectively results in an apparatus that performs the steps of the preferred method.

[0032] The computer system 900 includes a computer module 902 , input modules such as a keyboard 904 and a mouse 906 , and a number of output devices such as a display 908 and a printer 910 .

[0033] The computer module 902 is connected to a computer network 912 via a suitable transceiver device 914, enabling it to access, for example, the Internet or other network systems such as a local area network (LAN) or wide area network (WAN).

[0034] For example, the computer module 902 includes a processor 918, a random access memory (RAM) 920 and a read-only memory (ROM) 922. The computer module 902 also includes several input / output (I / O) interfaces, such as an I / O interface 924 to the display 908 and an I / O interface 926 to the keyboard 904.

[0035] The components of the computer module 902 typically communicate via an interconnected bus 928 in a manner known to those skilled in the relevant art.

[0036] The application program is typically supplied to a user of the computer system 900 and is encoded on a data storage medium such as a CD (compact disc)-ROM or flash memory carrier and read using a corresponding data storage medium drive in the data storage device 930. The application program is read and its execution controlled by the processor 918. Intermediate storage of program data may be achieved using the RAM 920.

[0037] The processor 918 can execute a set of instructions to implement the method claimed in FIG. 6 . The processor 918 is configured to receive sensor data 102 captured by the sensing device shown in FIG. 1 . The sensor data 102 can be received, for example, by a sensor 950 located in a remote monitoring area. The processor 918 is configured to analyze the sensor data 102 to detect events and event-related data. The processor 918 is configured to estimate the magnitude of the entire detected event based on the event-related data of the detected event. The processor 918 transmits the drive data 952 to one or more drivers 954 so that the one or more drivers 954 can drive one or more predetermined devices, such as a camera, a display, and an alarm notification system. The one or more predetermined devices are driven based on the estimated magnitude of the entire detected event.

[0038] While embodiments have been presented in the foregoing detailed description of the invention, it should be recognized that a vast number of variations exist. For example, one skilled in the art will recognize from the teachings herein that the present technology may also be applied to any portion of other types of chemical sensors.

[0039] It should be further appreciated that the above-described embodiments are merely examples and are not intended to limit the scope, applicability, operation, or configuration of the present invention in any manner. Rather, the foregoing detailed description will provide those skilled in the art with a convenient path for implementing embodiments of the present invention. It will be understood that various changes may be made in the function and arrangement of elements and method of operation described in certain embodiments without departing from the scope of the present invention as set forth in the appended claims.

[0040] Some or all of the above-described embodiments and their modified examples can be described as, but are not limited to, the following supplementary notes. (Appendix 1)

[0041] A process of detecting an event based on the sensor data by a sensor data analysis unit; estimating the magnitude of the entire detected event based on event-related data of the detected event; and driving a predetermined device based on the estimated magnitude of the entire detected event. A computer-readable non-transitory recording medium that records a program to be executed by a computer.

[0042] This application claims priority to Singapore application No. 10201501222X, filed February 17, 2015, the disclosure of which is incorporated herein in its entirety. [Industrial Applicability]

[0043] The invention can be applied, for example, to video surveillance systems used in several areas for routine surveillance. [Explanation of symbols]

[0044] 100 Video Surveillance System 102 Sensor Data 104 Sensor Data Analysis Department 106 Detection Device Information Database 108 Event size estimation unit 110 Camera control unit 112 Display 114 Alarm Notification System 200 Image range adjustment (zoom out) 202 Timeline 204 Initial imaging range 206 Field of view 208 Camera and Microphone Array 210 Glass Breaking 212 Direction of arrival 214 Scream 216 Direction of arrival 218 Adjustable imaging range 300 Sound-based imaging range adjustment (zoom-in and camera direction control) 302 Timeline 304 Initial Adjustment Range 306 Field of view 308 Camera and Microphone Array 310 Fight 312 Direction of arrival 314 Adjustable imaging range 400 Adjusting the imaging range (zoom out) based on the type of sound event 402 Timeline 404 Initial Adjustment Range 406 Field of view 408 Camera and Microphone Array 410 Explosion 412 Direction of arrival 414 Adjustable imaging range 500 Adjusting the imaging range (zoom out) using odor sensors and infrared sensors 502 Timeline 504 Odor Sensor 506 Infrared Sensor 508 Field of view 510 Initial Adjustment Range 512 Camera and Microphone Array 514 Unpleasant odor 516 Unusual crowds 518 Adjustable imaging range 600 Flowchart of a method for monitoring event-related data 602 Event detection step 604 Step of estimating the overall size of the detected event 606. Driving a predetermined device based on the estimated magnitude of the event 700 display 702 Glass Breaking 704 Crowds 706 Fight 708 Overall size of the detected event 800 Lookup Tables 900 Computer Systems 902 Computer Module 904 keyboard 906 Mouse 908 Display 910 Printer 912 Computer Network 914 Suitable transceiver equipment 918 processor 920 Random Access Memory (RAM) 922 Read-Only Memory (ROM) 924 Display I / O interface 926 Keyboard I / O Interface 928 Interconnect Bus 930 Data storage device 950 Sensor 952 driving data 954 Drive unit

Claims

1. A program for controlling the shooting range of a camera, The program A process of widening the imaging range of the camera so that all of the events detected by the multiple sensors are included in the imaging range of the camera. A program that causes a computer to execute the following.

2. When a sensor having a first detection means and a sensor having a second detection means each detect an event, the photographing range of the camera is widened to include the event detected by the first detection means and the event detected by the second detection means, compared to the photographing range of the camera when either the first detection means or the second detection means detected the event. The program according to claim 1, which causes a computer to execute the steps.

3. The first detection means includes infrared detection. The program according to claim 2.

4. The second detection means includes odor detection. The program according to claim 2 or 3.

5. 1. A method for controlling a camera field of view, comprising: The imaging range of the camera is widened so that all of the events detected by the plurality of sensors are included in the imaging range of the camera. method.

6. A device for controlling the imaging range of a camera, comprising: means for widening the imaging range of the camera so that all of the events detected by the plurality of sensors are included in the imaging range of the camera; An apparatus comprising:

Images