Security devices, security methods, and programs

Abstract

To provide a security system that can reduce both installation and operating costs. [Solution] The security device 30 includes a security status receiving unit 34 that receives the settings for the start of security in a first detection area and the start of security in a second detection area, respectively, based on the video acquired by the imaging device 10, and an object detection unit 35 that detects an object in the first detection area when the first detection area is set to start security, and detects an object in the second detection area when the second detection area is set to start security.

Description

Technical Field

[0001] The present disclosure relates to a security device, a security method, and a program.

Background Art

[0002] There is known a security device that detects an object based on an image obtained by an imaging device capturing a monitoring area and reports an abnormality such as an intruder detection to a control center (see, for example, Patent Document 1). In a conventional security device, a plurality of detection areas are set in an image captured by an imaging device, and object detection is performed in each detection area.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in a conventional security device, object detection in a plurality of detection areas is not controlled individually but is controlled together. Therefore, in order to individually control object detection in a plurality of detection areas, it is necessary to install an imaging device for each detection area, resulting in an increase in the introduction cost of the security device and the operation cost for management and maintenance.

[0005] The present disclosure has been made in view of the above circumstances, and an object thereof is to provide a security device capable of reducing the introduction cost and the operation cost.

Means for Solving the Problems

[0006] To achieve the above objective, the security device of this disclosure is a security device using an imaging device and includes a security status receiving unit that receives a setting for the start of security in a first detection area and a setting for the start of security in a second detection area, respectively, based on the image acquired by the imaging device, and an object detection unit that detects an object in the first detection area when the first detection area is set to start security, and detects an object in the second detection area when the second detection area is set to start security. [Effects of the Invention]

[0007] This configuration allows for individual control of object detection in multiple detection areas set on video footage captured by a single imaging device. Therefore, it is possible to provide a security system that can reduce both installation and operating costs. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows an example of the overall configuration of a security system equipped with a security device according to the first embodiment of this disclosure. [Figure 2] This is a block diagram showing the functional configuration of a security system equipped with a security device according to the first embodiment of this disclosure. [Figure 3] This figure shows an example of the detection area setting screen displayed on the terminal's display unit. [Figure 4] This figure shows examples of the detection area selection screen, security start screen, and security deactivation screen displayed on the terminal's display unit. [Figure 5] This figure shows an example of a video display screen shown on the control panel. [Figure 6] This figure shows an example of a video display screen shown on the control-side display unit of a security device system according to the second embodiment. [Figure 7] This is a flowchart illustrating an example of the operation flow of a security system. [Modes for carrying out the invention]

[0009] (First Embodiment) A security device 30 and a security system 100 comprising the security device 30 according to the first embodiment of this disclosure will be described below with reference to the drawings. The security system 100 of this embodiment shown in Figure 1 is a system that detects intruders, suspicious objects, etc., in a plurality of detection areas 71 set in a predetermined security area S of a predetermined facility S based on images taken by an imaging device 10 of the predetermined security area S of a predetermined facility S.

[0010] Facility 1 is not particularly limited as long as it is a facility that is subject to security. Examples of Facility 1 include commercial facilities such as department stores, shopping centers, shopping streets and offices; parking lots of commercial facilities; industrial facilities such as factories and warehouses; entertainment facilities such as theaters, cinemas, amusement parks, aquariums, zoos and game centers; medical and welfare facilities such as hospitals and nursing homes; research and educational facilities such as schools, research institutes, art museums and museums; residential facilities such as apartment buildings and condominiums and detached houses; agricultural facilities such as fields and farms; livestock facilities such as ranches, barns, cowsheds, stables and chicken coops; fishing grounds and aquaculture farms, etc.

[0011] Security area S may be any part of facility 1, for example, an area including entrances and windows to facility 1, an area including the boundary with the surrounding area, a designated outdoor area, a designated indoor area, etc. There may be one or more security areas S, and the multiple security areas S may be different areas without overlap, or some or all of the areas may overlap in order to provide stricter security to the main part.

[0012] The security system 100 of this embodiment has a security mode in which object detection is performed and a security deactivation mode in which object detection is not performed. The security system 100 switches between the security mode and the security deactivation mode according to the security status setting from user U, more specifically, the setting instructions for security start and security deactivation. The security mode may have more detailed modes, such as an absent security mode when security is stricter when user U is absent, and an occupied security mode when security is minimally necessary when user U is present.

[0013] As shown in Figures 1 and 2, the security system 100 according to the first embodiment mainly comprises an imaging device 10, a user terminal 20, a security device 30, and a control device 50. The imaging device 10 and the security device 30 are installed in the facility 1 where the security system 100 is introduced, for example, an office building to be protected. The user terminal 20 is owned by a user U who uses the security services provided by the security system 100, for example, the owner of the facility 1. The control device 50 is installed in the control center 2 of the security company that provides the security system 100.

[0014] The imaging device 10 is connected to the security device 30 via a communication line 3, which consists of a wired or short-range wireless communication line such as Wi-Fi (registered trademark), enabling it to send and receive information to and from each other. The user terminal 20 is connected to the security device 30 via a communication line 4, which consists of a telephone line, enabling it to send and receive information to and from each other. The security device 30 is connected to the control device 50 via a communication network 5, such as the Internet, enabling it to send and receive information to and from each other.

[0015] The imaging device 10 acquires video footage of the security area S within facility 1. The imaging device 10 is installed in a position that allows it to photograph the entire security area S. The imaging device 10 is a digital camera that includes a lens, image sensor, processor, memory, etc., and captures video footage of the security area S.

[0016] In the examples shown in Figures 1 and 2, one imaging device 10 is installed in a designated location within facility 1, enabling imaging of one security area S. However, multiple imaging devices 10 may be installed depending on the size of facility 1, the purpose of security, etc., enabling imaging of multiple security areas S. The imaging device 10 outputs the captured video to the security device 30 via the communication line 3.

[0017] The images captured by the imaging device 10 may be either still images or videos. By using a wide-angle lens, the imaging device 10 can capture a wider security area S, thereby enabling security over a wider area. By using a narrow-angle lens or a telephoto lens, the imaging device 10 can capture a narrow security area S, enabling pinpoint security or more detailed security.

[0018] The imaging device 10 is not limited to a digital camera, and it only needs to be able to acquire information of a predetermined object including a person, an animal, and an article. As other different examples, the imaging device 10 can be an infrared camera that captures an image using infrared light, a distance measurement sensor that detects the distance to an object using laser light, a radar sensor that detects the distance to an object using radio waves such as microwaves and millimeter waves, an ultrasonic sensor (sonar) that detects the distance to an object using ultrasonic waves, a LiDAR that detects the distance to an object using infrared light, laser light, etc. Further, the imaging device 10 can also be an image sensor for detecting an object by a background difference method, an inter-frame difference method, or the like.

[0019] The user terminal 20 functions as an operation unit for the user U, who is an operator, to set the start or release of security for the security device 30. From the viewpoints of portability and operability, the user terminal 20 is composed of a portable terminal such as a smartphone or a tablet terminal, but may also be composed of a notebook-type or desktop-type personal computer (PC), a dedicated terminal, or the like. One user terminal 20 is assigned to one security area S, and one user U can perform operations for starting and releasing security.

[0020] The user U can be, for example, the owner of the facility 1, the security responsible person for the entire facility, the top of each tenant, the security responsible person, etc. Further, the user U is not limited to these persons, and any person who can set the start and release of security may be used, and can also be an employee of the facility 1 or each tenant, etc.

[0021] The user terminal 20 is mainly configured to include a terminal-side control unit 21, a terminal-side display unit 22, and a terminal-side operation unit 23. The user terminal 20 further includes members generally provided in a smartphone, such as a speaker, a microphone, a communication interface, etc.

[0022] The terminal-side control unit 21 consists of a processor such as a CPU. The terminal-side display unit 22 can access the security device 30 via the communication line 4 by starting a pre-installed security program or by using a general-purpose browser. The terminal-side control unit 21 controls the terminal-side display unit 22 and the terminal-side operation unit 23.

[0023] The terminal-side display unit 22 is composed of a liquid crystal display, an organic EL display, a plasma display, etc. The terminal-side display unit 22 displays various screens as shown in Figures 3 and 4 under the control of the terminal-side control unit 21. The terminal-side display unit 22 has a touch panel on its surface, and this touch panel functions as the terminal-side operation unit 23. The terminal-side operation unit 23 receives operation input from the user and outputs operation signals to the terminal-side control unit 21.

[0024] Figure 3 shows an example of the detection area setting screen 60 displayed on the terminal-side display unit 22. The detection area setting screen 60 has a video display area 60a for setting the detection area, a setting button 60b for the user U to confirm or cancel the detection area setting, and a cancel button 60c.

[0025] The video display area 60a displays video 70 of the security area S. This video 70 is live video output from the security device 30, but it may also be a still image of the security area S taken in advance. User U can set a desired area of ​​the video 70 as a detection area 71 by tapping or swiping on the video 70 in the video display area 60a. The rectangles shown by dashed lines in Figure 3 are boundary line images 60d that represent the detection areas 71 set by user U, and are displayed superimposed on the video 70. User U can set one or more detection areas 71. In the example in Figure 3, the video 70 has four detection areas 71 set: the first detection area 71a, the second detection area 71b, the third detection area 71c, and the fourth detection area 71d, in order from the top left.

[0026] If facility 1 is an office building, the first detection area 71a may be the area including the automatic doors and lobby at the entrance to the office building, for example. The second detection area 71b may be the area including the doors to the conference rooms. The third detection area 71c may be the area including the corridor in front of the automatic doors. The fourth detection area 71d may be the area including the corridor in front of the conference rooms.

[0027] Each detection area 71a to 71d can be the same size or different in size, and can be set to an appropriate size depending on the structure of the security area S, the purpose of security, etc. Although each detection area 71a to 71d is a different area in the example in Figure 3, they may overlap in part or in whole. In the overlapping area, security (object detection) will be performed if security start is set for at least one detection area 71, so important areas can be secured more appropriately.

[0028] When the user taps the setting button 60b on the detection area setting screen 60, the terminal-side control unit 21 outputs the detection area setting signal and the location information of the set detection area 71 to the security device 30. The video 70 in the video display area 60a has the x-axis set horizontally and the y-axis set vertically. The terminal-side control unit 21 outputs the coordinates of the four vertices of the detection area 71 as location information to the security device 30. When user U taps the cancel button 63c, the terminal-side control unit 21 controls the terminal-side display unit 22 to end the display of the detection area setting screen 60.

[0029] Figure 4 shows an example of the detection area selection screen 61, security start screen 62, and security deactivation screen 63 displayed on the terminal-side display unit 22. The detection area selection screen 61 shown at the top of Figure 4 has multiple selection buttons 61a to 61e for inputting the security status setting. Selection buttons 61a to 61e are provided for each detection area 71. User U can tap the selection button 61a to 61e corresponding to the detection area 71 for which they want to start or deactivate security.

[0030] The security start screen 62 shown in the lower left of Figure 4 is displayed when the detection area 71 tapped by user U on the detection area selection screen 61 is in the process of being de-security. The security start screen 62 has a message area 62a that displays a confirmation message for starting security for the detection area, an OK button 62b for user U to input a response, and a cancel button 62c. When user U taps the OK button 62b, the terminal-side control unit 21 outputs a signal to the security device 30 to set the security start for the detection area 71. When user U taps the cancel button 62c, the terminal-side control unit 21 controls the terminal-side display unit 22 to return the screen to the detection area selection screen 61.

[0031] The security deactivation screen 63 shown in the lower right of Figure 4 is displayed when the detection area 71 tapped by user U on the detection area selection screen 61 is currently under security. The security deactivation screen 63 has a message area 63a that displays a confirmation message for deactivating the security of the detection area, an OK button 63b for user U to input a response, and a cancel button 63c. When user U taps the OK button 63b, the terminal-side control unit 21 outputs a signal to the security device 30 to deactivate the security of the detection area 71. When user U taps the cancel button 63c, the terminal-side control unit 21 controls the terminal-side display unit 22 to return the screen to the detection area selection screen 61.

[0032] The screens shown in Figures 3 and 4 may also be displayed on the display unit 38 of the security device 30 and / or the control-side display unit 52 of the control device 50. This allows the user U and / or controller G to operate the operation unit 39, such as a mouse, keyboard, or touch panel, and / or the control-side operation unit 53, to set the detection area 71, start security for the detection area, and / or deactivate security.

[0033] The security device 30 detects a predetermined object from the video input from the imaging device 10 and, based on the detection of the object, sends an alert to a predetermined recipient. The security device 30 mainly consists of a control unit 31, a display unit 38, an operation unit 39, and a storage unit 40. In addition, the security device 30 is a dedicated device equipped with a communication interface for communicating with the imaging device 10, the user terminal 20, and the control device 50.

[0034] The control unit 31 is composed of a processor such as a CPU. The control unit 31 comprehensively controls the operation of the security device 30 by, for example, loading the computer program stored in the storage unit 40 onto the RAM of the storage unit 40. By activating a pre-installed security program, the control unit 31 functions as one or more of the following, as shown in Figure 2: the image acquisition unit 32, the detection area reception unit 33, the security status reception unit 34, the object detection unit 35, the alarm generation unit 36, and the output unit 37.

[0035] The image acquisition unit 32 acquires video 70 from the imaging device 10 via the communication line 3. The video 70 input from the imaging device 10 is live video captured at the current time. The live video acquired by the image acquisition unit 32 is written to the video storage area 41 of the storage unit 40 by the output unit 37 and stored, as described later. The video 70 stored in the video storage area 41 is video captured at a time earlier than the present, and is hereinafter referred to as past video. Past video is referred to later by the controller G, etc., as needed. When past video is referred to, the image acquisition unit 32 acquires the past video from the video storage area 41. The image acquisition unit 32 outputs the acquired live video or past video to each part of the control unit 31.

[0036] The detection area reception unit 33 accepts the detection area setting by acquiring location information of the detection area 71 from the user terminal 20. The detection area reception unit 33 writes the acquired location information to the detection area storage area 42 of the storage unit 40 and stores it. Each part of the control unit 31 recognizes the detection area 71 based on the location information of this detection area storage area 42.

[0037] The security status reception unit 34 receives the security status setting for the detection area 71 from the user terminal 20. The security status is, but is not limited to, security start (security set) and security deactivation. When the security status reception unit 34 receives a signal for security start setting, it sets security start for the detection area 71 by turning on the security flag, etc. When the security status reception unit 34 receives a signal for security deactivation setting, it sets security deactivation for the detection area 71 by turning off the security flag, etc.

[0038] The object detection unit 35 performs object detection in a predetermined detection area 71 when the area is set to security mode. The object detection unit 35 terminates object detection in the detection area 71 when the area is set to security mode.

[0039] The object detection unit 35 detects object O by performing image analysis on the detection area 71, which is set to begin security. The image analysis method is not particularly limited, and for example, object detection algorithms such as pattern matching, background subtraction, and interframe subtraction can be used. The object detection unit 35 can also perform more detailed object detection, including specific movements of people, by using artificial intelligence (AI) technologies such as machine learning, reinforcement learning, and deep learning using neural networks with multiple hidden layers.

[0040] The object detection unit 35 detects objects O moving within the detection area 71, such as a person or animal entering facility 1, but is not limited to this configuration. For example, the object detection unit 35 may detect specific actions of a person, such as breaking locks or windows, or taking valuables. When the object detection unit 35 detects an object O, it superimposes a red detection frame image 72 surrounding the detected object O onto the image 70 (see Figure 5). The object detection unit 35 may also detect that a safe or the like in the detection area 71 has been taken away, i.e., that object O is no longer detected. When object O is no longer detected, the object detection unit 35 may superimpose a non-detection frame image indicating the location where object O was located onto the image 70. The image superimposed on the image 70 is not limited to the red detection frame image 72, etc., and may be an image of another shape or color, or these images may be displayed as flashing images. The detected object O may also be colored or flashing.

[0041] Only one object detection unit 35 is provided in the control unit 31 and performs object detection in all detection areas 71, but the system is not limited to this configuration. As an example, an object detection unit 35 may be provided for each detection area 71 and perform object detection only in the corresponding detection area 71. For example, in the example in Figure 3, four object detection units 35 may be provided corresponding to the first to fourth detection areas 71a to 71d, and each object detection unit 35 may perform object detection in the corresponding detection area 71.

[0042] The alarm generation unit 36 ​​issues an alarm to a predetermined recipient based on the object detection unit 35 detecting object O. The alarm generation unit 36 ​​issues an alarm by outputting detection information, including that object O has been detected, to the recipient. The alarm generation unit 36 ​​may also issue an alarm to the predetermined recipient indicating that object O is no longer detected.

[0043] Only one notification destination may be set, and the alarm unit 36 ​​may send an alert to the same destination for all detection areas 71. Alternatively, multiple notification destinations may be set, and the alarm unit 36 ​​may send alerts to different destinations or the same destination for each detection area 71.

[0044] In this embodiment, there is only one notification destination, the control device 50, and the alarm unit 36 ​​outputs detection information from all detection areas 71 to the control device 50 to issue an alarm. As a variation, the alarm unit 36 ​​may, for example, issue an alarm to the control device 50, the first notification destination, when an object is detected in the first and third detection areas 71a and 71c near the office entrance, and issue an alarm to the user terminal 20, the second notification destination, when an object is detected in the second and fourth detection areas 71b and 71d near the conference room.

[0045] Detection information includes, but is not limited to, the type of object O detected, location information, date and time, identification information, and actions. Examples of object O types include people such as intruders, animals such as vermin, and items such as safes. Location information includes the coordinates of the object on the video 70. Date and time refers to the date and time when the object was detected or not detected. Identification information includes, for example, gender, age, height, and size. Examples of actions include actions such as breaking locks or windows, or taking items.

[0046] The output unit 37 outputs the video 70, i.e., live video, acquired by the image acquisition unit 32 from the imaging device 10, to the control device 50 and also writes it to the video storage area 41. The output unit 37 also outputs the video 70, i.e., past video, acquired by the image acquisition unit 32 from the video storage area 41, to the control device 50. When the object detection unit 35 detects an object O, the object detection frame image 72 is superimposed on the video 70 and output to the control device 50. When the output unit 37 writes the live video to the video storage area 41, it may write the live video with the detection frame image 72 superimposed, or it may write only the live video in association with the detection information.

[0047] The display unit 38 consists of a liquid crystal display, an organic EL display, a plasma display, etc. The display unit 38 displays various screens under the control of the control unit 31. The operation unit 39 consists of a touch panel, operation buttons, a power switch, etc., and receives operation instructions from users in facility 1 and outputs them to the control unit 31.

[0048] The storage unit 40 is composed of semiconductor memory such as ROM and RAM, storage media such as memory cards, etc. The storage unit 40 may also include a cloud database provided on a cloud server. The storage unit 40 temporarily or permanently stores various programs, parameters, etc., used for various operations in the security device 30. The storage unit 40 has a video storage area 41 and a detection area storage area 42. The video storage area 41 stores video input from the imaging device 10, for example, by shooting date. The detection area storage area 42 stores the coordinates, which are the positions of the set detection areas 71.

[0049] The control device 50 acquires video 70 and alarm signals from the security device 30, displays the video 70, and notifies the control officer G. The control device 50 consists of one or more PCs equipped with a processor such as a CPU, semiconductor memory such as ROM and RAM, storage media such as a memory card, and peripheral devices such as a display, keyboard, mouse, microphone, speaker, camera, A / D converter, communication equipment, and printer. The personal computers may be replaced with server PCs or general-purpose server computers (mainframes), etc.

[0050] As shown in Figure 2, the control device 50 mainly comprises a control-side control unit 51, a control-side display unit 52, a control-side operation unit 53, and a control-side storage unit 54. The control-side control unit 51 is composed of a PC processor. The control-side control unit 51 controls the operation of the entire control device 50 by activating a pre-installed security program.

[0051] The control-side display unit 52 is composed of a liquid crystal display, an organic EL display, a plasma display, etc. The control-side display unit 52 displays various screens under the control of the control-side control unit 51. The control-side operation unit 53 is composed of a keyboard, mouse, touch panel, etc. The control-side operation unit 53 receives operation input from the operator, such as the controller G at the control center 2, and outputs operation signals to the control-side control unit 51.

[0052] The control-side memory unit 54 is composed of a storage medium provided by the PC. The control-side memory unit 54 temporarily or permanently stores programs, parameters, etc., used for various operations of the control device 50. The control-side memory unit 54 may also store video 70, object detection information, etc., input from the security device 30.

[0053] The control unit 51 displays a video display screen 52a on the control display unit 52 for displaying video 70 input from the security device 30. The control display unit 52 may be provided as one unit or multiple units, and video 70 captured by one imaging device 10 may be displayed on one control display unit 52. Alternatively, video 70 captured by multiple imaging devices 10 may be displayed on one control display unit 52, or video 70 captured by multiple imaging devices 10 may be switched and displayed on one control display unit 52. Figure 5 is a diagram showing an example of a video display screen 52a displayed on the control display unit 52. Multiple detection areas 71a to 71d are set by the detection area reception unit 33 of the security device 30 for the video 70 displayed on the video display screen 52a. In the example shown in Figure 5, as indicated by the dashed box, the first detection area 71a, second detection area 71b, third detection area 71c, and fourth detection area 71d are set in order from the top left of the video 70.

[0054] The dashed lines around the outer perimeters of detection areas 71a to 71d are shown to make detection areas 71a to 71d easier to understand and are not actually displayed on the video 70. However, to allow the controller G to easily determine which detection area 71 an anomaly occurred in, a demarcation line image may be displayed around the outer perimeters of detection areas 71a to 71d, similar to the detection area setting screen 60 shown in Figure 3.

[0055] In the example shown in Figure 5, object O is detected in the second detection area 71b while security is in operation, so a red detection frame image 72 surrounding object O is displayed. This allows the controller G to properly recognize that object O has been detected. Alternatively, if a non-detection image is displayed, the controller G can properly recognize that object O has been unintentionally taken away, etc. Furthermore, if the detection frame image 72 or non-detection frame image is displayed in a flashing manner, or if object O is displayed in a colored or flashing manner, it can attract the controller G's attention even more. Note that even if a person is in the first detection area 71a while security is being deactivated, the detection frame image 72 will not be displayed for this person because no object detection has been performed.

[0056] The control unit 51 notifies the controller G that object O has been detected based on an alarm from the security device 30. For example, the control unit 51 notifies by outputting a buzzer sound and a warning message from a speaker, and by displaying a warning message on the control display unit 52. This allows the controller G to become more appropriately aware of the detection of object O through sound and other means, in addition to the display of the detection frame image 72.

[0057] As another variation, the control unit 51 may display the detection area 71 while security is in operation clearly, while displaying the detection area 71 while security is being deactivated at a lower brightness or with a blurred effect. This allows the controller G to focus on monitoring the detection area 71 while security is in operation, while also protecting the privacy of people appearing in the video 70.

[0058] An example of the operation performed by the security system 100 according to this embodiment is described below. In the security system 100, the imaging device 10, user terminal 20, security device 30, and control device 50 are activated and able to communicate with each other, and the imaging device 10 has started capturing video 70 and outputting it to the security device 30.

[0059] First, the detection area setting process is performed when the security system 100 is installed or during maintenance. As described above, user U operates the user terminal 20 to set the detection areas 71 on the detection area setting screen 60. As a result, location information for each detection area 71 is output from the user terminal 20 to the detection area reception unit 33 of the security device 30. The detection area reception unit 33 acquires this location information and writes it to the detection area storage area 42 for storage.

[0060] An example of the daily security operations in the security system 100 is described below with reference to the flowchart shown in Figure 7, but is not limited to the operations described below. The flowchart in Figure 7 shows an example of the operation of the security device 30.

[0061] In step S1, the image acquisition unit 32 acquires one frame of video 70 from the imaging device 10. In step S2, the security status reception unit 34 determines whether a signal for setting security start or security deactivation has been input from the user terminal 20. As described above, the setting for starting or deactivating security can be done by user U from the security start screen 62 or security deactivation screen 63 displayed on the terminal-side display unit 22 of the user terminal 20.

[0062] If the security status reception unit 34 determines that a signal for setting security has been received (YES), the control unit 31 proceeds to step S3. On the other hand, if the security status reception unit 34 determines that there is no signal for setting security (NO), the control unit 31 skips step S3 and proceeds to step S4.

[0063] In step S3, the security status reception unit 34 sets the security to be started or deactivated for the detection area 71 where a signal for setting security to be started or deactivated has been input. After that, the control unit 31 proceeds to step S4.

[0064] In step S4, the object detection unit 35 performs object detection in the detection area 71 where security activation is set. In the next step S5, the control unit 31 determines whether the object detection unit 35 has detected object O. If the object detection unit 35 determines that it has detected object O (YES), the control unit 31 proceeds to step S6. On the other hand, if the object detection unit 35 determines that it has not detected object O (NO), the control unit 31 skips steps S6 and S7 and proceeds to step S8.

[0065] In step S6, the object detection unit 35 superimposes a red detection frame image 72 surrounding the detected object O onto the video 70. In the next step S7, the alarm generation unit 36 ​​outputs the detection information of object O to the control device 50, which is the notification destination, via the communication network 5 and generates an alarm.

[0066] In the next step S8, the output unit 37 outputs the video 70 to the control device 50 via the communication network 5 and also writes it to the video storage area 41 of the memory unit 40.

[0067] Upon receiving the video 70 input from the output unit 37, the control device 50's control-side control unit 51 displays the video 70 on the video display screen 52a of the control-side display unit 52. At this time, if object O is detected in the detection area 71 during security operation, an object detection frame image 72 is superimposed on the video 70. This allows the controller G to clearly confirm visually that object O has been detected. The control-side control unit 51 may also write and store the video 70 in the control-side storage unit 54, and in this case, it may write only the video 70 from the point in time when object O was detected. Furthermore, upon receiving an alarm input from the alarm unit 36, the control device 50's control-side control unit 51 notifies the controller G that object O has been detected by outputting a warning sound or displaying a warning message. This allows the controller G to recognize the detection of object O more clearly and quickly, enabling them to deal with intruders and other threats quickly and appropriately.

[0068] When step S8 is completed, the control unit 31 returns to step S1 and repeats steps S1 to S8. In detection area 71 where security deactivation is set, steps S4 to S7 are not performed, and only step S8 is executed, after which the process returns to step S1 and the same process is repeated.

[0069] The above-described operation is an example of security operation when performing object detection on live video. The security system 100 of this embodiment can perform object detection on past video stored in the video storage area 41. An example of this operation is also explained below using the flowchart in Figure 7.

[0070] Object detection using past video footage is performed, for example, by instructions from the control device 50, but may also be performed by instructions from the user terminal 20. The controller G issues an instruction to perform object detection from past video footage from a menu screen (not shown) displayed on the control-side display unit 52, and also inputs an instruction to start security for the detection area 71 in which object detection will be performed. At this time, the controller G or the like can specify a predetermined period for which object detection will be performed, for example, the period from 2:00 AM to 4:00 AM today, and object detection can be performed automatically on past video footage for this period all at once.

[0071] When an instruction signal from the control device 50 is input to the security device 30, in step S1, the image acquisition unit 32 acquires past video from the video storage area 41. In step S2, the security status reception unit 34 determines that a signal to start security has been input, and in the next step S3, the security status reception unit 34 sets security to start for the detection area 71.

[0072] In the next step S4, the object detection unit 35 performs object detection on the detection area 71. If the object detection unit 35 determines in step S5 that it has detected object O (YES), in step S6, the object detection unit 35 superimposes a red detection frame image 72 surrounding the detected object O onto the video 70. In the next step S7, the alarm unit 36 ​​may issue an alarm, but it does not have to be done as the controller G is monitoring past video footage.

[0073] In the next step, S8, the output unit 37 outputs the past video to the control device 50. If object O is detected, the past video with the detection frame image 72 superimposed is output. The past video or the past video with the detection frame image 72 superimposed is displayed on the video display screen 52a of the control-side display unit 52 of the control device 50. As a result, the controller G can recognize whether there was an intruder or something similar in the past.

[0074] (Second embodiment) The security device 30 and security system 100 according to the second embodiment of this disclosure have the same basic configuration and functions as those according to the first embodiment shown in Figures 1 and 2, etc. In the first embodiment described above, the security status receiving unit 34 of the security device 30 receives the setting of security start and security deactivation for each detection area 71 based on operations from the terminal side operation unit 23, etc. by a user U, etc. In contrast, in the second embodiment, the security status receiving unit 34 is configured to receive the setting of security start for another detection area 71 based on the object detection unit 35 detecting an object O in any of the detection areas 71.

[0075] Details of the processing in the security system 100 of the second embodiment will be explained below with reference to Figure 6. Figure 6 is a diagram showing an example of the video display screen 50a displayed on the control side display unit 52 of the security system 100 according to the second embodiment. In this example of Figure 6, the facility 1 to be guarded is a stable, and the first to fourth detection areas 71a to 71d are pre-set. The first and second detection areas 71a and 71b are areas that include compartments in which the first object to be detected, namely the horse O1, is housed. The third and fourth detection areas 71c and 71d are areas in front of the first and second detection areas 71a and 71b, respectively, and include passages through which horses, people, etc., pass. In Figure 6, O2 indicates a person, such as a suspicious person, who is the second object to be detected.

[0076] In the security system 100 of the second embodiment, when a horse O1 is in the first or second detection area 71a, 71b, the system is configured to monitor whether the horse O1 is being subjected to inappropriate acts such as theft by a suspicious person O2.

[0077] For example, assume that the first and second detection areas 71a and 71b are set to be activated and that horse O1 is not present. On the other hand, assume that the third and fourth detection areas 71c and 71d are set to be deactivated. The object detection unit 35 performs detection of horse O1 in the first and second detection areas 71a and 71b.

[0078] When a horse O1 returns to the stable from a pasture or similar location and enters a section within the first detection area 71a, as shown in Figure 6, the object detection unit 35 detects the horse O1 in the first or second detection area 71a, 71b and notifies the security status reception unit 34 that the horse O1 has been detected. Upon receiving this notification, the security status reception unit 34 sets security to begin for the third detection area 71c, 71d. As a result, the object detection unit 35 begins object detection in the third detection area 71c. When a person O2, such as a suspicious person, enters the third area 71c, the object detection unit 35 detects this person O2, a red detection frame image 72 is superimposed on the video 70, and output from the output unit 37 to the control device 50, while the alarm unit 36 ​​also sends an alarm to the control device 50.

[0079] Upon receiving these inputs, the control device 50 displays an image 70 on the control-side display unit 52, as shown in Figure 6, in which a detection frame image 72 surrounding the suspicious person O2 is superimposed, and also outputs a warning sound based on the alarm. Therefore, the control operator G can clearly and quickly recognize that the suspicious person O2 has entered the stable. Note that the fourth detection area 71d is deactivated, so even if a person is present, they will not be detected as a suspicious person.

[0080] Furthermore, when the security status reception unit 34 sets the third detection area 71c to security start, it sets the first detection area 71a to security deactivation, but it may also leave the security start setting in a different security mode. In this case, the object detection unit 35 can be configured to detect that horse O1 is not detected in the first detection area 71a, instead of detecting horse O1. With this configuration, when horse O1 is stolen, the object detection unit 35 detects its absence and superimposes a non-detection frame image onto the video 70, and the alarm unit 36 ​​also issues an alarm indicating that horse O1 is not detected. Therefore, the controller G can understand that horse O1 has been stolen, enabling more appropriate security measures.

[0081] As described above, the security device 30 of each embodiment includes, in a security device 30 using an imaging device 10, a security status receiving unit 34 that receives a pre-set setting for the start of security in a first detection area 71a and a setting for the start of security in a second detection area 71b, respectively, for the video 70 acquired by the imaging device 10, and an object detection unit 35 that detects an object in the first detection area 71a when the first detection area 71a is set to start security, and detects an object in the second detection area 71b when the second detection area 71b is set to start security. The security system 100 of each embodiment includes an imaging device 10 and the security device 30 as described above.

[0082] The security method executed by the control unit 31 of the security device 30 in each of the above embodiments includes a security status reception step that receives the settings for the start of security in a first detection area 71a and the start of security in a second detection area 71b, respectively, based on the video 70 acquired by the imaging device 10, and an object detection step that detects an object in the first detection area 71a when the first detection area 71a is set to start security, and detects an object in the second detection area when the second detection area 71b is set to start security. The program executed in the above embodiments is a program executed by a computer (security device 30), which causes the computer to execute each of the above steps of the security method.

[0083] Therefore, according to the security device 30, security system 100, security method, and program of each embodiment described above, object detection in multiple detection areas 71 can be performed based on video 70 captured by a single imaging device 10, eliminating the need to provide multiple imaging devices 10 for each detection area 71. Consequently, user U can reduce the introduction and operating costs of the security device 30 and security system 100.

[0084] The security device 30 in each of the above embodiments further includes a detection area receiving unit 33 that receives the setting of a first detection area 71a and the setting of a second detection area 71b for the video 70, respectively. With this configuration, user U or controller G can freely set the detection area 71 for the video 70 according to the size, structure, usage, security purpose, etc. of the facility 1.

[0085] The security status receiving unit 34 of the security device 30 in the first embodiment described above is connected to the operation unit 39, the terminal-side operation unit 23, and the control-side operation unit 53. Based on the operation of the operation unit by the user U or control officer G, the security status receiving unit 34 receives the setting to start security for the first detection area 71a and the second detection area 71b, respectively. With this configuration, the user U, control officer G, etc., can set the start of security for the detection area 71.

[0086] In the second embodiment described above, the security status receiving unit 34 of the security device 30 receives a setting to start security in the third detection area 71c based on the object detection unit 35 detecting a predetermined object, a horse O1, in the first detection area 71a. With this configuration, the user U etc. does not need to set the security status of the detection area 71, and security is automatically started and then deactivated according to the situation in the detection area 71, providing a more user-friendly security device 30 etc.

[0087] In each of the above embodiments, the video 70 is either live video or historical video. If the video 70 is live video, object detection of intruders and other objects can be performed in real time. If the video 70 is historical video, object detection can be performed retrospectively, and object detection can be performed by setting the detection target and situation as desired.

[0088] The security device 30 in each of the above embodiments further includes an alarm unit 36. Based on the object detection unit 35 detecting a predetermined object O in the first detection area 71a, the alarm unit 36 ​​sends an alarm to a first notification destination, and based on the object detection unit 35 detecting a predetermined object O in the second detection area 71b, the alarm unit 36 ​​sends an alarm to a second notification destination. If the first and second notification destinations are the same (for example, both are control devices 50 or both are user terminals 20), the fact of object detection, actions taken in response to object detection, etc., can be centrally managed at a single notification destination.

[0089] On the other hand, if the first and second notification destinations are different (for example, one being the control device 50 and the other being the user terminal 20), then not only the control officer G but also users such as the owner or person in charge of facility 1 can receive notifications. Furthermore, if there are multiple user terminals 20, and the first notification destination is the first user terminal 20 and the second notification destination is the second user terminal 20, then in a facility 1 with multiple tenants, notifications can be sent only to the tenants where object detection has occurred, thereby suppressing unnecessary notifications.

[0090] While embodiments and modifications of the present disclosure have been described in detail above with reference to the drawings, the specific configuration is not limited to these embodiments, and any design changes that do not depart from the gist of the present disclosure are included in this disclosure.

[0091] In each of the embodiments described above, instructions to start and stop security are given from the user terminal 20, but the configuration is not limited to this, and instructions may be given from the security device 30 or the control device 50 instead of the user terminal 20, or in addition to the user terminal 20. In this case, the control unit 31 of the security device 30 or the control-side control unit 51 of the control device 50 controls the display unit 38 or the control-side display unit 52 to display a screen similar to the screen displayed on the user terminal 20 shown in Figure 4, for example. User U at facility 1 or controller G at control center 2 can input instructions to start or stop security according to the displayed screen.

[0092] Furthermore, in each of the above embodiments, only one user terminal 20 is assigned to one security area S. As a variation, multiple user terminals 20 may be assigned to one security area S, and multiple users U may be able to perform security start and security deactivation operations. In this case, for example, the first user U may only be able to set the security status for the first detection area 71a, and the second user U may only be able to set the security status for the second detection area 71b. As a result, the security device 30 and security system 100 of this disclosure can be suitably used in a facility 1 that includes multiple different tenants.

[0093] Furthermore, the security status reception unit 34 may accept the settings for security start and security deactivation for each detection area 71 based on a pre-set schedule. In this case, for example, as shown by the dashed line in Figure 2, the storage unit 40 is configured to have a schedule storage area 43. This schedule storage area 43 stores a schedule for each detection area 71, including the security start time and security deactivation time. Writing the schedule to the schedule storage area 43 may be done by a user U from the user terminal 20 or security device 30 when setting up the detection area 71, or by a controller G from the control device 50. With this configuration, the security status does not need to be set by the user U or controller G, and the security status is set automatically based on the schedule, thus saving the user U and others time and providing a more user-friendly security device 30, etc. [Explanation of Symbols]

[0094] 10: Imaging device 20: User terminal (notification destination) 23: Terminal-side control unit (control unit) 30: Security device 31: Control Unit 33: Detection Area Reception Unit 34: Security status reception unit 35: Object detection unit 36: Alarm section 39: Operation section 53: Control panel (operator) 70: Video 71: Detection area 71a: First detection area 71b: Second detection area 71c: Third detection area 71d: Fourth detection area O: Object U: User (operator) G: Controller (operator)

Claims

1. In a security system using an imaging device, A security status receiving unit receives the settings for the start of security in a first detection area and the start of security in a second detection area, respectively, based on the video acquired by the aforementioned imaging device. When the first detection area is set to begin security, the object detection unit detects an object in the first detection area, and when the second detection area is set to begin security, the object detection unit detects an object in the second detection area. A security device characterized by being equipped with the following features.

2. The system further includes a detection area receiving unit that accepts the setting of the first detection area and the setting of the second detection area for the aforementioned video. The security device according to claim 1, characterized by the features described above.

3. The security status reception unit is connected to the operation unit, Based on the operator's operation of the control unit, the security status reception unit receives the setting for the start of security for the first detection area and the second detection area, respectively. The security device according to claim 1, characterized by the features described above.

4. The security status reception unit receives the settings for the start of security for the first detection area and the second detection area, respectively, based on a pre-set schedule. The security device according to claim 1, characterized by the features described above.

5. The security status receiving unit receives a setting to start security in the second detection area based on the object detection unit detecting a predetermined object in the first detection area. The security device according to claim 1, characterized by the features described above.

6. The aforementioned video is either live footage or past footage. The security device according to claim 1, characterized by the features described above.

7. It is further equipped with an alarm system, Based on the object detection unit detecting a predetermined object in the first detection area, the alarm unit sends an alarm to the first notification destination, and based on the object detection unit detecting a predetermined object in the second detection area, the alarm unit sends an alarm to the second notification destination. The first recipient and the second recipient are the same. The security device according to claim 1, characterized by the features described above.

8. It is further equipped with an alarm system, Based on the object detection unit detecting a predetermined object in the first detection area, the alarm unit sends an alarm to the first notification destination, and based on the object detection unit detecting a predetermined object in the second detection area, the alarm unit sends an alarm to the second notification destination. The first recipient and the second recipient are different. The security device according to claim 1, characterized by the features described above.

9. A security method performed by the control unit of a security device according to any one of claims 1 to 8, A security status reception process that receives the settings for the start of security in a first detection area and the start of security in a second detection area, respectively, based on the video acquired by the imaging device, The process includes an object detection step in which, when the first detection area is set to begin security, an object is detected in the first detection area, and when the second detection area is set to begin security, an object is detected in the second detection area. A security method characterized by the following features.

10. A program executed by a computer, A program that causes this computer to perform each step of the security method described in claim 9.

Images