Security systems, security devices, security methods and programs

Abstract

The aim is to allow video confirmation at the control center as needed, even when security is deactivated, while respecting user privacy. [Solution] The security system 100 includes an imaging device 10 that captures images of a predetermined security area S, a security device 30 that acquires images from the imaging device 10, a security terminal 50 that requests the security device 30 to display the images and displays the images when the request is approved, and a user terminal 60 that receives an image display signal indicating that the security terminal 50 has displayed the images. When the security device 30 approves the security terminal's request to display the images, it transmits the images to the security terminal 50 and also transmits an image display signal to the user terminal 60.

Description

Technical Field

[0001] The present disclosure relates to a security system, a security device, a security method, and a program.

Background Art

[0002] There is known a security device that, when detecting an abnormality in a security area, attaches an image and transmits an abnormality signal to a control center (see Patent Documents 1 and 2). The security device described in Patent Document 1 protects the privacy of the user by not transmitting an image in the security release state. The security device described in Patent Document 2 avoids invasion of privacy by blocking the lens of the surveillance camera and making imaging of the surveillance camera impossible in the security release state, and also明示 to the user that privacy has not been invaded.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in a conventional security device, even when an emergency such as a fire occurs in the security release state, a controller cannot view an image at the control center, so it is difficult to quickly grasp the situation at the scene.

[0005] The present disclosure has been made in view of the above circumstances, and an object thereof is to enable a security device to consider the privacy of a user and to enable video confirmation at a control center as needed even in the security release state.

Means for Solving the Problems

[0006] To achieve the above objective, the security system of this disclosure comprises: an imaging device that captures images of a predetermined security area; a security device that acquires the images from the imaging device; a security terminal that requests the security device to display the images and displays the images when the request is permitted; and a user terminal that receives an image display signal indicating that the security terminal has displayed the images. When the security device permits the security terminal to display the images, it transmits the images to the security terminal and also transmits the image display signal to the user terminal. [Effects of the Invention]

[0007] This configuration allows the security system to respect user privacy while also enabling video monitoring at the control center as needed, even when the security system is deactivated. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows an example of the overall configuration of a security system equipped with a security device according to the present disclosure, as well as the flow of signals, etc. [Figure 2] This is a block diagram showing the functional configuration of a security system equipped with a security device according to an embodiment of the present disclosure. [Figure 3] This figure shows the data structure of the event information storage area and the data structure of the browsing information storage area. [Figure 4] This figure shows examples of the alarm screen, image patrol screen, and video display screen displayed on the security system's display unit. [Figure 5] This figure shows an example of a push notification displayed on the user's screen. [Figure 6] This figure shows an example of a browsing information list displayed on the user's screen. [Figure 7] This is a flowchart illustrating an example of the operation flow of a security system. [Figure 8] This flowchart provides a detailed explanation of each step in the security system status setting, object detection, and anomaly notification process. [Figure 9]This flowchart provides a detailed explanation of each process: video output, viewing notification, and viewing information output. [Modes for carrying out the invention]

[0009] The security device 30 and the security system 100 comprising the security device 30 according to the embodiments of this disclosure will be described below with reference to the drawings. The security system 100 of this embodiment, shown in Figures 1 and 2, is a system that provides security for a predetermined security area S set in a predetermined facility 1 based on images captured by an imaging device 10 and alarms from a detection sensor 20.

[0010] Facility 1 is not particularly limited as long as it is a facility that is subject to security. Examples of Facility 1 include commercial facilities such as department stores, shopping centers, shopping streets and offices; parking lots of commercial facilities; industrial facilities such as factories and warehouses; entertainment facilities such as theaters, cinemas, amusement parks, aquariums, zoos and game centers; medical and welfare facilities such as hospitals and nursing homes; research and educational facilities such as schools, research institutes, art museums and museums; residential facilities such as apartment buildings and condominiums and detached houses; agricultural facilities such as fields and farms; livestock facilities such as ranches, barns, cowsheds, stables and chicken coops; fishing grounds and aquaculture farms, etc.

[0011] Security area S may be set in any location within facility 1. Examples of security area S include areas including entrances and windows to facility 1, areas including boundaries with neighboring properties, designated outdoor areas, designated indoor areas, etc. Security area S may be set in one location or multiple locations within facility 1. Multiple security areas S may be different areas without overlap, or some or all of the areas may overlap in order to provide more stringent security for the main areas.

[0012] The security system 100 of this embodiment has a security mode that performs object detection, such as detecting intruders, and a security deactivation mode that does not perform object detection. The security system 100 switches between the security mode and the security deactivation mode according to the security status setting from user U, more specifically, the setting instructions for starting and deactivating security. The security mode may have more detailed modes, such as an absent security mode when security is stricter when user U is absent, and an occupied security mode when security is minimally necessary when user U is present.

[0013] As shown in Figures 1 and 2, the security system 100 according to this embodiment mainly comprises an imaging device 10, a detection sensor 20, a security device 30, a security terminal 50, and a user terminal 60. Although Figures 1 and 2 depict one imaging device 10, one detection sensor 20, one security terminal 50, and one user terminal 60, in this embodiment, multiple units of each are installed. One security device 30 is installed in facility 1, but it is not limited to one, and multiple units may be installed in a single facility 1. Similarly, multiple security terminals 50 may be installed in the control center 2, not limited to one.

[0014] The imaging device 10, detection sensor 20, and security device 30 are installed in facility 1 where the security system 100 is introduced, which in this embodiment is a commercial facility. The security terminal 50 is installed in the control center 2 of the security company that provides the security system 100 and is used by the controller C of the control center 2. The security terminal 50 is also carried by the security company's security guards G. The security guards G are on standby at standby stations 3 set up by the security company in each predetermined area. The security guards G proceed from standby station 3 to facility 1 upon receiving an alarm from the security device 30 or instructions from controller C. The user terminal 60 is owned by user U who uses the security services provided by the security system 100.

[0015] In Facility 1, a plurality of security areas S are set up on a floor-by-floor basis or on a store-by-store basis. The imaging device 10 and the detection sensor 20 are respectively provided in each security area S. The imaging device 10 and the detection sensor 20 in each security area S are connected to the security device 30 so as to be able to transmit and receive information to and from each other via a communication line 4 composed of a wired line such as a USB cable or a short-range wireless communication line such as Wi-Fi (registered trademark).

[0016] The security device 30, the security terminal 50, and the user terminal 60 can be connected to the cloud 6 via a communication line 5 composed of an Internet line, a telephone line, a dedicated line, etc. The security device 30 is connected to the security terminal 50 and the user terminal 60 so as to be able to transmit and receive information to and from each other via the communication line 5 and the cloud 6. Note that the security device 30 is not limited to a configuration in which it transmits and receives information to and from the security terminal 50 and the user terminal 60 via the cloud 6, and may be configured to directly transmit and receive information via the communication line 5.

[0017] The imaging device 10 captures the video of the security area S. The imaging device 10 is installed at a position where it can capture the entire security area S. The imaging device 10 includes a lens, an imaging element, a processor, a memory, etc., and is a digital camera that captures the video of the security area S. The imaging device 10 outputs the captured video to the security device 30 via the communication line 4. The video captured by the imaging device 10 may be either a still image or a moving image.

[0018] The imaging device 10 is not limited to a digital camera, and it is sufficient if it can acquire information on a predetermined object including a person, an animal, and an article. As another different example, the imaging device 10 can be an infrared camera that captures video using infrared light, a distance measuring sensor that detects the distance to an object using laser light, a radar sensor that detects the distance to an object using radio waves such as microwaves and millimeter waves, an ultrasonic sensor (sonar) that detects the distance to an object using ultrasonic waves, a LiDAR that detects the distance to an object using infrared light, laser light, etc. Also, the imaging device 10 can be an image sensor for detecting an object by a background difference method, an inter-frame difference method, etc.

[0019] The detection sensor 20 detects abnormalities occurring in the security area S as events and outputs a detection signal to the security device 30 via the communication line 4 to trigger an alarm. The detection sensor 20 detects events and triggers an alarm regardless of whether the mode is security mode or de-security mode. Events include the detection or non-detection of a predetermined object in the security area S, or the occurrence of some kind of abnormality in the security area S. The detection sensor 20 includes a human presence sensor 21 that detects people or animals by heat or movement, a fire detection sensor 22 that detects fires by heat or smoke, a gas detection sensor 23 that detects fuel gas or carbon monoxide gas, etc.

[0020] The detection sensor 20 also includes the card reader of the card key device 24 as one of its detection sensors. The card key device 24 is a device that authenticates card keys and locks and unlocks locks. The card key device 24 can also identify people using card keys, and therefore functions as a human detection sensor. For example, when the security system is deactivated, if a person under surveillance as a person of interest (a perpetrator of an inside job) uses a card key to enter a high-security room such as a vault or the president's office, the card key device 24 will identify the card key and trigger an alarm. The card key device 24 will also trigger an alarm if an unlocking operation is performed with a card key while the security system is active.

[0021] In addition, the detection sensor 20 may include an emergency bell, an earthquake sensor, etc. The motion sensor 21, fire detection sensor 22, gas detection sensor 23, and card key device 24 may all be provided in each security area S, or any of them may be selectively provided depending on the type and usage of the security area S.

[0022] The security device 30 detects a predetermined object from the video input from the imaging device 10 and, based on the detection of an intruder or other object, sends an alert to a predetermined recipient. The security device 30 also sends an alert to a predetermined recipient based on the detection signal input from the detection sensor 20. The security device 30 mainly consists of a control unit 31, a display unit 40, an operation unit 41, and a storage unit 42. In addition, the security device 30 is a dedicated device equipped with communication interfaces for communicating with the imaging device 10, the detection sensor 20, the security terminal 50, and the user terminal 60.

[0023] The control unit 31 is composed of a processor such as a CPU. The control unit 31 comprehensively controls the operation of the security device 30 by, for example, loading the computer program stored in the memory unit 42 onto the RAM of the memory unit 42. By starting a pre-installed security program, the control unit 31 functions as one or more of the following, as shown in Figure 2: the security status reception unit 32, the image acquisition unit 33, the object detection unit 34, the alarm generation unit 35, the determination unit 36, the output unit 37, and the viewing notification unit 38. Note that some or all of the parts of the control unit 31 may be provided in the cloud 6, and the cloud 6 can also be configured to function as the security device 30.

[0024] The security status receiving unit 32 receives the setting of the security status of the security area S from the user terminal 60. The security status receiving unit 32 receives a security start or security deactivation signal from the user terminal 60. At this time, the security status receiving unit 32 performs user authentication based on the terminal ID or user ID included in the signal. This prevents unauthorized user terminals 60 from setting the security status. The security status is, but is not limited to, security start (security set) and security deactivation. When the security status receiving unit 32 receives a signal for setting security start, it sets security start for the security area S by turning on the mode flag (security mode), etc. When the security status receiving unit 32 receives a signal for setting security deactivation, it sets security deactivation for the security area S by turning off the mode flag (security deactivation mode), etc. As a modified example, the security status receiving unit 32 may set security start and security deactivation for each security area S based on a schedule pre-set in the storage unit 42.

[0025] The image acquisition unit 33 acquires video from the imaging device 10 via the communication line 4. The video input from the imaging device 10 is live video captured at the current time. The live video acquired by the image acquisition unit 33 is written to the video storage area 43 of the storage unit 42 by the output unit 37 and stored, as described later. The video stored in the video storage area 43 is video captured at a time earlier than the current time, and is hereinafter referred to as past video. Past video is referenced by the controller C, etc., as needed.

[0026] The object detection unit 34 performs object detection by analyzing video footage captured from the security area S, which is set to be activated for security purposes. The object detection unit 34 also functions as a detection sensor that detects events occurring in the security area S based on the detection of objects such as intruders. When the security status of a predetermined security area S is set to activated, that is, when the mode is set to security mode, the object detection unit 34 performs object detection in that security area S. When the security status of a predetermined security area S is set to deactivated, that is, when the mode is set to deactivated mode, the object detection unit 34 terminates object detection in that security area S.

[0027] The image analysis method is not particularly limited, and for example, object detection algorithms such as pattern matching, background subtraction, and interframe subtraction can be used. The object detection unit 34 can also perform more detailed object detection, including specific movements of people, by using artificial intelligence (AI) technologies such as machine learning, reinforcement learning, and deep learning using neural networks with multiple hidden layers.

[0028] The object detection unit 34 performs object detection of objects O moving within the security area S, such as a person or animal entering facility 1, but is not limited to this configuration. For example, the object detection unit 34 may perform object detection of specific actions by a person, such as breaking locks or windows, or taking money or valuables. When the object detection unit 34 detects an object O, it superimposes a red detection frame image (see detection frame image 72a in Figure 4) surrounding the detected object O onto the image. The object detection unit 34 may also detect that an object O, such as a safe in the security area S, has been taken away, resulting in the object O no longer being detected. In this case, the object detection unit 34 may superimpose a non-detection frame image indicating the location where the object O was located onto the image. The image superimposed on the image is not limited to a red detection frame image, but may be an image of another shape or color, and these images may be displayed as flashing images. The detected object O may also be colored or flashing.

[0029] Only one object detection unit 34 is provided in the control unit 31 and performs object detection in all security areas S, but the system is not limited to this configuration. As a modified example, multiple object detection units 34 may be provided to correspond to multiple security areas S, and each object detection unit 34 may perform object detection in its corresponding security area S.

[0030] The alarm generation unit 35, based on whether the object detection unit 34 detects an object or not, and receiving a detection signal from the detection sensor 20, determines that an event requiring an alarm has occurred and issues an alarm to a predetermined recipient. The alarm generation unit 35 generates event information corresponding to the occurred event and outputs it to the recipient to issue the alarm. There may be one or more recipients. The alarm generation unit 35 may issue an alarm to the same recipient for all security areas S, or it may issue alarms to different recipients or the same recipient depending on the security area S.

[0031] In this embodiment, the notification destination is the security terminal 50. The alarm unit 35 outputs event information from all security areas S to the security terminal 50 installed in the control center 2 and the security terminal 50 carried by the security guards G, thereby issuing an alarm. The alarm unit 35 may also use the user terminal 60 as a notification destination, or it may select a notification destination depending on the event content.

[0032] Event information includes the date and time of occurrence, facility information, security area information, and event details (event name). The date and time of occurrence is set to the date and time the event occurred. Facility information is set to the facility ID, facility address, etc. Security area information is set to the security area ID, floor number, store number, etc. Event details are set to include object detection or non-detection, fire detection sensor activation, gas detection sensor activation, intruder intrusion, emergency bell activation, earthquake detection sensor activation, etc.

[0033] If an event is either an object detection or an object non-detection, the event content may include the type of object O, identification information, action information, etc. Examples of object O types include people such as intruders, animals such as vermin, and items such as safes. Examples of identification information include gender, age, height, size, etc. Examples of action information include actions such as breaking locks or windows, or taking items.

[0034] The alarm generation unit 35 writes and stores event information in the event information storage area 44. Figure 3(a) shows the table configuration of the event information storage area 44. The event information storage area 44 has storage areas for occurrence date and time, facility information, security area information, event details, etc.

[0035] When the determination unit 36 ​​receives an input request for video display from the security terminal 50, that is, when it receives a video request signal, it determines whether to permit the request for video display. At this time, the determination unit 36 ​​may perform authentication based on the terminal ID and password included in the video request signal. This suppresses the output of video to security terminals 50 that do not have viewing privileges. The video request signal includes a terminal ID or security guard ID, a password, and may also include a camera ID, security area ID, reason for video request, etc. The terminal ID is a predetermined identifier for security terminal 50 and user terminal 60. The security guard ID is a predetermined identifier for user U, controller C, and security guard G. The camera ID is a predetermined identifier for imaging device 10. The security area ID is a predetermined identifier for security area S. The reason for video request is specifically the content of the event that occurred (event name), such as "object detection," "○○ detection sensor alarm," "suspicious person detection," "image patrol," etc. Image patrol refers to the process in which video footage captured by multiple imaging devices 10 within facility 1 is sequentially displayed on a security terminal 50 at predetermined intervals, allowing control officer C or security guard G to visually monitor the security area S.

[0036] The determination unit 36 ​​can, in principle, permit the request regardless of the security status or whether an event has occurred. Even with this configuration, the user terminal 60 is notified that the security device 30 has requested the display of the video and the reason for viewing it. As a result, user U can recognize that the video has been viewed and, by seeing the reason for viewing it, can determine whether the video was viewed for a legitimate reason or without a legitimate reason.

[0037] Furthermore, in order to make a more precise and detailed determination of whether to grant the request, the determination unit 36 ​​may determine whether to grant the request to display the video based on the security status and the event that occurred. When the determination unit 36 ​​receives a video request signal, it searches the event information storage area 44 to determine whether an alarm was triggered in the security area S where the imaging device 10 corresponding to the camera ID is installed, prior to a predetermined time from the time the video request signal was received. The predetermined time can be, for example, a few seconds or a few minutes. When the determination unit 36 ​​determines that an event such as "○○ detection sensor alarm" or "suspicious person detected" has occurred, that is, when it determines that an alarm has been triggered by the detection sensor 20, it grants the request in order to respond quickly to emergencies such as fires, regardless of whether the security status is security activated or deactivated. When an event such as "object detection" occurs, that is, when an alarm has been triggered by the object detection unit 34 detecting or not detecting an object, the determination unit 36 ​​grants the request if the security status is security activated. Note that when security is deactivated, object detection is not performed, so no object detection event occurs. In contrast, a mode can be set to perform object detection even when the security system is deactivated. In this case, even if an event such as object detection occurs while the security system is deactivated, the request may not be permitted in order to avoid unintentionally infringing on the privacy of user U. If the video request signal is configured to include a reason for the video request, the determination unit 36 ​​may make a determination based on the reason for the video request instead of the event information in the event information storage area 44.

[0038] When the determination unit 36 ​​determines that no event has occurred and no alarm has been issued, it then determines whether the current time is the time for image patrol. Based on a schedule pre-stored in the memory unit 42, the determination unit 36 ​​determines whether the current time is the time for image patrol of the security area S. If the determination unit 36 ​​determines that it is the time for image patrol, it permits the request. Conversely, if the determination unit 36 ​​determines that it is not the time for image patrol, it does not permit the request. Note that if the video request signal is configured to include a reason for the video request, this determination may also be made when "image patrol" is set as the reason for the video request.

[0039] The output unit 37 writes the live video, which is the video acquired by the image acquisition unit 33 from the imaging device 10, to the video storage area 43. When the object detection unit 34 detects an object O, the output unit 37 writes the live video with the detection frame image superimposed to the video storage area 43. Alternatively, the output unit 37 may write only the live video, associated with the event information, to the video storage area 43 without superimposing the detection frame image.

[0040] The output unit 37 outputs live video to the security terminal 50 when the determination unit 36 ​​permits the request to display the video. When the object detection unit 34 detects object O, the output unit 37 outputs video with the object detection frame superimposed to the security terminal 50. This video is displayed on the security-side display unit 52 of the security terminal 50 and viewed by controller C or security guard G. On the other hand, if the determination unit 36 ​​does not permit the request to display the video, the output unit 37 may output a denial notice to the security terminal 50 indicating that the request is not permitted.

[0041] The viewing notification unit 38 generates viewing information indicating that the video has been displayed, based on the output of video to the security terminal 50, and outputs a video display signal containing the generated viewing information to the user terminal 60. The viewing information is displayed via push notification on the user-side display unit 62 of the user terminal 60, as described later (see Figure 5). Push notification is a function that automatically displays new information on the display unit as a pop-up or the like to notify the user.

[0042] The viewing information includes the viewing date and time, security area ID, camera ID, and reason for viewing. The viewing information does not need to include all of these items; it is sufficient to include at least information indicating that the video was displayed, and appropriate items can be selected and included. The viewing date and time is the date and time when the video was displayed on the security terminal 50, and may be set to the date and time when the request for display of the video was made, or to the date and time when the video was output to the security terminal 50. The security area ID, camera ID, and reason for viewing are set based on the security area, event name, etc. of the event information in the event information storage area 44, but may also be obtained from the video request signal. The viewing information may also include the terminal ID, etc. of the security terminal 50 that requested the display of the video, so that it is possible to identify which security terminal 50 viewed the video, that is, who viewed the video.

[0043] The viewing notification unit 38 writes and stores the viewing information in the viewing information storage area 45. Figure 3(b) shows the data structure of the viewing information storage area 45. The viewing information storage area 45 has storage areas for viewing date and time, security area ID, camera ID, terminal ID, and viewing reason.

[0044] When the browsing notification unit 38 receives a request from the user terminal 60 to display browsing information, i.e., when it receives a browsing information request signal, it outputs the browsing information stored in the browsing information storage area 45 to the user terminal 60. At this time, the browsing notification unit 38 may perform authentication based on the terminal ID or user ID included in the browsing information request signal. The browsing notification unit 38 retrieves browsing information for a predetermined period, for example, browsing information for today, from the browsing information storage area 45 and outputs it to the user terminal 60. On the user terminal 60, a list of browsing information is displayed on the user-side display unit 62 as described later (see Figure 6).

[0045] The display unit 40 consists of a liquid crystal display, an organic EL display, a plasma display, etc. The display unit 40 displays various screens under the control of the control unit 31. The operation unit 41 consists of a touch panel, operation buttons, a power switch, etc., and receives operation instructions from users U, etc., in facility 1 and outputs them to the control unit 31.

[0046] The storage unit 42 consists of semiconductor memory such as ROM and RAM, and storage media such as memory cards. The storage unit 42 may also include a cloud database provided on a cloud server. The storage unit 42 temporarily or permanently stores various programs, parameters, etc., used for various operations in the security device 30. The storage unit 42 also stores authentication information used for authentication, security schedules such as image patrols, etc.

[0047] The memory unit 42 has a video storage area 43, an event information storage area 44, and a viewing information storage area 45. The video storage area 43 stores video input from the imaging device 10, organized by the date and time of acquisition. The event information storage area 44 stores event information related to events that occurred in the security area S, in chronological order of occurrence date and time. The viewing information storage area 45 stores viewing information related to when a video was viewed, in chronological order of viewing date and time. The video storage area 43, event information storage area 44, and viewing information storage area 45 store the latest data by overwriting data that has exceeded a predetermined storage period with new data.

[0048] The security terminal 50 notifies controller C or security guard G based on an alert received from the security device 30. The security terminal 50 requests the security device 30 to display video, and displays the video when the request is approved. The security terminal 50 installed in the control center 2 consists of a personal computer (PC) equipped with a processor such as a CPU, semiconductor memory such as ROM and RAM, storage media such as a memory card, and peripheral equipment such as a display, keyboard, mouse, microphone, speaker, camera, A / D converter, communication equipment, and printer. The personal computer may be replaced with a server PC or a general-purpose server computer (mainframe), etc.

[0049] The security terminal 50 owned by security guard G consists of portable devices such as smartphones and tablet devices, from the standpoint of portability and ease of operation, but may also consist of a notebook or desktop PC, a dedicated terminal, etc.

[0050] As shown in Figure 2, the security terminal 50 mainly comprises a security control unit 51, a security display unit 52, a security operation unit 53, and a security storage unit 54. The security control unit 51 is composed of a processor. The security control unit 51 controls the operation of the entire security terminal 50 by activating a pre-installed security program.

[0051] The security-side display unit 52 is composed of a liquid crystal display, an organic EL display, a plasma display, etc. The security-side display unit 52 displays various screens under the control of the security-side control unit 51. The security-side operation unit 53 is composed of a keyboard, mouse, touch panel, etc. The security-side operation unit 53 receives operation input from the controller C or security guard G and outputs an operation signal to the security-side control unit 51.

[0052] The security-side memory unit 54 is composed of a storage medium on a PC or mobile terminal. The security-side memory unit 54 temporarily or permanently stores programs, parameters, etc., used for various operations of the security terminal 50. The security-side memory unit 54 may also store video, event information, etc., input from the security device 30.

[0053] The security control unit 51 displays the alarm screen 70 on the security display unit 52 based on the alarm input from the security device 30. Figure 4(a) shows an example of the alarm screen 70 displayed on the security display unit 52. Note that the screens shown in Figures 4(a) to (c) are screens displayed on the security display unit 52 of the security terminal 50 installed in the control center 2, but the security display unit 52 of the security terminal 50 carried by the security guard G displays a screen with the same content but created for a portable terminal.

[0054] The alarm screen 70 displays a message confirming the event details and the video display request, as well as buttons for operation. When controller C or security guard G (hereinafter sometimes referred to as "controller C, etc.") operates the "Yes" button on the alarm screen 70, the security control unit 51 generates a video request signal including the terminal ID or security guard ID and outputs it to the security device 30. The video request signal may also include the camera ID, security area ID, reason for video request, etc. The terminal ID is set to the terminal ID of the security terminal 50. The security guard ID is set to the identifier of controller C, etc. who is logged into the security terminal 50. The camera ID, security area ID, and reason for video request (event details) are set based on the security area ID and event details of the event information. When controller C, etc. operates the "No" button on the alarm screen 70, the security control unit 51 does not generate a video request signal, etc., and displays a menu screen (not shown) or the like on the security display unit 52.

[0055] The security control unit 51 may also notify the controller C, etc., by displaying the alarm screen 70, or by outputting a buzzer sound or a warning message sound from a speaker instead of displaying the screen. This allows the controller C, etc., to become aware of the event more quickly. When a warning sound is output instead of displaying the alarm screen 70, the controller C, etc., can select the imaging device 10, etc., from a menu screen, etc., to request the display of video.

[0056] When a controller C or the like selects "Image Patrol" from the menu screen, the security control unit 51 displays the image patrol screen 71 on the security display unit 52. Figure 4(b) shows an example of the image patrol screen 71 displayed on the security display unit 52. The image patrol screen 71 displays a list of facility names. When a controller C or the like selects a facility name to patrol on the image patrol screen 71, the security control unit 51 generates a video request signal including the terminal ID or security guard ID, camera ID, security area ID, reason for video request, etc., and outputs it to the security device 30.

[0057] The terminal ID is set to the terminal ID of security terminal 50. The camera ID and security area ID are set to the camera ID and security area ID of the imaging device 10 installed in all security areas S of the selected facility 1. The video request signal may be set to the reason for the video request, "image patrol". When controller C or the like operates the "back" button on the image patrol screen 71, the security control unit 51 does not generate a video request signal, etc., but displays a menu screen, etc., on the security display unit 52.

[0058] When the security device 30 authorizes a request to display video and video is input from the security device 30, the security control unit 51 displays the video on the security display unit 52. Figure 4(c) shows an example of the video display screen 72 displayed on the security display unit 52. The video display screen 72 displays the facility name, camera name, live video, etc. If the event is the detection or non-detection of an object such as an intruder, the video displays a red detection frame image 72a or a non-detection frame image surrounding the object O. This allows the controller C, etc., to more clearly recognize that object O has been detected or that object O has been unintentionally taken away. If the event is the activation of a fire detection sensor or a gas detection sensor, etc., the controller C, etc., can recognize the state of smoke, flames, etc. by looking at the video display screen 72. If the event involves an intruder detected by the card key device 24, then the control officer C, etc., can recognize that an insider (suspicious person) has entered the security area S by viewing the video display screen 72.

[0059] The user terminal 60 allows user U to set the security device 30 to start or deactivate security. The user terminal 60 receives a video display signal indicating that the security terminal 50 has displayed video. The user terminal 60 is composed of a mobile device such as a smartphone or tablet, from the viewpoint of portability and operability, but may also be composed of a notebook or desktop PC or a dedicated terminal.

[0060] User U could be, for example, the owner of Facility 1, the security manager for the entire facility, or the head or security manager of each store. However, User U is not limited to these individuals; it can be anyone with the authority to set security activation and deactivation, and could also be an employee of Facility 1 or each store.

[0061] The user terminal 60 mainly comprises a user-side control unit 61, a user-side display unit 62, a user-side operation unit 63, and a user-side storage unit 64. The user terminal 60 also includes components commonly found in mobile terminals, such as a speaker, microphone, and communication interface.

[0062] The user-side control unit 61 consists of a processor such as a CPU. The user-side display unit 62 controls the operation of the entire user terminal 60 by activating a pre-installed security program.

[0063] The user-side display unit 62 is composed of a liquid crystal display, an organic EL display, a plasma display, etc. The user-side display unit 62 displays various screens under the control of the user-side control unit 61. The user-side operation unit 63 is composed of a touch panel, etc., provided on the surface of the user-side display unit 62. The user-side operation unit 63 receives operation input from the user U and outputs an operation signal to the user-side control unit 61.

[0064] The user-side storage unit 64 is composed of a storage medium provided by the mobile terminal. The user-side storage unit 64 temporarily or permanently stores programs, parameters, etc., used for various operations of the user terminal 60.

[0065] The user-side control unit 61 receives a video display signal from the security device 30 and displays the viewing information included in the video display signal on the user-side display unit 62 via push notification. Figure 5 shows an example of a push notification displayed on the user-side display unit 62. Figure 5(a) is an example of a push notification when video is displayed due to a fire detection sensor alarm, and Figure 5(b) is an example of a push notification when video is displayed due to an image patrol. The user-side display unit 62 displays a viewing information message 80, including the viewing date and time, the name of the security area S, the name of the imaging device 10 that viewed the video, and the reason for viewing.

[0066] When a user U requests the display of browsing information from a menu screen (not shown), the user-side control unit 61 generates a browsing information request signal and outputs it to the security device 30. The user-side control unit 61 displays a list of browsing information input from the security device 30 on the user-side display unit 62. Figure 6 shows an example of the browsing information list 81 displayed on the user-side display unit 62. The browsing information list 81 displays browsing information in order, including the date and time of viewing, the name of the security area S, the name of the imaging device 10 that viewed the video, and the reason for viewing.

[0067] An example of the daily security operations in the security system 100 is described below with reference to the flowcharts shown in Figures 7 to 9, but is not limited to the operations described below. The flowcharts in Figures 7 to 9 show an example of the operation of the security device 30. In the following, it is assumed that the imaging device 10, detection sensor 20, security device 30, security terminal 50, and user terminal 60 of the security system 100 are activated and able to communicate with each other.

[0068] Steps S1 and S2, S3, S4 and S5, and S6 and S7, as shown in Figure 7, are each executed independently and repeatedly.

[0069] Steps S1 and S2 will now be explained. In step S1, the security status receiving unit 32 determines whether there is an input signal for setting security to start or to deactivate security. If the security status receiving unit 32 determines that there is an input signal (YES), the control unit 31 proceeds to step S2. On the other hand, if the security status receiving unit 32 determines that there is no input signal (NO), the control unit 31 skips step S2 and repeats the process from step S1 at a predetermined timing.

[0070] The details of the security status setting process in step S2 will be explained using the flowchart shown in Figure 8. As shown in Figure 8, in step S201, the security status receiving unit 32 performs authentication based on the terminal ID or user ID included in the signal. In step S202, the control unit 31 determines whether the authentication was successful. If it determines that the authentication was successful (YES), the control unit 31 proceeds to step S203. On the other hand, if it determines that the authentication failed (NO), the control unit 31 skips step S203 and proceeds to the end, terminating step S2.

[0071] In step S203, the security status reception unit 32 sets security to start or deactivate for security area S for which a signal for setting security to start or deactivate has been input. After that, the control unit 31 ends the process in step S2 by advancing the process to the end. The control unit 31 repeats the process from step S1 at a predetermined timing.

[0072] Returning to Figure 7, step S3 will be explained. The object detection process in step S3 is repeatedly performed at predetermined timings for security areas S where the security state is set to security start, for example, when one frame of video is input from the imaging device 10. The object detection process in step S3 will be explained using the flowchart shown in Figure 8.

[0073] In step S301, the image acquisition unit 33 acquires one frame of video from the imaging device 10. In step S302, the object detection unit 34 performs image recognition of the video of the security area S where security has been set to start, and performs object detection. In the next step S303, the control unit 31 determines whether the object detection unit 34 has detected object O. If the object detection unit 34 determines that it has detected object O (YES), the control unit 31 proceeds to step S304. On the other hand, if the object detection unit 34 determines that it has not detected object O (NO), the control unit 31 skips steps 304 to S306 and proceeds to step S307.

[0074] In step S304, the object detection unit 34 superimposes a red detection frame image surrounding the detected object O onto the video. In the next step S305, the alarm generation unit 35 generates event information based on the object detection and outputs it to the security terminal 50, which is the notification destination, to issue an alarm. In step S306, the alarm generation unit 35 writes the event information to the event information storage area 44 for storage.

[0075] In step S307, the output unit 37 writes the video to the video storage area 43 for storage. Then, the control unit 31 proceeds to the end of the process, thereby ending the process in step S3. The control unit 31 repeats the process in step S3 at a predetermined timing.

[0076] Returning to Figure 7, steps S4 and S5 will be explained. In step S4, the alarm unit 35 determines whether there is a detection signal input from the detection sensor 20. If the alarm unit 35 determines that there is a signal input (YES), the control unit 31 proceeds to step S5. On the other hand, if the alarm unit 35 determines that there is no signal input (NO), the control unit 31 skips step S5 and repeats the process from step S4 at a predetermined timing.

[0077] The details of the abnormality notification process in step S5 will be explained using the flowchart shown in Figure 8. As shown in Figure 8, in step S501, the alarm unit 35 generates event information based on the detection signal from the detection sensor 20 and outputs it to the security terminal 50, which is the notification destination, to issue an alarm. In step S502, the alarm unit 35 writes the event information to the event information storage area 44 for storage. After that, the control unit 31 proceeds to the end of the process, thereby ending the process in step S5. The control unit 31 repeats the process from step S4 at predetermined timings.

[0078] Upon receiving an alert input, the security terminal 50 notifies the controller C, etc., by displaying the alert screen 70 shown in Figure 4(a) on the security-side display unit 52. This allows the controller C, etc., to recognize that some kind of event has occurred in the security area S. When the controller C, etc., operates the "Yes" button on the alert screen 70, the security-side control unit 51 generates a video request signal and outputs it to the security device 30. The video request signal is also output when the controller C, etc., selects the name of the facility to be patrolled on the image patrol screen 71.

[0079] Returning to Figure 7, steps S6 and S7 will be explained. These steps are performed when a video request signal is received from the security terminal 50. In step S6, the control unit 31 determines whether a video request signal has been received. If it determines that a video request signal has been received (YES), the control unit 31 proceeds to step S7. On the other hand, if it determines that there is no video request signal (NO), the control unit 31 skips step S7 and repeats the process from step S6 at a predetermined timing.

[0080] The video output and viewing notification process in step S7 is explained using the flowchart shown in Figure 9. In step S701, the determination unit 36 ​​performs authentication based on the terminal ID or security guard ID included in the video request signal. In step S702, the control unit 31 determines whether the authentication was successful. If it determines that the authentication was successful (YES), the control unit 31 proceeds to step S703. On the other hand, if it determines that the authentication failed (NO), the control unit 31 skips steps S704 to S708 and proceeds to the end of the process.

[0081] In step S703, the determination unit 36 ​​determines whether to permit the request to display the video. The determination unit 36 ​​may make the determination based on whether authentication was successful, as described above, or based on the event that occurred and the security status. In step S704, if the determination unit 36 ​​determines to permit the request (YES), the control unit 31 proceeds to step S705.

[0082] On the other hand, if the determination unit 36 ​​determines that the request is not permitted (NO), the control unit 31 proceeds to step S706. In step S706, the output unit 37 outputs a disapproval notice to the security terminal 50. After that, the control unit 31 proceeds to the end of the process.

[0083] When the request to display the video is approved, in step S705, the output unit 37 outputs the live video to the security terminal 50. When the object detection unit 34 detects object O, the output unit 37 outputs the video with the object detection frame superimposed to the security terminal 50.

[0084] Upon receiving video input from the output unit 37, the security terminal 50 displays the video on the video display screen 72 of the security display unit 52 shown in Figure 4(c) via the security control unit 51. By viewing the video display screen 72, the controller C can appropriately confirm the status of the security area S. Therefore, the controller C can respond more appropriately and quickly to events such as object detection, fire outbreak, and intruder intrusion. The security control unit 51 may also store the acquired video in the security storage unit 54 in association with the event. The controller C can also play back the video to confirm the event.

[0085] In step S707, the viewing notification unit 38 generates viewing information indicating that the video has been displayed and outputs it to the user terminal 60. Upon receiving the viewing information, the user terminal 60 pushes the viewing information to the user-side display unit 62, as shown in Figure 5(a) or (b). By confirming this push notification, user U can recognize that the video has been viewed by the controller C, etc., the imaging device 10 that captured the video, the security area S, the reason for viewing, etc. User U can request the display of the viewing information from the user terminal 60 as needed.

[0086] In step S708, the viewing notification unit 38 writes the viewing information to the viewing information storage area 45 for storage. After that, the control unit 31 advances the process to the end. When the process reaches the end, the control unit 31 terminates step S7 and repeats the process from step S6 at a predetermined timing.

[0087] Returning to Figure 7, steps S8 and S9 will be explained. These steps are performed when a browsing information request signal is input from the user terminal 60. In step S8, the control unit 31 determines whether a browsing information request signal has been input. If it determines that a video request signal has been input (YES), the control unit 31 proceeds to step S9. On the other hand, if it determines that there is no browsing information request signal input (NO), the control unit 31 skips step S9 and repeats the process from step S8 at a predetermined timing.

[0088] The details of the browsing information output process in step S9 will be explained using the flowchart shown in Figure 9. In step S901, the browsing notification unit 38 performs authentication based on the terminal ID or user ID included in the browsing information request signal. In step S902, the control unit 31 determines whether the authentication was successful. If it determines that the authentication was successful (YES), the control unit 31 proceeds to step S903. On the other hand, if it determines that the authentication failed (NO), the control unit 31 skips step S903 and proceeds to the end.

[0089] In step S903, the viewing notification unit 38 outputs viewing information to the user terminal 60. After that, the control unit 31 advances the process to the end. When the process reaches the end, the control unit 31 terminates step S9 and repeats the process from step S8 at a predetermined timing.

[0090] Upon receiving the browsing information, the user terminal 60's user-side control unit 61 displays the browsing information list 81 shown in Figure 5(c) on the user-side display unit 62. This allows user U to recognize when, which imaging device 10's video was viewed, and for what reason.

[0091] As described above, the security system 100 of this embodiment includes an imaging device 10 that captures images of a predetermined security area S, a security device 30 that acquires images from the imaging device 10, a security terminal 50 that requests the security device 30 to display images and displays the images when the request is permitted, and a user terminal 60 that receives an image display signal indicating that the security terminal 50 has displayed the images. When the security device 30 permits the security terminal to display the images, it transmits the images to the security terminal 50 and also transmits an image display signal to the user terminal 60. The security device 30 of this embodiment also includes an image acquisition unit 33 that acquires images of the predetermined security area S, a determination unit 36 ​​that determines whether to permit the request when it receives input from the security terminal 50 to display the images, an output unit 37 that transmits the images to the security terminal 50 when it is determined that the request is permitted, and a viewing notification unit 38 that transmits an image display signal to the user terminal indicating that the security terminal 50 has displayed the images.

[0092] The security method performed by the control unit 31 of the security device 30 in this embodiment includes an image acquisition step of acquiring video footage of a predetermined security area S, a determination step of determining whether to permit a request for video display when an input request for video display is received from the security terminal 50, an output step of transmitting the video to the security terminal 50 if it is determined that the request is permitted, and a notification step of transmitting a video display signal to the user terminal indicating that the security terminal 50 has displayed the video. The program performed in this embodiment is a program performed by a computer (security device 30), and is a program that causes this computer to perform each step of the security method described above.

[0093] Therefore, according to the security device 30, security system 100, security method, and program of this embodiment, user U can recognize that the security terminal 50 is displaying video. As a result, while security is in operation, user U can feel reassured that the security area S is being properly guarded by the controller C, etc., and the controller C, etc. can assure user U that security is being properly maintained. Furthermore, while security is deactivated, the controller C, etc. is discouraged from unnecessarily viewing the video, thereby preventing user U's privacy from being unintentionally violated. Therefore, the security device 30, etc., can allow video confirmation at the control center 2, etc., as needed, even when security is deactivated, while taking user U's privacy into consideration.

[0094] In this embodiment, the security terminal 50 requests the security device 30 to display video when the security system is deactivated, and displays the video when the request is granted. Therefore, when an emergency event such as a fire occurs, the security device 30 grants permission for the video display request, and the video is displayed on the security terminal 50. Consequently, the controller C, etc., who sees the video can respond quickly to the event. The security terminal 50 may also be configured to request the security device 30 to display video while the security system is active, and displays the video when the request is granted. This suppresses the display of unnecessary video even while the security system is active, and the privacy of user U is better protected.

[0095] The security system 100 of this embodiment includes a detection sensor 20 that detects events occurring in the security area S. When the security system is deactivated, the security terminal 50 requests the security device 30 to display video when the detection sensor 20 detects an event, and displays the video when the request is granted. Therefore, when an event occurs, video is displayed on the security terminal 50, enabling the controller C and others to respond quickly to events such as intruders and fires.

[0096] Furthermore, the video displayed on the security terminal 50 in this embodiment is live video. Therefore, controller C and others can grasp the real-time situation of the security area S. The video may also be past video that was captured in the past and stored in the video storage area 43, etc. If the security device 30 allows the display of past video to be shown on the security terminal 50 when the request for display of the video is authorized, and the user U can recognize that the security terminal 50 has displayed the video, then the unintentional display of past video can be suppressed.

[0097] While embodiments and modifications of the present disclosure have been described in detail above with reference to the drawings, the specific configuration is not limited to these embodiments, and any design changes that do not depart from the gist of the present disclosure are included in this disclosure. [Explanation of Symbols]

[0098] 10: Imaging device 20: Detection sensor 30: Security device 31: Control unit 33: Image acquisition unit 36: Judgment unit 37: Output unit 38: Viewing notification unit 50: Security terminal 60: User terminal 100: Security system S: Security area U: User

Claims

1. An imaging device that captures images of a designated security area, A security device that acquires the video from the aforementioned imaging device, A security terminal that requests the security device to display the video, and displays the video when the request is approved, The system includes a user terminal that receives a video display signal indicating that the security terminal has displayed the video, When the security device authorizes the security terminal to request the display of the video, it transmits the video to the security terminal and also transmits the video display signal to the user terminal. A security system characterized by the following features.

2. The security terminal, upon deactivating the security system, requests the security device to display the video, and if the request is granted, displays the video. The security system according to claim 1, characterized by the features described above.

3. The security area is equipped with a detection sensor that detects events occurring within that area. When the security system is deactivated, the security terminal requests the security device to display the video when the detection sensor detects the event, and displays the video when the request is granted. The security system according to claim 1, characterized by the features described above.

4. The aforementioned video is live footage. The security system according to claim 1, characterized by the features described above.

5. An image acquisition unit that acquires video footage of a designated security area, Upon receiving input from the security terminal requesting the display of the aforementioned video, a determination unit determines whether to permit the request, If it is determined that the request is permitted, the output unit transmits the video to the security terminal, The system includes a viewing notification unit that transmits a video display signal to a user terminal indicating that the security terminal has displayed the video. A security device characterized by the following features.

6. A security method performed by the control unit of the security device described in claim 5, An image acquisition process to acquire video footage of a designated security area, Upon receiving input from the security terminal requesting the display of the aforementioned video, a determination step is performed to determine whether to permit the request. If it is determined that the request is permitted, the output process involves transmitting the video to the security terminal, The process includes a viewing notification step of sending a video display signal to a user terminal indicating that the security terminal has displayed the video, A security method characterized by the following features.

7. A program executed by a computer, A program that causes this computer to execute each step of the security method described in claim 6.

Images