Alarm system, alarm output method, and alarm output program

Abstract

To provide an alarm system having a relatively simple configuration compared to conventional alarm systems. [Solution] The alarm system 1 comprises an alarm device 2a configured to output an alarm, and cameras 3a-1 to 3a-5 configured to capture video showing the state of store A. The alarm system 1 detects an intruder J based on the video captured by the cameras 3a-1 to 3a-5, identifies the alarm device 2a associated with the camera, and activates the alarm device 2a.

Description

[Technical Field]

[0001] The present disclosure relates to an alarm system, an alarm output method, and an alarm output program. [Background technology]

[0002] Patent Document 1 discloses an alarm system that notifies users of information about abnormalities in monitored areas of commercial facilities, etc., to deal with the abnormalities. The alarm system includes multiple security sensors installed throughout the building, a security device that receives detection signals from the multiple security sensors, a remote center device that receives signals from the security device, and a mobile terminal that receives information from the remote center device. The security sensors include sensors that detect when windows or doors are opened and sensors that detect moving objects in the room. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-142649 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the alarm system disclosed in Patent Document 1 tends to be expensive to install and maintain. Therefore, for relatively small businesses and businesses operating multiple stores, the installation and maintenance costs of such alarm systems are a significant burden on their management. Furthermore, survey data reveals that most alarms issued by alarm systems are false alarms, with only a very small number of alarms being issued based on actual trespassing within the facility. Thus, the cost-effectiveness of expensive alarm systems is likely to become a management issue, and this tendency is more pronounced in countries with higher public safety. From this perspective, there is room for consideration of new alarm systems that can replace conventional alarm systems, which have high installation and maintenance costs. In particular, many businesses have high hopes for alarm systems that offer a new alternative to conventional alarm systems.

[0005] In view of the above, an object of the present disclosure is to provide an alarm system having a relatively simple configuration compared to conventional alarm systems, an alarm output method to be executed by the alarm system, and an alarm output program for causing the alarm system to execute the alarm output method. [Means for solving the problem]

[0006] An alarm system according to one aspect of the present disclosure is an alarm system that outputs an alarm using a camera and an alarm device, detects an intruder based on video captured by the camera, identifies the alarm device associated with the camera, and activates the alarm device.

[0007] According to the above configuration, an intruder is detected based on the video captured by the camera, and an alarm is output by activating the alarm device. In this way, an alarm system with a relatively simple configuration compared to conventional alarm systems can be provided. Furthermore, an alarm system with reduced installation and maintenance costs compared to conventional alarm systems can be provided.

[0008] The alarm system may also identify a user associated with the alarm device and notify the user of information indicating that the alarm device is activated.

[0009] According to the above configuration, the user is notified of information indicating that the alarm device is activated, and thus the user who manages the facility can immediately understand that the alarm device is activated (i.e., that something unusual has occurred within the facility).

[0010] Furthermore, when the alarm system detects the intruder at a first time and then again at a second time, it determines whether the time interval between the first time and the second time is equal to or greater than a predetermined value, and if it determines that the time interval is equal to or greater than the predetermined value, it may again notify the user of information indicating that the alarm device is activated, and if it determines that the time interval is not equal to or greater than the predetermined value, it may not need to again notify the user of information indicating that the alarm device is activated.

[0011] According to the above configuration, the usability of the alarm system can be improved by preferably preventing the user from being frequently notified that the alarm device is activated each time an intruder is detected again.

[0012] In addition, the alarm system may set the operation mode of the alarm device to an alert mode or an alert disarm mode in response to a user's instruction, and if the operation mode is the alert mode, activate the alarm device when an intruder is detected, but may not activate the alarm device when the operation mode is the alert disarm mode.

[0013] According to the above configuration, the alarm device is activated when the operation mode of the alarm device is in the alert mode, but is not activated when the operation mode is in the alert disarm mode. In this way, for example, when the operation mode of the alarm device is set to the alert disarm mode during the business hours of a commercial facility, it is possible to effectively prevent the alarm device from being accidentally activated during the business hours of the commercial facility.

[0014] The alarm system may also stop operation of the alarm device in response to an input operation by a user via a user terminal.

[0015] According to the above configuration, it is possible to stop the operation of the alarm device in response to an input operation by the user via the user terminal, thereby improving the usability of the alarm system.

[0016] The alarm system may also display an image of the intruder detected on a user terminal.

[0017] According to the above configuration, a user can remotely grasp the state of an intruder who has entered the facility by viewing the video displayed on the user terminal.

[0018] The alarm system may also set an area for detecting the intruder based on the video in response to an input operation by a user via a user terminal.

[0019] According to the above configuration, an area for detecting an intruder can be set in response to an input operation by a user via a user terminal. Furthermore, by setting the area, it is possible to customize the activation conditions of the alarm device, thereby improving the usability of the alarm system.

[0020] The alarm system may also store the alarm devices and the cameras in association with each other in a first management table, and identify the alarm device associated with the camera by referring to the first management table.

[0021] According to the above configuration, the alarm device associated with the camera can be identified through the first management table.

[0022] The alarm system may also associate the alarm device with the user group to which the user belongs and store them in a second management table, and by referring to the second management table, identify the user group associated with the alarm device and notify the user associated with the user group of information indicating that the alarm device is in operation.

[0023] According to the above configuration, the user group associated with the alarm device is identified through the second management table, and then it is possible to notify the users associated with that user group of information indicating that the alarm device is in operation.

[0024] The alarm system may also set a first time period during which the process of setting the operation mode to the alert mode is not permitted, and during the first time period, the process of setting the operation mode to the alert mode is not permitted.

[0025] According to the above configuration, the operation mode of the alarm device is preferably prevented from being set to the alert mode during the first time period (e.g., during the business hours of the facility) by a user's input operation, thereby making it possible to preferably prevent the alarm device from being activated during the first time period.

[0026] In addition, the alarm system may set a second time period during which the process of setting the operation mode to the alert disarm mode is not permitted, and may not permit the process of setting the operation mode to the alert disarm mode during the second time period.

[0027] With the above configuration, it is possible to preferably prevent the operation mode of the alarm device from being set to the alarm disarm mode by a user's input operation during the second time period (e.g., outside the business hours of the facility), thereby preferably preventing a situation in which the alarm device does not go off even if an intruder is present within the facility during the second time period.

[0028] An alarm output method according to one aspect of the present disclosure is an alarm output method that outputs an alarm executed by an alarm system using a camera and an alarm device, and includes the steps of detecting an intruder based on video captured by the camera, identifying the alarm device associated with the camera, and activating the alarm device.

[0029] Also, an alarm output program may be provided that causes an alarm system to execute the alarm output method. [Effects of the Invention]

[0030] According to the present disclosure, it is possible to provide an alarm system having a relatively simple configuration compared to conventional alarm systems, an alarm output method executed by the alarm system, and an alarm output program for causing the alarm system to execute the alarm output method. [Brief explanation of the drawings]

[0031] [Figure 1] 1 is a diagram illustrating an alarm system according to an embodiment of the present disclosure (hereinafter referred to as the present embodiment). [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of an alarm device. [Figure 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of a camera. [Figure 4] FIG. 2 illustrates an example of a hardware configuration of a server. [Figure 5] FIG. 2 is a diagram illustrating an example of a hardware configuration of a user terminal. [Figure 6] 4 is a flowchart illustrating a series of processes executed by the alarm system according to the present embodiment. [Figure 7A] FIG. 4 is a diagram illustrating an example of a first management table. [Figure 7B] FIG. 10 is a diagram illustrating an example of a second management table. [Figure 8] FIG. 10 illustrates an example of a group management table. [Figure 9]1A is a diagram showing an example of an operation mode setting screen indicating that the operation mode of the alarm device is the alarm disarm mode, and FIG. 1B is a diagram showing an example of an operation mode setting screen indicating that the operation mode of the alarm device is the alarm mode. [Figure 10] FIG. 10 is a diagram showing an example of a video showing an intruder entering a store and a security area. [Figure 11] FIG. 10 is a diagram illustrating an example of a notification setting table. [Figure 12] FIG. 10 illustrates an example of a user management table. [Figure 13] FIG. 10 is a diagram showing an example of an operation mode setting screen showing that the alarm device is in operation. [Figure 14] FIG. 10 is a diagram showing an example of a video display screen displayed on a user terminal. [Figure 15] 10 is a flowchart illustrating an example of a process for setting the operation mode of the alarm device to an alert mode. [Figure 16] 10 is a flowchart illustrating an example of a process for setting the operation mode of the alarm device to a security release mode. DETAILED DESCRIPTION OF THE INVENTION

[0032] (Configuration of Alarm System 1) An alarm system 1 according to this embodiment will be described below with reference to the drawings. FIG. 1 is a diagram showing the alarm system 1 according to this embodiment. As shown in FIG. 1, the alarm system 1 comprises alarm devices 2a and 2b, cameras 3a-1 to 3b-5, a server 4 (an example of an information processing device), a cloud communication platform 5, and user terminals 6a and 6b. These elements are connected to a communication network 7. The communication network 7 is configured by at least one of a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, and a wireless core network. Note that the elements provided in the alarm system 1 are not limited to these elements, and other elements not shown in FIG. 1 may also be provided in the alarm system 1.

[0033] In this embodiment, alarm device 2a, cameras 3a-1 to 3a-5, and router 8a are installed in store A. Similarly, alarm device 2b, cameras 3b-1 to 3b-5, and router 8b are installed in store B. These elements may be installed not only in commercial facilities such as stores, but also in other facilities (e.g., hospitals, public facilities, factories, etc.). In the following description, cameras 3a-1 to 3a-5 may be simply referred to as camera 3 or camera 3a. Similarly, cameras 3b-1 to 3b-5 may be simply referred to as camera 3 or camera 3b. Furthermore, alarm devices 2a and 2b may be simply referred to as alarm device 2. User terminals 6a and 6b may be simply referred to as user terminal 6, and users Ua and Ub may be simply referred to as user U. Furthermore, the number of alarm devices 2, cameras 3, and user terminals 6 is not particularly limited. In this regard, two or more alarm devices 2 may be installed in each store.

[0034] Each camera 3a is configured to capture video showing the state of store A (especially video showing the bird's-eye view of store A) and is fixedly installed at various locations in store A. The alarm device 2a is fixedly installed at a predetermined location within store A and is configured to output an alarm to intruder J who illegally enters store A in order to scare him / her away. In store A, each camera 3a and alarm device 2a may be connected to a communication network 7 via a router 8a. In this way, each camera 3a and alarm device 2a are communicatively connected to the server 4 via the router 8a and the communication network 7. The user terminal 6a is an information terminal operated by a user Ua who manages store A. The user terminal 6a receives video captured by the camera 3a from the server 4 and can control the operation mode of the alarm device 2a via the server 4. It should be noted that there may be multiple users Ua managing store A. In this case, multiple user terminals 6a are provided in the alarm system 1.

[0035] Similarly, each camera 3b is configured to capture video showing the state of store B (especially video showing the bird's-eye view of store B) and is fixedly installed at various locations in store B. Alarm device 2b is fixedly installed at a predetermined location within store B and configured to output an alarm to an intruder illegally entering store B. In store B, each camera 3b and alarm device 2b may be connected to the communication network 7 via a router 8b. In this way, each camera 3b is communicatively connected to the server 4 via the router 8b and the communication network 7. User terminal 6b is an information terminal operated by user Ub who manages store B. User terminal 6b receives video captured by camera 3b from the server 4 and can control the operation mode of alarm device 2b via the server 4. It should be noted that there may be multiple users Ub who manage store B. In this case, multiple user terminals 6b are provided in the alarm system 1. The routers 8a and 8b may be, for example, wireless LAN routers.

[0036] (Configuration of alarm device 2) Next, the hardware configuration of the alarm device 2 will be described below with reference to Fig. 2. In this embodiment, the alarm devices 2a and 2b have the same configuration. Fig. 2 is a diagram showing an example of the hardware configuration of the alarm device 2. The alarm device 2 comprises a control unit 21, a communication unit 22, an audio output unit 23, a light emitting unit 24, an input operation unit 25, and a power supply circuit (not shown). These elements are connected to a bus 20.

[0037] The control unit 21 includes a memory and a processor. The memory is configured to store computer-readable instructions (programs). For example, the memory may include a read-only memory (ROM) storing various programs and a random access memory (RAM) having multiple work areas for storing various programs executed by the processor. The processor may include at least one of a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), a field programmable gate array (FPGA), and an application-specific integrated circuit (ASIC). The processor may be configured to load a specified program from various programs stored in the ROM onto the RAM and execute various processes in cooperation with the RAM.

[0038] The communication unit 22 is configured to connect the alarm device 2 to the communication network 7. The communication unit 22 includes, for example, a wireless communication module and / or a wired communication module for wireless communication with a wireless base station or a router 8a (wireless LAN router). The wireless communication module includes a transmitting / receiving antenna and a signal processing circuit. The wireless communication module may be a wireless communication module compatible with short-range wireless communication standards such as Wi-Fi (registered trademark) or Bluetooth (registered trademark), or may be a wireless communication module compatible with an X-generation mobile communication system (for example, a fourth-generation mobile communication system such as LTE) that uses a SIM (Subscriber Identity Module).

[0039] The audio output unit 23 includes a signal processing circuit, an amplifier, and a speaker. The audio output unit 23 is configured to receive audio data from the control unit 21 and output audio to the outside based on the received audio data. In particular, the audio output unit 23 is configured to output an alarm sound to the outside to scare off intruders entering the store. The light-emitting unit 24 includes a plurality of light-emitting elements such as LEDs (Light Emitting Diodes) and LDs (Laser Diodes), an optical system such as an optical lens, an optical filter, and a diffuser, a light-emitting drive circuit, and a light-emitting control circuit. The light-emitting unit 24 is configured to emit light to the outside in response to a signal from the control unit 21. In particular, the light-emitting unit 24 is configured to visually output an alarm by emitting light to the outside to scare off intruders. The light-emitting pattern (blinking pattern, light-emitting color, light-emitting intensity, etc.) of the light-emitting unit 24 may change over time. A separate drive mechanism for rotating the light-emitting unit 24 may also be provided. In this way, the alarm device 2 can output an alarm visually and audibly to the outside by driving both the audio output unit 23 and the light-emitting unit 24. The alarm device 2 may be provided with only one of the audio output unit 23 and the light-emitting unit 24. The input operation unit 35 may be an operation button for setting the alarm device 2.

[0040] (Camera 3 configuration) Next, the hardware configuration of camera 3 will be described below with reference to FIG. 3. In this embodiment, cameras 3a-1 to 3b-5 have the same configuration. FIG. 3 is a diagram showing an example of the hardware configuration of camera 3. Camera 3 is configured to capture images showing its surrounding environment through photography, and may be placed inside or around a store. Camera 3 is a network-type surveillance camera that monitors the status of the store, and is communicatively connected to server 4 via communication network 7. Each camera 3 can transmit video data (video stream) to server 4 in real time via communication network 7. Server 4 stores the video data transmitted by each camera 3. Furthermore, server 4 transmits the video data to user terminal 6 in response to a transmission request from user terminal 6.

[0041] 3, the camera 3 includes a control unit 31, a storage device 32, a position information acquisition unit 33, a communication unit 34, an input operation unit 35, an imaging unit 36, a PTZ mechanism 37, and a power supply circuit (not shown). These elements are connected to a bus 30. The camera 3 may also be provided with a battery (not shown), a microphone, and a speaker.

[0042] The control unit 31 includes a memory and a processor. The memory is configured to store computer-readable instructions (programs). For example, the memory is composed of a ROM and a RAM. The processor is configured, for example, by at least one of a CPU, an MPU, a GPU, an FPGA, and an ASIC. The storage device 32 is, for example, a storage device such as an HDD, an SSD, or a flash memory, and is configured to store programs and various data. The position information acquisition unit 33 is configured to acquire position information (longitude, latitude) of the camera 3, and is, for example, a GPS (Global Positioning System) receiver.

[0043] The communication unit 34 is configured to connect the camera 3 to the communication network 7. The communication unit 34 includes, for example, a wireless communication module and / or a wired communication module. The input operation unit 35 is configured to accept input operations from an operator and generate operation signals in response to the input operations from the operator. The imaging unit 36 ​​is configured to capture an image of the surrounding environment of the camera 3. In particular, the imaging unit 36 ​​is configured to generate a video signal indicative of the surrounding environment of the camera 3, and includes an optical system, an image sensor, and an image processing circuit. The optical system includes, for example, an optical lens and an optical filter. The image sensor is configured by a CCD (Charge-Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor) or the like. The image processing circuit is configured to process the video signal photoelectrically converted by the image sensor, and includes, for example, an amplifier and an AD converter.

[0044] The PTZ mechanism 37 includes a pan mechanism, a tilt mechanism, and a zoom mechanism. The pan mechanism is configured to change the orientation of the camera 3 in the horizontal direction. The tilt mechanism is configured to change the orientation of the camera 3 in the vertical direction. The zoom mechanism is configured to change the angle of view of the camera 3 to enlarge (zoom in) or reduce (zoom out) an image showing an object to be captured. The zoom mechanism may change the angle of view of the camera 3 optically by changing the focal length of an optical lens included in the imaging unit 36, or may change the angle of view of the camera 3 digitally. In response to an input operation by the user U on the user terminal 6, an instruction signal instructing panning, tilting, and / or zooming may be transmitted from the user terminal 6 to the camera 3 via the server 4. In this case, the control unit 31 drives the PTZ mechanism 37 in response to the received instruction signal, thereby realizing the pan, tilt, and zoom functions of the camera 3 in real time.

[0045] (Server 4 configuration) Next, the hardware configuration of the server 4 will be described below with reference to FIG. 4. FIG. 4 is a diagram showing an example of the hardware configuration of the server 4. In this embodiment, the server 4 may be configured as a web server, an application server, and a video data server. The server 4 is configured to transmit data of a display screen to be displayed on the user terminal 6 (e.g., HTML files, CSS files, image / video files, program files, etc.). The server 4 functions as a server for providing SaaS (System as a Service). The server 4 may be constructed on-premise or as a cloud server. The server 4 is communicatively connected to the alarm device 2, the camera 3, and the user terminal 6 via a communication network 7.

[0046] As shown in Fig. 4, the server 4 includes a control unit 41, a storage device 42, an input / output interface 43, and a communication unit 44. These elements are connected to a bus 40. The control unit 41 includes a memory and a processor. The memory is configured to store computer-readable instructions. In particular, the memory may store a program for causing the processor to execute a series of processes executed by the server 4. The memory is configured with a ROM and a RAM. The processor is configured with at least one of a CPU, an MPU, a GPU, an FPGA, and an ASIC.

[0047] The storage device 42 is, for example, a storage device such as an HDD, SSD, or flash memory, and is configured to store various data and programs including an image recognition model (described later). The storage device 42 stores video data captured by each camera 3 and various management tables. The various management tables may include, for example, a first management table (FIG. 7A), a second management table (FIG. 7B), a group management table (FIG. 8), a notification setting table (FIG. 11), a user management table (FIG. 12), an alarm device management table (not shown), and a camera management table (not shown). The various management tables stored in the storage device 42 will be described in detail later. The input / output interface 43 is an interface that enables connection between an external device and the server 4. The communication unit 44 may include various wired communication modules for communicating with external devices on the communication network 7.

[0048] (Configuration of user terminal 6) Next, the hardware configuration of the user terminal 6 will be described below with reference to FIG. 5. In this embodiment, the user terminals 6a and 6b have the same configuration. FIG. 5 is a diagram showing an example of the hardware configuration of the user terminal 6. The user terminal 6 is operated by a user U who manages each store. The user terminal 6 may be, for example, a personal computer, a smartphone, a tablet, or a wearable device (e.g., AR / VR / MR glasses) worn by the user U. The user terminal 6 has a web browser. An alarm application provided by the server 4 may run on the web browser of the user terminal 6. Furthermore, the alarm application may be downloaded from the server 4 and then installed on the user terminal 6.

[0049] 5, the user terminal 6 includes a control unit 61, a storage device 62, an input / output interface 63, a communication unit 64, an input operation unit 65, a display unit 66, an audio input unit 67, and an audio output unit 68. These elements are connected to a bus 60.

[0050] The control unit 61 includes a memory and a processor. The memory is configured to store computer-readable instructions. In particular, the memory may store a program for causing the processor to execute a series of processes executed by the user terminal 6. The memory is configured with a ROM and a RAM. The processor is configured with at least one of a CPU, an MPU, a GPU, an FPGA, and an ASIC. The storage device 62 is, for example, a storage device such as an HDD, an SSD, or a flash memory, and is configured to store programs and various data.

[0051] The input / output interface 63 is an interface that enables connection between an external device and the user terminal 6. The communication unit 64 is configured to connect the user terminal 6 to the communication network 7. The communication unit 64 includes, for example, a wireless communication module and / or a wired communication module. The input operation unit 65 is, for example, a touch panel, a mouse, and / or a keyboard superimposed on the video display of the display unit 66, and is configured to accept input operations by the user U and generate operation signals corresponding to the input operations. The display unit 66 is, for example, configured with a video display and a video display circuit that drives and controls the video display. The audio input unit 67 includes a signal processing circuit, an AD conversion circuit, and a microphone. The audio output unit 68 includes a signal processing circuit, an amplifier, and a speaker. The user terminal 6 may also include a physical or electronic SIM card. The SIM card stores information about a unique identification number associated with the telephone number of the user U who owns the user terminal 6.

[0052] (Warning output method according to this embodiment: flow of a series of processes executed by the warning system 1) Next, a series of processes executed by the alarm system 1 according to this embodiment (an alarm output method according to this embodiment) will be described below, mainly with reference to Fig. 6. Fig. 6 is a flowchart for explaining a series of processes executed by the alarm system 1.

[0053] In this example, it is assumed that the alarm device 2a issues an alarm to an intruder J who has illegally entered store A. Furthermore, it is assumed that information indicating that the alarm device 2a is in operation is notified to a user terminal 6a associated with a user Ua who manages store A.

[0054] As shown in FIG. 6, in step S1, the server 4 (more specifically, the control unit 41 of the server 4) receives video from each camera 3. In step S2, the server 4 refers to a first management table (FIG. 7A) in which the identification information (camera ID) of the camera 3 and the identification information (alarm device ID) of the alarm device 2 are associated with each other, thereby identifying the alarm device 2 associated with each camera 3. Furthermore, the server 4 refers to a second management table (FIG. 7B) in which the identification information of the alarm device 2 and the identification information (group ID) of the user group are associated with the alarm device 2. Specifically, the server 4 receives the video captured by the cameras 3a-1 to 3a-5, and then refers to the first management table to identify the alarm device 2a associated with the cameras 3a-1 to 3a-5. Furthermore, the server 4 refers to the second management table to identify the user group of store A associated with the alarm device 2a. Here, it is assumed that user Ua who manages store A belongs to the user group of store A.

[0055] As a preliminary step to the series of processes shown in Figure 6, the server 4 is assumed to have stored the camera ID and the alarm device ID in a first management table in association with each other, and to have stored the alarm device ID and the user group ID in a second management table in association with each other.

[0056] In step S3, the server 4 confirms that the operating mode of the alarm device 2a is the alert mode by referring to the group management table (Fig. 8). As shown in Fig. 8, the group management table associates the group ID, group name, operating mode of the alarm device 2, and operating status of the alarm device 2. The server 4 can confirm that the operating mode of the alarm device 2a is the alert disarm mode or the alert mode based on the group ID of store A associated with the alarm device 2a and the group management table. On the other hand, if the operating mode of the alarm device 2a is the alert disarm mode, the server 4 does not perform the processing from step S4 onwards.

[0057] When the operation mode of the alarm device 2a is the alert disarm mode, information indicating the alert disarm mode is displayed in the operation mode display area 103 of the operation mode setting screen 100 displayed on the display unit 66 of the user terminal 6a, as shown in Fig. 9(a). On the other hand, when the operation mode of the alarm device 2a is the alert mode, information indicating the alert mode is displayed in the operation mode display area 103 of the operation mode setting screen 100, as shown in Fig. 9(b).

[0058] If the operation mode of the alarm device 2a is the alert mode in step S3, the server 4 detects an intruder J entering store A based on the images captured by each camera 3a and the image recognition model in step S4. Here, the image recognition model is a trained model configured to detect people shown in the images. An algorithm such as a neural network may be used for the image recognition model.

[0059] As a specific example of processing, the image recognition model divides input video data into frames and then performs preprocessing (resizing, noise removal, normalization, etc.) on each frame. Next, the image recognition model extracts features (shape and contours) from each frame using a convolutional neural network (CNN) or similar, and then generates a bounding box (rectangular region) on each frame using an object detection algorithm (YOLO, SSD, Faster R-CNN, etc.). The image recognition model then calculates a confidence score (probability value) for each bounding box, and if the calculated confidence score is equal to or greater than a threshold, it determines that a person is present in that bounding box.

[0060] The image recognition model may also be constructed by learning using image data and image data (learning data) to which information related to human detection (particularly, annotation information added for identifying and detecting humans) is added. The learning data may be created by annotating the image data.

[0061] Furthermore, since cameras 3a-1 to 3a-5 are installed in different locations in store A, when intruder J is detected in at least one of the images captured by cameras 3a-1 to 3a-5, server 4 determines that intruder J is present in store A. When intruder J is not detected in these images, the processes from step S5 onwards are not executed.

[0062] Thereafter, in step S5, the server 4 determines to activate the alarm device 2a. In particular, the server 4 determines to activate the alarm device 2a associated with the camera 3a that captured the video showing the intruder J, after detecting the intruder J from the video captured by the camera 3a.

[0063] 10, the server 4 may set a security area S for detecting an intruder within the video V of the camera 3a in response to an input operation by the user Ua via the user terminal 6a. FIG. 10 shows an example of the video V showing an intruder J invading store A and the security area S. FIG. 10 also shows a bounding box surrounding the intruder J. Specifically, the user terminal 6a determines information about the security area S within the video V in response to an input operation by the user Ua, and then transmits the information to the server 4. The server 4 sets the security area S within the video V. The security area S may be set within the video V of each of the cameras 3a-1 to 3a-5.

[0064] In this case, the server 4 may decide to activate the alarm device 2a when it detects an intruder J within the alert area S. If the alert area S is set within the video V, it becomes possible to customize the activation conditions of the alarm device 2a through the setting of the alert area S. In this way, the usability of the alarm system 1 can be improved.

[0065] Returning to FIG. 6, in step S6, the server 4 refers to the notification settings table (FIG. 11) to identify the contact information linked to the user group corresponding to the alarm device 2a. In the notification settings table shown in FIG. 11, group IDs, registered contact information, and notification methods are associated with one another. The registered contact information is, for example, a telephone number. The notification method for a registered contact telephone number is a call or SMS (Short Message Service). In this example, the server 4 may refer to the notification settings table to determine that activation information indicating that the alarm device 2 is in operation is to be notified by call or SMS to the telephone number of user Ua belonging to the user group. Note that the registered contact information is not limited to a telephone number, and may also be the user Ua's email address or SNS (Social Networking Service) ID. The SNS may be, for example, LINE (registered trademark), WhatsApp (registered trademark), Messenger, etc.

[0066] The server 4 may also refer to the user management table (FIG. 12) to identify the contact information of a user who belongs to the user group corresponding to the alarm device 2a. In the user management table shown in FIG. 12, the user ID, user name, user contact information, operation authority, and group ID are associated with one another. The user contact information may be the email address or SNS ID of the user U. The operation authority may be information for identifying a user who is allowed to receive the activation information (in other words, information for identifying a user who has operation authority). In this example, the server 4 may refer to the user management table to determine that the activation information should be sent to the contact information of the user Ua who belongs to the user group and has operation authority.

[0067] Next, in step S7, the server 4 transmits an operation instruction signal to the alarm device 2a associated with the camera 3a that captured the video showing the intruder J. In step S8, the alarm device 2a (specifically, the control unit 21 of the alarm device 2a) outputs a visual and audible alarm toward the intruder J (toward the outside) in response to receiving the operation instruction signal. More specifically, the control unit 21 drives both the audio output unit 23 and the light-emitting unit 24 to output a visual and audible alarm toward the outside. The time interval at which the alarm is output from the alarm device 2 is not particularly limited, and may be, for example, several minutes.

[0068] In step S9, the server 4 decides to notify the user terminal 6a of activation information indicating that the alarm device 2a is in operation. Specifically, the server 4 decides whether the time interval between the time when the intruder J was last detected and the time when the intruder J is currently detected is equal to or greater than a predetermined time interval (for example, 15 minutes or more). Next, in response to determining that the time interval is equal to or greater than the predetermined time interval, the server 4 decides to notify the user terminal 6a of the activation information. In this way, the usability of the alarm system 1 can be improved by preferably preventing the activation information from being frequently notified to the user terminal 6a every time the intruder J is detected again by the server 4.

[0069] In step S10, the server 4 notifies the user terminal 6a of the operation information. In this regard, the server 4 may notify the user terminal 6 of the operation information through notification means such as a phone call, SMS, email, SNS, or push notification, or by using real-time communication such as WebSocket. If the notification means is a phone call or SMS, the server 4 may send the operation information and the user Ua's phone number to the cloud communication platform 5. The cloud communication platform 5 then notifies the user terminal 6a of the operation information by phone call or SMS. The cloud communication platform 5 is, for example, a Communications Platform as a Service (CPaaS). The CPaaS can provide communication functions such as voice calls, video calls, SMS, chat, and push notifications through APIs. The server 4 can notify the user terminal 6a, which can receive calls at the user Ua's phone number, of the operation information via the cloud communication platform 5.

[0070] Furthermore, if the notification means is email, the server 4 may send the activation information to the user Ua's email address via a sending / receiving mail server. If the notification means is SNS, the server 4 may send the activation information to the user terminal 6a via the SNS server. If the communication means is push notification, the server 4 may send the activation information to the user terminal 6a using the device token of the user terminal 6a. In this case, the server 4 may send the activation information to the user terminal 6a via a push notification service. Furthermore, as shown in FIG. 13 , when the operation mode setting screen 100 is displayed on the display unit 66 of the user terminal 6a, activation information indicating that the alarm device 2 is activated (alarm activated) may be displayed in the operation mode display area 103 of the operation mode setting screen 100. In this case, the activation information may be highlighted in the operation mode display area 103 so that the user Ua can easily visually recognize the activation information indicating that the alarm device 2 is activated. For example, the visual aspect of the activation information may change over time. Furthermore, the user terminal 6a may output the activation information to the user Ua visually and audibly. In order to ensure that the user Ua is aware of the operation information immediately and reliably, various notification means may be employed.

[0071] According to this embodiment, the user Ua who manages the store A can immediately know that the alarm device 2a is activated (i.e., that something unusual has occurred in the store A) by looking at the activation information (alarm activated) displayed on the user terminal 6a. This allows the user Ua to immediately report the abnormality in the store A to the police or other public safety authorities.

[0072] FIG. 13 is a diagram showing an example of an operation mode setting screen indicating that the alarm device 2a is in operation. An operation mode display area 103, an operation mode setting slider 102, an alarm stop button 105, and a video confirmation button 108 are displayed on the operation mode setting screen 100 shown in FIG. 13. By operating the operation mode setting slider 102, the user Ua can change the operation mode of the alarm device 2a to the alert mode or the alert cancellation mode. By operating the alarm stop button 105, the user Ua can stop the operation of the alarm device 2a (specifically, the operation of the audio output unit 23 and the light-emitting unit 24 that output an alarm). By operating the video confirmation button 108, the user Ua can display camera footage showing an intruder (camera footage taken before and after the time the intruder was detected) on the user terminal 6a. A detailed description of these functions will be given later.

[0073] In step S11, the user terminal 6a transmits a video transmission request to the server 4 in response to an input operation by the user Ua. Specifically, when the user Ua operates the video confirmation button 108 (see FIG. 13) on the operation mode setting screen 100, the user terminal 6a transmits the video transmission request to the server 4. In step S12, in response to the video transmission request from the user terminal 6a, the server 4 transmits to the user terminal 6a videos (videos showing the intruder J) before and after the intruder J is detected. Here, if two or more of the videos captured by the cameras 3a-1 to 3a-5 show the presence of the intruder J, the video to be transmitted to the user terminal 6a may be selected according to a predetermined condition. For example, the server 4 may select, from among the multiple camera videos, the camera video showing the largest area in which the intruder J is present or the camera video in which the intruder J was captured for the longest period of time as the video to be transmitted to the user terminal 6a. Furthermore, the priority order of the camera videos to be transmitted to the user terminal 6a may be set in advance. For example, if the presence of an intruder J is indicated in the images captured by camera 3a-1 and the images captured by camera 3a-2, and the priority of camera 3a-1 is higher than the priority of camera 3a-2, server 4 may transmit the image captured by camera 3a-1 to user terminal 6a.

[0074] In step S13, the user terminal 6a displays the video transmitted from the server 4 on the display unit 66 (see FIG. 14). FIG. 14 is a diagram showing an example of a video display screen 200 (video viewer) displayed on the user terminal 6a. As shown in FIG. 14, the video display screen 200 has a video display area 202, a time-series frame display area 205, a timeline 208, and a slider 210. The video display area 202 displays the camera video transmitted from the server 4. The time-series frame display area 205 displays reduced video frames at each time point in a row. The timeline 208 indicates the playback time of the video displayed in the video display area 202. The slider 210 is slidable on the timeline 208. The user Ua can change the playback time of the video displayed in the video display area 202 by moving the slider 210 on the timeline 208. For example, when the user Ua moves the slider 210 to the 22:30 position, the user terminal 6a transmits a request to the server 4 to transmit camera images for the time period before and after 22:30. In response to the transmission request, the server 4 transmits the camera images for the time period before and after 22:30 to the user terminal 6a. In this way, the images for the time period before and after 22:30 can be displayed in the image display area 202.

[0075] According to this embodiment, the user Ua who manages the store A can remotely and in detail grasp the behavior of the intruder J who has invaded the store A by viewing the video display screen 200 (video viewer) displayed on the user terminal 6a. In particular, by operating the video display screen 200, it becomes possible to grasp in detail the series of actions of the intruder J who has illegally invaded the store A.

[0076] Next, the process by which the user Ua remotely stops the alarm of the alarm device 2a will be described below. First, in step S14, the user terminal 6a transmits a stop signal to the server 4 instructing the operation of the alarm device 2a to be stopped in response to an input operation by the user Ua. Specifically, the user Ua operates the alarm stop button 105 on the operation mode setting screen 100 displayed on the user terminal 6a, causing the user terminal 6a to transmit the stop signal to the server 4. In response to receiving the stop signal from the user terminal 6a, the server 4 transmits the stop signal to the alarm device 2a (step S15). Thereafter, in step S16, the alarm device 2a stops the alarm operation in response to receiving the stop signal (specifically, the operation of the audio output unit 23 that outputs the alarm and the light-emitting unit 24 is stopped). In this way, the user Ua can remotely stop the operation of the alarm device 2a by input operation on the user terminal 6a, thereby improving the usability of the alarm system 1.

[0077] The alarm of the alarm device 2a may be stopped not only by a user's instruction but also when a predetermined time has elapsed since the alarm output was started.

[0078] The processing sequence shown in Figure 6 is merely an example, and the order of each step may be changed as appropriate. According to this embodiment, an intruder J who has illegally entered store A is detected based on the images captured by each camera 3a and a trained image recognition model, and an alarm is output by activation of the alarm device 2a. In this way, it is possible to provide an alarm system 1 with a relatively simple configuration compared to conventional alarm systems. Furthermore, it is possible to provide an alarm system 1 with reduced installation and maintenance costs compared to conventional alarm systems.

[0079] Furthermore, in the alarm system 1 according to this embodiment, when store A is open (particularly when the operation mode of the alarm device 2a is set to the alarm off mode), the user Ua who manages store A can monitor the situation inside store A in real time on the user terminal 6a through the images captured by each camera 3a. On the other hand, when the alarm device 2a is closed (particularly when the operation mode of the alarm device 2a is set to the alarm mode), an alarm can be output to intruder J trespassing into store A through the images from each camera 3a. Furthermore, the user Ua can remotely grasp any abnormalities in store A and the status of intruder J through the user terminal 6a. In this way, the alarm system 1 according to this embodiment makes it possible to simultaneously realize both real-time monitoring of store A from a remote location during business hours and alarm monitoring outside business hours.

[0080] (A series of processes to set the operation mode of the alarm device to alert mode) Next, a series of processes for setting the operation mode of the alarm device 2a to alert mode will be described below, mainly with reference to Fig. 15. Fig. 15 is a flowchart showing an example of the process for setting the operation mode of the alarm device 2a to alert mode. As shown in Fig. 15, in step S20, the user terminal 6a requests transmission of an operation mode setting screen 100 (see Fig. 9) in response to an input operation by the user Ua on the user terminal 6a. In step S21, the server 4 transmits data for displaying the operation mode setting screen 100 to the user terminal 6a in response to the transmission request from the user terminal 6a. In this way, the operation mode setting screen 100 shown in Fig. 9 is displayed on the user terminal 6a.

[0081] Next, in step S22, the user terminal 6a transmits an operation mode signal instructing the alert mode and the user ID to the server 4 in response to an input operation by the user Ua via the operation mode setting screen 100. At this point, as shown in FIG. 9(a), when the user Ua slides the operation mode setting slider 102 provided on the operation mode setting screen 100 to the right, the user terminal 6a transmits an operation mode signal instructing the alert mode and the user ID of the user Ua to the server 4.

[0082] In step S23, the server 4 identifies the group ID to which the user Ua belongs from the user ID by referring to the user management table shown in FIG. 12. Next, the server 4 acquires information about a first time slot during which the process of setting the operation mode of the alarm device 2a to alert mode is not permitted. In this regard, the server 4 acquires information about the first time slot associated with the group ID to which the user Ua belongs by referring to a first time slot table (not shown) in which group IDs and information about first time slots are associated with each other. The first time slot corresponds to the business hours of store A, for example. If the business hours of store A are 9:00 to 20:00, the first time slot is 9:00 to 20:00. Note that in this example, information about the first time slot during which the process of setting the operation mode to alert mode is not permitted is set for each group, but information about the first time slot may also be set for each alarm device 2.

[0083] In step S24, the server 4 determines whether the time at which the operation mode signal was received is within the first time period. If the time at which the operation mode signal was received is within the first time period (Yes in step S24), the server 4 determines not to permit the process of setting the operation mode to alert mode (step S25). In this case, the server 4 may send to the user terminal 6a a message indicating that the operation mode cannot be set to alert mode. On the other hand, if the time at which the operation mode signal was received is not within the first time period (No in step S24), the server 4 determines to permit the process of setting the operation mode to alert mode, and sets the operation mode to alert mode (step S26). Thereafter, the server 4 updates the information regarding the operation mode of the alarm device 2 contained in the group management table shown in FIG. 8.

[0084] After setting the operation mode to the alert mode, if the server 4 detects an intruder J in the video, it activates the alarm device 2a to output an alarm to the intruder J and notifies the user terminal 6a of the activation information. On the other hand, if the operation mode is maintained in the alert disengagement mode, the server 4 does not activate the alarm device 2a.

[0085] According to this embodiment, when the operation mode of the alarm device 2a is the alert mode, an alarm is output to the intruder J, but when the operation mode is the alert disarm mode, the alarm device 2a does not activate. In this way, it is possible to preferably prevent a situation in which the alarm device 2a is erroneously activated while the operation mode of the alarm device 2a is set to the alert disarm mode.

[0086] Furthermore, according to this embodiment, if the time when the operation mode signal is received falls within a first time slot corresponding to the business hours of store A, the process of setting the operation mode to alert mode is not permitted. This can preferably prevent a situation in which the operation mode of alarm device 2a is set to alert mode by an input operation by user Ua during the first time slot. In this way, it is possible to preferably prevent a situation in which alarm device 2a is activated during the first time slot.

[0087] (A series of processes to set the operation mode of the alarm device to the alarm disarm mode) Next, a series of processes for setting the operation mode of the alarm device 2a to alert disarm mode will be described below, mainly with reference to Fig. 16. Fig. 16 is a flowchart showing an example of the process for setting the operation mode of the alarm device 2a to alert disarm mode. As shown in Fig. 16, in step S30, the user terminal 6a requests transmission of an operation mode setting screen 100 (see Fig. 9). In step S31, the server 4 transmits data for displaying the operation mode setting screen 100 to the user terminal 6a in response to the transmission request from the user terminal 6a. In this way, the operation mode setting screen 100 is displayed on the user terminal 6a.

[0088] Next, in step S32, the user terminal 6a transmits an operation mode signal instructing the alert release mode and the user ID to the server 4 in response to an input operation by the user Ua via the operation mode setting screen 100. At this point, as shown in FIG. 9(b), the user Ua slides the operation mode setting slider 102 arranged on the operation mode setting screen 100 to the left, causing the user terminal 6a to transmit an operation mode signal instructing the alert release mode and the user ID of the user Ua to the server 4.

[0089] In step S33, the server 4 identifies the group ID to which the user Ua belongs from the user ID by referring to the user management table shown in FIG. 12. Next, the server 4 acquires information about a second time period during which the process of setting the operation mode of the alarm device 2a to the alert disarm mode is not permitted. In this regard, the server 4 acquires information about the second time period associated with the group ID to which the user Ua belongs by referring to a second time period table (not shown) in which group IDs and information about the second time period are associated with each other. The second time period corresponds, for example, to the non-business hours of store A. If the non-business hours of store A are from 20:00 to 9:00, the second time period would be from 20:00 to 9:00. Note that in this example, information about the second time period is set for each group, but information about the second time period may also be set for each alarm device 2.

[0090] In step S34, the server 4 determines whether the time at which the operation mode signal was received is within the second time period. If the time at which the operation mode signal was received is within the second time period (Yes in step S34), the server 4 determines not to permit the process of setting the operation mode to alert disarm mode (step S35). In this case, the server 4 may send a message to the user terminal 6a indicating that the operation mode cannot be set to alert disarm mode. On the other hand, if the time at which the operation mode signal was received is not within the second time period (No in step S34), the server 4 determines to permit the process of setting the operation mode to alert disarm mode, and sets the operation mode to alert disarm mode (step S36). Thereafter, the server 4 updates the information regarding the operation mode of the alarm device 2 contained in the group management table (see FIG. 8).

[0091] According to this embodiment, if the time when the operation mode signal is received falls within the second time period corresponding to outside business hours of store A, the process of setting the operation mode to the alarm disarm mode is not permitted. This can effectively prevent a situation in which the operation mode of the alarm device 2a is set to the alarm disarm mode by an input operation by user Ua during the second time period. In this way, it is possible to effectively prevent a situation in which the alarm device 2a does not activate when an intruder J trespasses into store A during the second time period when surveillance of store A is required. In particular, it is possible to effectively prevent fraudulent acts such as one of multiple users Ua managing store A intentionally setting the operation mode of the alarm device 2a to the alarm disarm mode outside business hours of store A in an attempt to cooperate with the intruder J in his crime. Note that the first and second time periods may be set by a person with predetermined authority, such as the manager or owner of store A.

[0092] Although the embodiments of the present invention have been described above, the technical scope of the present invention should not be construed as being limited by the description of the present embodiments. The present embodiments are merely examples, and it will be understood by those skilled in the art that various modifications of the embodiments are possible within the scope of the invention described in the claims. The technical scope of the present invention should be determined based on the scope of the invention described in the claims and its equivalents. [Explanation of symbols]

[0093] 1: alarm system, 2, 2a, 2b: alarm device, 3, 3a, 3a-1 to 3a-5, 3b, 3b-1 to 3b-5: camera, 4: server, 5: cloud communication platform, 6, 6a, 6b: user terminal, 7: communication network, 8a, 8b: router, 20: bus, 21: control unit, 22: communication unit, 23: audio output unit, 24: light emitting unit, 25: input operation unit, 30: bus, 31: control unit, 32: storage device, 33: position information acquisition unit, 34: communication unit, 35: input operation unit, 36: imaging unit, 37: PTZ mechanism, 40: bus, 41: control unit, 42: storage device, 43: input / output Interface, 44: Communication unit, 60: Bus, 61: Control unit, 62: Storage device, 63: Input / output interface, 64: Communication unit, 65: Input operation unit, 66: Display unit, 67: Audio input unit, 68: Audio output unit, 100: Operation mode setting screen, 102: Operation mode setting slider, 103: Operation mode display area, 105: Alarm stop button, 108: Video check button, 200: Video display screen, 202: Video display area, 205: Time series frame display area, 208: Timeline, 210: Slider, J: Intruder, S: Alert area, U, Ua, Ub: User, V: Video

Claims

1. An alarm system that outputs an alarm using a camera and an alarm device, storing the alarm devices and the groups in association with each other in a second management table; storing the group and the operation mode of the alarm device in association with each other in a fourth management table; Detecting an intruder based on the image captured by the camera; Identifying an operation mode associated with the alarm device by referring to the second management table and the fourth management table; If the specified operation mode is an alert mode, activating the alarm device in response to the detection of the intruder; If the specified operation mode is a disarm mode, the alarm device is not activated. Alarm system.

2. The alarm device and the camera are associated with each other and stored in a first management table; Identifying an alarm device associated with the camera by referring to the first management table. The alarm system of claim 1 .

3. The group and the contact are associated with each other and stored in a third management table; Identifying a contact point associated with the alarm device by referring to the second management table and the third management table; In response to activation of the alarm device, notify the specified contact person of information indicating that the alarm device is activated. The alarm system of claim 1 .

4. After detecting the intruder at a first time, when the intruder is detected again at a second time, determining whether or not the time interval between the first time and the second time is equal to or greater than a predetermined value; If it is determined that the time interval is equal to or greater than the predetermined value, notify the specified contact point again of information indicating that the alarm device is in operation; If it is determined that the time interval is not equal to or greater than the predetermined value, the information indicating that the alarm device is in operation is not notified again to the specified contact point.

4. The alarm system of claim 3.

5. stopping the operation of the alarm device in response to an input operation by a user via a user terminal; The alarm system of claim 1 .

6. Displaying an image of the intruder detected on a user terminal. The alarm system of claim 1 .

7. setting an area in the image for detecting the intruder based on the image in response to an input operation by a user via a user terminal; The alarm system of claim 1 .

8. setting a first time period during which a process of setting the operation mode to the alert mode is not permitted; a process of setting the operation mode to the alert mode is not permitted during the first time period; The alarm system of claim 1 .

9. setting a second time period during which the process of setting the operation mode to the alert cancellation mode is not permitted; a process of setting the operation mode to the alert cancellation mode is not permitted during the second time period; The alarm system of claim 1 .

10. An alarm output method for outputting an alarm executed by an alarm system using a camera and an alarm device, comprising: storing the alarm devices and groups in association with each other in a second management table; storing the group and the operation mode of the alarm device in association with each other in a fourth management table; detecting an intruder based on the image captured by the camera; Identifying an operation mode associated with the alarm device by referring to the second management table and the fourth management table; If the specified operation mode is an alert mode, activating the alarm device in response to the detection of the intruder; if the identified operating mode is a disarmed mode, not activating the alarm device; An alarm output method comprising:

11. An alarm output program that causes an alarm system to execute the alarm output method according to claim 10.

Images