Security management devices, security management methods, programs

Abstract

To provide a technology that reduces a specific effort of a person even when the person is not included in an image taken for a purpose of crime prevention for a managed object.SOLUTION: In a crime prevention management device, detection information including a photographed image generated by photographing by a photographing device and a detection value of a sensor provided in a management target device is acquired from the management target device provided with the photographing device. The detection value and the photographed image are associated to be recorded. Based on the detection value of the sensor, a photographed image is specified that includes at least the face of a person in the photographed image associated with the specified past similar detection value, and notification information including the photographed image is generated to output.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a crime prevention management device, a crime prevention management method, and a program.

Background Art

[0002] Vending machines can be installed even in unpopular places such as alleys and residential areas. Also, vending machines may operate 24 hours a day. In order to operate vending machines without human presence, it is necessary to prevent illegal acts such as acts of vandalism against vending machines. Installing cameras on vending machines for the purpose of suppressing such illegal acts is disclosed in Patent Document 1 and Patent Document 2.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] Here, even if a photographing device is installed in a management target device such as a vending machine and a person who has committed an illegal act can be photographed, there are cases where the person cannot be included in the shooting angle of the photographed image and cannot be photographed, or cases where the face cannot be photographed so that it can be recognized in a dark surrounding situation such as at night.

[0005] Therefore, an object of this invention is to provide a crime prevention management device, a crime prevention management method, and a program for solving the above problems.

Means for Solving the Problems

[0006] According to a first aspect of the present invention, the security management device includes: acquisition means for acquiring detection information from a managed device equipped with a camera, including a captured image generated by the camera and a detection value from a sensor provided on the managed device; recording means for linking and recording the detection value and the captured image; and notification means for identifying a captured image that includes at least a person's face from among captured images linked to similar past detection values ​​identified based on the sensor's detection value, and generating and outputting notification information including the captured image.

[0007] According to a second aspect of the present invention, the security management method acquires detection information from a managed device equipped with a camera, including a captured image generated by the camera and a detection value from a sensor provided on the managed device; records the detection value and the captured image in association; identifies a captured image that includes at least a person's face from among captured images associated with similar past detection values ​​identified based on the sensor's detection value; and generates and outputs notification information including the captured image.

[0008] According to a third aspect of the present invention, the program causes the computer of the security management device to function as an acquisition means for acquiring detection information including a captured image generated by the shooting of a managed device equipped with a shooting device and a detection value of a sensor provided on the managed device; a recording means for recording the detection value and the captured image in association; and a notification means for identifying a captured image that includes at least a person's face from among captured images associated with similar past detection values ​​identified based on the detection value of the sensor, and generating and outputting notification information including the captured image. [Effects of the Invention]

[0009] According to the present invention, even if a person who has committed an unauthorized act against the managed device is not clearly identifiable in the captured image when photographed by the camera installed in the managed device, the effort required to identify the person can be reduced. [Brief explanation of the drawing]

[0010] [Figure 1]This figure shows the schematic configuration of the security management system in this embodiment. [Figure 2] This is a schematic diagram of the vending machine according to this embodiment. [Figure 3] This is a functional block diagram of the vending machine according to this embodiment. [Figure 4] This is a hardware configuration diagram of the management server according to this embodiment. [Figure 5] This is a functional block diagram of the management server according to this embodiment. [Figure 6] This figure shows a list of information included in the anomaly detection data according to this embodiment. [Figure 7] This diagram shows the processing flow of the vending machine according to this embodiment. [Figure 8] This diagram shows the processing flow of the management server according to this embodiment. [Figure 9] This figure shows the minimum configuration of the security management device according to this embodiment. [Figure 10] This figure shows the processing flow of the minimal security management device according to this embodiment. [Modes for carrying out the invention]

[0011] A security management system equipped with a security management device according to one embodiment of the present invention will be described below with reference to the drawings. Figure 1 shows a schematic configuration of the security management system in this embodiment. As shown in Figure 1, the security management system 100 is configured by a management server 10 (security management device 30) communicating with multiple vending machines 20. The management server 10 is located in a management center or similar location and communicates with each vending machine 20 via a router 120, the internet, or other communication network. The management server 10 is one embodiment of the security management device 30. The management server 10 communicates with external devices such as the police information system 110 via a communication network such as the internet.

[0012] The vending machine 20 is a device that automatically sells PET bottles and cans, such as soft drinks. The vending machine 20 is composed of a wireless relay device 21, a camera 22, a pressure sensor 23, and a vibration sensor 24. The vending machine 20 communicates with the management server 10 via the wireless relay device 21 and a communication network such as the Internet.

[0013] Figure 2 is a schematic diagram of the vending machine according to this embodiment. The vending machine 20 is equipped with a camera 22, a vibration sensor 24, a product selection button 3 which senses the pressure when the switch is pressed using a pressure sensor 23, and a refund lever 6 which senses the pressure when the lever is operated using a pressure sensor 23. The vending machine 20 is also equipped with a product dispensing slot 4, a coin slot 5, a banknote slot 7, a body lock 8, and a change dispensing slot 9. Sensors for detecting foreign objects, or sensors for detecting vibration (acceleration) or pressure may be provided in the product dispensing slot 4, coin slot 5, banknote slot 7, body lock 8, and change dispensing slot 9.

[0014] Figure 3 is a functional block diagram of the vending machine according to this embodiment. The vending machine 20 includes a pressure sensor 231 of the main body lock 8, a pressure sensor 232 of the product selection button 3, and a pressure sensor 233 of the refund lever. These pressure sensors 231, 232, and 233 are collectively referred to as the pressure sensor 23. The vending machine 20 includes pressure conversion modules 251, 252, and 253. The pressure conversion module 251 converts the sensing data (analog value) of the pressure sensor 231 into digital data and outputs it to the data processing unit 220. The pressure conversion module 252 converts the sensing data (analog value) of the pressure sensor 232 into digital data and outputs it to the data processing unit 220. The pressure conversion module 253 converts the sensing data (analog value) of the pressure sensor 233 into digital data and outputs it to the data processing unit 220. The vending machine 20 also includes a vibration data conversion module 254. The vibration data conversion module 254 converts the sensing data (analog value) of the vibration sensor 24 into digital data and outputs it to the data processing unit 220. The vending machine 20 also includes a data processing unit 220. The data processing unit 220 outputs the sensing data, the time acquired from the timer 230, to the wireless relay device 21.

[0015] The wireless relay device 21 provided in the vending machine 20 exhibits the functions of an image data processing unit 211, a storage unit 212, and a wireless communication control unit 213. These functions may be configured by a circuit or may be functions provided in the wireless relay device 21 when a computer of the wireless relay device 21 executes a program. The image data processing unit 211 acquires the image captured by the camera 22 and records it in the storage unit 212. The wireless communication control unit 213 transmits the sensing data and time acquired from the data processing unit 220, and the abnormality detection data including the captured image acquired from the storage unit 212, to the management server 10.

[0016] Figure 4 is a hardware configuration diagram of the management server according to this embodiment. As shown in this figure, the management server 10, which is one aspect of the security management device 30, is a computer equipped with various hardware components such as a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a HDD (Hard Disk Drive) 104, a communication module 105, and a database 106.

[0017] Figure 5 is a functional block diagram of the management server according to this embodiment. The management server 10, which is one aspect of the security management device 30, starts a program installed in itself. As a result, the management server 10 is equipped with each function of a control unit 11, an acquisition unit 12, a recording unit 13, and a notification unit 14.

[0018] The control unit 11 controls each function of the management server 10. The acquisition unit 12 acquires detection information including a captured image generated by the camera 22 of the vending machine 20 and sensing data of each sensor from the vending machine 20. The above-mentioned anomaly detection data is one aspect of the detection information. The recording unit 13 records the sensing data and the captured image in association with each other. The notification unit 14 identifies a captured image that at least includes a person's face among the captured images associated with past similar sensing data identified based on the sensing data of each sensor, generates notification information including the captured image, and outputs the notification information to an external device such as the police information system 110.

[0019] Figure 6 is a diagram showing a list of information included in the anomaly detection data according to this embodiment. The anomaly detection data includes the time period during which the anomaly was detected (a numerical value indicating the time period), the area identifier (postal code or latitude and longitude), the type indicating the maximum value of the vibration of the vending machine 20, the number of times vibrations were detected in the vending machine 20, the type of the maximum value of the pressure detected by each pressure sensor 23 (231, 232, 233) on the vending machine 20, and the number of times pressure above a threshold was detected in each pressure sensor 23 on the vending machine 20. The recording unit 13 may record one or more of these pieces of information included in the anomaly detection data, along with the captured image, the vending machine's identification number (ID), and the sensing time. The area identifier of the vending machine 20 may be information obtained by converting the latitude and longitude information included in the anomaly detection data acquired from the vending machine.

[0020] Figure 7 shows the processing flow of the vending machine according to this embodiment. When the vending machine 20 is powered on, the camera 22 of the vending machine 20 repeatedly generates captured images at predetermined intervals, such as 1 second. The image data processing unit 211 sequentially acquires the captured images and records them in the storage unit (step S101). The image data processing unit 211 may delete captured images that have not been uploaded after a predetermined time has elapsed from the storage unit 212. The data processing unit 220 determines whether the sensing data acquired from the pressure sensor 23 and the vibration sensor 24 is above a threshold, and generates detection information for each sensor, such as the value that is above the threshold, the type of the maximum pressure value identified based on that value, the number of pressure detections, the number of vibration detections, the type indicating the maximum vibration, and the time when each value was sensed (step S102). If at least one of the following conditions is met, the data processing unit 220 determines that an abnormality has occurred and decides to transmit abnormality detection data (step S103). When the data processing unit 220 determines that it is time to transmit anomaly detection data, it outputs information for each sensor, such as the pressure sensor 23 and vibration sensor 24, including the value when the sensing value exceeds a threshold, the type of maximum pressure value identified based on that value, the number of pressure detections, the number of vibration detections, and the type indicating the maximum vibration, along with the time when the information was generated, to the wireless communication control unit 213. The time is obtained from the timer 230. The wireless communication control unit 213 generates anomaly detection data that includes the information obtained from the data processing unit 220 and one or more captured images obtained from the storage unit 212 based on the time included in that information. The wireless communication control unit 213 transmits the generated anomaly detection data to the management server 10 (step S104).

[0021] The data processing unit 220 of the vending machine 20 may output the sensing data acquired from the pressure sensor 23 and vibration sensor 24, along with the time at which the sensing data was acquired, to the wireless communication control unit 213 in the same order. The camera 22 may sequentially record the captured images generated at predetermined time intervals, such as 1 second, in the storage unit 212. When the wireless communication control unit 213 acquires the sensing data and time from the data processing unit 220, it may acquire the captured images recorded within the time range based on that time from the storage unit 212 and transmit them to the management server 10 as anomaly detection data without any processing. In this case, the recording unit 13 of the management server 10 may generate information for each sensor, such as the pressure sensor 23 and vibration sensor 24, based on the anomaly detection data, including the value when the sensing value exceeds a threshold, the type of maximum pressure value identified based on that value, the number of pressure detections, the number of vibration detections, and the type indicating the maximum vibration value. Furthermore, the information included in the anomaly detection data will include an ID for identifying the sensor, linked to the sensing values, in order to determine which sensor provided the sensing data.

[0022] When the vending machine 20 transmits sensing data directly to the management server 10, the notification unit 14 of the management server 10 determines whether or not an abnormality has occurred. For example, the notification unit 14 determines that an abnormality has occurred if the type of maximum pressure value of a certain pressure sensor 23 exceeds a predetermined threshold, if the number of times a pressure value above the threshold is detected exceeds a predetermined number of times, if the type of maximum vibration (acceleration) of a vibration sensor 24 exceeds a predetermined threshold, or if the number of times a vibration above the threshold is detected exceeds a predetermined number of times.

[0023] Figure 8 shows the processing flow of the management server 10 according to this embodiment. The following explanation is based on an example where an abnormality is detected in the vending machine 20 and abnormality detection data is transmitted. The acquisition unit 12 of the management server 10 acquires the abnormality detection data (step S201). The acquisition unit 12 outputs the abnormality detection data to the recording unit 13. The recording unit 13 identifies the information to be recorded based on the information contained in the abnormality detection data. For example, the recording unit 13 identifies the ID of the vending machine 20 that transmitted the abnormality detection data, the captured image, and the area identifier. The recording unit 13 also identifies the identifier of the pressure sensor 23, the type of the maximum value of the pressure detected by the pressure sensor 23, the number of times the pressure exceeded the threshold, and the time of each detection of the pressure value by the pressure sensor 23. The recording unit 13 also identifies the identifier of the vibration sensor 24, the type of the maximum value of the vibration detected by the vibration sensor 24, the number of times the vibration exceeded the threshold, and the time of each detection of the vibration (acceleration) by the vibration sensor 24. The recording unit 13 links this identified information and records it in the management table of the database 106 (step S202). Each time the management server 10 acquires anomaly detection data, it sequentially records the identified information in the management table.

[0024] The notification unit 14 of the management server 10 then determines whether a face is visible in the captured image included in the anomaly detection data indicating an anomaly (step S203). The determination of whether or not a face is visible in the captured image can be made using known techniques. If a face is visible in the captured image, the notification unit 14 sends the anomaly detection data, including that captured image, directly to an output destination such as the police information system 110 (step S204). As a result, the police information system 110 may perform processing such as person detection or comparison with past history information based on the anomaly detection data.

[0025] Furthermore, if no face is visible in the captured image, the notification unit 14 searches the database 106 based on the anomaly detection data and determines whether similar anomaly detection data transmitted as information in the event of an anomaly is recorded (step S205). Specifically, the notification unit 14 determines whether similar anomaly detection data transmitted by other vending machines in a nearby area is recorded in the database 106, based on the identifier of each sensor, detected value, detection time, number of detections, type of maximum value, and area identifier included in the anomaly detection data. More specifically, the notification unit 14 identifies the identifiers of vending machines included in a predetermined range, such as within a radius of 1 km, based on the area identifier, from the information of the vending machine 20 recorded in the database. The notification unit 14 obtains information about the anomaly detection data, including the identifiers of the identified other vending machines, from the management table. The notification unit 14 compares the anomaly detection data obtained from the vending machine 20 (sensor identifier, detected value, detection time, number of detections, type of maximum value) with the anomaly detection data from other vending machines 20 obtained from the management table (sensor identifier, detected value, detection time, number of detections, type of maximum value) to determine if they are similar. This determination may be made using known techniques. Alternatively, if the order of the detected sensor identifiers based on the detection time matches, and the number of detections and type of maximum value are similar, it may be determined that the anomaly detection data is similar to that obtained from other vending machines 20.

[0026] If the notification unit 14 does not have any data similar to the anomaly detection data from other vending machines 20, it transmits the anomaly detection data obtained from the vending machine 20 as an anomaly detection report to an output destination such as the police information system 110 (step S206).

[0027] The notification unit 14 retrieves a captured image from the database 106 that is included in the anomaly detection data from another vending machine 20 that it has determined to be similar (step S207). The notification unit 14 determines whether a face can be detected in the captured image (step S208). If a face is detected, the notification unit 14 sends the anomaly detection data including the captured image to an output destination such as the police information system 110, in the same manner as the process in step S204. If a face cannot be detected in the captured image included in the anomaly detection data from another vending machine 20 that it has determined to be similar, the notification unit 14 sends the anomaly detection data obtained from the vending machine 20 and the anomaly detection data obtained from the database 106 to an output destination such as the police information system 110 (step S209).

[0028] The processing performed by the management server 10 described above is one aspect of the process of identifying a captured image that includes at least a person's face from among past captured images associated with similar detection values ​​from multiple different sensors, which are identified based on the detection values ​​from multiple different sensors, and then generating and outputting notification information that includes the captured image. Furthermore, the processing of the management server 10 described above is one aspect of the process that identifies a captured image containing at least a person's face from among captured images linked to similar past detection values ​​and detection intervals from multiple different sensors, based on the detection values ​​of multiple different sensors and the detection times of those detection values, and generates and outputs notification information containing the captured image. Furthermore, the processing performed by the management server 10 described above is one aspect of the process of identifying images that include at least a person's face from among the images generated by the camera installed in the managed device identified based on location information, and generating and outputting notification information that includes said images.

[0029] The above explanation described the case where the managed device is a vending machine 20, but the managed device can be anything that is monitored for security purposes by a camera. For example, the managed device could be a car, a device in a store, an ATM, etc.

[0030] (Minimum configuration) Figure 9 shows the minimum configuration of the security management device according to this embodiment. Figure 10 shows the processing flow of the minimal security management device according to this embodiment. The security management device 30 performs at least the functions of an acquisition means 31, a recording means 32, and a notification means 33. The acquisition means 31 acquires detection information from the managed device equipped with a shooting device, including the captured image generated by the shooting device and the detected value of a sensor provided on the managed device (step S301). The recording means 32 records the detected value and the captured image in association (step S303). The notification means 33 identifies a captured image that includes at least a person's face from among the captured images associated with similar past detection values ​​identified based on the sensor's detection value, and generates and outputs notification information that includes the captured image (step S304).

[0031] The security management device 30 described above, the management server 10, has a computer system inside. The processes described above are stored in program form on a computer-readable recording medium, and the above processes are carried out when the computer reads and executes this program. Here, a computer-readable recording medium refers to a magnetic disk, magneto-optical disk, CD-ROM, DVD-ROM, semiconductor memory, etc. Alternatively, this computer program may be distributed to a computer via a communication line, and the computer that receives the distribution executes the program.

[0032] Furthermore, the above program may be intended to implement only a portion of the functions described above. It may also be a so-called differential file (differential program) that can implement the aforementioned functions in combination with programs already recorded in the computer system. [Explanation of Symbols]

[0033] 10. Management Server 11. Control Unit 12... Acquisition unit (acquisition means) 13. Recording section (recording means) 14...Notification section (notification means) 20... Vending machines 21. Wireless relay device 22...Camera 23. Pressure-sensitive sensor 24. Vibration Sensor 220...Data Processing Unit 230... Timer 211...Image Data Processing Unit 212...Storage section 213... Wireless Communication Control Unit 100...Security Management System

Claims

1. An acquisition means for acquiring detection information from a managed device equipped with a shooting device, including an image captured by the shooting device and a detection value from a sensor provided on the managed device. A recording means for linking the detected value and the captured image and recording them, A notification means that identifies a captured image containing at least a person's face from among captured images linked to similar past detection values ​​identified based on the sensor's detection value, and generates and outputs notification information containing the captured image. A security management device equipped with the following features.

2. The acquisition means acquires detection information including detection values ​​from a plurality of different sensors provided in the managed device, The recording means records the detection values ​​of multiple different sensors and the captured image in association with each other. The notification means identifies a captured image that includes at least a person's face from among past captured images associated with similar detection values ​​from multiple different sensors, which are identified based on the detection values ​​of multiple different sensors, and generates and outputs notification information that includes the captured image. The security management device according to claim 1.

3. The acquisition means acquires detection information including detection values ​​from multiple different sensors provided in the managed device and the detection time of those detection values. The recording means records the detection values ​​of multiple different sensors, the detection times of those sensors, and the captured images in association with each other. The notification means identifies a captured image that includes at least a person's face from among captured images associated with similar past detection values ​​and detection intervals from multiple different sensors, identified based on the detection values ​​of multiple different sensors and the detection times of those detection values, and generates and outputs notification information that includes the captured image. The security management device according to claim 1.

4. The acquisition means acquires the detection information, including the captured image generated by taking a picture when the sensor's detected value exceeds a threshold. A security management device according to any one of claims 1 to 3.

5. The acquisition means acquires detection information including location information of the device to be managed, The recording means further records the location information of the managed device in association with the captured image, The notification means further identifies an image from among the images generated by the camera, which was identified based on the location information, that includes at least the person's face, and generates and outputs notification information that includes the image. A security management device according to any one of claims 1 to 4.

6. The security management device according to any one of claims 1 to 5, wherein the device to be managed is a vending machine, and the device is connected to the vending machine via communication.

7. Detection information is acquired from a managed device equipped with a shooting device, including the captured image generated by the shooting device and the detected value of a sensor provided on the managed device. The detected value and the captured image are linked and recorded. Based on the sensor's detection values, the system identifies images that include at least a person's face from among the previously identified similar detection values, and generates and outputs notification information that includes such images. Security management methods.

8. The computer of the security management system, Acquisition means for acquiring detection information from a managed device equipped with a shooting device, including an image captured by the shooting device and a detection value from a sensor provided on the managed device. A recording means for linking the detected value and the captured image and recording them together. A notification means that identifies a captured image containing at least a person's face from among captured images linked to similar past detection values ​​identified based on the detection value of the aforementioned sensor, and generates and outputs notification information containing the captured image. A program that makes it function as such.

Images