Forced entry detection system, forced entry detection device, forced entry detection method, and forced entry detection program

Abstract

To detect a forced entry at a gate.SOLUTION: A forced entry detection system includes: a gate camera that picks up an image of a person passing through a gate to generate a gate picked-up image; and a management device. When the person included in the gate picked-up image is not permitted to pass through the gate and when the person oversteps a breakthrough line set previously for the gate picked-up image, the management device determines that the person has forcedly entered through the gate.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a forced break-in detection system, a forced break-in detection device, a forced break-in detection method, and a forced break-in detection program. [Background technology]

[0002] When an unauthorized person attempts to pass through an automatic ticket gate at a station or a security gate at a facility, the flapper is closed to prevent the person from passing through. However, there are people who force their way through even when the flapper is closed. Patent Document 1 discloses a technology that uses a photosensor provided above the opening and closing doors (flappers) of a pair of frames in an automatic ticket gate to detect people who force their way through closed opening and closing doors. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-161350 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, it is difficult to install new photo sensors on automated ticket barriers or security gates that have already been installed, and there is a demand for technology to detect forced entry using means other than photo sensors.

[0005] An object of the present disclosure is to provide a technique for detecting forced entry at a gate. [Means for solving the problem]

[0006] The forced break-in detection system according to the present disclosure is a forced break-in detection system that detects forced break-in of a gate, and includes a gate camera that photographs a person passing through the gate and generates a gate photographed image, and a management device, and if a person included in the gate photographed image is not permitted to pass through the gate and the person crosses a predetermined break-in line for the gate photographed image, the management device determines that the person has forced through the gate.

[0007] The forced break-in detection device according to the present disclosure is a forced break-in detection device that detects the forced break-in of a gate, and is equipped with a processor and a memory, and the processor, in cooperation with the memory, determines that a person included in a gate photographed image of a person passing through the gate is not permitted to pass through the gate, and the person crosses a break-in line that is preset for the gate photographed image, has forced through the gate.

[0008] The forced break-in detection method according to the present disclosure is a method for detecting forced break-in through a gate, in which a gate camera photographs a person passing through the gate and generates a gate photographed image, and a management device determines that the person included in the gate photographed image is not permitted to pass through the gate and the person crosses a predetermined break-in line for the gate photographed image, and determines that the person has forced through the gate.

[0009] The unauthorized break-in detection program of the present disclosure is a forced break-in detection program that detects forced break-in through a gate, and causes a computer to execute the following: if a person included in a gate photographed image of a person passing through the gate is not permitted to pass through the gate, and the person crosses a predetermined break-in line for the gate photographed image, the program determines that the person has forced their way through the gate.

[0010] Furthermore, these comprehensive or specific aspects may be realized by a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium, or may be realized by any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. Effect of the Invention

[0011] According to the present disclosure, forced entry at a gate can be detected. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a schematic diagram showing a configuration example of a forced entry detection system according to a first embodiment; [Diagram 2] FIG. 1 is a block diagram showing an example of a configuration of a matching server according to a first embodiment. [Diagram 3] FIG. 1 is a block diagram showing an example of a configuration example of a management device according to a first embodiment; [Figure 4] FIG. 1 is a perspective view for explaining a position of a depth measurement point and a breakthrough line for a flapper according to the first embodiment; [Diagram 5] FIG. 1 is a side view for explaining a position of a depth measurement point and a breakthrough line for a flapper according to the first embodiment; [Figure 6] FIG. 1 is a diagram for explaining tailgating determination and child-carrying determination according to the first embodiment; [Figure 7] A flowchart showing an example of a forced passage determination process based on a flapper open / close state according to the first embodiment. [Figure 8] A flowchart showing an example of a forced break-in determination process based on a notification lamp and a monitoring panel according to the first embodiment. [Figure 9] A flowchart showing an example of a flapper open / close determination process according to the first embodiment. [Figure 10] A flowchart showing an example of a forced break-in habitual offender recording process according to the first embodiment. [Figure 11] A flowchart showing an example of a forced break-in occurrence notification process according to the first embodiment. [Figure 12]FIG. 1 is a diagram showing a display example of a gate display according to the first embodiment; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, the embodiments of the present disclosure will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed description of already well-known matters and duplicated description of substantially the same configuration may be omitted. This is to avoid the following description becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0014] (Embodiment 1) <System configuration> FIG. 1 is a schematic diagram showing an example of the configuration of a forced break-in detection system 10 according to the first embodiment.

[0015] As shown in FIG. 1, the gate 1 includes flappers 2 (2A, 2B), a notification lamp 4, and a monitoring panel 5. Examples of the gate 1 include an automatic ticket gate at a station and a security gate at a facility. When a person 6 who does not have the right to pass through the gate 1 (hereinafter referred to as an unauthorized passerby 6B) attempts to pass through the gate 1, the flapper 2 is closed, and when a person 6 who has the right to pass through the gate 1 (hereinafter referred to as a normal passerby 6A) attempts to pass through the gate 1, the flapper 2 is opened. When the gate 1 is an automatic ticket gate at a station, the person 6 whose ticket or boarding IC card, etc., is unauthenticated by the automatic ticket gate (including insufficient amount, etc.) is an unauthorized passerby 6B. When the gate 1 is a security gate at a facility, the person 6 whose admission ticket or admission IC card, etc., is unauthenticated by the security gate is an unauthorized passerby 6B.

[0016] The notification lamp 4 is installed, for example, at each gate 1, and is turned on when an unauthorized pedestrian 6B attempts to pass through the gate 1.

[0017] The monitoring panel 5 is a device that displays information showing the status of the gate 1, and includes a display. When an unauthorized pedestrian 6B attempts to pass through the gate 1, the monitoring panel 5 may display a message indicating that unauthorized passage has occurred.

[0018] An attendant 7 monitoring the passage through the gate 1 can recognize the presence of an unauthorized passerby 6B passing through the gate 1 by seeing the light of the notification lamp 4 and / or the display on the monitoring panel 5.

[0019] Even though the flapper 2 of the gate 1 is in the closed state and the notification lamp 4 is turned on, there exists an unauthorized passerby 6B who ignores this and forces his way through the gate 1. Hereinafter, the unauthorized passerby 6B who forces his way through the gate 1 may be referred to as a forced passerby 6C. The forced pass detection system 10 is a system that detects the forced passerby 6C of the gate 1.

[0020] As shown in FIG. 1, the forced break-in detection system 10 includes at least one gate camera 11, at least one notification lamp camera 12, at least one monitoring panel camera 13, at least one gate display 14, at least one attendant display 15, a verification server 20, and a management device 40. The management device 40 can transmit and receive information to and from the gate camera 11, the notification lamp camera 12, the monitoring panel camera 13, and the verification server 20 through a communication network N. Examples of the communication network N include a wired LAN, a wireless LAN, a VPN, the Internet, or a mobile communication network (e.g., LTE, 4G, 5G, etc.). The management device 40 can transmit and receive data to and from the gate display 14 and the attendant display 15 through an electrical cable (e.g., a display cable). However, the management device 40 may also transmit and receive data to and from the gate display 14 and the attendant display 15 through the communication network N.

[0021] The gate camera 11 is installed in a position where it can capture an image of the flapper 2 of the gate 1 and a person 6 passing through the gate 1. The gate camera 11 captures an image of the flapper 2 of the gate 1 and a person 6 passing through the gate 1, and generates an RGB captured image (hereinafter referred to as a gate captured image). The gate camera 11 also measures the depth (or distance) of at least the flapper 2 of the gate 1, and generates a depth image (or distance image). The gate captured image and the depth image may be still images captured continuously at a predetermined cycle, or may be videos. The camera that generates the gate captured image and the camera (or sensor) that generates the depth image may be an integrated device, or may be separate devices.

[0022] The notification lamp camera 12 is installed in a position where it can capture an image of the notification lamp 4 of the gate 1. The notification lamp camera captures an image of the notification lamp 4 of the gate 1 and generates an RGB captured image (hereinafter, a notification lamp captured image). The notification lamp captured image may be a still image captured continuously at a predetermined cycle, or may be a video.

[0023] The monitoring panel camera 13 is installed in a position where it can capture an image of the display of the monitoring panel 5. The monitoring panel camera 13 captures an image of the display of the monitoring panel 5 and generates an RGB captured image (hereinafter referred to as a monitoring panel captured image). The monitoring panel camera 13 may capture still images at a predetermined cycle or may capture moving images.

[0024] The gate display 14 is installed in a position visible to people 6 passing through the gate 1. For example, the gate display 14 is installed diagonally above the direction of travel of the gate 1. The gate display 14 displays an image of the gate captured by the gate camera 11. Furthermore, if a forced breakthrough occurs, the gate display 14 displays a message to that effect. Details of the display on the gate display 14 will be described later (see FIG. 12).

[0025] The staff display 15 is installed at a position visible to the staff 7. The staff display 15 displays, for example, when a forced entry by a habitual forced entry person is detected.

[0026] Note that the collation server 20 and the management device 40 will be described later (see FIGS. 2 and 3).

[0027] FIG. 2 is a block diagram showing an example of the configuration of the collation server 20 according to Embodiment 1.

[0028] The collation server 20 is a server capable of collating face images or body images of the same person. A face image is an image in which a person's face is photographed. A body image is an image in which a person's body (including body shape and clothing) is photographed. The collation server 20 includes a processor 21, a memory 22, a storage 23, and a communication I / F 24.

[0029] The memory 22 stores programs, data, etc. used by the processor 21. The memory 22 may be composed of a volatile storage medium, a non-volatile storage medium, or a combination thereof.

[0030] The processor 21 realizes the functions of the collation server 20 by reading programs and data from the memory 22 and processing them. The processor 21 may be read as a Central Processing Unit (CPU), a controller, a control unit, etc.

[0031] The storage 23 is composed of a non-volatile storage medium and stores programs, data, etc. used in the collation server 20. Examples of the storage 23 include a Solid State Drive (SSD), a flash memory, and a Hard Disk Drive (HDD).

[0032] The communication I / F 24 is an I / F for the collation server 20 to communicate with other devices by wire or wirelessly.

[0033] The collation server 20 has in the storage 23 a forced breakthrough person face image DB31 that manages the face image of the forced breakthrough person 6C as a database (DB) and a forced breakthrough person body image DB32 that manages the body image of the forced breakthrough person 6C as a DB. The forced breakthrough person face image DB31 and the forced breakthrough person body image DB32 may be one DB. The collation server 20 may also have in the storage 23 a person collation DB in which face images of people who are allowed to pass through the gate are registered in advance. With this, the collation server 20 may collate a face image of a person who is trying to pass through the gate with face images registered in the person collation DB, and if the collation is successful, the collation server 20 may permit the person who is trying to pass through the gate to pass through, and if the collation is unsuccessful, the collation server 20 may refuse the person who is trying to pass through the gate to pass through. Further functions of the collation server 20 will be described later.

[0034] FIG. 3 is a block diagram showing an example of a configuration of the management device 40 according to the first embodiment.

[0035] The management device 40 is a device that detects forced break-in, etc. The management device 40 includes a processor 41, a memory 42, a storage 43, a communication I / F 44, an input I / F 45, and an output I / F 46.

[0036] The memory 42 stores programs, data, and the like used by the processor 41. The memory 42 may be configured with a volatile storage medium, may be configured with a non-volatile storage medium, or may be configured with a combination thereof.

[0037] The processor 41 reads and processes the programs and data from the memory 42 to realize the functions of the management device 40. The processor 41 may be interpreted as a CPU, a controller, a control unit, or the like.

[0038] The storage 43 is configured by a non-volatile storage medium, and stores programs, data, and the like used by the management device 40. Examples of the storage 43 include an SSD, a flash memory, and an HDD.

[0039] The communication I / F 44 is an I / F for the management device 40 to communicate with other devices via wired or wireless communication. The communication I / F 44 may communicate with the gate camera 11, the notification lamp camera 12, the monitoring panel camera 13, and the verification server 20.

[0040] The input I / F 45 is an I / F for connecting an input device to the management device 40. Examples of the input device include a keyboard, a mouse, a touch panel, and a microphone.

[0041] The output I / F 46 is an I / F for connecting an output device to the management device 40. Examples of the output device include the gate display 14, the attendant display 15, a speaker, and a PATLITE (registered trademark).

[0042] The management device 40 has, in the storage 43, a gate photographed image storage section 51, a depth image storage section 52, a notification lamp photographed image storage section 53, a monitoring panel photographed image storage section 54, and a habitual forced break-in offender list 55.

[0043] The management device 40 receives a gate photographed image from the gate camera 11 and stores it in the memory 42 (for example, overwrites it). When a forced breakthrough occurs, the management device 40 stores the gate photographed image stored in the memory 42 in the gate photographed image storage unit 51. The management device 40 receives a depth image from the gate camera 11 and stores it in the memory 42 (for example, overwrites it). When a forced breakthrough occurs, the management device 40 stores the depth image stored in the memory in the depth image storage unit 52. The management device 40 receives a notification lamp photographed image from the notification lamp camera 12 and stores it in the memory 42 (for example, overwrites it). When a forced breakthrough occurs, the management device 40 stores the notification lamp photographed image stored in the memory 42 in the notification lamp photographed image storage unit 53. The management device 40 receives a monitoring panel photographed image from the monitoring panel camera 13 and stores it in the memory 42 (for example, overwrites it). When a forced breakthrough occurs, the management device 40 stores the monitoring panel photographed image stored in the memory 42 in the monitoring panel photographed image storage unit 54. The management device 40 registers a face image or a body image of a habitual forcible break-in perpetrator in a habitual forcible break-in perpetrator list 55. Further functions of the management device will be described later.

[0044] <Flapper opening / closing judgment and breakthrough line> Fig. 4 is a perspective view for explaining the positions of depth measurement point 71 and breakthrough line 81 for flapper 2 according to embodiment 1. Fig. 5 is a side view for explaining the positions of depth measurement point 71 and breakthrough line 81 for flapper 2 according to embodiment 1.

[0045] 4, the management device 40 sets a plurality of depth measurement points 71 in a predetermined range 70 near the hinge 3 of the flapper 2 in the depth image. For example, for the left flapper 2A, the management device 40 sets a plurality of depth measurement points 71 in a predetermined range 70A near the hinge 3A located on the left side, and for the right flapper 2B, the management device 40 sets a plurality of depth measurement points 71 in a predetermined range 70B near the hinge 3B located on the right side. For example, the predetermined range 70 may be on the hinge 3 side of the center point C of the surface of the flapper 2.

[0046] As a result, even if a person 6 is present in front of the flapper 2 in the closed state (i.e., between the gate camera 11 and the flapper 2), the management device 40 can detect the measurement point 71 of the flapper 2 in the closed state from the depth image. For example, even if the person 6 located in front of the flapper 2 is present on the right side, center, or left side of the flapper 2 in the depth image, the management device 40 can measure the depth of any of the measurement points 71 of the flapper 2 in the closed state from the depth image. Also, for example, even if the arm of the person 6 located in front of the flapper 2 is present in the depth image, the management device 40 can measure the depth of any of the measurement points 71 of the flapper 2 in the closed state. If the measurement points are set in a range far from the hinge 3, all the measurement points will be hidden by the person 6 located in front of the flapper 2, and the management device 40 may not be able to detect the measurement points of the flapper 2 in the closed state.

[0047] 5, when the flapper 2 is in the open state, there is a high possibility that a depth 72A (distance to the floor surface 80) of the floor surface 80 is measured at the measurement point 71. Therefore, the management device 40 may determine that the flapper 2 is in the open state when the depth of at least one measurement point 71 is equal to or greater than a predetermined first depth threshold. The first depth threshold may be a value slightly smaller than the depth 72A of the floor surface 80.

[0048] When the flapper 2 is in a closed state, there is a high possibility that the depth 72B of the flapper 2 (the distance to the flapper 2) is measured at the measurement point 71. Therefore, the management device 40 may determine that the flapper 2 is in a closed state when the depth of the measurement point 71 is equal to or greater than a predetermined second depth threshold. The second depth threshold may be a value slightly smaller than the depth 72B of the flapper 2. However, when a person 6 is present in front of the closed flapper 2 (i.e., between the gate camera 11 and the flapper 2), there is a possibility that all or some of the multiple measurement points 71 will be the depth 72C of the passerby, rather than the depth 72B of the flapper 2. Therefore, in order to avoid erroneous determination of the closed state, the management device 40 may determine that the flapper 2 is in the open state when the depths of a predetermined percentage or more of all measurement points 71 are less than the second depth threshold, and may determine that the flapper 2 is in the closed state when the depths of a predetermined percentage or more of all measurement points 71 are greater than or equal to the second depth threshold.

[0049] 4 and 5, the management device 40 sets a virtual breakthrough line 81 on the gate photographed image. The breakthrough line 81 may be set on the floor surface 80 at the same position as the flapper 2. However, the breakthrough line 81 may also be set on the floor surface 80 slightly in front of the flapper 2, or may also be set on the floor surface 80 slightly behind the flapper 2.

[0050] The management device 40 determines whether or not at least a part of the body of the person 6 detected from the gate photographed image crosses the break-through line 81. When the management device 40 determines that the detected person 6 is an unauthorized passerby 6B and that at least a part of the body of the detected person 6 crosses the break-through line 81, the management device 40 may determine that the unauthorized passerby 6B is a forced break-through person 6C. Alternatively, when the management device 40 determines that at least a part of the body of the person 6 detected from the gate photographed image crosses the break-through line 81 even though the flapper is in the closed state, the management device 40 may determine that the person 6 is a forced break-through person 6C.

[0051] <Ticketing and child-carrying judgment> FIG. 6 is a diagram for explaining the tailgating determination and the child-accompanying determination according to the first embodiment.

[0052] The management device 40 detects a person 6 from the gate photographed image and measures the position (three-dimensional coordinates) of the person 6 in three-dimensional space. Using the measured position of the person 6, the management device 40 calculates the distance between two people 6 passing through the gate 1 in a row (hereinafter referred to as the distance between people). If the distance between the people is less than a predetermined distance threshold, the management device 40 determines that there is tailgating, and if the distance between the people is equal to or greater than the distance threshold, the management device 40 determines that there is no tailgating. If the management device 40 determines that there is tailgating, it may determine that the following person 6 is a forced break-through person 6C even if the flapper 2 is in the open state or the notification lamp 4 is in the off state (i.e., a state in which illegal passage has not been determined).

[0053] However, even if it is determined that there is a tailgating, there may be cases where the two people 6 are a parent and child, or a child and an adult accompanying the child, and are not forcibly breaking through 6C. Therefore, when the height difference between the two people 6 determined to be tailgating is greater than a predetermined height difference threshold, the management device 40 may determine that the two people 6 are normal passersby 6A accompanied by a child.

[0054] <Forced Break-through Judgment Processing> FIG. 7 is a flowchart illustrating an example of a forced passage determination process based on the open / closed state of the flapper according to the first embodiment.

[0055] The management device 40 performs a person detection process on the gate photographed image stored in the gate photographed image storage unit 51 (S101).

[0056] The management device 40 determines whether or not a person has been detected from the gate-captured image in step S101 (S102).

[0057] When a person cannot be detected from the gate-captured image (S102: NO), the management device 40 returns the process to step S101.

[0058] If a person is detected from the gate-photographed image (S102: YES), the management device 40 calculates the position of the detected person 6 (hereinafter, referred to as the target person) in three-dimensional space (S103). In addition, the management device 40 tracks the movement of the target person using the multiple gate-photographed images stored in the gate-photographed image storage unit 51.

[0059] The management device determines whether or not at least a part of the target person's body is beyond the breakthrough line 81 by the method described with reference to FIGS. 4 and 5 (S104).

[0060] If at least a part of the target person's body does not cross the breakthrough line 81 (S104: NO), the management device 40 returns the process to step S103.

[0061] If at least a part of the target person's body is beyond the breakthrough line 81 (S104: YES), the management device 40 executes a flapper open / close determination process (S105). The flapper open / close determination process will be described in detail later (see FIG. 9).

[0062] The management device 40 determines whether or not the flapper 2 is in the closed state based on the processing result of step S105 (S106).

[0063] When it is determined that the flapper 2 is in the closed state (S106: YES), the management device 40 determines that the target person is the forced break-through person 6C (S107). Then, the management device 40 advances the process to step S111.

[0064] When it is determined that the flapper 2 is in the open state (S106: NO), the management device 40 determines whether or not the target person is accompanied by another person by the method described with reference to FIG. 6 (S108).

[0065] When it is determined that there is no tailgating (S108: NO), the management device 40 determines that the target person is a normal passerby 6A (S110), and returns the process to step S101.

[0066] When it is determined that there is a tailgating person (S108: YES), the management device 40 determines whether or not the two people determined to be tailgating people are accompanied by a child, using the method described with reference to FIG. 6 (S109).

[0067] If it is determined that the two people are accompanied by a child (S109: YES), the management device 40 determines that the target persons are normal passersby 6A (S110), and returns the process to step S101.

[0068] When it is determined that the two people are not accompanied by a child (S109: NO), the management device 40 determines that the person following the target person is the forcible breakthrough person 6C (S107).

[0069] In addition, the management device 40 may execute a tailgating determination process and a child-accompanied determination process for a person passing through the gate as separate processes, and in the above steps S108 and / or S109, the determination results of the separate processes may be used to determine whether or not there is a tailgating person and / or whether or not the two tailgating people are accompanied by children.

[0070] The management device 40 registers the face image and body image of the person 6 determined to be the forced breakthrough person 6C in step S107 in the forced breakthrough person face image DB 31 and the forced breakthrough person body image DB 32 of the collation server 20, respectively (S111). Furthermore, the management device 40 may store in the storage 43 the gate photographed image at the time when the forced breakthrough person 6C crosses the breakthrough line 81, and one or more gate photographed images before and after that time. Then, the management device 40 returns the process to step S101.

[0071] Note that steps S108 and S109 may be omitted. In this case, when the management device 40 determines in step S106 that the flapper 2 is in the open state (S106: NO), the management device 40 may proceed to the process in step S110 and determine that the target person is a normal passerby 6A.

[0072] This allows the management device 40 to detect the forced breakthrough person 6C and register a face image and a body image of the forced breakthrough person 6C in the DB. In addition, the management device 40 can store a gate photographed image that serves as evidence that the forced breakthrough person 6C has crossed the breakthrough line 81.

[0073] FIG. 8 is a flowchart showing an example of a forced entry determination process based on the notification lamp 4 and the monitoring panel 5 according to the first embodiment.

[0074] The management device 40 performs the same processes as steps S101 to S104 described with reference to FIG. 7 (S201 to S204).

[0075] The management device 40 judges whether the notification lamp 4 is on or whether the detection of an unauthorized passerby 6B is displayed on the monitoring panel 5 (S205). The management device 40 may analyze the notification lamp photographed image stored in the notification lamp photographed image storage unit 53 to judge whether the notification lamp 4 is on or not. The management device 40 may analyze the monitoring panel photographed image stored in the monitoring panel photographed image storage unit 54 to judge whether the detection of an unauthorized passerby 6B is displayed on the display of the monitoring panel 5.

[0076] If the notification lamp 4 is off and the detection of the unauthorized passerby 6B is not displayed on the monitoring panel 5 (S205: NO), the management device 40 returns the process to step S201.

[0077] If the notification lamp 4 is on or the monitoring panel 5 displays the detection of an unauthorized passerby (S205: YES), the management device 40 determines that the target person is a forced break-through person 6C (S206).

[0078] The management device 40 registers the face image and body image of the target person determined to be the forced breakthrough person 6C in step S206 in the forced breakthrough person face image DB 31 and the forced breakthrough person body image DB 32 of the collation server 20, respectively (S207). Furthermore, the management device 40 may store in the storage 43 the gate photographed image at the time when the forced breakthrough person 6C crosses the breakthrough line 81, and one or more gate photographed images before and after that time. Then, the management device 40 returns the process to step S201.

[0079] In addition, although the case of monitoring both the notification lamp 4 and the monitoring panel 5 has been described in Fig. 8, the management device 40 may monitor either the notification lamp 4 or the monitoring panel 5. In addition, the management device 40 may implement both the process shown in Fig. 7 and the process shown in Fig. 8, or may implement either the process shown in Fig. 7 or the process shown in Fig. 8.

[0080] <Flapper open / close determination process> Fig. 9 is a flowchart showing an example of a flapper open / close determination process according to embodiment 1. This process corresponds to details of step S105 in Fig. 7, and corresponds to the method described with reference to Figs.

[0081] The management device 40 measures the depth of each measurement point 71 on the flapper 2 from the depth image by the method described with reference to FIGS. 4 and 5 (S301).

[0082] The management device 40 determines whether the depth of at least one measurement point 71 is equal to or greater than the first depth threshold (S302).

[0083] When the depth of at least one measurement point 71 is equal to or greater than the first depth threshold (S302: YES), the management device 40 determines that the flapper 2 is in the open state (S303).

[0084] If the depths of all measurement points 71 are less than the first depth threshold (S302: NO), the management device 40 determines whether the depths of a predetermined percentage or more of all measurement points 71 are less than the second depth threshold (S304).

[0085] If the depths of a predetermined proportion or more of all the measurement points 71 are less than the second depth threshold (S304: YES), the management device 40 determines that the flapper 2 is in the open state (S303).

[0086] If the depths of a predetermined proportion or more of all the measurement points 71 are equal to or greater than the second depth threshold (S304: NO), the management device 40 determines that the flapper 2 is in the closed state (S305).

[0087] After the process of step S303 or step S305, the management device 40 returns to the process of step S105 and subsequent steps in FIG.

[0088] <Processing Records of Repeat Break-In Violators> FIG. 10 is a flowchart illustrating an example of a forced break-in habitual offender recording process according to the first embodiment.

[0089] The management device 40 determines whether or not a face image of a target person has been detected from an image captured by the gate (S401).

[0090] When a facial image of the target person can be detected from the gate-captured image (S401: YES), the management device 40 stores the facial image in the memory 42 (S402). Note that since the target person is photographed and recorded in a plurality of gate-captured images (e.g., video frames) continuously captured from the timing of entering a predetermined area (e.g., the timing of crossing the authentication start line in FIG. 6), if the management device 40 can detect the facial image of the target person from any of the plurality of gate-captured images, the management device 40 may store the facial image in the memory 42.

[0091] The management device 40 determines whether or not the target person is the forced break-in person 6C by the forced break-in determination process described with reference to FIG. 7 and FIG. 8 (S403).

[0092] If the target person is not the forced break-through person 6C (S403: NO), the management device 40 returns the process to step S401.

[0093] If the target person is a forced breakthrough person (S403: YES), the management device 40 requests the matching server 20 to search the forced breakthrough person face image DB 31 for a face image that matches the face image stored in the memory 42 in step S402. The matching server 20 receives the request, searches the forced breakthrough person face image DB for a matching face image, and responds to the management device 40 with the number of matches (S404).

[0094] The management device 40 determines whether the number of matches is N or more (S405). N is an integer equal to or greater than 1 and is set in advance. In other words, the management device 40 determines whether the target person (the person who forced their way through) has forced their way through N or more times in the past.

[0095] If the number of matches is less than N (S405: NO), the management device 40 advances the process to step S408.

[0096] If the number of matches is equal to or greater than N (S405: YES), the management device 40 registers the face image stored in the memory 42 in step S402 in the forced break-in habitual offender list 55 (S406).

[0097] The management device 40 displays on the staff display 15 that a habitual forced break-in has appeared, and also displays the facial image stored in the memory 42 in step S402 (S407). This allows the staff 7 to know from the display on the staff display 15 that a habitual forced break-in has appeared and the facial features of the habitual forced break-in.

[0098] In step S408, the management device 40 registers the face image stored in step S402 in the forced breakthrough person face image DB 31 of the matching server 20 (S408). Then, the management device 40 returns the process to step S401.

[0099] On the other hand, in step S401, if a face image of the target person cannot be detected from the gate-captured image (S401: NO), the management device 40 determines whether a body image of the target person can be detected from the gate-captured image (S421).

[0100] When a body image of the target person cannot be detected from the gate-photographed image (S421: NO), the management device 40 returns the process to step S401.

[0101] If a body image of the target person can be detected from the gate-photographed image (S421: YES), the management device 40 stores the body image in the memory 42 (S422).

[0102] The management device 40 determines whether or not the target person is the forced break-in person 6C by the forced break-in determination process described with reference to FIG. 7 and FIG. 8 (S423).

[0103] If the target person is not the forced break-through person 6C (S423: NO), the management device 40 returns the process to step S401.

[0104] If the target person is the forced breakthrough person 6C (S423: YES), the management device 40 requests the matching server 20 to search the forced breakthrough person body image DB 32 for a body image that matches the body image stored in the memory 42 in step S422. The matching server 20 receives the request, searches the forced breakthrough person body image DB 32 for a matching body image, and responds to the management device 40 with the number of matches (S424).

[0105] The management device 40 determines whether the number of matches is N or more (S425). N is an integer equal to or greater than 1 and is set in advance. That is, the management device 40 determines whether the target person has forced their way through N or more times in the past. Note that the value of N in step S405 and the value of N in step S425 may be the same or different.

[0106] If the number of matches is less than N (S425: NO), the management device 40 advances the process to step S428.

[0107] If the number of matches is equal to or greater than N (S425: YES), the management device 40 registers the body image stored in the memory 42 in step S422 in the forced break-in habitual offender list 55 (S426).

[0108] The management device 40 displays on the attendant display 15 that a habitual forcible break-in has appeared, and also displays the body image stored in the memory 42 in step S422 (S427). This allows the attendant 7 to know from the display on the attendant display 15 that a habitual forcible break-in has appeared and the physical characteristics (including body type, clothing, etc.) of the habitual forcible break-in.

[0109] In step S428, the management device 40 registers the body image stored in the memory 42 in step S422 in the forced breakthrough person body image DB 32 of the matching server 20 (S428). Then, the management device 40 returns the process to step S401.

[0110] Through the above process, the management device 40 can notify the staff member 7 of the appearance of a habitual forcible break-in offender and the facial or physical features of that habitual forcible break-in offender.

[0111] <Notification of forced break-in occurrence> Fig. 11 is a flow chart showing an example of a forced break-in occurrence notification process according to embodiment 1. Fig. 12 is a diagram showing a display example of the gate display 14 according to embodiment 1. Fig. 12(a) is a display example of the gate display 14 when a forced break-in person 6C has not appeared, and Fig. 12(b) is a display example of the gate display 14 when a forced break-in person 6C has appeared.

[0112] 12(a), the management device 40 displays on the gate display 14 a gate photographed image and information indicating that monitoring is being performed, such as "live monitoring in progress" (S501). This makes it possible to inform the person 6 that the gate 1 is being monitored, and psychologically discourages the person 6 from forcing his or her way through.

[0113] The management device 40 determines whether or not a forced break-in has occurred (S502) by the forced break-in determination process described with reference to Fig. 7 and Fig. 8. If a forced break-in has not occurred (S502: NO), the management device 40 returns the process to step S501.

[0114] If a forced breakthrough occurs (S502: YES), the management device 40 displays on the gate display 14 a gate photographed image and information that implicitly indicates the appearance of a forced breakthrough person 6C, such as "Please contact an official" with a high color contrast, as shown in FIG. 12(b). Then, the management device 40 returns the process to step S501. This makes it possible to implicitly inform the official 7 and the person 6 that a forced breakthrough has occurred, and allows the official 7 to respond quickly.

[0115] If a forced breakthrough occurs (i.e., if step S502 is YES), the management device 40 may notify the staff member 7 or the like that the forced breakthrough person 6C has appeared by outputting a loud sound from a speaker or turning on or blinking a Patlite (registered trademark). Also, if a forced breakthrough occurs (i.e., if step S502 is YES), the management device 40 may display a facial image of the forced breakthrough person 6C on the gate display 14.

[0116] Summary of the Disclosure The above description of the first embodiment discloses the following techniques.

[0117] <Technology 1> A forced-through detection system (10) for detecting forced-through of a gate (1) in accordance with embodiment 1 includes a gate camera (11) for photographing a person passing through the gate and generating a gate photographed image, and a management device (40). When a person (6) included in the gate photographed image is not permitted to pass through the gate and the person crosses a predetermined breakthrough line (81) for the gate photographed image, the management device determines that the person has forced-through the gate. This allows the management device to detect a person who has forced their way through the gate.

[0118] <Technology 2> In the forced break-in detection system described in Technology 1, the gate is equipped with an openable and closable flapper (2), the gate camera measures the depth related to the flapper to generate a depth image, and the management device uses the depth image to determine whether the flapper is open or closed, and if the flapper is in a closed state, determines that the person is not permitted to pass through the gate. This allows the management device to detect a person who has forced their way through the gate even though the flapper is in the closed state.

[0119] <Technology 3> In the forced break-in detection system described in Technology 2, the management device uses the depth image to determine whether the depth of at least one measurement point (71) of the multiple measurement points related to the flapper is greater than or equal to a predetermined first depth threshold, and if the depth of at least one measurement point of the multiple measurement points related to the flapper is greater than or equal to the first depth threshold, it determines that the flapper is in an open state. This allows the management device to use the depth image to determine whether or not the flapper is in an open state.

[0120] <Technology 4> In the forced break-in detection system described in Technology 3, the management device determines that the flapper is in an open state if the depths of all of the multiple measurement points related to the flapper are less than the first depth threshold, and the depths of a predetermined percentage of the multiple measurement points are less than a predetermined second depth threshold that is smaller than the first depth threshold. This allows the management device to use the depth image to determine whether or not the flapper is in an open state.

[0121] <Technology 5> In the forced break-in detection system described in Technology 4, the management device determines that the flapper is in a closed state if the depths of all of the multiple measurement points related to the flapper are less than the first depth threshold and the depths of a predetermined percentage of the multiple measurement points are greater than or equal to a predetermined second depth threshold. This allows the management device to use the depth image to determine whether or not the flapper is in a closed state.

[0122] <Technology 6> In the forced entry detection system described in any one of Techniques 3 to 5, the plurality of measurement points are set on the hinge side of the flapper relative to the center of the surface of the flapper in a closed state. This allows the management device to suppress erroneous determination of the open / closed state of the flapper.

[0123] <Technology 7> The forced entry detection system described in any one of Techniques 1 to 6 further includes a notification lamp camera (12) that captures an image of a notification lamp (4) that notifies the person by its illumination state whether or not the person is permitted to pass through the gate, and the management device determines whether or not the person is permitted to pass through the gate based on the illumination state of the notification lamp contained in the notification lamp captured image taken by the notification lamp camera. This allows the management device to determine whether or not a person is permitted to pass through the gate, based on the state of the notification lamp.

[0124] <Technology 8> The forced break-in detection system described in any one of Techniques 1 to 7 further includes a monitoring panel camera (13) that captures an image of a display of a monitoring panel (5) that displays information indicating whether or not the person is permitted to pass through the gate, and the management device determines whether or not the person is permitted to pass through the gate based on information on the monitoring panel image captured by the monitoring panel camera. This allows the management device to determine whether or not a person is permitted to pass through the gate based on the information displayed on the monitoring panel.

[0125] <Technology 9> In the forced break-in detection system described in any one of Techniques 1 to 8, if there are a predetermined number of images matching the image taken of the person determined to have made a forced break-in this time in a database in which images of people determined to have made a forced break-in in the past are registered, the management device determines that the person determined to have made a forced break-in this time is a habitual forced break-in perpetrator. This enables the management device to determine whether or not the person who forced their way through is a repeat offender.

[0126] <Technology 10> In the forced break-in detection system described in Technology 9, if the management device can detect a facial image of the person determined to have made a forced break-in from the gate photographed image, it searches the database for an image that matches the facial image, and if the management device cannot detect a facial image of the person determined to have made a forced break-in from the gate photographed image but can detect a body image of the person, it searches the database for an image that matches the body image. This allows the management device to use the face image or body image of the person to determine whether the person who forced their way through is a habitual offender.

[0127] <Technology 11> In the forced break-through detection system described in any one of Techniques 2 to 10, the management device determines that the second person has forced their way through the gate when the flapper is in an open state, the distance between a first person and a second person included in the gate photographed image is less than a predetermined distance threshold, and the first person is beyond the break-through line. This enables the management device to detect someone forcing their way through by tailgating.

[0128] <Technology 12> In the forced break-in detection system described in any one of Techniques 2 to 10, when the flapper is in an open state, the distance between a first person and a second person included in the gate photographed image is less than a predetermined distance threshold, and the first person is beyond the break-in line, the management device determines that the first person and the second person are tailgated, and when the height difference between the first person determined to be tailgated and the second person is equal to or greater than a predetermined height difference threshold, it determines that the second person has forced their way through the gate. As a result, the management device does not determine that a parent and child are forced entry even if they are tailgated, but determines that a parent and child are forced entry if they are tailgated but not accompanied by a parent and child.

[0129] <Technology 13> In the forced break-through detection system described in any one of Techniques 1 to 12, when a person who has forced their way through the gate is not detected, the management device displays a photographed image of the gate on a display installed so as to be visible to people passing through the gate, and when a person who has forced their way through the gate is detected, displays information on the display indicating that a person who has forced their way through the gate has been detected. This makes it possible to inform people passing through the gate that the gate is being monitored, which has the effect of deterring forced break-ins. It also makes it possible to inform people passing through the gate and staff that a forced break-in has occurred.

[0130] <Technology 14> In the forced break-in detection system according to any one of the first to thirteenth aspects, the management device stores the gate photographed image in which a person determined to have forced a break-in crosses the break-in line. This allows the management device to store the captured image of the person who forced their way through.

[0131] <Technology 15> A forced-through detection device (e.g., a management device (40)) for detecting forced-through of a gate (1) in accordance with the first embodiment includes a processor (41) and a memory (42), and the processor, in cooperation with the memory, determines that a person included in a gate photographed image of a person passing through the gate is not permitted to pass through the gate and that the person has crossed a predetermined breakthrough line for the gate photographed image, has forced-through the gate. This allows the forced break-in detection device to detect a person who has forced their way through the gate.

[0132] <Technology 16> In the forced break-through detection method of this embodiment 1 for detecting forced break-through of a gate (1), a gate camera photographs a person passing through the gate and generates a gate photographed image, and a management device determines that a person included in the gate photographed image is not permitted to pass through the gate and the person crosses a predetermined break-through line for the gate photographed image, and determines that the person has forced through the gate. This allows the forced break-in detection method to detect a person who has forced their way through the gate.

[0133] <Technology 17> The forced breakthrough detection program for detecting forced breakthrough of a gate (1) in this embodiment 1 causes a computer to execute the following: if a person included in a gate photographed image of a person passing through the gate is not permitted to pass through the gate, and if the person crosses a breakthrough line that is preset for the gate photographed image, the computer determines that the person has forced breakthrough through the gate. This allows the computer executing the forced break-in detection program to detect a person who has forced their way through the gate.

[0134] Although the embodiments have been described above with reference to the accompanying drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications, corrections, substitutions, additions, deletions, and equivalents within the scope of the claims, and it is understood that these also belong to the technical scope of the present disclosure. In addition, the components in the above-mentioned embodiments may be arbitrarily combined within the scope of the invention. [Industrial Applicability]

[0135] The technology disclosed herein is useful for detecting people forcing their way through a gate and for preventing such forcing. [Explanation of symbols]

[0136] 1 Gate 2,2A,2B Flapper 3,3A,3B Hinge 4 Notification light 5 Monitoring board 6 people 6A Normal passerby 6B Illegal passerby 6C Forced breakthrough 7. Staff 10. Break-in Detection System 11 Gate Camera 12 Notification light camera 13 Surveillance panel camera 14 Gate Display 15 Staff Display 20 Matching Server 21 Processors 22 Memory 23. Storage 24 Communication I / F 31 Face image database of people who forced their way through 32 Forced breakthrough person body image DB 40 Management device 41 Processors 42 Memory 43 Storage 44 Communication I / F 45 Input I / F 46 Output I / F 51 Gate image storage unit 52 Depth image storage unit 53 Notification lamp capture image storage section 54 Monitoring panel image storage section 55 List of Frequent Breakthroughs 70 range 71 measurement points 72A,72B,72C depth 80 Floor 81 Breakthrough Line N Communication Network

Claims

1. 1. A forced entry detection system for detecting forced entry of a gate, comprising: a gate camera that captures an image of a person passing through the gate and generates a captured image of the gate; A management device, The management device includes: When a person included in the gate photographed image is not permitted to pass through the gate and the person crosses a predetermined breakthrough line in the gate photographed image, it is determined that the person has forced their way through the gate. Forced-break-in detection system.

2. The gate includes a flapper that can be opened and closed. The gate camera measures a depth relative to the flapper to generate a depth image; The management device includes: Using the depth image, determine whether the flapper is open or closed; If the flapper is in a closed state, it is determined that the person is not authorized to pass through the gate. The forced entry detection system of claim 1 .

3. The management device includes: using the depth image to determine whether a depth of at least one of a plurality of measurement points on the flapper is greater than or equal to a first predetermined depth threshold; determining that the flapper is in an open state when a depth of at least one of a plurality of measurement points related to the flapper is equal to or greater than the first depth threshold; The forced entry detection system of claim 2 .

4. the management device determines that the flapper is in an open state when the depths of all of a plurality of measurement points related to the flapper are less than the first depth threshold, and the depths of a predetermined percentage of the plurality of measurement points are less than a predetermined second depth threshold that is smaller than the first depth threshold. The forced entry detection system of claim 3.

5. the management device determines that the flapper is in a closed state when all depths of a plurality of measurement points related to the flapper are less than the first depth threshold and the depths of a predetermined percentage of the plurality of measurement points are equal to or greater than a predetermined second depth threshold. The forced entry detection system of claim 4.

6. the plurality of measurement points are set on a hinge side of the flapper from a center of a surface of the flapper in a closed state; A forced entry detection system according to any one of claims 3 to 5.

7. a notification lamp camera for photographing a notification lamp that notifies the person whether or not the person is permitted to pass through the gate by lighting the notification lamp, The management device includes: determining whether or not the person is permitted to pass through the gate based on a lighting state of the notification lamp included in a notification lamp photographed image photographed by the notification lamp camera; The forced entry detection system of claim 1 .

8. a monitor camera for capturing an image of a monitor display showing information indicating whether the person is permitted to pass through the gate; The management device includes: determining whether or not the person is permitted to pass through the gate based on information of a monitoring panel photographed image captured by the monitoring panel camera; The forced entry detection system of claim 1 .

9. The management device includes: If there are a predetermined number of images matching the image of the person determined to have made a forced break-in this time in a database in which images of people determined to have made a forced break-in in the past are registered, the person determined to have made a forced break-in this time is determined to be a habitual perpetrator of forced break-ins. The forced entry detection system of claim 1 .

10. The management device includes: When a facial image of the person determined to have forced their way through the gate is detected from the captured image of the gate, an image matching the facial image is searched for in the database; If a face image of the person determined to have forced their way through the gate cannot be detected from the gate photographed image, but a body image of the person can be detected, an image matching the body image is searched for in the database. The force-breaking detection system of claim 9.

11. The management device includes: when the flapper is in an open state, the distance between a first person and a second person included in the gate photographed image is less than a predetermined distance threshold, and the first person is beyond the break-through line, it is determined that the second person has forced their way through the gate. The forced entry detection system of claim 2 .

12. The management device includes: when the flapper is in an open state, the distance between a first person and a second person included in the gate photographed image is less than a predetermined distance threshold, and the first person is beyond the breakthrough line, it is determined that the first person and the second person are tailgated; if a height difference between the first person and the second person determined to be tailgated is equal to or greater than a predetermined height difference threshold, it is determined that the second person has forced their way through the gate. The forced entry detection system of claim 2 .

13. The management device includes: If no person is detected as having forced their way through the gate, the captured image of the gate is displayed on a display that is installed so as to be visible to people passing through the gate; when a person who has forced their way through the gate is detected, displaying information on the display indicating that a person who has forced their way through the gate has been detected. The forced entry detection system of claim 1 .

14. The management device includes: save the gate photographed image in which the person who is determined to have forced his way through crosses the breakthrough line; The forced entry detection system of claim 1 .

15. A forced entry detection device for detecting forced entry of a gate, the device comprising: a processor and a memory, The processor, in cooperation with the memory, When a person included in a gate photographed image of a person passing through the gate is not permitted to pass through the gate and the person crosses a breakthrough line set in advance for the gate photographed image, it is determined that the person has forced their way through the gate. Forced break-in detection device.

16. 1. A method for detecting forced entry of a gate, comprising: The gate camera photographs a person passing through the gate and generates a gate photographed image; a management device that, when a person included in the gate photographed image is not permitted to pass through the gate and the person crosses a breakthrough line that is set in advance for the gate photographed image, determines that the person has forced their way through the gate; Break-through detection methods.

17. A forced-through detection program for detecting a forced-through of a gate, comprising: When a person included in a gate photographed image of a person passing through the gate is not permitted to pass through the gate and the person crosses a breakthrough line set in advance for the gate photographed image, it is determined that the person has forced their way through the gate. The unauthorized intrusion detection program causes a computer to execute the following:

Images