False detection determination device, method, and program

Abstract

To provide an erroneous detection determination device, a method, and a program for determining whether an object other than a person has been erroneously detected.SOLUTION: In an erroneous detection determination system in which an erroneous detection determination device 10 obtains an image captured by an imaging device via a network or storage medium, the erroneous detection determination device includes: an image acquisition unit that obtains a plurality of images; an object detection unit that detects an object like a person in the images; a halation determination unit that determines presence of halation in an area where the object has been detected in the image where the object has been detected; a movement determination unit that when there is halation, determines whether movement of the object is that of a person; and an erroneous detection determination unit that if it is determined that the movement of the object is not that of a person, determines the detection of the object is an erroneous detection.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an apparatus, method, and program for determining erroneous detection. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is known a technique for detecting an intruder by using a security or surveillance camera to detect a person who has invaded an office, a residence, a vehicle, or the like.

[0003] Patent Document 1 discloses a human detection technology in which the shape and size of a bounding box of a human body candidate detected from a fisheye image obtained by a fisheye camera are compared with predetermined shape and size standards. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-107070 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, intruders in images captured by security and surveillance cameras may have parts of their bodies hidden (i.e., only parts of their bodies can be identified) or may be in various postures (for example, they may not only be standing, but also crouching or crawling). Therefore, when detecting intruders in security and surveillance camera images, there is a possibility that objects other than people in the images will be mistakenly detected when dealing with the shape and size of the bounding box.

[0006] Furthermore, when the technology described in Patent Document 1 is combined with a night vision camera for nighttime surveillance, images of people taken at night resemble whiteout caused by insects or other objects approaching the camera lens, and whiteout caused by insects or other objects may be mistakenly detected as people.

[0007] Therefore, an object of the present invention is to determine whether or not an object other than a human has been erroneously detected in a system that detects an intruder from an image captured at night. [Means for solving the problem]

[0008] An erroneous detection determination device according to one embodiment of the present invention comprises an image acquisition unit that acquires a plurality of images, an object detection unit that detects a human-like object within the images, a blown-out highlight determination unit that determines whether or not there is blown-out highlight in the area in the image in which the object is detected, a motion determination unit that, when blown-out highlight is present, determines whether the movement of the object is human movement, and an erroneous detection determination unit that, when it is determined that the movement of the object is not human movement, determines that the detection of the object is an erroneous detection. Effect of the Invention

[0009] According to the present invention, it is possible to determine whether or not an object other than a human has been erroneously detected. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram for explaining an overview according to one embodiment of the present invention. [Diagram 2] 1 is a diagram showing an overall system configuration according to an embodiment of the present invention; [Diagram 3] 1 is a functional block diagram of an erroneous detection determination device according to an embodiment of the present invention; [Figure 4] 11 is a flowchart of an erroneous detection determination process according to an embodiment of the present invention. [Diagram 5] 11 is a flowchart of an insect movement determination process according to an embodiment of the present invention. [Figure 6] 11 is a flowchart of a human movement determination process according to an embodiment of the present invention. [Figure 7] FIG. 13 is a diagram for explaining determination of insect movement according to one embodiment of the present invention. [Figure 8]1 is a diagram for explaining a determination of a person's movement according to an embodiment of the present invention; [Figure 9] 1 is a block diagram showing an example of a hardware configuration of an erroneous detection determination device according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0012] This specification describes an embodiment in which an infrared camera equipped with infrared lighting (hereinafter simply referred to as an "infrared camera") is used at night to detect intruders, in which overexposure caused by insects is erroneously detected as a person; however, the present invention can also be applied to overexposure caused by small animals other than insects (any object other than a person will do).

[0013] 1 is a diagram for explaining an overview according to one embodiment of the present invention. In one embodiment of the present invention, when a human-like object (specifically, an object with a size and shape that is assumed to be a human) is detected in an image captured by an infrared camera installed in a monitoring area, it is possible to determine whether the object has not been erroneously detected (i.e., is a human) or not (i.e., is not a human) depending on whether there is blown-out highlights in the area where the object was detected.

[0014] In step 1 (S1), an image is captured by an infrared camera.

[0015] In step 2 (S2), it is assumed that a human-like object (specifically, an object with a size and shape that is assumed to be a human) is detected in the image of S1.

[0016] In step 3 (S3), it is determined whether the detection score of S2 (specifically, the detection confidence level) is greater or smaller than a threshold. If it is greater than the threshold, the process proceeds to step 8, where it is determined that the object detected in S2 is a person (i.e., not a false detection). If it is less than the threshold, the process proceeds to step 4.

[0017] In step 4 (S4), it is determined whether or not there is whiteout in the area where the object was detected in the image in which the object was detected in S2. If there is no whiteout, the process proceeds to step 6. If there is whiteout, the process proceeds to step 5.

[0018] In step 5 (S5), it is determined whether the object detected in S2 has any insect-like movement (whether it is an insect-like movement or not). If there is any insect-like movement, the process proceeds to S9, and the detection of the human-like object in S2 is determined to be a false detection. If there is no insect-like movement, the process proceeds to step 6.

[0019] In step 6 (S6), it is determined whether the human-like object detected in S2 is moving. If there is movement, the process proceeds to S8, where the object detected in S2 is determined to be a human. If there is no movement, the process proceeds to S7, where the object detected in S2 is determined to be not a human.

[0020] Fig. 2 is a diagram showing the overall system configuration according to one embodiment of the present invention. As shown in Fig. 2, the false detection determination system 1 includes an false detection determination device 10 and an imaging device 20, which is an infrared camera. The false detection determination device 10 can acquire images captured by the imaging device 20 via any network or storage medium. Each of these will be described below.

[0021] When an object (specifically, an object having a size and shape that is assumed to be a person) is detected in an image captured by the imaging device 20, the false detection determination device 10 determines whether the object is not a false detection (i.e., it is a person) or whether it is a false detection (i.e., it is not a person). The false detection determination device 10 is a computer such as a server. The false detection determination device 10 will be described in detail later with reference to FIG. 3.

[0022] The imaging device 20 is an infrared camera such as a security or surveillance camera that captures an image of a person who has invaded an office, a residence, a car, or the like. For example, when an intruder detection unit (not shown) such as an infrared sensor detects an object, the imaging device 20 records an image captured several seconds before and after the detection in an internal memory (not shown) and transmits the image to the erroneous detection determination device 10. The infrared sensor or the like may be installed separately from the imaging device 20, and when the infrared sensor or the like detects an object, the imaging device 20 may be linked to capture an image of the target area. In addition, when the infrared sensor or the like transmits a detection signal to the erroneous detection determination device 10, the erroneous detection determination device 10 may request the imaging device 20 to transmit the captured image to itself according to the content of the detection signal.

[0023] Fig. 3 is a functional block diagram of an error detection determination device 10 according to an embodiment of the present invention. As shown in Fig. 3, the error detection determination device 10 can include an image acquisition unit 101, an object detection unit 102, a detection score determination unit 103, a highlight determination unit 104, an insect movement determination unit 105 (having a similarity calculation unit 151 and a determination unit 152), a human movement determination unit 106 (having a similarity calculation unit 161 and a determination unit 162), and an error detection determination unit 107. The insect movement determination unit 105 and the human movement determination unit 106 are also collectively referred to as a movement determination unit. In addition, by executing a program, the false detection determination device 10 can function as an image acquisition unit 101, an object detection unit 102, a detection score determination unit 103, a blown out highlight determination unit 104, an insect movement determination unit 105 (having a similarity calculation unit 151 and a determination unit 152), a human movement determination unit 106 (having a similarity calculation unit 161 and a determination unit 162), and a false detection determination unit 107.

[0024] The image acquiring unit 101 acquires a plurality of images (i.e., a video consisting of a plurality of frames (still images)) captured by the imaging device 20. Alternatively, the image acquiring unit 101 may receive a detection signal from the above-mentioned infrared sensor or the like, and request the imaging device 20 to transmit the captured images to itself according to the contents of the detection signal, and acquire the plurality of images transmitted by the imaging device 20 according to the request.

[0025] Object detection unit 102 detects an object (specifically, a body part or the entire body assumed to be a person) in each of the multiple images (i.e., each frame) acquired by image acquisition unit 101. Object detection unit 102 stores coordinate information of an area (e.g., a rectangle) in which an object is detected in an image, and a detection score (detection reliability) in a memory or the like (not shown) in false detection determination device 10. Hereinafter, an image (frame) in which object detection unit 102 detects an object is also referred to as an object detection image, and an area in which an object is detected in an object detection image is also referred to as an object detection area.

[0026] For example, the object detection unit 102 can detect an object in an image by machine learning such as deep learning. Specifically, the object detection unit 102 inputs an image into a trained model that has previously trained images of the entire and partial human body using a neural network or the like, detects any object that is assumed to be a person in the image, and outputs the object detection area in the image and the detection score (detection reliability). Here, "detection of people and objects using anchor boxes" is shown as an example. For example, in object detection methods such as "Single Shot Multibox Detector (SSD)", "M2Det", and "Faster R-CNN", anchor boxes with multiple aspect ratios are applied to each cell of a feature map obtained by inputting an image, and candidates for "human rectangles" and "human detection scores" are obtained. After that, NMS (Non-Maximum Suppression) is applied, and if the overlap of the "human rectangles" is equal to or greater than a certain level, only rectangles with high "human detection scores" are left and output. There are various methods for human and object detection, but any method can be used as long as it outputs a "human rectangle (object detection area)" and a "human detection score."

[0027] Note that an object may be detected in one or more images (frames).

[0028] The detection score determination unit 103 determines whether or not the score of the detection by the object detection unit 102 (detection reliability (indicating the accuracy of prediction / output by machine learning)) is smaller than a threshold value.

[0029] The blown-out highlight determination unit 104 determines whether or not there is blown-out highlight in an image in which an object has been detected. Specifically, the blown-out highlight determination unit 104 calculates the ratio of pixels whose brightness pixel value is a predetermined value (e.g., 250) or more among all pixels in an area (e.g., a rectangle) containing an object. The blown-out highlight determination unit 104 determines that there is blown-out highlight if the ratio of the number of pixels whose brightness pixel value is a predetermined value (e.g., 250) or more to the total number of pixels (number of pixels in width x number of pixels in height) is a predetermined numerical value (e.g., 20 percent) or more.

[0030] The insect movement determination unit 105 determines whether or not there is movement of the object detected by the object detection unit 102 (whether or not it is movement of something other than a human, such as an insect). Specifically, the insect movement determination unit 105 determines whether or not there is movement of the object based on whether or not the object detection image (the frame at time t where a human-like object is detected) is similar to the images before and after it (the frame at time t-1 and the frame at time t+1). Below, the insect movement determination unit 105 will be explained separately as a similarity calculation unit 151 and a determination unit 152.

[0031] Similarity calculation unit 151 calculates the similarity between the object detection image (a frame at time t in which a human-like object was detected) and the images before and after it (a frame at time t-1 and a frame at time t+1). Specifically, similarity calculation unit 151 compares an area (e.g., a rectangle) that includes an object in the object detection image with areas (e.g., rectangles) in the images before and after the object detection image that have the same coordinate positions as the area in the object detection image.

[0032] In addition, when a human-like object is detected in multiple images (frames), the similarity calculation unit 151 calculates the similarity between each object detection image and the images before and after it (i.e., the frames before and after it included in the video).

[0033] <<Calculating Similarity>> Here, the calculation of the similarity will be described in detail. For example, the similarity calculation unit 151 can use a method of ZNCC (Zero-mean Normalized Cross Correlation). For example, it is assumed that the similarity between a rectangle of M pixels x N pixels including an object and a rectangle of M pixels x N pixels in the previous and next images is calculated. The pixels (T(i,j) and I(i,j)) at the same coordinates of the two rectangles are used. The similarity calculation unit 151 calculates the similarity by:

[0034]

number

[0035]

number

[0036]

number

[0037]

number

[0038] The similarity is not limited to the ZNCC method, but may be calculated by any template matching method such as NCC (Normalized Cross-Correlation), SSD (Sum of Squared Difference), or SAD (Sum of Absolute Difference).

[0039] For each object detection region in an object detection image in which the object detection unit 102 detects an object, the determination unit 152 calculates the similarity between regions at the same coordinate position as the object detection region in the previous and next images, and determines whether or not at least one of the similarities is equal to or less than a threshold. Specifically, the determination unit 152 determines that there is object movement when the similarity of at least one of the previous and next images for at least one object detection image is equal to or less than a threshold. The determination unit 152 determines that there is no object movement when the similarity of none of the previous and next images is equal to or less than a threshold in all object detection images. This utilizes the characteristics of a situation in which an insect is photographed at a position close to the camera. The photographing interval between each of the approximately 15 images photographed within a few seconds is about 0.2 seconds. If an object assumed to be a person in the image data is truly a person, the similarity will be high when comparing adjacent images before and after the object detection region, but in the case of a small living thing such as an insect photographed just in front of the camera lens, the movement will be captured significantly, resulting in a low similarity of the images. Using this, the image immediately before and the image immediately after are compared, and if either one has a low degree of similarity, it can be determined that the movement is due to something other than a human, such as an insect.

[0040] The human movement determination unit 106 determines whether or not there is movement (whether or not it is human movement) of the human-like object detected by the object detection unit 102. Note that, in the following, an embodiment is described in which the presence or absence of object movement is determined based on whether or not an object detection image (i.e., a frame in which an object is detected) is similar to another image (i.e., another frame included in a video), but the present invention is not limited to this, and the human-like object movement may be determined by any method. Below, the human movement determination unit 106 will be described separately as a similarity calculation unit 161 and a determination unit 162.

[0041] Similarity calculation unit 161 calculates the similarity between the object detection image (a frame in which a human-like object is detected) and another image (i.e., another frame included in the video). Specifically, similarity calculation unit 161 compares an area in the object detection image in which an object is included (object detection area) with an area in the other image at the same coordinate position as the object detection area in the object detection image. Note that the other frames may be all other frames included in the video, or may be some other frames included in the video.

[0042] In addition, when a human-like object is detected in multiple images (frames), the similarity calculation unit 161 calculates the similarity between each object detection image (each frame) and each of the other images (i.e., other frames included in the video).

[0043] <<Calculating Similarity>> Here, the calculation of the similarity will be described in detail. For example, the similarity calculation unit 161 can use the ZNCC (Zero-mean Normalized Cross Correlation) method. For example, it is assumed that the similarity between a rectangle of M pixels x N pixels including an object and a rectangle of M pixels x N pixels in another image is calculated. The pixels (T(i,j) and I(i,j)) at the same coordinates of the two rectangles are used. The similarity calculation unit 161 calculates the similarity by:

[0044]

number

[0045]

number

[0046]

number

[0047]

number

[0048] The similarity is not limited to the ZNCC method, but may be calculated by any template matching method such as NCC (Normalized Cross-Correlation), SSD (Sum of Squared Difference), or SAD (Sum of Absolute Difference).

[0049] The determination unit 162 determines whether or not there are a predetermined number or more of other images whose similarity is equal to or less than the threshold for each object detection region in the object detection image in which the object detection unit 102 detects an object. Specifically, the determination unit 162 determines that there is object movement when the number of other images whose similarity is equal to or less than the threshold is equal to or more than the predetermined number in at least one object detection region. The determination unit 162 determines that there is no object movement when the number of other images whose similarity is equal to or less than the threshold is less than the predetermined number in all object detection regions. The predetermined number may be one or may be two or more. In addition, when there are multiple object detection regions in the same object detection image, these determination processes are performed for each object detection region, and if the number of other images whose similarity is equal to or less than the threshold is equal to or more than the predetermined number in at least one object detection region, it can be determined that there is object movement.

[0050] The erroneous detection determination unit 107 determines that the object detected by the object detection unit 102 is a person because the object is moving, or determines that the object detected by the object detection unit 102 is not a person because the object is not moving.

[0051] <Method> Hereinafter, the erroneous detection determination process will be described with reference to FIG. 4, the insect movement determination process will be described with reference to FIG. 5, and the human-like object movement determination process will be described with reference to FIG.

[0052] FIG. 4 is a flowchart of an erroneous detection determination process according to one embodiment of the present invention.

[0053] In step 11 (S11), the image acquisition unit 101 acquires a plurality of images captured by the imaging device 20 (that is, a moving image made up of a plurality of frames (still images)).

[0054] In step 12 (S12), the object detection unit 102 detects an object assumed to be a person (human-like) in each of the multiple images (i.e., each frame) acquired in S11. Note that an object may be detected in one or more images (frames). If a human-like object is detected, the process proceeds to step 13, and if a human-like object is not detected, the process ends.

[0055] In step 13 (S13), the detection score determination unit 103 determines whether the detection score (detection reliability) of S12 is smaller than a threshold value. If it is determined that it is less than the threshold value, the process proceeds to step 14, and if it is determined that it is equal to or greater than the threshold value, it is determined that it is a person.

[0056] In step 14 (S14), the highlight determination unit 104 determines whether or not there is a highlight in the area where the object was detected in S12. If there is a highlight, the process proceeds to step 15. If there is no highlight, the process proceeds to step 16.

[0057] In step 15 (S15), the insect movement determination unit 105 determines whether or not the object detected in S12 is moving (whether or not it is moving like an insect, etc.). If it is determined that there is no insect-like movement, the process proceeds to step 16, and if it is determined that there is insect-like movement, the process proceeds to step 17.

[0058] In step 16 (S16), the human movement determination unit 106 determines whether or not the human-like object detected in S12 is moving (whether or not the human-like object is moving). If it is determined that there is no movement, the process proceeds to step 17, and if it is determined that there is movement, the process proceeds to step 18.

[0059] In step 17 (S17), erroneous detection determination section 107 determines that the object detected in S12 is an erroneous detection (that is, the object detected in S12 is other than a human).

[0060] In step 18 (S18), erroneous detection determination section 107 determines that the object detected in S12 is not an erroneous detection (that is, the object detected in S12 is a person).

[0061] FIG. 5 is a flowchart of the insect movement determination process (S15 in FIG. 4) according to one embodiment of the present invention.

[0062] In step 21 (S21), similarity calculation section 151 selects one of the object detection regions in the object detection image in which object detection section 102 has detected an object.

[0063] In step 22 (S22), similarity calculation unit 151 calculates the similarity between the object detection area in the object detection image selected in S21 (i.e., the frame in which an object is detected) and areas at the same coordinate position as the object detection area in the previous and next images (i.e., the previous and next frames included in the video).

[0064] In step 23 (S23), similarity calculation unit 151 determines whether or not calculation of similarities for object detection regions in all images (object detection images) in which objects are detected by object detection unit 102 is completed. If completed, proceed to step 24, and if not completed, return to step 21.

[0065] In step 24 (S24), for each object detection region in an image (object detection image) in which object detection unit 102 detected an object, determination unit 152 calculates a similarity between regions in the previous and next images at the same coordinate position as the object detection region, and determines whether or not at least one of the similarities is equal to or less than a threshold. If the similarity of at least one of the previous and next images for at least one object detection image is equal to or less than the threshold, the process proceeds to step 25, and if the similarity of none of the previous and next images for all object detection images is equal to or less than the threshold, the process proceeds to step 26.

[0066] In step 25 (S25), the determination unit 152 determines that the insect is moving.

[0067] In step 26 (S26), the determination unit 152 determines that there is no movement of the insect.

[0068] FIG. 6 is a flowchart of the human movement determination process (S16 in FIG. 4) according to an embodiment of the present invention.

[0069] In step 31 (S31), similarity calculation section 161 selects one of the object detection regions in the object detection image in which object detection section 102 has detected an object.

[0070] In step 32 (S32), similarity calculation unit 161 calculates the similarity between the object detection area in the object detection image selected in S31 (i.e., the frame in which an object is detected) and an area at the same coordinate position as the object detection area in another image (i.e., another frame included in the video).

[0071] In step 33 (S33), similarity calculation unit 161 determines whether or not calculation of similarities for object detection regions in all images (object detection images) in which objects are detected by object detection unit 102 is completed. If completed, proceed to step 34, and if not completed, return to step 31.

[0072] In step 34 (S34), determination unit 162 determines whether or not there are a predetermined number or more of other images whose similarity is equal to or less than the threshold for each object detection region in which object detection unit 102 has detected an object. If the number of other images whose similarity is equal to or less than the threshold in at least one object detection region is equal to or more than the predetermined number, the process proceeds to step 35, and if the number of other images whose similarity is equal to or less than the threshold in all object detection regions is less than the predetermined number, the process proceeds to step 36.

[0073] In step 35 (S35), the determination unit 162 determines that there is a human-like object movement.

[0074] In step 36 (S36), the determination unit 162 determines that there is no human-like object movement.

[0075] <Judgment of insect movement> The determination of insect movement will now be described in detail.

[0076] 7 is a diagram for explaining the determination of insect movement according to one embodiment of the present invention. Assume that a video captured by a security or surveillance camera (i.e., a video acquired by the image acquisition unit 101) is composed of 15 frames in time series from the 1st frame to the 15th frame. Assume that an object is detected in the 10th frame (i.e., the object detection unit 102 detects an object in the 10th frame). Assume that the detection score (detection reliability) is 0.5, which is less than the threshold value.

[0077] First, the similarity calculation unit 151 of the insect movement determination unit 105 calculates the similarity between the frame in which the object is detected (the 10th frame in FIG. 7) and the previous and next frames included in the video (the 9th and 11th frames in FIG. 7).

[0078] Next, the determination unit 152 of the insect movement determination unit 105 calculates the similarity between the areas in the previous and next images at the same coordinate position as the object detection area in each object detection area in the object detection image, and determines whether or not at least one of the similarities is equal to or less than a threshold. In the example of FIG. 7, it is assumed that the similarity of the object detection area in the 11th frame is equal to or less than a threshold. In this case, the insect movement determination unit 105 determines that there is insect movement, since the similarity of at least one of the previous and next images is equal to or less than the threshold.

[0079] If an object is detected in multiple images (frames) (i.e., if an object is detected in a frame other than the 10th frame), the similarity calculation unit 151 calculates the similarity between the object detection area in each object detection image (each frame) and the area at the same coordinate position as the object detection area in each previous and next images (i.e., previous and next frames included in the video). Then, for each image in which an object is detected (object detection image), the determination unit 152 determines whether or not at least one of the previous and next images has a similarity below a threshold (i.e., a determination similar to the determination for the above 10 frames is performed). If at least one of the previous and next images has a similarity below a threshold in at least one object detection image, it is determined that there is movement, and if none of the previous and next images has a similarity below a threshold in all object detection images, it is determined that there is no movement.

[0080] <Determining human movement> The determination of human movement will now be described in detail.

[0081] 8 is a diagram for explaining the determination of human movement according to an embodiment of the present invention. Assume that a video captured by an imaging device 20 such as a security or surveillance camera and acquired by an image acquisition unit 101 is composed of 15 frames in time series from the 1st frame to the 15th frame. Assume that the object detection unit 102 detects a human-like object within the 10th frame. Assume that the detection score (detection reliability) is 0.5, which is less than a threshold value.

[0082] First, similarity calculation unit 161 of human movement determination unit 106 calculates the similarity between the object detection area in which the object is detected in the image (the 10th frame in Figure 8) and areas at the same coordinate position as the object detection area in which the aforementioned object is detected in other frames included in the video (frames 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 12, 13, 14, and 15 in Figure 8).

[0083] Next, the determination unit 162 of the human movement determination unit 106 counts the number of similarities calculated by the similarity calculation unit 161 that are equal to or less than the threshold, and determines whether or not the number is equal to or greater than a predetermined number (e.g., 8). In the example of Fig. 8, the threshold for similarity is set to 0.7, and there are 11 frames whose similarity is equal to or less than the threshold (marked with a circle in Fig. 8). In this case, the human movement determination unit 106 determines that the human-like object is moving, since the number of other images whose similarity is equal to or less than the threshold is equal to or greater than a predetermined number.

[0084] If an object is detected in a plurality of images (frames) (i.e., if an object is detected in a frame other than the tenth frame), similarity calculation unit 161 calculates the similarity between each object detection region of an image (object detection image) in which an object is detected and a region in another image (i.e., another frame included in a moving image) at the same coordinate position as the object detection region. Then, determination unit 162 determines whether or not there is a predetermined number of regions at the same coordinate position as the object detection region of another image in which the similarity is less than a threshold value for each object detection region in which an object is detected (i.e., a determination similar to the determination in the tenth frame described above is performed). If the number of regions at the same coordinate position as the object detection region of another image in which the similarity is less than or equal to the threshold value is equal to or greater than a predetermined number in at least one object detection region, it is determined that there is movement, and if the number of similarities less than or equal to the threshold value in all object detection images is less than a predetermined number, it is determined that there is no movement. Similarly, when there are multiple object detection regions within the same image, the similarity between each object detection region and other images is calculated, and the number of other images (regions) whose similarity is below a threshold is counted to determine movement.

[0085] Here, a description will be given of a judgment based on the condition that there are a plurality of images whose similarity is less than a threshold value. When comparing the object detection region of an image in which a human-like object is detected with other images, if there happens to be an insect or ambient light such as a car light reflected therein, the similarity may be calculated to be low. In this case, a method of calculating and comparing the similarity only with the region of the same position range in the previous and next images may erroneously detect the insect or ambient light as a human. By comparing not only the previous and next images but also multiple other images and setting a judgment condition including the number of images (regions) whose similarity is less than or equal to a threshold value, it is possible to suppress the occurrence of erroneous detection due to noise such as insects or ambient light, and to accurately judge that it is a moving human body.

[0086] <Other embodiments> Other embodiments will be described below.

[0087] <<Detection of non-human movements such as insects>> In the above, an embodiment has been described in which the presence or absence of object movement (whether the movement is of something other than a human, such as an insect) is determined based on whether an object detection image is similar to the previous and next images. However, the present invention can also be applied to an embodiment in which the presence or absence of object movement is determined based on the characteristics of the object movement. For example, the insect movement determination unit 105 can determine that the movement is of an insect or the like moving at high speed when the change in the ratio of white pixels between the object detection area of ​​the object detection image and the area at the same position as the object detection area in the previous and next images is equal to or greater than a threshold value. Also, for example, the insect movement determination unit 105 can determine that the movement is of an insect or the like moving at high speed when the change in the size of the area (e.g., a rectangle) containing the object between the object detection area of ​​the object detection image and each object detection area in the previous and next images is equal to or greater than a threshold value. At this time, if there is no object detection area in the previous or next image, a rectangular area that specifies the object position in the previous or next image is specified using an object tracking technique to make a determination. Also, for example, when the change in the moving direction of an area (e.g., a rectangle) containing an object between the object detection area of ​​the object detection image and each object detection area of ​​the previous and next images is equal to or greater than a threshold value, the insect movement determination unit 105 can determine that the movement is that of a fast moving insect, etc. In this case, when there is no object detection area in the previous or next image, an object tracking technique is used to specify a rectangular area that identifies the object position in the previous or next image and make the determination.

[0088] <<Determining the movement of each body part>> In one embodiment of the present invention, the false detection determination device 10 can detect parts of a person's body (e.g., not limited to the entire body, but parts of the head, arms, upper body, lower body, left or right half of the body, etc.) and determine the movement of the detected parts of the person's body.

[0089] Specifically, the object detection unit 102 detects human body parts by machine learning or the like. The detection score determination unit 103 determines whether the detection score (detection reliability) is smaller than a threshold. The human movement determination unit 106 determines whether or not the human body parts are moving. In this case, a threshold for the detection score (detection reliability) and a threshold for determining human-like object movement may be set for each human body part.

[0090] For example, when learning the shapes of heads and arms, a hat or helmet placed indoors may be erroneously detected as a "head," and a long, thin object such as a chair, a desk frame, or a pillar may be erroneously detected as an "arm." In order to prevent such erroneous detection, if a condition is set to uniformly determine that a person (moving object) is present when the similarity is below a threshold in a larger number of images, there is a risk that the detection of a person may be missed. Therefore, for object detection areas detected as arms, legs, and the like, which are parts that tend to move a lot in typical human movements, it is possible to accurately detect objects that are human by determining that the object detection areas are present as human when the similarity is below a threshold in a larger number of images than for object detection areas detected as parts that move relatively little, such as the head.

[0091] <<Motion detection based on brightness>> The above describes an embodiment in which whether or not the object detection areas of two images (frames) are similar is determined by template matching such as ZNCC. However, the present invention can also be applied to an embodiment in which whether or not two images (frames) are similar is determined based on an evaluation value based on the brightness of the object detection areas of the two images (frames) (e.g., the average brightness difference).

[0092] In addition, a plurality of images obtained by converting the difference in luminance of each pixel when comparing object detection regions can be trained in an AI model for classifying moving images, such as 3DCNN (AI that inputs a series of images (moving images) and outputs their contents), and output which movement pattern the image corresponds to. The trained model may be a model trained based on the similarity between an image (e.g., the first frame) other than the image in which the object detection unit 102 detects an object (in the example of Figs. 7 and 8, the tenth frame) and other images. Also, it may be a model trained based on the similarity between images of adjacent frames (e.g., the similarity between the images of the first and second frames, the similarity between the images of the second and third frames, etc.).

[0093] <<Exclusion of cyclical movements>> In one embodiment of the present invention, the human movement determination unit 106 can further determine whether the object movement is periodic or not. If the object movement is periodic, the erroneous detection determination unit 107 determines that the object detection is a erroneous detection (for example, a detection of something other than a human, such as a light, flag, or curtain swaying in the wind, or a blinking car headlight).

[0094] Specifically, the human movement determination unit 106 can input the similarity between the object detection area in which the object detection unit 102 detected the object and an area in another image at the same coordinate position as the object detection area (in the example of FIG. 8, the similarity between the 10th frame and the 1st to 9th and 11th to 15th frames) to a trained model using a method such as a support vector machine or a random forest, and output whether the movement is periodic or not. The trained model may be a model trained based on the similarity between an image (for example, the 1st frame) other than the image in which the object detection unit 102 detected the object (in the example of FIG. 8, the 10th frame) and another image. Also, it may be a model trained based on the similarity between images of adjacent frames (for example, the similarity between the images of the 1st and 2nd frames, the similarity between the images of the 2nd and 3rd frames, etc.).

[0095] <<Learning human-like movements>> The trained model may have previously learned patterns of human-like movements (such as a person moving or standing still). The human movement determination unit 106 may output which movement pattern corresponds to which of multiple classes from multiple frames.

[0096] <Effects> In this way, in one embodiment of the present invention, it is possible to determine whether an object detected in an image captured by a security or surveillance camera or the like is a false positive (i.e., a person) or a false positive (i.e., not a person). Furthermore, in one embodiment of the present invention, if there is blown out highlights and it is determined to be insect movement (i.e., high-speed movement), it is possible to reduce false positives of intruders by excluding it from the detection target.

[0097] <Hardware configuration> 9 is a block diagram showing an example of a hardware configuration of an error detection determination device 10 according to one embodiment of the present invention. The error detection determination device 10 has a central processing unit (CPU) 1001, a read only memory (ROM) 1002, and a random access memory (RAM) 1003. The CPU 1001, the ROM 1002, and the RAM 1003 form a so-called computer.

[0098] Moreover, the false detection determination device 10 may have an auxiliary storage device 1004, a display device 1005, an operation device 1006, an I / F (Interface) device 1007, and a drive device 1008. The hardware components of the false detection determination device 10 are connected to each other via a bus B.

[0099] The CPU 1001 is a computing device that executes various programs installed in the auxiliary storage device 1004 .

[0100] The ROM 1002 is a non-volatile memory. The ROM 1002 functions as a main storage device that stores various programs, data, etc. required for the CPU 1001 to execute various programs installed in the auxiliary storage device 1004. Specifically, the ROM 1002 functions as a main storage device that stores boot programs such as a BIOS (Basic Input / Output System) and an EFI (Extensible Firmware Interface).

[0101] The RAM 1003 is a volatile memory such as a dynamic random access memory (DRAM) or a static random access memory (SRAM). The RAM 1003 functions as a main storage device that provides a working area in which various programs installed in the auxiliary storage device 1004 are expanded when the CPU 1001 executes them.

[0102] The auxiliary storage device 1004 is an auxiliary storage device that stores various programs and information used when the various programs are executed.

[0103] The display device 1005 is a display device that displays the internal state of the error detection determination device 10 and the like.

[0104] The operation device 1006 is an input device through which an administrator of the error detection determination device 10 inputs various instructions to the error detection determination device 10 .

[0105] The I / F device 1007 is a communication device for connecting to a network and communicating with other devices.

[0106] The drive device 1008 is a device for setting the storage medium 1009. The storage medium 1009 here includes media that record information optically, electrically, or magnetically, such as a CD-ROM, a flexible disk, a magneto-optical disk, etc. The storage medium 1009 may also include semiconductor memories that record information electrically, such as an EPROM (Erasable Programmable Read Only Memory), a flash memory, etc.

[0107] The various programs to be installed in the auxiliary storage device 1004 are installed, for example, by setting the distributed storage medium 1009 in the drive device 1008 and reading out the various programs recorded in the storage medium 1009 by the drive device 1008. Alternatively, the various programs to be installed in the auxiliary storage device 1004 may be installed by being downloaded from a network via the I / F device 1007.

[0108] Although the embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments described above, and various modifications and variations are possible within the scope of the gist of the present invention described in the claims. [Explanation of symbols]

[0109] 1. False positive detection system 10. False positive detection device 20 Imaging device 101 Image acquisition unit 102 Object detection unit 103 Detection score judgment unit 104 Overexposure judgment section 105 Insect movement detection unit 106 Human movement detection unit 107 False positive judgment unit 151 Similarity calculation part 152 Judgment section 161 Similarity calculation part 162 Judgment section 1001 CPU 1002 ROM 1003 RAM 1004 Auxiliary storage device 1005 Display device 1006 Operating device 1007 I / F device 1008 Drive device 1009 Storage medium

Claims

1. an image acquisition unit that acquires a plurality of images; an object detection unit that detects a human-like object in the image; a blown-out highlight determination unit that determines whether or not there is blown-out highlight in an object detection region, which is a region in which the object is detected, within an object detection image, which is an image in which the object is detected; a motion determination unit that, when it is determined that there is whiteout, determines whether or not there is any movement of an object other than a human being among the detected objects, and, when it is determined that there is no movement of an object other than a human being among the detected objects, further determines whether or not there is any movement of a human being among the detected objects, and, when it is determined that there is no whiteout, determines whether or not there is any movement of the human being among the detected objects; an erroneous detection determination unit that determines that the detection of the object is an erroneous detection when it is determined that the detected object does not include the human movement and when it is determined that the detected object includes a movement of an object other than the human; The movement determination unit determines whether or not there is movement of an object other than the person in the detected object based on a similarity between the object detection area of ​​the object detection image and areas at the same coordinate position as the object detection area in each of an image immediately before and an image immediately after the object detection image.

13. An erroneous detection determination device comprising:

2. The movement determination unit determines whether or not the detected object includes movement of the person based on a similarity between the object detection region of the object detection image and a region at the same coordinate position as the object detection region in an image other than the object detection image among the plurality of images.

2. The erroneous detection determination device according to claim 1.

3. 3 . The erroneous detection determination device according to claim 1 , wherein the erroneous detection determination unit determines that the detection of the object is not an erroneous detection when a reliability of the detection of the object in the image is greater than a threshold value.

4. the detected object is a part of a human body; The false detection determination device according to claim 3 , further comprising: a threshold value for determining whether or not the detected object is indicative of the motion of the person, and a threshold value for determining the reliability of the detection of the object, for each part of the person's body.

5. A method executed by an erroneous detection determination device, comprising: acquiring a plurality of images; detecting a human-like object within the image; determining whether or not there is blown-out highlights in an object detection region, which is a region in which the object is detected, within an object detection image, which is an image in which the object is detected; when it is determined that there is blown-out highlights, determining whether or not there is any movement of an object other than a human among the detected objects based on a similarity between the object detection area of ​​the object detection image and areas at the same coordinate position as the object detection area in each of an image immediately before and an image immediately after the object detection image, and when it is determined that there is no movement of an object other than a human among the detected objects, further determining whether or not there is any movement of a human among the detected objects; when it is determined that there is no blown-out highlights, determining whether or not there is any movement of the human among the detected objects; determining that the detection of the object is a false detection when it is determined that the detected object does not include the movement of the person and when it is determined that the detected object includes the movement of an object other than the person; The method includes:

6. False positive judgment device an image acquisition unit for acquiring a plurality of images; an object detection unit that detects a human-like object in the image; a blown-out highlight determination unit that determines the presence or absence of blown-out highlights in an object detection region, which is a region in which the object is detected, within an object detection image, which is an image in which the object is detected; a motion determination unit which, when it is determined that there is blown-out highlights, determines whether or not there is any movement of an object other than a human being among the detected objects based on a similarity between the object detection area of ​​the object detection image and areas at the same coordinate position as the object detection area in each of an image immediately before and an image immediately after the object detection image, and when it is determined that there is no movement of an object other than a human being among the detected objects, further determines whether or not there is any movement of a human being among the detected objects, and when it is determined that there is no blown-out highlights, determines whether or not there is any movement of the human being among the detected objects; an erroneous detection determination unit that determines that the detection of the object is an erroneous detection when it is determined that the detected object does not include the movement of the person and when it is determined that the detected object includes the movement of an object other than the person; A program to function as a

Images