Anomaly detection device, method, and program
The anomaly detection device integrates autoencoders and one-class classification with gradient regularization to enhance anomaly detection, preventing the overlooking of abnormalities by leveraging complementary scores.
Patent Information
- Application Number
- JP2021181775
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-11-08
- Publication Date
- 2025-09-09
- Estimated Expiration
- 2041-11-08
AI Technical Summary
Conventional anomaly detection methods such as one-class classification and autoencoders often fail to detect abnormalities in objects despite their presence.
An anomaly detection device and method that combines autoencoders and one-class classification, utilizing complementary feature and reconstructed anomaly scores, and trains the model to regularize the gradient of the image reconstruction unit to enhance detection accuracy.
Prevents the overlooking of anomalies by integrating feature and reconstructed anomaly scores, ensuring reliable detection of both local and global anomalies.
Smart Images

Figure 0007735801000009 
Figure 0007735801000010 
Figure 0007735801000011
Abstract
Description
[Technical Field]
[0001] The present invention relates to an abnormality detection device, method, and program for detecting abnormalities in an object by visually inspecting an image of the object. [Background technology]
[0002] Conventionally, anomalies in objects are detected by visual inspection of the images of the objects. Methods used for this anomaly detection include autoencoders and one-class classification.
[0003] In an autoencoder, features are extracted from an input image, a reconstructed image that reproduces the input image from the features is reconstructed, and anomalies are detected based on the error between the input image and the reconstructed image (see, for example, Patent Document 1).
[0004] In one-class classification, features are extracted from the input image, and anomalies are detected based on the distance between the feature and the center point of the feature extracted from a normal input image during training (see, for example, Non-Patent Document 1). [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Patent No. 6599294 specification [Non-patent literature]
[0006] [Non-Patent Document 1] Ruff, L., Vandermeulen, R., Goernitz, N., Deecke, L., Siddiqui, SA, Binder, A., Muller, E., Kloft, M., “Deep One-Class Classification”, Proceedings of the 35th International Conference on Machine Learning (2018) Summary of the Invention [Problem to be solved by the invention]
[0007] Conventional anomaly detection methods such as one-class classification and autoencoders may fail to detect abnormalities in objects even though they exist.
[0008] The present invention has been made in view of the above-mentioned problems, and an object of the present invention is to provide an abnormality detection device, method, and program that can prevent overlooking of abnormalities in abnormality detection. [Means for solving the problem]
[0009] A first embodiment of the present invention is an anomaly detection device comprising: a feature extraction unit that extracts features from an input image; an image reconstruction unit that constructs a reconstructed image from the features; a feature anomaly score calculation unit that calculates a feature anomaly score indicating the distance between the feature and a predetermined center point; a reconstructed anomaly score calculation unit that calculates a reconstructed anomaly score indicating the error between the reconstructed image and the input image; and an anomaly determination unit that determines an anomaly using both the feature anomaly score and the reconstructed anomaly score.
[0010] In this embodiment, the feature anomaly score and the reconstructed anomaly score have complementary properties with respect to anomalies that may be overlooked, and since anomalies are determined using both the feature anomaly score and the reconstructed anomaly score, it is possible to prevent anomalies from being overlooked during anomaly detection.
[0011] A second embodiment of the present invention is a learning device that trains the anomaly detection device of the first embodiment, and includes a feature extraction update unit that updates the feature extraction unit using the feature anomaly score as a loss function, an image reconstruction update unit that updates the feature extraction unit and the image reconstruction unit using the reconstruction anomaly score as a loss function, and a gradient regularization unit that updates the image reconstruction unit so as to regularize the gradient of the image reconstruction unit.
[0012] In this embodiment, the anomaly detection device is trained to regularize the gradient of the image reconstruction unit, so that in the trained anomaly detection device, it is possible to promote complementarity between the feature anomaly score in anomaly detection and the reconstructed anomaly score, making it possible to more reliably prevent anomalies from being overlooked in anomaly detection.
[0013] A third embodiment of the present invention is an anomaly detection method comprising: a feature extraction step of extracting features from an input image; an image reconstruction step of constructing a reconstructed image from the features; a feature anomaly score calculation step of calculating a feature anomaly score indicating the distance between the feature and a predetermined center point; a reconstructed anomaly score calculation step of calculating a reconstructed anomaly score indicating the error between the reconstructed image and the input image; and an anomaly determination step of determining an anomaly using both the feature anomaly score and the reconstructed anomaly score. This embodiment provides the same effects as the first embodiment.
[0014] A fourth embodiment of the present invention is a learning method for the anomaly detection device of the first embodiment, comprising: a feature extraction updating step of updating the feature extraction unit using the feature anomaly score as a loss function; an image reconstruction updating step of updating the feature extraction unit and the image reconstruction unit using the reconstruction anomaly score as a loss function; and a gradient regularization step of updating the image reconstruction unit so as to regularize the gradient of the image reconstruction unit. This embodiment provides the same effects as the second embodiment.
[0015] A fifth embodiment of the present invention is an anomaly detection program that causes a computer to realize a feature extraction function that extracts features from an input image, an image reconstruction function that constructs a reconstructed image from the features, a feature anomaly score calculation function that calculates a feature anomaly score that indicates the distance between the feature and a predetermined center point, a reconstruction anomaly score calculation function that calculates a reconstruction anomaly score that indicates the error between the reconstructed image and the input image, and an anomaly determination function that determines an anomaly using both the feature anomaly score and the reconstruction anomaly score. This embodiment provides the same effects as the first embodiment.
[0016] A sixth embodiment of the present invention is a learning program for training the anomaly detection device of the first embodiment, which causes a computer to realize a feature extraction update function that updates the feature extraction unit using the feature anomaly score as a loss function, an image reconstruction update function that updates the feature extraction unit and the image reconstruction unit using the reconstruction anomaly score as a loss function, and a gradient regularization function that updates the image reconstruction unit so as to regularize the gradient of the image reconstruction unit. This embodiment provides the same effects as the second embodiment. [Effects of the Invention]
[0017] In the present invention, it is possible to prevent any abnormalities from being overlooked in the abnormality detection. [Brief explanation of the drawings]
[0018] [Figure 1] 1 is a block diagram showing an anomaly detection device according to an embodiment of the present invention; [Figure 2] FIG. 1 is a block diagram showing a learning device according to an embodiment of the present invention. [Figure 3] FIG. 2 is a flow diagram illustrating an anomaly detection method according to an embodiment of the present invention. [Figure 4] 1 is a flow diagram illustrating a training method according to an embodiment of the present invention. [Figure 5] FIG. 2 is a schematic diagram showing an input image according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0019] An outline of one embodiment of the present invention will be described below. A wide variety of anomaly detection techniques have been used to detect anomalies in an object by visually inspecting an image of the object. The inventors of the present application were the first to discover that among these various anomaly detection techniques, autoencoders and one-class classification have complementary properties with regard to anomalies that may be overlooked, leading to the invention of the present embodiment. The anomaly detection of the present embodiment combines autoencoders and one-class classification and utilizes their complementary properties to prevent overlooking of anomalies. Furthermore, in addition to combining autoencoders and one-class classification, the anomaly detection of the present embodiment is trained to regularize the gradient of the image reconstruction portion of the autoencoder. This promotes the complementary properties during anomaly detection in a trained anomaly detection device, thereby enabling further prevention of overlooking of anomalies.
[0020] An embodiment of the present invention will be described with reference to FIGS. The abnormality detection device of this embodiment will be described with reference to FIG.
[0021] In the anomaly detection device, the feature extraction unit 12 extracts a feature vector Z as a feature from the input image X, as shown in the following equation (1): where φ represents a parameter of the feature extraction unit 12.
number
[0022] The image reconstruction unit 14 reconstructs a reconstructed image X̂ that reproduces the input image X from the feature vector Z extracted from the input image X by the feature extraction unit 12, as shown in the following equation (2), where ψ represents a parameter of the image reconstruction unit 14.
number
[0023] The feature anomaly score calculation unit 16 calculates a feature anomaly score L1. The feature anomaly score L1 indicates the distance between a feature vector Z extracted from the input image X by the feature extraction unit 12 and a central vector C as a predetermined central point in the feature vector space. As the feature anomaly score L1, an arbitrary norm of the feature vector Z and the central vector C is used, for example, the L2 norm, as shown in the following equation (3):
number
[0024] During training of the anomaly detection device, the feature anomaly score L1 is used as a loss function, and the parameter φ of the feature extraction unit 12 is updated so that the feature vector Z extracted from a normal input image X approaches the central vector C. For this reason, when an abnormal input image X is input during anomaly detection by the anomaly detection device, the feature anomaly score L1 is expected to increase.
[0025] The reconstructed anomaly score calculation unit 18 calculates the reconstructed anomaly score L2. The reconstructed anomaly score L2 indicates the error in image space between the reconstructed image X̂ reconstructed by the image reconstruction unit 14 from the feature vector Z and the original input image X. As the reconstructed anomaly score L2, an arbitrary error function dist between the reconstructed image X̂ and the input image X is used, as shown in the following equation (4).
number
[0026] During training of the anomaly detection device, the reconstructed anomaly score L2 is used as a loss function, and the parameters φ and ψ of the feature extraction unit 12 and the image reconstruction unit 14 are updated so that the reconstructed image X^ constructed from a normal input image X approximates the original input image X. For this reason, if an abnormal input image X is input during anomaly detection by the anomaly detection device, the reconstructed anomaly score L2 is expected to increase.
[0027] The anomaly score integrating unit 20 calculates an integrated anomaly score L. The integrated anomaly score L is obtained by integrating the feature amount anomaly score L1 calculated by the feature amount anomaly score calculating unit 16 and the reconstructed anomaly score L2 calculated by the reconstructed anomaly score calculating unit 18.
[0028] Here, the feature anomaly score L1 and the reconstructed anomaly score L2 have complementary properties with respect to anomalies that can be eliminated. That is, (i) if the feature anomaly score L1 is small despite the input of an abnormal input image X, the feature vector Z is close to the center vector C in the feature vector space. Therefore, in the image space, the reconstructed image X^ reconstructed from the feature vector Z should be similar to the normal input image. Since the error between the original abnormal input image X and the reconstructed image X^ is large, the reconstructed anomaly score L2, which indicates the error between the reconstructed image X^ and the input image X, is large. On the other hand, (ii) if the reconstructed anomaly score L2 is small despite the input of an abnormal input image X, the error between the reconstructed image X^ and the original abnormal input image X is small in the image space. Therefore, in the feature vector space, the feature vector Z reconstructed from the reconstructed image X^ that approximates the abnormal input image X should be far from the center vector C. Therefore, the feature anomaly score L1, which indicates the distance between the feature vector Z and the center vector C, is large.
[0029] The anomaly score integrating unit 20 integrates the feature amount anomaly score L1 and the reconstructed anomaly score L2 while maintaining their complementarity to calculate the integrated anomaly score L. As the integrated anomaly score L, for example, the weighted sum of the feature amount anomaly score L1 and the reconstructed anomaly score L2 is used, as shown in the following equation (5).
number
[0030] The anomaly determination unit 22 determines an anomaly in the input image X using both the feature amount anomaly score L1 and the reconstructed anomaly score L2, which are complementary to each other. In this embodiment, the anomaly determination unit 22 determines an anomaly in the input image X using the integrated anomaly score L calculated by the anomaly score integrating unit 20. For example, the anomaly determination unit 22 determines that the input image X has an anomaly when the integrated anomaly score L is equal to or greater than a predetermined threshold.
[0031] The learning device of this embodiment will be described with reference to FIG. The learning device of this embodiment is used to train the anomaly detection device of this embodiment, and performs the training using a normal input image X.
[0032] In the learning device, the feature extraction update unit 32 updates the parameter φ of the feature extraction unit 12 using the feature anomaly score L1 calculated by the feature anomaly score calculation unit 16 as a loss function. Here, the feature anomaly score L1 indicates the distance between the feature vector Z and the central vector C in the feature vector space, and the parameter φ of the feature extraction unit 12 is updated so that the feature vector Z extracted from a normal input image X approaches the central vector C. For this reason, if an abnormal input image X is input during anomaly detection by the anomaly detection device, the feature anomaly score L1 is expected to increase.
[0033] The image reconstruction update unit 34 updates the parameters φ and ψ of the feature extraction unit 12 and the image reconstruction unit 14 using the reconstructed anomaly score L2 calculated by the reconstructed anomaly score calculation unit 18 as a loss function. Here, the reconstructed anomaly score L2 indicates the error between the reconstructed image X̂ and the original input image X in image space, and the parameters φ and ψ of the feature extraction unit 12 and the image reconstruction unit 14 are updated so that the reconstructed image X̂ constructed from the normal input image X approximates the original input image X. For this reason, if an abnormal input image X is input when the anomaly detection device detects an anomaly, the reconstructed anomaly score L2 is expected to increase.
[0034] The gradient regularizer 36 updates the parameter ψ of the image reconstructor 14 so as to regularize the gradient of the image reconstructor 14 . As described above, the feature anomaly score L1 and the reconstructed anomaly score L2 are complementary in terms of anomalies that can be eliminated. To ensure the complementarity between the feature anomaly score L1 and the reconstructed anomaly score L2, the gradient of the image reconstruction unit 14 must be regularized to a certain degree, and the image reconstruction unit 14 must be smooth as a function to a certain degree. The more the gradient of the image reconstruction unit 14 is regularized and the smoother the function of the image reconstruction unit 14, the more the complementarity between the feature anomaly score L1 and the reconstructed anomaly score L2 is enhanced. In other words, if the reconstructed image X^ reconstructed from the feature vector Z changes independently or extremely significantly in the image space with respect to the change in the feature vector Z in the feature vector space, the complementarity (i) and (ii) between the feature anomaly score L1 and the reconstructed anomaly score L2 described above will no longer be established. On the other hand, the more closely the change in the image space of the reconstructed image X^ reconstructed from the feature vector Z corresponds to the change in the feature vector space, the more the complementarity (i) and (ii) between the above-mentioned feature anomaly score L1 and the reconstructed anomaly score L2 is promoted.
[0035] In this embodiment, the gradient regularization unit 36 uses a gradient regularization term L3 that promotes regularization of the gradient of the image reconstruction unit 14 as a loss function to update the parameter ψ of the image reconstruction unit 14, thereby regularizing the gradient of the image reconstruction unit 14. As the gradient regularization term L3, the Frobenius norm of the Jacobian of the center vector C of the image reconstruction unit 14 or the like is used, as shown in the following equation (6).
number
number
[0036] The gradient regularizer 36 of one modified example of this embodiment uses spectral normalization to regularize the gradients of the image reconstructor 14. That is, as shown in the following equation (8), the parameter ω of each layer of the image reconstructor 14 is normalized by the maximum singular value σ(ω) calculated approximately, thereby regularizing the gradients of each layer of the image reconstructor 14.
number
[0037] In addition to the gradient regularizer 36, the model of the image reconstruction unit 14 itself may be simplified to regularize the gradient of the image reconstruction unit 14 and smooth the image reconstruction unit 14 as a function. To simplify the model of the image reconstruction unit 14 itself, the number of stacked layers constituting the model of the image reconstruction unit 14 may be reduced.
[0038] The abnormality detection method of this embodiment will be described with reference to FIG. As shown in FIG. 3, the anomaly detection method includes the following steps:
[0039] Feature vector extraction step S12 In the feature vector extraction step S12, the feature amount extraction unit 12 extracts a feature vector Z from the input image X.
[0040] Image reconstruction step S14 In the image reconstruction step S14, the image reconstruction unit 14 reconstructs a reconstructed image X^ that reproduces the input image X from the feature vector Z extracted from the input image X in the feature extraction step S16.
[0041] Feature anomaly score calculation step S16 In the feature anomaly score calculation step S16, the feature anomaly score L1 is calculated by the feature anomaly score calculation unit 16. The feature anomaly score L1 indicates the distance between the feature vector Z extracted from the input image X in the feature vector extraction step S12 and a predetermined center vector C in the feature vector space.
[0042] Reconstruction anomaly score calculation step S18 In the reconstructed anomaly score calculation step S18, the reconstructed anomaly score L2 is calculated by the reconstructed anomaly score calculation unit 18. The reconstructed anomaly score L2 indicates the error in the image space between the reconstructed image Ẑ reconstructed in the image reconstruction step S14 and the original input image X.
[0043] Anomaly score integration step S20 In the anomaly score integration step S20, the anomaly score integration unit 20 integrates the feature anomaly score L1 calculated in the feature anomaly score calculation step S16 and the reconstructed anomaly score L2 calculated in the reconstructed anomaly score calculation step S18 while maintaining complementarity, to calculate an integrated anomaly score L.
[0044] Abnormality determination step S22 In the anomaly determination step S22, the anomaly determination unit 22 uses both the feature amount anomaly score L1 and the reconstructed anomaly score L2, which are complementary to each other, to determine an anomaly in the input image X. In this embodiment, the integrated anomaly score L calculated in the anomaly score integration step S20 is used to determine an anomaly in the input image X.
[0045] The learning method of this embodiment will be described with reference to FIG. The learning method of this embodiment is a learning method for the anomaly detection device of this embodiment, and learning is performed using normal input images. As shown in FIG. 4, the learning method of this embodiment includes the following steps.
[0046] Feature vector extraction step S32, image reconstruction step S34, feature amount anomaly score calculation step S36, reconstruction anomaly score calculation step S38 These steps are the same as the feature vector extraction step S12, image reconstruction step S14, feature amount anomaly score calculation step S16, and reconstruction anomaly score calculation step S18 of the anomaly detection method.
[0047] Gradient regularization term calculation step S40 In the gradient regularization term calculation step S40, the gradient regularization unit 36 calculates a gradient regularization term L3 that promotes regularization of the gradient in the image reconstruction unit 14.
[0048] Feature extraction and update step S42 In the feature extraction and update step S42, the feature extraction and update unit 32 updates the parameter φ of the feature extraction unit 12 using the feature anomaly score L1 calculated in the feature anomaly score calculation step S36 as a loss function.
[0049] Image reconstruction update step S44 In the image reconstruction update step S44, the image reconstruction update unit 34 updates the parameters φ and ψ of the feature extraction unit 12 and the image reconstruction unit 14 using the reconstruction abnormality score L2 calculated in the reconstruction abnormality score calculation step S38 as a loss function.
[0050] Gradient regularization step S46 In the gradient regularization step S46, the gradient regularizer 36 updates the image reconstruction unit 14 so as to regularize the gradient of the image reconstruction unit 14. In this embodiment, the parameter ψ of the image reconstruction unit 14 is updated using the gradient regularization term L3 calculated in the gradient regularization term calculation step S40 as a loss function.
[0051] Parameter optimization step S48 In the parameter optimization step S48, the above steps are repeated until the parameters φ and ψ of the feature extraction unit 12 and the image reconstruction unit 14 are optimized.
[0052] In one modification of this embodiment, spectral normalization is used to regularize the gradients of the image reconstruction unit 14. That is, instead of the gradient regularization term calculation step, a maximum singular value calculation step is executed to approximately calculate the maximum singular value σ(ω) of the parameters of each layer of the image reconstruction unit 14. Then, in the gradient regularization step, the parameter ω of each layer of the image reconstruction unit 14 is normalized by the maximum singular value σ(ω) calculated in the maximum singular value calculation step, thereby regularizing the gradients of each layer of the image reconstruction unit 14.
[0053] The complementarity in anomaly detection in this embodiment will be described with reference to FIG. FIG. 5(a) shows a normal input image, FIG. 5(b) shows an input image with a local anomaly, and FIG. 5(c) shows an input image with a global anomaly. For an input image with a local anomaly such as that shown in FIG. 5(b), it is difficult to detect an anomaly using a feature anomaly score based on a feature vector obtained by compressing the input image, but it is easy to detect an anomaly using a reconstructed anomaly score. On the other hand, for an input image with a global anomaly such as that shown in FIG. 5(c), it is difficult to detect an anomaly using a reconstructed anomaly score because the image is locally normal, but it is easy to detect an anomaly using a feature anomaly score. In this embodiment, anomaly detection is performed using both the feature anomaly score and the reconstructed anomaly score, so that anomalies can be detected without missing any of the input images with local anomalies and those with global anomalies.
[0054] The anomaly detection device and method, and learning device and method of the present embodiment have the following advantages.
[0055] In the anomaly detection device and method of this embodiment, the feature anomaly score L1, which indicates the distance in feature vector space between the feature vector Z extracted from the input image X and a predetermined center point C, and the reconstructed anomaly score L2, which indicates the error in image space between the reconstructed image X^ reconstructed from the feature vector Z and the original input image X, have complementary properties with respect to anomalies that may be overlooked. Since anomalies are determined using an integrated anomaly score L, which is obtained by integrating the feature anomaly score L1 and the reconstructed anomaly score L2 while maintaining their complementarity, it is possible to prevent anomalies from being overlooked during anomaly detection.
[0056] In the learning device and method of this embodiment, the anomaly detection device is trained to regularize the gradient of the image reconstruction unit 14. This makes it possible to promote complementarity between the feature anomaly score L1 and the reconstructed anomaly score L2 in anomaly detection in the trained anomaly detection device, thereby more reliably preventing the overlooking of anomalies in anomaly detection.
[0057] In the above embodiments, an anomaly detection device and method, and a learning device and method have been described, but the scope of the present invention also includes a program that causes a computer to realize each function of the device, or a program that causes a computer to execute each step of the method. Furthermore, the scope of the present invention also includes an anomaly detection device that has been trained by the learning device, method, and program. [Explanation of symbols]
[0058] 12...Feature extraction unit 14...Image reconstruction unit 16...Feature anomaly score calculation unit 18... Reconstruction anomaly score calculation unit 20... Anomaly score integration unit 22... Anomaly determination unit 32...Feature extraction update unit 34...Image reconstruction update unit 36...Gradient regularization unit
Claims
1. a feature extraction unit that extracts features from an input image; an image reconstruction unit that constructs a reconstructed image from the feature amount; a feature anomaly score calculation unit that calculates a feature anomaly score indicating a distance between the feature and a predetermined center point; a reconstruction anomaly score calculation unit that calculates a reconstruction anomaly score indicating an error between the reconstructed image and the input image; an abnormality determination unit that determines an abnormality using both the feature amount abnormality score and the reconstructed abnormality score; Equipped with an anomaly score integrating unit that integrates the feature amount anomaly score and the reconstructed anomaly score while maintaining complementarity to calculate an integrated anomaly score; the abnormality determination unit determines an abnormality using the integrated abnormality score. Anomaly detection device.
2. A learning device that trains an anomaly detection device, The abnormality detection device a feature extraction unit that extracts features from an input image; an image reconstruction unit that constructs a reconstructed image from the feature amount; a feature anomaly score calculation unit that calculates a feature anomaly score indicating a distance between the feature and a predetermined center point; a reconstruction anomaly score calculation unit that calculates a reconstruction anomaly score indicating an error between the reconstructed image and the input image; an abnormality determination unit that determines an abnormality using both the feature amount abnormality score and the reconstructed abnormality score; Equipped with The learning device a feature extraction update unit that updates the feature extraction unit using the feature anomaly score as a loss function; an image reconstruction update unit that updates the feature amount extraction unit and the image reconstruction unit using the reconstruction anomaly score as a loss function; a gradient regularizer that updates the image reconstruction unit to regularize the gradient of the image reconstruction unit; A learning device comprising:
3. The gradient regularization unit calculates a Frobenius norm of the Jacobian at the center point of the image reconstruction unit as a gradient regularization term, and updates the image reconstruction unit using the gradient regularization term as a loss function. The learning device according to claim 2 .
4. The gradient regularization unit regularizes the gradient of each layer of the image reconstruction unit by normalizing the parameter of each layer of the image reconstruction unit using the maximum singular value of the parameter. The learning device according to claim 2 .
5. An anomaly detection device as described in claim 1, which has been trained by a learning device as described in any one of claims 2 to 4.
6. A feature extraction step of extracting features from an input image; an image reconstruction step of constructing a reconstructed image from the feature amount; a feature amount anomaly score calculation step of calculating a feature amount anomaly score indicating a distance between the feature amount and a predetermined center point; a reconstruction anomaly score calculation step of calculating a reconstruction anomaly score indicating an error between the reconstructed image and the input image; an anomaly determination step of determining an anomaly using both the feature amount anomaly score and the reconstructed anomaly score; Equipped with an anomaly score integration step of integrating the feature anomaly score and the reconstructed anomaly score while maintaining complementarity to calculate an integrated anomaly score, In the abnormality determination step, an abnormality is determined using the integrated abnormality score. Anomaly detection methods.
7. A learning method for an anomaly detection device, comprising: The abnormality detection device a feature extraction unit that extracts features from an input image; an image reconstruction unit that constructs a reconstructed image from the feature amount; a feature anomaly score calculation unit that calculates a feature anomaly score indicating a distance between the feature and a predetermined center point; a reconstruction anomaly score calculation unit that calculates a reconstruction anomaly score indicating an error between the reconstructed image and the input image; an abnormality determination unit that determines an abnormality using both the feature amount abnormality score and the reconstructed abnormality score; Equipped with The learning method includes: a feature extraction update step of updating the feature extraction unit using the feature anomaly score as a loss function; an image reconstruction updating step of updating the feature amount extraction unit and the image reconstruction unit using the reconstruction anomaly score as a loss function; a gradient regularization step of updating the image reconstructor to regularize the gradient of the image reconstructor; A learning method that includes the following.
8. A computer comprising: A feature extraction function that extracts features from input images, an image reconstruction function for constructing a reconstructed image from the feature amount; a feature anomaly score calculation function for calculating a feature anomaly score indicating a distance between the feature and a predetermined center point; a reconstruction anomaly score calculation function for calculating a reconstruction anomaly score indicating an error between the reconstructed image and the input image; an anomaly determination function that determines an anomaly using both the feature amount anomaly score and the reconstructed anomaly score; To achieve this, further realizing an anomaly score integration function that calculates an integrated anomaly score by integrating the feature anomaly score and the reconstructed anomaly score while maintaining complementarity; The abnormality determination function determines an abnormality using the integrated abnormality score. Anomaly detection programs.
9. A learning program for training an anomaly detection device, comprising: The abnormality detection device a feature extraction unit that extracts features from an input image; an image reconstruction unit that constructs a reconstructed image from the feature amount; a feature anomaly score calculation unit that calculates a feature anomaly score indicating a distance between the feature and a predetermined center point; a reconstruction anomaly score calculation unit that calculates a reconstruction anomaly score indicating an error between the reconstructed image and the input image; an abnormality determination unit that determines an abnormality using both the feature amount abnormality score and the reconstructed abnormality score; Equipped with The learning program On the computer, a feature extraction update function that updates the feature extraction unit using the feature anomaly score as a loss function; an image reconstruction update function that updates the feature extraction unit and the image reconstruction unit using the reconstruction anomaly score as a loss function; a gradient regularization function that updates the image reconstruction unit to regularize the gradient of the image reconstruction unit; A learning program that makes this possible.
Citation Information
Patent Citations
Abnormality detector, learning device, abnormality detection method learning method, abnormality detection program and learning program
JP2018049355A
Inspection support apparatus, inspection support method, inspection support system, inspection apparatus, inspection method, and program
JP2021051702A
Anomaly detection device, learning device, anomaly detection method, learning method, anomaly detection program, and learning program
JP6599294B2
Abnormality detection device, learning device, abnormality detection method, and learning method
US20180082150A1
Systems and methods for object identification
US20190108396A1