Information processing program, information processing method, and information processing device

Abstract

To provide an information processing program, an information processing method, and an information processing apparatus for efficiently performing an out-of-distribution determination.SOLUTION: In an information processing apparatus, an information processing method includes: a feature extractor that generates feature data based on input data; and an OOD estimation unit that, relating to a machine learning model including a first network that performs estimation for the feature data, inputs a feature vector generated by the feature extractor to a second network, outputs a loss estimation result of the machine learning model, and performs an out-of-distribution determination whether the input data is included in a specific domain based on the loss estimation result.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing program, an information processing method, and an information processing device. [Background technology]

[0002] In learning-type AI (Artificial Intelligence), which mainly uses neural networks, a technique called Out-of-Distribution Detection (OOD) judgment is sometimes used. OOD judgment can also be called OOD detection.

[0003] OOD judgment assumes that a machine learning model has been trained by performing empirical risk minimization (ERM) using data samples from a specific domain, and then determines whether another sample given at inference time belongs to that domain.

[0004] Conventional OOD judgment methods utilize the reliability output by a machine learning model for each sample. Specifically, when the reliability is high, the sample is considered to be ID (In-Distribution), and when the reliability is low, it is considered to be OOD. Therefore, conventional OOD judgment methods realize OOD judgment by setting an appropriate threshold for the reliability.

[0005] However, machine learning models can also output high confidence scores for OOD data. Several methods, such as Calibration, Parametric Assumption, Anomaly Detection, and Outlier Exposure, are known to solve the problem of high confidence scores being output for OOD data.

[0006] Calibration prevents an unreasonably high confidence level from being output by aligning the confidence level output by a machine learning model with the accuracy rate of the machine learning model. Specific calibration methods include, for example, ODIN, FocalLoss, and Confidence Learning.

[0007] Parametric Assumption makes statistical assumptions about ID or OOD data, and performs OOD judgments based on how much the assumptions are violated. Mahalanobis, PriorNet, and FSSD are known as specific methods of Parametric Assumption.

[0008] Anomaly Detection performs OOD judgment by utilizing the fact that the model cannot reconstruct unknown data well, mainly in an autoencoder structure network. AnoGAN and Efficient GAN are known as specific methods of Anomaly Detection.

[0009] In the case of outlier exposure, it is assumed that OOD data is also available, even if it is a small amount, and the OOD data is regularized so as not to output high confidence. For example, OE and OECC are known as specific methods for outlier exposure. [Prior art documents] [Patent documents]

[0010] [Patent Document 1] JP 2020-123830 A [Patent Document 2] Special Publication No. 2020-533723 Summary of the Invention [Problem to be solved by the invention]

[0011] However, these conventional OOD judgment methods cannot perform OOD judgment efficiently for several reasons. For example, the OOD judgment accuracy may be low, such as the ODIN and FocalLoss of the calibration described above.

[0012] In addition, OOD decisions may have a negative impact on the performance of the original task. For example, the PriorNet in the Parametric Assumption mentioned above is a case in this case.

[0013] In addition, a completely separate model may be required for OOD judgment, which increases the cost. For example, the AnoGAN for Anomaly Detection mentioned above corresponds to this.

[0014] In addition, in the above-mentioned Outlier Exposure system, it is necessary to use OOD data for training, but it is difficult to comprehensively prepare OOD data for training. In one aspect, an object of the present invention is to enable out-of-distribution determination to be performed efficiently. [Means for solving the problem]

[0015] Therefore, this information processing program generates characteristics based on input data. Vector a feature extractor for generating said feature Vector and a first network that performs inference on the feature generated by the feature extractor. The above The feature vector is input to a second network, and a loss inference result of the machine learning model is output. Based on the loss inference result, an out-of-distribution determination is made as to whether the input data is included in a specific domain. Effect of the Invention

[0016] According to one embodiment, out-of-distribution determination can be performed efficiently. [Brief description of the drawings]

[0017] [Figure 1] FIG. 1 is a diagram illustrating a functional configuration of an information processing apparatus as an example of an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating a process performed by an information processing device according to an embodiment. [Diagram 3] 1 is a flowchart illustrating a process in an information processing device as an example of an embodiment. [Figure 4] FIG. 1 is a diagram illustrating a hardware configuration of an information processing apparatus according to an embodiment; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Hereinafter, the embodiments of the present information processing program, information processing method, and information processing device will be described with reference to the drawings. However, the embodiments shown below are merely examples, and there is no intention to exclude the application of various modified examples and techniques not explicitly stated in the embodiments. In other words, this embodiment can be implemented with various modifications within the scope of its purpose. Furthermore, each figure is not intended to include only the components shown in the figure, but may include other functions, etc.

[0019] (A) Configuration FIG. 1 is a diagram illustrating a functional configuration of an information processing device 1 as an example of an embodiment, and FIG. 2 is a diagram for explaining the processing thereof.

[0020] In the example shown in Fig. 2, the input data is image data, and a classification of the input data is inferred. Hereinafter, the input data may be represented by the symbol x. The input data x is data to be inferred by the first inference processing unit 100 (to be described later), and is also data to be subjected to OOD judgment by the second inference processing unit 300 (to be described later). The information processing device 1 includes a first inference processing unit 100, a second inference processing unit 300, and a training processing unit 200, as shown in FIG.

[0021] The first inference processing unit 100 performs inference using the machine learning model 110. Let the inference in the machine learning model 110 be O(F(x)), and the loss function of the original task be Loss(y, y′). The first inference processing unit 100 inputs input data to the machine learning model 110 and obtains an inference result output by the machine learning model 110. The machine learning model 110 includes a feature extractor 101 and a first network 102, as shown in FIG.

[0022] The feature extractor 101 extracts features from input data. The feature extractor 101 may extract features from the input data by using, for example, a Convolutional Neural Network (CNN). The feature extractor 101 generates a feature vector based on the input data (see symbol P1 in FIG. 2). Hereinafter, the feature vector may be represented by symbol z. The feature vector z generated by the feature extractor 101 is expressed by the following equation (1). z = F(x ; θ f ) ···(1)

[0023] F is a feature extraction function. The feature vector z is obtained by passing the input data x through the feature extraction function F. θ f represents the weight of the function F, and is updated by the optimization processing unit 204 described later when training the machine learning model 110.

[0024] The feature vector generated by the feature extractor 101 is input to the first network 102, which outputs an inference result (see symbol P2 in FIG. 2). Hereinafter, the inference result may be represented by symbol y. The first network 102 may be configured, for example, as a fully connected layer (FC layer) (see symbol P3 in FIG. 2). The first network 102 may be called the final layer 102. The inference result y output by the machine learning model 110 is expressed by the following equation (2). y = O(z ; θo ) ···(2)

[0025] O is a function. The inference result y is obtained by passing the feature vector z through the function O. θ o represents the weights of the final layer O, and is updated by the optimization unit 204 when training the machine learning model 110. The second inference processing unit 300 uses the second network 301 to perform loss inference and OOD inference for the machine learning model 110.

[0026] In general, when a machine learning model is sufficiently trained on a sample, i.e., when the sample is an ID, the model will output a correct inference result with a higher probability. On the other hand, when a machine learning model is not sufficiently trained, the model is more likely to output an incorrect inference result.

[0027] In other words, when a machine learning model outputs a result with a high degree of confidence, the loss is generally small, and when it outputs a result with a low degree of confidence, the loss is large. Also, even if the model outputs a result with a high degree of confidence, the loss is large when the inference result is incorrect. In the present information processing device 1, such characteristics are utilized to explicitly learn OOD judgments for input data. As shown in FIG. 1, the second inference processing unit 300 includes a second network 301 and an OOD inference unit 302 .

[0028] In the second inference processing unit 300, the feature vector generated by the feature extractor 101 of the machine learning model 110 is input to the second network 301, which outputs a loss inference result.

[0029] Hereinafter, the loss inference result by the second network 301 may be represented by the symbol w. In Fig. 2, an example is shown in which the second network 301 performs inference using a three-layer multi-layer fully connected layer (FC layer) (see symbol P4 in Fig. 2).

[0030] The second network 301 is a network that receives the feature vector z generated by the feature extractor 101 of the machine learning model 110 as input and outputs one scalar, and is a different network provided separately from the first network 102. The loss inference result w generated by the second network 301 is expressed by the following equation (3). w = L(z ; θ l ) ···(3)

[0031] L is a function. The loss inference result w is obtained by passing the feature vector z through the function L. θ l are the weights of the network that infers the loss, and are updated by the optimization unit 204 when the second network 301 is trained. The OOD inference unit 302 infers an OOD judgment based on the loss inference result w inferred by the second network 301. That is, the OOD inference unit 302 performs an out-of-distribution judgment as to whether or not the input data x is included in a specific domain based on the loss inference result w inferred by the second network 301.

[0032] The OOD inference unit 302 compares the loss inference result w inferred by the second network 301 with a threshold T, and determines that the input data x is not included in the specific domain (OOD) if the loss inference result w is greater than the threshold T. Also, the OOD inference unit 302 determines that the input data x is included in the specific domain (ID) if the loss inference result w is equal to or less than the threshold T.

[0033] The threshold T is the threshold of the loss inference result w that can best separate ID and OOD, calculated using the validation set. The threshold T may be set arbitrarily by the user. The training processing unit 200 performs training (machine learning) of the machine learning model 110.

[0034] Training data is used to train the machine learning model 110. The training data includes input data and a correct answer to the input data. The training data is prepared in advance by, for example, a user. As shown in FIG. 1, the training processing unit 200 includes a first loss calculation unit 201, a second loss calculation unit 202, a total loss calculation unit 203, and an optimization processing unit 204.

[0035] The first loss calculation unit 201 obtains a correct answer t for the input data x (see reference symbol P5 in FIG. 2). Then, the first loss calculation unit 201 calculates the loss (distance, error) of the input data x for the correct answer t. The loss of the input data x for the correct answer t may be represented by reference symbol l1 (see reference symbol P6 in FIG. 2). The loss l1 is expressed by the following formula (4). l1 = Loss(y,t) (4)

[0036] The loss l1 may be called the first loss l1. The first loss l1 is a loss calculated from the inference result y output by the first network 102 of the machine learning model 110 and the correct answer data t, and represents the loss that actually occurred in the machine learning model 110.

[0037] The second loss calculation unit 202 calculates the L1 distance l2 between the loss inference result w generated by the second network 301 and the first loss l1 calculated by the first loss calculation unit 201 (see symbol P7 in FIG. 2). The L1 distance l2 is expressed by the following formula (5). l2 = |l1 - w| (5) The L1 distance l2 may be called the second loss l2. The second loss l2 represents the loss of the inferred machine learning model 110.

[0038] The total loss calculation unit 203 sums up the first loss l1 calculated by the first loss calculation unit 201 and the second loss l2 calculated by the second loss calculation unit 202 to obtain a total loss l total (See P8 in Figure 2.) total is expressed by the following equation (6). l total = l1 + l2 (6) Total loss l total is the sum of the first loss l1 and the second loss l2, and indicates the cost to be minimized by the optimization processor 204.

[0039] The optimization processing unit 204 optimizes the total loss l calculated by the total loss calculation unit 203. total The gradient that minimizes is calculated, and error backpropagation is performed. For example, the steepest descent method (gradient method) may be used for error backpropagation, and it can be modified as appropriate. total It may also be expressed as / δθ.

[0040] The optimization unit 204 calculates the total loss l total The weight θ that minimizes f ,θ o and θ l The weights θ f ,θ o and θ l The calculation of can be realized using various known methods, and the description thereof will be omitted.

[0041] The optimization processor 204 calculates the weight θ f ,θ o and θ l In other words, the optimization processing unit 204 reflects these calculated parameters (weights θ f ,θ o and θ l ) to calculate the parameters (weights θ f and θ o ) and the parameters of the second network 301 (weights θ l ) are updated respectively. In addition, each weight θ calculated by the optimization processing unit 204 f ,θ o and θ l are stored in a predetermined storage area such as the storage device 13 (see FIG. 4) described later.

[0042] (B) Operation The process of the information processing device 1 as one example of the embodiment configured as described above will be described with reference to the flowchart (steps S1 to S12) shown in FIG.

[0043] In the flowchart shown in FIG. 3, the processes of steps S1 to S6 indicate an inference process for input data, and the processes of steps S1 to S3 and S7 to S12 indicate a training process for the machine learning model 110 (first network 102) and the second network 301.

[0044] First, the inference process for input data in the information processing device 1 will be described. In step S1, the first inference processing unit 100 acquires input data x. In step S2, the feature extractor 101 of the machine learning model 110 extracts features from the input data x, and calculates the feature vector z using the above-mentioned equation (1). In step S3, the second network 301 of the second inference processing unit 300 calculates the loss inference result w by using the above-mentioned formula (3).

[0045] In step S4, the OOD inference unit 302 of the second inference processing unit 300 compares the loss inference result w inferred by the second network 301 with a threshold T, and checks whether the loss inference result w is equal to or smaller than the threshold T.

[0046] If the loss inference result w is equal to or smaller than the threshold value T (see the "True" route in step S4), the OOD inference unit 302 determines in step S6 that the input data x is an ID. Then, the process ends.

[0047] On the other hand, if the result of the check in step S4 indicates that the loss inference result w is greater than the threshold T (see the "False" route in step S4), the OOD inference unit 302 determines in step S5 that the input data x is an OOD. Then, the process ends.

[0048] Next, a training process in the information processing device 1 will be described. In step S1, the first inference processing unit 100 acquires input data x. In step S2, the feature extractor 101 of the machine learning model 110 extracts features from the input data x, and calculates the feature vector z using the above-mentioned equation (1). In step S7, the first network 102 of the machine learning model 110 calculates the inference result y using the above-mentioned formula (2).

[0049] In step S8, the first loss calculation unit 201 of the training processing unit 200 obtains a correct answer t for the input data x. In step S9, the first loss calculation unit 201 calculates the first loss l1 by using the above-mentioned formula (4). In addition, in step S3, the second network 301 of the second inference processing unit 300 calculates the loss inference result w by using the above-mentioned formula (3).

[0050] In step S10, the second loss calculation unit 202 calculates the second loss l2 using the above-mentioned formula (5). Also, the total loss calculation unit 203 calculates the total loss l using the above-mentioned formula (6). total Calculate. In step S11, the optimization unit 204 calculates the total loss l total The weight θ that minimizes f ,θ o and θ l are calculated using backpropagation.

[0051] In step S12, the optimization processor 204 calculates the weight θ f ,θ o and θ l Using this, the parameters (weights θ f and θ o ) and the parameters of the second network 301 (weights θ l ) are updated respectively. Then, the process returns to step S1. The training process may be performed, for example, until a preset number of repetitions is reached, or until the inference accuracy of the machine learning model reaches a predetermined threshold or higher, and may be modified as appropriate.

[0052] (C) Effects In this way, according to the information processing device 1 as an example of the embodiment, the second inference processing unit 300 is provided with the second network 301, so that the OOD judgment itself can be directly learned, and high accuracy can be obtained in the OOD judgment. Moreover, it has been experimentally confirmed that there is almost no degradation in the performance of the original task.

[0053] Furthermore, a second network 301 is provided to which the feature vector generated by the feature extractor 101 of the machine learning model 110 is input, and the loss of the machine learning model 110 is inferred by this second network 301. This eliminates the need to provide a new machine learning model dedicated to inferring OOD, and enables OOD detection to be achieved at low cost. Furthermore, in the present information processing device 1, there is no need to prepare training data for performing OOD inference.

[0054] (D) Other FIG. 4 is a diagram illustrating a hardware configuration of an information processing device 1 as an example of an embodiment.

[0055] The information processing device 1 is a computer and includes, as components, a processor 11, a memory 12, a storage device 13, a graphics processing device 14, an input interface 15, an optical drive device 16, a device connection interface 17, and a network interface 18. These components 11 to 18 are configured to be able to communicate with each other via a bus 19.

[0056] The processor (processing unit) 11 controls the entire information processing device 1. The processor 11 may be a multiprocessor. The processor 11 may be, for example, any one of a CPU, an MPU (Micro Processing Unit), a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). The processor 11 may also be a combination of two or more types of elements among the CPU, MPU, DSP, ASIC, PLD, and FPGA.

[0057] Then, when the processor 11 executes a control program (information processing program, not shown) for the information processing device 1, the functions of the first inference processing unit 100, the training processing unit 200 and the second inference processing unit 300 illustrated in FIG. 1 are realized.

[0058] The information processing device 1 realizes the functions of the first inference processing unit 100, the training processing unit 200 and the second inference processing unit 300 by executing a program (information processing program, OS program) recorded on, for example, a computer-readable non-transitory recording medium.

[0059] The programs describing the processing contents to be executed by the information processing device 1 can be recorded on various recording media. For example, the programs to be executed by the information processing device 1 can be stored in the storage device 13. The processor 11 loads at least a part of the programs in the storage device 13 into the memory 12 and executes the loaded programs.

[0060] The programs to be executed by the information processing device 1 (processor 11) may also be recorded in a non-transitory portable recording medium such as the optical disk 16a, the memory device 17a, or the memory card 17c. The programs stored in the portable recording medium are executable after being installed in the storage device 13, for example, under the control of the processor 11. The processor 11 may also read and execute the programs directly from the portable recording medium.

[0061] The memory 12 is a storage memory including a ROM (Read Only Memory) and a RAM (Random Access Memory). The RAM of the memory 12 is used as a main storage device of the information processing device 1. The RAM temporarily stores at least a part of the program to be executed by the processor 11. The memory 12 also stores various data necessary for processing by the processor 11.

[0062] The storage device 13 is a storage device such as a hard disk drive (HDD), a solid state drive (SSD), a storage class memory (SCM), etc., and stores various data. The storage device 13 is used as an auxiliary storage device of the information processing device 1. An OS program, a control program, and various data are stored in the storage device 13. The control program includes an information processing program.

[0063] As the auxiliary storage device, a semiconductor storage device such as an SCM or a flash memory can also be used. Furthermore, a plurality of storage devices 13 may be used to configure a RAID (Redundant Arrays of Inexpensive Disks).

[0064] The storage device 13 may store various data generated by the first inference processing unit 100, the second inference processing unit 300 and the training processing unit 200.

[0065] A monitor 14a is connected to the graphics processing device 14. The graphics processing device 14 displays an image on the screen of the monitor 14a in accordance with an instruction from the processor 11. Examples of the monitor 14a include a display device using a CRT (Cathode Ray Tube) and a liquid crystal display device.

[0066] A keyboard 15a and a mouse 15b are connected to the input interface 15. The input interface 15 transmits signals sent from the keyboard 15a and the mouse 15b to the processor 11. The mouse 15b is an example of a pointing device, and other pointing devices can also be used. Examples of other pointing devices include a touch panel, a tablet, a touch pad, and a trackball.

[0067] The optical drive device 16 uses a laser beam or the like to read data recorded on an optical disk 16a. The optical disk 16a is a portable, non-transient recording medium on which data is recorded so that it can be read by the reflection of light. Examples of the optical disk 16a include a DVD (Digital Versatile Disk), a DVD-RAM, a CD-ROM (Compact Disc Read Only Memory), and a CD-R (Recordable) / RW (ReWritable).

[0068] The device connection interface 17 is a communication interface for connecting peripheral devices to the information processing device 1. For example, a memory device 17a or a memory reader / writer 17b can be connected to the device connection interface 17. The memory device 17a is a non-transitory recording medium equipped with a communication function with the device connection interface 17, such as a Universal Serial Bus (USB) memory. The memory reader / writer 17b writes data to a memory card 17c or reads data from the memory card 17c. The memory card 17c is a card-type non-transitory recording medium.

[0069] The network interface 18 is connected to a network. The network interface 18 transmits and receives data via the network. Other information processing devices, communication devices, etc. may be connected to the network.

[0070] The disclosed technology is not limited to the above-described embodiment, and may be modified in various ways without departing from the spirit of the present embodiment. Each configuration and each process of the present embodiment may be selected as necessary, or may be combined as appropriate.

[0071] For example, in the above-mentioned embodiment, the OOD inference unit 302 judges whether or not the loss inference result w is OOD by comparing it with the threshold value T, but this is not limited to this and can be implemented in various modified forms. For example, ensemble learning may be performed to integrate the estimation results of one or more other models such as Mahalanobis, ODIN, and FSSD. When using such ensemble learning, logistic regression or the like may be used, which is expected to further improve accuracy. In the present information processing device 1, ensembling with other methods is easy, and even higher accuracy can be achieved.

[0072] In addition, in the above-described embodiment, the input data is image data, and an example is shown in which a classification for this input data is inferred, but the present invention is not limited to this and can be implemented with appropriate modifications.

[0073] Furthermore, in the above-described embodiment, an example has been described in which the feature extractor 101 extracts features of the input data using a Convolutional Neural Network (CNN). However, the present invention is not limited to this example and can be modified as appropriate.

[0074] In the above embodiment, the second network 301 performs inference using a three-layer fully connected layer (FC layer), but the present invention is not limited to this. The second network 301 can be modified as appropriate. Furthermore, the above disclosure enables a person skilled in the art to implement and manufacture the present embodiment.

[0075] (E) Notes Regarding the above embodiment, the following supplementary notes are further disclosed. (Appendix 1) A machine learning model including a feature extractor that generates feature data based on input data, and a first network that performs inference on the feature data, Input the feature vector generated by the feature extractor into a second network, and output the loss inference result of the machine learning model; Based on the loss inference result, an out-of-distribution determination is made as to whether the input data is included in a specific domain. An information processing program that causes a processor to execute a process.

[0076] (Appendix 2) The out-of-distribution determination process determines that the input data is not included in the specific domain when the loss inference result is greater than a threshold, and determines that the input data is included in the specific domain when the loss inference result is equal to or less than the threshold. 2. The information processing program according to claim 1,

[0077] (Appendix 3) A machine learning model including a feature extractor that generates feature data based on input data and a first network that performs inference on the feature data is trained using training data including sample data and correct answer data included in a specific domain, causing the feature extractor to generate feature data based on the sample data; causing the first network to perform inference on the feature data based on the sample data and output an inference result; performing a first calculation to calculate a first loss of the inference result for the ground truth data; a second network that outputs a loss inference result of the machine learning model based on the feature vector generated by the feature extractor, and causes the second network to perform a second calculation to calculate an L1 distance between the loss inference result output by performing inference on the feature data based on the sample data and the first loss calculated by the first calculation; Calculate each parameter of the machine learning model and the second network by finding a gradient that minimizes the first loss and the L1 distance and backpropagating the error. An information processing program that causes a processor to execute a process.

[0078] (Appendix 4) A machine learning model including a feature extractor that generates feature data based on input data, and a first network that performs inference on the feature data, Input the feature vector generated by the feature extractor into a second network, and output the loss inference result of the machine learning model; Based on the loss inference result, an out-of-distribution determination is made as to whether the input data is included in a specific domain. An information processing method, characterized in that processing is executed by a processor.

[0079] (Appendix 5) The out-of-distribution determination process determines that the input data is not included in the specific domain when the loss inference result is greater than a threshold, and determines that the input data is included in the specific domain when the loss inference result is equal to or less than the threshold. 5. The information processing method according to claim 4.

[0080] (Appendix 6) A machine learning model including a feature extractor that generates feature data based on input data and a first network that performs inference on the feature data is trained using training data including sample data and correct answer data included in a specific domain, The feature extractor generates feature data based on the sample data; The first network performs inference on the feature data based on the sample data and outputs an inference result; performing a first calculation to calculate a first loss of the inference result for the ground truth data; A second network that outputs a loss inference result of the machine learning model based on the feature vector generated by the feature extractor performs a second calculation to calculate an L1 distance between the loss inference result output by performing inference on the feature data based on the sample data and the first loss calculated by the first calculation; Calculate each parameter of the machine learning model and the second network by finding a gradient that minimizes the first loss and the L1 distance and backpropagating the error. An information processing method, characterized in that processing is executed by a processor.

[0081] (Appendix 7) A machine learning model including a feature extractor that generates feature data based on input data, and a first network that performs inference on the feature data, Input the feature vector generated by the feature extractor into a second network, and output the loss inference result of the machine learning model; Based on the loss inference result, an out-of-distribution determination is made as to whether the input data is included in a specific domain. An information processing device comprising a processing unit.

[0082] (Appendix 8) The out-of-distribution determination process determines that the input data is not included in the specific domain when the loss inference result is greater than a threshold, and determines that the input data is included in the specific domain when the loss inference result is equal to or less than the threshold. 8. The information processing device according to claim 7.

[0083] (Appendix 9) A machine learning model including a feature extractor that generates feature data based on input data and a first network that performs inference on the feature data is trained using training data including sample data and correct answer data included in a specific domain, causing the feature extractor to generate feature data based on the sample data; causing the first network to perform inference on the feature data based on the sample data and output an inference result; performing a first calculation to calculate a first loss of the inference result for the ground truth data; A second network that outputs a loss inference result of the machine learning model based on the feature vector generated by the feature extractor performs a second calculation to calculate an L1 distance between the loss inference result output by performing inference on the feature data based on the sample data and the first loss calculated by the first calculation; Calculate each parameter of the machine learning model and the second network by finding a gradient that minimizes the first loss and the L1 distance and backpropagating the gradient. An information processing device comprising a processing unit. [Explanation of symbols]

[0084] 1. Information processing device 11 Processor (processing unit) 12. Memory 13 Storage device 14 Graphics Processing Unit 14a Monitor 15 Input Interface 15a Keyboard 15b Mouse 16 Optical drive device 16a Optical disc 17 Device connection interface 17a Memory Device 17b Memory Reader / Writer 17c Memory Card 18 Network Interface 18a Network 19 Bus 100 First inference processing unit 101 Feature Extractor 102 Network No. 1 110 Machine Learning Models 200 Training Processing Unit 201 First Loss Calculation Section 202 Second Loss Calculation Section 203 Total Loss Calculation Unit 204 Optimization Processing Unit 300 Second inference processing unit 301 Second Network 302 OOD Reasoning Department

Claims

1. A machine learning model including a feature extractor that generates a feature vector based on input data, and a first network that performs inference on the feature vector, Input the feature vector generated by the feature extractor into a second network, and output a loss inference result of the machine learning model; Based on the loss inference result, an out-of-distribution determination is made as to whether the input data is included in a specific domain. An information processing program that causes a processor to execute a process.

2. The out-of-distribution determination process determines that the input data is not included in the specific domain when the loss inference result is greater than a threshold, and determines that the input data is included in the specific domain when the loss inference result is equal to or less than the threshold.

2. The information processing program according to claim 1,

3. When a machine learning model including a feature extractor that generates a feature vector based on input data and a first network that performs inference on the feature vector is trained using training data including sample data and correct answer data included in a specific domain, causing the feature extractor to generate a feature vector based on the sample data; causing the first network to perform inference on the feature vector based on the sample data and output an inference result; performing a first calculation to calculate a first loss of the inference result for the ground truth data; a second network that outputs a loss inference result of the machine learning model based on the feature vector generated by the feature extractor, and causes the second network to perform a second calculation to calculate an L1 distance between the loss inference result output by performing inference on the feature vector based on the sample data and the first loss calculated by the first calculation; Calculate each parameter of the machine learning model and the second network by finding a gradient that minimizes the first loss and the L1 distance and backpropagating the error. An information processing program that causes a processor to execute a process.

4. A machine learning model including a feature extractor that generates a feature vector based on input data, and a first network that performs inference on the feature vector, Input the feature vector generated by the feature extractor into a second network, and output a loss inference result of the machine learning model; Based on the loss inference result, an out-of-distribution determination is made as to whether the input data is included in a specific domain. An information processing method, characterized in that processing is executed by a processor.

5. When a machine learning model including a feature extractor that generates a feature vector based on input data and a first network that performs inference on the feature vector is trained using training data including sample data and correct answer data included in a specific domain, The feature extractor generates a feature vector based on the sample data; The first network performs inference on the feature vector based on the sample data and outputs an inference result; performing a first calculation to calculate a first loss of the inference result for the ground truth data; A second network that outputs a loss inference result of the machine learning model based on the feature vector generated by the feature extractor performs a second calculation to calculate an L1 distance between the loss inference result output by performing inference on the feature vector based on the sample data and the first loss calculated by the first calculation; By finding a gradient that minimizes the first loss and the L1 distance and backpropagating the error, Calculating parameters of the machine learning model and the second network An information processing method, characterized in that processing is executed by a processor.

6. A machine learning model including a feature extractor that generates a feature vector based on input data, and a first network that performs inference on the feature vector, Input the feature vector generated by the feature extractor into a second network, and output a loss inference result of the machine learning model; Based on the loss inference result, an out-of-distribution determination is made as to whether the input data is included in a specific domain. An information processing device comprising a processing unit.

7. When a machine learning model including a feature extractor that generates a feature vector based on input data and a first network that performs inference on the feature vector is trained using training data including sample data and correct answer data included in a specific domain, causing the feature extractor to generate a feature vector based on the sample data; causing the first network to perform inference on the feature vector based on the sample data and output an inference result; performing a first calculation to calculate a first loss of the inference result for the ground truth data; A second network that outputs a loss inference result of the machine learning model based on the feature vector generated by the feature extractor performs a second calculation to calculate an L1 distance between the loss inference result output by performing inference on the feature vector based on the sample data and the first loss calculated by the first calculation; Calculate each parameter of the machine learning model and the second network by finding a gradient that minimizes the first loss and the L1 distance and backpropagating the error. An information processing device comprising a processing unit.

Images