Mathematical formula specification device, mathematical formula specification method, estimation device and estimation method

Abstract

To provide a technique for formulating an arithmetic process of a trained model.SOLUTION: A formula identification device (1) is provided, comprising one or more processors configured to perform an identification step (M12) of identifying a nonlinear formula representing a relationship between a numerical value representing input data of a trained model and a numerical value representing output data of the trained model.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an apparatus and method for formulating the computational process of a trained model, and also to an apparatus and method for estimating the output of the trained model using such a formula. [Background technology]

[0002] The use of third-generation AI using deep neural networks (DNN) is being promoted in society. DNNs are used, for example, for image recognition of still and video images, speech recognition, natural language processing such as machine translation, and anomaly detection processing to detect signs of abnormalities from time-series data from sensors attached to industrial equipment.

[0003] DNN is a neural network that corresponds to deep learning and has a deeper network hierarchy. DNN includes multiple layers including an input layer, multiple hidden layers, and an output layer, and each layer is structured with multiple nodes connected by edges. Each layer has a function called an activation function, and edges can have weights. The output value of each node is calculated from the output value of the node in the previous layer that is connected to that node. In other words, the output value of each node is calculated from the output value of the node in the previous layer, the weight value of the connecting edge, and the activation function of the layer.

[0004] However, since DNNs have a multi-layered learning process for the perceptron layer, when an output value is obtained from an input value, humans may not understand why that output value was obtained. Since there are various types of calculation methods in DNNs and the contents are complex, it is difficult to visualize the calculation process in a way that users can understand.

[0005] To solve this problem, for example, Patent Document 1 describes a technique for visualizing the computational process of DNNs, in which a linear expression is obtained by using a dimension reduction algorithm such as a principal component analysis algorithm or a least squares method on a group of output values. The technique described in Patent Document 1 allows humans to explicitly understand what computations are being performed inside the DNN, so that users can know which parameters and weights they should adjust the next time they use it. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2019-46453 A (Published on March 22, 2019) Summary of the Invention [Problem to be solved by the invention]

[0007] However, the method described in Patent Document 1 uses a dimensionality reduction algorithm, which is a linear algorithm, and the range of computational expression, formulation, and visualization is narrow, so it may be difficult to formulate and visualize the internal computational process of a DNN.

[0008] One aspect of the present invention has been made in consideration of the above problems, and aims to realize a technology for mathematically formulating the computational process of a trained model. [Means for solving the problem]

[0009] In order to solve the above problems, a mathematical formula identification device according to an aspect of the present invention includes one or more processors that execute an identification step. Also, a mathematical formula identification method according to an aspect of the present invention includes an identification step. The identification step is a step of identifying a nonlinear mathematical formula that represents a relationship between a numerical value representing input data of a trained model and a numerical value representing output data of the trained model.

[0010] Moreover, an estimation device according to an aspect of the present invention includes one or more processors that execute a second estimation step. Moreover, an estimation method according to an aspect of the present invention includes a second estimation step. The second estimation step is a step of estimating a numerical value representing the output data by substituting a numerical value representing the input data into the nonlinear mathematical formula identified by the above-mentioned mathematical formula identification method and performing a calculation. Effect of the Invention

[0011] According to the mathematical formula identification device and the mathematical formula identification method of one aspect of the present invention, it is possible to mathematically express the calculation process of a trained model. Also, according to the estimation device and the estimation method of one aspect of the present invention, it is possible to estimate the output of the trained model using the mathematical formula identified by the mathematical formula identification device and the mathematical formula identification method. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram showing a configuration of an arithmetic formula system according to an embodiment of the present invention. [Diagram 2] 2 is a block diagram showing a configuration of a mathematical formula specifying device included in the arithmetic formula generating system of FIG. 1. [Diagram 3] 3 is a flowchart showing the flow of a mathematical formula specifying method implemented by the mathematical formula specifying device of FIG. 2. [Figure 4] FIG. 1 illustrates an example of a trained model and a genetic algorithm. [Diagram 5] 4 is a flowchart showing the flow of specific steps in FIG. 3. [Figure 6] 10 is a flowchart showing a flow of processing performed by a mathematical formula identification device. [Figure 7] FIG. 13 is a diagram illustrating an example of the contents of a crossover. [Figure 8] FIG. 1 illustrates the contents of a subtree mutation. [Figure 9] FIG. 1 illustrates the content of a hoist mutation. [Figure 10] FIG. 1 illustrates the contents of point mutations. [Figure 11]FIG. 1 illustrates an example of a trained model and a genetic algorithm. [Figure 12] 4 is a flowchart showing the flow of specific steps in FIG. 3. [Figure 13] FIG. 2 is a block diagram showing a configuration of an estimation device included in the arithmetic formulation system of FIG. 1. [Figure 14] 14 is a flowchart showing the flow of an estimation method implemented by the estimation device of FIG. 13. [Figure 15] FIG. 2 is a block diagram showing a configuration of a machine learning device included in the arithmetic formula system of FIG. 1. [Figure 16] 16 is a flowchart showing the flow of a machine learning method implemented by the machine learning device of FIG. 15 . [Figure 17] FIG. 2 is a diagram showing a configuration of a casting phase. [Figure 18] FIG. 1 illustrates an example of a trained model and a genetic algorithm. [Figure 19] FIG. 1 illustrates an example of a trained model and a genetic algorithm. [Figure 20] FIG. 1 illustrates an example of a trained model and a genetic algorithm. [Figure 21] FIG. 1 illustrates an example of a trained model and a genetic algorithm. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] [Embodiment 1] [Calculation Formula System] An operation formula system S according to one embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 is a diagram showing the configuration of the operation formula system S.

[0014] The arithmetic formula system S is a system that specifies a nonlinear formula that expresses the relationship between the input and output of the trained model LM1. As shown in FIG. 1, the arithmetic formula system S includes a formula specification device 1, a machine learning device 2, and an estimation device 3.

[0015] The mathematical formula identification device 1 is a device that performs a mathematical formula identification method M1. The mathematical formula identification method M1 includes an estimation step M11 in which the mathematical formula identification device 1 estimates output data from input data using a trained model LM1 constructed by machine learning, and an identification step M12 in which a nonlinear mathematical formula f that represents a relationship between a numerical value representing input data and a numerical value representing output data is identified by nonlinear regression using a genetic algorithm GA. As the trained model LM1, for example, an algorithm such as a neural network model such as a convolutional neural network or a recurrent neural network, a regression model such as a linear regression, or a tree model such as a regression tree can be used. The configuration of the mathematical formula identification device 1 and the flow of the mathematical formula identification method M1 will be described in detail below with reference to the drawings.

[0016] Various data may be used as the input of the trained model LM1. For example, the input of the trained model LM1 may be image data representing still or moving images, audio data representing audio, document data representing documents, or time-series data of sensors attached to industrial equipment. For example, the input of the trained model LM1 may be various parameters collected in a casting line.

[0017] Various data can be used as the output of the trained model LM1. For example, the output of the trained model LM1 is an image recognition result, a voice recognition result, a machine translation result, or the presence or absence of anomalies. In addition, the output of the trained model LM1 is, for example, a target value for the CB value (compactability) of molding sand in a casting line.

[0018] The mathematical formula identification device 1 includes a data collection device 111. The data collection device 111 temporarily holds input data to the trained model LM1 and output data from the trained model LM1, and inputs the held input data and output data to the next stage genetic algorithm GA. The data collection device 111 is, for example, a buffer equipped with information storage means such as a semiconductor memory or a hard disk and input / output means. Note that, although the example of FIG. 1 illustrates a configuration in which the data collection device 111 is included in the mathematical formula identification device 1, the data collection device 111 may be configured as a device separate from the mathematical formula identification device 1. The data collection device 111 may be configured as a single piece of hardware, or may be configured as a combination of hardware and software.

[0019] The machine learning device 2 is a device for implementing the machine learning method M2. The machine learning method M2 is a method for constructing a learning dataset DS using input data and constructing a trained model LM1 by machine learning (supervised learning) using the learning dataset DS. Details of the configuration of the machine learning device 2 and the flow of the machine learning method M2 will be described later with reference to the accompanying drawings.

[0020] The estimation device 3 is a device for implementing the estimation method M3. The estimation method M3 includes a second estimation step in which the estimation device 3 estimates a numerical value representing output data by substituting a numerical value representing input data into the nonlinear mathematical formula f identified by the mathematical formula identification method M1 and performing an operation. The configuration of the estimation device 3 and the flow of the estimation method M3 will be described in detail below with reference to the accompanying drawings.

[0021] The arithmetic formula system S executes a learning phase, a formula specification phase, and an estimation phase. The learning phase, the formula specification phase, and the estimation phase will be briefly described below.

[0022] (1) Learning Phase In the learning phase, a trained model LM1 is constructed. The machine learning device 2 creates training data from input data and output data, and adds the created training data to the training dataset DS. The machine learning device 2 also constructs the trained model LM1 by machine learning using the training data DS. The constructed trained model LM1 is transferred from the machine learning device 2 to the mathematical formula identification device 1.

[0023] (2) Formula Identification Phase In the mathematical formula identification phase, the mathematical formula identification device 1 estimates output data based on input data using the trained model LM1. The mathematical formula identification device 1 also identifies a nonlinear mathematical formula that represents the relationship between the numerical values ​​representing the input data and the numerical values ​​representing the output data of the trained model LM1 by nonlinear regression using a genetic algorithm.

[0024] (3) Estimation Phase In the estimation phase, the estimation device 3 estimates a numerical value representing the output data by performing a calculation by substituting a numerical value representing the input data into the mathematical formula identified by the mathematical formula identification device 1. That is, the estimation device 3 estimates the output data from the input data without using the learned model LM1.

[0025] [Configuration of the mathematical formula identification device] The configuration of the mathematical expression identification device 1 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the configuration of the mathematical expression identification device 1.

[0026] The mathematical expression identification device 1 is realized using a general-purpose computer, and includes a processor 11, a primary memory 12, a secondary memory 13, an input / output interface 14, a communication interface 15, and a bus 16. The processor 11, the primary memory 12, the secondary memory 13, the input / output interface 14, and the communication interface 15 are connected to each other via the bus 16.

[0027] The secondary memory 13 stores a mathematical formula identification program P1 and a trained model LM1. The processor 11 expands the mathematical formula identification program P1 and the trained model LM1 stored in the secondary memory 13 onto the primary memory 12. The processor 11 then executes each step included in the mathematical formula identification method M1 according to instructions included in the mathematical formula identification program P1 expanded onto the primary memory 12. The trained model LM1 expanded onto the primary memory 12 is used when the processor 11 executes an estimation step M11 (described later) of the mathematical formula identification method M1. Note that the mathematical formula identification program P1 being stored in the secondary memory 13 refers to a source code or an executable file obtained by compiling the source code being stored in the secondary memory 13. Also, the trained model LM1 being stored in the secondary memory 13 refers to a parameter defining the trained model LM1 being stored in the secondary memory 13.

[0028] Examples of devices that can be used as the processor 11 include a central processing unit (CPU), a graphic processing unit (GPU), a digital signal processor (DSP), a micro processing unit (MPU), a floating point number processing unit (FPU), a physics processing unit (PPU), a microcontroller, or a combination of these. The processor 11 is also called a "computing device."

[0029] Moreover, a device that can be used as the primary memory 12 may be, for example, a semiconductor RAM (Random Access Memory). The primary memory 12 may also be called a "main memory". Moreover, a device that can be used as the secondary memory 13 may be, for example, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), an optical disk drive (ODD), a floppy (registered trademark) disk drive (FDD), or a combination thereof. The secondary memory 13 may also be called an "auxiliary memory". The secondary memory 13 may be built in the mathematical expression identification device 1, or may be built in another computer (for example, a computer constituting a cloud server) connected to the mathematical expression identification device 1 via the input / output interface 14 or the communication interface 15. In this embodiment, the storage in the mathematical expression identification device 1 is realized by two memories (the primary memory 12 and the secondary memory 13), but is not limited to this. In other words, the storage in the mathematical expression identification device 1 may be realized by one memory. In this case, for example, one storage area of ​​the memory may be used as the primary memory 12 and another storage area of ​​the memory may be used as the secondary memory 13.

[0030] An input device and / or an output device are connected to the input / output interface 14. Examples of the input / output interface 14 include interfaces such as USB (Universal Serial Bus), ATA (Advanced Technology Attachment), SCSI (Small Computer System Interface), and PCI (Peripheral Component Interconnect). Examples of input devices connected to the input / output interface 14 include a group of sensors provided in a casting line. Data acquired from the group of sensors in the mathematical formula identification method M1 is input to the mathematical formula identification device 1 and stored in the primary memory 12. Examples of input devices connected to the input / output interface 14 include a keyboard, a mouse, a touchpad, a microphone, or a combination of these. Data acquired from a user in the mathematical formula identification method M1 is input to the mathematical formula identification device 1 through these input devices and stored in the primary memory 12. Examples of output devices connected to the input / output interface 14 include a display, a projector, a printer, a speaker, a headphone, or a combination of these. Information provided to a user in the mathematical formula identification method M1 is output from the mathematical formula identification device 1 through these output devices. The mathematical expression identification device 1 may incorporate a keyboard functioning as an input device and a display functioning as an output device, like a laptop computer, or may incorporate a touch panel functioning as both an input device and an output device, like a tablet computer.

[0031] The communication interface 15 is connected to other computers by wire or wirelessly via a network. Examples of the communication interface 15 include interfaces such as Ethernet (registered trademark) and Wi-Fi (registered trademark). Examples of available networks include a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a global area network (GAN), or an internetwork including these networks. The internetwork may be an intranet, an extranet, or the Internet. Data (e.g., trained model LM1) acquired by the mathematical formula identification device 1 from another computer (e.g., machine learning device 2) in the mathematical formula identification method M1, and data provided by the mathematical formula identification device 1 to another computer in the mathematical formula identification method M1 are transmitted and received via these networks.

[0032] In this embodiment, a configuration is adopted in which the mathematical formula identification method M1 is executed using a single processor (processor 11), but the present invention is not limited to this. That is, a configuration may be adopted in which the mathematical formula identification method M1 is executed using multiple processors. In this case, the multiple processors that execute the mathematical formula identification method M1 in cooperation with each other may be provided in a single computer and configured to be able to communicate with each other via a bus, or may be provided in a distributed manner in multiple computers and configured to be able to communicate with each other via a network. As an example, a mode in which a processor built in a computer that constitutes a cloud server and a processor built in a computer owned by a user of the cloud server execute the mathematical formula identification method M1 in cooperation with each other may be considered.

[0033] In addition, in this embodiment, a configuration is adopted in which the trained model LM1 is stored in a memory (secondary memory 13) built into the same computer as the processor (processor 11) that executes the mathematical expression identification method M1, but the present invention is not limited to this. That is, a configuration may be adopted in which the trained model LM1 is stored in a memory built into a computer different from the processor that executes the mathematical expression identification method M1. In this case, the computer with the built-in memory for storing the trained model LM1 is configured to be able to communicate with the computer with the built-in processor that executes the mathematical expression identification method M1 via a network. As an example, a mode in which the trained model LM1 is stored in a memory built into a computer constituting a cloud server, and a processor built into a computer owned by a user of the cloud server executes the mathematical expression identification method M1, etc., can be considered.

[0034] In addition, in this embodiment, a configuration in which the trained model LM1 is stored in a single memory (secondary memory 13) is adopted, but the present invention is not limited to this. That is, a configuration in which the trained model LM1 is distributed and stored in multiple memories may be adopted. In this case, the multiple memories that store the trained model LM1 may be provided in a single computer (which may or may not be a computer with a processor that executes the mathematical formula identification method M1 built in), or may be distributed and provided in multiple computers (which may or may not include a computer with a processor that executes the mathematical formula identification method M1). As an example, a configuration in which the trained model LM1 is distributed and stored in memories built in each of multiple computers that constitute a cloud server is conceivable.

[0035] When the data collection device 111 is configured as a device separate from the mathematical expression identifying device 1, the data collection device 111 includes, for example, a memory (not shown) and a processor (not shown).

[0036] [Flow of formula identification method] The flow of the mathematical formula identification method M1 will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the flow of the mathematical formula identification method M1. The mathematical formula identification method M1 includes an estimation step M11 and an identification step M12.

[0037] The estimation step M11 is a step in which the processor 11 estimates output data from input data using the trained model LM1. In the estimation step M11, the processor 11 inputs the input data to the trained model LM1 to obtain output data. The input data input to the trained model LM1 and the output data output from the trained model LM1 are temporarily stored in the data collection device 111. The data stored in the data collection device 111 is used in the subsequent identification step M12.

[0038] 3 is a step in which the processor 11 identifies a nonlinear formula expressing the relationship between the numerical values ​​expressing the input data and the numerical values ​​expressing the output data by nonlinear regression using the genetic algorithm GA. The data collection device 111 inputs the temporarily stored input data and output data of the trained model LM1 in time synchronization with the genetic algorithm GA. In this way, the data collection device 111 operates as a kind of buffer that collects the data of the trained model LM1 (in certain information units) and inputs it to the next stage of the genetic algorithm GA.

[0039] The genetic algorithm GA is an algorithm that prepares a plurality of individuals i, each of which represents a candidate solution by genes, and searches for a solution by repeating operations such as crossover and mutation, by preferentially selecting an individual i with high fitness Di. In this embodiment, the individual i is a nonlinear mathematical expression (relational expression) expressed in a tree structure, and the operators and arguments included in the mathematical expression are represented by the nodes of the tree. The fitness Di is given by a fitness function.

[0040] [Example 1 of trained model and genetic algorithm] FIG. 4 is a diagram illustrating a trained model LM1 and a genetic algorithm GA. The trained model LM1 is a deep neural network composed of multiple layers. The trained model LM1 includes multiple layers, including an input layer LX to which input data is input, a hidden layer LY, and an output layer LZ to which output data is output. Each layer has a structure in which multiple nodes are connected by edges.

[0041] Each layer has a function called an activation function, and edges can have weights. The output value of each node is calculated from the output value of the node in the previous layer that is connected to that node. In other words, the output value of each node is calculated from the output value of the node in the previous layer, the weight value of the connecting edge, and the activation function of the layer.

[0042] 4, the input layer LX includes nodes X1, X2, X3, and X4. That is, in this example, the input data input to the trained model LM1 includes output values ​​x1, x2, x3, and x4 of the nodes X1, X2, X3, and X4.

[0043] The hidden layer LY includes nodes Y1, Y2, and Y3. The output values ​​y1, y2, and y3 of the nodes Y1, Y2, and Y3 are calculated from the output values ​​x1, x2, x3, and x4 of the nodes of the input layer LX, which is the layer before the hidden layer LY.

[0044] The output layer LZ includes a node Z1. The output value z1 of the node Z1 is calculated from the output values ​​y1, y2, and y3 of the nodes in the hidden layer LY, which is the layer before the output layer LZ. That is, in this example, the output data of the trained model LM1 is the output value z1 of the node Z1.

[0045] The data collection device 111 temporarily holds input data to the trained model LM1 and output data from the trained model LM1, and sequentially inputs the input data and output data to the next stage of the genetic algorithm GA.

[0046] The genetic algorithm GA includes a first generation G1 to a fourth generation G4. In the example of Fig. 4, a nonlinear mathematical expression that is an individual i is expressed, for example, by the following formula (1). z1=f0(x1,x2,x3,x4) …(1)

[0047] In formula (1), z1 is a numerical value representing the output value of node Z1 of the trained model LM1, i.e., the output data. x1, x2, x3, and x4 are numerical values ​​representing the output values ​​of each node of the input layer LX, i.e., the input data. That is, formula (1) is a formula representing the relationship between the output values ​​x1, x2, x3, and x4 of each node of the input layer LX and the output value z1 of node Z1 of the output layer LZ. As shown in formula (1), the processor 11 identifies a nonlinear formula by nonlinear regression using a genetic algorithm in which a nonlinear formula (relational formula) representing the relationship between input data and output data is set as a candidate solution.

[0048] FIG. 5 is a flow chart illustrating the flow of the identifying step M12 executed by the processor 11. The processor 11 executes the identifying step M12 using a predetermined module (hereinafter referred to as "A module"). The A module is a module that executes a genetic algorithm. In the A module, the processor 11 starts by creating a population of simple random formulas that represent the relationship between known independent variables and their dependent variable targets to predict new data. The processor 11 then evolves the population to generate the next generation of the population by selecting the most suitable individual from the population to be subjected to genetic manipulation. Through the above operations, a formula that best represents the above relationship is identified.

[0049] In this specific example, a module that executes genetic programming is used as module A. Genetic programming is an extension of genetic algorithms, and uses a tree structure as an expression of a genotype. Note that the flow of the identifying step M12 shown in FIG. 5 is an example, and the method of identifying a formula using the genetic algorithm GA is not limited to the method shown in FIG. 5. Various other methods can be adopted as the method of identifying a formula using the genetic algorithm GA.

[0050] In step M121, the processor 11 acquires input data and output data of the trained model LM1 from the data collection device 111. The input data includes output values ​​x1, x2, x3, and x4 of each node of the input layer LX of the trained model LM1. The output data includes the value z1 of the node Z1 of the output layer LZ.

[0051] In step M122, the processor 11 acquires parameters used in the genetic algorithm GA. The parameters include, for example, the number of individuals to be generated N, the tournament size Nt, the crossover probability Pc, the mutation probability Pms, the number of evolutionary generations Ng, the operator Oj used in the syntax tree, the maximum depth d of the syntax tree, and the event occurrence probabilities Pk1 to Pk5. The values ​​of the parameters are input to the mathematical formula identification device 1 by, for example, the user.

[0052] The number of generated individuals N represents the number of individuals i to be included in the set. The tournament size Nt is the number of individuals i to be randomly selected from the current generation set. The mutation probability Pms is the probability that a gene will mutate. Operators Oi used in the syntax tree are, for example, Max, Min, sqrt (root), log (natural logarithm), +, -, ×, ÷, sin (radians), cos (radians), tan (radians), abs, neg, and inv. Max is an operator that selects the maximum value. Min is an operator that selects the minimum value. neg is an operator that makes the sign negative. inv is an operator that sets arguments close to zero to 0.

[0053] Event occurrence probabilities Pk1 to Pk5 are probabilities that operations m1 to m5 are selected as operations for evolving the next-generation set. Processor 11 evolves the next-generation set by one of operations m1 to m5. The sum of event occurrence probabilities Pk1 to Pk5 is 1. As an example, the values ​​of event occurrence probabilities Pk1, Pk2, Pk3, Pk4, and Pk5 are "0.1", "0.2", "0.3", "0.4", and "0.1", respectively. Operations m1 to m5 will be described later with reference to different drawings.

[0054] In step M123, processor 11 randomly generates N individuals i based on specified parameters (the operator Oi to be used in the syntax tree, the maximum depth d of the syntax tree, etc.) and generates a set of N individuals i that will become the initial current generation.

[0055] In step M124, the processor 11 calculates the fitness Di of each individual i included in the set of the current generation. The fitness Di is given by a fitness function.

[0056] In step M125, processor 11 randomly selects individuals i of the tournament size Nt from the set of the current generation, selects the individual i with the highest fitness Di among them, and adds it to the set of the next generation. The individual i selected in step M125, i.e., the individual i added to the set of the next generation, is also called the "winner tree."

[0057] Processor 11 repeats the process of step M125 until the number of individuals in the next generation becomes N, the same as the current generation, that is, while the number of individuals in the next generation has not reached N (step M126; NO). When the number of individuals in the next generation reaches N (step M126; YES), processor 21 executes the process of step M127.

[0058] In step M127, the processor 11 executes a process of evolving the next generation set. Details of step M127 will be described later with reference to another drawing.

[0059] In step M130, the processor 11 overwrites the next-generation set to the current-generation set. In step M131, the processor 11 determines whether the number of evolutionary generations Ng has been reached. If the number of evolutionary generations Ng has not been reached (step M131; NO), the processor 11 returns to the processing of step M124. On the other hand, if the number of evolutionary generations Ng has been reached (step M131; YES), the processor 11 proceeds to the processing of step M132.

[0060] In step M132, the processor 11 identifies an individual i having the highest fitness Di from among the individuals i included in the set of the current generation. In step M133, the processor 11 outputs the identified individual i as an optimal solution. For example, the processor 11 displays on a display a formula that is the selected individual i, or a figure (such as a graph) that represents the formula.

[0061] FIG. 6 is a flow chart illustrating the flow of step M127 executed by the processor 11. In step M201, the processor 11 selects one of the operations m1 to m5 based on the event occurrence probabilities Pk1 to Pk5 set by the user. If the operation m1 is selected (step M201; "operation m1"), the processor 11 proceeds to the process of step M202. If the operation m2 is selected (step M201; "operation m2"), the processor 11 proceeds to the process of step M211. If the operation m3 is selected (step M201; "operation m3"), the processor 11 proceeds to the process of step M221. If the operation m4 is selected (step M201; "operation m4"), the processor 11 proceeds to the process of step M231. If the operation m5 is selected (step M201; "operation m5"), the processor 11 ends the process.

[0062] Operation m1 is a crossover. Crossover is a method of mixing genetic material between individuals. In the case of crossover, in step M202, processor 11 randomly selects subtrees included in each winning tree for the winning trees included in the next generation set.

[0063] In step M203, the processor 11 generates a next-generation set for donors. The processing content of step M203 is the same as the processing content of steps M123 to M125 in FIG. 6. That is, the processor 11 first randomly generates N individuals i based on individual parameters designated by the user, and generates a set of N individuals i (hereinafter referred to as a "donor set"). Next, the processor 11 calculates the fitness Di of each of the individuals i included in the donor set. Next, the processor 11 randomly extracts individuals i in a number equal to the tournament size Nt from the donor set, selects the individual i with the highest fitness Di among them, and adds it to the donor set of the next generation. The individual i selected by this processing is also referred to as a "donor tree". The processor 11 repeats the donor tree selection processing until the number of donor trees of the next generation reaches N.

[0064] In step M204, processor 11 randomly selects a subtree included in the donor tree (hereinafter referred to as a "donor subtree").

[0065] In step M205, processor 11 replaces the subtrees in the winning tree. In this embodiment, processor 11 removes the subtree selected in step M202 from the winning tree, and transplants the donor subtree selected in step M203 into the location where the subtree was. That is, processor 11 replaces the subtree included in the winning tree with the donor subtree. The winning tree with the replaced subtree becomes the next generation descendant (individual).

[0066] Operation m2 is an operation for mutating a subtree. By mutating a subtree, extinct functions and operators can be reintroduced into the population to maintain diversity. In this case, in step M211, processor 11 randomly selects a subtree to be included in the winning tree.

[0067] In step M212, processor 11 randomly generates a subtree. In step M213, processor 11 replaces the subtrees in the winning tree. In this embodiment, processor 11 removes the subtree selected in step M202 from the winning tree, and transplants the subtree generated in step M212 into the location of the removed subtree. That is, processor 11 replaces the subtree included in the winning tree with the subtree generated in step M212. The winning tree with the replaced subtree becomes the next generation descendant (individual).

[0068] Operation m3 is hoist mutation. Hoist mutation is a mutation operation that fights tree bloat. In step M221, the processor randomly selects a subtree to be included in the winning tree. In step M222, processor 11 randomly selects a subtree to be included in the subtree selected in step M221.

[0069] In step M223, processor 11 rolls up the subtree selected in step M222 to the position of the original subtree (the subtree selected in step M221). The winning tree into which this subtree has been rolled up becomes the next generation's descendant (individual).

[0070] Operation m4 is point mutation. Point mutation is an operation for reintroducing extinct formulas and operators into a population in order to maintain diversity. In step M231, processor 11 randomly selects a node of the winning tree. In step M232, processor 11 replaces the node selected in step M231 with another node. As a result, the formula represented by the winning tree is replaced with another formula that requires the same number of arguments as the original node. The winning tree obtained by the replacement becomes the descendant (individual) of the next generation.

[0071] Operation m5 is regeneration, where the winning tree is replicated and included in the next generation without modification.

[0072] 7 to 10 are diagrams illustrating the contents of operations performed on the winning tree. Fig. 7 is a diagram illustrating the contents of operation m1 (crossover). In the example of Fig. 7, the subtree tr111 of the winning tree tr11 is replaced with the subtree tr121 of the donor tree tr12 to become the winning tree tr13. The winning tree tr13 becomes the descendant (individual) of the next generation.

[0073] Figure 8 is a diagram illustrating the contents of operation m2 (subtree mutation). In the example of Figure 8, subtree tr111 of winner tree tr11 is replaced with subtree tr22 to become winner tree tr23. Winner tree tr23 becomes a descendant (individual) of the next generation.

[0074] Figure 9 is a diagram illustrating the contents of operation m3 (hoist mutation). In the example of Figure 9, subtree tr1121 of winner tree tr11 is rolled up to the position of subtree tr112 to become winner tree tr31. Winner tree tr31 becomes a descendant (individual) of the next generation.

[0075] Fig. 10 is a diagram illustrating the contents of operation m4 (point mutation). In the example of Fig. 10, node n21 and node n34 included in the winning tree tr11 are replaced with node n421 and node n434, resulting in a winning tree tr41. The winning tree tr41 becomes a descendant (individual) of the next generation.

[0076] [Example 2 of trained model and genetic algorithm] Fig. 11 is a diagram showing another example of the trained model LM1 and the genetic algorithm GA. In the example of Fig. 11, an individual i of the genetic algorithm GA includes, for example, the following four equations (2) to (5). z1 = f1 (y1, y2, y3) … (2) y1 = f2 (x1, x2, x3, x4) … (3) y2 = f3 (x1, x2, x3, x4) … (4) y3 = f4 (x1, x2, x3, x4) … (5)

[0077] Equations (3) to (5) are nonlinear equations (first equation) that express the relationship between the output values ​​x1, x2, x3, and x4 of each node in the input layer LX and the output values ​​y1, y2, and y3 of each node in the hidden layer LY. Equation (2) is a nonlinear equation (second equation) that expresses the relationship between the value z1 of node Z1 in the output layer LZ and the output values ​​y1, y2, and y3 of each node in the hidden layer LY.

[0078] That is, in this example, the processor 11 identifies the first formula and the second formula by nonlinear regression using a genetic algorithm, with a first nonlinear formula representing the relationship between a numerical value representing the input data and each output value of all nodes belonging to the hidden layer LY1, and a second nonlinear formula representing the relationship between each output value of each node in the hidden layer LY1 and a numerical value representing the output data as solution candidates.

[0079] Fig. 12 is a flowchart illustrating the flow of specific step M12 executed by the processor 11 in the example of Fig. 11. The flowchart of Fig. 12 executes steps M151, M152, and M153 instead of steps M121, M123, and M132 of the flowchart of Fig. 5.

[0080] In step M151, the processor 11 acquires input data and output data of the trained model LM1. The acquired input data includes output values ​​x1, x2, and x3 of each node of the input layer LX. The output data includes output value z1 of node Z1 of the output layer LZ as well as output values ​​y1, y2, and y3 of each node of the hidden layer LY.

[0081] In step M152, processor 11 randomly generates N individuals i based on specified parameters (operator Oi used in the syntax tree, maximum depth d of the syntax tree, etc.), and generates a set of N individuals i that will become the initial current generation. Individual i includes the above four formulas (2) to (5). After completing the process of step M152, processor 11 proceeds to the process of step M124.

[0082] The processor 11 executes the process of steps M124 to M131. As a result, the optimal solution (equations (2) to (5)) is obtained by the genetic algorithm. After completing the process of step M131, the processor 11 proceeds to the process of step M153.

[0083] In step M153, the processor 11 uses the first formula (formulas (3) to (5)) and the second formula (formula (2)) identified by the genetic algorithm to identify a nonlinear formula expressing the relationship between the input data and the output data. In this example, the processor 11 identifies a formula expressing the relationship between the input data and the output data of the trained model LM1 by solving the simultaneous equations (2) to (5) included in the individual i selected as the optimal solution. The formula expressing the relationship between the input data and the output data is expressed, for example, by the above-mentioned formula (1). In step S133, the processor 11 outputs the identified formula, for example, by displaying it on a display.

[0084] As described above, according to this embodiment, the mathematical formula identification device 1 identifies a nonlinear mathematical formula that represents the relationship between the numerical values ​​representing the data input to the trained model LM1 and the numerical values ​​representing the output data output from the trained model LM1 by nonlinear regression using a genetic algorithm GA. A user can easily understand the calculation process of the trained model by the nonlinear mathematical formula or a figure such as a graph represented by this mathematical formula.

[0085] [Configuration of the Estimation Device] The configuration of the estimation device 3 will be described with reference to Fig. 13. Fig. 13 is a block diagram showing the configuration of the estimation device 3.

[0086] The estimation device 3 is realized using a general-purpose computer, and includes a processor 31, a primary memory 32, a secondary memory 33, an input / output interface 34, a communication interface 35, and a bus 36. The processor 31, the primary memory 32, the secondary memory 33, the input / output interface 34, and the communication interface 35 are connected to each other via the bus 36.

[0087] An estimation program P3 is stored in the secondary memory 33. The processor 21 expands the estimation program P3 stored in the secondary memory 23 onto the primary memory 32. The processor 31 then executes each step included in an estimation method M3 (an example of a second estimation step) according to instructions included in the estimation program P3 expanded onto the primary memory 32. The formula f stored in the secondary memory 33 is used in a second estimation step M31 (described later) of the estimation method M3. Note that the estimation program P3 being stored in the secondary memory 33 refers to the fact that a source code or an executable file obtained by compiling the source code is stored in the secondary memory 33.

[0088] Examples of devices that can be used as the processor 31 include a central processing unit (CPU), a graphic processing unit (GPU), a digital signal processor (DSP), a micro processing unit (MPU), a floating point number processing unit (FPU), a physics processing unit (PPU), a microcontroller, or a combination of these. The processor 31 is also called a "computing device."

[0089] Moreover, examples of devices that can be used as the primary memory 32 include, for example, a semiconductor RAM (Random Access Memory). The primary memory 32 is sometimes called a "main storage device." Examples of devices that can be used as the secondary memory 33 include, for example, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), an optical disk drive (ODD), a floppy disk drive (FDD), or a combination of these. The secondary memory 33 is sometimes called an "auxiliary storage device." The secondary memory 33 may be built in the estimation device 3, or may be built in another computer (for example, a computer constituting a cloud server) connected to the estimation device 3 via the input / output interface 34 or the communication interface 35. In this embodiment, the storage in the estimation device 3 is realized by two memories (the primary memory 32 and the secondary memory 33), but is not limited to this. That is, the storage in the estimation device 3 may be realized by one memory. In this case, for example, a certain storage area of ​​the memory may be used as the primary memory 32, and another storage area of ​​the memory may be used as the secondary memory 33.

[0090] An input device and / or an output device are connected to the input / output interface 34. Examples of the input / output interface 34 include interfaces such as Universal Serial Bus (USB), Advanced Technology Attachment (ATA), Small Computer System Interface (SCSI), and Peripheral Component Interconnect (PCI). Examples of input devices connected to the input / output interface 34 include a group of sensors provided in a casting line. Data acquired from the group of sensors in the estimation method M3 is input to the estimation device 3 and stored in the primary memory 32. Examples of input devices connected to the input / output interface 34 include a keyboard, a mouse, a touchpad, a microphone, or a combination of these. Data acquired from a user in the estimation method M3 is input to the estimation method M3 via these input devices and stored in the primary memory 32. Examples of output devices connected to the input / output interface 34 include a display, a projector, a printer, a speaker, a headphone, or a combination of these. Information provided to a user in the estimation method M3 is output from the estimation device 3 via these output devices. The estimation device 3 may incorporate a keyboard that functions as an input device and a display that functions as an output device, like a laptop computer, or may incorporate a touch panel that functions as both an input device and an output device, like a tablet computer.

[0091] The communication interface 35 is connected to other computers via a network in a wired or wireless manner. Examples of the communication interface 35 include interfaces such as Ethernet (registered trademark) and Wi-Fi (registered trademark). Available networks include a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a global area network (GAN), or an internetwork including these networks. The internetwork may be an intranet, an extranet, or the Internet. Data (e.g., formula f) provided to the estimation device 3 from other computers (e.g., the formula identification device 1) is transmitted and received via these networks.

[0092] In this embodiment, a configuration in which the estimation method M3 is executed using a single processor (processor 31) is adopted, but the present invention is not limited to this. That is, a configuration in which the estimation method M3 is executed using a plurality of processors may be adopted. In this case, the plurality of processors that execute the estimation method M3 in cooperation with each other may be provided in a single computer and configured to be able to communicate with each other via a bus, or may be provided in a distributed manner in a plurality of computers and configured to be able to communicate with each other via a network. As an example, a mode in which a processor built in a computer that constitutes a cloud server and a processor built in a computer owned by a user of the cloud server execute the estimation method M3 in cooperation with each other may be considered.

[0093] In addition, in this embodiment, a configuration is adopted in which the formula f is stored in a memory (secondary memory 33) built in the same computer as the processor (processor 31) that executes the estimation method M3, but the present invention is not limited to this. That is, a configuration may be adopted in which the formula f is stored in a memory built in a computer different from the processor that executes the estimation method M3. In this case, the computer built in the memory that stores the formula f is configured to be able to communicate with the computer built in the processor that executes the estimation method M3 via a network. As an example, a mode is conceivable in which the formula f is stored in a memory built in a computer constituting a cloud server, and a processor built in a computer owned by a user of the cloud server executes the estimation method M3.

[0094] In addition, in this embodiment, a configuration in which the formula f is stored in a single memory (secondary memory 33) is adopted, but the present invention is not limited to this. That is, a configuration in which the formula f is distributed and stored in multiple memories may be adopted. In this case, the multiple memories that store the formula f may be provided in a single computer (which may or may not be a computer with a built-in processor that executes the estimation method M3), or may be distributed and provided in multiple computers (which may or may not include a computer with a built-in processor that executes the estimation method M3). As an example, a configuration in which the formula f is distributed and stored in memories built into each of the multiple computers that constitute the cloud server is conceivable.

[0095] [Flow of estimation method] The flow of the estimation method M3 will be described with reference to Fig. 14. Fig. 14 is a flowchart showing the flow of the estimation method M3. The estimation method M3 includes a second estimation step M31 and an output step M32.

[0096] The second estimation step M31 is a step in which the processor 11 estimates a numerical value representing the output data by substituting a numerical value representing the input data into the nonlinear formula identified by the estimation device 3 and performing a calculation. The output data estimated in the second estimation step M31 is data estimated to be output when the input data is input to the trained model LM1.

[0097] In the output step M32, the processor 11 outputs the estimated output data. The processor 11 outputs the output data, for example, by displaying an image representing the output data on a display.

[0098] According to this embodiment, the estimation device 3 estimates the output of the trained model LM1 using a nonlinear formula specified by nonlinear regression using a genetic algorithm GA. That is, the estimation device 3 can estimate the output of the trained model LM1 from the input data without using the trained model LM1. Therefore, for example, even if the calculation device of the estimation device 3 does not support advanced calculation processing, the estimation device 3 can estimate the output result of the trained model LM1.

[0099] In this embodiment, the data collection device 111 buffers the input data and output data of the trained model LM1 and inputs them to the genetic algorithm GA in a time-synchronized manner. Since the output from the trained model LM1 and the input to the genetic algorithm GA can be synchronized in time, it is possible to predict the time until the next-stage genetic algorithm GA outputs the final solution.

[0100] In this embodiment, the data collection device 111 acts as a kind of buffer that collects data of the learned model LM1 (in certain information units) and inputs it to the next stage of the genetic algorithm GA. This makes it possible to reduce wasted memory space and wasted calculation processing in the next stage of the genetic algorithm GA, and to improve the efficiency of the generation calculation processing of the genetic algorithm.

[0101] [Configuration of machine learning device] The configuration of the machine learning device 2 will be described with reference to Fig. 15. Fig. 15 is a block diagram showing the configuration of the machine learning device 2.

[0102] The machine learning device 2 is realized using a general-purpose computer, and includes a processor 21, a primary memory 22, a secondary memory 23, an input / output interface 24, a communication interface 25, and a bus 26. The processor 21, the primary memory 22, the secondary memory 23, the input / output interface 24, and the communication interface 25 are connected to each other via the bus 26.

[0103] The secondary memory 23 stores a machine learning program P2 and a training dataset DS. The training dataset DS is a collection of teacher data DS1, DS2, .... The processor 21 expands the machine learning program P2 stored in the secondary memory 23 onto the primary memory 22. Then, the processor 21 executes each step included in the machine learning method M2 according to an instruction included in the machine learning program P2 expanded onto the primary memory 22. The training dataset DS stored in the secondary memory 23 is constructed in a training dataset construction step M21 (described later) of the machine learning method M2, and is used in a trained model construction step M22 (described later) of the machine learning method M2. In addition, the trained model LM1 constructed in the trained model construction step M22 of the machine learning method M2 is also stored in the secondary memory 23. Note that the machine learning program P2 being stored in the secondary memory 23 refers to a source code or an executable file obtained by compiling the source code being stored in the secondary memory 23. In addition, the trained model LM1 being stored in the secondary memory 23 means that parameters defining the trained model LM1 are stored in the secondary memory 23.

[0104] Examples of devices that can be used as the processor 21 include a central processing unit (CPU), a graphic processing unit (GPU), a digital signal processor (DSP), a micro processing unit (MPU), a floating point number processing unit (FPU), a physics processing unit (PPU), a microcontroller, or a combination of these. The processor 21 is also called a "computing device."

[0105] Moreover, examples of devices that can be used as the primary memory 22 include, for example, semiconductor RAM (Random Access Memory). The primary memory 22 is sometimes called a "main storage device". Examples of devices that can be used as the secondary memory 23 include, for example, flash memory, HDD (Hard Disk Drive), SSD (Solid State Drive), ODD (Optical Disk Drive), FDD (Floppy Disk Drive), or a combination thereof. The secondary memory 23 is sometimes called an "auxiliary storage device". The secondary memory 23 may be built in the machine learning device 2, or may be built in another computer (for example, a computer constituting a cloud server) connected to the machine learning device 2 via the input / output interface 24 or the communication interface 25. In this embodiment, the storage in the machine learning device 2 is realized by two memories (the primary memory 22 and the secondary memory 23), but is not limited to this. That is, the storage in the machine learning device 2 may be realized by one memory. In this case, for example, a certain storage area of ​​the memory may be used as the primary memory 22, and another storage area of ​​the memory may be used as the secondary memory 23.

[0106] An input device and / or an output device are connected to the input / output interface 24. Examples of the input / output interface 24 include interfaces such as Universal Serial Bus (USB), Advanced Technology Attachment (ATA), Small Computer System Interface (SCSI), and Peripheral Component Interconnect (PCI). Examples of input devices connected to the input / output interface 24 include a group of sensors provided in a casting line. Data acquired from the group of sensors in the machine learning method M2 is input to the machine learning device 2 and stored in the primary memory 22. Examples of input devices connected to the input / output interface 24 include a keyboard, a mouse, a touchpad, a microphone, or a combination of these. Data acquired from a user in the machine learning method M2 is input to the machine learning device 2 via these input devices and stored in the primary memory 22. Examples of output devices connected to the input / output interface 24 include a display, a projector, a printer, a speaker, a headphone, or a combination of these. Information provided to a user in the machine learning method M2 is output from the machine learning device 2 via these output devices. The machine learning device 2 may incorporate a keyboard that functions as an input device and a display that functions as an output device, like a laptop computer, or may incorporate a touch panel that functions as both an input device and an output device, like a tablet computer.

[0107] The communication interface 25 is connected to other computers via a network in a wired or wireless manner. Examples of the communication interface 25 include interfaces such as Ethernet (registered trademark) and Wi-Fi (registered trademark). Available networks include a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a global area network (GAN), or an internetwork including these networks. The internetwork may be an intranet, an extranet, or the Internet. Data (e.g., the trained model LM1) provided by the machine learning device 2 to other computers (e.g., the mathematical formula identification device 1) is transmitted and received via these networks.

[0108] In this embodiment, a configuration is adopted in which the machine learning method M2 is executed using a single processor (processor 21), but the present invention is not limited to this. That is, a configuration may be adopted in which the machine learning method M2 is executed using multiple processors. In this case, the multiple processors that execute the machine learning method M2 in cooperation with each other may be provided in a single computer and configured to be able to communicate with each other via a bus, or may be provided in a distributed manner in multiple computers and configured to be able to communicate with each other via a network. As an example, a processor built in a computer that constitutes a cloud server and a processor built in a computer owned by a user of the cloud server may cooperate to execute the machine learning method M2.

[0109] In addition, in this embodiment, a configuration is adopted in which the training dataset DS is stored in a memory (secondary memory 23) built into the same computer as the processor (processor 21) that executes the machine learning method M2, but the present invention is not limited to this. That is, a configuration may be adopted in which the training dataset DS is stored in a memory built into a computer different from the processor that executes the machine learning method M2. In this case, the computer with the built-in memory for storing the training dataset DS is configured to be able to communicate with the computer with the built-in processor that executes the machine learning method M2 via a network. As an example, a mode in which the training dataset DS is stored in a memory built into a computer constituting a cloud server, and a processor built into a computer owned by a user of the cloud server executes the machine learning method M2, etc., can be considered.

[0110] In addition, in this embodiment, a configuration in which the training dataset DS is stored in a single memory (secondary memory 23) is adopted, but the present invention is not limited to this. That is, a configuration in which the training dataset DS is distributed and stored in multiple memories may be adopted. In this case, the multiple memories that store the training dataset DS may be provided in a single computer (which may or may not be a computer with a built-in processor that executes the machine learning method M2), or may be distributed and provided in multiple computers (which may or may not include a computer with a built-in processor that executes the machine learning method M2). As an example, a configuration in which the training dataset DS is distributed and stored in memories built into each of the multiple computers that constitute the cloud server is conceivable.

[0111] In addition, in the present embodiment, a configuration is adopted in which the mathematical formula identification method M1, the machine learning method M2, and the estimation method M3 are executed using different processors (processor 11, processor 21, and processor 31), but the present invention is not limited to this. That is, the mathematical formula identification method M1, the machine learning method M2, and the estimation method M3 may be executed using the same processor. In this case, by executing the machine learning method M2, the trained model LM1 is stored in a memory built into the same computer as this processor. Then, when executing the mathematical formula identification method M1, this processor uses the trained model LM1 stored in this memory to identify the mathematical formula. Also, when executing the estimation method M3, this processor estimates output data using the identified mathematical formula.

[0112] [Machine learning method flow] The flow of the machine learning method M2 will be described with reference to Fig. 16. Fig. 16 is a flowchart showing the flow of the machine learning method M2.

[0113] The machine learning method M2 includes a learning dataset construction step M21 and a trained model construction step M22.

[0114] The learning data set construction step M21 is a step in which the processor 21 constructs a learning data set DS which is a collection of teacher data DS1, DS2, . . .

[0115] Each of the training data DSi (i=1, 2, ...) includes first data and second data. The first data included in the training data DSi is the same as the input data input to the trained model LM1. In the training data set construction step M21, the processor 21 acquires this data in the same manner as the mathematical formula identification device 1. The training data set DSi also includes the second data as a label. In the training data set construction step M21, the processor 21 associates the first data with the second data and stores them in the secondary memory 23. The training data set DS is constructed by the processor 21 repeating the above process.

[0116] The trained model construction step M22 is a step in which the processor 21 constructs the trained model LM1. In the trained model construction step M22, the processor 21 constructs the trained model LM1 by supervised learning using the training data set DS. Then, the processor 21 stores the constructed trained model LM1 in the secondary memory 23.

[0117] Example 1 The arithmetic formulating system S according to this embodiment is applied to, for example, a casting system. The casting phase C1 will be described with reference to Fig. 17. Fig. 17 is a diagram showing the configuration of the casting phase C1 in the casting system.

[0118] The casting phase C1 is a phase in which casting is performed using molding sand. For example, as shown in Fig. 17, the casting phase C1 can be composed of a kneading process C11, a molding process C12, a mold removal process C13, a mold coating process C14, a frame alignment process C15, a molten metal pouring process C16, a cooling process C17, and a frame removal process C18.

[0119] The kneading process C11 is a process of adding additives including resin and hardener to the molding sand and kneading the mixture. The molding process C12 is a process of molding a mold by filling a flask with the molding sand kneaded in the kneading process C11. Here, a top mold corresponding to the upper part of the mold and a bottom mold corresponding to the lower part of the mold are molded. The mold removal process C13 is a process of separating the top mold and bottom mold molded in the mold removal process C12 from the flask. The mold coating process C14 is a process of applying a mold wash to the product surfaces of the top mold and bottom mold removed in the mold removal process C13. The frame matching process C15 is a process of obtaining a mold by combining the top mold and bottom mold to which the mold wash has been applied in the mold coating process C14. The molten metal pouring process C16 is a process of pouring molten metal into the mold obtained in the frame matching process C15. The cooling process C17 is a process for cooling the molten metal poured into the mold in the pouring process C16. The cooled molten metal solidifies inside the mold to become a casting. The flask removing process C18 is a process for vibrating the mold to dismantle it into a sand lump, and for removing the casting obtained in the cooling process C17.

[0120] The sand blocks obtained in the casting phase C1 are recycled into foundry sand through, for example, a crushing process, a separation process, a pre-regeneration cooling process, a sand regeneration process, etc.

[0121] In the casting system according to the present embodiment, the input data in the formula specified by the genetic algorithm includes, for example, sensor output values ​​detected by various sensors installed in the casting line, and the output data includes, for example, the CB value, mold strength, a label indicating whether the mold is chipped, and a pass / fail label for the product.

[0122] According to this embodiment, for example, the mathematical formula identification device 1 identifies a nonlinear mathematical formula expressing the relationship between the sensor output value input to the learned model LM1 and the CB value output from the learned model LM1 by nonlinear regression using a genetic algorithm GA. A user can easily grasp the relationship between the sensor output value and the CB value by this nonlinear mathematical formula or a figure such as a graph represented by this mathematical formula.

[0123] Example 2 The arithmetic formula system S according to this embodiment is applied to, for example, a sales forecasting system. In the sales forecasting system, the input data in the formula specified using a genetic algorithm includes, for example, condition data indicating temperature, day of the week, traffic volume, population, number of households, store area, unit price, number of products available, distance from a station, advertising expenses, SNS hashtag statistics, keyword search statistics, number of people infected with infectious diseases, number of foreign visitors to Japan, exchange rates, stock prices, interest rates, prices, employment statistics, the Bank of Japan Tankan, and household survey. The output data includes, for example, data indicating sales amounts.

[0124] According to this embodiment, for example, the mathematical formula identification device 1 identifies a nonlinear mathematical formula expressing the relationship between the condition data input to the trained model LM1 and the sales amount output from the trained model LM1 by nonlinear regression using a genetic algorithm GA. A user can easily understand the relationship between the conditions and sales in the sales forecasting system by using this nonlinear mathematical formula or a figure such as a graph represented by this mathematical formula.

[0125] Example 3 The arithmetic formula system S according to this embodiment is applied to, for example, a drug discovery system. In the drug discovery system, input data in a formula specified using a genetic algorithm includes, for example, molecular model parameters and data indicating the binding affinity of each component. Output data includes, for example, data indicating a drug.

[0126] According to this embodiment, for example, the mathematical formula identification device 1 identifies a nonlinear mathematical formula expressing the relationship between the input data input to the trained model LM1 and the data indicating the drug output from the trained model LM1 by nonlinear regression using the genetic algorithm GA. The user can easily grasp the relationship between the input data and the drug by the nonlinear mathematical formula or a figure such as a graph represented by the mathematical formula.

[0127] Example 4 The arithmetic formula system S according to this embodiment is applied to, for example, a material development system. In the material development system, input data in the formula specified using a genetic algorithm includes, for example, the mixing ratio and physical property values ​​of the alloy components. Output data includes, for example, characteristic data representing the characteristics (strength, etc.) of the material to be generated.

[0128] According to this embodiment, for example, the formula identification device 1 identifies a nonlinear formula expressing the relationship between the mixture ratio and physical property values ​​input to the trained model LM1 and the characteristic data output from the trained model LM1 by nonlinear regression using a genetic algorithm GA. A user can easily grasp the relationship between the mixture ratio and physical property values ​​and the characteristic data by using this nonlinear formula or a figure such as a graph represented by this formula.

[0129] Example 5 The arithmetic formula system S according to the present embodiment is applied to, for example, an image recognition system. In the image recognition system, input data in a formula specified using a genetic algorithm includes, for example, data indicating a feature amount of an image. Output data includes, for example, data indicating an image recognition result.

[0130] According to this embodiment, for example, the mathematical formula identification device 1 identifies a nonlinear mathematical formula expressing the relationship between the feature amount input to the trained model LM1 and the image recognition result output from the trained model LM1 by nonlinear regression using a genetic algorithm GA. A user can easily grasp the relationship between the feature amount of an image and the image recognition result by using this nonlinear mathematical formula or a figure such as a graph represented by this mathematical formula.

[0131] Example 6 The mathematical formula system S according to the present embodiment is applied to, for example, an equipment malfunction prediction system. In the equipment malfunction prediction system, input data in the mathematical formula specified using a genetic algorithm includes, for example, detection values ​​detected by each sensor installed in the equipment. Output data includes, for example, data indicating an estimated result of whether or not a malfunction of the equipment occurs.

[0132] According to this embodiment, for example, the mathematical formula identification device 1 identifies a nonlinear mathematical formula expressing the relationship between the detection value input to the trained model LM1 and the estimation result of the occurrence or non-occurrence of a malfunction output from the trained model LM1 by nonlinear regression using a genetic algorithm GA. A user can easily grasp the relationship between the detection value of the sensor and the occurrence or non-occurrence of a malfunction of the equipment by using this nonlinear mathematical formula or a figure such as a graph represented by this mathematical formula.

[0133] [Embodiment 2] Other embodiments of the present invention will be described below. For ease of explanation, the same reference numerals are given to members having the same functions as those described in the above embodiment, and the description thereof will not be repeated.

[0134] The computation formula system according to this embodiment has a different structure of a trained model from the computation formula system S according to the above-described embodiment 1. The device configurations of the mathematical formula identification device 1, the machine learning device 2, and the estimation device 3 according to this embodiment are similar to the device configurations of the mathematical formula identification device 1, the machine learning device 2, and the estimation device 3 according to the above-described embodiment 1.

[0135] While the trained model LM1 according to the above-mentioned first embodiment includes one hidden layer LY, the trained model LM2 according to this embodiment includes multiple hidden layers LY1, LY2.

[0136] [Example 3 of trained model and genetic algorithm] 18 is a diagram illustrating a trained model LM2 and a genetic algorithm GA according to the second embodiment. In the diagram, the trained model LM2 includes an input layer LX, hidden layers LY1 and LY2, and an output layer LZ. Each layer has a structure in which a plurality of nodes are connected by edges. The trained model LM2 includes two hidden layers LY1 and LY2.

[0137] The input layer LX includes nodes X1, X2, X3, and X4. That is, input data including values ​​x1, x2, x3, and x4 of the nodes X1, X2, X3, and X4, respectively, is input to the input layer LX.

[0138] The hidden layer LY1 includes nodes Y1, Y2, and Y3, and the hidden layer LY2 includes nodes Y11, Y12, and Y13. The values ​​y1, y2, and y3 of the nodes Y1, Y2, and Y3 are calculated from the output values ​​x1, x2, x3, and x4 of the nodes of the input layer LX, which is the layer before the hidden layer LY1. The values ​​y11, y12, and y13 of the nodes Y11, Y12, and Y13 are calculated from the output values ​​y1, y2, and y3 of the nodes of the hidden layer LY1, which is the layer before the hidden layer LY2.

[0139] The output layer LZ includes a node Z1. The value z1 of the node Z1 is calculated from the output values ​​y11, y12, y13, and y14 of the nodes in the hidden layer LY2, which is the layer before the output layer LZ. The output layer LZ outputs the value z1 of the node Z1 as output data.

[0140] In the example of FIG. 18, the nonlinear formula which is the individual i of the genetic algorithm is expressed by, for example, the above formula (1).

[0141] In this example, the identifying step M12 executed by the processor 11 is similar to the process of Fig. 5 shown in the above-mentioned embodiment 1. That is, the processor 11 executes the processes of steps M121 to M132 in Fig. 5 to identify and output a nonlinear formula expressing the relationship between input data and output data.

[0142] [Example 4 of trained models and genetic algorithms] FIG. 19 is a diagram illustrating a trained model LM2 and a genetic algorithm GA according to this embodiment.

[0143] In the example of FIG. 19, an individual i of the genetic algorithm GA includes, for example, the following seven equations (6) to (12). z1=f5(y1,y2,y3,y11,y12,y13) …(6) y1 = f2 (x1, x2, x3, x4) … (7) y2=f3(x1,x2,x3,x4) …(8) y3 = f4 (x1, x2, x3, x4) … (9) y11=f6(x1,x2,x3,x4) …(10) y12 = f7(x1, x2, x3, x4) … (11) y13=f8(x1,x2,x3,x4) …(12)

[0144] In this example, the determination step M12 executed by the processor 11 is similar to the process of Fig. 12 shown in the above-mentioned embodiment 1. That is, in step M151, the processor 11 obtains input data and output data for mathematically formulating the relationship.

[0145] The input data includes the values ​​x1, x2, and x3 of each node in the input layer LX. The output data includes the value z1 of the node Z1 in the output layer LZ, as well as the output values ​​y1, y2, y3, y11, y12, and y13 of each node in the hidden layers LY1 and LY2.

[0146] Processor 11 executes the processes of steps M152 to M131 in Fig. 12 and selects an individual i that is an optimal solution. In step M153, processor 11 identifies a formula expressing the relationship between the input data and the output data of trained model LM2 by solving the simultaneous equations of equations (6) to (12) included in the selected individual i. The formula expressing the relationship between the input data and the output data is expressed, for example, by the above-mentioned equation (1). Processor 11 outputs the identified formula, for example, by displaying it on a display.

[0147] [Example] Examples 1 to 6 described in the above-mentioned embodiment 1 can also be applied as examples of this embodiment. That is, the arithmetic formula system according to this embodiment is applied to, for example, a casting system, a sales forecast system, a drug discovery system, a material development system, and an image recognition system. Among the above-mentioned embodiments 1 to 6, examples 3 to 5 are more suitable for embodiment 2, while examples 1, 2, and 6 are more suitable for embodiment 1.

[0148] [Modifications] [Variation 1] 20 is a diagram illustrating a trained model LM3 and a genetic algorithm GA according to Modification 1. In the diagram, the trained model LM3 includes an input layer LX, multiple hidden layers LY11 and LY12, and an output layer LZ. Each layer has a structure in which multiple nodes are connected by edges.

[0149] The input layer LX includes nodes X1, X2, X3, and X4. That is, input data including values ​​x1, x2, x3, and x4 of the nodes X1, X2, X3, and X4, respectively, is input to the input layer LX.

[0150] The hidden layer LY11 includes nodes Y1, Y2, and Y3, and the hidden layer LY12 includes nodes Y11 and Y12. The values ​​y1, y2, and y3 of the nodes Y1, Y2, and Y3 are calculated from the output values ​​x1, x2, x3, and x4 of the nodes of the input layer LX, which is the layer before the hidden layer LY11. The values ​​y11 and y12 of the nodes Y11 and Y12 are calculated from the output values ​​y1, y2, and y3 of the nodes of the hidden layer LY11, which is the layer before the hidden layer LY12.

[0151] The output layer LZ includes a node Z1. The value z1 of the node Z1 is calculated from the output values ​​y11 and y12 of the nodes in the hidden layer LY12, which is the layer before the output layer LZ. The output layer LZ outputs the value z1 of the node Z1 as output data.

[0152] 20, an individual i of the genetic algorithm GA includes, for example, the four nonlinear formulas (2) to (5) described above. That is, the processor 11 specifies, by nonlinear regression using the genetic algorithm, a first nonlinear formula (formulas (3) to (5)) expressing the relationship between the input data and the output value of each node belonging to a part of a hidden layer (one hidden layer (hidden layer LY11)), and a second nonlinear formula (formula (2)) expressing the relationship between the data of each node and the output data.

[0153] The determination step M12 executed by the processor 11 is similar to the process of Fig. 12 shown in the above-mentioned embodiment 1. That is, in step M151, the processor 11 obtains input data and output data for mathematically formulating the relationship. The input data includes values ​​x1, x2, and x3 of each node in the input layer LX. The output data includes output values ​​y1, y2, and y3 of each node in the hidden layer LY11 in addition to value z1 of node Z1 in the output layer LZ.

[0154] Processor 11 executes the process of steps M152 to M131 in Fig. 12 and selects an individual i that is an optimal solution. In step M153, processor 11 identifies a formula expressing the relationship between the input data and the output data of trained model LM2 by solving the simultaneous equations of equations (2) to (5) included in the selected individual i. The formula expressing the relationship between the input data and the output data is expressed, for example, by the above-mentioned equation (1). Processor 11 outputs the identified formula, for example, by displaying it on a display.

[0155] The hidden layers of the trained model LM3 may include layers that are slow to learn and layers that are fast to learn. A layer that is slow to learn is a layer that has many perceptrons or multiple weightings. A layer that is fast to learn is a layer that has few perceptrons or no weighting or only one weighting. In this modification, for a hidden layer that is slow to learn (e.g., hidden layer LY11), processor 11 includes the values ​​of each node of that layer as variables in the formula. On the other hand, for a layer that is fast to learn (e.g., hidden layer LY12), processor 11 does not include the values ​​of each node of that layer in the formula.

[0156] By including the values ​​of each node in layers where learning is difficult as variables in the formula, it is possible to grasp the features in complex phenomena such as image recognition. It is also easy to understand how each node works. Furthermore, by not including the values ​​of each node in layers where learning is easy in the formula, it is possible to save on calculation costs and simplify the formula.

[0157] [Modification 2] Fig. 21 is a diagram illustrating a trained model LM3 and a genetic algorithm GA according to Modification 1. In the diagram, the trained model LM3 is similar to the trained model LM3 shown in Fig. 20 of Modification 1 described above.

[0158] In FIG. 21, an individual i of the genetic algorithm GA includes, for example, the following three nonlinear expressions (13) to (15). z1 = f8 (y11, y12) … (13) y11=f6(x1,x2,x3,x4) …(14) y12=f7(x1,x2,x3,x4) …(15)

[0159] The processor 11 identifies, by nonlinear regression using the genetic algorithm, a first nonlinear equation (equations (14) to (15)) expressing the relationship between the input data and the output values ​​of each node belonging to the hidden layer LY12 preceding the output layer LZ, and a second nonlinear equation (equation (13)) expressing the relationship between the output values ​​of each node and the output data.

[0160] In this example, the determination step M12 executed by the processor 11 is similar to the process of Fig. 12 shown in the above-mentioned embodiment 1. That is, in step M151, the processor 11 obtains input data and output data for mathematically formulating the relationship.

[0161] The input data includes values ​​x1, x2, and x3 of each node in the input layer LX, and the output data includes output values ​​y11 and y12 of each node in the hidden layer LY12 in addition to the value z1 of node Z1 in the output layer LZ.

[0162] Processor 11 executes the processes of steps M152 to M131 in Fig. 12 and selects an individual i that is an optimal solution. In step M153, processor 11 identifies a formula expressing the relationship between the input data and the output data of trained model LM2 by solving the simultaneous equations of equations (13) to (15) included in the selected individual i. The formula expressing the relationship between the input data and the output data is expressed, for example, by the above-mentioned equation (1). Processor 11 outputs the identified formula, for example, by displaying it on a display.

[0163] In the above-described second embodiment, a trained model LM2 including two hidden layers LY1 and LY2 is used, but the number of hidden layers included in the trained model may be two or more.

[0164] 〔summary〕 The mathematical formula identification device according to aspect 1 includes one or more processors that execute an identification step of identifying a nonlinear mathematical formula that expresses a relationship between a numerical value representing input data of a trained model and a numerical value representing output data of the trained model.

[0165] According to the above configuration, the mathematical formula identification device can mathematically express the calculation process of the trained model.

[0166] The mathematical formula identification device according to aspect 2 has the following features in addition to the features of the mathematical formula identification device according to aspect 1. That is, in the mathematical formula identification device according to aspect 2, the processor further executes an estimation step of estimating the output data from the input data using the trained model constructed by machine learning, and in the identification step, identifies the nonlinear mathematical formula by nonlinear regression using a genetic algorithm.

[0167] According to the above configuration, the mathematical formula identification device can mathematically express the calculation process of the trained model.

[0168] The mathematical formula identification device according to aspect 3 has the following features in addition to the features of the mathematical formula identification device according to aspect 2. That is, in the mathematical formula identification device according to aspect 3, the trained model is a deep neural network composed of a plurality of layers, and the processor, in the identifying step, identifies the mathematical formula by nonlinear regression using the genetic algorithm, in which a nonlinear mathematical formula expressing a relationship between a numerical value expressing the input data input to an input layer and a numerical value expressing the output data output from an output layer is set as a solution candidate.

[0169] According to the above configuration, the mathematical formula identification device identifies a nonlinear mathematical formula that represents a relationship between numerical values ​​representing input data and numerical values ​​representing output data of the trained model by nonlinear regression using a genetic algorithm, which sets a nonlinear mathematical formula that represents a relationship between numerical values ​​representing input data and output data of the trained model as a solution candidate. This makes it possible to mathematically express the calculation process of the trained model.

[0170] The mathematical formula identification device according to aspect 4 has the following features in addition to the features of the mathematical formula identification device according to aspect 2. That is, in the mathematical formula identification device according to aspect 4, the trained model is a deep neural network composed of a plurality of layers, and in the identifying step, the processor identifies the first mathematical formula and the second mathematical formula by nonlinear regression using the genetic algorithm in which a nonlinear first mathematical formula expressing a relationship between a numerical value expressing the input data and each output value of a part or all of nodes belonging to a hidden layer, and a nonlinear second mathematical formula expressing a relationship between each output value of the nodes and the numerical value expressing the output data, as solution candidates, and identifies a nonlinear mathematical formula expressing a relationship between a numerical value expressing the input data and a numerical value expressing the output data by using the identified first mathematical formula and second mathematical formula.

[0171] According to the above configuration, the mathematical formula identification device identifies, by nonlinear regression using a genetic algorithm, a mathematical formula expressing the relationship between the output values ​​of nodes in the input layer of a trained model including multiple layers and the output values ​​of some or all of the nodes in the hidden layer, and a mathematical formula expressing the relationship between the output values ​​of the nodes in the hidden layer and the output values ​​of the nodes in the output layer. This makes it possible to mathematically express the computation process of the trained model.

[0172] The mathematical formula identification device according to aspect 5 has the following features in addition to the features of the mathematical formula identification device according to aspect 4. That is, in the mathematical formula identification device according to aspect 5, the trained model includes a plurality of hidden layers, and the processor, in the identifying step, identifies a first nonlinear mathematical formula expressing a relationship between a numerical value expressing the input data and an output value of each node belonging to one hidden layer, and a second nonlinear mathematical formula expressing a relationship between the output value of each node and a numerical value expressing the output data, by nonlinear regression using the genetic algorithm.

[0173] According to the above configuration, the mathematical formula identification device identifies a mathematical formula expressing the relationship between the output value of a node in an input layer of a trained model including multiple layers and the output value of a node in one hidden layer, and a mathematical formula expressing the relationship between the output value of the node in the one hidden layer and the output value of a node in the output layer, by nonlinear regression using a genetic algorithm. This makes it possible to mathematically express the computation process of the trained model.

[0174] The mathematical formula identification device according to aspect 6 has the following features in addition to the features of the mathematical formula identification device according to aspect 4. That is, in the mathematical formula identification device according to aspect 6, the trained model includes a plurality of hidden layers, and the processor, in the identifying step, identifies a first nonlinear mathematical formula expressing a relationship between a numerical value expressing the input data and an output value of each node belonging to a hidden layer preceding the output layer, and a second nonlinear mathematical formula expressing a relationship between data of each node and a numerical value expressing the output data, by nonlinear regression using the genetic algorithm.

[0175] According to the above configuration, the mathematical formula identification device identifies, by nonlinear regression using a genetic algorithm, a mathematical formula expressing the relationship between the output value of a node in an input layer of a trained model including multiple layers and the output value of a node in a hidden layer preceding the output layer, and a mathematical formula expressing the relationship between the output value of a node in the hidden layer and the output value of a node in the output layer. This makes it possible to mathematically express the computation process of the trained model.

[0176] The mathematical formula identification method of aspect 7 includes a step in which one or more processors identify a nonlinear mathematical formula that represents a relationship between a numerical value representing input data of a trained model and a numerical value representing output data of the trained model.

[0177] The estimation device of aspect 8 includes one or more processors that execute a second estimation step of estimating a numerical value representing the output data by substituting a numerical value representing the input data into the nonlinear mathematical formula identified by the mathematical formula identification device of any one of aspects 1 to 6 and performing a calculation.

[0178] According to the above configuration, the output of the trained model can be estimated using a nonlinear formula that mathematically represents the computational process of the trained model.

[0179] The mathematical formula identification method of aspect 9 includes a second estimation step in which one or more processors estimate a numerical value representing the output data by substituting a numerical value representing the input data into the nonlinear mathematical formula identified by the mathematical formula identification method described in aspect 7 and performing an operation.

[0180] According to the above configuration, the output of the trained model can be estimated using a nonlinear formula that mathematically represents the computational process of the trained model.

[0181] [Additional Note 1] In each of the above-described embodiments and modifications, trained models trained by machine learning through supervised learning are used as trained models LM1, LM2, and LM3, but trained models trained by machine learning through unsupervised learning may also be used. As in each of the above-described embodiments and modifications, for trained models trained by machine learning through unsupervised learning, the processor 11 identifies a nonlinear formula expressing the relationship between the input and output of the trained model by regression using a genetic algorithm.

[0182] [Additional Note 2] In each of the above-described embodiments and modified examples, the machine learning device 2 constructs the trained models LM1, LM2, and LM3, but the trained models LM1, LM2, and LM3 may be constructed in advance by a device other than the machine learning device 2. In this case, the mathematical formula identification device 1 performs the above-described mathematical formula identification method M1 using the trained models constructed in advance by the other device.

[0183] [Additional Note 3] In each of the above-described embodiments and modifications, the processor 11 identifies the nonlinear formula expressing the relationship between the input data and the output data by nonlinear regression using a genetic algorithm. The algorithm for identifying the nonlinear formula expressing the relationship between the input data and the output data is not limited to the genetic algorithm, and may be another nonlinear algorithm.

[0184] As an example, the processor 11 may specify a nonlinear formula expressing the relationship between input data and output data using the Monte Carlo method. In this case, as an example, the processor 11 creates a plurality of formulas by randomly selecting the length of the formula and elements of the formula (variables, operators, etc.), and constructs a relational formula for deriving output data from input data by selecting the formula with the smallest error from the created plurality of formulas.

[0185] Also, as an example, the processor 11 may identify a nonlinear formula using a trained model (hereinafter, referred to as a "formula derivation model") that derives a nonlinear formula from a dataset. In this case, the formula derivation model is a trained model that takes a dataset as input and outputs a label corresponding to the nonlinear formula. The dataset, which is the input, is a set of input data and output data of the trained models LM1, LM2, and LM3 described above. The label, which is the output, is a label corresponding to the nonlinear formula.

[0186] In the learning phase of the mathematical formula derivation model, an information processing device such as the machine learning device 2 constructs a mathematical formula derivation model by machine learning using learning data in which a data set and a label are linked.

[0187] [Additional Note 4] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Other embodiments obtained by appropriately combining the technical means disclosed in the above-described embodiments are also included in the technical scope of the present invention. [Explanation of symbols]

[0188] 1. Formula Identification Device 2 Machine learning device 3 Estimation device 11, 21 Processors 12, 22 Primary memory 13, 23 Secondary memory 14, 24 Input / Output Interface 15, 25 Communication Interface 16, 26 Bus LM1, LM2 pre-trained models M1 Formula Identification Method M11 Estimation Step M12 Specific Step M2 Machine Learning Method M21 Training Dataset Construction Steps M22 Trained model construction steps S Calculation Formula System

Claims

1. An estimation step of estimating output data from input data using a trained model constructed by machine learning; A step of identifying a nonlinear formula that represents a relationship between a numerical value representing the input data of the trained model and a numerical value representing the output data of the trained model; and one or more processors executing The trained model is a deep neural network composed of multiple layers, In the identifying step, the processor identifies a nonlinear equation that represents a relationship between a numerical value representing the input data input to an input layer and a numerical value representing the output data output from an output layer by nonlinear regression using a genetic algorithm, the nonlinear equation being a candidate solution. A mathematical expression identification device.

2. An estimation step of estimating output data from input data using a trained model constructed by machine learning; A step of identifying a nonlinear formula that represents a relationship between a numerical value representing the input data of the trained model and a numerical value representing the output data of the trained model; and one or more processors executing The trained model is a deep neural network composed of multiple layers, In the identifying step, the processor identifies a first nonlinear formula expressing a relationship between a numerical value expressing the input data and each output value of a part or all of the nodes belonging to a hidden layer, and a second nonlinear formula expressing a relationship between the output value of each of the nodes and the numerical value expressing the output data, by nonlinear regression using a genetic algorithm with the first formula and the second formula as solution candidates, and identifies a nonlinear formula expressing the relationship between the numerical value expressing the input data and the numerical value expressing the output data, by using the identified first formula and second formula. A mathematical expression identification device.

3. The trained model includes a plurality of hidden layers, In the identifying step, the processor identifies a first nonlinear formula expressing a relationship between a numerical value expressing the input data and an output value of each node belonging to one hidden layer, and a second nonlinear formula expressing a relationship between data of each node and a numerical value expressing the output data, by nonlinear regression using the genetic algorithm.

3. The mathematical expression specifying device according to claim 2.

4. The trained model includes a plurality of hidden layers, In the identifying step, the processor identifies a first nonlinear formula expressing a relationship between a numerical value expressing the input data and an output value of each node belonging to a hidden layer preceding the output layer, and a second nonlinear formula expressing a relationship between data of each node and a numerical value expressing the output data, by nonlinear regression using the genetic algorithm.

3. The mathematical expression specifying device according to claim 2.

5. One or more processors, An estimation step of estimating output data from input data using a trained model constructed by machine learning; A step of identifying a nonlinear formula that represents a relationship between a numerical value representing the input data of the trained model and a numerical value representing the output data of the trained model; Including, The trained model is a deep neural network composed of multiple layers, In the identifying step, the processor identifies a nonlinear equation that represents a relationship between a numerical value representing the input data input to an input layer and a numerical value representing the output data output from an output layer by nonlinear regression using a genetic algorithm, the nonlinear equation being a candidate solution. A method for identifying a mathematical expression.

6. One or more processors, An estimation step of estimating output data from input data using a trained model constructed by machine learning; A step of identifying a nonlinear formula that represents a relationship between a numerical value representing the input data of the trained model and a numerical value representing the output data of the trained model; Including, The trained model is a deep neural network composed of multiple layers, In the identifying step, the processor identifies a first nonlinear formula expressing a relationship between a numerical value expressing the input data and each output value of a part or all of the nodes belonging to a hidden layer, and a second nonlinear formula expressing a relationship between the output value of each of the nodes and the numerical value expressing the output data, by nonlinear regression using a genetic algorithm with the first formula and the second formula as solution candidates, and identifies a nonlinear formula expressing the relationship between the numerical value expressing the input data and the numerical value expressing the output data, by using the identified first formula and second formula. A method for identifying a mathematical expression.

7. A second estimation step of estimating a numerical value representing the output data by substituting a numerical value representing the input data into the nonlinear mathematical formula identified by the mathematical formula identification device according to any one of claims 1 to 4 and performing an operation on the nonlinear mathematical formula identified by the mathematical formula identification device according to any one of claims 1 to 4; and one or more processors executing An estimation device comprising:

8. A second estimation step in which one or more processors estimate a numerical value representing the output data by substituting a numerical value representing the input data into the nonlinear mathematical formula identified by the mathematical formula identification method according to claim 5 or 6, and performing an operation on the nonlinear mathematical formula; The estimation method according to claim 1,

Images