MODEL GENERATION DEVICE, MODEL GENERATION METHOD, MODEL GENERATION PROGRAM, QUALITY PREDICTION MODEL, AND PRODUCT QUALITY PREDICTION DEVICE

Abstract

To enable prediction of quality of a product produced in a plant which produces multiple models of products in smaller lots such as a batch plant.SOLUTION: A model generation device 10 generates a quality prediction model for predicting product quality of two or more sorts of products produced in a plant etc. by machine learning. The model generation device comprises: a model input / output unit 13 which inputs sensor data included in learning data and physical property data of a product corresponding to the learning data into the quality prediction model, and acquires product quality prediction data outputted from the quality prediction model; a model learning unit 14 which updates a parameter included in the quality prediction model on the basis of an error between the product quality prediction data and the product quality data included in the learning data; and a model output unit 15 which outputs a learned quality prediction model in which the parameter was updated by the model learning unit 14.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] One aspect of the present disclosure relates to a model generation device, a model generation method, a model generation program, a quality prediction model, and a product quality prediction device. [Background technology]

[0002] Product quality in chemical plants and the like has been measured, for example, by sampling inspection. Sampling inspection has drawbacks such as being costly, time-consuming, and lacking in immediacy. To address these drawbacks, product quality has been estimated by analyzing the correlation between product quality and sensor data such as temperature and pressure detected in the product manufacturing process. This estimation has been performed, for example, by a model including a neural network. As a method for predicting product quality using a model constructed by machine learning including such a neural network, a technology is known that predicts quality by applying LSTM (Long short-term memory) to a manufacturing process consisting of multiple phases (for example, see Non-Patent Document 1). [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Kai Wang, Bhushan Gopaluni, Junghui Chen andZhihuan Song, “DeepLearning of Complex Batch Process Data and Its Application on QualityPrediction”, [online], IEEETransactions on Industrial Informatics, vol.16, no.12, pp.7233-7242, Dec. 2020,doi: 10.1109 / TII.2018.2880968, [Searched December 11, 2020], Internet<https: / / dais.chbe.ubc.ca / assets / preprints / 2019J2_Wang_IEEEII.pdf> Summary of the Invention [Problem to be solved by the invention]

[0004] A method of predicting product quality based on sensor data using a model constructed by machine learning is effective in continuous plants that mass-produce one type of product. However, in so-called batch plants that produce a wide variety of products in small quantities, it is difficult to apply the above method due to the fact that the amount of data acquired for one product is small, the plant is a non-stationary process in which the state of the plant changes with time, and the product quality is affected by the entire process history. Although the technology described in Non-Patent Document 1 refers to a batch process, it does not assume the production of a wide variety of products and the prediction of their product quality.

[0005] The present invention has been made in consideration of the above problems, and has an object to make it possible to predict the quality of products manufactured in a plant that manufactures a wide variety of products in small quantities, such as a batch plant. [Means for solving the problem]

[0006] A model generation device according to one aspect of the present disclosure is a model generation device that generates a quality prediction model by machine learning to predict product quality of multiple types of products to be manufactured, wherein the quality prediction model includes a neural network, receives sensor data and physical property data as input, and outputs product quality prediction data representing predicted product quality, wherein learning data used for the machine learning of the quality prediction model consists of pairs of sensor data and product quality data, wherein the sensor data is data including inspection values ​​of one or more detection items that indicate a production state detected in a production process of a unit quantity of products, wherein the product quality data is data that indicates the product quality of a product manufactured in the production process in which the corresponding sensor data was detected, and wherein the physical property data is data that indicates characteristics of the product and is associated with each product, wherein the model generation device includes: a model input / output unit that inputs the sensor data included in the learning data and the physical property data of the product corresponding to the learning data into the quality prediction model and acquires product quality prediction data output from the quality prediction model, a model learning unit that updates parameters included in the quality prediction model based on an error between the product quality prediction data and the product quality data included in the learning data, and a model output unit that outputs the learned quality prediction model whose parameters have been updated by the model learning unit.

[0007] A model generation method according to one aspect of the present disclosure is a model generation method in a model generation device that generates a quality prediction model by machine learning to predict product quality of multiple types of products to be manufactured, wherein the quality prediction model includes a neural network, receives sensor data and physical property data as input, and outputs product quality prediction data representing predicted product quality, and learning data used for the machine learning of the quality prediction model consists of pairs of sensor data and product quality data, the sensor data is data including inspection values ​​of one or more detection items that indicate a production state detected in a production process of a unit quantity of products, the product quality data is data that indicates the product quality of products manufactured in the production process in which the corresponding sensor data was detected, and the physical property data is data that indicates the characteristics of the products associated with each product, and the model generation method includes a model input / output step of inputting the sensor data included in the learning data and the physical property data of the product corresponding to the learning data into the quality prediction model and acquiring product quality prediction data output from the quality prediction model, a model learning step of updating parameters included in the quality prediction model based on an error between the product quality prediction data and the product quality data included in the learning data, and a model output step of outputting the learned quality prediction model whose parameters have been updated in the model learning step.

[0008] A model generation program according to one aspect of the present disclosure is a model generation program for causing a computer to function as a model generation device that generates, by machine learning, a quality prediction model for predicting product quality of multiple types of products to be manufactured, wherein the quality prediction model includes a neural network, receives sensor data and physical property data as input, and outputs product quality prediction data representing predicted product quality, wherein learning data used for the machine learning of the quality prediction model consists of pairs of sensor data and product quality data, wherein the sensor data is data including inspection values ​​of one or more detection items that indicate a production state, detected in a production process of a unit quantity of products, wherein the product quality data is data that indicates the product quality of a product manufactured in the production process in which the corresponding sensor data was detected, and wherein the physical property data is data that indicates the characteristics of the product, associated with each product, wherein the model generation program causes the computer to realize a model input / output function of inputting the sensor data included in the learning data and the physical property data of the product corresponding to the learning data into the quality prediction model and acquiring product quality prediction data output from the quality prediction model, a model learning function of updating parameters included in the quality prediction model based on an error between the product quality prediction data and the product quality data included in the learning data, and a model output function of outputting the learned quality prediction model whose parameters have been updated by the model learning function.

[0009] According to this aspect, the sensor data detected in the manufacturing process of the product and the physical property data associated with the product are input to the quality prediction model, so that the characteristics of the sensor data are learned in association with the type of product. As a result, the sensor data of different types of products can be used for learning the quality prediction model, so that even if the amount of sensor data acquired from the manufacturing results of each product type is not sufficient for learning the quality prediction model, the sensor data of multiple types of products can be used for learning the quality prediction model. Therefore, it becomes possible to predict the quality of products manufactured in a plant that manufactures a wide variety of products in small quantities, such as a batch plant.

[0010] In a model generation device according to another aspect, the quality prediction model may include a first model and a second model, and the model input / output unit may input sensor data to the first model, obtain latent variables expressing characteristics of the sensor data from the first model, input the latent variables and the physical property data to the second model, and obtain product quality prediction data output from the second model.

[0011] According to this aspect, the features of the sensor data are learned by the first model. Then, the latent variables and physical property data output from the first model are input to the second model, so that the second model learns the correlation between the features of the sensor data and the product. Therefore, the features of the sensor data are learned in association with the type of product, so that the first model and the second model can build a quality prediction model applicable to multiple product varieties.

[0012] In another aspect of the model generation device, the first model may be an encoder-decoder model including a neural network and composed of an encoder and a decoder, the encoder generates latent variables based on sensor data, the decoder generates output data based on the latent variables, the model input / output unit inputs the sensor data to the encoder and acquires output data output from the decoder, and the model learning unit updates parameters of the first model based on an error between the output data and the sensor data input to the encoder, and updates parameters of the second model based on an error between product quality prediction data output from the second model and the product quality data.

[0013] According to this aspect, latent variables that compress and express the features of the sensor data can be obtained. The latent variables and the physical property data are input together into the second model, and the parameters of the second model are updated based on the error between the product quality prediction data output from the second model and the product quality data in the training data, thereby constructing the second model, thereby making it possible to construct a quality prediction model that can be applied to multiple product varieties.

[0014] In another aspect of the model generating device, the sensor data includes data acquired in a time series for each item during the product manufacturing process, the encoder / decoder model is composed of any one of a Recurrent Neural Network (RNN), a Long short-term memory (LSTM), a Transformer, and a Gated Recurrent Unit (GRU), and the model input / output unit may sequentially input the sensor data to the encoder in time series.

[0015] According to this aspect, in view of the fact that the sensor data is time-series data indicating the state of the manufacturing process, the encoder-decoder model constituting the first model is configured with any one of RNN, LSTM, Transformer, and GRU, which are suitable for learning the features of the time-series data. Therefore, the features of the sensor data are appropriately learned by the first model.

[0016] In another aspect of the model generating device, the sensor data may include at least one of the temperature and pressure in the manufacturing process, and the physical property data may be data indicating at least one of the physical properties and characteristics of the raw materials associated with the raw materials of the product.

[0017] According to this aspect, the sensor data includes at least either the temperature or the pressure in the manufacturing process, and physical property data including either the physical properties or characteristics of the raw materials of the product is input into the quality prediction model together with the sensor data, so that the characteristics of the state of the manufacturing process are learned in the quality prediction model while being appropriately associated with the type of product.

[0018] A quality prediction model according to one aspect of the present disclosure is a quality prediction model trained by machine learning for causing a computer to function and predicting product quality of multiple types of products to be manufactured, the quality prediction model including a neural network, receiving sensor data and physical property data as input, and outputting product quality prediction data representing predicted product quality, the learning data used in the machine learning of the quality prediction model consisting of pairs of sensor data and product quality data, the sensor data being data including inspection values ​​of one or more detection items indicating the state of production detected in a production process of a unit quantity of products, the product quality data being data indicating the product quality of products manufactured in the production process in which the corresponding sensor data was detected, and the physical property data being data corresponding to each product and indicating the characteristics of the product, the quality prediction model being constructed by machine learning that updates parameters based on the error between the product quality prediction data output in response to input of the sensor data included in the learning data and the physical property data corresponding to the sensor data, and the product quality data included in the learning data.

[0019] According to this aspect, the sensor data detected in the manufacturing process of the product is input together with the physical property data associated with the product, so that a quality prediction model can be obtained in which the characteristics of the sensor data are learned in association with the type of product. As a result, the sensor data of different types of products can be used for learning the quality prediction model, so that even if the amount of sensor data acquired from the manufacturing results of each product type is not sufficient for learning the quality prediction model, the sensor data of multiple types of products can be used for learning the quality prediction model. Therefore, a quality prediction model applicable to predicting the quality of products manufactured in a plant that manufactures a wide variety of products in small quantities, such as a batch plant, can be obtained.

[0020] A product quality prediction device according to one aspect of the present disclosure is a product quality prediction device that predicts product quality of multiple types of products to be manufactured using a quality prediction model constructed by machine learning, wherein the quality prediction model includes a neural network, receives sensor data and physical property data as input, and outputs product quality prediction data representing predicted product quality, and learning data used in the machine learning of the quality prediction model consists of pairs of sensor data and product quality data, the sensor data is data including inspection values ​​of one or more detection items that indicate a production state, detected in a production process of a unit quantity of products, and the product quality data is data indicating the product quality of products produced in the production process in which the corresponding sensor data was detected. The physical property data is data corresponding to each product and indicating the characteristics of the product. The quality prediction model is constructed by machine learning that updates parameters based on an error between product quality prediction data output in response to input of sensor data included in the learning data and physical property data corresponding to the sensor data, and the product quality prediction data included in the learning data. The product quality prediction device includes a product quality prediction unit that inputs sensor data detected in the manufacturing process of the product whose product quality is to be predicted and the physical property data of the product corresponding to the sensor data into the quality prediction model, and acquires the product quality prediction data output from the quality prediction model, and a product quality prediction data output unit that outputs the product quality prediction data acquired by the product quality prediction unit.

[0021] According to this aspect, by inputting the sensor data detected in the manufacturing process of the product together with the physical property data associated with the product, a quality prediction model that has been learned by associating the characteristics of the sensor data with the type of product is used to predict the quality of the product. Therefore, it is possible to predict the quality of products manufactured in a plant that manufactures a wide variety of products in small quantities, such as a batch plant. Effect of the Invention

[0022] According to one aspect of the present disclosure, it is possible to predict the quality of products produced in a plant that produces a wide variety of products in small quantities, such as a batch plant. [Brief description of the drawings]

[0023] [Figure 1] 1 is a block diagram showing an example of a functional configuration of a model generating device according to an embodiment. [Diagram 2] 1 is a block diagram showing an example of a functional configuration of a product quality prediction device according to an embodiment. [Diagram 3] FIG. 2 is a hardware block diagram of a model generating device and a product quality predicting device according to the embodiment. [Figure 4] FIG. 2 is a diagram showing a schematic configuration of a quality prediction model. [Diagram 5] FIG. 10 is a diagram illustrating an example of learning data including sensor data and product quality data. [Figure 6] FIG. 11 is a diagram showing an example of physical property data. [Figure 7] FIG. 2 is a diagram illustrating an example of a configuration of a quality prediction model. [Figure 8] FIG. 2 is a diagram illustrating an example of a first model configured by an encoder-decoder model. [Figure 9] 4 is a flowchart showing the process of a model generation method in the model generation device according to the embodiment. [Figure 10] 4 is a flowchart showing the process of a product quality prediction method in the product quality prediction device according to the embodiment. [Figure 11] FIG. 13 is a diagram illustrating a configuration of a model generation program. [Figure 12] FIG. 13 is a diagram showing a configuration of a product quality prediction program. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same or equivalent elements are designated by the same reference numerals, and duplicated description will be omitted.

[0025] 1 is a block diagram showing an example of a functional configuration of a model generation device according to an embodiment. The model generation device 10 is a device that generates a quality prediction model for predicting product quality of multiple types of products produced in a plant by machine learning. In this embodiment, the term "product" is a concept that may include a finished product, a work-in-progress, a semi-finished product, a part, and a prototype.

[0026] 1, the model generating device 10 may include functional units configured in a processor 101, a learning data storage unit 30, a physical property data storage unit 40, and a quality prediction model storage unit 50. The model generating device 10 includes a learning data acquisition unit 11, a first physical property data acquisition unit 12, a model input / output unit 13, a model learning unit 14, and a model output unit 15. Each of these functional units 11 to 15 may be configured in one device, or may be distributed across multiple devices.

[0027] Each of the functional units 11 to 15 is configured to be accessible to the learning data storage unit 30, the physical property data storage unit 40, and the quality prediction model storage unit 50. The learning data storage unit 30, the physical property data storage unit 40, and the quality prediction model storage unit 50 may be configured inside the model generation device 10 as shown in Fig. 1, or may be configured outside the model generation device 10 as another device accessible from the model generation device 10. Each of the functional units 11 to 15 and the storage units 30, 40, and 50 will be described in detail later.

[0028] 2 is a block diagram showing an example of a functional configuration of a product quality prediction device according to an embodiment. The product quality prediction device 20 is a device that predicts the product quality of multiple types of products produced in a plant by using a quality prediction model constructed by machine learning.

[0029] 2, the product quality prediction device 20 may include functional units configured in a processor 101, a sensor data storage unit 60, a physical property data storage unit 40, and a quality prediction model storage unit 50. The product quality prediction device 20 includes a sensor data acquisition unit 21, a second physical property data acquisition unit 22, a product quality prediction unit 23, and a product quality prediction data output unit 24. Each of these functional units 21 to 24 may be configured in one device, or may be configured distributed across multiple devices.

[0030] Each of the functional units 21 to 24 is configured to be accessible to the sensor data storage unit 60, the physical property data storage unit 40, and the quality prediction model storage unit 50. The sensor data storage unit 60, the physical property data storage unit 40, and the quality prediction model storage unit 50 may be configured inside the product quality prediction device 20 as shown in FIG. 2, or may be configured in another device outside the product quality prediction device 20 and accessible from the product quality prediction device 20. The physical property data storage unit 40 and the quality prediction model storage unit 50 shown in FIG. 2 may be configured as the same storage unit as the storage unit shown in FIG. Each of the functional units 21 to 24 and each of the storage units 60, 40, and 50 will be described in detail later.

[0031] 3 is a diagram showing an example of a hardware configuration of a computer 100 constituting the model generating device 10 and the product quality predicting device 20 according to the embodiment. That is, the computer 100 can constitute the model generating device 10 and the product quality predicting device 20.

[0032] As an example, the computer 100 includes, as hardware components, a processor 101, a main memory device 102, an auxiliary memory device 103, and a communication control device 104. The computer 100 constituting the model generating device 10 and the product quality prediction device 20 may further include an input device 105 such as a keyboard, a touch panel, a mouse, or the like, which is an input device, and an output device 106 such as a display.

[0033] The processor 101 is a computing device that executes an operating system and application programs. Examples of processors include a central processing unit (CPU) and a graphics processing unit (GPU), but the type of the processor 101 is not limited to these. For example, the processor 101 may be a combination of a sensor and a dedicated circuit. The dedicated circuit may be a programmable circuit such as a field-programmable gate array (FPGA), or may be another type of circuit.

[0034] The main memory device 102 is a device that stores programs for implementing the model generating device 10 and the like, and calculation results output from the processor 101. The main memory device 102 is configured, for example, with at least one of a ROM (Read Only Memory) and a RAM (Random Access Memory).

[0035] The auxiliary storage device 103 is generally a device capable of storing a larger amount of data than the main storage device 102. The auxiliary storage device 103 is configured by a non-volatile storage medium such as a hard disk or a flash memory. The auxiliary storage device 103 stores the model generation program P1 and / or the product quality prediction program P2 for causing the computer 100 to function as the model generation device 10 or the product quality prediction device 20, and various data.

[0036] The communication control device 104 is a device that executes data communication with other computers via a communication network, and is configured by, for example, a network card or a wireless communication module.

[0037] Each functional element of the model generating device 10 and the product quality predicting device 20 is realized by loading the corresponding programs P1, P2 onto the processor 101 or the main memory device 102 and having the processor 101 execute the programs. The programs P1, P2 include codes for realizing each functional element of the corresponding server. The processor 101 operates the communication control device 104 in accordance with the programs P1, P2, and executes reading and writing of data in the main memory device 102 or the auxiliary memory device 103. Through such processing, each functional element of the corresponding server is realized.

[0038] The programs P1 and P2 may be provided in a state of being fixedly recorded on a tangible recording medium such as a CD-ROM, a DVD-ROM, a semiconductor memory, etc. Alternatively, at least one of these programs may be provided via a communication network as a data signal superimposed on a carrier wave.

[0039] Next, a quality prediction model generated by the model generation device 10 will be described with reference to Fig. 4. Fig. 4 is a diagram showing a schematic configuration of the quality prediction model. The quality prediction model MD includes a neural network, and is constructed by machine learning in the model generation device 10. The quality prediction model MD receives sensor data sd and physical property data pd as input, and outputs product quality prediction data qd representing predicted product quality.

[0040] The sensor data sd is data including inspection values ​​of one or more detection items that indicate the state of production, detected in the manufacturing process of one unit quantity (e.g., one lot). The sensor data sd may include, for example, at least one of temperature and pressure in the manufacturing process of the product as a detection item. The sensor data sd is not limited to the above example, as long as it is data detected from the manufacturing system of the product. In addition, the sensor data sd may be data (inspection values) detected at a certain time in the manufacturing process, or may include time-series data. The sensor data sd is converted into a vector representation and input to the quality prediction model MD. The details of the sensor data sd will be described later with reference to FIG. 5.

[0041] The physical property data pd is data associated with each product produced in the plant and indicates the characteristics of each product. That is, the physical property data pd constitutes product-specific information that can identify each product. More specifically, the physical property data pd is data associated with the raw material of a product and indicates at least one of the physical properties and characteristics of the raw material. The physical property data pd is converted into a vector representation and input to the quality prediction model MD. The details of the physical property data pd will be described later with reference to FIG. 6.

[0042] The product quality prediction data qd is data indicating the quality of the product predicted by the quality prediction model MD. The quality prediction model MD outputs a vector representing a predetermined product quality. The product quality may be, for example, viscosity and the concentration of a specific impurity, but is not limited to these examples.

[0043] The quality prediction model MD may be configured by a multi-layer neural network, and the network configuration is not limited and may be any arbitrary network configuration. The quality prediction model MD may be configured by a known neural network, and the type is not limited and may be configured by, for example, a multi-layer perceptron. As described later, the quality prediction model MD may be configured by a plurality of models including a neural network.

[0044] 1 again, the functional units of the model generating device 10 will be described. The learning data acquiring unit 11 acquires learning data used for machine learning of the quality prediction model MD. In this embodiment, the learning data acquiring unit 11 acquires the learning data from the learning data storage unit 30.

[0045] The learning data consists of pairs of sensor data sd and product quality data obtained based on the track record of product production. Fig. 5 is a diagram showing an example of learning data consisting of sensor data sd and product quality data pq. The learning data ld consists of pairs of sensor data sd obtained by producing one unit quantity (one lot) of a product and product quality data pq indicating a predetermined quality of the product involved in the production. Fig. 5 shows learning data ld obtained by producing L lots of products.

[0046] The sensor data sd for one lot is made up of time-series sensor data (1 to D) acquired by D types of sensors at each time step from time t1 to tn. The inspection values ​​acquired by each of the D types of sensors may constitute the inspection values ​​for each of the D types of detection items. Furthermore, the number of time steps from time t1 to tn is variable. By manufacturing one lot of products, product quality data pq indicating the quality of the manufactured products is acquired. The product quality data pq (q1 to q L ) are the corresponding sensor data sd1 to sd L The learning data ld for each lot is associated with the products in each lot. Note that the products in each lot may be different types of products.

[0047] The first physical property data acquisition unit 12 acquires the physical property data pd of the product corresponding to the learning data ld acquired by the learning data acquisition unit 11. In this embodiment, the first physical property data acquisition unit 12 acquires the physical property data pd by referring to the physical property data storage unit 40. FIG. 6 is a diagram showing data stored in the physical property data storage unit 40. As shown in FIG. 6, the physical property data storage unit 40 stores feature amounts for each raw material used in the manufacture of the product. The feature amounts 1 to d may be, for example, information on the physical properties of the compounds constituting the raw materials, such as the boiling point and vapor pressure. The feature amounts 1 to d may be latent variables generated based on the molecular descriptors and physical property values ​​of the compounds constituting the raw materials. The feature amounts 1 to d may be any data that represents the characteristics of the raw materials, and are not limited to the above examples.

[0048] The physical property data pd of the present embodiment can be composed of, for example, the feature quantities of the raw materials of the product. Specifically, the first physical property data acquisition unit 12 determines the type of product of the learning data of one lot of the learning data acquired by the learning data acquisition unit 11 based on the attribute information (not shown) of the learning data, and determines the raw materials used in the determined product based on the attribute information (not shown) that associates the raw materials used in the production of the product with the product. Furthermore, the first physical property data acquisition unit 12 refers to the physical property data storage unit 40 to acquire information on the feature quantities associated with the raw materials of the product, and configures the physical property data pd consisting of the acquired information on the feature quantities. The physical property data pd configured in this manner becomes data having a number of dimensions obtained by multiplying (the number of types of raw materials used in the production of the product) by the number d of the feature quantities associated with each raw material. The physical property data pd of the product corresponding to the learning data ld may be acquired in advance and configured as a part of the learning data ld.

[0049] The model input / output unit 13 inputs the sensor data sd included in the learning data ld and the physical property data pd of the product corresponding to the learning data ld (sensor data sd) to the quality prediction model MD. Then, the model input / output unit 13 acquires the product quality prediction data qd output from the quality prediction model MD.

[0050] The model learning unit 14 performs machine learning of the quality prediction model MD by updating the parameters (weighting coefficients) included in the quality prediction model MD based on the error between the product quality prediction data qd output from the quality prediction model MD and acquired by the model input / output unit 13, and the product quality data pq included in the learning data ld.

[0051] The model output unit 15 outputs the trained quality prediction model MD whose parameters have been updated by the model learning unit 14. In this embodiment, the model output unit 15 stores the trained quality prediction model MD in the quality prediction model storage unit 50. When machine learning based on all previously prepared training data ld has been performed by the model learning unit 14, the model output unit 15 may determine that the quality prediction model MD has been trained and output the quality prediction model MD.

[0052] Next, a specific example of the configuration of the quality prediction model MD will be described with reference to Fig. 7. Fig. 7 is a diagram showing an example of the configuration of the quality prediction model MD. As shown in Fig. 7, the quality prediction model MD may include a first model md1 and a second model md2.

[0053] The first model md1 includes a neural network, has the sensor data sd as input, and outputs the latent variable h. The latent variable h is a vector that expresses the characteristics of the sensor data sd. The second model md2 includes a neural network, has the latent variable h and physical property data pd as input, and outputs product quality prediction data qd.

[0054] 7, when the quality prediction model MD includes a first model md1 and a second model md2, the model input / output unit 13 inputs the sensor data sd to the first model md1 and acquires a latent variable h expressing the characteristics of the sensor data sd from the first model md1. Then, the model input / output unit 13 inputs the latent variable h and the physical property data pd to the second model md2 and acquires the product quality prediction data qd output from the second model md2.

[0055] The first model md1 is only required to generate a latent variable h that is a compressed representation of the features of the input sensor data sd, and the configuration of its network and layers is not limited, but may be configured, for example, by an encoder-decoder model.

[0056] The network configuration of the neural network constituting the second model md2 is not limited, and may be, for example, a multi-layer perceptron. The second model md2 may include a fully connected layer that receives inputs of the latent variables h and the physical property data pd.

[0057] Fig. 8 is a diagram showing an example of a first model md1 configured by an encoder-decoder model. As shown in Fig. 8, the first model md1 includes an encoder en1 and a decoder de1.

[0058] The encoder en1 receives the time-series sensor data sd as input and outputs the latent variable h. That is, the model input / output unit 13 sequentially inputs the vectors of the sensor data group acquired at each time step from time t1 to tn as input data x1 to xn to the encoder en1 in time series.

[0059] The decoder de1 sequentially outputs output data y1 to yn based on the input of the latent variable h output from the encoder en1. The model input / output unit 13 acquires the output data y1 to yn output from the decoder de1.

[0060] The model learning unit 14 updates (learns) parameters of the first model md1 consisting of an encoder-decoder model, based on the error between the output data y1 to yn and the input data x1 to xn. That is, the first model md1 is an autoencoder that is machine-trained so that the output data y1 to yn and the input data x1 to xn are equal.

[0061] The encoder-decoder model constituting the first model md1 may be composed of any of a recurrent neural network (RNN), a long short-term memory (LSTM), a transformer, and a gated recurrent unit (GRU). These exemplified models are suitable for learning time-series data.

[0062] The model input / output unit 13 acquires the latent variable h output from the encoder en1 as the output of the first model md1. The model input / output unit 13 inputs the latent variable h and the physical property data pd to the second model md2, and acquires the product quality prediction data qd output from the second model md2. The model learning unit 14 updates (learns) the parameters of the second model md2 based on the error between the product quality prediction data qd and the product quality data pq included in the learning data ld.

[0063] The quality prediction model MD, which is a model including a trained neural network, can be considered as a program that is read or referenced by a computer and causes the computer to execute predetermined processes and realize predetermined functions.

[0064] That is, the trained quality prediction model MD of this embodiment is used in a computer having a CPU and a memory. Specifically, the CPU of the computer operates in accordance with instructions from the trained quality prediction model MD stored in the memory to perform calculations on input data input to an input layer of a neural network based on trained weight coefficients (parameters) and functions corresponding to each layer, and to output the results of the calculations from an output layer.

[0065] Referring again to Fig. 2, the functional units of the product quality prediction device 20 will be described. The sensor data acquisition unit 21 acquires sensor data sd detected in the manufacturing process of a product whose quality is to be predicted. In this embodiment, the sensor data acquisition unit 21 acquires the sensor data sd stored in the sensor data storage unit 60. The sensor data sd acquired here is data indicating the manufacturing state detected in the manufacturing process of one lot of products, and has the same configuration as the sensor data sd included in the learning data ld described with reference to Fig. 5.

[0066] The second physical property data acquiring unit 22 acquires product physical property data pd corresponding to the sensor data sd acquired by the sensor data acquiring unit 21. Specifically, like the first physical property data acquiring unit 12, the second physical property data acquiring unit 22 acquires the physical property data pd by referring to the physical property data storage unit 40.

[0067] The product quality prediction unit 23 inputs the sensor data sd acquired by the sensor data acquisition unit 21 and the physical property data pd acquired by the second physical property data acquisition unit 22 into the quality prediction model MD, and acquires the product quality prediction data qd output from the quality prediction model MD.

[0068] The product quality prediction data output unit 24 outputs the product quality prediction data qd acquired by the product quality prediction unit 23 as information predicting the product quality of the product to be predicted.

[0069] 9 is a flowchart showing an example of the processing contents of a model generation method in the model generation device 10 according to the embodiment. The model generation method is executed by loading a model generation program P1 into the processor 101 and executing the program to realize each of the functional units 11 to 15.

[0070] In step S1, the learning data acquiring unit 11 acquires learning data ld consisting of pairs of sensor data sd and product quality data pq acquired from the manufacturing process of a product and lot to be learned.

[0071] In step S2, the first physical property data acquiring unit 12 acquires the physical property data pd of the product corresponding to the learning data ld acquired in step S1 by the learning data acquiring unit 11. The physical property data pd of the product corresponding to the learning data ld may be acquired in advance and may constitute a part of the learning data ld.

[0072] In step S3, the model input / output unit 13 inputs the sensor data sd included in the learning data ld acquired in step S1 and the physical property data pd acquired in step S2 to the quality prediction model MD.

[0073] In step S4, the model input / output unit 13 acquires the product quality prediction data qd output from the quality prediction model MD.

[0074] In step S5, the model learning unit 14 performs machine learning of the quality prediction model MD by updating the parameters (weighting coefficients) included in the quality prediction model MD based on the error between the product quality data pq included in the learning data ld and the product quality prediction data qd acquired in step S4.

[0075] In step S6, the model output unit 15 judges whether or not to end the learning of the quality prediction model MD. For example, when machine learning based on all previously prepared learning data ld is performed by the model learning unit 14, it may be judged to end the learning. If it is judged to end the learning, the process proceeds to step S7. On the other hand, if it is not judged to end the learning, the process returns to step S1.

[0076] In step S7, the model output unit 15 outputs the trained quality prediction model MD whose parameters have been updated by the model training unit 14.

[0077] 10 is a flowchart showing an example of the processing contents of a product quality prediction method in the product quality prediction device 20 according to the embodiment. The product quality prediction method is executed by loading a product quality prediction program P2 into the processor 101 and executing the program to realize each of the functional units 21 to 24.

[0078] In step S11, the sensor data acquiring unit 21 acquires sensor data sd detected in the manufacturing process of a product whose product quality is to be predicted.

[0079] In step S12 , the second physical property data acquiring unit 22 acquires the physical property data pd of the product corresponding to the sensor data sd acquired by the sensor data acquiring unit 21 .

[0080] In step S13, the product quality prediction unit 23 inputs the sensor data sd acquired by the sensor data acquisition unit 21 and the physical property data pd acquired by the second physical property data acquisition unit 22 into the trained quality prediction model MD.

[0081] In step S14, the product quality prediction unit 23 acquires the product quality prediction data qd output from the quality prediction model MD.

[0082] In step S15, the product quality prediction data output unit 24 outputs the product quality prediction data qd acquired by the product quality predicting unit 23 in step S14 as information predicting the product quality of the product to be predicted.

[0083] Next, a model generation program for causing a computer to function as the model generation device 10 of this embodiment will be described. Fig. 11 is a diagram showing the configuration of the model generation program.

[0084] The model generation program P1 includes a main module m10 that controls the overall model generation process in the model generation device 10, a learning data acquisition module m11, a first physical property data acquisition module m12, a model input / output module m13, a model learning module m14, and a model output module m15. The modules m11 to m15 realize the functions of the learning data acquisition unit 11, the first physical property data acquisition unit 12, the model input / output unit 13, the model learning unit 14, and the model output unit 15.

[0085] The model generation program P1 may be transmitted via a transmission medium such as a communication line, or may be stored in a recording medium M1 as shown in FIG.

[0086] Next, a product quality prediction program for causing a computer to function as the product quality prediction device 20 of this embodiment will be described. Fig. 12 is a diagram showing the configuration of the product quality prediction program.

[0087] The product quality prediction program P2 includes a main module m20 that controls the overall product quality prediction process in the product quality prediction device 20, a sensor data acquisition module m21, a second physical property data acquisition module m22, a product quality prediction module m23, and a product quality prediction data output module m24. The modules m21 to m24 realize the functions of the sensor data acquisition unit 21, the second physical property data acquisition unit 22, the product quality prediction unit 23, and the product quality prediction data output unit 24.

[0088] The product quality prediction program P2 may be transmitted via a transmission medium such as a communication line, or may be stored in a recording medium M2 as shown in FIG.

[0089] According to the model generation device 10, the model generation method, and the model generation program P1 of the present embodiment described above, the sensor data detected in the manufacturing process of the product and the physical property data associated with the product are input to the quality prediction model, so that the characteristics of the sensor data are learned in association with the type of product. As a result, the sensor data of different types of products can be used for learning the quality prediction model, so that even if the amount of sensor data acquired from the manufacturing results of each type is not sufficient for learning the quality prediction model, the sensor data of multiple types of products can be used for learning the quality prediction model. Therefore, it is possible to predict the quality of products manufactured in a plant that manufactures a wide variety of products in small quantities, such as a batch plant.

[0090] The present invention has been described in detail above based on the embodiments. However, the present invention is not limited to the above embodiments. The present invention can be modified in various ways without departing from the gist of the present invention. [Explanation of symbols]

[0091] P1: model generation program, P2: product quality prediction program, m10: main module, m11: learning data acquisition module, m12: first physical property data acquisition module, m13: model input / output module, m14: model learning module, m15: model output module, m20: main module, m21: sensor data acquisition module, m22: second physical property data acquisition module, m23: product quality prediction module, m24: product quality prediction data output module 1, 10...model generation device, 11...learning data acquisition unit, 12...first physical property data acquisition unit, 13...model input / output unit, 14...model learning unit, 15...model output unit, 20...product quality prediction device, 21...sensor data acquisition unit, 22...second physical property data acquisition unit, 23...product quality prediction unit, 24...product quality prediction data output unit, 30...learning data storage unit, 40...physical property data storage unit, 50...quality prediction model storage unit, 60...sensor data storage unit, M1, M2...recording medium, MD...quality prediction model.

Claims

1. A model generation device that generates a quality prediction model for predicting product quality of a plurality of types of products to be manufactured by machine learning, the quality prediction model includes a neural network, receives sensor data and physical property data as input, and outputs product quality prediction data representing a predicted product quality; and includes a first model and a second model; learning data used in machine learning of the quality prediction model includes pairs of sensor data and product quality data; the sensor data is data including inspection values ​​of one or more detection items that are detected in a manufacturing process of one unit quantity of the product and indicate a manufacturing state, the product quality data is data indicating a product quality of the product manufactured in a manufacturing process in which the corresponding sensor data is detected, The physical property data is data associated with each product and indicates characteristics of the product; The model generating device comprises: a model input / output unit that inputs the sensor data included in the learning data and the physical property data of the product corresponding to the learning data into the quality prediction model, and acquires the product quality prediction data output from the quality prediction model; a model learning unit that updates parameters included in the quality prediction model based on an error between the product quality prediction data and the product quality data included in the learning data; a model output unit that outputs the trained quality prediction model in which the parameters have been updated by the model training unit, the model input / output unit inputs the sensor data to the first model, acquires latent variables expressing features of the sensor data from the first model, inputs the latent variables and the physical property data to the second model, and acquires the product quality prediction data output from the second model. Model generation device.

2. The first model is an encoder-decoder model including a neural network and configured with an encoder and a decoder, the encoder generates the latent variables based on the sensor data, and the decoder generates output data based on the latent variables; the model input / output unit inputs the sensor data to the encoder and acquires the output data output from the decoder; the model learning unit updates parameters of the first model based on an error between the output data and the sensor data input to the encoder, and updates parameters of the second model based on an error between the product quality prediction data output from the second model and the product quality data. The model generating device according to claim 1 .

3. the sensor data includes data acquired in a time series for each item in a manufacturing process of the product, The encoder-decoder model is configured by any one of a recurrent neural network (RNN), a long short-term memory (LSTM), a transformer, and a gated recurrent unit (GRU), The model input / output unit sequentially inputs the sensor data to the encoder in time series. The model generating device according to claim 2 .

4. The sensor data includes at least one of a temperature and a pressure in a manufacturing process, The physical property data is data indicative of at least one of physical properties and characteristics of a raw material associated with the raw material of a product. The model generating device according to any one of claims 1 to 3.

5. A model generation method for a model generation device that generates a quality prediction model for predicting product quality of a plurality of types of products to be manufactured by machine learning, comprising: the quality prediction model includes a neural network, receives sensor data and physical property data as input, and outputs product quality prediction data representing a predicted product quality; and includes a first model and a second model; learning data used in machine learning of the quality prediction model includes pairs of sensor data and product quality data; the sensor data is data including inspection values ​​of one or more detection items that are detected in a manufacturing process of one unit quantity of the product and indicate a manufacturing state, the product quality data is data indicating a product quality of the product manufactured in a manufacturing process in which the corresponding sensor data is detected, The physical property data is data associated with each product and indicates characteristics of the product; The model generation method includes: a model input / output step of inputting the sensor data included in the learning data and the physical property data of the product corresponding to the learning data into the quality prediction model, and acquiring the product quality prediction data output from the quality prediction model; a model learning step of updating parameters included in the quality prediction model based on an error between the product quality prediction data and the product quality data included in the learning data; a model output step of outputting the trained quality prediction model in which the parameters have been updated in the model training step, In the model input / output step, the sensor data is input to the first model, latent variables expressing features of the sensor data are obtained from the first model, the latent variables and the physical property data are input to the second model, and the product quality prediction data output from the second model is obtained. Model generation method.

6. A model generation program for causing a computer to function as a model generation device that generates, by machine learning, a quality prediction model for predicting product quality of a plurality of types of products to be manufactured, the quality prediction model includes a neural network, receives sensor data and physical property data as input, and outputs product quality prediction data representing a predicted product quality; and includes a first model and a second model; learning data used in machine learning of the quality prediction model includes pairs of sensor data and product quality data; the sensor data is data including inspection values ​​of one or more detection items that are detected in a manufacturing process of one unit quantity of the product and indicate a manufacturing state, the product quality data is data indicating a product quality of the product manufactured in a manufacturing process in which the corresponding sensor data is detected, The physical property data is data associated with each product and indicates characteristics of the product; The model generation program is configured to: a model input / output function for inputting the sensor data included in the learning data and the physical property data of the product corresponding to the learning data into the quality prediction model, and acquiring the product quality prediction data output from the quality prediction model; a model learning function for updating parameters included in the quality prediction model based on an error between the product quality prediction data and the product quality data included in the learning data; A model output function that outputs the learned quality prediction model in which the parameters have been updated by the model learning function, The model input / output function inputs the sensor data into the first model, acquires latent variables expressing features of the sensor data from the first model, inputs the latent variables and the physical property data into the second model, and acquires the product quality prediction data output from the second model. Model generator.

7. A quality prediction model trained by machine learning for causing a computer to function and predicting product quality of multiple types of products to be manufactured, The method includes a neural network, receives sensor data and physical property data as input, outputs product quality prediction data representing a predicted product quality, and includes a first model and a second model; learning data used in machine learning of the quality prediction model includes pairs of sensor data and product quality data; the sensor data is data including inspection values ​​of one or more detection items that are detected in a manufacturing process of one unit quantity of the product and indicate a manufacturing state, the product quality data is data indicating a product quality of the product manufactured in a manufacturing process in which the corresponding sensor data is detected, The physical property data is data associated with each product and indicates characteristics of the product, The quality prediction model is The system is constructed by machine learning that updates parameters based on an error between the product quality prediction data output in response to input of the sensor data and the physical property data corresponding to the sensor data included in the learning data, and the product quality data included in the learning data; a latent variable expressing a feature of the sensor data is output from the first model in response to the sensor data being input to the first model, and the product quality prediction data is output from the second model in response to the latent variable and the physical property data being input to the second model. A trained quality prediction model.

8. A product quality prediction device that predicts product quality of multiple types of products to be manufactured using a quality prediction model constructed by machine learning, the quality prediction model includes a neural network, receives sensor data and physical property data as input, and outputs product quality prediction data representing a predicted product quality; and includes a first model and a second model; learning data used in machine learning of the quality prediction model includes pairs of sensor data and product quality data; the sensor data is data including inspection values ​​of one or more detection items that are detected in a manufacturing process of one unit quantity of the product and indicate a manufacturing state, the product quality data is data indicating a product quality of the product manufactured in a manufacturing process in which the corresponding sensor data is detected, The physical property data is data associated with each product and indicates characteristics of the product, The quality prediction model is The system is constructed by machine learning that updates parameters based on an error between the product quality prediction data output in response to input of the sensor data and the physical property data corresponding to the sensor data included in the learning data, and the product quality data included in the learning data; a latent variable expressing a feature of the sensor data is output from the first model in response to the sensor data being input to the first model, and the product quality prediction data is output from the second model in response to the latent variable and the physical property data being input to the second model. The product quality prediction device includes: a product quality prediction unit that inputs sensor data detected in a manufacturing process of a product whose product quality is to be predicted and the physical property data of the product corresponding to the sensor data into the quality prediction model, and obtains the product quality prediction data output from the quality prediction model; a product quality prediction data output unit that outputs the product quality prediction data acquired by the product quality prediction unit; A product quality prediction device comprising:

Images