Engine control device, engine control method, and engine control program

Abstract

To provide an engine control device, an engine control method, and an engine control program, which quickly find a solution to an optimization problem by using an engine combustion model reproduced by AI deep learning.SOLUTION: A model reproduces, on the basis of an engine operation condition and a first operation amount, at least one of a thermal efficiency, a maximum pressure rise rate in a cylinder, a torque, a combustion start position, a combustion center of gravity, NOx, Soot, CO, HC and PM, which are indicators of a combustion state of the engine. An operation amount optimizing unit 173 uses at least one of the indicators reproduced by the model as an estimated value of a controlled variable, and determines a second operation amount by using a model so that the estimated value of the controlled variable follows a control target value. A learning control table updating unit 174 associates the second operation amount, the control target value, and the engine operating condition with each other to rewrite the learning control table. An operation amount calculation unit 106 calculates an operation amount by the learning control table on the basis of the control target value and the engine operation condition.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an engine control device, an engine control method, and an engine control program. [Background technology]

[0002] In the control of automobile engines, efforts are being made to achieve high-performance control by using AI (Artificial Intelligence) deep learning to reproduce the combustion phenomenon of the engine in a combustion model. [Overview of the project] [Problems that the invention aims to solve]

[0003] However, in control systems using engine combustion models reproduced by AI deep learning, optimal control is performed by simultaneously controlling multiple controlled variables using a multi-input, multi-output model of engine combustion that includes a multi-layer neural network (NN). Therefore, control systems using engine combustion models reproduced by AI deep learning require a significant amount of computation time.

[0004] Furthermore, the engine combustion model is nonlinear and represents a dynamic system that includes characteristics such as first-order and second-order lags and dead time, because it takes into account the effects of the amount of air flowing into the engine cylinder, its temperature, and pressure. Therefore, it is difficult to derive a mathematical model of the inverse function of the engine combustion model using symbolic computation. This makes it difficult to solve the problem analytically, resulting in a high computational load. For these reasons, it is difficult to implement the engine combustion model in the engine control unit and control its execution time onboard.

[0005] One aspect of this invention is to provide an engine control device, an engine control method, and an engine control program that can quickly derive solutions to optimization problems using an engine combustion model reproduced by AI deep learning. [Means for solving the problem]

[0006] In the first proposal, the model shows the error between the control target value and the controlled variable, and the manipulated variable, when a predetermined operation is performed on the engine. Change The first manipulated variable that minimizes the control evaluation value calculated from the engine, along with the engine operating conditions, reproduces at least one of the engine combustion state indicators: thermal efficiency, maximum in-cylinder pressure rise rate, torque, combustion start position, combustion center of gravity, NOx, Soot, CO, HC, and PM. The manipulated variable optimization unit uses at least one of the indicators reproduced by the model as an estimated value of the controlled variable, and repeatedly calculates the control evaluation value by optimizing the model so that the estimated value of the controlled variable follows the control target value. The first manipulated variable at the end of the calculation of the control evaluation value is determined as the second manipulated variable. The learning control table update unit associates the second manipulated variable with the control target value and the engine operating conditions, and rewrites the learning control table in which the manipulated variables corresponding to the control target value and the engine operating conditions are registered. The manipulated variable calculation unit calculates the manipulated variable using the learning control table based on the control target value and the engine operating conditions. [Effects of the Invention]

[0007] In one respect, the present invention can quickly derive solutions to optimization problems using engine combustion models reproduced by AI deep learning. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 is a block diagram of the engine control device according to the first embodiment. [Figure 2] Figure 2 shows an example of calculating the manipulated variable using a high-dimensional table called a learning control table. [Figure 3] Figure 3 shows an example of how to calculate manipulated variables using a learning control table, which is a two-dimensional table. [Figure 4]Figure 4 shows an example of an AI model, which is a mathematical model of an engine system. [Figure 5] Figure 5 illustrates an example of considering modeling errors in an AI model and drift due to sensor degradation. [Figure 6] Figure 6 is a flowchart of the control process of the engine system by the engine control device according to the first embodiment. [Figure 7] Figure 7 is a flowchart of the learning control table update process by the engine control device according to the first embodiment. [Figure 8] Figure 8 is a block diagram of the engine control device according to the second embodiment. [Figure 9] Figure 9 is a flowchart of the control process of the engine system by the engine control device according to the second embodiment. [Figure 10] Figure 10 is a flowchart of the AI ​​model learning process by the engine control device according to the second embodiment. [Figure 11] Figure 11 is a block diagram of the engine control device according to the third embodiment. [Figure 12] Figure 12 is a flowchart of the control process of the engine system by the engine control device according to the third embodiment. [Figure 13] Figure 13 is a flowchart of the learning process for the AI ​​model error learning table by the engine control device according to the third embodiment. [Figure 14] Figure 14 is a flowchart of the learning control table update process by the engine control device according to the third embodiment. [Figure 15] Figure 15 shows an example of the hardware configuration of an engine control device. [Modes for carrying out the invention]

[0009] Hereinafter, embodiments of the engine control device, engine control method, and engine control program disclosed in the present application will be described in detail based on the drawings. Note that the engine control device, engine control method, and engine control program disclosed in the present application are not limited by the following embodiments. Also, the respective embodiments can be appropriately combined within a non - contradictory range.

[0010] (First Embodiment) [Example of Overall Configuration] Using FIG. 1, the configuration of the engine control device according to this embodiment will be described. FIG. 1 is a block diagram of the engine control device according to the first embodiment. As shown in FIG. 1, the engine control device 100 is connected to an engine system 200 that is the control target. The engine control device 100 and the engine system 200 communicate with each other.

[0011] The engine control device 100 uses an AI model, which is an engine combustion model of a multi - layer neural network, to perform optimal control of the engine system 200 while calculating an optimal operation amount at high speed. Details of the engine control device 100 will be described below.

[0012] As shown in FIG. 1, the engine control device 100 includes an engine operation condition detection unit 101, a cylinder - internal pressure detection unit 102, an exhaust - gas detection unit 103, a combustion index calculation unit 104, a control target value calculation unit 105, an operation amount calculation unit 106, and a learning control table management unit 107.

[0013] The engine operating condition detection unit 101 acquires engine operating conditions, including engine speed and total combustion injection amount, from the engine system 200. The engine operating condition detection unit 101 also acquires state quantities, including excess air ratio, fuel injection pressure, intake manifold pressure, and intake manifold oxygen concentration, from the engine system 200. The engine operating condition detection unit 101 then outputs the acquired engine operating condition information from the engine system 200 to the control target value calculation unit 105. The engine operating condition detection unit 101 also outputs the engine operating conditions and state quantity information to the manipulated variable calculation unit 106 and the learning control table management unit 107.

[0014] The in-cylinder pressure detection unit 102 acquires information on the in-cylinder pressure detected by an in-cylinder pressure sensor (not shown) mounted on the engine system 200. The in-cylinder pressure detection unit 102 then outputs the detected in-cylinder pressure information to the combustion index calculation unit 104.

[0015] The exhaust gas detection unit 103 acquires exhaust gas information such as NOx (nitrogen oxides), soot, CO (carbon monoxide), HC (hydrocarbons), and PM (particulate matter) detected by an exhaust gas sensor (not shown) mounted on the engine system 200. The exhaust gas detection unit 103 then outputs the exhaust gas information to the combustion index calculation unit 104.

[0016] The combustion index calculation unit 104 receives in-cylinder pressure information from the in-cylinder pressure detection unit 102. The combustion index calculation unit 104 also receives exhaust gas information from the exhaust gas detection unit 103. From the acquired in-cylinder pressure, the combustion index calculation unit 104 calculates thermal efficiency, maximum in-cylinder pressure rise rate, torque, combustion start position, and combustion center of gravity. Next, the combustion index calculation unit 104 combines the calculated information on thermal efficiency, maximum in-cylinder pressure rise rate, torque, combustion start position, and combustion center of gravity with exhaust gas information such as NOx, Soot, CO, HC, and PM to create an index representing the engine's combustion state. Hereafter, this index representing the engine's combustion state will be referred to as the engine combustion index. Finally, the combustion index calculation unit 104 outputs the engine combustion index to the learning control table management unit 107.

[0017] The control target value calculation unit 105 receives information on engine operating conditions from the engine operating condition detection unit 101. The control target value calculation unit 105 then calculates the control target value from the engine operating conditions, namely the engine speed and the total fuel injection amount. Subsequently, the control target value calculation unit 105 outputs the calculated control target value to the manipulated variable calculation unit 106 and the learning control table management unit 107.

[0018] The manipulated variable calculation unit 106 receives input of engine operating conditions and state variables of the engine system 200 from the engine operating condition detection unit 101. The manipulated variable calculation unit 106 also receives input of control target values ​​from the control target value calculation unit 105. Furthermore, the manipulated variable calculation unit 106 obtains a learning control table from the learning control table management unit 107. Here, the learning control table is a table in which combinations of control target values ​​and one or more pieces of information of state variables and engine operating conditions, and the appropriate manipulated variables corresponding to them are registered. In other words, the learning control table allows the acquisition of manipulated variables corresponding to combinations of control target values ​​and one or more pieces of information of state variables and engine operating conditions. Thus, the learning control table has a rewritable structure that reproduces the input / output response of the inverse model of the AI ​​model, which will be described later.

[0019] Next, the manipulated variable calculation unit 106 uses a learning control table to acquire manipulated variables, including the fuel injection amounts and injection durations for each stage of multi-stage injection such as pre-, pilot, main, and after, based on one or more pieces of information from the engine operating conditions and state variables of the engine system 200, as well as control target values. The manipulated variable calculation unit 106 then notifies the engine system 200 of the acquired manipulated variables and controls the engine system 200 to operate according to the acquired manipulated variables.

[0020] Figure 2 shows an example of calculating a manipulated variable using a high-dimensional table called a learning control table. For example, the manipulated variable calculation unit 106 has a learning control table 300 as shown in Figure 2. By using the learning control table 300, the manipulated variable calculation unit 106 can receive input values ​​for three or more items from engine operating conditions, state variables, and control target values, and obtain a manipulated variable called the pre-fuel injection amount, which is one of the manipulated variables, for those inputs. In this case, the manipulated variable calculation unit 106 may prepare multiple multi-input, one-output tables like the learning control table 300, or it may use a multi-input, multi-output table in order to obtain multiple manipulated variables.

[0021] Figure 3 shows an example of calculating manipulated variables using a two-dimensional learning control table. For example, the manipulated variable calculation unit 106 has learning control tables 301 to 306, which are two-dimensional tables as shown in Figure 3. The manipulated variable calculation unit 106 can obtain the pre-fuel injection amount, which is one of the manipulated variables, by combining the outputs from each of the learning control tables 301 to 306, which correspond to two values ​​from among the engine operating conditions, state variables, and control target values, in multiple stages. In this case, the manipulated variable calculation unit 106 can also obtain other manipulated variables such as injection amount and injection duration by combining the two-dimensional learning control tables 301 to 306, similar to the pre-fuel injection amount.

[0022] The learning control table management unit 107 updates the learning control table, which contains combinations of control target values ​​and one or more pieces of information from engine operating conditions and state variables, as well as the values ​​of the manipulated variables corresponding to each combination. The learning control table management unit 107 updates the learning control table periodically or at predetermined timings, such as when predetermined conditions are met, and is performed independently of the calculation of manipulated variables using the learning control table by the manipulated variable calculation unit 106. That is, the learning control table management unit 107 transmits the updated learning control table to the manipulated variable calculation unit 106, and from there until the next update, the manipulated variable calculation unit 106 uses the updated learning control table to calculate manipulated variables. As shown in Figure 1, the learning control table management unit 107 includes a control variable estimation unit 171, a control evaluation value calculation unit 172, a manipulated variable optimization unit 173, and a learning control table update unit 174.

[0023] The control variable estimation unit 171 holds an AI model, which is a mathematical model of the engine system 200. The AI ​​model can use a type of neural network such as DNN (Deep Neural Network), RNN (Recurrent Neural Network), or LSTM (Long Short-Term Memory).

[0024] For example, the control variable estimation unit 171 has an AI model 400, which is an LSTM model as shown in Figure 4. Figure 4 is a diagram showing an example of an AI model, which is a mathematical model of the engine system. As shown in Figure 4, the AI ​​model 400 has an input layer 401, a hidden layer 402, and an output layer 403. The LSTM model has a structure in which each unit of the hidden layer of an RNN, a type of deep learning model, is replaced with an LSTM block 404. The LSTM block 404 has a memory cell 411 that stores the state and three gates 412 to 414. The LSTM block 404 is capable of handling both long-term and short-term time dependencies.

[0025] Each parameter in the LSTM model shown in Figure 4 is calculated using the following equations (1) to (6).

[0026]

number

[0027]

number

[0028]

number

[0029]

number

[0030]

number

[0031]

number

[0032] Here, s is the sigmoid function, b is the bias, W is the input weight, U is the regression weight, and f and g are the hyperbolic tangent functions (tanh).

[0033] The AI ​​model in the control variable estimation unit 171 takes engine operating conditions, state variables, and manipulated variables as input and estimates and outputs information that serves as an indicator of the engine's combustion state as a controlled variable. As information that serves as an indicator of the engine's combustion state, for example, one or more combinations of the following can be used: thermal efficiency, maximum in-cylinder pressure rise rate, torque, combustion start position, combustion center of gravity, and exhaust gas information. The exhaust gas information may be one or more of NOx, Soot, CO, HC, and PM. In other words, the AI ​​model reproduces at least one of the thermal efficiency, maximum in-cylinder pressure rise rate, torque, combustion start position, combustion center of gravity, NOx, Soot, CO, HC, and PM included in the engine combustion indicator based on the engine operating conditions and the first manipulated variable.

[0034] The control variable estimation unit 171 acquires the engine operating conditions and state variables of the engine system 200 from the engine operating condition detection unit 101. The control variable estimation unit 171 also acquires the first manipulated variable during the optimization calculation from the manipulated variable optimization unit 173.

[0035] Next, the control variable estimation unit 171 inputs the acquired engine operating conditions, state variables, and the first manipulated variable of the manipulated variable optimization unit 173 of the engine system 200 into the stored AI model to estimate a controlled variable that serves as an indicator of the engine's combustion state. The controlled variable is at least one of the engine combustion indicators reproduced by the AI ​​model. Subsequently, the control variable estimation unit 171 outputs the estimated value of the estimated controlled variable to the control evaluation value calculation unit 172. The control variable estimation unit 171 also outputs the engine operating conditions and state variable information of the engine system 200 used to estimate the control variable to the learning control table update unit 174.

[0036] The control evaluation value calculation unit 172 obtains the control target value from the control target value calculation unit 105. The control evaluation value calculation unit 172 also obtains the estimated value of the controlled quantity estimated by the control quantity estimation unit 171. The control evaluation value calculation unit 172 also obtains the first manipulated quantity from the manipulated quantity optimization unit 173. The control evaluation value calculation unit 172 also obtains the engine combustion index generated by the combustion index calculation unit 104.

[0037] Next, the control evaluation value calculation unit 172 obtains the actual value of the controlled variable from the engine combustion index in order to consider the modeling error of the AI model that estimates the controlled variable and the drift due to sensor degradation. Then, the control evaluation value calculation unit 172 adds the actual value of the controlled variable to the estimated controlled variable to calculate the controlled variable considering the modeling error of the AI model and the drift due to sensor degradation.

[0038] FIG. 5 is a diagram for explaining an example of considering the modeling error of the AI model and the drift due to sensor degradation. The vertical axis in FIG. 5 represents the output, and the horizontal axis represents the passage of time. In order to consider the deviation between the estimated value by the AI model and the actual measured value, disturbances, and the influence of sensor degradation, the control evaluation value calculation unit 172 estimates the controlled variable by taking into account, for example, the error between the current estimated value of the controlled variable and the current measured value in the relationship shown in FIG. 5.

[0039] In FIG. 5, the current actual measured value is y(t), the estimated value at the j steps ahead is y M (t + j), and the current estimated value of the model is y M (t). The case will be described. The estimated value of the controlled variable y p (t + j) is expressed as y p (t + j) = y(t) + y M (t + j) - y M (t). In this case, y p = [y p (t + L),..., y p( (t + L + P - 1)] t That is, it can be said that the estimation by the AI model simply predicts the change amount without considering the error d(t). Therefore, the control evaluation value calculation unit 172 uses, as the estimated value of the controlled variable, the value obtained by adding the error between the estimated value and the measured value of the controlled variable at a specific time point to the predicted estimated value of the controlled variable.

[0040] Next, the control evaluation value calculation unit 172 calculates the control evaluation value using a weighted value obtained by adding the error between the control target value and the controlled variable and the change in the manipulated variable. For example, the control evaluation value calculation unit 172 calculates the control evaluation value as the sum of the time average value of the error between the control target value and the controlled variable over a predetermined period and a weighted value obtained by adding the time average value of the change in the manipulated variable over a predetermined period. After that, the control evaluation value calculation unit 172 outputs the calculated control evaluation value to the manipulated variable optimization unit 173. The control evaluation value calculation unit 172 also outputs the control target value used to calculate the control evaluation value to the learning control table update unit 174.

[0041] The manipulated variable optimization unit 173 obtains the control evaluation value input from the control evaluation value calculation unit 172. The manipulated variable optimization unit 173 then calculates the manipulated variable that minimizes the obtained control evaluation value. During the optimization calculation, the manipulated variable optimization unit 173 outputs the calculated manipulated variable as the first manipulated variable to the control variable estimation unit 171. Furthermore, when the control evaluation value is minimized or when the optimization calculation is completed after a predetermined number of iterations, the manipulated variable optimization unit 173 outputs the calculated manipulated variable as the second manipulated variable and the optimal manipulated variable to the learning control table update unit 174.

[0042] The learning control table update unit 174 obtains the optimal manipulated variable input from the manipulated variable optimization unit 173. The learning control table update unit 174 also obtains the engine operating conditions and state variables of the engine system 200 from the control variable estimation unit 171. Furthermore, the learning control table update unit 174 obtains the control target value input from the control evaluation value calculation unit 172.

[0043] Next, the learning control table update unit 174 associates the combination of control target value, engine operating conditions, and state variables with the corresponding optimal manipulated variable. Then, the learning control table update unit 174 rewrites the learning control table using the combination of control target value, state variables, and engine operating conditions and the corresponding manipulated variable values. After that, the learning control table update unit 174 outputs the updated learning control table to the manipulated variable calculation unit 106.

[0044] In this embodiment, the learning control table update unit 174 updates the learning control table by rewriting the information in the learning control table, which is a table that reproduces the input / output response of the inverse model of the AI ​​model. However, other configurations are also possible. For example, two tables may be prepared as the learning control table. One is a first learning control table in which combinations of control target values, state variables, and one or more pieces of engine operating condition information, and the corresponding appropriate manipulated variables are registered. The other is a second learning control table for correcting the difference between the manipulated variables registered in the first learning control table and the manipulated variables calculated by optimization using the AI ​​model. The learning control table update unit 174 may then update the second learning control table to correct the difference between the manipulated variables registered in the first learning table and the optimal manipulated variables obtained by the manipulated variable optimization unit 173, and pass the first learning control table and the second learning control table to the manipulated variable calculation unit 106. In that case, the manipulated variable calculation unit 106 may apply a correction to the manipulated variable calculated using the first learning control table using the second learning control table, and then control the engine system 200 with the corrected manipulated variable.

[0045] [Process flow] Figure 6 is a flowchart of the control process of the engine system by the engine control device according to the first embodiment. Next, referring to Figure 6, the flow of the control process of the engine system 200 by the engine control device 100 according to this embodiment will be explained.

[0046] The in-cylinder pressure detection unit 102 acquires information on the in-cylinder pressure detected by the in-cylinder pressure sensor mounted on the engine system 200 (step S101). The in-cylinder pressure detection unit 102 then outputs the detected in-cylinder pressure information to the combustion index calculation unit 104.

[0047] The exhaust gas detection unit 103 acquires exhaust gas information detected by the exhaust gas sensor mounted on the engine system 200 (step S102). The exhaust gas detection unit 103 then outputs the exhaust gas information to the combustion index calculation unit 104.

[0048] The combustion index calculation unit 104 calculates the fuel index of the engine system 200 using the in-cylinder pressure information obtained from the in-cylinder pressure detection unit 102 and the exhaust gas information obtained from the exhaust gas detection unit 103 (step S103).

[0049] The engine operating condition detection unit 101 acquires engine operating conditions, including engine speed and total combustion injection amount, from the engine system 200. The engine operating condition detection unit 101 also acquires state quantities, including excess air ratio, fuel injection pressure, intake manifold pressure, and intake manifold oxygen concentration, from the engine system 200 (step S104). The engine operating condition detection unit 101 then outputs the engine operating condition information to the control target value calculation unit 105.

[0050] The control target value calculation unit 105 receives information on engine operating conditions from the engine operating condition detection unit 101. The control target value calculation unit 105 then calculates the control target value from the engine operating conditions (step S105). After that, the control target value calculation unit 105 outputs the calculated control target value to the manipulated variable calculation unit 106.

[0051] The learning control table update unit 174 of the learning control table management unit 107 determines whether or not the learning control table has been updated (step S106). If the learning control table has not been updated (step S106: negative), the engine system control process proceeds to step S108.

[0052] In contrast, if the learning control table is updated (step S106: affirmative), the learning control table update unit 174 outputs the updated learning control table to the manipulated variable calculation unit 106. The manipulated variable calculation unit 106 acquires the updated learning control table (step S107).

[0053] Subsequently, the manipulated variable calculation unit 106 uses a learning control table to acquire manipulated variables, including the fuel injection amounts and injection durations for each multi-stage injection at each time point such as pre-, pilot, main, and after, based on one or more pieces of information from the engine operating conditions and state variables of the engine system 200, as well as control target values ​​(step S108). Then, the manipulated variable calculation unit 106 notifies the engine system 200 of the acquired manipulated variables and controls the engine system 200 to operate according to the notified manipulated variables.

[0054] Figure 7 is a flowchart of the learning control table update process by the engine control device according to the first embodiment. Next, the flow of the learning control table update process by the engine control device 100 according to this embodiment will be described with reference to Figure 7.

[0055] The control variable estimation unit 171 acquires the engine operating conditions and state variables of the engine system 200 from the engine operating condition detection unit 101. The control variable estimation unit 171 also acquires the first manipulated variable during the optimization calculation from the manipulated variable optimization unit 173. Next, the control variable estimation unit 171 inputs the acquired engine operating conditions, state variables of the engine system 200, and the first manipulated variable from the manipulated variable optimization unit 173 into the stored AI model to estimate the controlled variable (step S111). After that, the control variable estimation unit 171 outputs the estimated controlled variable to the control evaluation value calculation unit 172. The control variable estimation unit 171 also outputs the engine operating conditions and state variables of the engine system 200 used for estimating the control variable to the learning control table update unit 174.

[0056] The control evaluation value calculation unit 172 obtains the control target value from the control target value calculation unit 105. The control evaluation value calculation unit 172 also obtains the estimated controlled quantity from the controlled quantity estimation unit 171. The control evaluation value calculation unit 172 also obtains the first manipulated quantity from the manipulated quantity optimization unit 173. The control evaluation value calculation unit 172 also obtains the engine combustion index generated by the combustion index calculation unit 104. The control evaluation value calculation unit 172 also obtains the actual value of the controlled quantity from the engine combustion index. Next, the control evaluation value calculation unit 172 calculates the controlled quantity considering drift by adding the actual value of the controlled quantity to the estimated controlled quantity. Next, the control evaluation value calculation unit 172 calculates a control evaluation value as a weighted value based on the error between the control target value and the controlled quantity and the change in the manipulated quantity (step S112). After that, the control evaluation value calculation unit 172 outputs the calculated control evaluation value to the manipulated quantity optimization unit 173. Furthermore, the control evaluation value calculation unit 172 outputs the control target value used to calculate the control evaluation value to the learning control table update unit 174.

[0057] The manipulated variable optimization unit 173 obtains the control evaluation value input from the control evaluation value calculation unit 172. The manipulated variable optimization unit 173 then calculates the manipulated variable that minimizes the obtained control evaluation value (step S113). In the optimization calculation, the manipulated variable optimization unit 173 outputs the calculated manipulated variable as the first manipulated variable to the control variable estimation unit 171. Furthermore, when the control evaluation value is minimized or when the optimization calculation is completed after a predetermined number of iterations, the manipulated variable optimization unit 173 uses the calculated manipulated variable as the second manipulated variable and outputs it as the optimal manipulated variable to the learning control table update unit 174.

[0058] The learning control table update unit 174 obtains the input of the optimal manipulated variable from the manipulated variable optimization unit 173. The learning control table update unit 174 also obtains the input of the engine operating conditions and state variables of the engine system 200 from the control variable estimation unit 171. Furthermore, the learning control table update unit 174 obtains the input of the control target value from the control evaluation value calculation unit 172. Next, the learning control table update unit 174 associates the combination of the control target value, engine operating conditions and state variables with the corresponding optimal manipulated variable. Then, the learning control table update unit 174 rewrites the learning control table using the combination of the control target value, state variables and engine operating conditions and the corresponding values ​​of the manipulated variables (step S114).

[0059] As described above, the engine control device 100 according to this embodiment includes an AI model that reproduces at least one of the indicators of the engine's combustion state, namely thermal efficiency, maximum pressure rise rate in the cylinder, torque, combustion start position, combustion center of gravity, NOx, Soot, CO, HC, and PM, based on engine operating conditions, state variables, and a first manipulated variable; a learning control table management unit 107 that determines a second manipulated variable by optimization using the AI ​​model so that the estimated value of the controlled variable follows the control target; a learning control table management unit 107 that associates the second manipulated variable with the control target value and the engine operating conditions and state variables, and rewrites a learning control table in which the manipulated variables corresponding to the control target value and the engine operating conditions and state variables are registered; and a manipulated variable calculation unit 106 that calculates the manipulated variable using the learning control table based on the control target value and the engine operating conditions and state variables.

[0060] The engine control device 100 according to this embodiment determines the optimal manipulated variable corresponding to the combination of the control target value, engine operating conditions, and state variable by optimization using an AI model that estimates the controlled variable, which is an indicator of the combustion state. The engine control device 100 then updates the learning control table, which stores the combination of the control target value, engine operating conditions, and state variable and the corresponding manipulated variable, at a predetermined timing using the determined optimal manipulated variable. The engine control device 100 also uses the learning control table to acquire the optimal manipulated variable based on the current engine operating conditions, state variable, and control target value of the engine system 200, and controls the engine system 200 with that manipulated variable. This makes it possible to quickly control the engine system 200 using the optimal manipulated variable determined using the AI ​​model, and to update the optimal manipulated variable to an appropriate value according to the operation and state of the engine system 200.

[0061] As a result, the engine control device 100 can quickly derive a solution to an optimization problem using an engine combustion model reproduced by AI deep learning, and can provide a high-performance real-time controller for the engine system 200.

[0062] Furthermore, engine operating conditions include engine speed and total fuel injection amount.

[0063] As a result, the engine control device 100 can appropriately control the engine according to the solution of an optimization problem using the engine's combustion model.

[0064] Furthermore, the control quantity includes the fuel injection amount and injection duration for each stage of multi-stage injection.

[0065] As a result, the engine control device 100 can appropriately control the engine according to the solution of an optimization problem using the engine's combustion model.

[0066] Furthermore, the AI ​​model is one of the following types of neural networks: DNN, RNN, or LSTM.

[0067] As a result, the engine control device 100 can quickly derive a solution to an optimization problem using the engine's combustion model with higher accuracy.

[0068] Furthermore, the learning control table management unit 107 optimizes the manipulated variable using the error between the control target value and the estimated value of the controlled variable by the AI ​​model, as well as the weighted change in the manipulated variable.

[0069] As a result, the engine control device 100 can quickly derive a solution to an optimization problem using the engine's combustion model with higher accuracy.

[0070] Furthermore, the learning control table is a table that reproduces the input / output response of the inverse model of the AI ​​model, and is also rewritable.

[0071] As a result, the engine control device 100 can quickly derive a solution to an optimization problem using the engine's combustion model.

[0072] Furthermore, the learning control table is a table that reproduces the input and output responses of the inverse model of the AI ​​model, which is composed of a combination of two-dimensional tables.

[0073] As a result, the engine control device 100 can quickly derive a solution to an optimization problem using the engine's combustion model.

[0074] Furthermore, the learning control table includes two types of tables: a first learning control table formed by the control target value, engine operating conditions (engine speed and fuel injection amount), and the manipulated variable; and a second learning control table for correcting the difference between the manipulated variable of the first learning control table and the second manipulated variable calculated by optimization.

[0075] As a result, the engine control device 100 can quickly derive a solution to an optimization problem using the engine's combustion model.

[0076] Furthermore, the learning control table has one axis representing the engine operating conditions, namely engine speed and fuel injection amount, and the other axis representing an indicator of the engine's combustion state.

[0077] As a result, the engine control device 100 can quickly derive a solution to an optimization problem using the engine's combustion model.

[0078] (Second Embodiment) Figure 8 is a block diagram of the engine control device according to the second embodiment. The engine control device 100 according to this embodiment differs from that of Embodiment 1 in that it sequentially updates the AI ​​model. In the following description, the AI ​​model update process will be mainly described, and the operation of each part, which is the same as in the first embodiment, will be omitted. In addition to the parts described in the first embodiment, the engine control device 100 according to this embodiment has an AI model update unit 108.

[0079] The AI ​​model update unit 108 receives engine operating conditions and the state variables as input from the engine operating condition detection unit 101. The AI ​​model update unit 108 also receives manipulated variables acquired using a learning control table as input from the manipulated variable calculation unit 106. Based on the acquired engine operating conditions, state variables, and manipulated variables, the AI ​​model update unit 108 estimates the controlled variable using the AI ​​model. Here, the controlled variable is one or more pieces of information from indicators of the combustion state of the engine system 200, such as thermal efficiency, maximum in-cylinder pressure rise rate, torque, combustion start position, combustion center of gravity, and exhaust gas. The exhaust gas is one or a combination of NOx, Soot, CO, HC, or PM.

[0080] Next, the AI ​​model update unit 108 acquires the actual value of the controlled quantity calculated by the combustion index calculation unit 104. Then, the AI ​​model update unit 108 determines whether the error between the estimated controlled quantity and the acquired actual value of the controlled quantity is greater than or equal to a predetermined threshold. If the error between the estimated controlled quantity and the acquired actual value of the controlled quantity is greater than or equal to the threshold, the AI ​​model update unit 108 performs learning of each weight coefficient and bias of the AI ​​model possessed by the controlled quantity estimation unit 171 so that the error between the estimated value and the actual value of the controlled quantity becomes smaller than the threshold. The AI ​​model update unit 108 sequentially updates the AI ​​model.

[0081] The control variable estimation unit 171 estimates the controlled variable using an AI model that is sequentially updated by the AI ​​model update unit 108.

[0082] [Process flow] Figure 9 is a flowchart of the control process of the engine system by the engine control device according to the second embodiment. Next, referring to Figure 9, the flow of the control process of the engine system 200 by the engine control device 100 according to this embodiment will be explained.

[0083] The in-cylinder pressure detection unit 102 acquires information on the in-cylinder pressure detected by the in-cylinder pressure sensor mounted on the engine system 200 (step S201). The in-cylinder pressure detection unit 102 then outputs the detected in-cylinder pressure information to the combustion index calculation unit 104.

[0084] The exhaust gas detection unit 103 acquires exhaust gas information detected by the exhaust gas sensor mounted on the engine system 200 (step S202). The exhaust gas detection unit 103 then outputs the exhaust gas information to the combustion index calculation unit 104.

[0085] The combustion index calculation unit 104 calculates the fuel index of the engine system 200 using the in-cylinder pressure information obtained from the in-cylinder pressure detection unit 102 and the exhaust gas information obtained from the exhaust gas detection unit 103 (step S203). The combustion index calculation unit 104 outputs the calculated fuel index information to the AI ​​model update unit 108.

[0086] The engine operating condition detection unit 101 acquires engine operating conditions, including engine speed and total combustion injection amount, from the engine system 200. The engine operating condition detection unit 101 also acquires state quantities, including excess air ratio, fuel injection pressure, intake manifold pressure, and intake manifold oxygen concentration, from the engine system 200 (step S204). The engine operating condition detection unit 101 then outputs the engine operating condition information to the control target value calculation unit 105. The engine operating condition detection unit 101 also outputs the engine operating conditions and state quantity information to the AI ​​model update unit 108.

[0087] The control target value calculation unit 105 receives information on engine operating conditions from the engine operating condition detection unit 101. The control target value calculation unit 105 then calculates the control target value from the engine operating conditions (step S205). After that, the control target value calculation unit 105 outputs the calculated control target value to the manipulated variable calculation unit 106.

[0088] The AI ​​model update unit 108 receives engine operating conditions and the state variables as input from the engine operating condition detection unit 101. The AI ​​model update unit 108 also receives manipulated variables obtained using the learning control table as input from the manipulated variable calculation unit 106. The AI ​​model update unit 108 also obtains the actual value of the controlled variable calculated by the combustion index calculation unit 104. Then, the AI ​​model update unit 108 learns the AI ​​model held by the controlled variable estimation unit 171 (step S206).

[0089] The learning control table update unit 174 of the learning control table management unit 107 determines whether or not the learning control table has been updated (step S207). If the learning control table has not been updated (step S207: negative), the engine system control process proceeds to step S209.

[0090] In contrast, if the learning control table is updated (step S207: affirmative), the learning control table update unit 174 outputs the updated learning control table to the manipulated variable calculation unit 106. The manipulated variable calculation unit 106 acquires the updated learning control table (step S208).

[0091] Subsequently, the manipulated variable calculation unit 106 uses a learning control table to acquire manipulated variables, including the fuel injection amounts and injection durations for each stage of multi-stage injection such as pre-, pilot, main, and after, based on one or more pieces of information from the engine operating conditions and state variables of the engine system 200, as well as control target values ​​(step S209). Then, the manipulated variable calculation unit 106 notifies the engine system 200 of the acquired manipulated variables and controls the engine system 200 to operate according to the notified manipulated variables.

[0092] Figure 10 is a flowchart of the AI ​​model learning process by the engine control device according to the second embodiment. Next, the flow of the AI ​​model learning process by the engine control device 100 according to this embodiment will be explained with reference to Figure 10. The process shown in the flowchart in Figure 10 is an example of the process performed in step S206 in Figure 9.

[0093] The AI ​​model update unit 108 estimates the controlled quantity using the AI ​​model based on the acquired engine operating conditions, state quantities, and manipulated quantities (step S211).

[0094] Next, the AI ​​model update unit 108 calculates the error between the estimated value of the controlled quantity and the actual value of the controlled quantity from the estimated value of the controlled quantity and the acquired actual value of the controlled quantity (step S212).

[0095] Next, the AI ​​model update unit 108 determines whether the error between the estimated value of the controlled quantity and the actual value of the controlled quantity is greater than or equal to a threshold (step S213). If the error between the estimated value of the controlled quantity and the actual value of the controlled quantity is less than the threshold (step S213: negative), the AI ​​model update unit 108 terminates the AI ​​model learning process.

[0096] In contrast, if the error between the estimated value of the controlled variable and the actual value of the controlled variable is greater than or equal to a threshold (step S213: affirmative), the AI ​​model update unit 108 performs learning of each weight coefficient and bias of the AI ​​model possessed by the controlled variable estimation unit 171 so that the error between the estimated value and the actual value of the controlled variable becomes smaller than the threshold (step S214).

[0097] As described above, the engine control device 100 according to this embodiment sequentially updates the AI ​​model used to estimate the controlled quantity for updating the learning control table. The weight coefficients and biases of each neuron in the AI ​​model are rewritten online as the AI ​​model learns in response to changes in the engine over time and environmental changes.

[0098] As a result, the engine control device 100 can manage a learning control table using an AI model that is updated according to the engine state, more appropriately derive solutions to optimization problems using the engine combustion model, and provide a high-performance real-time controller for the engine system 200.

[0099] (Third embodiment) Figure 11 is a block diagram of the engine control device according to the third embodiment. The engine control device 100 according to this embodiment differs from Embodiment 1 in that, in addition to the AI ​​model, it uses an AI model error learning table to correct the AI ​​model to determine the controlled quantity, and learns the AI ​​model error learning table according to the actual value of the controlled quantity. In the following description, the estimation process of the controlled quantity using the AI ​​model and the AI ​​model error learning table and the learning process of the AI ​​model error learning table will be mainly described, and the operation of each part which is the same as in the first embodiment will be omitted from the description. The engine control device 100 according to this embodiment has an AI model error learning unit 109 in addition to the parts described in the first embodiment.

[0100] The control variable estimation unit 171 has an AI model that takes engine operating conditions, state variables, and manipulated variables as inputs and outputs a controlled variable in response to the inputs. Here, the controlled variable is one or more pieces of information from indicators representing the combustion state of the engine system 200, such as thermal efficiency, maximum in-cylinder pressure rise rate, torque, combustion start position, combustion center of gravity, and exhaust gas. The exhaust gas is one or a combination of NOx, Soot, CO, HC, or PM. The control variable estimation unit 171 also has an AI model error learning table in which correction values ​​for correcting errors in the AI ​​model corresponding to the engine operating conditions are registered.

[0101] The control variable estimation unit 171 estimates the controlled variable using the engine operating conditions, state variables, and manipulated variables obtained from the manipulated variable optimization unit 173. Next, the control variable estimation unit 171 calculates a correction value for the controlled variable from the engine operating conditions using the AI ​​model error learning table. In this case, the control variable estimation unit 171 uses the AI ​​model error learning table, which is sequentially updated by the AI ​​model error learning unit 109, to calculate the correction value. Finally, the control variable estimation unit 171 calculates the final controlled variable by adding the estimated controlled variable and the correction value.

[0102] The AI ​​model error learning unit 109 receives engine operating conditions and state variables as input from the engine operating condition detection unit 101. The AI ​​model error learning unit 109 also receives manipulated variables obtained using the learning control table as input from the manipulated variable calculation unit 106. The AI ​​model error learning unit 109 then estimates the controlled variable using the acquired engine operating conditions, state variables, and manipulated variables. Furthermore, the AI ​​model error learning unit 109 calculates a correction value for the controlled variable from the engine operating conditions using the AI ​​model error learning table. Next, the AI ​​model error learning unit 109 calculates the final controlled variable by adding the estimated controlled variable and the correction value.

[0103] Next, the AI ​​model error learning unit 109 acquires the actual value of the controlled quantity calculated by the combustion index calculation unit 104. Then, the AI ​​model error learning unit 109 determines whether the error between the final estimated value of the controlled quantity and the acquired actual value of the controlled quantity is greater than or equal to a threshold. If the error between the estimated value of the controlled quantity and the acquired actual value of the controlled quantity is greater than or equal to the threshold, the AI ​​model error learning unit 109 performs learning on the AI ​​model error learning table held by the controlled quantity estimation unit 171 so that the error between the estimated value and the actual value of the controlled quantity becomes smaller than the threshold. The AI ​​model error learning unit 109 sequentially updates the AI ​​model error learning table.

[0104] [Process flow] Figure 12 is a flowchart of the control process of the engine system by the engine control device according to the third embodiment. Next, with reference to Figure 12, the flow of the control process of the engine system 200 by the engine control device 100 according to this embodiment will be explained.

[0105] The in-cylinder pressure detection unit 102 acquires information on the in-cylinder pressure detected by the in-cylinder pressure sensor mounted on the engine system 200 (step S301). The in-cylinder pressure detection unit 102 then outputs the detected in-cylinder pressure information to the combustion index calculation unit 104.

[0106] The exhaust gas detection unit 103 acquires exhaust gas information detected by the exhaust gas sensor mounted on the engine system 200 (step S302). The exhaust gas detection unit 103 then outputs the exhaust gas information to the combustion index calculation unit 104.

[0107] The combustion index calculation unit 104 calculates the fuel index of the engine system 200 using the in-cylinder pressure information obtained from the in-cylinder pressure detection unit 102 and the exhaust gas information obtained from the exhaust gas detection unit 103 (step S303). The combustion index calculation unit 104 outputs the calculated fuel index information to the AI ​​model update unit 108.

[0108] The engine operating condition detection unit 101 acquires engine operating conditions, including engine speed and total combustion injection amount, from the engine system 200. The engine operating condition detection unit 101 also acquires state quantities, including excess air ratio, fuel injection pressure, intake manifold pressure, and intake manifold oxygen concentration, from the engine system 200 (step S304). The engine operating condition detection unit 101 then outputs the engine operating condition information to the control target value calculation unit 105. The engine operating condition detection unit 101 also outputs the engine operating conditions and state quantity information to the AI ​​model error learning unit 109.

[0109] The control target value calculation unit 105 receives information on engine operating conditions from the engine operating condition detection unit 101. The control target value calculation unit 105 then calculates the control target value from the engine operating conditions (step S305). After that, the control target value calculation unit 105 outputs the calculated control target value to the manipulated variable calculation unit 106.

[0110] The AI ​​model error learning unit 109 receives engine operating conditions and the state variables as input from the engine operating condition detection unit 101. The AI ​​model error learning unit 109 also receives the manipulated variable input obtained using the learning control table from the manipulated variable calculation unit 106. The AI ​​model error learning unit 109 also obtains the actual value of the controlled variable calculated by the combustion index calculation unit 104. Then, the AI ​​model error learning unit 109 learns the AI ​​model error learning table held by the control variable estimation unit 171 (step S306).

[0111] The learning control table update unit 174 of the learning control table management unit 107 determines whether or not the learning control table has been updated (step S307). If the learning control table has not been updated (step S307: negative), the engine system control process proceeds to step S309.

[0112] In contrast, if the learning control table is updated (step S307: affirmative), the learning control table update unit 174 outputs the updated learning control table to the manipulated variable calculation unit 106. The manipulated variable calculation unit 106 acquires the updated learning control table (step S308).

[0113] Subsequently, the manipulated variable calculation unit 106 uses a learning control table to acquire manipulated variables, including the fuel injection amounts and injection durations for each stage of multi-stage injection such as pre-, pilot, main, and after, based on one or more pieces of information from the engine operating conditions and state variables of the engine system 200, as well as control target values ​​(step S309). Then, the manipulated variable calculation unit 106 notifies the engine system 200 of the acquired manipulated variables and controls the engine system 200 to operate according to the notified manipulated variables.

[0114] Figure 13 is a flowchart of the learning process for the AI ​​model error learning table by the engine control device according to the third embodiment. Next, referring to Figure 13, the flow of the learning process for the AI ​​model error learning table by the engine control device 100 according to this embodiment will be explained. The process shown in the flowchart in Figure 13 is an example of the process performed in step S306 in Figure 12.

[0115] The AI ​​model error learning unit 109 estimates the controlled quantity using the AI ​​model and the AI ​​model error learning table based on the acquired engine operating conditions, state quantities, and manipulated quantities (step S311).

[0116] Next, the AI ​​model error learning unit 109 calculates the error between the estimated value of the controlled variable and the actual value of the controlled variable from the estimated value of the controlled variable and the acquired actual value of the controlled variable (step S312).

[0117] Next, the AI ​​model error learning unit 109 determines whether the error between the estimated value of the controlled variable and the actual value of the controlled variable is greater than or equal to a threshold (step S313). If the error between the estimated value of the controlled variable and the actual value of the controlled variable is less than the threshold (step S313: negative), the AI ​​model error learning unit 109 terminates the learning process of the AI ​​model error learning table.

[0118] In response to this, if the error between the estimated value of the controlled variable and the actual value of the controlled variable is greater than or equal to a threshold (step S313: affirmative), the AI ​​model error learning unit 109 performs training on the AI ​​model error learning table of the controlled variable estimation unit 171 so that the error between the estimated value and the actual value of the controlled variable becomes smaller than the threshold (step S314).

[0119] Figure 14 is a flowchart of the learning control table update process by the engine control device according to the third embodiment. Next, the flow of the learning control table update process by the engine control device 100 according to this embodiment will be described with reference to Figure 14.

[0120] The control variable estimation unit 171 acquires the engine operating conditions and state variables of the engine system 200 from the engine operating condition detection unit 101. The control variable estimation unit 171 also acquires the first manipulated variable during the optimization calculation from the manipulated variable optimization unit 173. Next, the control variable estimation unit 171 inputs the acquired engine operating conditions, state variables of the engine system 200, and the first manipulated variable from the manipulated variable optimization unit 173 into the AI ​​model it holds to estimate the controlled variable. Next, the control variable estimation unit 171 calculates a correction value for the controlled variable from the engine operating conditions using the AI ​​model error learning table. Then, the control variable estimation unit 171 adds the estimated controlled variable and the correction value to calculate the final estimated value of the controlled variable (step S321). After that, the control variable estimation unit 171 outputs the final estimated value of the controlled variable to the control evaluation value calculation unit 172. Furthermore, the control variable estimation unit 171 outputs information on the engine operating conditions and state variables of the engine system 200 used for estimating the control variable to the learning control table update unit 174.

[0121] The control evaluation value calculation unit 172 obtains the control target value from the control target value calculation unit 105. The control evaluation value calculation unit 172 also obtains the estimated value of the controlled quantity from the control quantity estimation unit 171. The control evaluation value calculation unit 172 also obtains the first manipulated quantity from the manipulated quantity optimization unit 173. The control evaluation value calculation unit 172 also obtains the engine combustion index generated by the combustion index calculation unit 104. The control evaluation value calculation unit 172 also obtains the actual value of the controlled quantity from the engine combustion index. Next, the control evaluation value calculation unit 172 calculates the controlled quantity considering drift by adding the actual value of the controlled quantity to the estimated value of the controlled quantity. Next, the control evaluation value calculation unit 172 calculates a control evaluation value as a weighted value based on the error between the control target value and the controlled quantity and the change in the manipulated quantity (step S322). After that, the control evaluation value calculation unit 172 outputs the calculated control evaluation value to the manipulated quantity optimization unit 173. Furthermore, the control evaluation value calculation unit 172 outputs the control target value used to calculate the control evaluation value to the learning control table update unit 174.

[0122] The manipulated variable optimization unit 173 obtains the control evaluation value input from the control evaluation value calculation unit 172. The manipulated variable optimization unit 173 then calculates the manipulated variable that minimizes the obtained control evaluation value (step S323). Subsequently, the manipulated variable optimization unit 173 outputs the calculated manipulated variable as the first manipulated variable to the control variable estimation unit 171. Furthermore, when the control evaluation value is minimized or when the optimization calculation is completed after a predetermined number of iterations, the manipulated variable optimization unit 173 uses the calculated manipulated variable as the second manipulated variable and outputs it as the optimal manipulated variable to the learning control table update unit 174.

[0123] The learning control table update unit 174 obtains the input of the optimal manipulated variable from the manipulated variable optimization unit 173. The learning control table update unit 174 also obtains the input of the engine operating conditions and state variables of the engine system 200 from the control variable estimation unit 171. Furthermore, the learning control table update unit 174 obtains the input of the control target value from the control evaluation value calculation unit 172. Next, the learning control table update unit 174 associates the combination of the control target value, engine operating conditions and state variables with the corresponding optimal manipulated variable. Then, the learning control table update unit 174 rewrites the learning control table using the combination of the control target value, state variables and engine operating conditions and the corresponding values ​​of the manipulated variables (step S324).

[0124] As described above, the engine control device 100 according to this embodiment sequentially updates the AI ​​model error learning table to correct the controlled quantity for updating the learning control table estimated by the AI ​​model in accordance with the state of the engine system 200.

[0125] As a result, the engine control device 100 can manage the learning control table using an AI model error learning table that is updated according to the engine state, and can more appropriately derive the solution to the optimization problem using the engine combustion model. Therefore, the engine control device 100 can provide a high-performance real-time controller for the engine system 200.

[0126] [system] The processing procedures, control procedures, specific names, and various data and parameters shown in the above documents and drawings may be modified at will unless otherwise specified. Furthermore, the specific examples, distributions, and numerical values ​​described in the embodiments are merely examples and may be modified at will.

[0127] Furthermore, the specific forms of distribution and integration of the components of each device are not limited to those shown in the illustration. For example, the learning control table management unit 107 of the engine control device 100 and other functional units may be located on different devices. In other words, all or part of the components may be functionally or physically distributed and integrated in any unit depending on various loads and usage conditions. Moreover, all or any part of the processing functions of each device may be realized by a CPU and a program that is analyzed and executed by the CPU, or by hardware using wired logic.

[0128] [Hardware] Figure 15 shows an example of the hardware configuration of an engine control device. As shown in Figure 15, the engine control device 100 includes a processor 91, memory 92, storage device 93, and communication unit 94. Furthermore, the components shown in Figure 15 are interconnected by a bus or similar means.

[0129] The communication unit 94 is a network interface card or the like, and communicates with other information processing devices. The storage device 93 stores programs and data that operate the various functions of the engine control device 100 shown in Figures 1, 8, and 11.

[0130] The processor 91 reads programs from the storage device 93 or other memory device that operate the various functions of the engine control device 100 shown in Figures 1, 8, and 11. Then, the processor 91 loads the read programs into memory 92 and executes the processes that realize the various functions of the engine control device 100 shown in Figures 1, 8, and 11.

[0131] Furthermore, the engine control device 100 can also realize each function by reading a program that operates each of the functions of the engine control device 100 shown in Figures 1, 8, and 11 from the recording medium using a media reading device and executing it. It should be noted that the program referred to in these other embodiments is not limited to being executed by the engine control device 100. For example, the present invention may similarly be applied when other information processing devices execute the program, or when they cooperate to execute the program.

[0132] Furthermore, the programs that operate the various functions of the engine control device 100 shown in Figures 1, 8, and 11 may be distributed via a network such as the Internet. Alternatively, these programs may be recorded on a computer-readable recording medium such as a hard disk drive (HDD), solid state drive (SSD), flexible disk (FD), CD-ROM, MO (Magneto-Optical disk), or DVD (Digital Versatile Disc), and executed by being read from the recording medium by a computer.

[0133] With respect to embodiments including each of the above embodiments, the following additional information is disclosed.

[0134] (Note 1) A model that reproduces at least one of the following indicators of the engine's combustion state based on engine operating conditions and the first manipulated variable: thermal efficiency, maximum in-cylinder pressure rise rate, torque, combustion start position, combustion center of gravity, NOx, Soot, CO, HC, and PM. An manipulated variable optimization unit determines a second manipulated variable by optimization using the model, with at least one of the indicators reproduced by the model being used as an estimated value of the controlled variable, so that the estimated value of the controlled variable follows the control target value. A learning control table update unit that associates the second manipulated variable with the control target value and the engine operating conditions, and rewrites the learning control table in which the manipulated variable corresponding to the control target value and the engine operating conditions is registered. An operation variable calculation unit calculates an operation variable using the learning control table based on the control target value and the engine operating conditions. An engine control device characterized by being equipped with

[0135] (Note 2) The engine control device according to Note 1, characterized in that the engine operating conditions include engine speed and total fuel injection amount.

[0136] (Note 3) The engine control device according to Note 1, characterized in that the first and second operating quantities include the respective fuel injection amounts and injection durations for multi-stage injection.

[0137] (Note 4) The engine control device according to Note 1, characterized in that the model is one of the following types of neural networks: Deep Neural Network (DNN), Recurrent Neural Network (RNN), or Long Short-Term Memory (LSTM).

[0138] (Note 5) The engine control device according to Note 1, characterized in that the manipulated variable optimization unit performs the optimization using the error between the control target value and the estimated value of the controlled variable by the model, and a control evaluation value weighted to the manipulated variable.

[0139] (Note 6) The engine control device according to Note 1, characterized in that each weight coefficient and bias of the model is rewritten online after the model is learned in accordance with the aging and environmental changes of the engine.

[0140] (Note 7) The engine control device according to Note 1, characterized in that the learning control table is a table that reproduces the input / output response of the inverse model of the model and is rewritable.

[0141] (Note 8) The engine control device according to Note 1, characterized in that the learning control table is a table that reproduces the input / output response of the inverse model of the model composed of a combination of two-dimensional tables.

[0142] (Note 9) The engine control device according to Note 1, characterized in that the learning control table includes two types of tables: a first learning control table formed by the control target value, the engine operating conditions which are engine speed and fuel injection amount, and the manipulated amount, and a second learning control table for correcting the difference between the manipulated amount in the first learning control table and the second manipulated amount calculated by the optimization.

[0143] (Note 10) The engine control device according to any one of Notes 7 to 9, characterized in that the learning control table has one axis representing the engine operating conditions, namely engine speed and fuel injection amount, and the other axis representing an indicator of the engine's combustion state.

[0144] (Note 11) Based on the engine operating conditions and the first manipulated volume, a model is maintained that reproduces at least one of the following indicators of the engine's combustion state: thermal efficiency, maximum in-cylinder pressure rise rate, torque, combustion start position, combustion center of gravity, and exhaust gas. At least one of the indicators reproduced by the aforementioned model is used as an estimate of the controlled variable, and a second manipulated variable is determined by optimization using the aforementioned model so that the estimated value of the controlled variable follows the control target value. The second manipulated variable is associated with the control target value and the engine operating conditions, and the learning control table in which the manipulated variable corresponding to the control target value and the engine operating conditions is registered is rewritten. Based on the control target value and the engine operating conditions, the manipulated variable is calculated using the learning control table. An engine control method characterized by the following.

[0145] (Note 12) Based on the engine operating conditions and the first manipulated volume, a model is maintained that reproduces at least one of the following indicators of the engine's combustion state: thermal efficiency, maximum in-cylinder pressure rise rate, torque, combustion start position, combustion center of gravity, and exhaust gas. At least one of the indicators reproduced by the aforementioned model is used as an estimate of the controlled variable, and a second manipulated variable is determined by optimization using the aforementioned model so that the estimated value of the controlled variable follows the control target value. The second manipulated variable is associated with the control target value and the engine operating conditions, and the learning control table in which the manipulated variable corresponding to the control target value and the engine operating conditions is registered is rewritten. Based on the control target value and the engine operating conditions, the manipulated variable is calculated using the learning control table. An engine control program characterized by having a computer perform the processing. [Explanation of Symbols]

[0146] 100 Engine control unit 200 Engine System 101 Engine operating condition detection unit 102 In-cylinder pressure detection unit 103 Exhaust gas detection unit 104 Combustion Index Calculation Unit 105 Control target value calculation unit 106 Manipulated amount calculation section 107 Learning Control Table Management Unit 108 AI Model Update Section 109 AI Model Error Learning Section 171 Control variable estimation unit 172 Control Evaluation Value Calculation Unit 173 Manipulation Variable Optimization Unit 174 Learning Control Table Update Unit

Claims

1. A first manipulated variable that minimizes the error between the control target value and the controlled variable when a predetermined operation is performed on the engine, and the control evaluation value calculated from the change in the manipulated variable, and a model that reproduces at least one of the engine combustion state indicators, namely thermal efficiency, maximum in-cylinder pressure rise rate, torque, combustion start position, combustion center of gravity, NOx, Soot, CO, HC, and PM, based on engine operating conditions, An operation variable optimization unit that takes at least one of the indicators reproduced by the model as an estimated value of the controlled quantity, repeatedly calculates the control evaluation value by optimizing using the model so that the estimated value of the controlled quantity follows the control target value, and determines the first operation variable as the second operation variable when the calculation of the control evaluation value is completed, A learning control table update unit that associates the second manipulated variable with the control target value and the engine operating conditions, and rewrites the learning control table in which the manipulated variable corresponding to the control target value and the engine operating conditions is registered. An operation variable calculation unit calculates an operation variable using the learning control table based on the control target value and the engine operating conditions. An engine control device characterized by being equipped with

2. The engine control device according to claim 1, characterized in that the engine operating conditions include engine speed and total fuel injection amount.

3. The engine control device according to claim 1, characterized in that the first manipulated amount and the second manipulated amount include the respective fuel injection amounts and injection durations for multi-stage injection.

4. The engine control device according to claim 1, characterized in that the model is one of the following types of neural networks: Deep Neural Network (DNN), Recurrent Neural Network (RNN), or Long Short-Term Memory (LSTM).

5. The engine control device according to claim 1, characterized in that the manipulated variable optimization unit performs the optimization using the error between the control target value and the estimated value of the controlled variable by the model, and a control evaluation value weighted by the amount of change of the manipulated variable.

6. The engine control device according to claim 1, characterized in that each weight coefficient and bias of the model is rewritten online after the model is learned in accordance with the aging of the engine and changes in the environment.

7. The engine control device according to claim 1, characterized in that the learning control table is a table that reproduces the input / output response of the inverse model of the model and is rewritable.

8. The engine control device according to claim 1, characterized in that the learning control table is a table that reproduces the input / output response of the inverse model of the model, which is composed of a combination of two-dimensional tables.

9. The engine control device according to claim 1, characterized in that the learning control table includes two types of tables: a first learning control table formed by the control target value, the engine operating conditions which are engine speed and fuel injection amount, and the manipulated amount, and a second learning control table for correcting the difference between the manipulated amount in the first learning control table and the second manipulated amount calculated by the optimization.

10. The engine control device according to any one of claims 7 to 9, characterized in that the learning control table has one axis representing the engine operating conditions, namely engine speed and fuel injection amount, and the other axis representing an indicator of the engine's combustion state.

11. A first manipulated variable that minimizes the control evaluation value calculated from the error between the control target value and the controlled variable and the change in the manipulated variable when a predetermined operation is performed on the engine, and a model that reproduces at least one of the following indicators of the engine's combustion state based on the engine operating conditions: thermal efficiency, maximum in-cylinder pressure rise rate, torque, combustion start position, combustion center of gravity, and exhaust gas. At least one of the indicators reproduced by the model is used as the estimated value of the controlled quantity, and the calculation of the control evaluation value is repeatedly performed by optimizing the model so that the estimated value of the controlled quantity follows the control target value, and the first manipulated variable is determined as the second manipulated variable when the calculation of the control evaluation value is completed. The second manipulated variable is associated with the control target value and the engine operating conditions, and the learning control table in which the manipulated variable corresponding to the control target value and the engine operating conditions is registered is rewritten. Based on the control target value and the engine operating conditions, the manipulated variable is calculated using the learning control table. An engine control method characterized by the following.

12. A first manipulated variable that minimizes the control evaluation value calculated from the error between the control target value and the controlled variable and the change in the manipulated variable when a predetermined operation is performed on the engine, and a model that reproduces at least one of the following indicators of the engine's combustion state based on the engine operating conditions: thermal efficiency, maximum in-cylinder pressure rise rate, torque, combustion start position, combustion center of gravity, and exhaust gas. At least one of the indicators reproduced by the model is used as the estimated value of the controlled quantity, and the calculation of the control evaluation value is repeatedly performed by optimizing the model so that the estimated value of the controlled quantity follows the control target value, and the first manipulated variable is determined as the second manipulated variable when the calculation of the control evaluation value is completed. The second manipulated variable is associated with the control target value and the engine operating conditions, and the learning control table in which the manipulated variable corresponding to the control target value and the engine operating conditions is registered is rewritten. Based on the control target value and the engine operating conditions, the manipulated variable is calculated using the learning control table. An engine control program characterized by having a computer perform the processing.

Images