Information processing system, information processing method, learning system and learning method

Abstract

To provide an information processing system which can derive a proper operation content related to combustion equipment, an information processing method, a learning system and a learning method.SOLUTION: An information processing system of the present disclosure being an information processing system for use in combustion equipment comprises: an acquisition part for acquiring state amount information being information related to a state amount of the combustion equipment; and an operation content derivation part for inputting the state amount information which is acquired by the acquisition part by using the state amount information, an operation content of a supply device for supplying a combusted product to the combustion equipment, and a learning model at which learning is performed on the basis of a correspondence correlation of a remuneration corresponding to a state of the combustion equipment, and deriving the operation content of the supply device corresponding to the inputted state amount information.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to an information processing system, an information processing method, a learning system, and a learning method. [Background technology]

[0002] Patent Document 1 discloses an information processing device that acquires process data including at least one of a plurality of combustion process measurement values ​​and a plurality of control values ​​in a combustion equipment, acquires or generates image data based on thermal image information captured by an imaging unit provided in the combustion equipment for capturing images inside the combustion equipment, predicts the amount of steam generation after a predetermined predicted time based on the process data and the image data, and controls a waste incinerator based on the predicted steam generation amount value. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-188813 Summary of the Invention [Problem to be solved by the invention]

[0004] However, while the information processing device described in Patent Document 1 can obtain a predicted value of steam generation amount, it can be difficult to determine the correspondence between the predicted value of steam generation amount and the operation content of the combustion equipment that should be performed in accordance with the predicted value of steam generation amount.

[0005] The present disclosure has been made to solve the above-mentioned problems, and aims to provide an information processing system, an information processing method, a learning system, and a learning method that are capable of deriving appropriate operation content related to combustion equipment. [Means for solving the problem]

[0006] In order to solve the above problems, the information processing system of the present disclosure is an information processing system for combustion equipment, and includes an acquisition unit that acquires state quantity information, which is information regarding the state quantity of the combustion equipment, and an operation content derivation unit that inputs the state quantity information acquired by the acquisition unit and derives the operation content of the supply device according to the input state quantity information using a learning model that has been trained based on the correspondence between the state quantity information, the operation content of the supply device that supplies the material to be incinerated to the combustion equipment, and a reward according to the state of the combustion equipment.

[0007] The information processing method according to the present disclosure is an information processing method related to combustion equipment, and includes acquiring state quantity information, which is information regarding the state quantities of the combustion equipment, inputting the state quantity information using a learning model that has been trained based on a correspondence between the state quantity information, the operation contents of a supply device that supplies material to be incinerated to the combustion equipment, and a reward according to the state of the combustion equipment, and deriving the operation contents of the supply device according to the input state quantity information.

[0008] The learning system of the present disclosure is a learning system for combustion equipment, and includes a learning unit that performs reinforcement learning of a learning model based on the correspondence between state quantity information, which is information regarding the state quantities of the combustion equipment, the operation contents of a supply device that supplies materials to be incinerated to the combustion equipment, and a reward according to the state of the combustion equipment.

[0009] The learning method disclosed herein is a learning method for combustion equipment, and includes performing reinforcement learning of a learning model based on a correspondence between state quantity information, which is information regarding the state quantities of the combustion equipment, the operation contents of a supply device that supplies materials to be incinerated to the combustion equipment, and a reward according to the state of the combustion equipment. Effect of the Invention

[0010] According to the information processing system, information processing method, learning system, and learning method disclosed herein, appropriate operation content related to combustion equipment can be derived. [Brief description of the drawings]

[0011] [Figure 1] 1 is a schematic configuration diagram showing an entire combustion facility according to an embodiment of the present disclosure. [Diagram 2] FIG. 1 is a block diagram I showing a functional configuration of a combustion facility according to an embodiment of the present disclosure. [Diagram 3] FIG. 1 is a diagram illustrating a schematic diagram of a change in configuration of a neural network in reinforcement learning according to an embodiment of the present disclosure. [Figure 4] FIG. 13 is a diagram illustrating an example of an operation content associated with an output layer in reinforcement learning according to an embodiment of the present disclosure. [Diagram 5] FIG. 13 is a diagram illustrating an example of a reward value related to a change in configuration of a neural network in reinforcement learning according to an embodiment of the present disclosure. [Figure 6] 1 is a flowchart illustrating an information processing method according to an embodiment of the present disclosure. [Figure 7] 1 is a flowchart I illustrating a learning method according to an embodiment of the present disclosure. [Figure 8] FIG. 2 is a block diagram II showing a functional configuration of a combustion facility according to an embodiment of the present disclosure. [Figure 9] 2 is a flowchart II illustrating a learning method according to an embodiment of the present disclosure. [Figure 10] FIG. 2 is a hardware configuration diagram illustrating a configuration of a computer according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, the control device according to the embodiment of the present disclosure will be described with reference to the drawings. In the following description, the same reference numerals are used for configurations having the same or similar functions. And, duplicated descriptions of those configurations may be omitted. In this disclosure, "based on XX" means "based on at least XX" and may include cases where it is based on another element in addition to XX. Also, "based on XX" is not limited to cases where XX is directly used, but may also include cases where it is based on XX that has been subjected to calculation or processing. In this disclosure, "XX or YY" is not limited to either one of XX and YY, but may include both XX and YY. This also applies when there are three or more selective elements. "XX" and "YY" are any element (for example, any information).

[0013] In this application, "obtain" is not limited to actively obtaining information by sending a transmission request, but may also include passively receiving information transmitted from another device. Also, "obtain" is not limited to directly obtaining target information (information to be obtained) from outside, but may also include generating and obtaining target information by performing calculations or processing on information obtained from outside.

[0014] First embodiment <1. Overall configuration of incineration facility> FIG. 1 is a schematic diagram showing the overall configuration of a combustion facility SF according to an embodiment. The combustion facility SF is a stoker furnace for incinerating materials G, such as urban waste, industrial waste, or biomass. For convenience of explanation, the "materials G" will be referred to as "waste G" below. The combustion facility SF is not limited to a stoker furnace, and may be another type of incineration facility. In this embodiment, the combustion facility SF includes, for example, a crane 1, an incinerator 2, a heat recovery boiler 3, a cooling tower 4, a dust collector 5, a flue 6, a chimney 7, and an information processing system 100.

[0015] The crane 1 carries the garbage G stored in the garbage pit to a hopper 11 of the incinerator 2 described below and dumps the garbage G into the hopper 11. The crane 1 includes a gripping part 1a that grips the garbage G, and a weight sensor 1b provided on the gripping part 1a. The weight sensor 1b is, for example, a load cell. When the garbage G is gripped and lifted by the gripping part 1a, the weight sensor 1b detects the weight of the garbage G gripped by the gripping part 1a. The detection result of the weight sensor 1b is in a state that can be acquired by the acquisition part 110 of the information processing system 100.

[0016] The incinerator 2 is a furnace that burns waste G that has been put into a hopper 11, which will be described later, while transporting it. Exhaust gas is generated in the incinerator 2 as the waste G is burned inside the incinerator 2. The generated exhaust gas is sent to a heat recovery boiler 3 provided on the top of the incinerator 2. The heat recovery boiler 3 exchanges heat between the exhaust gas generated in the incinerator 2 and water, thereby heating the water and generating steam.

[0017] The exhaust gas that has passed through the exhaust heat recovery boiler 3 is cooled in the cooling tower 4 and then sent to the dust collector 5. After soot and dust are removed from the exhaust gas in the dust collector 5, the exhaust gas is discharged into the atmosphere through the flue 6 and the chimney 7. A gas concentration sensor 6a is provided in the flue 6. The gas concentration sensor 6a detects the concentrations of various gases (e.g., CO concentration) contained in the exhaust gas flowing through the flue 6. Note that the detection result of the gas concentration sensor 6a may include one or more of the oxygen concentration, NOx concentration, and SOx concentration instead of / in addition to the CO concentration. The detection result of the gas concentration sensor 6a is transmitted to the acquisition unit 110 of the information processing system 100.

[0018] <2. Incinerator> Next, a detailed description will be given of the incinerator 2. The incinerator 2 has, for example, a supply mechanism 10, a furnace body 20, a stoker 30, a wind box 41, a discharge chute 42, a furnace 43, and a blower mechanism 50.

[0019] <2.1 Supply mechanism> The supply mechanism 10 is a mechanism for temporarily storing the waste G transported by the crane 1 and sequentially supplying the waste G to a treatment space V of the furnace body 20, which will be described later. The supply mechanism 10 includes, for example, a hopper 11, a feeder 12, an extrusion device 13, an object measuring instrument 14, and a moisture measuring instrument 15.

[0020] The hopper 11 is a storage section provided to supply waste G to the inside of the furnace body 20. Waste G transported by the crane 1 is fed into the hopper 11. The hopper 11 has an inlet section 11a and an outlet section 11b. The inlet section 11a is an inlet section through which the waste G is fed from the outside. The inlet section 11a extends, for example, in the vertical direction. The waste G fed into the inlet section 11a moves downward by gravity. The outlet section 11b is provided below the inlet section 11a. The outlet section 11b is an outlet section that guides the waste G supplied from the inlet section 11a toward the treatment space V in the furnace body 20 described later. The outlet section 11b extends, for example, in the horizontal direction.

[0021] The feeder 12 is a device that supplies waste G to the furnace body 20. The feeder 12 is an example of a "feeding device." In the following, a reciprocating feeder 12 that supplies waste G to the furnace body 20 by performing a reciprocating motion will be described as an example. Note that the feeder 12 is not limited to a reciprocating type, and may be a rotary feeder 12 that supplies waste G by performing a rotary motion.

[0022] The feeder 12 is provided at the outlet portion 11b of the hopper 11. The feeder 12 is plate-shaped and is disposed along the bottom of the outlet portion 11b of the hopper 11. The feeder 12 can move back and forth along a direction from the outlet portion 11b of the hopper 11 toward the treatment space V of the furnace body 20. The feeder 12 is driven by the pushing device 13, and pushes out the waste G accumulated inside the hopper 11 (e.g., the outlet portion 11b of the hopper 11) toward the treatment space V of the furnace body 20. The stroke of the feeder 12, the moving speed of the feeder 12, and the stop time of the feeder 12, which relate to the supply amount of the waste G, are controlled by the pushing device 13.

[0023] The object measuring instrument 14 is a measuring instrument that detects the height of the garbage G thrown into the hopper 11 by the crane 1. The object measuring instrument 14 is, for example, a LiDAR (Light Detection and Ranging). The object measuring instrument 14 is provided, for example, at the entrance 11a of the hopper 11, and detects the height of the garbage G passing through the entrance 11a of the hopper 11. Note that the object measuring instrument 14 may directly detect the volume of the garbage G by three-dimensional measurement instead of the height of the garbage G. The detection result of the object measuring instrument 14 is transmitted to the acquisition unit 110 of the information processing system 100.

[0024] The moisture meter 15 is a measuring instrument that detects a value related to the moisture contained in the garbage G put into the hopper 11 (e.g., moisture percentage or moisture amount). In this embodiment, the moisture meter 15 has an irradiation unit and a detection unit provided in the hopper 11, and an analysis unit. The irradiation unit irradiates the garbage G piled up in the hopper 11 with electromagnetic waves of a predetermined frequency band. The detection unit receives the electromagnetic waves irradiated from the irradiation unit and transmitted through the garbage G or reflected by the garbage G. The analysis unit stores in advance correlation information indicating the relationship between the characteristic change of the electromagnetic wave (e.g., change in amplitude or change in phase) and the moisture percentage, for example. The analysis unit detects the moisture percentage contained in the garbage G based on the characteristic change of the electromagnetic wave between the irradiation unit and the detection unit and the correlation information.

[0025] In this embodiment, the irradiation unit and detection unit of the moisture meter 15 are provided slightly above the feeder 12 and detect the moisture content of the garbage G accumulated on the upper surface of the feeder 12. The detection result of the moisture meter 15 is in a state where it can be acquired by the acquisition unit 110 of the information processing system 100.

[0026] <2.2 Furnace body> The furnace body 20 is provided adjacent to the hopper 11, and is a facility for burning the waste G while transporting it. Hereinafter, the transport direction of the waste G in the combustion facility SF is referred to as the "transport direction D". The furnace body 20 has a drying stage 20a, a combustion stage 20b, and a post-combustion stage 20c in this order from the upstream side to the downstream side in the transport direction D. The drying stage 20a is located upstream of the combustion stage 20b and the post-combustion stage 20c, and is a region in which the waste G supplied from the hopper 11 is dried prior to combustion on the stoker 30. The combustion stage 20b and the post-combustion stage 20c are regions in which the waste G in a dried state after passing through the drying stage 20a is burned on the stoker 30. In the combustion stage 20b, diffusion combustion occurs due to pyrolysis gas generated from the waste G, and a luminous flame F is generated. In the post-combustion stage 20c, fixed carbon combustion occurs after diffusion combustion of the waste G, so a luminous flame F is not generated. The combustion stage 20b and the post-combustion stage 20c are an example of a treatment space V in which waste G is combusted. The drying stage 20a is an example of a region upstream of the treatment space V in the conveying direction D.

[0027] In this embodiment, the furnace body 20 has a visible light camera 21 and an infrared camera 22. The visible light camera 21 and the infrared camera 22 are disposed downstream of the processing space V in the transport direction D, and capture images of the upstream side of the transport direction D from the downstream side. In this embodiment, the visible light camera 21 and the infrared camera 22 are provided at an end portion (hereinafter referred to as the "furnace end") of the furnace body 20 on the downstream side in the transport direction D. For example, the visible light camera 21 and the infrared camera 22 capture images of the upstream side of the transport direction D from the downstream side through a window portion provided at the furnace end of the furnace body 20. For example, the visible light camera 21 and the infrared camera 22 are disposed at positions adjacent to each other vertically or horizontally.

[0028] The visible light camera 21 captures an image of the luminous flame F from the bottom of the furnace body 20. The imaging results of the visible light camera 21 are in a state where they can be acquired by the acquisition unit 110 of the information processing system 100.

[0029] The infrared camera 22 captures an image of the garbage G accumulated in the drying stage 20a of the furnace body 20 (i.e., upstream of the treatment space V) from the bottom of the furnace body 20 through the luminous flame F. In this embodiment, the infrared camera 22 captures an image of the outlet 11b of the hopper 11 through the luminous flame F from the bottom of the furnace body 20. For example, the infrared camera 22 captures an image including the garbage G accumulated on the feeder 12 at the outlet 11b of the hopper 11 (an image showing the accumulation state of the garbage G). The imaging results of the infrared camera 22 are in a state that can be acquired by the acquisition unit 110 of the information processing system 100.

[0030] In this embodiment, an image including both the drying stage 20a of the furnace body 20 and the outlet portion 11b of the hopper 11 (e.g., garbage G accumulated on the feeder 12) is captured by a single infrared camera 22. Alternatively, the furnace body 20 may be provided with a first infrared camera for capturing an image of the drying stage 20a of the furnace body 20 and a second infrared camera for capturing an image of the outlet portion 11b of the hopper 11 (e.g., garbage G accumulated on the feeder 12) separately. Also, the infrared camera 22 may be provided at a different position instead of the end of the furnace body 20.

[0031] <2.3 Stalker> The stoker 30 includes a plurality of grates 31 and a grate drive device 32 (not shown). The plurality of grates 31 form a stoker surface 30a which is the bottom surface of the furnace body 20 (for example, the bottom surface of the treatment space V). The waste G is supplied in layers to the stoker surface 30a by the supply mechanism 10. The stoker surface 30a is provided across the drying stage 20a, the combustion stage 20b, and the post-combustion stage 20c described above. The plurality of grates 31 include a fixed grate and a movable grate. The fixed grate is fixed to the upper surface of the wind box 41 described later. The movable grate reciprocates at a constant speed along the transport direction D, thereby stirring and mixing the waste G on the movable grate and the fixed grate (on the stoker surface 30a) to the downstream side.

[0032] <2.4 Wind box, discharge chute, furnace> The wind box 41 is provided below the stoker 30 and supplies combustion air to the inside of the furnace body 20 through the stoker 30. A plurality of wind boxes 41 are arranged in the conveying direction D. The wind box 41 has a wind box pressure sensor 41a. The wind box pressure sensor 41a detects the pressure inside the wind box 41. The pressure inside the wind box 41 corresponds to the pressure of the combustion air supplied to the inside of the furnace body 20 through the primary air line 52 described later. The detection result of the wind box pressure sensor 41a is in a state where it can be acquired by the acquisition unit 110 of the information processing system 100.

[0033] The discharge chute 42 is a device that drops the waste G that has been burned and turned into ash to an ash pushing device located below the furnace body 20. The discharge chute 42 is provided at the bottom of the furnace body 20.

[0034] The furnace 43 extends upward from the upper part of the furnace body 20. Exhaust gas generated by burning the waste G in the treatment space V is sent to the heat recovery boiler 3 through the furnace 43.

[0035] <2.5 Blower mechanism> The blower mechanism 50 supplies air (e.g., combustion air) to the inside of the furnace body 20. The blower mechanism 50 has, for example, a blower 51, a primary air line 52, an air preheater 53, a secondary air line 54, a damper 55, and an air flow sensor 56.

[0036] The blower 51 is a forced draft blower that pressurizes and sends air (e.g., combustion air) into the inside of the furnace body 20. The blower 51 includes, for example, a first blower 51A and a second blower 51B. The first blower 51A pressurizes and sends the combustion air into the inside of the furnace body 20 (e.g., the treatment space V) through the primary air line 52 and the wind box 41. The second blower 51B pressurizes and sends the combustion air into the inside of the furnace 43 through the secondary air line 54.

[0037] The primary air line 52 connects the first blower 51A and the wind box 41. One or more (e.g., a plurality of) primary air dampers 55A are provided in the middle of the primary air line 52. The primary air damper 55A changes the flow rate of the combustion air flowing through the primary air line 52 depending on the opening degree of the primary air damper 55A.

[0038] The air preheater 53 is a heat exchanger that preheats the air pressure-fed from the first blower 51 A. For example, the air preheater 53 is provided in the middle of the primary air line 52.

[0039] The secondary air line 54 connects the second blower 51B and the furnace 43. The secondary air supplied into the furnace 43 flows from above the stoker 30 toward the waste G. One or more (e.g., multiple) secondary air dampers 55B are provided in the middle of the secondary air line 54. The secondary air damper 55B changes the flow rate of the combustion air flowing through the secondary air line 54 depending on the opening degree of the secondary air damper 55B. For ease of explanation, the primary air damper 55A and the secondary air damper 55B will be collectively referred to as "damper 55" below.

[0040] The air flow sensor 56 detects the flow rate of air (e.g., combustion air) supplied to the inside of the furnace body 20. The air flow sensor 56 includes, for example, a first air flow sensor 56A and a second air flow sensor 56B. The first air flow sensor 56A is provided in the middle of the primary air line 52 and detects the flow rate of air supplied through the primary air line 52. The second air flow sensor 56B is provided in the middle of the secondary air line 54 and detects the flow rate of air supplied through the secondary air line 54. In the following description, "detection result of the air flow sensor 56" includes, for example, the detection result of the first air flow sensor 56A and the detection result of the second air flow sensor 56B.

[0041] <3. Waste heat recovery boiler> Next, a description will be given of the heat recovery boiler 3. The heat recovery boiler 3 includes, for example, a boiler body 61, a pipe 62, a radiation temperature sensor (infrared temperature sensor) 63, an in-furnace pressure sensor 64, a feedwater flow rate sensor 65, and a superheater desuperheater flow rate sensor (steam amount sensor) 66.

[0042] The boiler body 61 is connected to the furnace 43 of the incinerator 2. Exhaust gas generated in the incinerator 2 flows into the inside of the boiler body 61. A radiation temperature sensor 63 and an in-furnace pressure sensor 64 are provided in the boiler body 61. The radiation temperature sensor 63 detects the temperature inside the boiler body 61. The in-furnace pressure sensor 64 detects the pressure inside the boiler body 61. The detection result of the radiation temperature sensor 63 is transmitted to the acquisition unit 110 of the information processing system 100. The detection result of the in-furnace pressure sensor 64 is in a state that can be acquired by the acquisition unit 110 of the information processing system 100.

[0043] The pipe 62 extends inside the boiler body 61. The pipe 62 is provided with a plurality of superheaters and a plurality of attemperators. Water is supplied to the inlet of the pipe 62 from a water supply unit. At least a portion of the water flowing through the pipe 62 is heated by heat exchange inside the boiler body 61, becomes main steam, and flows toward an external device (e.g., a turbine). Note that the "amount of steam" in this disclosure means the amount of main steam flowing from the pipe 62 toward the external device (e.g., a turbine).

[0044] The feedwater flow rate sensor 65 is provided at the inlet of the pipe 62 and detects the flow rate of water supplied to the pipe 62. The superheater attemperator flow rate sensor 66 is provided midway through the pipe 62 and detects the flow rate of a fluid (e.g., steam) flowing through the pipe 62. For example, the superheater attemperator flow rate sensor 66 includes a first superheater attemperator flow rate sensor 66A that detects the flow rate of a fluid passing through the primary attemperator (primary superheater attemperator flow rate) and a second superheater attemperator flow rate sensor 66B that detects the flow rate of a fluid passing through the secondary attemperator (secondary superheater attemperator flow rate). In the following description, the "detection result of the superheater attemperator flow rate sensor 66" includes, for example, the detection result of the first superheater attemperator flow rate sensor 66A and the detection result of the second superheater attemperator flow rate sensor 66B. The detection results of the feedwater flow rate sensor 65 and the superheater desuperheater flow rate sensor 66 are transmitted to the acquisition unit 110 of the information processing system 100 .

[0045] <4. Information Processing System> Next, the information processing system 100 will be described. FIG. 2 is a block diagram showing a functional configuration of the combustion equipment SF according to the embodiment. The information processing system 100 comprehensively controls the combustion equipment SF. For example, the information processing system 100 controls the combustion of the waste G in the treatment space V of the furnace body 20. In this embodiment, the information processing system 100 includes, for example, an acquisition unit 110, a storage unit 120, an operation content derivation unit 130, a control unit 140, and a learning system 160. The information processing system 100 may also include a notification unit 150. Alternatively, the information processing system 100 may include the notification unit 150 instead of the control unit 140. In the present disclosure, the device to be controlled by the information processing system 100 is the above-mentioned extrusion device 13 (feeder 12). The operations of each unit in the information processing system 100 described below correspond to a part of the information processing method and learning method of the present disclosure.

[0046] <4.1 Acquisition part> The acquisition unit 110 acquires the detection results detected by the various sensors included in the combustion equipment SF described above. For example, the acquisition unit 110 acquires the detection result of the weight sensor 1b (waste weight), the detection result of the object measuring instrument 14 (waste height), the detection result of the radiation temperature sensor 63 (furnace temperature), the detection result of the superheater attemperator flow rate sensor 66 (superheater attemperator flow rate), and the detection result of the gas concentration sensor 6a (CO concentration, etc.). The detection result of the superheater attemperator flow rate sensor 66 (superheater attemperator flow rate) is an example of the "steam amount."

[0047] In addition, the detection results of the moisture measuring instrument 15 (garbage moisture detection results), the imaging results of the visible light camera 21 (combustion flame image), the imaging results of the infrared camera 22 (garbage layer image), the detection results of the wind box pressure sensor 41a (wind box pressure), the detection results of the air flow sensor 56 (forced air flow rate), the detection results of the furnace pressure sensor 64 (furnace pressure), and the detection results of the water supply flow sensor 65 (water supply flow rate) are available for acquisition by the acquisition unit 110.

[0048] These pieces of information acquired or obtainable by the acquisition unit 110 are values ​​related to the state quantities of the combustion equipment SF. In the present disclosure, the information processing system 100 uses these values ​​related to the state quantities of the combustion equipment SF to control the extrusion device 13 (feeder 12). The acquisition unit 110 writes and stores the acquired state quantities in the storage unit 120 as a history of the state quantities (referred to as state quantity history 122).

[0049] The acquisition unit 110 further acquires state quantity information by statistically processing these values ​​related to the state quantities of the combustion equipment SF over a predetermined length of time. In the present disclosure, "state quantity information" is a representative value obtained by statistically processing these values ​​related to the state quantities of the combustion equipment SF over a predetermined length of time. For example, the state quantity information is an average value of the values ​​related to the state quantities of the combustion equipment SF over the above-mentioned predetermined length of time. Note that the state quantity information is not limited to an average value, and may be a median value or a most frequent value.

[0050] The above-mentioned predetermined time length is a time length including the time difference between the time when the waste G is supplied by the extrusion device 13 (feeder 12) and the time when a fluctuation occurs in a state quantity (e.g., steam volume) of the combustion equipment SF in response to the supply. For example, the above-mentioned predetermined time length is a time length including the time difference between the time when the waste G is supplied by the extrusion device 13 (feeder 12) and the time when a fluctuation in a state quantity (e.g., steam volume) of the combustion equipment SF in response to the supply has the most significant correlation. From another perspective, the above-mentioned predetermined time length is a time length longer than the time it takes for the feeder 12 to make one round trip. The above-mentioned predetermined time length is, for example, 20 minutes.

[0051] Moreover, the acquisition unit 110 acquires, from the storage unit 120, the operation content derived by the operation content derivation unit 130 (referred to as derived operation content 121), a learning model M described below, and a control target value SV of the steam amount.

[0052] <4.2 Storage section> In the storage unit 120, derivation operation content 121, learning model M, control target value SV of the steam amount, and state quantity history 122 are written and stored.

[0053] <4.3 Operation content derivation part> The operation content derivation unit 130 inputs the state quantity information acquired by the acquisition unit 110 into the learning model M using the learning model M, and derives the operation content of the extrusion device 13 (feeder 12) according to the input state quantity information. In the present disclosure, the learning model mounted on the operation content derivation unit 130 is referred to as the learning model M. In the learning model M, learning is performed based on the correspondence between the state quantity information acquired by the acquisition unit 110, the operation content of the extrusion device 13 (operation content of the feeder 12) corresponding to the case where the state quantity information is acquired, and the reward according to the state (e.g., steam volume) of the combustion equipment SF resulting from the operation content of the extrusion device 13 (operation content of the feeder 12). The state of the combustion equipment SF resulting from the operation content of the extrusion device 13 (operation content of the feeder 12) means the state (e.g., steam volume) of the combustion equipment SF after a predetermined time (e.g., 20 minutes) from the operation of the operation content of the extrusion device 13.

[0054] Thereafter, the operation content derivation unit 130 outputs the derived operation content to the control unit 140. The operation content derivation unit 130 may also output the derived operation content to the notification unit 150. Note that the operation content derivation unit 130 updates the learning model M to the learning model M stored in the storage unit 120 at a predetermined timing.

[0055] <4.4 Control section and notification section> The control unit 140 performs combustion control of the treatment space V based on the derived operation content output by the operation content derivation unit 130. Specifically, the control unit 140 outputs a control instruction value to the extrusion device 13 (feeder 12) based on the derived operation content output by the operation content derivation unit 130, and controls the feeder 12. The control unit 140 increases the supply amount of waste G when promoting combustion. On the other hand, the control unit 140 decreases the supply amount of waste G when suppressing combustion.

[0056] For example, if the information processing system 100 is provided with a notification unit 150, the notification unit 150 notifies an operator (an operator of the combustion equipment SF) of the derived operation content output by the operation content derivation unit 130. The notification unit 150 is, for example, a display device having a display screen that displays the derived operation content output by the operation content derivation unit 130. The operator may manually input a control instruction value to the extrusion device 13 (feeder 12) based on the notified derived operation content, and control the feeder 12.

[0057] <4.5 Learning System> The learning system 160 includes a learning unit 161. The learning unit 161 of the learning system 160 performs reinforcement learning of the learning model M stored in the storage unit 120 after acquiring the learning model M via the acquisition unit 110. For example, the learning unit 161 performs reinforcement learning of the learning model M based on the correspondence between state quantity information, the operation content of the extrusion device 13 (feeder 12), and the reward.

[0058] <5. Overview of learning model processing> Here, an overview of the learning model M in the present disclosure is shown with reference to FIG. 3 to FIG. 5. The operation content derivation unit 130 includes the learning model M, and state quantity information acquired by the acquisition unit 110 is input to the learning model M. The learning model M is a forward propagation type neural network as shown in FIG. 3. When state quantity information after statistical processing is input to the learning model M as an input layer, the learning model M outputs an expected value for each of a plurality of operation content candidates of the extrusion device 13 (feeder 12) to the output layer. The input state quantity is a value related to the state quantity of the combustion equipment SF that is acquired or can be acquired by the acquisition unit 110. Examples of the input state quantity include a lower heating value (LHV: Lower Heating Value), a concentration of an emission material (CO concentration), a supply amount of waste G, and a steam amount. The state quantities input to the learning model M are two or more of these. In this embodiment, the state quantities input are representative values ​​(e.g., average values) of the lower heating value (LHV), the concentration of exhaust substances (CO concentration), the supply amount of waste G, and the amount of steam for the above-mentioned specified length of time.

[0059] In addition, the input state quantity information may be, instead of some or all of the above-mentioned state quantities, representative values ​​(or representative images) at the above-mentioned specified time of each of the detection results (garbage moisture detection results) of the moisture meter 15, the imaging results (combustion flame image) of the visible light camera 21, the imaging results (garbage layer image) of the infrared camera 22, the detection results (wind box pressure) of the wind box pressure sensor 41a, the detection results (forced air flow rate) of the air flow sensor 56, the detection results (furnace pressure) of the furnace pressure sensor 64, and the detection results (feed water flow rate) of the water supply flow sensor 65.

[0060] Among the expected values ​​(expected values ​​for each of the multiple operation content candidates for the extrusion device 13 (feeder 12)) output to the output layer of the learning model M, the operation content candidate corresponding to the largest expected value is output by the operation content derivation unit 130 to the control unit 140 or the notification unit 150 as the derived operation content.

[0061] The acquiring unit 110 may perform the following estimation separately from the statistical processing. The estimation performed by the acquiring unit 110 is treated as a state quantity. That is, in this embodiment, a value related to the state quantity for which the following estimation is performed is input to the learning model M.

[0062] The acquisition unit 110 acquires the detection result (dust weight) of the weight sensor 1b and the detection result (dust height) of the object measuring device 14. The acquisition unit 110 estimates the supply amount of dust G as a state quantity from the dust weight, the dust height, and the operation details of the extrusion device 13 (supply device). However, the method of estimating the supply amount of dust G is not limited to the above.

[0063] The acquisition unit 110 acquires the detection result (waste weight) of the weight sensor 1b, the detection result (waste height) of the object measuring instrument 14, and the detection result (furnace temperature) of the radiation temperature sensor 63. The acquisition unit 110 determines the furnace temperature according to the supply amount (estimated amount) of waste G from the detection result and the operation details of the extrusion device 13 (supply device), and estimates the LHV as a state quantity by back-calculating the combustion data based on these.

[0064] As shown in Fig. 4, the operation content of the extrusion device 13 (feeding device) is determined by a combination of two or more of the operation amount of a first operation element of the feeder 12, the operation amount of a second operation element of the feeder 12 different from the first operation element, and the stop time of the feeder 12. For example, when the feeder 12 is a reciprocating feeder, the first operation element is the stroke of the feeder 12 (feeder stroke ST). The second operation element is the speed of the feeder 12 (feeder speed SD).

[0065] In the two-dimensional map of the operation contents in FIG. 4, the first operation element is the feeder stroke ST, and the second operation element is the feeder speed SD. In FIG. 4, there are 40 combinations of the first operation element and the second operation element, including 5 patterns of the feeder speed SD and 8 patterns of the feeder stroke ST. These 40 patterns are multiple operation content candidates of the extrusion device 13 (feeder 12) set in the output layer of the learning model M. That is, 40 patterns of operation content candidates are discretely set in the output layer of the learning model M. Among the expected values ​​output to the output layer of the learning model M, the operation content corresponding to the largest expected value is the combination of the feeder stroke ST: α and the feeder speed SD: β in the 40 patterns in FIG. 4. Note that the operation contents are not limited to this two-dimensional map, and may be a three-dimensional map in which a stop time is added to the combination of the first operation element and the second operation element.

[0066] After the feeder 12 is controlled based on the derived operation content thus output, the learning unit 161 of the learning system 160 performs reinforcement learning of the learning model M. After the above-mentioned predetermined time, when a fluctuation occurs in the state quantity of the combustion facility SF in response to the supply of waste G by the feeder 12, the learning unit 161 receives state quantity information (also referred to as a detection value) after the derived operation content is performed and a control target value from the acquisition unit 110. The control target value is a target value corresponding to a detection value of at least one index included in the state quantity information. The reward is derived based on the magnitude of the difference between this detection value and the control target value. For example, the learning unit 161 uses the detection value PV of the steam amount, which is one of the indexes included in the state quantity information (detection value) after the operation content is performed, and the control target value SV of the steam amount.

[0067] As shown in Fig. 5, the learning unit 161 derives a reward based on the magnitude of the difference between the detected value PV of the steam amount and the control target value SV of the steam amount. The reward is divided into stages. For example, the reward may be set in advance for the learning model M. Alternatively, the reward may be stored in the storage unit 120, and after being acquired by the acquisition unit 110, may be input to the learning model M by the learning unit 161.

[0068] In step ST24 described later, the learning unit 161 changes the weighting related to the expected value based on the reward. The learning unit 161 changes the weighting related to the expected value by updating the connection weight between each node from the input layer to the output layer. By repeating the reinforcement learning many times, the learning model M learns the operation content that increases the reward with respect to the state quantity. The learning unit 161 performs reinforcement learning of the learning model M at a predetermined timing.

[0069] <6 Processing flow> Next, a description will be given of an example of the flow of processes in the above-mentioned information processing system 100. However, the order of the processes described below is not limited to the following example, and may be changed as appropriate.

[0070] <6.1 Information processing method> First, an information processing method related to the combustion facility SF will be described. The information processing method in this embodiment is carried out according to the flowchart shown in FIG. 6. First, the acquisition unit 110 of the information processing system 100 acquires state quantities from each detection result (step ST11). Next, the acquisition unit 110 of the information processing system 100 writes the acquired state quantities as state quantity history 122 in the storage unit 120 (step ST12). Next, the acquisition unit 110 of the information processing system 100 statistically processes the state quantities acquired in step ST11 (step ST13). As a result, the acquisition unit 110 acquires state quantity information, which is information on the state quantities of the combustion equipment SF. Next, the operation content derivation unit 130 of the information processing system 100 receives the state quantity information obtained by statistically processing the state quantities from the acquisition unit 110, and inputs the state quantity information to the learning model M (step ST14). Next, the operation content derivation unit 130 of the information processing system 100 derives the operation content of the extrusion device 13 (feeder 12) according to the input state quantity information (step ST15), and outputs the derived operation content to the control unit 140 or the notification unit 150 (step ST16).

[0071] <6.2 Learning Method> Next, a learning method for the combustion facility SF will be described. The learning method in this embodiment is carried out according to the flowchart shown in Fig. 7. The learning method described below is also executed in parallel during the operation stage of the incineration facility SF.

[0072] First, the acquisition unit 110 of the information processing system 100 acquires state quantity information (detection value) after the operation content is performed based on the state quantity history 122 of the storage unit 120, and acquires the operation content of the extrusion device 13 (feeder 12) from the derived operation content 121 of the storage unit 120 (step ST21). At that time, the acquisition unit 110 performs statistical processing of the state quantity after the operation content is performed in advance (step ST21a). Next, the acquisition unit 110 of the information processing system 100 acquires the control target value SV from the storage unit 120 (step ST22).

[0073] Next, the learning unit 161 of the learning system 160 of the information processing system 100 receives state quantity information (detection value PV) and control target value SV after the operation content is performed from the acquisition unit 110, and derives a reward from the detection value PV and the control target value SV (step ST23). Next, the learning unit 161 of the learning system 160 changes the weighting of the expected value based on the operation content of the extrusion device 13 (feeder 12) from the derived operation content 121 of the storage unit 120 and the reward corresponding to the operation content (step ST24).

[0074] As a result, the learning unit 161 performs reinforcement learning of the learning model based on the correspondence between the state quantity information, which is information about the state quantities of the combustion facility SF, the operation contents of the supply device that supplies the materials to be incinerated to the combustion facility SF, and the reward according to the state of the combustion facility SF. Next, the learning unit 161 of the learning system 160 writes the updated learning model M with the changed weighting into the storage unit 120 (step ST25).

[0075] <7. Effects> According to the information processing system 100 and the information processing method configured as above, a learning model M can be used that learns operation contents that increase rewards for state quantities of the combustion equipment SF. As a result, the information processing system 100 and the information processing method of this embodiment can derive appropriate operation contents related to the combustion equipment SF. As a result, the fluctuation amount of the steam amount of the combustion equipment SF can be suppressed.

[0076] Furthermore, according to the learning system 160 and the learning method configured as above, the learning model M can learn the operation contents that increase the reward for the state quantity of the combustion equipment SF. As a result, the learning system 160 and the learning method of this embodiment can derive the appropriate operation contents related to the combustion equipment SF. As a result, the fluctuation amount of the steam amount of the combustion equipment SF can be suppressed.

[0077] Furthermore, the amount of steam can vary greatly depending on the supply state of the waste G and the properties of the waste G. The combustion properties (such as LHV) and powder engineering properties (such as adhesion amount) of the waste G are strongly affected by the season and climate, so the sensitivity of the controlled parameters such as the steam amount can also change from moment to moment. For example, when controlling the supply device based on a prediction of the steam amount, it is necessary to build a control logic that corresponds to the predicted value of the steam amount. If rule-based logic is used, the number of branching processes corresponding to the predicted value of the steam amount becomes enormous, making it difficult to take into account all seasonal fluctuations.

[0078] According to the information processing system 100 and the information processing method configured as above, a learning model M can be used that learns an operation pattern that provides a high reward for the state quantity of the combustion equipment SF. As a result, the information processing system 100 and the information processing method of this embodiment can automatically construct logic that derives appropriate operation content related to the combustion equipment SF while taking seasonal fluctuations into account. As a result, the fluctuation amount of the steam volume of the combustion equipment SF can be suppressed.

[0079] Furthermore, according to the learning system 160 and the learning method configured as above, the learning model M can learn an operation pattern that provides a high reward for the state quantity of the combustion equipment SF. As a result, the learning system 160 and the learning method of this embodiment can automatically construct logic that derives appropriate operation content related to the combustion equipment SF while taking seasonal fluctuations into account. As a result, the fluctuation amount of the steam volume of the combustion equipment SF can be suppressed.

[0080] Second Embodiment <8. Information Processing Systems> Hereinafter, an information processing system 100B according to the present disclosure will be described as a second embodiment with reference to Fig. 8. Components common to the first embodiment will be given the same reference numerals and detailed description will be omitted.

[0081] In this embodiment, the information processing system 100B includes, for example, an acquisition unit 110, a storage unit 120B, an operation content derivation unit 130, a control unit 140, and a learning system 160B. The information processing system 100B may also include a notification unit 150. Alternatively, the information processing system 100B may include the notification unit 150 instead of the control unit 140. In the present disclosure, the device to be controlled by the information processing system 100 is the above-mentioned extrusion device 13 (supply device).

[0082] In addition, in this embodiment, the learning model M is generated based on an initial model generated by pre-learning based on the correspondence between the state quantity information and the operation content of the extrusion device 13 (feeder 12) obtained from the operator's past operation history. Based on this initial model, pre-learning is performed based on the correspondence between the state quantity information acquired by the acquisition unit 110, the operation content of the extrusion device 13 (feeder 12), and the reward according to the operator's operation history. After that, reinforcement learning is performed based on the correspondence between the state quantity information acquired by the acquisition unit 110 described in the first embodiment, the operation content of the feed device, and the reward according to the state of the combustion equipment SF. The operation of each part added in the information processing system 100B described below corresponds to a part of the information processing method and learning method disclosed herein.

[0083] In the information processing system 100B, the storage unit 120B newly stores an operation history (referred to as an operator operation history 123) of the extrusion device 13 (feeder 12) by the operator.

[0084] In the information processing system 100B, the learning unit 161B generates an initial model of the learning model M by performing reinforcement learning as pre-learning in addition to the reinforcement learning described in the first embodiment. In this embodiment, the information processing system 100B is provided with a generation unit 162 that adds some functions to the learning system 160B. The generation unit 162 generates an initial model of the learning model M by pre-learning based on the correspondence between the state quantity information and the operation content of the extrusion device 13 (feeder 12) obtained from the operation history of the operator.

[0085] The learning method in this embodiment is carried out according to the flowchart shown in Fig. 9. The learning method described below is also executed in parallel during the operation stage of the incineration facility SF.

[0086] First, the generation unit 162 of the information processing system 100B sets an initial model before learning (step ST20B). Using this initial model as a learning model M, the operation content derivation unit 130 of the information processing system 100B receives state quantity information obtained by statistically processing the state quantities by the acquisition unit 110, and inputs the state quantity information to the learning model M. Thereafter, the operation content derivation unit 130 derives the operation content of the extrusion device 13 (feeder 12) according to the input state quantity information (step ST21B).

[0087] Next, the acquisition unit 110 of the information processing system 100B acquires the operation history by the operator (operator operation history 123) from the storage unit 120 (step ST22B). Next, the learning unit 161B of the learning system 160B of the information processing system 100B pre-learns the learning model M based on the correspondence between past state quantity information, the operation content of the extrusion device 13 (feeder 12) derived using the learning model M corresponding to the case where the state quantity information is acquired, and the reward based on the operation of the operator actually performed when the state quantity information is acquired. Specifically, in the above pre-learning, the learning unit 161B derives the reward based on the degree of agreement between the operation content of the extrusion device 13 (feeder 12) derived using the learning model M and the operator operation history 123 (step ST23B).

[0088] In addition, as the pre-learning of the learning model M, instead of / in addition to the degree of agreement between the operation content of the extrusion device 13 derived using the learning model M and the operator operation history 123, reinforcement learning may be performed based on a correspondence relationship between previously acquired state quantity information, the operation content of the operator included in the operator operation history 123 corresponding to the case where the state quantity information is acquired, and a reward according to the state of the combustion equipment SF (e.g., steam volume) resulting from the operation content of the operator. For example, in this embodiment, the reward in the pre-learning is derived by reflecting the operation content of the operator included in the operator operation history 123 and the magnitude of the difference between the detection value and the control target value of at least one index included in the state quantity of the combustion equipment SF according to the operation content of the operator.

[0089] Next, the learning unit 161 of the learning system 160 changes the weighting of the expected value based on the reward (step ST24). As a result, the learning unit 161 performs reinforcement learning as pre-learning based on the correspondence between the state quantity information acquired by the acquisition unit 110, the operation content of the extrusion device 13 (feeder 12), and the reward according to the operation history of the operator, based on this initial model. Next, the learning unit 161B of the learning system 160B writes the updated learning model with the weighting changed to the storage unit 120 (step ST24).

[0090] The learning unit 161B of the learning system 160B performs reinforcement learning as pre-learning of an initial model based on the operation content of the extrusion device 13 (feeder 12) derived using the learning model M and the reward derived from the operator operation history 123, and then performs reinforcement learning similar to that of the first embodiment. That is, reinforcement learning of the learning model M is performed based on the correspondence between the state amount information acquired by the acquisition unit 110, the operation content of the extrusion device 13 (operation content of the feeder 12) corresponding to the case where the state amount information is acquired, and the reward according to the state (e.g., steam volume) of the combustion equipment SF resulting from the operation content of the extrusion device 13 (operation content of the feeder 12). As a result of the above, the learning model M is obtained based on the initial model. Alternatively, the learning unit 161B may perform reinforcement learning on the initial model by appropriately selecting reinforcement learning as pre-learning and reinforcement learning of the first embodiment to obtain a learning model.

[0091] <9. Effects> According to the information processing system 100B and the information processing method configured as above, a learning model M can be used that learns an operation pattern that increases the reward for the state quantity of the combustion equipment SF. As a result, the information processing system 100B and the information processing method of this embodiment can derive appropriate operation contents related to the combustion equipment SF. As a result, it becomes easier to maintain the combustion equipment SF in a desired state.

[0092] Furthermore, according to the learning system 160B and the learning method configured as above, the learning model can learn an operation pattern that provides a high reward for the state quantity of the combustion equipment SF. As a result, the learning system 160B and the learning method of this embodiment can derive appropriate operation content related to the combustion equipment SF. As a result, the fluctuation amount of the steam amount of the combustion equipment SF can be suppressed.

[0093] Furthermore, according to the information processing system 100B and the information processing method configured as above, since learning is performed based on the degree of agreement with the operator's operation history 123, it is possible to automatically construct a logic that adopts a similar operation pattern to that of an operator who controls the supply device based on the state quantity information. As a result, an operation pattern that takes into consideration cooperation with other existing information processing systems is constructed, so that stable control of the extrusion device 13 (feeder 12) can be performed when the information processing system 100B of the present disclosure is introduced. Therefore, the information processing system 100B and the information processing method of the present embodiment can derive appropriate operation content related to the combustion facility SF while reflecting the operation pattern of the operator.

[0094] In addition, according to the learning system 160B and the learning method configured as above, since learning is performed based on the degree of agreement with the operator's operation history, it is possible to automatically construct a logic that takes a similar operation pattern to that of the operator who controls the extrusion device 13 (feeder 12) based on the state quantity information. As a result, an operation pattern that takes into account cooperation with other existing information processing systems is constructed, so that stable control of the feed device can be performed when the information processing system 100B in the present disclosure is introduced. Therefore, the learning system 160B and the learning method of this embodiment can derive appropriate operation contents related to the combustion equipment SF after reflecting the operator's operation pattern. As a result, it is possible to suppress the fluctuation amount of the steam amount of the combustion equipment SF.

[0095] <10. Other embodiments> Although the embodiment of the present disclosure has been described above in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and design changes within the scope of the present disclosure are also included. The initial model in the present disclosure may be an initial model generated by prior learning based on the correspondence between state quantity information in a facility other than the combustion facility SF and the operation content of the supply device in the facility. For example, the learning unit 161B of the learning system 160B learns the learning model M based on the correspondence between the past state quantity information, the operation content of the extrusion device 13 (feeder 12) derived using the learning model M corresponding to the case where the state quantity information is acquired, and the operation content of the extrusion device 13 (feeder 12) performed in the facility when the state quantity information is acquired. In this case, the learning unit 161B derives a reward based on the degree of agreement between the operation content of the extrusion device 13 (feeder 12) derived using the learning model M and the operation content of the extrusion device 13 (feeder 12) performed in the facility.

[0096] In addition, the operation details of the extrusion device 13 (feeder 12) may be learned after correction has been made based on the ratio of the sizes of the combustion equipment 1 and another piece of equipment, in order to take into account the difference in size between the combustion equipment 1 in which the information processing system 100 is installed and another piece of equipment.

[0097] In this case, reinforcement learning as pre-learning may be performed on the initial model of the modified example, and then the reinforcement learning of the first embodiment based on the reward derived from the detection value and the control target value may be performed. Alternatively, reinforcement learning as pre-learning and the reinforcement learning of the first embodiment may be appropriately selected for the initial model of the modified example, and a learning model may be obtained.

[0098] According to such a configuration, this modified example can derive appropriate operation content related to the combustion facility SF while reflecting the operation pattern in another facility.

[0099] 10 is a hardware configuration diagram showing the configuration of a computer 1100 according to this embodiment. The computer 1100 includes, for example, a processor 1110, a main memory 1120, a storage 1130, and an interface 1140.

[0100] Each functional unit of the information processing system 100 or the information processing system 100B described above is implemented in a computer 1100. The operation of each functional unit described above is stored in the form of a program in a storage 1130. The processor 1110 reads the program from the storage 1130, loads it in the main memory 1120, and executes the above-mentioned processing according to the program. The processor 1110 also secures a storage area in the main memory 1120 for use by each functional unit described above according to the program.

[0101] The program may be for realizing a part of the functions to be performed by the computer 1100. For example, the program may be for realizing the functions by combining with other programs already stored in the storage 1130 or by combining with other programs implemented in other devices. The computer 1100 may include a custom LSI (Large Scale Integrated Circuit) such as a PLD (Programmable Logic Device) in addition to the above configuration or instead of the above configuration. Examples of PLDs include a PAL (Programmable Array Logic), a GAL (Generic Array Logic), a CPLD (Complex Programmable Logic Device), and an FPGA (Field Programmable Gate Array). In this case, a part or all of the functions to be realized by the processor 1110 may be realized by the integrated circuit.

[0102] Examples of the storage 1130 include a magnetic disk, a magneto-optical disk, and a semiconductor memory. The storage 1130 may be an internal medium directly connected to the bus of the computer 1100, or an external medium connected to the computer 1100 via the interface 1140 or a communication line. When the program is distributed to the computer 1100 via a communication line, the computer 1100 that receives the program may load the program in the main memory 1120 and execute the above-mentioned process. The program may be for realizing part of the above-mentioned functions. Furthermore, the program may be a program that realizes the above-mentioned functions in combination with other programs already stored in the storage 1130, that is, a so-called difference file (difference program).

[0103] <Additional Notes> The information processing system 100 or the information processing system 100B described in each embodiment can be understood, for example, as follows.

[0104] (1) The information processing system 100 according to the first embodiment is an information processing system for an incineration facility SF, and includes an acquisition unit 110 that acquires state quantity information, which is information regarding the state quantities of the incineration facility SF, and an operation content derivation unit 130 that inputs the state quantity information acquired by the acquisition unit 110 and derives the operation content of the supply device according to the input state quantity information using a learning model that has been trained based on the correspondence between the state quantity information, the operation content of the supply device (feeder 12) that supplies the incinerated material G to the incineration facility SF, and a reward according to the state of the combustion facility SF.

[0105] According to such a configuration, a learning model can be used that learns operation contents that increase rewards for state quantities of the combustion equipment SF. This allows the information processing system 100 according to the first aspect to derive appropriate operation contents related to the combustion equipment SF. As a result, it becomes easier to maintain the combustion equipment SF in a target state.

[0106] (2) The information processing system 100 according to the second aspect is the information processing system 100 of (1), wherein the state quantity information is a representative value obtained by statistically processing values ​​related to the state quantities of the combustion equipment SF over a predetermined length of time.

[0107] According to this configuration, by performing statistical processing of the state quantities over a predetermined time length, it is possible to reduce the influence of the detection value of the state quantity that momentarily increases (or decreases) on the state quantity that can instantaneously change. This allows the information processing system 100 according to the second aspect to derive more appropriate operation contents related to the combustion facility SF.

[0108] (3) The information processing system 100 according to the third aspect is the information processing system 100 of (2), wherein the above-mentioned specified time length is a time length including the time difference between the time when the supply device (feeder 12) supplies the incineration material G and the time when the state quantity fluctuates in response to the supply.

[0109] According to this configuration, by performing statistical processing of the state quantities over a predetermined length of time, which is a relatively long period as described above, it is possible to reduce the influence of the detected value of the state quantity that momentarily increases (or decreases) on the state quantity that can momentarily change after the supply of the incineration material G. This allows the information processing system 100 according to the third aspect to derive more appropriate operation contents related to the combustion facility SF.

[0110] (4) The information processing system 100 according to a fourth aspect is an information processing system 100 according to any one of (1) to (3), wherein the operation content of the supplying device (feeder 12) is determined by a combination of two or more of the operation amount of a first operating element of the supplying device, the operation amount of a second operating element of the supplying device that is different from the first operating element, and the stop time of the supplying device.

[0111] According to this configuration, the operation details of the supply device (feeder 12) can be specified in detail, and the information processing system 100 according to the fourth embodiment can derive more appropriate operation details related to the combustion facility SF.

[0112] (5) The information processing system 100 according to a fifth aspect is an information processing system 100 described in any one of (1) to (4), wherein the supply device (feeder 12) is a reciprocating or rotary feeder, and the operation content of the supply device is determined by a combination of two or more of the stroke (feeder stroke ST) of the feeder 12, the speed (feeder speed SD) of the feeder 12, and the stop time of the feeder 12.

[0113] According to this configuration, the operation details of the supply device (feeder 12) can be specified in detail to control the supply of the materials to be incinerated G. This allows the information processing system 100 according to the fifth aspect to derive more appropriate operation details related to the combustion facility SF.

[0114] (6) The information processing system 100 according to a sixth aspect is an information processing system 100 according to any one of (1) to (5), in which the reward is derived based on the magnitude of the difference between a detection value of at least one indicator included in the state quantity information and a target value of the indicator.

[0115] According to this configuration, it is possible to derive an operation content that will provide a high reward based on the magnitude of the difference between the state quantity (detection value) after the operation content is performed and the control target value. This allows the information processing system 100 according to the sixth aspect to derive more appropriate operation content related to the combustion facility SF.

[0116] (7) The information processing system 100 according to a seventh aspect is an information processing system 100 according to any one of (1) to (6), wherein the state quantities are two or more of a lower heating value, a concentration of exhaust substances, a supply amount of incinerated material, or a steam amount.

[0117] According to this configuration, it is possible to input state quantities that may change by supplying the incineration equipment SF with the materials to be incinerated G. This allows the information processing system 100 according to the seventh aspect to derive more appropriate operation contents related to the combustion equipment SF.

[0118] (8) The information processing system 100 according to the eighth aspect is the information processing system 100 according to any one of (1) to (7), and further includes a learning unit that performs reinforcement learning of a learning model based on the correspondence between the state quantity information acquired by the acquisition unit, the operation content of the supply device, and the reward.

[0119] According to this configuration, the weighting of the expected value for each operation content can be changed based on the correspondence between the operation content of the supply device and the reward by reinforcement learning. This allows the information processing system 100 according to the eighth aspect to derive more appropriate operation content related to the combustion facility SF.

[0120] (9) The information processing system 100B according to a ninth aspect is an information processing system 100B described in any one of (1) to (8), and the learning model is obtained by performing reinforcement learning based on the correspondence between the state quantity information acquired by the acquisition unit 110, the operation content of the supply device, and the reward according to the state of the combustion equipment SF, based on an initial model generated by pre-learning based at least on the correspondence between the state quantity information and the operation content of the supply device obtained from the operation history of the operator.

[0121] According to this configuration, the information processing system 100B according to the ninth embodiment can derive appropriate operation contents related to the combustion equipment SF while reflecting the operation patterns of the operator. This makes it possible to ensure a certain degree of accuracy at the initial model stage.

[0122] (10) The information processing system 100B according to a tenth aspect is an information processing system 100B described in any one of (1) to (9), and the learning model is obtained by performing reinforcement learning based on the correspondence between the state quantity information acquired by the acquisition unit 110, the operation content of the supply device, and the reward according to the state of the combustion equipment SF, based on an initial model generated by pre-learning based at least on the correspondence between the state quantity information of another facility and the operation content of the supply device of the other facility.

[0123] According to this configuration, the information processing system 100B according to the tenth aspect can derive appropriate operation contents related to the combustion facility SF after reflecting the operation contents of other facilities. This makes it possible to ensure a certain degree of accuracy at the initial model stage.

[0124] (11) An information processing method according to an eleventh aspect is an information processing method related to the combustion equipment SF, and includes acquiring state quantity information, which is information regarding the state quantities of the combustion equipment SF, inputting the state quantity information using a learning model that has been trained based on the correspondence between the state quantity information, the operation contents of a supply device (feeder 12) that supplies incinerated material G to the combustion equipment SF, and a reward according to the state of the combustion equipment SF, and deriving the operation contents of the supply device according to the input state quantity information.

[0125] According to this configuration, a learning model can be used that learns operation contents that increase rewards for state quantities of the combustion equipment SF. In this way, the information processing method according to the eleventh aspect can derive appropriate operation contents related to the combustion equipment SF. As a result, it becomes easier to maintain the combustion equipment SF in a desired state.

[0126] (12) The learning system 160 according to the 12th aspect is a learning system for the combustion equipment SF, and includes a learning unit that performs reinforcement learning of a learning model based on the correspondence between state quantity information, which is information relating to the state quantities of the combustion equipment SF, the operation contents of a supply device (feeder 12) that supplies incinerated material G to the combustion equipment SF, and a reward according to the state of the combustion equipment SF.

[0127] According to this configuration, the learning model can learn the operation contents that increase the reward for the state quantity of the combustion equipment SF. This allows the learning system 160 according to the twelfth aspect to derive appropriate operation contents related to the combustion equipment SF. As a result, it becomes easier to maintain the combustion equipment SF in a target state.

[0128] (13) The learning method according to the thirteenth aspect is a learning method for the combustion equipment SF, and includes performing reinforcement learning of a learning model based on a correspondence between state quantity information, which is information regarding the state quantity of the combustion equipment SF, the operation content of a supply device (feeder 12) that supplies incinerated material G to the combustion equipment SF, and a reward according to the state of the combustion equipment SF.

[0129] According to this configuration, the learning model can learn operation contents that increase rewards for the state quantities of the combustion equipment SF. As a result, the learning method according to the thirteenth aspect can derive appropriate operation contents related to the combustion equipment SF. As a result, it becomes easier to maintain the combustion equipment SF in a target state. [Explanation of symbols]

[0130] SF... incineration equipment, G... material to be incinerated (waste), 1... crane, 1a... gripping part, 1b... weight sensor, 2... incinerator, 3... exhaust heat recovery boiler, 4... cooling tower, 5... dust collector, 6... flue, 6a... gas concentration sensor, 7... chimney, 10... supply mechanism, 11... hopper, 12... feeder, 13... extrusion device, 14... object measuring instrument, 15... moisture measuring instrument, 20... furnace body, 21... visible light camera, 22... red External camera, 30... stoker, 31... grate, 32... grate drive device, 41... wind box, 41a... wind box pressure sensor, 42... discharge chute, 43... furnace, 50... blower mechanism, 51... blower, 52... primary air line, 53... air preheater, 54... secondary air line, 55... damper, 56... air flow sensor, 56A... first air flow sensor, 56B... second air flow sensor, 61... voice coil, main body, 62...pipe, 63...radiation temperature sensor (infrared temperature sensor), 63...radiation temperature sensor, 64...furnace pressure sensor, 65...feedwater flow rate sensor, 66...superheater attemperator flow rate sensor (steam volume sensor), 66...superheater attemperator flow rate sensor, 66A...first superheater attemperator flow rate sensor, 66B...second superheater attemperator flow rate sensor, 100...information processing system, 100B...information processing system, 110...acquisition unit, 120...storage unit, 120B...storage unit, 130...operation content derivation unit, 140...control unit, 150...notification unit, 160...learning system, 160B...learning system, 161...learning unit, 161B...learning unit, 162...generation unit, 1100...computer, 1110...processor, 1120...main memory, 1130...storage, 1140...interface

Claims

1. An information processing system for a combustion facility, comprising: An acquisition unit that acquires state quantity information that is information regarding a state quantity of the combustion equipment; an operation content derivation unit that inputs the state quantity information acquired by the acquisition unit and derives the operation content of the supply device according to the input state quantity information, using a learning model that has been trained based on the correspondence between the state quantity information, the operation content of the supply device that supplies the incineration material to the combustion equipment, and a reward according to the state of the combustion equipment; An information processing system comprising:

2. The state quantity information is a representative value obtained by statistically processing values ​​related to the state quantity of the combustion equipment over a predetermined time period. The information processing system according to claim 1 .

3. The predetermined time length is a time length including a time difference between the time when the supply device supplies the incineration material and the time when the state quantity fluctuates in response to the supply. The information processing system according to claim 2 .

4. The operation content of the supply device is specified by a combination of two or more of an operation amount of a first operation element of the supply device, an operation amount of a second operation element of the supply device different from the first operation element, and a stop time of the supply device.

3. The information processing system according to claim 1 or 2.

5. The feeding device is a reciprocating or rotary feeder; The operation content of the feeding device is specified by a combination of two or more of the stroke of the feeder, the speed of the feeder, and the stop time of the feeder.

3. The information processing system according to claim 1 or 2.

6. The reward is derived based on a magnitude of a difference between a detection value of at least one index included in the state quantity information and a target value of the index.

3. The information processing system according to claim 1 or 2.

7. The state quantity is two or more of the lower heating value, the concentration of the exhaust material, the supply amount of the incineration material, or the steam amount; 3. The information processing system according to claim 1 or 2.

8. A learning unit that performs reinforcement learning of the learning model based on a correspondence relationship between the state quantity information acquired by the acquisition unit, the operation content of the supply device, and the reward.

3. The information processing system according to claim 1 or 2.

9. The learning model is obtained by performing reinforcement learning based on the correspondence between the state quantity information acquired by the acquisition unit, the operation content of the supply device, and the reward, based on an initial model generated by pre-learning based at least on the correspondence between the state quantity information and the operation content of the supply device obtained from the operation history of the operator.

3. The information processing system according to claim 1 or 2.

10. The learning model is obtained by performing reinforcement learning based on the correspondence between the state quantity information acquired by the acquisition unit, the operation content of the previous supply device, and the reward, based on an initial model generated by pre-learning based at least on the correspondence between the state quantity information in another facility and the operation content of the supply device in the other facility.

3. The information processing system according to claim 1 or 2.

11. An information processing method related to a combustion facility, comprising: Acquire state quantity information which is information regarding a state quantity of the combustion equipment, The state quantity information is input using a learning model that has been trained based on the correspondence between the state quantity information, the operation content of the supply device that supplies the incineration material to the combustion equipment, and the reward according to the state of the combustion equipment, and the state quantity information is input, and the operation content of the supply device according to the input state quantity information is derived. An information processing method comprising the steps of:

12. A learning system for a combustion installation, comprising: A learning unit that performs reinforcement learning of a learning model based on a correspondence between state quantity information, which is information about the state quantity of the combustion equipment, the operation content of a supply device that supplies materials to be incinerated to the combustion equipment, and a reward according to the state of the combustion equipment. A learning system with

13. A learning method for a combustion installation, comprising: A reinforcement learning of a learning model is performed based on a correspondence between state quantity information, which is information about the state quantity of the combustion equipment, the operation content of a supply device that supplies the incineration target material to the combustion equipment, and a reward according to the state of the combustion equipment. A learning method that includes:

Images