Information processing device, information processing method, and program

Abstract

In order to generate a more efficient operation plan as the operation plan concerning a water distribution plan, an information processing device (1) comprises: an acquisition means (11) for acquiring target data concerning a target water distribution plan; and a generation means (12) for generating an operation plan concerning the target water distribution plan by solving an optimization problem that uses a cost function determined by inverse reinforcement learning by use of reference data concerning reference water distribution plans and the target data acquired by the acquisition means.

Description

[Technical Field]

[0001] The present invention relates to a technique for generating an operation plan for a water distribution plan. [Background technology]

[0002] There is a demand for more efficient water distribution planning in water infrastructure, and optimization techniques using predictive models have been known for some time. For example, Patent Document 1 describes a method for formulating an operation plan for the water intake, transport, and distribution process of a water plant by solving an optimization problem with constraints and evaluation indices related to the plant configuration as objective functions. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-185678 Summary of the Invention [Problem to be solved by the invention]

[0004] However, Patent Document 1 does not describe a specific method for calculating the evaluation index, and therefore the technology described in Patent Document 1 has the problem that the operation plan is not necessarily optimized.

[0005] One aspect of the present invention has been made in consideration of the above-mentioned problems, and one object thereof is to provide a technology that can generate a more efficient operation plan as an operation plan related to a water distribution plan. [Means for solving the problem]

[0006] An information processing device according to one aspect of the present invention includes an acquisition means for acquiring target data relating to a target water distribution plan, and a generation means for generating an operation plan for the target water distribution plan by solving an optimization problem using a cost function determined by inverse reinforcement learning using reference data relating to a reference water distribution plan and the target data acquired by the acquisition means.

[0007] In addition, an information processing device according to one aspect of the present invention includes an acquisition means for acquiring reference data related to a reference water distribution plan, and a determination means for determining a cost function to be used in an optimization problem for generating an operation plan related to a target water distribution plan by inverse reinforcement learning with reference to the reference data.

[0008] An information processing method according to one aspect of the present invention includes acquiring target data related to a target water distribution plan, and calculating a cost function determined by inverse reinforcement learning using reference data related to a reference water distribution plan. Recording and generating an operational plan for the target water distribution plan by solving an optimization problem using the obtained target data.

[0009] In addition, an information processing method according to one aspect of the present invention includes obtaining reference data relating to a reference water distribution plan, and determining a cost function to be used in an optimization problem for generating an operation plan for a target water distribution plan by inverse reinforcement learning with reference to the reference data.

[0010] Further, a program according to one aspect of the present invention is a program for causing a computer to execute an acquisition process for acquiring target data related to a target water distribution plan, a cost function determined by inverse reinforcement learning using reference data related to a reference water distribution plan, and In processing and generating a generation process for generating an operation plan for the target water distribution plan by solving an optimization problem using the acquired target data.

[0011] In addition, a program according to one aspect of the present invention causes a computer to execute an acquisition process for acquiring reference data related to a reference water distribution plan, and a determination process for determining a cost function to be used in an optimization problem for generating an operation plan related to a target water distribution plan by inverse reinforcement learning with reference to the reference data. [Effects of the Invention]

[0012] According to one aspect of the present invention, a more efficient operation plan can be generated as an operation plan related to a water distribution plan. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a block diagram showing a configuration of an information processing device according to a first exemplary embodiment. [Figure 2] 1 is a flowchart showing the flow of an information processing method according to the first exemplary embodiment. [Figure 3] 1 is a block diagram showing a configuration of an information processing device according to a first exemplary embodiment. [Figure 4] 1 is a flowchart showing the flow of an information processing method according to the first exemplary embodiment. [Figure 5] FIG. 10 is a block diagram showing the configuration of an information processing device according to a second exemplary embodiment. [Figure 6] FIG. 10 is a diagram for explaining a water distribution planning problem according to the second exemplary embodiment. [Figure 7] FIG. 10 is a diagram showing an overview of a water distribution network according to an exemplary embodiment 2. [Figure 8] 10A and 10B are diagrams showing specific examples of operation patterns of a pump according to the second exemplary embodiment. [Figure 9] FIG. 10 is a diagram showing an example of a display in which the operation pattern of the pump according to the second exemplary embodiment is output in association with a time axis. [Figure 10] FIG. 1 is a block diagram illustrating a configuration of a computer that functions as an information processing device according to each exemplary embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0014] Exemplary Embodiment 1 A first exemplary embodiment of the present invention will be described in detail with reference to the drawings. This exemplary embodiment is a basic form of the exemplary embodiments described below.

[0015] <Configuration of information processing device 1> The configuration of an information processing device 1 according to this exemplary embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of the information processing device 1. The information processing device 1 is a device that generates an operation plan for a target water distribution plan. The target of the water distribution plan is, for example, a water infrastructure (hereinafter also referred to as "water infrastructure"). The information processing device 1 includes an acquisition unit 11 and a generation unit 12.

[0016] (Acquisition part 11) The acquisition unit 11 acquires target data related to a target water distribution plan. The target data includes, for example, information indicating the status of the target water infrastructure. More specifically, the target data includes, for example, information related to at least one of pumps, water distribution networks, water pipelines, and demand points in the target water infrastructure. However, the target data is not limited to the above examples, and may include other data related to the target water distribution plan.

[0017] (Generation part 12) The generation unit 12 generates an operation plan for a target water distribution plan by solving an optimization problem using a cost function determined by inverse reinforcement learning using reference data for the reference water distribution plan and the target data acquired by the acquisition unit 11. Here, the reference data is information related to the reference water distribution plan. As an example, the reference data includes information representing the state of the reference water infrastructure. More specifically, as an example, the reference data includes information related to at least one of pumps, water distribution networks, water pipelines, and demand points in the reference water infrastructure. Here, the reference water infrastructure may be the same as or different from the water infrastructure for which the operation plan is generated.

[0018] The reference data may also include, for example, information about pump operation patterns in the reference water infrastructure, and information about personnel involved in the reference water infrastructure, but the reference data is not limited to the above examples and may include other data related to the reference water distribution plan.

[0019] The various data included in the target data and the various data included in the reference data can also be said to be state data representing states in inverse reinforcement learning, or behavior data representing actions in inverse reinforcement learning. Here, the distinction between state data and behavior data can be changed as appropriate depending on the problem setting. That is, at least a portion of the data included in the state data can also have the meaning of behavior data. Furthermore, at least a portion of the data included in the behavior data can also have the meaning of state data.

[0020] The behavioral data included in the reference data includes, for example, data representing an operation plan created by an expert for the reference water infrastructure. More specifically, the behavioral data is represented by, for example, variables controlled based on operation rules, such as valve opening / closing, water intake, and pump thresholds.

[0021] The operation plan generated by the generation unit 12 includes, for example, information about the operation patterns of pumps in the target water infrastructure. The operation plan also includes, for example, information about personnel involved in the target water infrastructure. However, the operation plan is not limited to the above examples and may include other information.

[0022] As an example, the cost function includes cost terms including variables corresponding to the items included in the reference data. In this case, the generation unit 12 generates an operation plan for the target water distribution plan by solving an optimization problem using the cost function, in which the target data acquired by the acquisition unit 11 is set as fixed variables and variables other than the fixed variables among the variables included in each cost term included in the cost function are set as manipulated variables. However, the cost function is not limited to the above example and may be another function.

[0023] The method used by the generation unit 12 to solve the optimization problem is not particularly limited, but as an example, the solution may be obtained by performing processing equivalent to that of a general application program (e.g., IBM ILOG CPLEX, GurobiOptimizer, SCIP).

[0024] As described above, the information processing device 1 according to this exemplary embodiment is configured to acquire target data related to a target water distribution plan, and generate an operation plan for the target water distribution plan by solving an optimization problem using the acquired target data and a cost function determined by inverse reinforcement learning using reference data related to a reference water distribution plan. Therefore, the information processing device 1 according to this exemplary embodiment has the effect of being able to generate a more efficient operation plan for the water distribution plan.

[0025] <Flow of information processing method S10> The flow of an information processing method S10 according to this exemplary embodiment will be described with reference to Fig. 2. Fig. 2 is a flow diagram showing the flow of the information processing method S10. In step S11, the acquisition unit 11 acquires target data related to a target water distribution plan. In step S12, the generation unit 12 generates an operation plan related to the target water distribution plan by solving an optimization problem using a cost function determined by inverse reinforcement learning using reference data related to a reference water distribution plan and the target data acquired in step S11.

[0026] As described above, the information processing method S10 according to this exemplary embodiment is configured to acquire target data related to a target water distribution plan, and generate an operation plan for the target water distribution plan by solving an optimization problem using the acquired target data and a cost function determined by inverse reinforcement learning using reference data related to a reference water distribution plan. Therefore, the information processing method S10 according to this exemplary embodiment has the effect of being able to generate a more efficient operation plan for the water distribution plan.

[0027] <Configuration of information processing device 2> The configuration of an information processing device 2 according to this exemplary embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing the configuration of the information processing device 2. The information processing device 2 is a device that determines a cost function to be used in an optimization problem for generating an operation plan related to a water distribution plan. The information processing device 2 includes an acquisition unit 21 and a determination unit 22.

[0028] (Acquisition part 21) The acquisition unit 21 acquires reference data related to a water distribution plan for reference. The acquisition unit 21 may acquire the reference data all at once, or may acquire the reference data sequentially.

[0029] (Decision unit 22) The determination unit 22 determines a cost function to be used for an optimization problem for generating an operation plan for a target water distribution plan by inverse reinforcement learning with reference to the reference data. Here, the cost function includes, as an example, cost terms including variables corresponding to items included in the reference data.

[0030] As described above, the information processing device 2 according to this exemplary embodiment is configured to acquire reference data related to a reference water distribution plan, and determine a cost function to be used in an optimization problem for generating an operation plan related to the target water distribution plan by inverse reinforcement learning with reference to the reference data. Therefore, the information processing device 2 according to this exemplary embodiment has the advantage of being able to determine a cost function that can generate a more efficient operation plan related to the water distribution plan.

[0031] <Flow of information processing method S2> The flow of the information processing method S2 according to this exemplary embodiment will be described with reference to Fig. 4. Fig. 4 is a flow diagram showing the flow of the information processing method S2. In step S21, the acquisition unit 21 acquires reference data related to a water distribution plan for reference. In step S22, The determination unit 22 determines a cost function to be used in an optimization problem for generating an operation plan for a target water distribution plan by inverse reinforcement learning with reference to reference data.

[0032] As described above, the information processing method S2 according to this exemplary embodiment employs a configuration in which reference data related to a reference water distribution plan is acquired, and a cost function to be used in an optimization problem for generating an operation plan related to a target water distribution plan is determined by inverse reinforcement learning with reference to the reference data. Therefore, the information processing method S2 according to this exemplary embodiment has the effect of being able to determine a cost function that can generate a more efficient operation plan related to the water distribution plan.

[0033] Exemplary Embodiment 2 A second exemplary embodiment of the present invention will be described in detail with reference to the drawings. Note that components having the same functions as those described in the first exemplary embodiment are given the same reference numerals, and their description will not be repeated.

[0034] <Configuration of information processing device 1A> FIG. 5 is a block diagram showing the configuration of an information processing device 1A according to this exemplary embodiment. The information processing device 1A generates an operation plan related to a water distribution plan for a water infrastructure. The water infrastructure according to this exemplary embodiment includes, as an example, a plurality of bases such as reservoirs, distribution reservoirs, water intake facilities, water purification plants, water supply stations, and demand points. The operation plan includes, as an example, information indicating the operation patterns of pumps at each base. The information processing device 1A includes a control unit 10A, a memory unit 20A, a communication unit 30A, and an input / output unit 40A.

[0035] (Communication unit 30A) The communication unit 30A communicates with devices external to the information processing device 1A via a communication line. While the specific configuration of the communication line does not limit the present exemplary embodiment, examples of the communication line include a wireless LAN (Local Area Network), a wired LAN, a WAN (Wide Area Network), a public line network, a mobile data communication network, or a combination thereof. The communication unit 30A transmits data supplied from the control unit 10A to other devices, and supplies data received from other devices to the control unit 10A.

[0036] (Input / output section 40A) Input / output devices such as a keyboard, a mouse, a display, a printer, and a touch panel are connected to the input / output unit 40A. The input / output unit 40A receives various types of information input to the information processing device 1A from the connected input devices. Furthermore, the input / output unit 40A outputs various types of information to connected output devices under the control of the control unit 10A. An example of the input / output unit 40A is an interface such as a USB (Universal Serial Bus).

[0037] (Control unit 10A) As shown in FIG. 5, the control unit 10A includes an acquisition unit 11A, a generation unit 12A, and a determination unit 22A.

[0038] (Acquisition part 11A) The acquisition unit 11A acquires the target data TD and the reference data RD. As an example, the acquisition unit 11A acquires the target data TD and the reference data RD from another device via the communication unit 30A. As another example, the acquisition unit 11 may acquire the target data TD and the reference data RD input via the input / output unit 40A. As an example, the acquisition unit 11 may acquire the target data TD and the reference data RD by reading the target data TD and the reference data RD from the storage unit 20A or an externally connected storage device. Details of the target data TD and the reference data RD will be described later.

[0039] (Generation section 12A) The generation unit 12A generates an operation plan OP for a target water distribution plan by solving an optimization problem using a cost function c determined by inverse reinforcement learning using reference data RD for a reference water distribution plan and the target data TD acquired by the acquisition unit 11. The process of generating the operation plan OP executed by the generation unit 12A will be described later.

[0040] (Decision section 22A) The determination unit 22A determines a cost function c to be used for an optimization problem for generating an operation plan OP for a target water distribution plan by inverse reinforcement learning with reference to the reference data RD. The process of determining the cost function c executed by the determination unit 22A will be described later.

[0041] (Storage unit 20A) The memory unit 20A stores the target data TD and reference data RD acquired by the acquisition unit 11. The memory unit 20A also stores the operation plan OP generated by the generation unit 12A. The memory unit 20A also stores the cost function c and constraint conditions LC determined by the determination unit 22A. Here, storing the cost function c in the memory unit 20A means that parameters that determine the cost function c are stored in the memory unit 20A.

[0042] (Target data TD) The target data TD is data used by the generation unit 12A to generate the operation plan OP. The target data TD includes information indicating the state of the target water infrastructure. As an example, the target data TD includes information regarding at least one of pumps, water distribution networks, water pipelines, and demand points in the target water infrastructure.

[0043] Specifically, the target data TD includes, as an example, at least one of the following data (i) to (x) for the water infrastructure that is the target of the operation plan. However, the data included in the target data TD is not limited to these, and may include other data. (i) Power consumption at each location, (ii) demand forecast margin, (iii) reservoir margin, (iv) water distribution loss, (v) number of operating personnel at each location, (vi) electricity charges at each location, (vii) voltage at each location, (viii) water level at each location, (ix) water pressure at each location, (x) water volume at each location.

[0044] (i) The power consumption at each base indicates the power consumption at each base, such as the water purification plant and water supply station. (ii) The demand forecast margin indicates the extent to which supply exceeds demand. (iii) The distribution reservoir margin indicates the extent to which the designed water storage volume at the distribution reservoir exceeds the actual storage volume. (iv) The water distribution loss indicates the extent to which water cannot be distributed to each demand point. (v) The number of operating personnel indicates the number of operating personnel at each base.

[0045] (Reference Data RD) The reference data RD is data used by the determination unit 22A when determining a cost function. The reference data RD includes information representing the state of the reference water infrastructure. Here, the reference water infrastructure may be the same as or different from the water infrastructure for which the operation plan is generated. More specifically, the reference data RD includes, for example, information regarding at least one of pumps, a water distribution network, water pipelines, and demand points in the reference water infrastructure. Furthermore, the reference data RD includes, for example, information regarding at least one of pump operation patterns and personnel in the reference water infrastructure. Each item included in the reference data RD may be treated as state data or as behavior data.

[0046] Specifically, the reference data RD includes, as an example, at least one of the following data (i) to (x) in the reference water infrastructure. However, the data included in the reference data RD is not limited to these, and may include other data. (i) Power consumption at each location, (ii) demand forecast margin, (iii) reservoir margin, (iv) water distribution loss, (v) number of operating personnel at each location, (vi) electricity charges at each location, (vii) voltage at each location, (viii) water level at each location, (ix) water pressure at each location, (x) water volume at each location.

[0047] Furthermore, the reference data RD includes, for example, data indicating an operation plan prepared by an expert for the reference water infrastructure. More specifically, the reference data RD includes, for example, data represented by variables controlled based on operation rules, such as valve opening / closing, water intake, and pump thresholds. Such data can also be said to represent the decision-making history (the expert's intentions) of the expert or other expert who prepared the reference operation plan.

[0048] (Operational Plan OP) The operational plan OP includes, for example, information about the operation patterns of pumps in the target water infrastructure, and also includes, for example, information about personnel involved in the target water infrastructure.

[0049] (cost function c) The cost function c includes cost terms including variables corresponding to the items included in the reference data RD. For example, the cost function c is as follows:

number

[0050] (Constraint condition LC) The constraints LC are constraints on the optimization problem to be solved by the generating unit 12A. The constraints LC include, for example, the following (i) to (iv). Note that the constraints LC are not limited to these and may include other conditions. (i) The water volume of the reservoir / distribution reservoir is greater than or equal to threshold value X and less than threshold value Y. (ii) Supply exceeds demand by at least X%. (iii) Water is being distributed to all demand points. (iv) Do not use routes that are under construction.

[0051] <Processing Executed by the Generation Unit 12A> The generation unit 12A generates an operation plan OP for a target water distribution plan by solving an optimization problem using a cost function c and target data TD under constraint conditions LC. In this exemplary embodiment, the generation unit 12A generates an operation plan OP for a target water distribution plan by solving an optimization problem using a cost function c, in which the target data TD acquired by the acquisition unit 11A is used as a fixed variable and variables other than the fixed variables among the variables included in each cost term in the cost function c are used as manipulated variables.

[0052] The generating unit 12A also outputs the generated operation plan OP. The generating unit 12A may output the operation plan OP by writing it to the storage unit 20A or an external storage device, or may output it to an output device (display, printer, etc.) connected to the input / output unit 40A. The generating unit 12A may also transmit the operation plan OP to another device via the communication unit 30A.

[0053] <Processing Executed by Determining Unit 22A> Furthermore, the determination unit 22A determines a cost function c used in an optimization problem for generating an operation plan for the target water distribution plan by inverse reinforcement learning with reference to the reference data RD. As an example, the determination unit 22A determines a cost term α i f i (x i ) weighting coefficient α i is determined by inverse reinforcement learning using the state data and behavior data included in the reference data RD. i A cost function c having various values ​​is prepared as a function of the reference data RD, and the cost related to the reference data RD is calculated using the cost function. Then, the weighting coefficients α that minimize the cost related to the reference data RD are calculated. i Determine the value of

[0054] As another example, the determination unit 22A may be configured to determine the cost function c by the inverse reinforcement learning method described in Patent Document WO2021 / 130916. However, the method by which the determination unit 22A determines the cost function c is not limited to this, and other methods may be used.

[0055] Furthermore, the determination unit 22A outputs the determined cost function c. The determination unit 22A may output the cost function c by writing it to the storage unit 20A or an external storage device, or may output it to an output device (such as a display or printer) connected to the input / output unit 40A. Furthermore, the generation unit 12A may transmit the cost function c to another device via the communication unit 30A.

[0056] <Optimization problem settings> FIG. 6 is a diagram illustrating a specific example of setting an optimization problem according to this exemplary embodiment. The operation plan OP needs to be determined taking into consideration various perspectives, such as how much margin to leave in the predicted demand, how much to reduce power consumption, and how much to consider the water level of the water reservoir. Setting the weighting of these perspectives is difficult because the degree of importance given to each perspective varies depending on the operator of the water infrastructure and is not uniformly determined. For example, there is a case where local government A, which is the creator of a certain operation plan, places emphasis on the aspect of power consumption, while local government B places emphasis on the water level of the water reservoir.

[0057] In this exemplary embodiment, the generator 12A generates each cost term α i f i (x i ) weighting coefficient α i The optimization problem is solved using the cost function c determined by inverse reinforcement learning with reference data RD and the target data TD. Here, each cost term α i f i (x i ) weighting coefficient α i is determined by inverse reinforcement learning with reference to the reference data RD, it is a value that reflects the behavioral data contained in the reference data RD, that is, a value that reflects the intention of the expert who generated the reference operation plan. i By solving the optimization problem using a cost function c including the above, it is possible to generate an operation plan that reflects the intentions of the expert who generated the reference operation plan.

[0058] For example, in the example of Figure 6, the weighting coefficients α1 to α6 included in the cost function c used to generate the operation plan OP of local government A are values ​​that reflect the intentions of the experts who generated the reference operation plan used to determine the cost function c. Also, the weighting coefficients α1 to α6 included in the cost function c used to generate the operation plan OP of local government B are values ​​that reflect the intentions of the experts who generated the reference operation plan used to determine the cost function c. By comparing the weighting coefficients of local government A and local government B, it becomes easier to understand what perspectives each local government places importance on.

[0059] Also, for example, the determination unit 22A can determine the cost function c by referring to reference data RD including an operation plan created by an expert a1 in the local government A, and the generation unit 12A can generate a future operation plan OP using the cost function c determined by the determination unit 22A and the target data TD of the local government A. In this case, the generation unit 12A can generate a future operation plan OP for the local government A that reflects the intentions of the expert a1.

[0060] Furthermore, according to this exemplary embodiment, the intention of the generator of an operation plan for one municipality can be reflected in the operation plans of other municipalities. For example, the determination unit 22A can determine a cost function c by referring to reference data RD including an operation plan created by an expert a1 in municipality A, and the generation unit 12A can generate a future operation plan OP using the cost function c determined by the determination unit 22A and the target data TD of municipality B. In this case, the generation unit 12A can generate an operation plan OP for municipality B that reflects the intention of the expert a1.

[0061] <Example 1 of optimizing operational planning> Here, a specific example of optimizing an operation plan for pumps in a water infrastructure will be described with reference to FIGS.

[0062] (Overview of Water Distribution Network 3) FIG. 7 is a diagram showing an overview of a water distribution network 3, which is an example of a target of an operation plan OP generated by the information processing device 1A. The water distribution network 3 includes multiple bases, namely, water purification plants F1 and F2, a water supply station S1, a branch point B1, and demand points D1 and D2. The water purification plants F1 and F2 are, for example, facilities that produce purified water from water taken in by a water intake facility from a water intake target (rivers, oceans, lakes, etc.). The water purification plants F1 and F2 are equipped with water storage facilities (tanks, reservoirs, etc.) and pumps. The water supply station S1 is, for example, a facility that distributes water delivered from the water purification plants F1 and F2 to a specific area. The water supply station S1 is equipped with, for example, a water storage facility (tanks, reservoirs, etc.) and pumps. The demand points D1 and D2 are facilities of consumers (for example, offices, homes, factories, stores) that use the distributed water. The branch point B1 is a facility where the water pipeline L branches off. The components (bases) of the water distribution network 3 are connected by the water pipeline L.

[0063] In the example of Figure 7, multiple water purification plants F1 and F2, one water supply station S1, one branch point B1, and multiple demand points D1 and D2 are shown, but the number of water purification plants, water supply stations, branch points, and demand points included in the water distribution network is not limited to the example of Figure 7 and may be more or less than this.

[0064] (Examples of explanatory variables) Specific examples of explanatory variables used in optimizing the operation plan for the water distribution network 3 described above are described below. However, the data used when optimizing the operation plan for water infrastructure is not limited to the data exemplified below. Any information that can define the state of the water infrastructure and any variable that can be controlled based on the operation rules of the water infrastructure can be used.

[0065] (Example 1 of explanatory variables: pump information) The explanatory variables include, for example, information about pumps installed at each base station. The information about the pumps includes, for example, (i) the pump speed at a certain timing (or time interval) Operation (ii) the combination of pumps used; (iii) the water flow rate; and (iv) the power consumption.

[0066] (i) As an example of a combination of pumps operating at a certain timing (or time interval), consider a case where two pumps (let's call them pumps P1 and P2) are installed in a certain facility. In this case, if the pump operation pattern is "l," "l" includes three patterns: "{P1}" (only P1 operating), "{P2}" (only P2 operating), and "{P1, P2}" (both P1 and P2 operating), and each pattern is expressed as "l=1, 2, 3."

[0067] (ii) Water flow rate is the amount of water output from the pump (water flow rate) according to each operation pattern, and (iii) power consumption is the amount of electricity used by each pump (power consumption).

[0068] (Example 2 of explanatory variables: Information on water distribution network 3) Additionally, the explanatory variables include, for example, information related to the water distribution network 3. For example, let V (V={1, 2, . . . , n}) be the set of nodes of the facilities (assumed to be "n" locations) that make up the water distribution network 3. If the set of nodes of water purification plants is represented as "F," the set of nodes of water supply stations as "S," the set of nodes of branch points as "B," and the set of nodes of demand points as "D," then the following equation holds.

number

[0069] Furthermore, assuming that there are a total of "K" water purification plants F1, F2 and water supply station S1, the set of these nodes can be expressed as follows:

number

[0070] (Example 3 of explanatory variables: information about water pipeline L) The explanatory variables include, for example, information about water pipelines L. For example, each water pipeline L is assigned identification information that can identify the water pipeline L, and is expressed as a feature. More specifically, each water pipeline L may be assigned a number that can identify the water pipeline L, for example, from "1" to "m." As an example of a feature of each water pipeline L, the water flow rate "q" flowing through the water pipeline L numbered "i" in the time interval "t" ("t=1, . . . , T") may be expressed as a feature. i (t)[m 3 / 15min]”.

[0071] (Example 4 of explanatory variables: information about demand point D) The explanatory variables may also include information about the demand point D. The information about the demand point D is, for example, a predicted value of the demand amount at a certain timing (for example, time or time interval) of each demand point. i Demand quantity d in time interval t for (i∈D) i (t)" is expressed as follows:

number

[0072] (Example 5 of explanatory variables: Actual pump operation patterns) Furthermore, as an example, the explanatory variables may include the actual operating status of a pump operation pattern. In this case, the explanatory variables represent, for example, a pump operating at a certain timing (or time interval). When there are "Lk" patterns as pump operation patterns "l" in a certain facility (a water purification plant F or a water supply station S), the operating status of the pump operation pattern in time interval "t" is formulated as the following equation P(t):

number

[0073] (Example 6 of explanatory variables: information about personnel) The explanatory variables include, for example, information about personnel assigned to each base included in the water distribution network 3. The information about personnel may be any data that can be expressed as features, such as the number of people assigned, each person's job type (clerical or technical), years of service, etc. The data may also include the work shifts of employees at each node.

[0074] (Example output) Next, a specific example of the output of the information processing device 1A will be described with reference to the drawings. As an example, the information processing device 1A outputs the generated operation plan OP to the input / output unit 4 The data is displayed on a display (not shown) connected to OA.

[0075] FIG. 8 is a diagram showing specific examples of pump operation patterns included in the operation plan OP. In the example of FIG. 8, water purification plant F1 and water purification plant F2 are each equipped with two pumps (pump A and pump B). One pump (pump C) is installed at water supply station S1. For example, pumps A and C may be small pumps, and pump B may be a larger pump (than pumps A and C). In the example of FIG. 8, "pattern 1" at water purification plant F1 represents a pattern in which only pump A is operating, and "operation pattern 2" represents a pattern in which only pump B is operating. The same is true for water purification plant F2. "Pattern 1" at water supply station S1 represents a pattern in which only pump C is operating.

[0076] The information processing device 1A can output an operation plan OP by linking the pump operation pattern shown in Fig. 8 to a time axis and outputting it. Fig. 9 is a diagram showing a display example in which the pump operation pattern is linked to a time axis and output. In the graph of Fig. 9, the horizontal axis indicates the time interval, and the vertical axis indicates the pump operation pattern. The graph of Fig. 9 represents an operation plan in which the pump operation pattern is changed from operation pattern 2 to operation pattern 1 in time interval 5.

[0077] <Example of application to downsizing> As an application example of this exemplary embodiment, an application to downsizing will be described. In areas where population decline is predicted, there is a demand for more efficient water facilities. Water pipes require periodic large-scale maintenance, and simply owning them is costly. These costs are added to water bills, resulting in higher water bills. For this reason, there is a demand for downsizing in areas where population decline is predicted.

[0078] Downsizing requires a great deal of work, as it requires predicting the future and deciding which facilities to keep and which to abolish. Furthermore, the budgets and operating methods of water utilities vary greatly from one municipality to another, making it difficult to address the issue with the simple forecasting models that have traditionally been used.

[0079] Examples of the application of downsizing include (i) applying an operational plan from one municipality, A, to a target municipality, B, which has downsized its waterworks facilities, and (ii) extracting the intention from the downsizing implementation plan from one municipality, A, and formulating a downsizing plan for the target municipality, B.

[0080] In this case, the status data includes, for example, (a) indicators representing the status of the water infrastructure, (b) the water distribution network, pump capacity, and drainage pipe status, and (c) the voltage, water level, pressure, and water volume at each location.The behavior data is represented by variables that can be controlled based on operational rules, such as opening and closing valves, drawing in water, and pump thresholds.

[0081] Examples of reference data include (a) information on water pipes and water quality, (b) information on water purification plants, (c) demographics, (d) information on waterworks bureau staff, and (e) behavioral data of experts.Here, examples of information on (a) water pipes and water quality include the water quality, number, and altitude of water sources (high levels of arsenic, iron, manganese, etc. increase the cost of water purification), the location of water pipes, the number of users per region, and the population served by 1 km of water pipes.

[0082] (b) Information about water purification plants includes, for example, how much water the plant produces per day, its percentage of the total amount of purified water, its annual production costs, and its annual power consumption.

[0083] (c) Demographics, for example, may be the population trends or predicted population trends in a 500m square. (d) Staff information of the waterworks bureau, for example, may be the number of administrative staff and technical staff (which may include skilled staff, meter readers, and contract staff).

[0084] (e) Examples of behavioral data of experts, etc. include facility consolidation and renewal plans (number of water purification plants and their locations), population served per kilometer of water pipeline, and number of staff assigned. For example, if there are three water purification plants, A, B, and C, the behavioral data may indicate that the current proportions of A's share of the total purified water volume, A's share of 50%, B's share of 20%, and C's share of C's total purified water volume, should be changed to A's share of 30%, B's share of 10%, and C's share of C's total purified water volume.

[0085] (Example of using intent extraction results) The information processing device 1A may present a consolidation plan based on multiple intentions. The intention of the creator of the reference water distribution plan is reflected in the cost function c determined by the determination unit 22A. In other words, if the reference data RD is different, the cost function c determined by the determination unit 22A will also be different. As an example, the generation unit 12A generates an operation plan OP (consolidation plan) using each of multiple cost functions c, and presents the generated multiple operation plans OP to the user. At this time, the generation unit 12A may also visualize and present the features of each operation plan OP (weighting coefficients of each cost function c, etc.).

[0086] In addition, when generating multiple operation plans OP, the generation unit 12A may present the user with a fee simulator for each generated operation plan OP (for example, calculating the cost of replacing aging water pipes, the cost of maintaining water facilities, labor costs, water revenue, etc. for the operation plan, and calculating the fee per 1,000 liters, etc.).

[0087] Furthermore, the generation unit 12A may display the estimated household water usage (population transition×water usage per household) and the amount of water supplied according to the generated operation plan in a display format that allows comparison.

[0088] [Software implementation example] Some or all of the functions of the information processing devices 1, 1A, and 2 may be realized by hardware such as an integrated circuit (IC chip), or by software.

[0089] In the latter case, the information processing devices 1, 1A, and 2 are realized, for example, by a computer that executes instructions of a program, which is software that realizes each function. An example of such a computer (hereinafter referred to as computer C) is shown in FIG. 10. The computer C includes at least one processor C1 and at least one memory C2. The memory C2 stores a program P for operating the computer C as the information processing devices 1, 1A, and 2. In the computer C, the processor C1 reads and executes the program P from the memory C2, thereby realizing each function of the information processing devices 1, 1A, and 2.

[0090] The processor C1 may be, for example, a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), a micro processing unit (MPU), a floating point number processing unit (FPU), a physics processing unit (PPU), a microcontroller, or a combination thereof. The memory C2 may be, for example, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), or a combination thereof.

[0091] The computer C may further include a RAM (Random Access Memory) for expanding the program P during execution and for temporarily storing various data. The computer C may also include a communication interface for transmitting and receiving data to and from other devices. The computer C may also include an input / output interface for connecting input / output devices such as a keyboard, mouse, display, and printer.

[0092] Furthermore, the program P can be recorded on a non-transitory tangible recording medium M that can be read by the computer C. Such a recording medium M can be, for example, a tape, a disk, a card, a semiconductor memory, or a programmable logic circuit. The computer C can acquire the program P via such a recording medium M. The program P can also be transmitted via a transmission medium. Such a transmission medium can be, for example, a communication network or broadcast waves. The computer C can also acquire the program P via such a transmission medium.

[0093] [Appendix 1] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. For example, embodiments obtained by appropriately combining the technical means disclosed in the above-described embodiments are also included in the technical scope of the present invention.

[0094] [Appendix 2] Some or all of the above-described embodiments can also be described as follows: However, the present invention is not limited to the following described aspects. (Appendix 1) an acquisition means for acquiring target data relating to a target water distribution plan; a cost function determined by inverse reinforcement learning using reference data related to a reference water distribution plan; The target data acquired by the acquisition means; a generation means for generating an operation plan for the target water distribution plan by solving an optimization problem using An information processing device comprising:

[0095] According to the above configuration, a more efficient operation plan can be generated as an operation plan related to a water distribution plan.

[0096] (Appendix 2) the cost function includes cost terms each including a variable corresponding to each item included in the reference data; The generating means generates an optimization problem using the cost function, The target data acquired by the acquisition means is set as a fixed variable, Among the variables included in each cost term included in the cost function, variables other than the fixed variables are used as manipulated variables. Generate an operation plan for the target water distribution plan by solving an optimization problem. 10. The information processing device according to claim 1.

[0097] According to the above configuration, a more efficient water distribution plan can be generated.

[0098] (Appendix 3) the target data includes information indicative of the status of the target water infrastructure; 3. The information processing device according to claim 1 or 2.

[0099] According to the above configuration, a more efficient operation plan for the water infrastructure can be generated.

[0100] (Appendix 4) The target data includes information about at least one of pumps, distribution networks, water pipelines, and demand points in the target water infrastructure; 4. The information processing device according to claim 3.

[0101] According to the above configuration, an operation plan that reflects the intentions of the creator of the operation plan regarding the reference data can be generated for at least one of pumps, water distribution networks, water pipelines, and demand points in the water infrastructure.

[0102] (Appendix 5) The operation plan generated by the generating means includes information about pump operation patterns in the target water infrastructure. 5. The information processing device according to claim 3 or 4.

[0103] According to the above configuration, a more efficient pump operation pattern can be generated.

[0104] (Appendix 6) The operation plan generated by the generating means includes information about personnel involved in the target water infrastructure. 6. An information processing device according to any one of appendices 3 to 5.

[0105] According to the above configuration, it is possible to generate information about personnel involved in the target water infrastructure, which allows for more efficient operation.

[0106] (Appendix 7) The acquisition means acquires the reference data, The information processing device includes: 7. The information processing device according to any one of appendices 1 to 6, further comprising: a determination means for determining the cost function by inverse reinforcement learning with reference to the reference data.

[0107] According to the above configuration, it is possible to determine a cost function that can generate a more efficient operation plan as an operation plan related to a water distribution plan.

[0108] (Appendix 8) The reference data includes: Information about pumps, distribution networks, pipelines, and / or demand points in the reference water infrastructure; and information regarding pump operation patterns and / or personnel in the reference water infrastructure; 8. The information processing device according to claim 7,

[0109] According to the above configuration, a cost function can be determined that reflects the intentions of the creator of the operation plan based on information regarding at least one of pumps, water distribution networks, water pipelines, and demand points in the reference water infrastructure, as well as information regarding at least one of pump operation patterns and personnel in the reference water infrastructure.

[0110] (Appendix 9) an acquisition means for acquiring reference data relating to a reference water distribution plan; a determination means for determining a cost function to be used in an optimization problem for generating an operation plan for a target water distribution plan by inverse reinforcement learning with reference to the reference data; An information processing device comprising:

[0111] According to the above configuration, it is possible to determine a cost function that can generate a more efficient water distribution plan.

[0112] (Appendix 10) obtaining target data relating to a target water distribution plan; a cost function determined by inverse reinforcement learning using reference data related to a reference water distribution plan; The acquired target data; generating an operation plan for the target water distribution plan by solving an optimization problem using An information processing method including:

[0113] According to the above information processing method, the same effects as those of the above information processing device can be achieved.

[0114] (Appendix 11) Obtaining reference data for a reference water distribution plan; determining a cost function to be used in an optimization problem for generating an operation plan for a target water distribution plan by inverse reinforcement learning with reference to the reference data; An information processing method including:

[0115] According to the above information processing method, the same effects as those of the above information processing device can be achieved.

[0116] (Appendix 12) On the computer, an acquisition process for acquiring target data relating to a target water distribution plan; a cost function determined by inverse reinforcement learning using reference data related to a reference water distribution plan; The target data acquired in the acquisition process a generation process for generating an operation plan for the target water distribution plan by solving an optimization problem using A program that executes the following.

[0117] According to the above configuration, the same effects as those of the above-mentioned information processing device can be achieved.

[0118] (Appendix 13) On the computer, an acquisition process for acquiring reference data relating to a reference water distribution plan; a determination process for determining a cost function to be used in an optimization problem for generating an operation plan for a target water distribution plan by inverse reinforcement learning with reference to the reference data; A program that executes the following.

[0119] According to the above configuration, the same effects as those of the above-mentioned information processing device can be achieved.

[0120] [Appendix 3] Some or all of the above-described embodiments can also be expressed as follows. The system includes at least one processor, and the processor includes: an acquisition process for acquiring target data related to a target water distribution plan; a cost function determined by inverse reinforcement learning using reference data related to a reference water distribution plan; and a previous Recording and an information processing device that executes a generation process for generating an operation plan for the target water distribution plan by solving an optimization problem using the obtained target data.

[0121] The information processing device may further include a memory that stores a program for causing the processor to execute the acquisition process and the generation process. The program may also be recorded on a computer-readable, non-transitory, tangible recording medium.

[0122] Furthermore, some or all of the above-described embodiments can also be expressed as follows. An information processing device comprising at least one processor, which executes an acquisition process for acquiring reference data related to a reference water distribution plan, and a determination process for determining a cost function to be used in an optimization problem for generating an operation plan related to a target water distribution plan by inverse reinforcement learning with reference to the reference data.

[0123] The information processing device may further include a memory that stores a program for causing the processor to execute the acquisition process and the determination process. The program may also be recorded on a computer-readable, non-transitory, tangible recording medium. [Explanation of symbols]

[0124] 1, 1A, 2 Information processing equipment S10, S2 Information processing method 10A Control unit 11, 21 Acquisition Department 12 Generation part 20A storage section 22 Decision Section 30A Communications Department 40A input / output section

Claims

1. an acquisition means for acquiring target data relating to a target water distribution plan; Costs determined by inverse reinforcement learning using reference data for reference water distribution plans Functions and The target data acquired by the acquisition means; Generate an operation plan for the target water distribution plan by solving an optimization problem using Generation means and Equipped with The cost function is a function of each cost including each variable corresponding to each item included in the reference data. Contains the term The generating means generates an optimization problem using the cost function, The target data acquired by the acquisition means is set as a fixed variable, Among the variables included in each cost term included in the cost function, variables other than the fixed variables are Use as an instrumental variable Generate an operation plan for the target water distribution plan by solving an optimization problem. Information processing device.

2. The subject data includes information indicating the status of the subject water infrastructure. are The information processing device according to claim 1 .

3. The target data includes pumps, distribution networks, Contains information on at least one of water pipelines and demand points The information processing device according to claim 2 .

4. The operation plan generated by the generating means includes the following: Contains information about pump operation patterns 4. The information processing device according to claim 2 or 3.

5. a second acquisition means for acquiring reference data relating to a reference water distribution plan; a determination means for determining the cost function by inverse reinforcement learning with reference to the reference data; The information processing device according to claim 1 , further comprising:

6. A computer comprising: obtaining target data relating to a target water distribution plan; Costs determined by inverse reinforcement learning using reference data for reference water distribution plans Functions and The acquired target data; Generate an operation plan for the target water distribution plan by solving an optimization problem using Koto and Including, The cost function is a function of each cost including each variable corresponding to each item included in the reference data. Contains the term In the step of generating the operation plan, an optimization problem using the cost function is The acquired target data is set as a fixed variable, Among the variables included in each cost term included in the cost function, variables other than the fixed variables are Use as an instrumental variable Generate an operation plan for the target water distribution plan by solving an optimization problem. Information processing methods.

7. The computer Obtaining reference data for a reference water distribution plan; determining the cost function by inverse reinforcement learning with reference to the reference data; The information processing method according to claim 6 , further comprising:

8. On the computer, an acquisition process for acquiring target data relating to a target water distribution plan; Costs determined by inverse reinforcement learning using reference data for reference water distribution plans Functions and The target data acquired in the acquisition process Generate an operation plan for the target water distribution plan by solving an optimization problem using Generation process and A program for executing The cost function is a function of each cost including each variable corresponding to each item included in the reference data. Contains the term The generation process is an optimization problem using the cost function, The target data acquired in the acquisition process is set as a fixed variable, Among the variables included in each cost term included in the cost function, variables other than the fixed variables are Use as an instrumental variable Generate an operation plan for the target water distribution plan by solving an optimization problem. program.

9. The computer, a second acquisition process for acquiring reference data related to a reference water distribution plan; a determination process of determining the cost function by inverse reinforcement learning with reference to the reference data; The program according to claim 8, further comprising:

Images