Information processing device, information processing method, program, display device, and display method

Abstract

The present invention comprises: a machine learning unit (12) that, on the basis of a search point of a parameter and an evaluation value for the search point, learns the relationship between the evaluation value and the parameter, and predicts an evaluation value for a search candidate point of the parameter; and a search progress status acquisition unit (13) that acquires progress information indicating the progress status of a search, on the basis of the search point, the evaluation value for the search point, the search candidate point, and the evaluation value for the search candidate point predicted by the machine learning unit (12).

Description

Information processing device, information processing method, program, display device, and display method

[0001] The present disclosure relates to an information processing device, an information processing method, a program, a display device, and a display method.

[0002] Conventionally, Bayesian optimization, a black-box optimization method, has been used to optimize parameter values. Examples of parameters include hyperparameters in machine learning, or parameters that determine the installation environment of a machine that can be formulated as an equivalent problem, optimal operating conditions for each task, or the configuration of the machine.

[0003] Bayesian optimization is a method capable of efficiently searching for parameter values ​​with good evaluation values, and by repeatedly performing searches, it is possible to obtain optimal parameter values. However, Bayesian optimization can potentially result in a prolonged search. In response to this, it is known that Bayesian optimization can further shorten the search time by determining the number of searches or a target value and then terminating the search (see, for example, Patent Document 1).

[0004] International Publication No. 2021-024396

[0005] One challenge with this optimization is that it is sometimes difficult for users to decide whether to continue the search because no information indicating the progress of the search is obtained.

[0006] The present disclosure has been made to solve the above-mentioned problems, and aims to provide an information processing device that is capable of acquiring information to use as a reference for deciding whether to continue or terminate parameter search.

[0007] The information processing device according to the present disclosure is characterized by comprising a machine learning unit that learns the relationship between evaluation values ​​and parameters based on search points of parameters and evaluation values ​​of the search points, and predicts evaluation values ​​for search candidate points of the parameters, and a search progress acquisition unit that acquires progress information indicating the progress of the search based on the search points, the evaluation values ​​of the search points, the search candidate points, and the evaluation values ​​of the search candidate points predicted by the machine learning unit.

[0008] According to the present disclosure, with the above configuration, it is possible to obtain information that can be used as a reference for deciding whether to continue or end the parameter search.

[0009] FIG. 1 is a diagram illustrating an example of the configuration of a parameter optimization device according to a first embodiment. FIG. 2 is a diagram illustrating an example of the hardware configuration of the parameter optimization device according to the first embodiment. FIG. 3 is a flowchart illustrating an example of the operation of the parameter optimization device according to the first embodiment. FIG. 4 is a diagram illustrating an example of the calculation of a search progress status by the parameter optimization device according to the first embodiment. FIG. 5 is a diagram illustrating an example of the display of a search progress status by the parameter optimization device according to the first embodiment. FIG. 6 is a diagram illustrating an example of the configuration of a parameter optimization device according to a second embodiment. FIG. 7 is a flowchart illustrating an example of the operation of the parameter optimization device according to the second embodiment. FIG. 8 is a diagram illustrating an example of the display of a search termination determination by the parameter optimization device according to the second embodiment. FIG. 9 is a diagram illustrating an example of the configuration of a parameter optimization device according to a third embodiment. FIG. 10 is a flowchart illustrating an example of the operation of the parameter optimization device according to the third embodiment. FIG. 11 is a diagram illustrating an example of the display of a search termination determination by the parameter optimization device according to the third embodiment. FIG. 12 is a diagram illustrating an example of the configuration of a parameter optimization device according to a fourth embodiment. FIG. 13 is a flowchart illustrating an example of the operation of the parameter optimization device according to the fourth embodiment.

[0010] Hereinafter, embodiments will be described in detail with reference to the drawings. Embodiment 1. Fig. 1 is a diagram showing an example of the configuration of a parameter optimization device 1 according to embodiment 1. The parameter optimization device 1 optimizes parameter values. As shown in Fig. 1, the parameter optimization device 1 includes a parameter evaluation unit 11, a machine learning unit 12, a search progress acquisition unit 13, a display unit 14, and a search parameter generation unit 15.

[0011] The display unit 14 may be referred to as a display device. The display device may include an acquisition unit (not shown) that acquires progress information indicating the progress of the search for optimal parameters by the parameter optimization device 1. The parameter optimization device 1 may also be referred to as an information processing device that processes information.

[0012] The information processing device and parameter optimization device of the present disclosure do not need to include all of the components of the parameter optimization device 1 shown in FIG. 1 of embodiment 1. For example, the configuration may be such that any one or all of the parameter evaluation unit 11, the display unit 14, and the search parameter generation unit 15 are removed. In other words, an extracted version of only a portion of the components of the parameter optimization device 1 of FIG. 1 is also included in the concept of the information processing device and parameter optimization device of the present disclosure.

[0013] Furthermore, the components included in each unit may be appropriately removed as needed. For example, the search progress calculation unit 132 included in the search progress acquisition unit 13, which will be described below, may be configured to be removable from the search progress acquisition unit 13. Note that when an information processing device includes at least some of the components of the search progress acquisition unit 13, it may be referred to as a search progress acquisition device.

[0014] Furthermore, the components included in the parameter optimization device 1 may be located in different locations. For example, the parameter evaluation unit 11 and the machine learning unit 12 may be stored in separate servers. In this case, the processes disclosed herein may be executed by communication via a network from a communication unit included in each server.

[0015] The parameter evaluation unit 11 acquires an evaluation value for the parameter search point based on the determined parameter search point. The evaluation value acquired by the parameter evaluation unit 11 and information indicating the corresponding parameter search point are output to the machine learning unit 12.

[0016] As shown in FIG. 1, the parameter evaluation unit 11 includes an operation unit 111, an evaluation value calculation unit 112, and a searched data storage unit 113.

[0017] The operation unit 111 operates the optimization target at the parameter search points based on the determined parameter search points. The optimization target may be, for example, a machine learning model or a mechanical device. Information indicating the operation result of the optimization target by the operation unit 111 is output to the evaluation value calculation unit 112.

[0018] The evaluation value calculation unit 112 calculates an evaluation value for the search point of the parameter used by the operation unit 111 based on the operation result of the optimization target by the operation unit 111. The evaluation value calculated by the evaluation value calculation unit 112 and information indicating the search point of the corresponding parameter are output to the searched data storage unit 113.

[0019] The searched data storage unit 113 stores, as searched data, the evaluation value calculated by the evaluation value calculation unit 112 and information indicating the search points of the corresponding parameters. The searched data stored in the searched data storage unit 113 is read out by the machine learning unit 12 and the search progress status acquisition unit 13.

[0020] 1 illustrates a case where the searched data storage unit 113 is provided inside the parameter optimization device 1. However, the present invention is not limited to this, and the searched data storage unit 113 may be provided outside the parameter optimization device 1.

[0021] The machine learning unit 12 learns the relationship between the evaluation value and the parameter based on the evaluation value and the corresponding parameter search point acquired by the parameter evaluation unit 11, and predicts the evaluation value for the parameter's candidate search point. The parameter's candidate search point is a point that is a candidate for the parameter's search point. Information indicating the evaluation value predicted by the machine learning unit 12 and the corresponding parameter's candidate search point is output to the search progress status acquisition unit 13.

[0022] The search progress acquisition unit 13 acquires progress information indicating the progress of the search based on the evaluation values ​​and corresponding parameter search points acquired by the parameter evaluation unit 11, and the evaluation values ​​and corresponding parameter candidate search points predicted by the machine learning unit 12. In a case where the search termination determination unit 151 (described later) automatically determines whether to terminate the search, as in the first embodiment, the search progress may be, for example, one of a search progress rate, which is the progress rate of the search for a search point, and a progress rate based on the evaluation value of the search point. Furthermore, without being limited to this, the search progress may include, for example, one or more of the intra-search optimum value, information regarding the end of the search, the remaining number of searches, or a global optimum value (prospect), and each of these may be treated as information separate from the progress status. Note that the information regarding the end of the search may be any form of information indicating the end of the search, such as the time remaining until the end of the search, the end time of the parameter search, or the remaining search percentage. Note that the progress status will be described in more detail later. The progress information indicating the progress of the search acquired by the search progress acquisition unit 13 is output to the display unit 14 and the search parameter generation unit 15 .

[0023] 1, the search progress acquisition unit 13 includes a function class identification unit 131, a search progress calculation unit 132, and a search progress storage unit 133. The search progress acquisition unit 13 may also include an output control unit (not shown) that controls the output of progress information to the display unit 14.

[0024] The function class identification unit 131 identifies a function class of the evaluation value based on the evaluation value and the corresponding parameter search point acquired by the parameter evaluation unit 11, and the evaluation value and the corresponding parameter candidate search point predicted by the machine learning unit 12. At this time, the function class identification unit 131 identifies the function class of the evaluation value from a set of function classes for which global optimality is guaranteed. Information indicating the function class identified by this function class identification unit 131 is output to the search progress calculation unit 132.

[0025] The search progress calculation unit 132 calculates the progress of the search based on the evaluation value and corresponding parameters acquired by the parameter evaluation unit 11, the evaluation value predicted by the machine learning unit 12 and the search candidate points of the corresponding parameters, and the function class identified by the function class identification unit 131. Progress information indicating the progress of the search calculated by this search progress calculation unit 132 is output to the search progress storage unit 133.

[0026] The search progress storage unit 133 stores progress information indicating the progress of the search calculated by the search progress calculation unit 132. The progress information indicating the progress of the search stored in the search progress storage unit 133 is read out by the display unit 14 and the search parameter generation unit 15.

[0027] 1 illustrates a case where the search progress status storage unit 133 is provided inside the parameter optimization device 1. However, the present invention is not limited to this, and the search progress status storage unit 133 may be provided outside the parameter optimization device 1.

[0028] The display unit 14 displays progress information indicating the progress of the search based on the progress information indicating the progress of the search acquired by the search progress acquisition unit 13 .

[0029] 1 shows a case where the display unit 14 is provided inside the parameter optimization device 1. However, this is not limiting, and the display unit 14 may be provided outside the parameter optimization device 1. Furthermore, in the parameter optimization device 1 according to embodiment 1, the display unit 14 is not an essential component, and the display unit 14 may not be provided.

[0030] The search parameter generation unit 15 determines the next parameter search point in the parameter evaluation unit 11 based on progress information indicating the progress of the search acquired by the search progress acquisition unit 13. Information indicating the parameters determined by the search parameter generation unit 15 is output as a command value to the parameter evaluation unit 11. The parameter evaluation unit 11 then repeats the above operation based on the parameters included in the command value from the search parameter generation unit 15.

[0031] As shown in FIG. 1, the search parameter generating unit 15 includes a search end determining unit 151, a search parameter calculating unit 152, and an action command generating unit 153.

[0032] The search termination determination unit 151 determines whether to terminate the search based on progress information indicating the progress of the search acquired by the search progress acquisition unit 13 .

[0033] When the search end determination unit 151 determines not to end the search, that is, to continue the search, the search parameter calculation unit 152 determines the search point of the next parameter. Information indicating the parameter determined by this search parameter calculation unit 152 is output to the action command generation unit 153.

[0034] The motion command generation unit 153 generates a command value for the motion unit 111 based on the parameters determined by the search parameter calculation unit 152. The command value generated by the motion command generation unit 153 is output to the parameter evaluation unit 11 (motion unit 111).

[0035] Next, an example of the hardware configuration of the parameter optimization device 1 according to the first embodiment will be described with reference to Fig. 2 . The display unit 14 in the parameter optimization device 1 is a display 101. The functions of the parameter evaluation unit 11, the machine learning unit 12, the search progress acquisition unit 13, and the search parameter generation unit 15 in the parameter optimization device 1 are realized by a processing circuit 102. As shown in Fig. 2 , the processing circuit 102 is a CPU (also referred to as a central processing unit, processing device, arithmetic unit, microprocessor, microcomputer, processor, or DSP (Digital Signal Processor)) that executes a program stored in a memory 104 or a storage medium 105. The parameter optimization device 1 also includes a communication interface 103 for the optimization target.

[0036] The functions of the parameter evaluation unit 11, the machine learning unit 12, the search progress acquisition unit 13, and the search parameter generation unit 15 are realized by software, firmware, or a combination of software and firmware. The software and firmware are written as programs and stored in the memory 104 or the storage medium 105. The processing circuit 102 realizes the functions of each unit by reading and executing the programs stored in the memory 104 or the storage medium 105. That is, the parameter optimization device 1 includes the memory 104 or the storage medium 105 for storing a program that, when executed by the processing circuit 102, results in the execution of, for example, each step shown in FIG. 3 described below. Furthermore, these programs can also be said to cause a computer to execute the procedures and methods of the parameter evaluation unit 11, the machine learning unit 12, the search progress acquisition unit 13, and the search parameter generation unit 15. Here, the memory 104 may be, for example, a random access memory (RAM) or a read-only memory (ROM). The storage medium 105 may be a hard disk drive (HDD) or a solid state drive (SSD).

[0037] As described above, the memory 104 or storage medium 105 storing the programs realizing the functions of the parameter evaluation unit 11, the machine learning unit 12, the search progress status acquisition unit 13, and the search parameter generation unit 15 may be provided separately for each unit. For example, two servers may be located remotely, with one server having a memory or storage medium storing programs realizing the functions of the machine learning unit 12 and the search progress status acquisition unit 13, and the other server having a memory or storage medium storing programs realizing the functions of the parameter evaluation unit 11 and the search parameter generation unit 15. The above is just one example, and any configuration is possible. For example, a configuration may be adopted in which a server is provided for each memory or storage medium that stores a program realizing each function.

[0038] Next, an example of the operation of the parameter optimization device 1 according to the first embodiment shown in Fig. 1 will be described with reference to Fig. 3. In the example of the operation of the parameter optimization device 1 according to the first embodiment shown in Fig. 1, the parameter optimization device 1 first determines an initial point as a search point for parameters (step ST101), as shown in Fig. 3. Here, the initial point may be random, or if a point with a good evaluation value is known in advance, that point may be used as the initial point.

[0039] Next, the parameter evaluation unit 11 acquires an evaluation value for the parameter search point based on the determined parameter search point (step ST102). That is, first, the operation unit 111 operates the optimization target at the parameter search point based on the determined parameter search point. Next, the evaluation value calculation unit 112 calculates an evaluation value for the parameter search point used by the operation unit 111 based on the operation result of the optimization target by the operation unit 111.

[0040] The operation results of the optimization target obtained by the operation unit 111 include, for example, information such as parameters set in the machine, machine configuration, machine-specific values ​​such as operation mode, operation log data, etc. Furthermore, this information is obtained from the machine via, for example, an encoder or the like.

[0041] For example, values ​​measured by a sensor installed in the machine may be directly used as this information, or values ​​calculated based on the values ​​measured by the sensor may be used. Examples of the sensor include a temperature sensor, a pressure sensor, an acceleration sensor, a gyro sensor, and a humidity sensor. The evaluation value calculation unit 112 then calculates the evaluation value based on the information obtained by the operation unit 111 as described above.

[0042] The evaluation value calculated by the evaluation value calculation unit 112 uses at least one value to be maximized or minimized. Here, the target is a maximization problem, but in the case of a minimization problem, the sign of the evaluation value can be inverted. Furthermore, when there are multiple evaluation values, each may be calculated as an evaluation value, or they may be combined into a single evaluation value by weighted sum or the like. Furthermore, an index showing how close to a certain target value it is may be used as the evaluation value. For example, if there is a target value for the operating speed when a mechanical device operates, evaluation value = - (actually measured operating speed - target operating speed) ２ Then, we calculate the evaluation value and search for the parameter values ​​that maximize this evaluation value.

[0043] Next, the searched data storage unit 113 stores the evaluation value calculated by the evaluation value calculation unit 112 and information indicating the search point of the corresponding parameter as searched data (step ST103).

[0044] Next, the machine learning unit 12 learns the relationship between the evaluation value and the parameter using a machine learning model based on the evaluation value acquired by the parameter evaluation unit 11 and the search point of the corresponding parameter (step ST104).

[0045] The machine learning unit 12 uses one or more of the following methods as the machine learning model: linear regression, generalized linear model, Gaussian process regression, hierarchical Bayes model, neural network, neural process, random forest, gradient boosting tree, etc. When the number of dimensions to be input to the machine learning model, such as the number of parameters, becomes large, the machine learning unit 12 may use dimension reduction methods such as principal component analysis, singular value decomposition, tensor decomposition, or auto encoder, and input the dimension-reduced values ​​to the machine learning model.

[0046] Here, the searched data is D ｔ The parameter obtained after the search count (t) is x ｔ The state quantity indicating the state of the mechanical device, not the parameter, is s ｔ Let the evaluation value be y ｔ Then, the searched data (D ｔ) is expressed by the following formula (1). Then, the machine learning unit 12 uses this searched data (D ｔ ) is used to train the machine learning model. ｔ ) as the parameter (x ｔ ) and the evaluation value (y ｔ ) is essential, but the state quantity (s ｔ ) is not limited to this.

[0047] For example, when Gaussian process regression is used as a machine learning model, the evaluation value (y), which is the predicted result for a certain parameter (x), is calculated based on the searched data (D ｔ ) and the hyperparameter (θ) of the machine learning model, it can be expressed by the following equation (2), and the machine learning model can be constructed.

[0048] Also, for example, when a neural network or neural process is used as a machine learning model, the searched data (D ｔ ) of the n data obtained in mini-batches, the parameters are set to X = {x, ..., x ｎ}, and the evaluation value is Y={y, . . . , y ｎ}, the machine learning model is f(·), and the parameter of the machine learning model is θ, the loss function (L) is calculated by the following formula (3). Then, the machine learning unit 12 performs learning by updating the parameter (θ) of the machine learning model using an optimization method such as stochastic gradient descent (SGD).

[0049] Next, the machine learning unit 12 predicts the evaluation value of the parameter for the search candidate point using the machine learning model (step ST105).

[0050] Here, the machine learning unit 12 may generate the candidate search points (x (hat)) for the parameters, for example, randomly, or if the maximum or minimum value of the parameter is known, may generate them at lattice points based on these, or may generate them using experimental design.

[0051] Next, the function class identification unit 131 identifies a function class of the evaluation value based on the evaluation value and the corresponding parameter search point acquired by the parameter evaluation unit 11, and the evaluation value and the corresponding parameter candidate search point predicted by the machine learning unit 12 (step ST106). At this time, the function class identification unit 131 identifies a function class of the evaluation value from a set of function classes for which global optimality is guaranteed.

[0052] The function class for which global optimality is guaranteed and identified by the function class identification unit 131 includes, but is not limited to, Lipschitz continuous functions or convex functions.

[0053] The function class identification unit 131 uses the prediction results from the machine learning unit 12 and the searched data (D ｔ ) to determine whether the function class is applicable, starting from the function class with looser conditions, and thereby identify the function class. For example, consider a case where the function class candidates are two, a convex function and a Lipschitz continuous function. In this case, the conditions for a Lipschitz continuous function are looser than those for a convex function. Therefore, first, the function class identification unit 131 assumes that the objective function is a Lipschitz continuous function. Next, the function class identification unit 131 calculates the prediction result by the machine learning unit 12 and the searched data (D ｔ ) satisfies the condition of a convex function. In equation (4), the gradient of the objective function, ∇f(x ｉ ) is estimated from the prediction result by the machine learning unit 12. Then, the function class identification unit 131 determines that the objective function is a convex function if it determines that the convexity condition is satisfied, and determines that the objective function is a Lipschitz continuous function if it determines that the convexity condition is not satisfied, and identifies the function class.

[0054] Next, the search progress calculation unit 132 calculates the theoretical upper limit based on the function class identified by the function class identification unit 131 (step ST107).

[0055] For example, if the parameter and evaluation value function is specified as a Lipschitz continuous function, the theoretical upper limit U ｆ(x) can be calculated by the following formula (5). In formula (5), l is the Lipschitz constant. When calculating the Lipschitz constant from a machine learning model, for example, a value that maximizes the differential value calculated by forward difference from y(x(hat)) and y(x(hat)+Δx), which are inference results for x(hat) and x(hat)+Δx, which are a small change from x(hat) by Δx, may be used, or the value that maximizes the differential value calculated by forward difference from searched data (D ｔ ) may also be calculated.

[0056] Next, the search progress calculation unit 132 calculates the progress of the search based on the evaluation values ​​and corresponding parameters acquired by the parameter evaluation unit 11, the evaluation values ​​predicted by the machine learning unit 12 and the search candidate points of the corresponding parameters, and the calculated theoretical upper limit (step ST108). The following describes a case in which the search progress calculation unit 132 calculates the search optimum value, search progress rate, progress rate based on the evaluation value, remaining time, remaining number of searches, and global optimum value (prospect) as the search progress. As described above, the search optimum value, information regarding the end of the search, remaining number of searches, and global optimum value (prospect) may be treated as information separate from the progress status, or may be included in the progress status.

[0057] First, as shown in FIG. 4, the search progress calculation unit 132 calculates the best evaluation value among the evaluation values ​​for the search points of the searched parameters as the in-search optimum value (y ｂｅｓｔ ) In FIG. 4, the black dots indicate the search points of the parameters, and the dashed dotted line indicates the optimum value (y ｂｅｓｔ ) is shown.

[0058] In addition, the search progress calculation unit 132 calculates the theoretical upper limit and the optimum value within the search (y ｂｅｓｔ) and the region where the theoretical upper limit is exceeded is determined to be the range where the global optimum exists. Note that the search space is a space consisting of upper and lower limit values ​​or possible values ​​of each parameter specified by the user when optimizing the parameters. In addition, in FIG. 4, the dotted line indicates the theoretical upper limit when the function class identified by the function class identification unit 131 is a Lipschitz continuous function, and the shaded portion in the search space indicates the range where the global optimum exists. Specifically, when the search space is X, the range where the global optimum exists is calculated using the following formula (6). However, if it is difficult to calculate the range due to computational resources, the number (n) of search points where the theoretical upper limit is exceeded may be used instead of the range.

[0059] Furthermore, the search progress rate (PR [%]) can be calculated for N search candidate points using the following equations (7) and (8).

[0060] In addition, the remaining time (T ｒ ) and the remaining number of searches (t ｒ ) may be calculated from the following formulas (9) and (10), where t is the number of searches performed up to that point, T is the required search time, and n is the number of search points that exceed the theoretical upper limit. Alternatively, as shown in FIG. 4, for example, by simulating the change in the theoretical upper limit when the search is continued, the number of searches until the search progress rate (PR [%]) reaches 100% can be calculated as the remaining number of searches (t ｒ ) and the remaining time (T ｒ ) may be calculated.

[0061] Also, the global optimum (prospect) (f ＊ ) is the maximum theoretical upper limit, and can be calculated using the following formula (11).

[0062] Next, the display unit 14 displays progress information indicating the progress of the search based on the progress information indicating the progress of the search acquired by the search progress acquisition unit 13 (step ST109). Here, the progress information displayed by the display unit 14 may be output under the control of the output control unit included in the search progress acquisition unit 13 described above. The display unit 14 may display the information shown in FIG. 4 . That is, the display unit 14 may display at least one of the search points, true objective function, theoretical upper limit, search space, and range of existence of the global optimum, which are included in FIG. 4 . By displaying this information, the user can confirm the current search status. Furthermore, by displaying the theoretical upper limit or range of existence of the global optimum, the user can visually confirm the evaluation value or existence of the optimum value.

[0063] 5, the display unit 14 displays the progress of the search, including the calculated intra-search optimum, search progress rate, remaining time, remaining search time, and global optimum (prospect), as well as the evaluation values ​​for the initial parameter points and information indicating the ratio of the intra-search optimum to the global optimum. Note that, as mentioned above, the progress does not have to include all of this information.

[0064] The in-search optimum value is the highest evaluated value found in the current search. Note that the in-search optimum value may result in a higher evaluation than normal for the search point due to noise, etc. Therefore, the in-search optimum value may be the average value of multiple evaluation values ​​among the currently searched high evaluation values, or may be calculated using other calculation methods, and may be a value that is close to or indicates the maximum value among the searched evaluation values.

[0065] The search progress rate is shown using a bar graph 1401 in Fig. 5. When the diagonally shaded portion of the bar graph 1401 shown in Fig. 5 reaches the right end, it indicates that the search progress rate is 100%. Note that in Fig. 5, the search progress rate is shown using the bar graph 1401, but it is also possible to display only the progress rate percentage (62% in Fig. 5), or to display both the bar graph 1401 and the percentage.

[0066] In FIG. 5 , the upper bar graph 1401 indicates the search progress rate at the search point, and the lower bar graph 1402 indicates the progress status based on the evaluation value of the search point. In the bar graph 1402 in FIG. 5 , the position 1404 of the black dot 1403 indicates the current search optimum value, and the left end 1405 of the bar graph 1402 indicates the evaluation value evaluated at the search point at the beginning of the search. The right end 1406 of the bar graph 1402 indicates the calculated, predicted global optimum value. This global optimum value may be a specific value; in FIG. 5 , 120 is shown as an example of the predicted global optimum value. This bar graph 1402 allows for comparison and overview of the extent to which the evaluation value currently being searched (search optimum value) is, relative to the predicted maximum value. Furthermore, the bar graph 1402 in FIG. 5 also allows for the confirmation of the ratio of the search optimum value to the global optimum value. Although not shown in FIG. 5 , the percentage of the search optimum value may be specifically shown. For example, if the global optimum value is 120 and the search optimum value is 60, a value such as 50% or 50 may be displayed on the display unit 14. Note that, since the evaluation value may be calculated as a negative value, the percentage may be calculated by dividing the value obtained by subtracting the initial value from the search optimum value by the value obtained by subtracting the initial value from the global optimum value. In the example of FIG. 5 , the percentage is 0.736, which is calculated by dividing 91-10 (the value obtained by subtracting the initial value from the search optimum value) by 120-10 (the global optimum value minus the initial value). In this way, as shown in FIG. 5 , the progress rate may be displayed based on the evaluation value of the search point.

[0067] Furthermore, as shown in FIG. 5 , both the search progress rate (e.g., a bar graph or a percentage) and the progress rate relative to the evaluation value of the search point (e.g., a bar graph or a percentage) may be displayed on the display unit 14. Although the search progress rate and the progress rate relative to the evaluation value of the search point both indicate progress, they may take different values, as shown in FIG. 5 , because they are based on different standards for progress. These values ​​can be used as a reference for determining whether to terminate the search, as described below. As an example, the search progress rate shown in FIG. 5 is 62%, while the progress rate relative to the evaluation value of the search point is approximately 74% based on the above calculation, which are different from each other. According to these values ​​or the bar graph showing this percentage, although only about half of the searchable search points have been explored, a relatively large optimal value, approximately 74% of the theoretically predicted value, has been found. In light of this situation, the user may, for example, determine that only about half of the searchable search points have been explored, but that a search point with a sufficient evaluation value has been found, and the user or the parameter optimization device 1 may terminate the search, as described in the following embodiment. By presenting both pieces of information in this way, it becomes possible to determine the appropriate timing to end the search.

[0068] Next, the search end determination unit 151 determines whether to continue the search, that is, whether to not end the search, based on the progress of the search acquired by the search progress acquisition unit 13 (step ST110).

[0069] In this case, for example, the search termination determination unit 151 may determine to terminate the search when the in-search optimal value reaches a desired value. Furthermore, for example, the search termination determination unit 151 may determine to terminate the search when the search progress rate reaches 100%. Furthermore, for example, the search termination determination unit 151 may determine to terminate the search when it determines that the in-search optimal value has reached a global optimal value (prospect).

[0070] If the search termination determination unit 151 determines in step ST110 that the search should be continued, the search parameter calculation unit 152 determines the search point for the next parameter, and the operation command generation unit 153 generates a command value for the operation unit 111 based on the parameters determined by the search parameter calculation unit 152 (step ST111). Thereafter, the sequence returns to step ST102. The parameter evaluation unit 11 then repeats the above operation based on the parameters included in the command value from the search parameter generation unit 15.

[0071] When Bayesian optimization is used as a method for determining the next parameter search point, the next search point can be determined by calculating a value called an acquisition function. Typical examples of this calculation method include Upper Confidence Bound (UCB) and Expected Improvement (EI).

[0072] Using the mean (μ(x(hat))) and standard deviation (σ(x(hat))) of the prediction results of Gaussian process regression for the candidate point (x(hat)) of the parameter to be searched, UCB is expressed by the following formula (12). Here, κ is a hyperparameter, and as it increases, the tendency to search for parameters that have not been searched for increases.

[0073] EI is the optimum value in the search obtained at a certain point in time, y ｂｅｓｔ Then, it is defined by the following equations (13) and (14): where Φ(Z) and φ(Z) are the cumulative distribution function and probability density function of the standard normal distribution.

[0074] Then, the search parameter calculation unit 152 can determine the point at which the value of these acquisition functions is the largest as the search point for the next parameter.

[0075] On the other hand, if the search end determination section 151 determines in step ST110 not to continue the search, that is, to end the search, the sequence ends.

[0076] As described above, according to the first embodiment, the information processing device includes a machine learning unit 12 that learns the relationship between evaluation values ​​and parameters based on the search points of the parameters and the evaluation values ​​of the search points, and predicts evaluation values ​​for the parameter candidate search points, and a search progress acquisition unit 13 that acquires progress information indicating the progress of the search based on the search points, the evaluation values ​​of the search points, the search candidate points, and the evaluation values ​​of the search candidate points predicted by the machine learning unit 12. Also, according to the first embodiment, the information processing device includes a parameter evaluation unit 11 that acquires evaluation values ​​of the search points based on the determined search points. Also, according to the first embodiment, the information processing device includes a parameter evaluation unit 11 that includes an operation unit 111 that operates the target at the determined next search point, and an evaluation value calculation unit 112 that calculates the evaluation value of the next search point based on the operation result of the operation unit 111. As a result, the information processing device according to the first embodiment can acquire information to refer to whether to continue or end the parameter search.

[0077] Furthermore, according to the first embodiment, the information processing device includes a search parameter generation unit 15 that determines the next search point, which is the search point for the parameter to be searched next, based on the progress information acquired by the search progress acquisition unit 13. This allows the information processing device according to the first embodiment to end the search at a more appropriate timing than conventional devices. As a result, the information processing device according to the first embodiment can reduce the parameter search time compared to conventional devices.

[0078] Moreover, according to the first embodiment, the information processing device includes an output control unit that controls output of the acquired progress information to the display unit 14. Moreover, according to the first embodiment, the information processing device includes the display unit 14. As a result, the information processing device according to the first embodiment allows the user to grasp information that can be used as a reference for deciding whether to continue or end the parameter search.

[0079] Furthermore, according to the first embodiment, the search progress acquisition unit 13 provided in the information processing device includes a function class identification unit 131 that identifies a function class of evaluation values ​​from a set of function classes based on the search points, the evaluation values ​​of the search points, the candidate search points, and the evaluation values ​​of the candidate search points predicted by the machine learning unit 12, and a search progress calculation unit 132 that calculates the progress of the search based on the search points, the evaluation values ​​of the search points, the candidate search points, the evaluation values ​​of the candidate search points predicted by the machine learning unit 12, and the function class. Also, according to the first embodiment, the function classes are functions for which global optimality is guaranteed. As a result, the information processing device according to the first embodiment can avoid convergence to local optima and obtain a global optimum.

[0080] Moreover, according to the first embodiment, the information processing method includes the steps of: learning the relationship between the evaluation values ​​and the parameters based on the search points of the parameters and the evaluation values ​​of the search points; and predicting the evaluation values ​​of the parameter for the candidate search points by the machine learning unit 12; and acquiring, by the search progress acquisition unit 13, progress information indicating the progress of the search based on the search points, the evaluation values ​​of the search points, the candidate search points, and the evaluation values ​​of the candidate search points predicted by the machine learning unit 12. In this way, the information processing method according to the first embodiment makes it possible to acquire information to be used as a reference for deciding whether to continue or end the search of the parameters.

[0081] Furthermore, according to the first embodiment, the program causes a computer to execute the following processes: learning the relationship between the evaluation values ​​and the parameters based on the search points of the parameters and the evaluation values ​​of the search points, and predicting the evaluation values ​​of the parameters for the candidate search points; and acquiring progress information indicating the progress of the search based on the search points, the evaluation values ​​of the search points, the candidate search points, and the predicted evaluation values ​​of the candidate search points. As a result, the program according to the first embodiment makes it possible to acquire information to refer to whether to continue or end the parameter search.

[0082] Furthermore, according to the first embodiment, the display device includes an acquisition unit that acquires progress information indicating the progress of the search for optimal parameters by the parameter optimization device 1, which evaluates parameters to be optimized and searches for optimal parameters, and a display unit 14 that displays the progress information. Furthermore, according to the first embodiment, the acquisition unit included in the display device acquires evaluation values ​​for the search points based on the determined parameter search points, the parameter optimization device 1 learns a relationship between the evaluation values ​​and the parameters based on the search points and the evaluation values ​​of the search points, the parameter optimization device 1 predicts evaluation values ​​for the parameter search candidate points based on the learned relationship, and acquires the progress information calculated by the parameter optimization device 1 based on the search points, the evaluation values ​​of the search points, the search candidate points, and the predicted evaluation values ​​of the search candidate points. As a result, the display device according to the first embodiment allows the user to grasp information that can be used as a reference for deciding whether to continue or end the parameter search.

[0083] Moreover, according to the first embodiment, the progress information includes information indicating the progress of the search for the parameter search points, and the display unit 14 displays the information indicating the progress of the search for the search points. Moreover, according to the first embodiment, the progress information includes information indicating the progress based on an in-search optimum value among the evaluation values ​​searched by the parameter optimization device 1 and an expected maximum evaluation value among the entire search by the parameter optimization device 1, and the display unit 14 displays the information indicating the progress based on the in-search optimum value among the evaluation values ​​searched by the parameter optimization device 1 and an expected maximum evaluation value among the entire search by the parameter optimization device 1. Moreover, according to the first embodiment, the progress information includes information indicating a percentage of the entire parameter search for which the parameter search has been completed, and the display unit 14 displays the information indicating the percentage of the parameter search for which the parameter search has been completed. Moreover, according to the first embodiment, the progress information includes information regarding the end of the parameter search, and the display unit 14 displays the information regarding the search end. Moreover, according to the first embodiment, the information regarding the search end includes the remaining time until the parameter search is completed or the end time of the parameter search based on the progress information. Moreover, according to the first embodiment, the progress information includes information regarding the remaining number of searches in the parameter search, and the display unit 14 displays the information regarding the remaining number of searches. Moreover, according to the first embodiment, the progress information includes an in-search optimum value among the evaluation values ​​searched by the parameter optimization device 1, and the display unit 14 displays the in-search optimum value. Moreover, according to the first embodiment, the progress information includes information indicating the maximum evaluation value predicted by the parameter optimization device 1 among the entire search performed by the parameter optimization device 1, and the display unit 14 displays the information indicating the predicted maximum evaluation value. Moreover, according to the first embodiment, the progress information includes information indicating the ratio of the in-search optimum value to the predicted maximum evaluation value, and the display unit 14 displays information indicating the ratio of the in-search optimum value to the predicted maximum evaluation value based on the progress information. As a result, the display device according to the first embodiment allows the user to grasp information that can be used as a reference for deciding whether to continue or terminate the parameter search.

[0084] Moreover, according to the first embodiment, the display method includes a step of acquiring, by an acquisition unit, progress information indicating the progress of the search for optimal parameters by the parameter optimization device 1, which evaluates parameters to be optimized and searches for optimal parameters, and a step of displaying the progress information by the display unit 14. As a result, the display method according to the first embodiment allows the user to grasp information that can be used as a reference for deciding whether to continue or terminate the search for parameters.

[0085] Furthermore, according to the first embodiment, the program causes a computer to execute a process of acquiring progress information indicating the progress of the search for optimal parameters by the parameter optimization device 1, which evaluates parameters to be optimized and searches for optimal parameters, and a process of displaying the progress information. As a result, the display method according to the first embodiment allows the user to grasp information that can be used as a reference for deciding whether to continue or terminate the search for parameters.

[0086] Embodiment 2 In the parameter optimization device 1 according to embodiment 1, the case where the search termination determination unit 151 automatically determines whether to terminate the search has been described. In contrast, in the parameter optimization device 1 according to embodiment 2, a case where the user manually determines whether to terminate the search after checking the progress of the search will be described.

[0087] Figure 6 is a diagram showing an example of the configuration of a parameter optimization device 1 according to embodiment 2. In the parameter optimization device 1 according to embodiment 2 shown in Figure 6, the configuration of the display unit 14 is changed and the search end determination unit 151 is changed to a search end determination unit 151b, compared to the parameter optimization device 1 according to embodiment 1 shown in Figure 1. The other example of the configuration of the parameter optimization device 1 according to embodiment 2 shown in Figure 6 is the same as the example of the configuration of the parameter optimization device 1 according to embodiment 1 shown in Figure 1, and the same reference numerals are used and only the different parts will be described.

[0088] In addition, when the user manually determines whether to end the search as in embodiment 2, the progress of the search may include, for example, one or more of the search progress rate, the optimum value within the search, the remaining time, the number of remaining searches, or the global optimum value (prospect).

[0089] As shown in FIG. 6, the display unit 14 in the second embodiment includes a search status display control unit 141 and a search end decision input unit 142 .

[0090] The search status display control unit 141 controls the display of information indicating the search progress status based on the search progress status acquired by the search progress status acquisition unit 13. The function of this search status display control unit 141 is the same as the function of the display unit 14 in the first embodiment.

[0091] The search termination determination input unit 142 receives an input from the user indicating whether or not to terminate the search. Information indicating the input received by the search termination determination input unit 142 is output to the search parameter generation unit 15 (search termination determination unit 151b).

[0092] 6 shows a case where the display unit 14 is provided inside the parameter optimization device 1. However, this is not limiting, and the display unit 14 may be provided outside the parameter optimization device 1, which is the same as in the first embodiment.

[0093] The search end determination unit 151b determines whether or not to end the search based on the input received by the display unit 14.

[0094] When the search end determination unit 151b determines not to end the search, that is, to continue the search, the search parameter calculation unit 152 in the second embodiment determines the search point of the next parameter.

[0095] Next, an example of the operation of the parameter optimization device 1 according to the second embodiment shown in Fig. 6 will be described with reference to Fig. 7. In the example of the operation of the parameter optimization device 1 according to the second embodiment shown in Fig. 6, as shown in Fig. 7, for example, the parameter optimization device 1 first determines an initial point as a search point for parameters (step ST201).

[0096] Next, the parameter evaluation unit 11 acquires an evaluation value for the parameter search point based on the determined parameter search point (step ST202). That is, first, the operation unit 111 operates the optimization target at the parameter search point based on the determined parameter search point. Next, the evaluation value calculation unit 112 calculates an evaluation value for the parameter search point used by the operation unit 111 based on the operation result of the optimization target by the operation unit 111.

[0097] Next, the searched data storage unit 113 stores the evaluation value calculated by the evaluation value calculation unit 112 and information indicating the search point of the corresponding parameter as searched data (step ST203).

[0098] Next, the machine learning unit 12 learns the relationship between the evaluation value and the parameter using a machine learning model based on the evaluation value acquired by the parameter evaluation unit 11 and the search point of the corresponding parameter (step ST204).

[0099] Next, the machine learning unit 12 predicts the evaluation value of the parameter for the search candidate point using the machine learning model (step ST205).

[0100] Next, the function class identification unit 131 identifies a function class of the evaluation value based on the evaluation value and the corresponding parameter search point acquired by the parameter evaluation unit 11, and the evaluation value and the corresponding parameter candidate search point predicted by the machine learning unit 12 (step ST206). At this time, the function class identification unit 131 identifies a function class of the evaluation value from a set of function classes for which global optimality is guaranteed.

[0101] Next, the search progress calculation section 132 calculates the theoretical upper limit based on the function class identified by the function class identification section 131 (step ST207).

[0102] Next, the search progress calculation unit 132 calculates the progress of the search based on the evaluation value and corresponding parameters obtained by the parameter evaluation unit 11, the search candidate points of the evaluation value and corresponding parameters predicted by the machine learning unit 12, and the calculated theoretical upper limit value (step ST208).

[0103] Next, the search status display control unit 141 displays progress information indicating the progress of the search based on the progress information indicating the progress of the search acquired by the search progress acquisition unit 13 (step ST209).

[0104] Next, the search end decision input unit 142 receives an input from the user indicating whether or not to end the search (step ST210).

[0105] In the display unit 14 of the second embodiment, as shown in Fig. 8, in addition to displaying progress information showing the progress of the search as shown in Fig. 5 of the first embodiment, a display for determining whether to continue or end the search is also provided. In the case of Fig. 8, the user selects either the "Continue Search" button or the "End Search" button, and the search end determination input unit 142 accepts the selection.

[0106] Next, the search end determination unit 151b determines whether to continue the search, that is, whether to not end the search, based on the input received by the display unit 14 (step ST211).

[0107] At this time, the search termination determination unit 151b determines to continue the search if the user makes an input indicating that the search should be continued, and determines to terminate the search if the user makes an input indicating that the search should be terminated. For example, in the case of Figure 8, the search termination determination unit 151b determines to continue the search if the user selects the "Continue Search" button, and determines to terminate the search if the user selects the "End Search" button.

[0108] If the search termination determination unit 151b determines in step ST211 that the search should be continued, the search parameter calculation unit 152 determines the search point for the next parameter, and the operation command generation unit 153 generates a command value for the operation unit 111 based on the parameters determined by the search parameter calculation unit 152 (step ST212). The sequence then returns to step ST202. The parameter evaluation unit 11 then repeats the above operation based on the parameters included in the command value from the search parameter generation unit 15.

[0109] On the other hand, if the search end determination unit 151b determines in step ST211 not to continue the search, that is, to end the search, the sequence ends.

[0110] As described above, according to the second embodiment, the information processing device includes a search parameter generation unit 15 that determines the next search point, which is the search point for the next parameter to be searched, based on the progress information acquired by the search progress acquisition unit 13, based on whether the user has made an input indicating that the parameter search should be terminated, or based on whether the user has made an input indicating that the parameter search should be continued. Furthermore, according to the second embodiment, the display unit 14 included in the information processing device displays information accepting an input to terminate the search. As a result, the information processing device according to the second embodiment allows the user to terminate the search at an appropriate timing, unlike the first embodiment. As a result, the information processing device according to the second embodiment can reduce the parameter search time compared to conventional devices.

[0111] Furthermore, according to the second embodiment, the display unit 14 of the display device displays information for accepting an input to terminate or continue the search by the parameter optimization device 1. As a result, the display device according to the second embodiment allows the user to terminate the search at an appropriate timing, unlike the first embodiment. As a result, the display device according to the second embodiment can reduce the parameter search time compared to the conventional display device.

[0112] Embodiment 3. In the parameter optimization device 1 according to embodiment 1, a case has been described in which the search termination determination unit 151 automatically determines whether to terminate the search, while in the parameter optimization device 1 according to embodiment 2, a case has been described in which the user manually determines whether to terminate the search. In contrast, in the parameter optimization device 1 according to embodiment 3, a case in which the determination of whether to terminate the search can be switched between automatic and manual is described.

[0113] Fig. 9 is a diagram showing an example of the configuration of a parameter optimization device 1 according to embodiment 3. In the parameter optimization device 1 according to embodiment 3 shown in Fig. 9, the search end determination input unit 142 is changed to a search end determination input unit 142b, and the search end determination unit 151b is changed to a search end determination unit 151c, compared to the parameter optimization device 1 according to embodiment 2 shown in Fig. 6. The other example of the configuration of the parameter optimization device 1 according to embodiment 3 shown in Fig. 9 is similar to the example of the configuration of the parameter optimization device 1 according to embodiment 2 shown in Fig. 6, and the same reference numerals are used and only the different parts will be described.

[0114] The search termination determination input unit 142b accepts a user input indicating whether to terminate the search when the search termination determination is set to be performed manually. The search termination determination input unit 142b may also accept an input indicating whether the user sets whether to perform the search termination determination automatically or manually. Information indicating the input accepted by the search termination determination input unit 142b is output to the search parameter generation unit 15 (search termination determination unit 151c).

[0115] In addition, when the search termination determination input unit 142b receives input indicating whether the search termination determination is to be performed automatically or manually, the parameter optimization device 1 updates the setting of whether the search termination determination is to be performed automatically or manually in accordance with the input.

[0116] The search termination determination unit 151c determines whether to terminate the search based on information indicating whether the search termination determination is to be performed automatically or manually, as well as the search progress status acquired by the search progress status acquisition unit 13, or input indicating whether to terminate the search received by the search termination determination input unit 142b.

[0117] In this case, the search termination determination unit 151c first confirms whether the search termination determination is set to automatic or manual based on information indicating whether the search termination determination is set to automatic or manual. Here, if the search termination determination unit 151c confirms that the search termination determination is set to automatic, it determines whether to terminate the search based on the search progress status acquired by the search progress acquisition unit 13. That is, in this case, the search termination determination unit 151c makes the above determination by operating in the same manner as the search termination determination unit 151 in embodiment 1. On the other hand, if the search termination determination unit 151c confirms that the search termination determination is set to manual, it determines whether to terminate the search based on an input indicating whether to terminate the search received by the display unit 14. That is, in this case, the search termination determination unit 151c makes the above determination by operating in the same manner as the search termination determination unit 151b in embodiment 2.

[0118] When the search end determination unit 151c determines not to end the search, that is, to continue the search, the search parameter calculation unit 152 in the third embodiment determines the search point for the next parameter.

[0119] Next, an example of the operation of the parameter optimization device 1 according to the third embodiment shown in Fig. 9 will be described with reference to Fig. 10. In the example of the operation of the parameter optimization device 1 according to the third embodiment shown in Fig. 9, as shown in Fig. 10, for example, the parameter optimization device 1 first determines an initial point as a search point for parameters (step ST301).

[0120] Next, the parameter evaluation unit 11 acquires an evaluation value for the parameter search point based on the determined parameter search point (step ST302). That is, first, the operation unit 111 operates the optimization target at the parameter search point based on the determined parameter search point. Next, the evaluation value calculation unit 112 calculates an evaluation value for the parameter search point used by the operation unit 111 based on the operation result of the optimization target by the operation unit 111.

[0121] Next, the searched data storage unit 113 stores the evaluation value calculated by the evaluation value calculation unit 112 and information indicating the search point of the corresponding parameter as searched data (step ST303).

[0122] Next, the machine learning unit 12 learns the relationship between the evaluation value and the parameter using a machine learning model based on the evaluation value acquired by the parameter evaluation unit 11 and the search point of the corresponding parameter (step ST304).

[0123] Next, the machine learning unit 12 predicts the evaluation value of the parameter for the search candidate point using the machine learning model (step ST305).

[0124] Next, the function class identification unit 131 identifies a function class of the evaluation value based on the evaluation value and the corresponding parameter search point acquired by the parameter evaluation unit 11, and the evaluation value and the corresponding parameter search candidate point predicted by the machine learning unit 12 (step ST306). At this time, the function class identification unit 131 identifies a function class of the evaluation value from a set of function classes for which global optimality is guaranteed.

[0125] Next, the search progress calculation section 132 calculates the theoretical upper limit based on the function class identified by the function class identification section 131 (step ST307).

[0126] Next, the search progress calculation unit 132 calculates the progress of the search based on the evaluation value and corresponding parameters obtained by the parameter evaluation unit 11, the search candidate points of the evaluation value and corresponding parameters predicted by the machine learning unit 12, and the calculated theoretical upper limit value (step ST308).

[0127] Next, the search status display control unit 141 displays progress information indicating the progress of the search based on the progress information indicating the progress of the search acquired by the search progress acquisition unit 13 (step ST309).

[0128] Next, the search termination determination input unit 142b checks whether the search termination determination is set to be automatic, i.e., whether the auto mode is selected, based on information indicating whether the search termination determination is set to be automatic or manual (step ST310).

[0129] In the display unit 14 of the third embodiment, as shown in FIG. 11 , in addition to displaying progress information indicating the progress of the search as shown in FIG. 5 of the first embodiment, the display unit 14 also displays information for determining whether to perform automatic or manual determination and for determining whether to continue or terminate the search. In the case of FIG. 11 , either "manual mode" or "auto mode" is selected by default. The user can switch modes by selecting either the check box marked "manual mode" or the check box marked "auto mode." Note that the mode can be switched at any time during the search. In the case of FIG. 11 , when "manual mode" is selected, the user selects either the "continue search" button or the "end search" button.

[0130] In step ST310, if the search termination determination input unit 142b determines that the setting is not to automatically perform the search termination determination, that is, that the setting is to manually perform the search termination determination, it accepts an input from the user indicating whether or not to terminate the search (step ST311). On the other hand, in step ST310, if the search termination determination input unit 142b determines that the setting is to automatically perform the search termination determination, the sequence proceeds to step ST312.

[0131] Next, the search termination determination unit 151c determines whether to terminate the search based on information indicating whether the search termination determination is to be performed automatically or manually, as well as progress information indicating the progress of the search acquired by the search progress acquisition unit 13, or input indicating whether to terminate the search received by the search termination determination input unit 142b (step ST312).

[0132] Here, when the search termination determination unit 151c confirms that the setting is such that the search termination determination is performed automatically, it determines whether or not to terminate the search based on progress information indicating the progress of the search acquired by the search progress acquisition unit 13. That is, in this case, the search termination determination unit 151c makes the above determination by operating in the same manner as the search termination determination unit 151 in embodiment 1. On the other hand, when the search termination determination unit 151c confirms that the setting is such that the search termination determination is performed manually, it determines whether or not to terminate the search based on an input indicating whether or not to terminate the search, which is received by the display unit 14. That is, in this case, the search termination determination unit 151c makes the above determination by operating in the same manner as the search termination determination unit 151b in embodiment 2.

[0133] If the search termination determination unit 151c determines in step ST312 that the search should be continued, the search parameter calculation unit 152 determines the search point for the next parameter, and the operation command generation unit 153 generates a command value for the operation unit 111 based on the parameters determined by the search parameter calculation unit 152 (step ST313). The sequence then returns to step ST302. The parameter evaluation unit 11 then repeats the above operation based on the parameters included in the command value from the search parameter generation unit 15.

[0134] On the other hand, if the search end determination unit 151c determines in step ST312 not to continue the search, that is, to end the search, the sequence ends.

[0135] As described above, according to the third embodiment, the display unit 14 of the display device displays information for setting whether the termination of the search by the parameter optimization device 1 is to be determined by the user or by the parameter optimization device 1. As a result, in the display device according to the third embodiment, unlike the first and second embodiments, the user can select whether to automatically or manually determine the termination of the search, and it is possible to provide a method of determining the termination of the search that suits the user's preference.

[0136] Fourth Embodiment In a parameter optimization device 1 according to a fourth embodiment, a case will be described in which, in addition to the progress status of the search described in the third embodiment, an improvement probability indicating how much the next search point will improve the evaluation value is also acquired.

[0137] Fig. 12 is a diagram showing an example configuration of a parameter optimization device 1 according to embodiment 4. In the parameter optimization device 1 according to embodiment 4 shown in Fig. 12, the configuration of the machine learning unit 12 is changed compared to the parameter optimization device 1 according to embodiment 3 shown in Fig. 9, a rating value improvement probability calculation unit 134 and a rating value improvement probability storage unit 135 are added to the search progress status acquisition unit 13, and the search termination determination unit 151c is changed to a search termination determination unit 151d. The other example configuration of the parameter optimization device 1 according to embodiment 4 shown in Fig. 12 is similar to the example configuration of the parameter optimization device 1 according to embodiment 3 shown in Fig. 9, and the same reference numerals are used, and only the different parts will be described.

[0138] As shown in FIG. 12 , the machine learning unit 12 includes an evaluation value prediction unit 121 , an evaluation value prediction result storage unit 122 , an uncertainty prediction unit 123 , and an uncertainty prediction result storage unit 124 .

[0139] The evaluation value prediction unit 121 learns the relationship between the evaluation value and the parameter based on the evaluation value acquired by the parameter evaluation unit 11 and the search point of the corresponding parameter, and predicts the evaluation value for the search candidate point of the parameter. The function of this evaluation value prediction unit 121 is similar to the function of the machine learning unit 12 in Embodiment 3. Information indicating the evaluation value predicted by this evaluation value prediction unit 121 and the search candidate point of the corresponding parameter is output to the evaluation value prediction result storage unit 122.

[0140] The evaluation value prediction result storage unit 122 stores information indicating the evaluation value predicted by the evaluation value prediction unit 121 and the search candidate points of the corresponding parameters. The evaluation value stored in the evaluation value prediction result storage unit 122 and the information indicating the search candidate points of the corresponding parameters are read out by the search progress status acquisition unit 13.

[0141] 12 illustrates a case where the evaluation value prediction result storage unit 122 is provided inside the parameter optimization device 1. However, the present invention is not limited to this, and the evaluation value prediction result storage unit 122 may be provided outside the parameter optimization device 1.

[0142] The uncertainty prediction unit 123 predicts the uncertainty of the prediction result by the machine learning unit 12 (evaluation value prediction unit 121) based on the evaluation value acquired by the parameter evaluation unit 11 and the search point of the corresponding parameter. Information indicating the uncertainty predicted by this uncertainty prediction unit 123 is output to the uncertainty prediction result storage unit 124.

[0143] The uncertainty prediction result storage unit 124 stores information indicating the uncertainty predicted by the uncertainty prediction unit 123. The information indicating the uncertainty stored in the uncertainty prediction result storage unit 124 is read out by the search progress status acquisition unit 13.

[0144] 12 illustrates a case where the uncertainty prediction result storage unit 124 is provided inside the parameter optimization device 1. However, the present invention is not limited to this, and the uncertainty prediction result storage unit 124 may be provided outside the parameter optimization device 1.

[0145] Note that information indicating the function class identified by the function class identification unit 131 in the fourth embodiment is output to the search progress calculation unit 132 and the evaluation value improvement probability calculation unit 134 .

[0146] The evaluation value improvement probability calculation unit 134 calculates the improvement probability for updating the evaluation value, or the improvement probability and improvement amount, based on the evaluation value acquired by the parameter evaluation unit 11 and the search point of the corresponding parameter, the evaluation value predicted by the machine learning unit 12 and the search candidate point of the corresponding parameter, the uncertainty predicted by the machine learning unit 12, and the function class identified by the function class identification unit 131. Information indicating the improvement probability, or information indicating the improvement probability and improvement amount, calculated by the evaluation value improvement probability calculation unit 134 is output to the evaluation value improvement probability storage unit 135.

[0147] The evaluation value improvement probability storage unit 135 stores information indicating the improvement probability calculated by the evaluation value improvement probability calculation unit 134, or information indicating the improvement probability and the improvement amount. The information stored in this evaluation value improvement probability storage unit 135 is read out by the display unit 14 and the search parameter generation unit 15.

[0148] 12 illustrates a case where the evaluation value improvement probability storage unit 135 is provided inside the parameter optimization device 1. However, the present invention is not limited to this, and the evaluation value improvement probability storage unit 135 may be provided outside the parameter optimization device 1.

[0149] In addition, the display unit 14 (search status display control unit 141) in embodiment 4 displays progress information indicating the progress of the search based on the results acquired by the search progress acquisition unit 13 (progress information indicating the progress of the search, as well as the improvement probability, or the improvement probability and the improvement amount).

[0150] The search termination determination unit 151d determines whether to terminate the search based on information indicating whether the search termination determination is to be performed automatically or manually, as well as the results acquired by the search progress acquisition unit 13 (at least one of progress information indicating the progress of the search, improvement probability, or improvement probability and improvement amount), or input indicating whether to terminate the search received by the search termination determination input unit 142b.

[0151] In this case, the search termination determination unit 151d first confirms whether the search termination determination is set to automatic or manual based on information indicating whether the search termination determination is set to automatic or manual. Here, if the search termination determination unit 151d confirms that the search termination determination is set to automatic, it determines whether to terminate the search based on the results acquired by the search progress acquisition unit 13 (at least one of the search progress, improvement probability, or improvement probability and improvement amount). On the other hand, if the search termination determination unit 151d confirms that the search termination determination is set to manual, it determines whether to terminate the search based on an input indicating whether to terminate the search received by the display unit 14. That is, in this case, the search termination determination unit 151d makes the above determination by operating in the same manner as the search termination determination unit 151b in embodiment 2.

[0152] When the search end determination unit 151d determines not to end the search, that is, to continue the search, the search parameter calculation unit 152 in the fourth embodiment determines the search point for the next parameter.

[0153] Next, an example of the operation of the parameter optimization device 1 according to the fourth embodiment shown in Fig. 12 will be described with reference to Fig. 13. In the example of the operation of the parameter optimization device 1 according to the fourth embodiment shown in Fig. 12, as shown in Fig. 13, for example, the parameter optimization device 1 first determines an initial point as a search point for parameters (step ST401).

[0154] Next, the parameter evaluation unit 11 acquires an evaluation value for the parameter search point based on the determined parameter search point (step ST402). That is, first, the operation unit 111 operates the optimization target at the parameter search point based on the determined parameter search point. Next, the evaluation value calculation unit 112 calculates an evaluation value for the parameter search point used by the operation unit 111 based on the operation result of the optimization target by the operation unit 111.

[0155] Next, the searched data storage unit 113 stores the evaluation value calculated by the evaluation value calculation unit 112 and information indicating the search point of the corresponding parameter as searched data (step ST403).

[0156] Next, the evaluation value prediction unit 121 learns the relationship between the evaluation value and the parameter using a machine learning model based on the evaluation value acquired by the parameter evaluation unit 11 and the search point of the corresponding parameter (step ST404).

[0157] Next, the evaluation value prediction unit 121 predicts the evaluation value of the parameter for the search candidate point using the machine learning model (step ST405).

[0158] Next, the uncertainty prediction unit 123 predicts the uncertainty of the prediction result by the machine learning unit 12 (evaluation value prediction unit 121) based on the evaluation value obtained by the parameter evaluation unit 11 and the search point of the corresponding parameter (step ST406).

[0159] Next, the function class identification unit 131 identifies a function class of the evaluation value based on the evaluation value and the corresponding parameter search point acquired by the parameter evaluation unit 11, and the evaluation value and the corresponding parameter search candidate point predicted by the machine learning unit 12 (step ST407). At this time, the function class identification unit 131 identifies a function class of the evaluation value from a set of function classes for which global optimality is guaranteed.

[0160] Next, the search progress calculation section 132 calculates the theoretical upper limit based on the function class identified by the function class identification section 131 (step ST408).

[0161] Next, the search progress calculation unit 132 calculates the progress of the search based on the evaluation value and corresponding parameters obtained by the parameter evaluation unit 11, the search candidate points of the evaluation value and corresponding parameters predicted by the machine learning unit 12, and the calculated theoretical upper limit value (step ST409).

[0162] Next, the evaluation value improvement probability calculation unit 134 calculates the improvement probability of updating the evaluation value, or the improvement probability and improvement amount, based on the evaluation value obtained by the parameter evaluation unit 11 and the search point of the corresponding parameter, the evaluation value predicted by the machine learning unit 12 and the search candidate point of the corresponding parameter, the uncertainty predicted by the machine learning unit 12, and the function class identified by the function class identification unit 131 (step ST410).

[0163] Here, as shown by the dashed line in FIG. 14, for example, an evaluation value (predicted value) is obtained that is predicted based on the uncertainty predicted by the machine learning unit 12 and that takes the uncertainty into consideration. Then, the evaluation value acquired by the parameter evaluation unit 11 and the evaluation value predicted by the machine learning unit 12 are compared with the evaluation value that takes the uncertainty into consideration. If the difference is large, the probability of improvement is high, and if the difference is small, the probability of improvement is low. More specifically, for example, when parameter optimization is performed using Bayesian optimization, the average of the prediction results of Gaussian process regression for a parameter search candidate point (x (hat)) is defined as μ(x (hat)), the standard deviation is defined as σ(x (hat)), and the in-search optimum value obtained at a certain point in time is defined as y ｂｅｓｔ Then, the improvement probability (P(x(hat))) is defined by the following equation (15): The evaluation value improvement probability calculation unit 134 can calculate the improvement probability for the next search point from among these.

[0164] The improvement (PV) may be an expected improvement obtained from the following formula (16), or may be a theoretical upper limit (U) such as the following formula (17) or (18). ｆ ) and the optimal value within the search (y ｂｅｓｔ ) may be used as the improvement amount calculated by the following formula, but is not limited to these.

[0165] Next, the search status display control unit 141 displays progress information indicating the progress of the search based on the results acquired by the search progress acquisition unit 13 (progress information indicating the progress of the search, as well as the improvement probability, or the improvement probability and the improvement amount) (step ST411).

[0166] In the display unit 14 of the fourth embodiment, as shown in Fig. 15, the probability of improvement of the evaluation value for the next search point is also displayed together with the progress information showing the progress of the search shown in Fig. 5. In Fig. 15, the amount of improvement is also displayed together with the above display.

[0167] Next, the search termination determination input unit 142b checks whether the search termination determination is set to be automatic, i.e., whether it is in auto mode, based on information indicating whether the search termination determination is set to be automatic or manual (step ST412).

[0168] In step ST412, if the search termination determination input unit 142b determines that the setting is not to automatically perform the search termination determination, that is, that the setting is to manually perform the search termination determination, it accepts an input from the user indicating whether or not to terminate the search (step ST413). On the other hand, in step ST413, if the search termination determination input unit 142b determines that the setting is to automatically perform the search termination determination, the sequence proceeds to step ST414.

[0169] Next, the search termination determination unit 151d determines whether to terminate the search based on information indicating whether the search termination determination is set to be performed automatically or manually, as well as the results acquired by the search progress acquisition unit 13 (at least one of progress information indicating the progress of the search, improvement probability, or improvement probability and improvement amount), or input indicating whether to terminate the search received by the search termination determination input unit 142b (step ST414).

[0170] Here, when the search termination determination unit 151d confirms that the setting is such that the search termination determination is performed automatically, it determines whether or not to terminate the search based on the results acquired by the search progress status acquisition unit 13 (at least one of progress information indicating the progress status of the search, the improvement probability, or the improvement probability and the improvement amount). On the other hand, when the search termination determination unit 151d confirms that the setting is such that the search termination determination is performed manually, it determines whether or not to terminate the search based on an input indicating whether or not to terminate the search received by the display unit 14. That is, in this case, the search termination determination unit 151d performs the above determination by operating in the same manner as the operation of the search termination determination unit 151b in the second embodiment.

[0171] If the search termination determination unit 151d determines in step ST414 that the search should be continued, the search parameter calculation unit 152 determines the search point for the next parameter, and the action command generation unit 153 generates a command value for the action unit 111 based on the parameters determined by the search parameter calculation unit 152 (step ST415). The sequence then returns to step ST402. The parameter evaluation unit 11 then repeats the above-described operation based on the parameters included in the command value from the search parameter generation unit 15.

[0172] On the other hand, if the search end determination section 151d determines in step ST414 not to continue the search, that is, to end the search, the sequence ends.

[0173] Note that the above description shows a case where the configuration of the machine learning unit 12 is changed from the parameter optimization device 1 according to embodiment 3, the evaluation value improvement probability calculation unit 134 and the evaluation value improvement probability storage unit 135 are added to the search progress status acquisition unit 13, and the search termination determination unit 151c is changed to the search termination determination unit 151d. However, this is not limiting, and the configuration of the machine learning unit 12 may be changed from the parameter optimization device 1 according to embodiments 1 and 2, the evaluation value improvement probability calculation unit 134 and the evaluation value improvement probability storage unit 135 are added to the search progress status acquisition unit 13, and the search termination determination unit 151 or the search termination determination unit 151b may be changed to the search termination determination unit 151d, and the same effects as those described above may be obtained.

[0174] As described above, according to the fourth embodiment, the machine learning unit 12 included in the information processing device includes an uncertainty prediction unit 123 that predicts uncertainty regarding the prediction result by the machine learning unit 12 based on the search point of the parameter and the evaluation value of the search point, and the search progress acquisition unit 13 includes an evaluation value improvement probability calculation unit 134 that calculates an improvement probability of updating the evaluation value based on the search point, the evaluation value of the search point, the candidate search point, the evaluation value of the candidate search point predicted by the machine learning unit 12, the uncertainty predicted by the machine learning unit 12, and the function class identified by the function class identification unit 131. This allows the information processing device according to the fourth embodiment to grasp the improvement probability of the evaluation value for the next search point, compared to the first to third embodiments. As a result, the information processing device according to the fourth embodiment can end the parameter search early if there is little prospect of improvement, for example, even if the search progress rate has not reached 100% or the remaining number of searches has not reached 0.

[0175] The search progress status acquisition unit 13 identifies a function class using the function class identification unit 131, and calculates the theoretical upper limit U ｆ However, the configuration may be such that the function class specification unit 131 is not included. In this case, the theoretical upper limit value is calculated in step ST408 by using the theoretical upper limit value U ｆ (x) can be calculated using the following equation (19).

[0176] In equation (19), μ(x) is the predicted value of the evaluation value for the parameter search candidate point calculated by the evaluation value prediction unit 121. σ(x) is the uncertainty of the prediction result by the evaluation value prediction unit 121 calculated by the uncertainty prediction unit 123. κ is a hyperparameter, and for example, when κ=2, it is a theoretical upper limit value taking into account the prediction uncertainty of approximately 95%, and when κ=3, it is approximately 99.7%. For subsequent processing, the processing of step ST409 described above may be performed. This makes it possible to calculate the progress status (this progress status is not a limitation but is an example of progress information) without using the function class identification unit 131.

[0177] The theoretical upper limit value calculated by the above-described method may be used in other embodiments, not just in the fourth embodiment, and may be used to calculate the search status. As a result, it is possible to calculate the value included in the progress status described above without using the function class identification unit 131.

[0178] Fifth Embodiment In a fifth embodiment, a case where the optimization target is air conditioning and refrigeration equipment 2 will be described.

[0179] Fig. 16 is a diagram showing a configuration example of a parameter optimization device 1 according to embodiment 5. The configuration example of the parameter optimization device 1 according to embodiment 5 shown in Fig. 16 is similar to the configuration example of the parameter optimization device 1 according to embodiment 4 shown in Fig. 12. Meanwhile, in the parameter optimization device 1 according to embodiment 5 shown in Fig. 16, the air conditioning and refrigeration equipment 2 to be optimized is connected to the parameter evaluation unit 11 (operation unit 111).

[0180] The air conditioning / refrigeration equipment 2 may be, for example, an air conditioning, ventilation, or sanitation equipment, a refrigerator, or a water heater. As shown in FIG. 17 , the air conditioning / refrigeration equipment 2 includes at least a compressor 21 that transports a refrigerant, a condenser 22 that releases heat from the refrigerant into a surrounding fluid, an evaporator 23 that absorbs heat from the refrigerant from the surrounding fluid, and an expansion valve 24 that creates a pressure difference in the refrigerant. FIG. 17 illustrates a case in which an electronic expansion valve 241 and a bypass electronic expansion valve 242 are provided as the expansion valve 24. The following describes the search operation using an air conditioning / refrigeration equipment 2 that includes, as shown in FIG. 17 , four components: the compressor 21, the condenser 22, the evaporator 23, and the expansion valve 24; a four-way valve 25, a refrigerant-refrigerant heat exchanger 26, and an accumulator 27. The following discussion focuses on the cooling mode, in which the heat exchanger of the outdoor unit is the condenser 22 and the heat exchanger of the indoor unit is the evaporator 23.

[0181] 17, parameters to be searched for for this air conditioning / refrigeration equipment 2 include the opening degree of the electronic expansion valve 241 of the indoor unit, the frequency of the compressor 21 in the outdoor unit, or the opening degree of the bypass electronic expansion valve 242. Other parameters include at least one of the solenoid valve, the fan air volume, the vane which is the blowing angle, or the water flow rate.

[0182] In addition, the evaluation values ​​used to determine the quality of parameters when searching for parameters include at least one of the following: COP, which indicates energy efficiency; heating / cooling capacity, which indicates how much a room can be heated or cooled; PMV, which is a comfort index; outlet temperature; outlet water temperature; or CO2 concentration.

[0183] For example, if one wishes to maximize the COP in rated cooling mode, it is not possible to directly measure the COP. Therefore, the evaluation value calculation unit 112 calculates COP = rated capacity [kW] / rated power consumption [kW], and the parameter optimization device 1 searches for parameters that maximize this value. Furthermore, the cooling / heating capacity is generally determined by measuring the heat balance (the difference in temperature and humidity between the intake air and the discharge air, as well as the air volume) in the indoor unit. Furthermore, the heat balance of the refrigerant may be predicted by calculating the physical properties of the refrigerant based on the temperatures of each actuator or the indoor and outdoor air.

[0184] Next, an example of the operation of the parameter optimization device 1 according to the fifth embodiment shown in Fig. 16 will be described with reference to Fig. 18. In the example of the operation of the parameter optimization device 1 according to the fifth embodiment shown in Fig. 16, as shown in Fig. 18, for example, the parameter optimization device 1 first determines an initial point as a search point for parameters (step ST501).

[0185] Next, the parameter evaluation unit 11 acquires an evaluation value for the parameter search point based on the determined parameter search point (step ST502). That is, first, the operation unit 111 operates the air conditioning and refrigeration equipment 2 at the parameter search point based on the determined parameter search point. Next, the evaluation value calculation unit 112 calculates an evaluation value for the parameter search point used by the operation unit 111 based on the operation result of the air conditioning and refrigeration equipment 2 by the operation unit 111.

[0186] At this time, the operation unit 111 transmits the determined parameter search points to the air conditioning and refrigeration equipment 2 via the air conditioning controller (not shown) (step ST5021). The air conditioning and refrigeration equipment 2 then sets its own parameters according to the transmitted parameter search points and operates. The operation unit 111 then acquires the operation results of the air conditioning and refrigeration equipment 2 (step ST5022). The evaluation value calculation unit 112 then determines whether to predict the heating and cooling capacity (step ST5023). If the evaluation value calculation unit 112 determines to predict the heating and cooling capacity in step ST5023, the evaluation value calculation unit 112 predicts the refrigerant heat balance based on each actuator in the air conditioning and refrigeration equipment 2 or the indoor and outdoor air temperatures, and calculates the evaluation value by predicting the heating and cooling capacity (step ST5024). On the other hand, if the evaluation value calculation unit 112 decides not to predict the heating and cooling capacity in step ST5023, the evaluation value calculation unit 112 calculates the evaluation value by calculating the heating and cooling capacity based on the temperature and humidity differences and air volume between the intake air and the blown air (step ST5025).

[0187] Next, the searched data storage unit 113 stores the evaluation value calculated by the evaluation value calculation unit 112 and information indicating the search point of the corresponding parameter as searched data (step ST503).

[0188] Next, the evaluation value prediction unit 121 learns the relationship between the evaluation value and the parameter using a machine learning model based on the evaluation value acquired by the parameter evaluation unit 11 and the search point of the corresponding parameter (step ST504).

[0189] Next, the evaluation value prediction unit 121 predicts the evaluation value of the parameter for the search candidate point using the machine learning model (step ST505).

[0190] Next, the uncertainty prediction unit 123 predicts the uncertainty of the prediction result by the machine learning unit 12 (evaluation value prediction unit 121) based on the evaluation value obtained by the parameter evaluation unit 11 and the search point of the corresponding parameter (step ST506).

[0191] Next, the function class identification unit 131 identifies a function class of the evaluation value based on the evaluation value and the corresponding parameter search point acquired by the parameter evaluation unit 11, and the evaluation value and the corresponding parameter candidate search point predicted by the machine learning unit 12 (step ST507). At this time, the function class identification unit 131 identifies a function class of the evaluation value from a set of function classes for which global optimality is guaranteed.

[0192] Next, the search progress calculation section 132 calculates the theoretical upper limit based on the function class identified by the function class identification section 131 (step ST508).

[0193] Next, the search progress calculation unit 132 calculates the progress of the search based on the evaluation value and corresponding parameters obtained by the parameter evaluation unit 11, the search candidate points of the evaluation value and corresponding parameters predicted by the machine learning unit 12, and the calculated theoretical upper limit value (step ST509).

[0194] Next, the evaluation value improvement probability calculation unit 134 calculates the improvement probability of updating the optimal value within the search, or the improvement probability and improvement amount, based on the evaluation value obtained by the parameter evaluation unit 11 and the search point of the corresponding parameter, the evaluation value predicted by the machine learning unit 12 and the search candidate point of the corresponding parameter, the uncertainty predicted by the machine learning unit 12, and the function class identified by the function class identification unit 131 (step ST510).

[0195] Next, the search status display control unit 141 displays information indicating the progress of the search based on the results acquired by the search progress acquisition unit 13 (the progress of the search plus the improvement probability, or the improvement probability and the amount of improvement) (step ST511).

[0196] Next, the search termination determination input unit 142b checks whether the search termination determination is set to be automatic, i.e., whether it is in auto mode, based on information indicating whether the search termination determination is set to be automatic or manual (step ST512).

[0197] In step ST512, if the search termination determination input unit 142b confirms that the setting is not to automatically perform the search termination determination, that is, that the setting is to manually perform the search termination determination, it accepts an input from the user indicating whether or not to terminate the search (step ST513). On the other hand, in step ST513, if the search termination determination input unit 142b confirms that the setting is to automatically perform the search termination determination, the sequence proceeds to step ST514.

[0198] Next, the search termination determination unit 151d determines whether to terminate the search based on information indicating whether the search termination determination is to be performed automatically or manually, as well as the results acquired by the search progress acquisition unit 13 (at least one of the search progress, improvement probability, or improvement probability and improvement amount), or the input indicating whether to terminate the search received by the search termination determination input unit 142b (step ST514).

[0199] If the search termination determination unit 151d determines in step ST514 to continue the search, the search parameter calculation unit 152 determines the search point for the next parameter, and the operation command generation unit 153 generates a command value for the operation unit 111 based on the parameters determined by the search parameter calculation unit 152 (step ST515). Thereafter, the sequence returns to step ST502. Thereafter, the parameter evaluation unit 11 repeats the above operation based on the parameters included in the command value from the search parameter generation unit 15.

[0200] On the other hand, if the search end determination section 151d determines in step ST514 not to continue the search, that is, to end the search, the sequence ends.

[0201] In the above description, the parameter optimization device 1 according to embodiment 4 has been described as being configured to optimize the air conditioning and refrigeration equipment 2. However, the present invention is not limited to this, and the parameter optimization device 1 according to embodiments 1 to 3 may be configured to optimize the air conditioning and refrigeration equipment 2, and the same effects as those described above can be obtained.

[0202] As described above, according to the fifth embodiment, the optimization target in the parameter optimization device 1 is the air conditioning and refrigeration equipment 2. As a result, the parameter optimization device 1 according to the fifth embodiment can determine parameters that maximize or minimize, for example, the heating and cooling capacity, energy efficiency, or power consumption of the air conditioning and refrigeration equipment 2. As a result, the parameter optimization device 1 according to the fifth embodiment can provide air conditioning and refrigeration equipment 2 with high operating efficiency.

[0203] It should be noted that the embodiments may be freely combined, or any of the components in each embodiment may be modified, or any of the components in each embodiment may be omitted.

[0204] The present disclosure is suitable for use in an information processing device, an information processing method, a program, a display device, a display method, and the like.

[0205] 1 Parameter optimization device, 2 Air conditioning and refrigeration equipment, 11 Parameter evaluation unit, 12 Machine learning unit, 13 Search progress acquisition unit, 14 Display unit, 15 Search parameter generation unit, 21 Compressor, 22 Condenser, 23 Evaporator, 24 Expansion valve, 25 Four-way valve, 26 Refrigerant-refrigerant heat exchanger, 27 Accumulator, 101 Display, 102 Processing circuit, 103 Communication interface, 104 Memory, 105 Storage medium, 111 Operation unit, 112 Evaluation value calculation unit, 113 Searched data storage unit, 121 Evaluation value prediction unit, 122 Evaluation value prediction result storage unit, 123 Uncertainty prediction unit, 124 Uncertainty prediction result storage unit, 131 Function class identification unit, 132 Search progress calculation unit, 133 Search progress storage unit, 134 Evaluation value improvement probability calculation unit, 135 Evaluation value improvement probability storage unit, 141 search status display control unit, 142, 142b search end determination input unit, 151, 151b, 151c, 151d search end determination unit, 152 search parameter calculation unit, 153 operation command generation unit, 241 electronic expansion valve, 242 bypass electronic expansion valve.

Claims

1. An information processing device comprising: a machine learning unit that learns the relationship between a search point of a parameter and an evaluation value of the search point, and predicts the evaluation value for a search candidate point of the parameter; and a search progress acquisition unit that acquires progress information indicating the progress of a search, based on the search point, the evaluation value of the search point, the search candidate point, and the evaluation value of the search candidate point predicted by the machine learning unit.

2. The information processing device according to claim 1, further comprising a parameter evaluation unit that obtains an evaluation value of the search point based on the determined search point.

3. An information processing device as described in claim 1 or claim 2, characterized in that it is further provided with a search parameter generation unit that determines a next search point, which is a search point for the parameter to be next searched, based on the progress information acquired by the search progress acquisition unit, or based on the progress information, based on whether or not the user has made an input indicating to end the search of the parameter, or based on whether or not the user has made an input indicating to continue the search of the parameter.

4. An information processing device as described in claim 3, characterized in that it is provided with a parameter evaluation unit including an operation unit that operates an object at the determined next search point, and an evaluation value calculation unit that calculates an evaluation value of the next search point based on the operation result by the operation unit.

5. An information processing device according to any one of claims 1 to 4, further comprising an output control unit that controls output of the acquired progress information to a display unit.

6. An information processing device according to claim 5, further comprising the display unit.

7. The information processing device according to claim 6, wherein said display unit displays information for accepting an input for terminating a search.

8. An information processing device as claimed in any one of claims 1 to 7, characterized in that the search progress acquisition unit includes: a function class identification unit that identifies a function class of an evaluation value from a set of function classes based on the search point, the evaluation value of the search point, the search candidate point, and the evaluation value of the search candidate point predicted by the machine learning unit; and a search progress calculation unit that calculates the progress of the search based on the search point, the evaluation value of the search point, the search candidate point, the evaluation value of the search candidate point predicted by the machine learning unit, and the function class.

9. The information processing apparatus according to claim 8, wherein the function class is a function for which global optimality is guaranteed.

10. An information processing device as described in claim 8 or claim 9, characterized in that the machine learning unit includes an uncertainty prediction unit that predicts uncertainty regarding the prediction result by the machine learning unit based on the search point of the parameter and the evaluation value of the search point, and the search progress acquisition unit includes an evaluation value improvement probability calculation unit that calculates an improvement probability of updating the evaluation value based on the search point, the evaluation value of the search point, the search candidate point, the evaluation value of the search candidate point predicted by the machine learning unit, the uncertainty predicted by the machine learning unit, and the function class identified by the function class identification unit.

11. An information processing method comprising: a step of learning a relationship between a search point of a parameter and an evaluation value of the search point, and predicting the evaluation value for a search candidate point of the parameter by a machine learning unit; and a step of acquiring progress information indicating the progress of the search by a search progress acquisition unit, based on the search point, the evaluation value of the search point, the search candidate point, and the evaluation value of the search candidate point predicted by the machine learning unit.

12. A program that causes a computer to execute the following processes: a process of learning the relationship between a search point of a parameter and the evaluation value of the search point, and predicting the evaluation value for a search candidate point of the parameter; and a process of acquiring progress information indicating the progress of the search, based on the search point, the evaluation value of the search point, the search candidate point, and the predicted evaluation value of the search candidate point.

13. A display device comprising: an acquisition unit that acquires progress information indicating the progress of a search for optimal parameters by a parameter optimization device that evaluates parameters to be optimized and searches for optimal parameters; and a display unit that displays the progress information.

14. The display device of claim 13, characterized in that the acquisition unit acquires an evaluation value for the search point of the determined parameter by the parameter optimization device, learns a relationship between the evaluation value and the parameter based on the search point and the evaluation value of the search point by the parameter optimization device, predicts the evaluation value for a search candidate point of the parameter based on the learned relationship, and acquires the progress information calculated by the parameter optimization device based on the search point, the evaluation value of the search point, the search candidate point, and the predicted evaluation value of the search candidate point.

15. A display device as described in claim 13 or 14, characterized in that the progress information includes information indicating the progress of the search for the search points of the parameter, and the display unit displays the information indicating the progress of the search for the search points.

16. A display device as described in any one of claims 13 to 15, characterized in that the progress information includes information indicating the progress status based on an in-search optimal value among the evaluation values ​​searched for by the parameter optimization device and a maximum predicted evaluation value among the entire search by the parameter optimization device, and the display unit displays the information indicating the progress status based on an in-search optimal value among the evaluation values ​​searched for by the parameter optimization device and a maximum predicted evaluation value among the entire search by the parameter optimization device.

17. A display device as claimed in any one of claims 13 to 16, characterized in that the progress information includes information indicating the percentage of the entire search of the parameters that has been completed, and the display unit displays the information indicating the percentage of the search of the parameters that has been completed.

18. A display device according to any one of claims 13 to 17, characterized in that the progress information includes information regarding the end of the parameter search, and the display unit displays the information regarding the end of the search.

19. The display device according to claim 18, characterized in that the information regarding the end of the search includes the remaining time until the end of the parameter search or the end time of the parameter search based on the progress information.

20. A display device according to any one of claims 13 to 19, characterized in that the progress information includes information relating to the remaining number of searches in the parameter search, and the display unit displays the information relating to the remaining number of searches.

21. A display device as claimed in any one of claims 13 to 20, characterized in that the progress information includes an optimum value within the search among the evaluation values ​​searched for by the parameter optimization device, and the display unit displays the optimum value within the search.

22. A display device as described in any one of claims 13 to 21, characterized in that the progress information includes information indicating the maximum evaluation value predicted by the parameter optimization device within the entire search by the parameter optimization device, and the display unit displays the information indicating the predicted maximum evaluation value.

23. The display device according to claim 22, characterized in that the progress information includes information indicating the ratio of the optimum value within the search to the expected maximum evaluation value, and the display unit displays information indicating the ratio of the optimum value within the search to the expected maximum evaluation value based on the progress information.

24. The display device according to any one of claims 13 to 23, characterized in that the display unit displays information for accepting an input for ending a search by the parameter optimization device or an input for continuing a search.

25. A display device according to any one of claims 13 to 24, characterized in that the display unit displays information for setting whether the termination of the search by the parameter optimization device is to be decided by a user or by the parameter optimization device.

26. A display method comprising the steps of: acquiring progress information indicating the progress of a search for optimal parameters by a parameter optimization device that evaluates parameters to be optimized and searches for optimal parameters, using an acquisition unit; and displaying the progress information by a display unit.

27. A program causing a computer to execute the following processes: acquiring progress information indicating the progress of a search for optimal parameters by a parameter optimization device that evaluates parameters to be optimized and searches for optimal parameters; and displaying the progress information.

Images