Evaluation support device, evaluation support system, evaluation support method, and program

Abstract

To provide an evaluation support device providing policy evaluation data applicable to a review of a policy application area.SOLUTION: An evaluation support device is provided with: an acquisition unit for acquiring policy utilized data showing a utilized state of policy to be evaluated, and evaluation item data related to the purpose of the policy to be evaluated; a policy evaluation data generating unit for generating the policy evaluation data used for evaluation on the policy to be evaluated using the policy utilized data and the evaluation item data; a policy effect information generating unit for generating policy effect information indicating effect of the policy to be evaluated through summarizing the policy evaluation data according to attribution of a designated policy user; and an output unit for outputting the policy effect information.SELECTED DRAWING: Figure 24

Description

[Technical field]

[0001] The present disclosure relates to an evaluation support device, an evaluation support system, an evaluation support method, and a program. [Background technology]

[0002] Local governments (local authorities) are implementing their own policies to solve social problems. Local governments are hoping to build a system to evaluate these policies.

[0003] A technology for evaluating whether an intervention service provided to an intervention target for health promotion is appropriate or not is disclosed in Patent Document 1. The performance evaluation device described in Patent Document 1 evaluates the intervention service provided to the intervention target by comparing health management information before and after the application of the intervention service to the intervention target. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2004-341611 A Summary of the Invention [Problem to be solved by the invention]

[0005] The scope of application of policies implemented by local governments is often determined in advance. Due to financial constraints, local governments are reviewing this scope. When building a system for evaluating unique policies, it is desirable to provide data that can be used to review the scope of application of policies.

[0006] An object of the present disclosure is to provide an evaluation support device, an evaluation support system, an evaluation support method, and a program capable of providing policy evaluation data that can be used to review the scope of application of the policy. [Means for solving the problem]

[0007] An evaluation support device of one embodiment of the present disclosure includes an acquisition unit that acquires policy utilization data indicating the utilization status of the policy to be evaluated and evaluation item data related to the objective of the policy to be evaluated, a policy evaluation data generation unit that uses the policy utilization data and the evaluation item data to generate policy evaluation data to be used in evaluating the policy to be evaluated, a policy effect information generation unit that aggregates the policy evaluation data according to the attributes of specified policy users and generates policy effect information indicating the effectiveness of the policy to be evaluated, and an output unit that outputs the policy effect information.

[0008] One aspect of the evaluation support method of the present disclosure involves a computer acquiring policy utilization data indicating the utilization status of the policy to be evaluated and evaluation item data related to the objective of the policy to be evaluated, using the policy utilization data and the evaluation item data to generate policy evaluation data to be used in evaluating the policy to be evaluated, aggregating the policy evaluation data according to the attributes of specified policy users, generating policy effect information indicating the effectiveness of the policy to be evaluated, and outputting the policy effect information.

[0009] A program of one embodiment of the present disclosure causes a computer to perform the following processes: acquiring policy utilization data indicating the utilization status of the policy to be evaluated and evaluation item data related to the objective of the policy to be evaluated; using the policy utilization data and the evaluation item data to generate policy evaluation data to be used in evaluating the policy to be evaluated; aggregating the policy evaluation data according to the attributes of specified policy users to generate policy effect information indicating the effectiveness of the policy to be evaluated; and outputting the policy effect information. Effect of the Invention

[0010] According to the present disclosure, it is possible to provide an evaluation support device, an evaluation support system, an evaluation support method, and a program capable of providing evaluation data of a policy applicable to reviewing the scope of application of the policy. [Brief description of the drawings]

[0011] [Figure 1]1 is a conceptual diagram for explaining an overview of an evaluation support system in the present disclosure. [Diagram 2] 1 is a block diagram showing an example of a configuration of an evaluation support system according to the present disclosure. [Diagram 3] FIG. 13 is a diagram showing an example of a local government selection screen for selecting a local government that implements a policy to be evaluated. [Figure 4] FIG. 13 is a diagram showing an example of an evaluation target policy identification information input screen. [Diagram 5] FIG. 13 is a diagram showing an example of an evaluation item input screen. [Figure 6] FIG. 13 is a diagram showing an example of a group unit input screen. [Figure 7] FIG. 13 is a diagram showing an example of an output screen including policy evaluation data. [Figure 8] FIG. 11 is a diagram showing an example of policy use data. [Figure 9] FIG. 4 is a diagram showing an example of evaluation item data. [Figure 10] FIG. 13 is a diagram showing an example of policy evaluation data. [Figure 11] FIG. 11 is a diagram showing an example of policy effect information. [Figure 12] FIG. 11 is a diagram showing an example of policy effect information. [Figure 13] FIG. 11 is a diagram illustrating an example of output information. [Figure 14] 10 is a flowchart illustrating an example of an operation of the evaluation support device according to the present disclosure. [Figure 15] 1 is a block diagram showing an example of a configuration of an evaluation support system according to the present disclosure. [Figure 16] 13 is an example of a correlation data information selection screen for specifying data for determining a correlation. [Figure 17] FIG. 13 is a diagram illustrating an example of a correlation analysis result. [Figure 18] FIG. 13 is a diagram illustrating an example of a correlation analysis result. [Figure 19] FIG. 11 is a diagram illustrating an example of output information. [Figure 20] 10 is a flowchart illustrating an example of an operation of the evaluation support device according to the present disclosure. [Figure 21]10 is a flowchart illustrating an example of an operation of the evaluation support device according to the present disclosure. [Figure 22] 10 is a flowchart illustrating an example of an operation of the evaluation support device according to the present disclosure. [Figure 23] 10 is a flowchart illustrating an example of an operation of the evaluation support device according to the present disclosure. [Figure 24] 1 is a block diagram showing an example of a configuration of an evaluation support device according to the present disclosure. [Diagram 25] 10 is a flowchart illustrating an example of an operation of the evaluation support device according to the present disclosure. [Figure 26] FIG. 2 is a block diagram showing an example of a hardware configuration for executing control and processing in each embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, the embodiments of the present disclosure will be described in detail with reference to the drawings. The embodiments described below are limited in a manner that is technically preferable for implementing the present disclosure, but the scope of the invention is not limited to the following. In all the drawings used to explain the following embodiments, the same reference numerals are used for similar parts unless otherwise specified. In the following embodiments, repeated explanations of similar configurations and operations may be omitted.

[0013] [First embodiment] First, an evaluation support system according to a first embodiment will be described with reference to the drawings.

[0014] (overview) Fig. 1 is a conceptual diagram for explaining an overview of the evaluation support system in the present disclosure. Note that Fig. 1 is a diagram for explaining the overview of the evaluation support system, and does not limit the number of components or the connection method.

[0015] The evaluation support system 1 includes an evaluation support device 10 and a system user terminal 60. The evaluation support device 10 and the system user terminal 60 are communicatively connected. The evaluation support device 10 is communicatively connected to a server or storage in which a policy use database 70 and an evaluation item database 80 are stored, respectively.

[0016] The system user terminal 60 is a terminal device operated by a system user. The system user terminal 60 has an input section (not shown) and an output section (not shown). The input section is realized by an input / output interface connected to an input device such as a mouse or a keyboard. The output section is realized by an input / output interface connected to a display device such as a display. The system user terminal 60 inputs the policy identification information to be evaluated and the evaluation items via the input section. The system user terminal 60 displays the policy effect information, which is the evaluation result of the policy to be evaluated, via the output section. The policy identification information to be evaluated is information for identifying the policy to be evaluated. In the following explanation, the policy to be evaluated is also referred to as the policy to be evaluated. The evaluation items are items related to the purpose of the policy to be evaluated. The evaluation items will be described in detail later.

[0017] The policy use database 70 is a database in which policy use data indicating the utilization status of the policy to be evaluated is compiled. The policy use data is data in which the identification information of a user is associated with the utilization status of the policy by the user. The policy use database 70 may be one or more. In the example shown in FIG. 1, the policy use database 70 has databases 70-1, 70-2, and 70-3. For example, the database 70-1 is owned by each local government. For example, the database 70-2 is a database generated using information of an IC (Integrated Circuit) card read at the time of policy utilization. The database 70-3 is a database generated using information of an application used at the time of policy utilization. The policy use data may be acquired from a database other than those described above. In addition, the policy use database 70 may be a cloud-type database or an on-premise-type database.

[0018] The evaluation item database 80 is a database in which evaluation item data related to the objective of the policy to be evaluated is stored. The evaluation item data is data associated with the evaluation items. The evaluation items and the evaluation item data will be further explained using a concrete example. Assume that the policy to be evaluated is "walking points". In this case, for example, the evaluation items include medical cost reduction, health promotion, and improvement of lifestyle-related diseases. For example, the evaluation item of "medical cost reduction" is associated with the medical cost data of residents as the evaluation item data. For example, the evaluation items of "health promotion" and "improvement of lifestyle-related diseases" are associated with the medical examination result data as the evaluation item data. The evaluation item database 80 is a database in which these evaluation item data are stored. There may be one or more evaluation item databases 80. In the example shown in FIG. 1, the evaluation item database 80 has a database 80-1, a database 80-2, and a database 80-3. For example, the databases 80-1 to 80-3 are databases owned by medical institutions or administrative agencies. The evaluation item data may be acquired from a database other than the above-mentioned databases. Furthermore, the evaluation item database 80 may be a cloud-based database or an on-premise database.

[0019] The evaluation support device 10 evaluates policies implemented by local governments. For example, the evaluation support device 10 is realized by a server device that employs cloud computing to provide services to users via a network. The evaluation support device 10 may be realized by an application installed on a server or cloud. The evaluation support device 10 acquires policy use data from a policy use database 70 using evaluation target policy identification information input from a system user terminal 60. The evaluation support device 10 acquires evaluation item data from an evaluation item database using evaluation items input from the system user terminal 60. The evaluation support device generates policy effect information, which is an evaluation result of the evaluation target policy, using the policy use data and the evaluation item data. The evaluation support device 10 outputs the generated policy effect information to the system user terminal 60.

[0020] (composition) 2 is a block diagram showing an example of the configuration of the evaluation support system in the present disclosure. The evaluation support system 1 includes an evaluation support device 10 and a system user terminal 60. The evaluation support device 10 is communicably connected to each of the system user terminal 60, a policy use database 70, and an evaluation item database 80.

[0021] The evaluation support device 10 includes an input receiving unit 11 , an acquiring unit 12 , a policy evaluation data generating unit 13 , a graph determining unit 14 , a policy effect information generating unit 15 , and an output unit 16 .

[0022] The input reception unit 11 receives input of the evaluation target policy identification information, the evaluation item information, and the group unit information. The procedure by which the input reception unit 11 receives the evaluation target policy identification information, the evaluation item information, and the group unit information will be described with reference to Figs. 3 to 6. The drawings referred to in the following description are diagrams showing an example of an interface of a screen displayed on the output unit of the system user terminal 60. Figs. 3 to 6 may be provided in any format, such as a dedicated application screen or a web page by the evaluation support device 10. The GUI (Graphical User Interface) shown in Figs. 3 to 6 is an example. For example, where push buttons are used in Figs. 3 to 6, text input fields may be used instead of radio buttons. The input screen may include other GUIs in addition to the GUIs shown in Figs. 3 to 6.

[0023] FIG. 3 is a diagram showing an example of a local government selection screen for selecting a local government implementing a policy to be evaluated. The input reception unit 11 displays a local government selection screen (W1) on the output unit of the system user terminal 60 in order to receive input of information identifying a local government from the system user terminal 60. The local government selection screen includes a list of local government information (D1). The local government selection screen may include a search box (D2) for searching for a local government. The operator of the system user terminal 60 selects a relevant local government from the list of local government information (D1) via the input unit of the system user terminal 60. When the operator of the system user terminal 60 finishes selecting a local government, he or she presses a button B1. In response to the pressing of the button B1, the system user terminal 60 transmits the input information to the evaluation support device 10. The input reception unit 11 acquires the received information as local government identification information.

[0024] FIG. 4 is a diagram showing an example of an evaluation target policy identification information input screen. In order to receive input of information that identifies the evaluation target policy, the input reception unit 11 displays an evaluation target policy identification information input screen (W2) on the output unit of the system user terminal 60. The evaluation target policy identification information input screen includes a list of policies implemented by local governments (D3). The input reception unit 11 includes a list of policies implemented by local governments in the evaluation target policy identification information input screen. The policies implemented by local governments correspond to the local government identification information input received via the local government selection screen. The evaluation target policy identification information input screen may include a search box (D4) for searching for policies. The operator of the system user terminal 60 selects the evaluation target policy from the list of policies implemented by local governments (D3) via the input unit of the system user terminal 60. When the operator of the system user terminal 60 finishes selecting the evaluation target policy, he or she presses a button B2. In response to the pressing of the button B2, the system user terminal 60 transmits the input information to the evaluation support device 10. The input receiving unit 11 acquires the received input information as evaluation target policy identification information.

[0025] FIG. 5 is a diagram showing an example of an evaluation item input screen. The input accepting unit 11 displays an evaluation item input screen (W3) on the output unit of the system user terminal 60 in order to accept input of information identifying the evaluation items. The evaluation item input screen includes list information (D5) of evaluation items corresponding to the policy identification information to be evaluated. The operator of the system user terminal 60 selects evaluation items from the list information (D5) of evaluation items via the input unit of the system user terminal 60. After finishing selecting the evaluation items, the operator of the system user terminal 60 presses button B3. In response to the pressing of button B3, the system user terminal 60 transmits the input information to the evaluation support device 10. The input accepting unit 11 acquires the received input information as evaluation item information.

[0026] FIG. 6 is a diagram showing an example of a group unit input screen. The input receiving unit 11 displays a group unit input screen (W4) on the output unit of the system user terminal 60 in order to receive input of information that specifies the group unit. The group unit is a unit when grouping users in data aggregation. For example, the group unit may be the attributes of the policy user. The attributes of the policy user are properties and characteristics that are common to the policy users. For example, the attributes of the policy user include the age, sex, residential area, degree of care required, number of household members, and number of years of continuous use of the policy to be evaluated of the policy user. The group unit input screen includes list information (D6) of group units when grouping. The operator of the system user terminal 60 selects a group unit from the list information (D6) of group units via the input unit of the system user terminal 60. A plurality of group units may be selected. Also, the group unit may not be specified. If the group unit is not specified, the users are not grouped when data aggregation is performed. Alternatively, if the group unit is not specified, the grouping may be performed in a group unit that is predetermined according to the evaluation item. When the operator of the system user terminal 60 finishes selecting the group unit, he / she presses the button B4. In response to the pressing of the button B4, the system user terminal 60 transmits the input information to the evaluation support device 10. The input receiving unit 11 acquires the received input information as group unit information.

[0027] The group unit input screen may include a button B5 for requesting the display of policy evaluation data, as shown in Fig. 6. The policy evaluation data is original data used for analyzing the policy to be evaluated. The policy evaluation data will be described in detail later.

[0028] Fig. 7 is a diagram showing an example of an output screen in response to a request to display policy evaluation data. In response to an operator pressing button B5, the evaluation support device 10 outputs the policy evaluation data to the system user terminal 60. The system user terminal 60 displays an output information screen (W5) including policy evaluation data (D7) as shown in Fig. 7 via the output unit. As shown in Fig. 6, the group unit input screen includes a GUI for requesting the display of policy evaluation data, so that the operator of the system user terminal 60 can specify a group unit after grasping the trends in the data while viewing the original data.

[0029] The acquisition unit 12 acquires policy use data and evaluation item data.

[0030] The acquisition unit 12 searches the policy use database 70 using the evaluation target policy identification information accepted by the input acceptance unit 11. The acquisition unit 12 acquires policy use data of the evaluation target policy, which is the search result. The acquisition unit 12 also searches the evaluation item database 80 using the evaluation item information accepted by the input acceptance unit 11. The acquisition unit 12 acquires evaluation item data, which is the search result.

[0031] The policy use data will be described with reference to FIG. 8. FIG. 8 is a diagram showing an example of the policy use data. The policy use data is data in which the identification information of a user and data indicating the usage of the policy to be evaluated are associated with each other. The data indicating the usage of the policy to be evaluated includes the number of times the policy to be evaluated is used, the date and time of use, and the usage rate. In the example shown in FIG. 8, the data indicating the usage of the policy to be evaluated is the number of times the policy is used, which is statistically calculated by year. The identification information of a user is information for uniquely identifying a user. For example, the identification information of a user includes the user's national identification number, citizen identification number, name, address, date of birth, sex, degree of need for care, and number of household members. The national identification number is a number given to a citizen to identify a specific individual. For example, the national identification number includes an individual number, a social security number, and a national insurance number. The citizen identification number is a number given by each local government to identify each citizen. In the example shown in FIG. 8, the identification information of a user is the user's citizen identification number, name, address, and date of birth.

[0032] Next, the evaluation item data will be described with reference to FIG. 9. FIG. 9 is a diagram showing an example of the evaluation item data. The evaluation item data is data in which the user's identification information and data previously associated with the evaluation item are associated. For each evaluation item, evaluation item data to be acquired is previously determined. For example, when the evaluation item is "medical cost reduction", the evaluation item data is medical cost. For example, when the evaluation items are "health promotion" and "lifestyle-related disease improvement", the evaluation item data is medical examination result data. As described above, the user's identification information includes the user's national identification number, citizen identification number, name, address, date of birth, sex, degree of care required, and number of people in the household. In the example shown in FIG. 9, the evaluation item data is medical cost statistically calculated by year. Also, in the example shown in FIG. 9, the user's identification information is the citizen identification number and name.

[0033] The policy evaluation data generating unit 13 generates policy evaluation data to be used for evaluating the policy to be evaluated, using the policy use data and the evaluation item data acquired by the acquiring unit 12. The policy evaluation data generating unit 13 combines the policy use data and the evaluation item data using the user's identification information included in each data. The policy evaluation data generating unit 13 may conceal personal information when combining the data. Furthermore, if the user's identification information is not sufficiently associated with the usage status of the policy to be evaluated, the policy evaluation data generating unit 13 may further combine the user's identification information acquired from another database. Whether the user's identification information is sufficient is determined, for example, for each evaluation item. Necessary identification information is stored in advance for each evaluation item. If all necessary identification information is not available, the policy evaluation data generating unit 13 determines that the identification information is insufficient, and further combines the missing identification information.

[0034] An example of the process performed by the policy evaluation data generating unit 13 will be described with reference to Figs. 8 to 10. Fig. 10 is a diagram showing an example of policy evaluation data. It is assumed that the acquiring unit 12 acquires the policy use data shown in Fig. 8 and the evaluation item data shown in Fig. 9. For example, in this case, the policy evaluation data generating unit 13 combines data having the same national ID number. When generating the policy evaluation data, the policy evaluation data generating unit 13 may discard data that is not used for policy evaluation or data that is to be kept secret. For example, the policy evaluation data generating unit 13 may discard the name of the user when generating the policy evaluation data. In the example shown in Fig. 10, the national ID number and the name are discarded from among the identification information of the user shown in Fig. 8. In addition, the policy evaluation data generating unit 13 may rewrite the data so that only the data necessary for policy evaluation remains. For example, the policy evaluation data generating unit 13 may rewrite the address of the user to a value that can be identified only by the district of the user. In the example shown in Fig. 10, the address is rewritten to information indicating the district. In the example shown in FIG. 10, the date of birth is rewritten to information indicating only the year. If the user's identification information is not sufficiently associated with the usage status of the policy to be evaluated, the policy evaluation data generation unit 13 may further combine the user's identification information acquired from another database. For example, if the identification information included in the policy evaluation data is only the national identification number, the policy evaluation data generation unit 13 requests the acquisition unit 12 to search for the user's identification information. In response to the request from the policy evaluation data generation unit 13, the acquisition unit 12 searches other databases using the national identification number as a search key. For example, the acquisition unit 12 searches databases owned by each local government. Then, the acquisition unit 12 acquires other identification information linked to the national identification number. The policy evaluation data generation unit 13 combines the newly acquired user's identification information with the generated policy evaluation data.

[0035] The graph determination unit 14 determines the display form and graph axes of a graph included in the policy effect information, which is output information of the evaluation support device 10. The graph determination unit 14 determines the display form and graph axes of a graph using evaluation item information and group unit information. The display form of a graph refers to the type of graph, such as a bar graph, a band graph, a pie chart, and a line graph. The graph axis is the value of the axis of the graph. For example, in the case of an XY two-axis graph, the graph axis refers to the value of the X axis and the value of the Y axis. Note that the display form and graph axis of a graph may be determined in advance according to the evaluation item and the group unit. In that case, the evaluation support device 10 does not need to have the graph determination unit 14.

[0036] For example, the graph determination unit 14 may determine the display form and graph axes of the graph by inputting the evaluation items and group unit information into a trained model that has been machine-learned. The trained model is a model trained by machine learning using the display form of a graph generated in the past, the graph axes of the generated graph, the evaluation items, and the group units as teacher data. The output of the trained model is the display form and graph axes of the graph.

[0037] For example, the graph determination unit 14 may input a prompt for identifying the type of graph and determine the display form and graph axes of the graph using a large language model LLM (Large Language Model). LLM is a type of AI (Artificial Intelligence) for generating natural language processing models. For example, the prompt for identifying the type of graph is a question sentence with reference information added. The question sentence prompts an answer regarding the display form and graph axes of the graph to be generated. The reference information includes the display form of a graph generated in the past, the graph axes, evaluation item information, and group unit information. The reference information also includes the evaluation item information and group unit information of the graph to be generated. The above-mentioned reference information is an example and may include other information.

[0038] The policy effect information generating unit 15 tally up policy evaluation data according to the attributes of the specified policy users. The policy effect information generating unit 15 generates policy effect information using the tallied data. The attributes of the specified policy users refer to group unit information inputted via the input receiving unit 11. If no group unit is specified, the attributes of the specified policy users refer to a group unit determined in advance according to the evaluation items.

[0039] Next, the policy effect information will be described with reference to Figures 11 and 12. The policy effect information may be one or more.

[0040] Fig. 11 is a diagram showing an example of policy effect information. In the example of Fig. 11, the policy effect information is aggregated data aggregated according to evaluation items and group units. In the example of Fig. 11, the aggregated data is displayed in a table format. The aggregated data does not have to be displayed in a table format as shown in Fig. 11.

[0041] Fig. 12 is a diagram showing an example of policy effect information. In the example of Fig. 12, the policy effect information is a graph created using aggregated data. The graph is created using the graph display format and graph axes determined by the graph determination unit 14.

[0042] The output unit 16 outputs the generated policy effect information. The output unit 16 transmits the output information including the policy effect information generated by the policy effect information generating unit 15 to the system user terminal 60. The output information will be described with reference to FIG. 13. FIG. 13 is a diagram showing an example of the output information. For example, the output information is provided by an output information screen (W5) including the policy effect information (D8, D9). The output information screen may include a GUI (B6) for receiving a request to edit the policy effect information (D8, D9). The output information screen may include a GUI (B7) for receiving a request to change the grouping. The output information screen may include a GUI (B8) for receiving a request to change the evaluation items. The output information screen may also include a GUI (B9) for receiving a request to end the process from a user. The output information screen may include information other than the above-mentioned information.

[0043] (operation) Next, an example of the operation of the evaluation support device 10 in this embodiment will be described with reference to the drawings. Fig. 14 is a flowchart showing an example of the operation of the evaluation support device in the present disclosure.

[0044] 14, first, the input reception unit 11 receives input of the policy identification information to be evaluated and the evaluation item information (step S101). The input reception unit 11 requests the system user terminal 60 to input the policy identification information to be evaluated and the evaluation item information. The input reception unit 11 acquires the input information from the system user terminal 60 as the policy identification information to be evaluated and the evaluation item information.

[0045] Next, the acquisition unit 12 acquires policy utilization data and evaluation item data using the evaluation target policy identification information and evaluation item information (step S102). The acquisition unit 12 searches the policy utilization database 70 using the evaluation target policy identification information. The acquisition unit 12 acquires the policy utilization data of the evaluation target policy, which is the search result. The acquisition unit 12 also searches the evaluation item database 80 using the evaluation item information. The acquisition unit 12 acquires the evaluation item data, which is the search result.

[0046] Next, the policy evaluation data generation unit 13 generates policy evaluation data to be used for evaluating the policy to be evaluated, using the policy use data and evaluation item data acquired by the acquisition unit 12 (step S103). The policy evaluation data generation unit 13 combines the policy use data and the evaluation item data, using the user identification information included in each data.

[0047] Next, the input accepting unit 11 accepts the input of group unit information. When accepting the input of group unit information, the input accepting unit 11 accepts a request to output policy evaluation data (step S104). If the input accepting unit 11 has not received a request to output policy evaluation data (No in step S104), the input accepting unit 11 proceeds to the process of step S106. If the input accepting unit 11 has received a request to output policy evaluation data (Yes in step S104), the input accepting unit 11 outputs the policy evaluation data to the system user terminal 60 (step S105). Thereafter, the input accepting unit 11 accepts the input of group unit information (step S106).

[0048] Next, the graph determination unit 14 determines the display format and graph axes of the graph included in the policy effect information, using the evaluation item information and the group unit information (step S107).

[0049] Next, the policy effect information generating unit 15 uses the policy evaluation data to generate policy effect information that indicates the effect of the policy to be evaluated (step S108). For example, the policy effect information includes aggregated data that is aggregated according to the evaluation items and group units. For example, the policy effect information includes a graph generated using the aggregated data. The graph is created using the graph display form and graph axes determined by the graph determining unit 14.

[0050] Next, the output unit 16 outputs the output information including the generated policy effect information (step S109).

[0051] Next, the input reception unit 11 receives a group-based change request from the system user terminal 60 (step S110). If a group-based change request is received (Yes in step S110), the evaluation support device 10 repeats the process from step S106 onwards. If a group-based change request is not received (No in step S110), the evaluation support device 10 proceeds to the process of step S111.

[0052] Next, the input reception unit 11 receives a request to change an evaluation item from the system user terminal 60 (step S111). If a request to change an evaluation item is received (Yes in step S111), the evaluation support device 10 repeats the process from step S101 onwards. If a request to change an evaluation item is not received (No in step S111), the evaluation support device 10 proceeds to the process of step S112.

[0053] Next, the evaluation support device 10 judges whether or not a termination condition is satisfied (step S112). For example, the termination condition is that the input receiving unit 11 receives a termination request from the system user terminal 60. The termination condition may be that no input is made from the system user terminal 60 for a certain period of time. The evaluation support device 10 repeats the processes of steps S109 to S112 until the termination condition is satisfied (No in step S112). When the termination condition is satisfied (Yes in step S112), the evaluation support device 10 terminates the series of processes described above.

[0054] As described above, the evaluation support device of this embodiment includes an acquisition unit, a policy evaluation data generation unit, a policy effect information generation unit, and an output unit. The acquisition unit acquires policy use data indicating the utilization status of the policy to be evaluated, and evaluation item data related to the purpose of the policy to be evaluated. The policy evaluation data generation unit generates policy evaluation data to be used in evaluating the policy to be evaluated, using the policy use data and the evaluation item data. The policy effect information generation unit aggregates the policy evaluation data according to the attributes of the specified policy users, and generates policy effect information indicating the effect of the policy to be evaluated. The output unit outputs the generated policy effect information.

[0055] The evaluation support device of this embodiment, with the above configuration, can provide evaluation data of a policy that allows the review of the scope of application of the policy. The reason is that the policy evaluation data is collected according to the attributes of the policy user. The scope of application of a policy implemented by a local government may be predetermined. For example, the applicable age is predetermined for a policy regarding the elderly. If the attribute of the specified policy user is age, the evaluation support device outputs policy effect information collected according to age. The user of the evaluation support device can grasp the age class in which the policy effect is maximized from the policy effect information collected according to age. In other words, the evaluation support device of this embodiment can grasp the scope of application in which the policy effect is maximized. This allows the user of the evaluation support device to review the scope of application, for example, by limiting the scope of application of the policy to the range in which the policy effect is maximized.

[0056] The evaluation support device according to one aspect of the present embodiment further includes an input receiving unit. The input receiving unit receives input of evaluation target policy identification information, evaluation item information, and group unit information. The evaluation item information is information for acquiring evaluation item data. The group unit information is information for identifying attributes of a policy user. The acquiring unit acquires policy use data using the evaluation target identification information. The acquiring unit also acquires evaluation item data using the evaluation item information. With the above configuration, the evaluation support device according to one aspect of the present embodiment can evaluate items that the user wants to evaluate, rather than items that are predetermined. Furthermore, when receiving the input of the group unit information, the input receiving unit further accepts an input requesting output of policy evaluation data. This allows the user of the evaluation support device to specify a group unit after grasping the trends of the data while viewing the original data.

[0057] The evaluation support device according to one aspect of the present embodiment further includes a graph determination unit. The graph determination unit determines the display form and graph axes of a graph representing the policy effect information. The policy effect information generation means generates a graph according to the determined display form and graph axes. The output means outputs the graph as the policy effect information. The graph determination unit inputs evaluation items and group unit information to a machine-learned trained model, and determines the display form and graph axes of the graph according to the output from the trained model. The trained model is machine-learned using previously generated graph display forms, graph axes, evaluation item information for acquiring evaluation item data, and group unit information for identifying attributes of policy users as teacher data. Alternatively, the graph determination unit inputs a prompt for identifying the type of graph to the large-scale language model, and determines the display form and graph axes of the graph according to the output from the large-scale language model. The graph determination means determines the display form and graph axes of the graph by inputting a prompt for identifying the type of graph to the large-scale language model. The prompt is a question sentence to which reference information is added. The reference information includes the display form of a graph generated in the past, graph axes, evaluation item information for acquiring evaluation item data, and group units for identifying attributes of policy users, as well as the evaluation items and group units of a graph to be generated. Depending on the policy, the combinations of evaluation items and group units may be enormous. In such cases, it may be difficult to determine the display form and graph axes of the graph in advance for all combinations. The graph determination unit can determine the display form and graph axes of the graph using a machine-learned trained model or LLM. According to the evaluation support device of this embodiment, even if the display form and graph axes of the graph according to the evaluation items and group units are not determined in advance, the display form and graph axes of the graph can be determined.

[0058] [Second embodiment] Next, the evaluation support device in this embodiment will be described with reference to the drawings. The evaluation support device in this embodiment is different from the evaluation support device in the first embodiment in that it further includes a correlation analysis unit that calculates a correlation coefficient between two pieces of data input from a system user terminal. In the following description, the same reference numerals are used for the same parts as in the first embodiment, and the description will be omitted as appropriate.

[0059] (composition) 15 is a block diagram showing an example of the configuration of the evaluation support system according to the present disclosure. The evaluation support system 2 according to this embodiment includes an evaluation support device 20 and a system user terminal 60. The evaluation support device 20 includes an input receiving unit 21, an acquiring unit 22, a policy evaluation data generating unit 23, a graph determining unit 24, a policy effect information generating unit 25, an output unit 26, and a correlation analyzing unit 27.

[0060] The input receiving unit 21 receives input of correlation data information for calculating a correlation coefficient, in addition to the various information listed in the first embodiment.

[0061] FIG. 16 is an example of a correlation data information selection screen for designating data for obtaining correlation. The input receiving unit 21 displays a correlation data information selection screen (W6) on the output unit of the system user terminal 60 in order to receive input of correlation data information from the system user terminal 60. The correlation data information selection screen includes list information (D10) of data for obtaining correlation. The data for obtaining correlation includes data A and data B. One of the data for obtaining correlation (data A) is data related to the attributes of the policy user. The other (data B) is an evaluation item related to the purpose of the policy. The operator of the system user terminal 60 selects one piece of data each from data A and data B from the list information of data for obtaining correlation via the input unit of the system user terminal 60. When the operator of the system user terminal 60 finishes selecting correlation data, he or she presses a button B11. In response to the pressing of the button B11, the system user terminal 60 transmits the input information to the evaluation support device 10. The input receiving unit 11 acquires the received input information as correlation data information. The data for calculating the correlation may include data C representing the usage status of the policy. The data representing the usage status may include, for example, the number of times the policy has been used, the number of years the policy has been used, etc. In this case, any two of data A, data B, and data C are selected as the correlation data information. The correlation data information may also be information that combines any of data A, data B, and data C.

[0062] The correlation data information selection screen may include a button B10 for requesting the display of policy evaluation data, as shown in Fig. 16. By including a GUI for requesting the display of policy evaluation data in the correlation data information selection screen, the operator of the system user terminal 60 can specify correlation data after grasping the trends of the data while viewing the original data.

[0063] The acquisition unit 22 acquires the policy use data and the evaluation item data.

[0064] The policy evaluation data generating unit 23 uses the policy use data and the evaluation item data acquired by the acquiring unit 22 to generate policy evaluation data to be used for evaluating the policy to be evaluated.

[0065] The graph determination unit 24 determines the display mode and graph axes of the graph included in the policy effect information.

[0066] The policy effect information generating unit 25 collects policy evaluation data according to the attributes of the designated policy users, and generates policy effect information using the collected data.

[0067] The correlation analysis unit 27 performs a correlation analysis using the policy evaluation data. The correlation analysis unit 27 calculates a correlation coefficient between two pieces of data inputted from the system user terminal 60.

[0068] Next, an example of the process performed by the correlation analysis unit 27 will be described with reference to Fig. 17. Fig. 17 is a diagram showing an example of a correlation analysis result. For example, it is assumed that the input reception unit 11 receives the age of the policy user and the medical cost reduction rate from the previous year as correlation data information. In this case, the correlation analysis unit 27 uses the policy evaluation data to calculate a correlation coefficient with the medical cost reduction rate for each age class of the policy user. The correlation analysis unit 27 generates a correlation analysis result as shown in Fig. 17 using the correlation coefficient calculated for each age class of the policy user.

[0069] The correlation analysis unit 27 may generate a scatter diagram as a result of the correlation analysis. The scatter diagram is plotted by setting two pieces of data accepted by the input acceptance unit 11 on two axes.

[0070] FIG. 18 is a diagram showing an example of a correlation analysis result. For example, it is assumed that the input receiving unit 11 receives the age of the policy user and the medical cost reduction rate from the previous year as correlation data information. In this case, the correlation analysis unit 27 sets the age of the policy user on the horizontal axis and the medical cost reduction rate on the vertical axis, and plots a scatter diagram. The correlation analysis unit 27 may plot all data included in the policy evaluation data. Alternatively, the correlation analysis unit 27 may plot data randomly selected from the data included in the policy evaluation data.

[0071] The output unit 26 outputs output information including the generated policy effect information and the correlation analysis result. The policy effect information included in the output information is the same as that described in the first embodiment, and therefore a description thereof will be omitted.

[0072] Next, the correlation analysis result included in the output information will be described with reference to FIG. 19. FIG. 19 is a diagram showing an example of the output information. For example, the output information of the correlation analysis result is provided by an output information screen (W7) including the correlation analysis result (D11, D12). The correlation analysis result information may be rearranged in descending order of correlation value as shown in D12. This allows the attributes of policy users with strong positive correlation to be more intuitively understood. In addition, the output unit 26 may extract only data whose correlation coefficient exceeds a predetermined value from the correlation analysis result information and output the extracted data. The output information screen may include information (D13) indicating a group with strong positive correlation. The output information screen may include a GUI (B12) for accepting an edit request for the correlation analysis result. The output information screen may include a GUI (B13) for accepting a change request for the correlation data. Furthermore, the output information may include a GUI (B14) for accepting a request to end the process from a user. The output information screen may include information other than the above-mentioned information.

[0073] (operation) Next, an example of the operation of the evaluation support device 20 in this embodiment will be described with reference to Fig. 20 to Fig. 23. Fig. 20 to Fig. 23 are flowcharts showing an example of the operation of the evaluation support device in the present disclosure.

[0074] In FIG. 20, first, the evaluation support device 20 performs a policy data generation process (step S201).

[0075] The policy data generation processing will be described with reference to Fig. 21. Fig. 21 is a flowchart showing an example of the operation of the policy data generation processing.

[0076] In FIG. 21, first, the input receiving unit 21 receives input of evaluation target policy identification information and evaluation item information (step S2011).

[0077] Next, the acquisition unit 22 acquires policy utilization data and evaluation item data using the evaluation target policy identification information and the evaluation item information (step S2012).

[0078] Next, the policy evaluation data generating unit 23 generates policy evaluation data to be used for evaluating the policy to be evaluated, using the policy use data and the evaluation item data acquired by the acquiring unit 22 (step S2013). After completing the process of step S2013, the evaluation support device 20 ends the policy data generating process shown in Fig. 21 (proceeds to step S202 in Fig. 20).

[0079] The explanation will be returned to the process in Fig. 20. After completing the policy evaluation data generation process shown in Fig. 21, the evaluation support device 20 performs a group unit information input reception process (step S202).

[0080] The group unit information input reception process will be described with reference to Fig. 22. Fig. 22 is a flowchart showing an example of the operation of the group unit information input reception process.

[0081] 22, first, the input receiving unit 21 receives a request to output policy evaluation data (step S2021). If the input receiving unit 21 has not received a request to output policy evaluation data (No in step S2021), the process proceeds to step S2022. If the input receiving unit 21 has received a request to output policy evaluation data (Yes in step S2021), the input receiving unit 21 outputs the policy evaluation data to the system user terminal 60 (step S2022).

[0082] Next, the input receiving unit 21 receives an input of group unit information (step S2023). After completing the process of step S2023, the evaluation support device 20 ends the group unit information input process shown in Fig. 22 (proceeds to step S203 in Fig. 20).

[0083] The description will be returned to the process in Fig. 20. After the group unit information input reception process shown in Fig. 22 is completed, the evaluation support device 20 performs correlation data information input reception process (step S203).

[0084] The correlation data information input reception process will be described with reference to Fig. 23. Fig. 23 is a flowchart showing an example of the operation of the correlation data information input reception process.

[0085] 23, first, the input receiving unit 21 receives a request to output policy evaluation data (step S2031). If the input receiving unit 21 has not received a request to output policy evaluation data (No in step S2031), the process proceeds to step S2022. If the input receiving unit 21 has received a request to output policy evaluation data (Yes in step S2031), the input receiving unit 21 outputs the policy evaluation data to the system user terminal 60 (step S2032).

[0086] Next, the input receiving unit 21 receives the input of correlation data information (step S2033). The correlation data information is two pieces of data for determining correlation. After completing the process of step S2023, the evaluation support device 20 ends the correlation data information input receiving process shown in FIG. 23 (proceeds to step S204 in FIG. 20).

[0087] Returning the explanation to the process in Fig. 20, when the correlation data information input reception process shown in Fig. 23 is completed, the graph determination unit 24 determines the display form and graph axes of the graph included in the policy effect information, using the evaluation item information and the group unit information (step S204).

[0088] Next, the policy effect information generating unit 25 uses the policy evaluation data to generate policy effect information that indicates the effects of the policy to be evaluated (step S205).

[0089] Next, the correlation analysis unit 27 performs correlation analysis using the correlation data information and the policy evaluation data received in step S203 (step S206). The correlation analysis unit 27 generates correlation analysis result information indicating the result of the correlation analysis. The correlation analysis result information may be in a table format as shown in FIG. 17 or may be a scatter diagram as shown in FIG. 18.

[0090] Next, the output unit 26 outputs output information including the generated policy effect information and the correlation analysis result (step S207).

[0091] Next, the input reception unit 21 receives a correlation data change request from the system user terminal 60 (step S208). If a correlation data change request is received (Yes in step S208), the evaluation support device 20 repeats the processes from step S203 onward. If a request to change an evaluation item is not received (No in step S203), the evaluation support device 20 proceeds to step S209.

[0092] Next, the input reception unit 21 receives a group-based change request from the system user terminal 60 (step S209). If a group-based change request is received (Yes in step S209), the evaluation support device 20 repeats the process from step S202 onwards. If a group-based change request is not received (No in step S209), the evaluation support device 20 proceeds to the process of step S210.

[0093] Next, the input reception unit 21 receives a request to change an evaluation item from the system user terminal 60 (step S210). If a request to change an evaluation item is received (Yes in step S210), the evaluation support device 20 repeats the processes from step S201 onward. If a request to change an evaluation item is not received (No in step S210), the evaluation support device 20 proceeds to the process of step S211.

[0094] Next, the evaluation support device 20 judges whether or not a termination condition is satisfied (step S211). For example, the termination condition is that the input receiving unit 21 receives a termination request from the system user terminal 60. The termination condition may be that no input is made from the system user terminal 60 for a certain period of time. The evaluation support device 20 repeats the processes of steps S207 to S211 until the termination condition is satisfied (No in step S211). When the termination condition is satisfied (Yes in step S211), the evaluation support device 20 terminates the series of processes described above.

[0095] The evaluation support device in this embodiment is configured as described above. In addition to the effects described in the first embodiment, the evaluation support device in this embodiment provides the following effects.

[0096] The evaluation support device in this embodiment further includes a correlation analysis unit. The correlation analysis unit performs correlation analysis using correlation data information and policy evaluation data. The correlation data information is data for determining correlation, and includes evaluation items related to the purpose of the policy and attributes of the policy user. The correlation analysis unit generates correlation analysis result information, which is the analysis result. The output unit further outputs the correlation analysis result information. As a result, the evaluation support device in this embodiment can provide evaluation data of a policy that allows the review of the application range of the policy. This is because the correlation analysis result makes it possible to grasp the attributes of the policy user that have a strong positive correlation with the policy effect. As a result, for example, the user of the evaluation support device can review the application range of the policy, such as limiting the application range of the policy to a range where the policy effect is maximized. In addition, the correlation analysis result may be a scatter diagram. As a result, the user of the evaluation support device can more intuitively grasp the range where the correlation between the policy effect and the attributes of the policy user is strong.

[0097] [Third embodiment]

[0098] (composition) Next, the configuration of the evaluation support device in this embodiment will be described with reference to the drawings. The evaluation support device 30 is a simplified configuration of the evaluation support device according to each embodiment. In the following description, the description of the same parts as those in the first or second embodiment will be omitted as appropriate.

[0099] 24 is a block diagram showing an example of the configuration of an evaluation support device in the present disclosure. The evaluation support device 30 includes an acquisition unit 32, a policy evaluation data output unit 33, a policy effect information generation unit 35, and an output unit .

[0100] The acquisition unit 32 acquires policy use data indicating the utilization status of the policy to be evaluated, and evaluation item data related to the purpose of the policy to be evaluated. The policy evaluation data output unit 33 uses the policy use data and the evaluation item data to generate policy evaluation data to be used in evaluating the policy to be evaluated. The policy effect information generation unit 35 aggregates the policy evaluation data according to the attributes of the specified policy users, and generates policy effect information indicating the effect of the policy to be evaluated. The output unit 36 ​​outputs the generated policy effect information.

[0101] (operation) Next, an example of the operation of the evaluation support device according to the present disclosure will be described with reference to FIG.

[0102] First, the acquisition unit 32 acquires policy utilization data indicating the utilization state of the policy to be evaluated, and evaluation item data related to the purpose of the policy to be evaluated (step S31).

[0103] Next, the policy evaluation data output unit 33 uses the policy use data and the evaluation item data to generate policy evaluation data to be used for evaluating the policy to be evaluated (step S32).

[0104] Next, the policy effect information generating unit 35 collects the policy evaluation data according to the attributes of the specified policy users, and generates policy effect information that indicates the effect of the policy to be evaluated (step S33).

[0105] Next, the output unit 36 ​​outputs the generated policy effect information (step S34).

[0106] The evaluation support device of this embodiment outputs policy effect information compiled according to the attributes of policy users. The policy effect information is the evaluation result of the policy to be evaluated. The evaluation result of the policy to be evaluated can be applied to reviewing the scope of application of the policy. Therefore, according to the evaluation support device of this embodiment, it is possible to provide evaluation data of a policy that can be applied to reviewing the scope of application of the policy.

[0107] [Hardware configuration] The functions of each of the components in each of the embodiments of the present disclosure described above can be realized not only by hardware but also by a computer device and firmware based on program control.

[0108] Fig. 26 is a diagram showing an example of a hardware configuration in which the evaluation support device in the present disclosure is realized by a computer device 90 including a processor. The evaluation support device of each embodiment is realized by the computer device 90. As shown in Fig. 26, the computer device 90 includes a CPU (Central Processing Unit) 91, a memory 92, a storage device 93 such as a hard disk for storing programs, an input / output interface 94 for connecting input devices and output devices, and a communication interface 95 for connecting to a network.

[0109] The CPU 91 runs an operating system to control the evaluation support device of the present disclosure. For example, the CPU 91 reads out programs and data from a storage medium mounted in a drive device or the like to a memory 92. The CPU 91 also functions as a part of the acquisition unit 32, policy evaluation data output unit 33, policy effect information generation unit 35, and output unit 36 ​​in the evaluation support device 30 of the present disclosure, and executes processes or commands based on the programs.

[0110] The storage device 93 is, for example, an optical disk, a flexible disk, a magneto-optical disk, an external hard disk, or a semiconductor memory. A part of the storage device is a storage medium that is a non-volatile storage device, and the program is recorded therein. The program may also be downloaded from an external computer (not shown) connected to a communication network.

[0111] The input device connected to the input / output interface 94 is realized by, for example, a mouse, a keyboard, etc., and is used for input operations. Similarly, the output device connected to the input / output interface 94 is realized by, for example, a display, etc., and is used for displaying and checking output results.

[0112] Although the present disclosure has been described above with reference to each embodiment, the present disclosure is not limited to the above embodiment. The configuration and details of the present disclosure can be modified in various ways that can be understood by a person skilled in the art within the scope of the present disclosure. For example, although multiple operations are described in order in the form of a flowchart, the order of description does not limit the order in which the multiple operations are performed. Therefore, when implementing each embodiment, the order of the multiple operations can be changed to the extent that the content is not affected.

[0113] Some or all of the above embodiments can be described as follows.

[0114] (Appendix 1) An acquisition means for acquiring policy utilization data indicating a utilization status of the policy to be evaluated and evaluation item data related to the purpose of the policy to be evaluated; a policy evaluation data generating means for generating policy evaluation data to be used for evaluating a policy to be evaluated, using the policy use data and the evaluation item data; a policy effect information generating means for aggregating the policy evaluation data according to attributes of designated policy users and generating policy effect information representing the effects of the policy to be evaluated; an output means for outputting the policy effect information; An evaluation support device comprising: (Appendix 2) further comprising an input receiving means for receiving input of evaluation target policy specification information for acquiring the policy use data, evaluation item information for acquiring the evaluation item data, and group unit information for identifying attributes of the policy users; The evaluation support device according to claim 1, wherein the acquisition means acquires the policy use data by using the evaluation target policy identification information, and further acquires the evaluation item data by using the evaluation item information. (Appendix 3) the input receiving means, when receiving the input of the group unit information, further receives an input requesting output of the policy evaluation data; 3. The evaluation support device according to claim 2, wherein the output means outputs the policy evaluation data upon receiving the request. (Appendix 4) a graph determining means for determining a display form and graph axes of a graph representing the policy effect information, the policy effect information generating means generates the graph according to the determined display format and graph axes; 4. The evaluation support device according to claim 1, wherein the output means outputs the graph as policy effect information. (Appendix 5) The graph determination means inputting the evaluation items and group unit information into a trained model that has been machine-learned using as training data the display format of a previously generated graph, graph axes, evaluation item information for acquiring the evaluation item data, and group unit information for identifying attributes of the policy users; The evaluation support device according to claim 4, further comprising: determining a display format and graph axes of a graph according to an output from the trained model. (Appendix 6) The graph determination means inputting a prompt to identify a type of graph into a large-scale language model, and determining a display format and graph axes of the graph in response to an output from the large-scale language model; The prompt is a question with additional information, The question prompts the user to answer questions about the display format and graph axes of a graph to be generated, The evaluation support device described in Appendix 4, wherein the reference information includes the display format of previously generated graphs, graph axes, evaluation item information for obtaining the evaluation item data, and group units for identifying attributes of the policy users, as well as the evaluation items and group units of the graph to be generated. (Appendix 7) A correlation analysis means for performing a correlation analysis using correlation data information, which is data for determining a correlation, and the policy evaluation data, and generating correlation analysis result information, which is an analysis result, is further provided. The correlation data information includes evaluation items related to the objectives of the policy to be evaluated and attributes of the policy users; 7. The evaluation support device according to claim 1, wherein the output means further outputs the correlation analysis result information. (Appendix 8) An evaluation support device according to any one of appendix 1 to 7, A system user terminal which is an output destination of the policy effect information; An evaluation support system comprising: (Appendix 9) The computer Obtain policy utilization data indicating the utilization status of the policy to be evaluated and evaluation item data related to the purpose of the policy to be evaluated; generating policy evaluation data to be used for evaluating a policy to be evaluated, using the policy use data and the evaluation item data; aggregating the policy evaluation data according to attributes of designated policy users to generate policy effectiveness information representing the effectiveness of the policy to be evaluated; Output the policy effect information Evaluation support methods. (Appendix 10) the computer further receives input of evaluation target policy specification information for acquiring the policy use data, evaluation item information for acquiring the evaluation item data, and group unit information for identifying attributes of the policy users; An evaluation support method as described in Appendix 9, wherein, in the acquisition, the policy use data is acquired using the policy identification information to be evaluated, and the evaluation item data is acquired using the evaluation item information. (Appendix 11) In the receiving of the input, when receiving the input of the group unit information, the computer further receives an input requesting output of the policy evaluation data. The evaluation support method according to claim 10, wherein the output outputs the policy evaluation data when the request is accepted. (Appendix 12) The computer further determines a display format and graph axes of the graph representing the policy effect information; generating the graph according to the determined display format and graph axes; 12. The evaluation support method according to claim 9, wherein the output means outputs the graph as the policy effect information. (Appendix 13) The evaluation support method described in Appendix 12, wherein in determining the display form and graph axes of the graph, a computer inputs evaluation items and group-unit information into a trained model that has been machine-learned using previously generated graph display forms, graph axes, evaluation item information for obtaining the evaluation item data, and group-unit information for identifying the attributes of the policy users as training data, and determines the display form and graph axes of the graph according to the output from the trained model. (Appendix 14) In determining the display form and graph axes of the graph, the computer inputs a prompt for identifying a type of graph into a large-scale language model, and determines the display form and graph axes of the graph according to an output from the large-scale language model; The prompt is a question with additional information, The question prompts the user to answer questions about the display format and graph axes of a graph to be generated, An evaluation support method as described in Appendix 12, wherein the reference information includes the display format of previously generated graphs, graph axes, evaluation item information for obtaining the evaluation item data, and group units for identifying the attributes of the policy users, as well as the evaluation items and group units of the graph to be generated. (Appendix 15) The computer further performs a correlation analysis using correlation data information, which is data for determining a correlation, and the policy evaluation data, and generates correlation analysis result information, which is an analysis result; The correlation data information includes evaluation items related to the objectives of the policy to be evaluated and attributes of the policy users; The evaluation support method according to any one of appendixes 9 to 14, wherein the output further comprises outputting the correlation analysis result information. (Appendix 16) On the computer, A process of acquiring policy utilization data indicating a utilization status of the policy to be evaluated and evaluation item data related to the purpose of the policy to be evaluated; A process of generating policy evaluation data to be used for evaluating a policy to be evaluated, using the policy use data and the evaluation item data; a process of aggregating the policy evaluation data according to attributes of designated policy users and generating policy effect information representing the effect of the policy to be evaluated; A process of outputting the policy effect information; A program to execute. (Appendix 17) further causing the computer to execute a process of receiving input of evaluation target policy specification information for acquiring the policy use data, evaluation item information for acquiring the evaluation item data, and group unit information for identifying attributes of the policy users; The program described in Appendix 16, wherein in the acquisition process, the policy use data is acquired using the policy information to be evaluated, and the evaluation item data is acquired using the evaluation item information. (Appendix 18) causing the computer to further execute a process of receiving an input requesting output of the policy evaluation data when receiving the input of the group unit information; 18. The program according to claim 17, further outputting the policy evaluation data when the request is accepted in the output process. (Appendix 19) causing the computer to execute a process of determining a display form and graph axes of a graph representing the policy effect information; generating the graph according to the determined display format and graph axes in the process of generating the policy effect information; 19. The program according to any one of appendices 16 to 18, wherein in the output process, the graph is output as the policy effect information. (Appendix 20) The program described in Appendix 19, in which, in the process of determining the display form and graph axes of the graph, evaluation items and group-unit information are input into a trained model that has been machine-learned using previously generated graph display forms, graph axes, evaluation item information for obtaining the evaluation item data, and group-unit information for identifying the attributes of the policy users as training data, and the display form and graph axes of the graph are determined according to the output from the trained model. (Appendix 21) In the process of determining the display form and graph axes of the graph, a prompt for identifying a type of graph is input to a large-scale language model, and the display form and graph axes of the graph are determined in response to an output from the large-scale model; The prompt is a question with additional information, The question prompts the user to answer questions about the display format and graph axes of a graph to be generated, The program described in Appendix 19, wherein the reference information includes the display format of previously generated graphs, graph axes, evaluation item information for obtaining the evaluation item data, and group units for identifying attributes of the policy users, as well as the evaluation items and group units of the graph to be generated. (Appendix 22) further causing the computer to execute a process of performing a correlation analysis using correlation data information, which is data for determining a correlation, and the policy evaluation data, and generating correlation analysis result information, which is an analysis result; The correlation data information includes evaluation items related to the objectives of the policy to be evaluated and attributes of the policy users; 22. The program according to any one of appendixes 16 to 21, further outputting the correlation analysis result information in the output processing. [Explanation of symbols]

[0115] 1, 2 Evaluation support system 10, 20, 30 Evaluation support device 11, 21 Input reception section 12, 22, 32 Acquisition part 13, 23 Policy Evaluation Data Generation Department 14, 24 Graph decision unit 15, 25, 35 Policy Effect Information Generation Division 16, 26, 36 Output section 27 Correlation Analysis Department 60 System user terminal 70 Policy Use Database 80 Evaluation Item Database 90 Computer Equipment 91 CPU(Central Processing Unit) 92 Memory 93 Storage device 94 Input / Output Interface 95 Communication Interface

Claims

1. An acquisition means for acquiring policy utilization data indicating a utilization status of the policy to be evaluated and evaluation item data related to the purpose of the policy to be evaluated; a policy evaluation data generating means for generating policy evaluation data to be used for evaluating a policy to be evaluated, using the policy use data and the evaluation item data; a policy effect information generating means for aggregating the policy evaluation data according to attributes of designated policy users and generating policy effect information representing the effects of the policy to be evaluated; an output means for outputting the policy effect information; An evaluation support device comprising:

2. further comprising an input receiving means for receiving input of evaluation target policy specification information for acquiring the policy use data, evaluation item information for acquiring the evaluation item data, and group unit information for identifying attributes of the policy users; 2. The evaluation support device according to claim 1, wherein the acquisition means acquires the policy use data by using the evaluation target policy specification information, and acquires the evaluation item data by using the evaluation item information.

3. the input receiving means, when receiving the input of the group unit information, further receives an input requesting output of the policy evaluation data; 3. The evaluation support device according to claim 2, wherein said output means further outputs said policy evaluation data when said request is received.

4. a graph determining means for determining a display form and graph axes of a graph representing the policy effect information, the policy effect information generating means generates the graph according to the determined display form and graph axes; The evaluation support device according to claim 1 , wherein the output means outputs the graph as the policy effect information.

5. The graph determination means inputting the evaluation items and group unit information into a trained model that has been machine-learned using as training data the display format of a previously generated graph, graph axes, evaluation item information for acquiring the evaluation item data, and group unit information for identifying attributes of the policy users; The evaluation support device according to claim 4 , further comprising: a display format and graph axes of the graph being determined according to an output from the trained model.

6. The graph determination means inputting a prompt to identify a type of graph into a large-scale language model, and determining a display format and graph axes of the graph in response to an output from the large-scale language model; The prompt is a question with additional information, The question prompts the user to answer questions about the display format and graph axes of a graph to be generated, 5. The evaluation support device of claim 4, wherein the reference information includes the display format of previously generated graphs, graph axes, evaluation item information for obtaining the evaluation item data, and group units for identifying attributes of the policy users, as well as the evaluation items and group units of the graph to be generated.

7. A correlation analysis means for performing a correlation analysis using correlation data information, which is data for determining a correlation, and the policy evaluation data, and generating correlation analysis result information, which is an analysis result, is further provided. The correlation data information includes evaluation items related to the objectives of the policy to be evaluated and attributes of the policy users; The evaluation support device according to claim 1 , wherein the output means further outputs the correlation analysis result information.

8. An evaluation support device according to any one of claims 1 to 7, A system user terminal which is an output destination of the policy effect information; An evaluation support system comprising:

9. The computer Obtain policy utilization data indicating the utilization status of the policy to be evaluated and evaluation item data related to the purpose of the policy to be evaluated; generating policy evaluation data to be used for evaluating a policy to be evaluated, using the policy use data and the evaluation item data; aggregating the policy evaluation data according to attributes of designated policy users to generate policy effectiveness information representing the effectiveness of the policy to be evaluated; Output the policy effect information Evaluation support methods.

10. On the computer, A process of acquiring policy utilization data indicating a utilization status of the policy to be evaluated and evaluation item data related to the purpose of the policy to be evaluated; A process of generating policy evaluation data to be used for evaluating a policy to be evaluated, using the policy use data and the evaluation item data; a process of aggregating the policy evaluation data according to attributes of designated policy users and generating policy effect information representing the effect of the policy to be evaluated; A process of outputting the policy effect information; A program to execute.

Images