Information providing device, information providing method, and information providing program
The information providing device addresses the burden on analysts by generating report-friendly overviews of data analysis processes, facilitating better communication of analysis results among stakeholders.
Patent Information
- Application Number
- JP2023141577
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-08-31
- Publication Date
- 2025-04-21
- Estimated Expiration
- 2043-08-31
AI Technical Summary
In analytical projects using data analysis tools, there is a lack of tools that facilitate the sharing and understanding of analysis results among project participants, leading to a significant burden on analysts to prepare separate report materials.
An information providing device that creates prompts for language models to generate sentences outlining the series of data analysis processes, and converts these outlines into report-friendly expressions, thereby reducing the analyst's burden in preparing reports.
The solution effectively reduces the analyst's workload in creating reports by automating the generation of analysis overviews, making it easier for stakeholders to understand the analysis content.
Smart Images

Figure 0007665697000001 
Figure 0007665697000002 
Figure 0007665697000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information providing device, an information providing method, and an information providing program. [Background technology]
[0002] In order to advance an analysis project, it is important to combine the analytical skills of the analyst with domain knowledge specific to the data, and close communication between the analyst and project stakeholders is essential to progress the project.
[0003] In recent years, data analysis tools are increasingly being provided in so-called no-code data analysis tool (e.g., application) environments. No-code data analysis tools have the advantage that they do not require programming skills and can be used intuitively even by beginners. This has partially reduced the amount of coding and other labor required for analysis. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2023-27964 A [Non-patent literature]
[0005] [Non-Patent Document 1] “No-code AI development tool Node-AI”, [online], [Retrieved July 21, 2023], Internet<https: / / sdpf.ntt.com / services / nodeai / > Summary of the Invention [Problem to be solved by the invention]
[0006] When an analysis project using a data analysis tool is progressing, it is necessary to share information such as analysis results among project participants. However, there is no tool that allows discussions about analysis to be completed. In addition, project personnel (hereinafter referred to as stakeholders) other than the person in charge of analysis (hereinafter referred to as the analyst) have difficulty understanding the analysis content just by looking at the analysis tool screen.
[0007] For this reason, analysts prepare separate reports on the content of the analysis performed on the tool.However, analysts are responsible for many tasks, such as deciding the analysis policy, conducting the analysis, and preparing the reports, and the task of preparing separate reports, especially for reports to other stakeholders, places a heavy burden on analysts.
[0008] The present invention has been made in consideration of the above, and has an object to provide an information providing device, an information providing method, and an information providing program that can reduce the burden of report creation work on an analyst. [Means for solving the problem]
[0009] In order to solve the above-mentioned problems and achieve the object, the information providing device of the present invention is characterized in having: a prompt creation unit that creates a prompt for causing a language model to generate a sentence indicating an overview of a series of processes related to data analysis based on execution parameters including parameters of each process and execution results of each process received from an analysis device executing a data analysis tool that generates a series of processes related to data analysis; a summary generation unit that generates a sentence indicating an overview of the series of processes by inputting the prompt generated by the prompt creation unit into the language model; and an expression conversion unit that converts the sentence indicating the overview generated by the summary generation unit into an expression suitable for a report, and displays the converted sentence indicating the overview of the series of processes on a terminal device. Effect of the Invention
[0010] According to the present invention, the burden of report creation work on an analyst can be reduced. [Brief description of the drawings]
[0011] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of an information providing system according to the first embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of the canvas data. [Diagram 3] FIG. 3 is a diagram showing an example of a summary list displayed on the screen of the related party terminal. [Figure 4] FIG. 4 is a diagram illustrating a process flow of the information providing system in the first embodiment. [Diagram 5] FIG. 5 is a sequence diagram illustrating a processing procedure of the information providing process according to the first embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of a configuration of an information providing system according to the second embodiment. [Figure 7] FIG. 7 is a diagram illustrating a process flow of the information providing system in the second embodiment. [Figure 8] FIG. 8 is a sequence diagram illustrating a processing procedure of the information providing process according to the second embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of a computer that realizes each of the components of the information providing system by executing a program. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. Note that the present invention is not limited to this embodiment. In addition, in the description of the drawings, the same parts are indicated by the same reference numerals.
[0013] [Embodiment 1] [Configuration of the first embodiment] The configuration of the information providing system will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of the information providing system according to the first embodiment. As shown in Fig. 1, the information providing system 100 has an analyst terminal 20, an analysis server 30 (analysis device), an information providing device 10, and a related person terminal 40 (terminal device). The information providing device 10 is a server connected to the analysis server 30 via a network. The analyst terminal 20 is connected to the analysis server 30 via a network. The related person terminal 40 is connected to the information providing device 10 via a network.
[0014] The analyst terminal 20 is a terminal device used by an analyst of a data analysis project. The analyst terminal 20 may be a PC (Personal Computer), a notebook PC, a tablet terminal, a smartphone, or the like. The analyst sets the analysis policy and carries out the analysis. Specifically, the analyst is in charge of setting a series of processes related to data analysis to be executed by the analysis server 30. Under the analyst's operation, the analyst terminal 20 communicates with the analysis server 30, sets a series of processes related to data analysis (including setting parameters for each process), and causes the analysis server 30 to execute the processes related to data analysis.
[0015] The analysis server 30 has the function of a data analysis tool such as Node-AI described in Non-Patent Document 1. The analysis server 30 may have a function equivalent to the information processing device described in Patent Document 1. An analyst executes the data analysis tool of the analysis server 30 via the analyst terminal 20 to generate canvas data.
[0016] The data analysis tool generates a series of processes (pipeline) for data analysis using each machine learning model in response to the operation of an analyst. Each machine learning model that performs data analysis is called an analytical model. The processes include, for example, preprocessing of data, learning of an analytical model using data (updating parameters), evaluation of the trained analytical model, etc. Note that the division of processes in the data analysis tool is not limited to preprocessing, learning, and evaluation, and may be further subdivided.
[0017] Node-AI employs flow-based programming, which allows designing a pipeline for data processing without coding. Node-AI also allows intuitive description of a pipeline for data processing by connecting data to be processed with functions that can execute each process. In the first embodiment, a function that executes a predetermined process on data is referred to as a "card." Data for which a pipeline is described is referred to as "canvas data."
[0018] FIG. 2 is a diagram showing an example of canvas data. In the example shown in FIG. 2, the canvas data includes a plurality of cards N1, N2, N3, N41, N42, N51, N52, N6, N7, N8, and N9, which are interconnected. The cards N1, N2, N3, N41, N42, N51, N52, N6, N7, N8, and N9 correspond to functions that execute predetermined data processing. The information of the interconnected cards N1, N2, N3, N41, N42, N51, N52, N6, N7, N8, and N9 corresponds to a "graph."
[0019] Card N1 is a card that designates data to be processed (for example, time series data).
[0020] Cards N2, N3, N41, N42, N51, and N52 correspond to processes that further subdivide the pre-processing of data. Each card N2, N3, N41, N42, N51, and N52 takes the processing result of the previous card as input, executes its respective function, and outputs the processing result. Card N2 executes missing value interpolation, card N3 executes data division, cards N41 and N42 execute normalization, and cards N51 and N52 execute time window extraction.
[0021] Cards N6 and N7 correspond to the process of learning an analytical model using data. Card N6 executes a linear model, and card N7 executes learning (updating parameters).
[0022] Cards N8 and N9 correspond to the process of evaluating the trained analytical model. Card N8 executes the evaluation, and card N9 performs the factor analysis.
[0023] It should be noted that the canvas data is not limited to the example described in FIG. 2, and may include a card for executing other data processing.
[0024] Then, in the analysis server 30, the data analysis tool outputs the execution parameters when executing the series of processes to the information providing device 10. The execution parameters are information including the parameters of each process in the series of processes and the execution results of each process.
[0025] The information providing device 10 generates a document outlining a series of processes related to the data analysis, based on the execution parameters received from the analysis server 30. The document outlines what processes were performed in this analysis.
[0026] At this time, the information providing device 10 converts the sentence indicating an overview of the series of processes into an expression suitable for a report, and displays the sentence indicating an overview of the series of processes converted into an expression suitable for a report on the screen of the relevant person terminal 40.
[0027] Specifically, the information providing device 10 generates a summary list in which each sentence indicating the summary of the process, which has been converted into an expression suitable for a report, is associated with the identification information of each process. The information providing device 10 generates a summary list of the report format based on the execution parameters received from the analysis server 30, and displays it on the related party terminal 40.
[0028] The involved party terminal 40 is a terminal device used by a person involved in the data analysis project. The involved party terminal 40 is a PC, a notebook PC, a tablet terminal, a smartphone, or the like.
[0029] The related party terminal 40 communicates with the analysis server 30 based on the operation of the related party, and displays and outputs the summary list sent from the analysis server 30. The summary list is converted into an expression suitable for a report. The related party can understand the analysis contents by visually checking the summary list displayed on the related party terminal 40.
[0030] [Information providing device] Next, returning to FIG. 1, the information providing device 10 will be described.
[0031] The information providing device 10 is realized, for example, by loading a predetermined program into a computer or the like including a ROM (Read Only Memory), a RAM (Random Access Memory), a CPU (Central Processing Unit), etc., and having the CPU execute the predetermined program. The information providing device 10 also has a communication interface for transmitting and receiving various information to and from other devices (for example, the analysis server 30, the related party terminal 40) connected via a network or the like.
[0032] The information providing device 10 includes a prompt creating unit 11, an outline generating unit 12, and an expression converting unit 13.
[0033] Based on execution parameters received from analysis server 30, including parameters for each process and execution results for each process, prompt creation unit 11 creates a prompt for causing a language model of summary generation unit 12 (described later) to generate a sentence indicating an overview of the process. The prompt becomes an input to the language model. Prompt creation unit 11 outputs the generated prompt to summary generation unit 12. For example, prompt creation unit 11 converts data including the execution parameters into text with a consistent format so that it can be processed by the language model of summary generation unit 12 (described later).
[0034] Summary generation unit 12 generates a sentence outlining a series of processes related to data analysis by inputting the prompt generated by prompt creation unit 11 into a language model. Summary generation unit 12 outputs the generated sentence outlining the series of processes to expression conversion unit 13.
[0035] Summary generator 12 has a plurality of language models. A language model is provided for each process related to data analysis. Each language model is trained in advance to generate a sentence showing a summary of the process according to the execution parameters of the corresponding process.
[0036] Each language model included in summary generation unit 12 is a large language model (LLM). Each language model included in summary generation unit 12 may be a neural network. Each language model included in summary generation unit 12 may be a language model group including a plurality of language models.
[0037] Each language model in summary generation unit 12 executes inference based on the input prompt and generates a sentence in a natural language obtained by the inference. Each language model generates a sentence that shows an outline of the corresponding process. The sentence generated by each language model is a colloquial sentence.
[0038] An example will be described in which the processing related to data analysis includes preprocessing of data, learning of an analytical model using the data, and evaluation of the learned analytical model. In this case, the summary generator 12 includes, as a language model, a language model whose parameters are tuned for each of these three processes.
[0039] The summary generation unit 12 has a preprocessing model 121 which is a language model whose parameters are tuned for preprocessing, a learning model 122 which is a language model whose parameters are tuned for learning processing, and an evaluation model 123 which is a language model whose parameters are tuned for evaluation processing.
[0040] Specifically, the preprocessing model 121 is a machine learning model that performs machine learning using, as learning data, a prompt based on the execution parameters of the preprocessing and a sentence that shows an overview of the preprocessing created by an experienced analyst in response to the execution parameters. The preprocessing model 121 can appropriately generate a sentence that shows an overview of the preprocessing corresponding to the execution parameters.
[0041] Similarly, the learning model 122 is a machine learning model in which machine learning is performed using as learning data a prompt based on execution parameters of the learning process and a sentence that shows an overview of the learning process created by a veteran analyst in response to the execution parameters. The evaluator model 123 is a machine learning model in which machine learning is performed using as learning data a prompt based on execution parameters of the evaluation process and a sentence that shows an overview of the evaluation process created by a veteran analyst in response to the execution parameters.
[0042] The division of the processing of the data analysis tool is not limited to the above, and may be further divided into pre-processing, learning, and evaluation. Accordingly, summary generation unit 12 has a language model tuned to each of the subdivided processing. For example, summary generation unit 12 includes a language model tuned to each of the cards in the data analysis tool. In the example of FIG. 2, summary generation unit 12 has a missing value interpolation model tuned to the missing value interpolation processing of card N2, a data division model tuned to the data division processing of card N3, and the like.
[0043] The expression conversion unit 13 converts the sentence indicating the summary generated by the summary generation unit 12 into an expression suitable for a report. The expression conversion unit 13 has a report material manager model 131.
[0044] The report material manager model 131 receives as input a plurality of sentences indicating summaries generated by each language model (e.g., the preprocessing model 121, the learning model 122, and the evaluation model 123) and converts them into expressions suitable for a report. The report material manager model 131 then outputs the sentences indicating the summaries of each process that have been converted into expressions suitable for a report as a single data item associated with the identification information of each process. The data output by the report material manager model 131 will be described as a list of summaries.
[0045] The expression conversion unit 13 inputs each sentence generated by each language model, which indicates an overview of the process, into the report material manager model 131, and generates a summary list in which each sentence is converted into an expression suitable for a report and associated with the identification information of each process.
[0046] The expression conversion unit 13 causes the relevant party terminal 40 to display a sentence (outline list) showing an outline of the series of processes, which has been converted into an expression suitable for a report.
[0047] Fig. 3 is a diagram showing an example of a summary list displayed on the screen of the related party terminal 40. As shown in Fig. 3, in the summary list, a sentence indicating the analysis purpose is displayed as a heading (box B10). In addition, in the summary list, the time series data to be processed (card N1) is displayed in text and table format in box B11.
[0048] Furthermore, in the summary list, the cards N2, N3, N41, N42, N51, N52, and N8 of the canvas data shown in FIG. 2 are displayed in association with text (frames B2, B3, B4, B5, and B8) indicating the corresponding process and its summary.
[0049] For example, for card N2, within box B2 to the right of card N2, is displayed a message stating that the process corresponding to card N2 is "missing value interpolation," along with text C2 stating, "Linear interpolation was performed by referencing the values before and after where missing values existed in the data. Interpolation was performed on four missing values."
[0050] Furthermore, for card N8, in box B8 to the left of card N8, it is displayed that the process corresponding to card N8 is "evaluation," and as an overview of the "evaluation" (explanation of the evaluation indicators and evaluation results), the following text C8 is displayed: "PMSE and MAE refer to the error between the predicted value and the actual measured value, and the smaller the error, the higher the prediction accuracy. RMSE will take a large value when the evaluation data includes outliers. Looking at RMSE, the constructed model will have an error of 6974 on average between the predicted value and the actual measured value.", along with a table T8 listing the evaluation results.
[0051] For the other cards N3, N41, N42, N51, and N52, text C3, C4, and C5 indicating the corresponding process and its outline are displayed to the right of each card N3, N41, N42, N51, and N52 (frames B3, B4, and B5).
[0052] Each of the texts C2, C3, C4, C5, and C8 is written in a manner suitable for a report.
[0053] [Processing flow] Next, a description will be given of a process flow of the information providing system in the embodiment 1. Fig. 4 is a diagram for explaining a process flow of the information providing system in the embodiment 1. Fig. 5 is a sequence diagram showing a process procedure of the information providing process according to the embodiment 1.
[0054] As shown in Fig. 4, analysis processing is executed in analysis server 30 ((A) in Fig. 4). Specifically, the analyst operates analyst terminal 20 to transmit an analysis request to analysis server 30 (step S1 in Fig. 5). In response to instructions from analyst terminal 20, analysis server 30 sets a series of processes related to data analysis and executes the processes related to data analysis ((1) in Fig. 4, step S2 in Fig. 5).
[0055] The analyst terminal 20 adjusts the parameters of each process according to the analyst's operation (step S3 in FIG. 5). If the analyst has not yet completed the adjustment of the parameters of each process (step S4 in FIG. 5: No), the analysis server 30 returns to the execution of the analysis process for readjustment.
[0056] When the analyst has completed adjusting the parameters for each process (step S4 in FIG. 5: Yes), the analysis server 30 passes the execution parameters (meaning the parameters for each process and the execution results) to the information providing device 10 ((2) in FIG. 4, step S5 in FIG. 5).
[0057] The information providing device 10 creates an outline of a series of processes related to data analysis (FIG. 4(B)).
[0058] Specifically, in the information providing device 10, the prompt creation unit 11 creates a prompt based on the execution parameters received from the analysis server 30 ((3) in FIG. 4, step S6 in FIG. 5). The prompt becomes an input to each language model of the summary generation unit 12 (e.g., the preprocessing model 121, the learning model 122, and the evaluation model 123).
[0059] Next, in the information providing device 10, the summary generating unit 12 generates a sentence outlining a series of processes related to data analysis by inputting the prompt generated by the prompt creating unit 11 to each language model (e.g., the preprocessing model 121, the learning model 122, and the evaluation model 123) (step S7 in FIG. 5). A prompt is input for each language model corresponding to each process, and each language model outputs a colloquial summary of the process ((4) in FIG. 4).
[0060] In the information providing device 10, the expression conversion unit 13 uses the report material manager model 131 to convert the sentences indicating the summaries generated by the summary generation unit 12 into expressions suitable for reports ((5) in FIG. 4, step S8 in FIG. 5). The report material manager model 131 receives colloquial process summaries generated by each language model. The report material manager model 131 converts each colloquial process summary into a report-like feel, that is, into expressions suitable for reports. The report material manager model 131 outputs a list of summaries in which the sentences indicating the summaries of each process converted into expressions suitable for reports are associated with the identification information of each process.
[0061] The information providing device 10 transmits the summary list output by the report material manager model 131 to the involved party terminal 40 (step S9 in FIG. 5) and displays it on the screen (tool) of the involved party terminal 40 ((6) in FIG. 4, step S10 in FIG. 5).
[0062] [Advantages of the First Embodiment] In this way, the information providing device 10 according to the first embodiment automatically generates an outline list of a series of processes related to data analysis, expressed in a format suitable for a report, based on the execution parameters received from the analysis server 30, and displays it on the related party terminal 40. According to the first embodiment, it is possible to support the related party in understanding the analysis content while reducing the burden on the analyst in creating the report.
[0063] [Embodiment 2] Next, a description will be given of embodiment 2. In the information providing system in embodiment 2, a summary list is generated that reflects the analyst's aim and / or ingenuity with respect to a series of processes related to data analysis.
[0064] [Configuration of the second embodiment] The configuration of the information providing system will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the configuration of the information providing system according to embodiment 2. The information providing system 200 shown in Fig. 6 has an information providing device 210 instead of the information providing device 10 shown in Fig. 1.
[0065] The information providing device 210 generates an outline of a series of processes related to data analysis, expressed in a format suitable for a report. At this time, the information providing device 210 creates a prompt and generates the outline based on the analyst's aim and / or ingenuity for the series of processes related to data analysis, in addition to the execution parameters received from the analysis server 30.
[0066] [Information providing device] An information providing device 210 shown in Fig. 6 will be described. The information providing device 210 has a prompt creating section 211 and a summary creating section 212 instead of the prompt creating section 11 and the summary creating section 12 shown in Fig. 1. The information providing device 210 further has an extraction section 214.
[0067] The extraction unit 214 uses a dialogue model (machine learning model) to have a dialogue with the analyst via the analyst terminal 20. The extraction unit 214 extracts the analyst's aim and / or ingenuity for a series of processes related to data analysis from a response to the dialogue between the analyst and the dialogue model. The extraction unit 214 has a conversation manager model 2141, a dialogue summary model 2142, and a state detection model 2143 as dialogue models.
[0068] The conversation manager model 2141 integrates the inputs of the conversation summary model 2142 and the state detection model 2143 to generate a coherent and comprehensive conversation. The conversation manager model 2141 extracts the analyst's aim and / or ingenuity for a series of processes related to data analysis from the conversation response between the analyst and the conversation model.
[0069] The dialogue summary model 2142 takes as input the analyst's answers to the questions generated by the dialogue manager model 2141 and determines a dialogue summary. The dialogue summary model 2142 generates a concise summary of the ongoing conversation. The dialogue summary model 2142 considers the most recent analyst utterances, past conversation history, and current responses from the analyst to generate a dialogue summary that maintains consistency and context throughout the entire conversation.
[0070] The state detection model 2143 detects the state of the dialogue based on the dialogue summary by the dialogue summary model 2142. The state detection model 2143 determines whether the analyst should move to the next state in the dialogue based on the user's needs, the accuracy of the objectives, the smooth flow of the conversation, and the decision on whether to proceed to the next dialogue state.
[0071] The conversation manager model 2141 determines, based on the detection result by the state detection model 2143, whether or not an answer to the question has been obtained.
[0072] If no answer to the question is obtained, the conversation manager model 2141 generates a sentence that takes into consideration the overall flow of the conversation and outputs it as a question to the analyst.If an answer to the question is obtained, the conversation manager model 2141 inputs the extracted analyst's aim and / or ingenuity for the series of processes related to data analysis to the prompt creation unit 211 in order to incorporate the analyst's aim and / or ingenuity for the series of processes related to data analysis into the prompt.
[0073] The prompt creation unit 211 has a prompt creation model 2111. The prompt creation unit 211 inputs the execution parameters received from the analysis server 30 and the analyst's aim and / or ingenuity extracted by the extraction unit 214 to the prompt creation model 2111, thereby creating a prompt for causing a language model of the summary generation unit 212 (described later) to generate a sentence showing an overview of the process.
[0074] The prompt creation model 2111 is a machine learning model in which machine learning is performed using learning data so as to input the analyst's goals and / or ingenuity and execution parameters for the analysis process, and output a prompt corresponding to the analysis process.
[0075] The summary generation unit 212, like the summary generation unit 12, generates a sentence that provides an overview of a series of processes related to data analysis by inputting the prompt generated by the prompt creation unit 211 into multiple language models (e.g., a preprocessing model 2121, a learning model 2122, and an evaluation model 2123).
[0076] A language model is provided for each process related to data analysis. Each language model is pre-trained to generate sentences that outline the process according to the execution parameters of the corresponding process and the analyst's aims and / or ideas.
[0077] Specifically, the preprocessing model 2121 is a machine learning model in which machine learning is performed using as learning data execution parameters of the preprocessing, prompts based on the analyst's aim and / or ingenuity for the preprocessing, and sentences showing an overview of the preprocessing created by an experienced analyst corresponding to the execution parameters and the analyst's aim and / or ingenuity for the preprocessing. The preprocessing model 2121 reflects the analyst's aim and / or ingenuity for the preprocessing and can appropriately generate sentences showing an overview of the preprocessing corresponding to the execution parameters.
[0078] Similarly, the learning model 2122 is a machine learning model in which machine learning is performed using as learning data the execution parameters of the learning process, prompts based on the analyst's aims and / or ingenuity for the learning process, and text outlining the learning process created by an experienced analyst in response to the execution parameters and the analyst's aims and / or ingenuity for the learning process.
[0079] In addition, the evaluator model 2123 is a machine learning model in which machine learning is performed using as learning data the execution parameters of the evaluation process, prompts based on the analyst's aims and / or ingenuity points for the evaluation process, and text outlining the evaluation process created by a veteran analyst in response to the execution parameters and the analyst's aims and / or ingenuity points for the evaluation process.
[0080] [Processing flow] Next, a description will be given of a process flow of the information providing system in the embodiment 2. Fig. 7 is a diagram for explaining a process flow of the information providing system in the embodiment 2. Fig. 8 is a sequence diagram showing a process procedure of the information providing process according to the embodiment 2.
[0081] As in the first embodiment, the analysis server 30 executes the analysis process ((A) in FIG. 7). The analyst terminal 20 transmits an analysis request to the analysis server 30 (step S21 in FIG. 8). In response to an instruction from the analyst terminal 20, the analysis server 30 sets a series of processes related to data analysis and executes the processes related to data analysis ((1) in FIG. 7, step S22 in FIG. 8).
[0082] The analyst terminal 20 adjusts the parameters of each process according to the analyst's operation (step S23 in FIG. 8). If the analyst has not yet completed the adjustment of the parameters of each process (step S24 in FIG. 8: No), the analysis server 30 returns to the execution of the analysis process for readjustment.
[0083] When the analyst has completed adjusting the parameters for each process (step S24 in FIG. 8: Yes), the analysis server 30 passes the execution parameters (meaning the parameters and execution results for each process) to the information providing device 210 ((2) in FIG. 7, step S25 in FIG. 8).
[0084] In the information providing device 210, the extraction unit 214 uses the dialogue model to have a dialogue with the analyst via the analyst terminal 20, thereby extracting the analyst's aim and / or ingenuity for each process in a series of processes related to data analysis. Specifically, in the information providing device 210, the conversation manager model 2141 generates a sentence that takes into consideration the overall flow of the conversation, outputs it to the analyst terminal 20 as a question for the analyst, and receives the answer to the question from the analyst terminal 20, thereby generating a dialogue with the analyst (step S26 in FIG. 8).
[0085] In the extraction unit 214, the dialogue summary model 2142 receives the analyst's response to the question generated by the dialogue manager model 2141 as input (FIG. 7(3-1)), and determines the summary of the dialogue (FIG. 7(3-2), step S27 in FIG. 8).
[0086] In the extraction unit 214, the state detection model 2143 detects the state of the dialogue with the analyst based on the dialogue summary by the dialogue summary model 2142 ((3-2) in FIG. 7, step S28 in FIG. 8). The conversation manager model 2141 determines whether or not an answer to the question has been obtained based on the detection result by the state detection model 2143 ((3-3) in FIG. 7, step S29 in FIG. 8).
[0087] If the question cannot be answered because there is some ambiguity ((3-4) in Figure 7, step S29: No in Figure 8), the process returns to step S27 in Figure 8, and the conversation manager model 2141 generates a sentence that takes into consideration the overall flow of the conversation and outputs it as a question to the analyst ((3-4) in Figure 7).
[0088] If an answer to the question is obtained (step S29 in FIG. 8: Yes), the extraction unit 214 extracts the analyst's aim and / or ingenuity points for the series of processes related to data analysis. Then, the extraction unit 214 inputs the extracted analyst's aim and / or ingenuity points to the prompt creation unit 211 (step S30 in FIG. 8), and incorporates the analyst's aim and / or ingenuity points for the series of processes related to data analysis into the prompt.
[0089] The prompt creation unit 211 creates a prompt by inputting the execution parameters received from the analysis server 30 and the analyst's aim and / or ingenuity points extracted by the extraction unit 214 into the prompt creation model 2111 ((4) in FIG. 7, step S31 in FIG. 8). The prompt creation model 2111 receives the execution parameters and the analyst's aim and / or ingenuity points received from the analysis server 30 as input, and generates and outputs input texts (prompts) for each language model based on the execution parameters and the analyst's aim.
[0090] Next, in the information providing device 210, the summary generating unit 212 inputs the prompt generated by the prompt creating unit 211 to each language model (e.g., the preprocessing model 2121, the learning model 2122, and the evaluation model 2123) to generate a sentence indicating an overview of a series of processes related to data analysis (step S32 in FIG. 8). A prompt is input for each language model corresponding to each analysis process, and each language model outputs a colloquial summary of the process ((5) in FIG. 7). Each of these process summaries corresponds to the execution parameters and the analyst's aim and / or devised points for the evaluation process.
[0091] In the information providing device 210, the expression conversion unit 13 converts the sentences indicating the summaries generated by the summary generation unit 212 into expressions suitable for reports using the report material manager model 131 ((6) in FIG. 7, step S33 in FIG. 8). The expression conversion unit 13 creates a summary list in which the sentences indicating the summaries of each process, which have been converted into expressions suitable for reports, are associated with the identification information of each process. The information is transmitted to the terminal 40 of the person concerned (step S34 in FIG. 8), and is displayed on the screen (tool) of the terminal 40 of the person concerned ((7) in FIG. 7, step S35 in FIG. 8).
[0092] [Effects of the second embodiment] The information providing device 210 according to the second embodiment can generate a summary list that reflects the analyst's aim and / or ingenuity for a series of processes related to data analysis, and can facilitate support for the relevant parties in understanding the analysis content.
[0093] [System configuration of the embodiment] Each component of the information providing system 100, 200 is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of the functions of the information providing system 100, 200 is not limited to that shown in the figure, and all or part of it can be functionally or physically distributed or integrated in any unit according to various loads, usage conditions, etc.
[0094] Further, all or any part of each process performed in the information providing system 100, 200 may be realized by a CPU, a GPU (Graphics Processing Unit), and a program analyzed and executed by the CPU and the GPU. Further, each process performed in the information providing system 100, 200 may be realized as hardware using wired logic.
[0095] Furthermore, among the processes described in the embodiments, all or part of the processes described as being performed automatically can be performed manually. Alternatively, all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the process procedures, control procedures, specific names, and information including various data and parameters described above and shown in the drawings can be changed as appropriate unless otherwise specified.
[0096] [program] 9 is a diagram showing an example of a computer in which each component device of the information provision system 100, 200 is realized by executing a program. The computer 1000 has, for example, a memory 1010 and a CPU 1020. The computer 1000 also has a hard disk drive interface 1030, a disk drive interface 1040, a serial port interface 1050, a video adapter 1060, and a network interface 1070. Each of these components is connected by a bus 1080.
[0097] The memory 1010 includes a ROM 1011 and a RAM 1012. The ROM 1011 stores a boot program such as a BIOS (Basic Input Output System). The hard disk drive interface 1030 is connected to a hard disk drive 1090. The disk drive interface 1040 is connected to a disk drive 1100. A removable storage medium such as a magnetic disk or an optical disk is inserted into the disk drive 1100. The serial port interface 1050 is connected to a mouse 1110 and a keyboard 1120, for example. The video adapter 1060 is connected to a display 1130, for example.
[0098] The hard disk drive 1090 stores, for example, an OS (Operating System) 1091, an application program 1092, a program module 1093, and program data 1094. That is, a program that defines each process of the information providing systems 100, 200 is implemented as a program module 1093 in which code executable by the computer 1000 is written. The program module 1093 is stored, for example, in the hard disk drive 1090. For example, a program module 1093 for executing the same process as the functional configuration in the information providing systems 100, 200 is stored in the hard disk drive 1090. The hard disk drive 1090 may be replaced with an SSD (Solid State Drive).
[0099] Furthermore, setting data used in the processing of the above-described embodiment is stored as program data 1094, for example, in memory 1010 or hard disk drive 1090. Then, CPU 1020 reads out program module 1093 or program data 1094 stored in memory 1010 or hard disk drive 1090 into RAM 1012 as necessary, and executes the program.
[0100] Note that the program module 1093 and the program data 1094 are not limited to being stored in the hard disk drive 1090, but may be stored in, for example, a removable storage medium and read by the CPU 1020 via the disk drive 1100 or the like. Alternatively, the program module 1093 and the program data 1094 may be stored in another computer connected via a network (such as a local area network (LAN) or wide area network (WAN)). The program module 1093 and the program data 1094 may then be read by the CPU 1020 from the other computer via the network interface 1070.
[0101] Although the embodiment of the invention made by the present inventor has been described above, the present invention is not limited by the description and drawings that form a part of the disclosure of the present invention according to the present embodiment. In other words, other embodiments, examples, operation techniques, etc. made by those skilled in the art based on the present embodiment are all included in the scope of the present invention. [Explanation of symbols]
[0102] 10,210 Information provision equipment 11,211 Prompt Creation Department 12,212 Summary generator 13 Expression conversion section 20 Analyst terminal 30 Analysis Server 40 Related party terminals 100,200 Information system 121,2121 Pre-processing model 122,2122 Learning Model 123,2123 Evaluation model 131 Reporting Manager Model 214 Extraction part 2111 Prompt Creation Model 2141 Conversation Manager Model 2142 Dialogue Summary Model 2143 Condition Detection Model
Claims
1. a prompt creation unit that creates a prompt for causing a language model to generate a sentence indicating an overview of a series of processes related to data analysis, based on execution parameters including parameters of each process and execution results of each process received from an analysis device that executes a data analysis tool that generates the series of processes related to data analysis; an outline generation unit that generates a sentence indicating an outline of the series of processes by inputting the prompt generated by the prompt creation unit into the language model; an expression conversion unit that converts a sentence indicating the summary generated by the summary generation unit into an expression suitable for a report and displays the converted sentence indicating the summary of the series of processes on a terminal device; having the language model is provided for each of the processes, An information provision device characterized in that each language model is a machine learning model in which machine learning is performed using as learning data a prompt based on the execution parameters of the corresponding process and a sentence outlining the process created by an experienced analyst in response to the execution parameters of the corresponding process.
2. The information providing device according to claim 1, characterized in that the expression conversion unit inputs each sentence indicating an overview of the process generated by each language model into a manager model, and generates a summary list in which each sentence is converted into an expression suitable for the report and associated with identification information of each process.
3. an extraction unit that extracts, from a response to a dialogue between an analyst who has set a series of processes related to the data analysis and a dialogue model, an aim and / or ingenuity of the analyst with respect to the series of processes related to the data analysis; and The response of the dialogue is a question of the dialogue model for eliciting the analyst's aim and / or ingenuity with respect to a series of processes related to the data analysis, and an answer of the analyst in response to the question, The information providing device according to claim 1, characterized in that the prompt creation unit creates a prompt for causing the language model to generate a sentence indicating an overview of the process by inputting the execution parameters received from the analysis device and the analyst's aim and / or ingenuity points extracted by the extraction unit into a prompt creation model.
4. the summary generation unit inputs the prompt generated by the prompt creation unit into the language model provided for each of the processes; The information providing device according to claim 3, characterized in that each language model has been trained in advance to generate a sentence outlining the process in accordance with the execution parameters of the corresponding process and the analyst's aims and / or ingenuity.
5. An information providing method executed by an information providing device, comprising: A step of generating a prompt for causing a language model to generate a sentence indicating an overview of a series of processes related to data analysis, based on execution parameters including parameters of each process and execution results of each process received from an analysis device in which a data analysis tool that generates the series of processes related to data analysis is executed; generating a sentence outlining the series of processes by inputting the prompt into the language model; a step of converting the summary text generated in the generating step into an expression suitable for a report, and displaying the converted summary text of the series of processes on a terminal device; Including, the language model is provided for each of the processes, An information provision method characterized in that each language model is a machine learning model in which machine learning is performed using as learning data a prompt based on the execution parameters of the corresponding process and a sentence outlining the process created by an experienced analyst in response to the execution parameters of the corresponding process.
6. creating a prompt for causing a language model to generate a sentence indicating an overview of a series of processes related to data analysis, based on execution parameters including parameters of each process and execution results of each process received from an analysis device in which a data analysis tool that generates the series of processes related to data analysis is executed; generating a sentence outlining the series of processes by inputting the prompt into the language model; a step of converting the text indicating the summary generated in the generating step into an expression suitable for a report, and displaying the converted text indicating the summary of the series of processes on a terminal device; on the computer, the language model is provided for each of the processes, An information provision program in which each language model is a machine learning model in which machine learning is performed using as learning data a prompt based on the execution parameters of the corresponding process and a sentence outlining the process created by an experienced analyst in response to the execution parameters of the corresponding process.
Citation Information
Patent Citations
Information processing device, information processing method, and information processing program
JP2023027964A
User-aware explanation selection for machine learning systems
US20200402658A1
System and method to generate insight templates for risk probability analysis
US20230087583A1
Information processing system, information processing method, and program
WO2022201795A1