Information processing device, information processing method, and program

Abstract

Provide information regarding the reliability of the answers to the questions. [Solution] The information processing device 1 includes a reception unit 131 that receives a prompt containing content to be generated by an LLM (Large Language Model), a search unit 132 that searches a data database which is a database of data containing text and extracts data related to the content included in the prompt, a calculation unit 133 that calculates a validity score indicating the validity of each of the extracted data as data to be used as the basis for generating an answer to the prompt, a selection unit 134 that selects a data from among the data to be used as the basis for generating an answer based on the validity score for each of the data, and a display control unit 135 that displays the data selected by the selection unit 134 and the validity score of the data.

Claims

1. A reception unit that receives a prompt containing content to be generated by the Large Language Model (LLM), A search unit that searches a data database which is a database of data containing text, and extracts data related to the content included in the prompt, A calculation unit calculates a validity score indicating the validity of each of the extracted documents as a basis for generating an answer to the prompt, A selection unit that selects from among the multiple documents the document that will serve as the basis for generating the answer, based on the validity score for each of the multiple documents, A display control unit that displays the material selected by the selection unit and the validity score of the material, An information processing device having

2. The system further includes a generation unit that inputs the prompt and the material selected by the selection unit into the LLM and generates a response to the prompt. The display control unit further displays the answer generated by the generation unit. The information processing apparatus according to claim 1.

3. The selection unit selects one or more materials from the plurality of materials that will serve as the basis for generating the answer, based on the validity score for each of the plurality of materials. The display control unit displays a screen configured to allow the user to select one or more materials selected by the selection unit. The generation unit inputs the prompt and the document selected by the user from the one or more documents into the LLM and generates a response to the prompt. The information processing apparatus according to claim 2.

4. In the aforementioned data database, the reliability of each searched data is associated with each of the searched data. The display control unit further displays the reliability of the material selected by the selection unit. The information processing apparatus according to claim 1.

5. The calculation unit described above, (1) The search unit calculates a degree of relevance indicating the consistency between each of the multiple documents extracted and the content included in the prompt, (2) Based on the confidence level and suitability of each of the aforementioned materials, the validity score for each of the aforementioned materials is calculated. The information processing apparatus according to claim 4.

6. The aforementioned search unit, (1) Calculate the relationship between the content contained in the prompt and the content contained in each of the searched documents, (2) Based on the calculated correlation, extract multiple documents related to the content included in the prompt, The calculation unit described above, (1) The search unit calculates a degree of relevance indicating the consistency between each of the multiple documents extracted and the content included in the prompt, (2) Based on the reliability, relevance and suitability of each of the aforementioned materials, the validity score for each of the aforementioned materials is calculated. The information processing apparatus according to claim 4.

7. A computer executes A reception step that accepts a prompt containing content to be generated by the LLM, A search step which involves searching a data database which is a database of data containing text, and extracting data related to the content included in the prompt, A calculation step which involves calculating a validity score indicating the validity of each of the multiple documents extracted in the search step as a basis for generating an answer to the prompt, A selection step in which, based on the validity score for each of the aforementioned multiple materials, a material is selected from among the multiple materials to serve as the basis for generating the answer, A display step that displays the materials selected in the selection step and the validity score of those materials, An information processing method having

8. On the computer, A reception step that accepts a prompt containing content to be generated by the LLM, A search step which involves searching a data database which is a database of data containing text, and extracting data related to the content included in the prompt, A calculation step which involves calculating a validity score indicating the validity of each of the multiple documents extracted in the search step as a basis for generating an answer to the prompt, A selection step in which, based on the validity score for each of the aforementioned multiple materials, a material is selected from among the multiple materials to serve as the basis for generating the answer, A display step that displays the materials selected in the selection step and the validity score of those materials, A program that executes the command.

Images