System, computer device, and method

Abstract

To provide a system for reducing the number of times that a language model outputs a reply.SOLUTION: A system includes at least one computer device. The system comprises: first acquisition means for acquiring a reply from a language model on the basis of a prompt; storage means for storing a reply acquired by the first acquisition means, and information related to a prompt corresponding to the reply, in association with each other; first generation means for generating or acquiring a prompt to be inputted to the language model or a temporary prompt for generating the prompt; and specification means for specifying a reply corresponding to information related to the prompt from the storage means, in the case that the prompt or the temporary prompt generated or acquired by the first generation means, and pieces of information related to a prompt satisfying prescribed conditions are stored.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present invention relates to a system, a computer device and a method. [Background technology]

[0002] In recent years, the accuracy of generative AI, which can autonomously generate text and images, has improved, and it is expected to be used in a variety of fields. For example, systems have been provided that use large-scale language models (LLMs) to perform natural language processing tasks such as question and answering, text summarization, and text generation (see, for example, Patent Document 1). An LLM is a natural language processing model trained using large amounts of text data. When using an LLM to perform a task such as question and answering, text is input into the LLM, which outputs an answer. The text input into the LLM is called a prompt.

[0003] However, it was difficult for users who were not familiar with language models to input prompts themselves. Also, depending on the content of the prompts input into the language model, the output answer might differ from the answer the user wanted. For this reason, inputting prompts required individual skills, making it difficult for users who were not familiar with language models to use them. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 7441366 Summary of the Invention [Problem to be solved by the invention]

[0005] The present invention can solve, for example, any of the following problems: A first problem of the present invention is to provide a system that allows a user to obtain an answer through simple input. A second problem of the present invention is to provide a system that reduces the number of times a language model outputs an answer. [Means for solving the problem]

[0006] The object of the present invention is to [1] A system including at least one computer device, the system including: a selection means for accepting selection of one or more options from a plurality of options corresponding to each of a plurality of keywords in response to an input from a user terminal operated by a user; and a first generation means for generating a prompt to be input into a language model, or for generating a provisional prompt for generating the prompt, so as to include a keyword corresponding to the option selected by the selection means; [2] The system according to [1], further comprising a prompt display unit configured to display the prompt or provisional prompt generated by the first generation unit in the user terminal; [3] The system according to [1] or [2], further comprising: an option display means for controlling the user terminal to display options; a selection means for accepting selection of one or more options from the options controlled to be displayed by the option display means; and, when one option is selected from the multiple options by the selection means, the option display means for controlling the selection means to further display options corresponding to keywords associated with the selected option; [4] The system according to [3], wherein a keyword associated with a first option and a keyword associated with a second option are different from each other among the displayed options; [5] The system according to any one of [2] to [4], wherein the prompt display means controls the display of the keyword corresponding to the option selected by the selection means in a manner different from other text included in the generated prompt or provisional prompt; [6] The system according to any one of [1] to [5], further comprising an input means for accepting input of text information in response to input from the user terminal, and wherein the first generation means generates the prompt or the provisional prompt based on a keyword corresponding to an option selected by the selection means and the text information input by the input means; [7] The system according to any one of [1] to [6], wherein the first generating means generates the prompt or the provisional prompt by embedding a keyword corresponding to the option selected by the selecting means into a preset template; [8] The system according to any one of [1] to [7], further comprising an answer acquisition means for acquiring an answer from a language model based on the prompt generated by the first generation means or a prompt generated from a provisional prompt; [9] The system according to any one of [1] to [7], further comprising: an information acquisition means for acquiring, in a language model, related information from a specialized information database storing predetermined information based on the prompt generated by the first generation means or a prompt generated from a provisional prompt; and an answer acquisition means for acquiring an answer from the language model using the information acquired by the information acquisition means and the prompt;

[10] The system according to any one of [1] to [7], further comprising: an information acquisition means for acquiring related information from a specialized information database in which predetermined information is stored, based on the generated provisional prompt or a keyword corresponding to an option for which a selection has been accepted; a second generation means for generating a prompt based on the information acquired by the information acquisition means and the provisional prompt or the keyword; and an answer acquisition means for acquiring an answer from a language model based on the prompt generated by the second generation means;

[11] The system according to [9] or

[10] , further comprising an extraction means for extracting predetermined keywords by referring to a specialized information database using a language model, and a selection means for accepting a selection of an option from options corresponding to the keywords extracted by the extraction means;

[12] The system according to any one of [1] to

[11] , further comprising an option display means for controlling the user terminal to display options, wherein the selection means accepts the selection of one or more options from the options controlled to be displayed by the option display means, and the option display means controls to display at least two or more options in a list, and controls to change and display an area displaying each option according to information on the number of times the option has been selected by the selection means;

[13] A computer device comprising: a selection means for accepting selection of one or more options from a plurality of options corresponding to each of a plurality of keywords in response to an input from a user terminal operated by a user; and a first generation means for generating a prompt to be input into a language model so as to include a keyword corresponding to the option selected by the selection means, or for generating a provisional prompt for generating the prompt;

[14] A method executed on at least one computer device, the method comprising: a selection step of accepting selection of one or more options from a plurality of options corresponding to each of a plurality of keywords in response to an input from a user terminal operated by a user; and a first generation step of generating a prompt to be input into a language model, or generating a provisional prompt for generating the prompt, so that the prompt includes keywords corresponding to the options selected in the selection step;

[15] A system including at least one computer device, the system including: a first acquisition means for acquiring an answer from a language model based on a prompt; a storage means for storing the answer acquired by the first acquisition means in association with information about the prompt corresponding to the answer; a first generation means for generating or acquiring a prompt to be input to the language model or a provisional prompt for generating the prompt; and an identification means for identifying an answer corresponding to the information about the prompt from the storage means when the prompt or provisional prompt generated or acquired by the first generation means and information about a prompt that satisfies a predetermined condition are stored;

[16] The system according to

[15] , further comprising a second acquisition means for acquiring an answer from a language model based on a prompt or provisional prompt generated or acquired by the first generation means and a prompt generated from the provisional prompt when information relating to the prompt that satisfies a predetermined condition is not stored;

[17] The system according to

[16] , further comprising a second generating means for generating a prompt by adding predetermined information to the provisional prompt, wherein the second obtaining means obtains answers from a language model based on the prompt generated by the second generating means, and the storage means stores at least some of the answers obtained by the second obtaining means in association with information about the prompt corresponding to at least some of the answers;

[18] The system according to any one of

[15] to

[17] , further comprising: an information acquisition means for acquiring related information from a specialized information database in which predetermined information is stored based on a prompt; a first acquisition means for acquiring an answer from a language model using the related information and the prompt; an information update means for adding, replacing, and / or deleting predetermined information from the specialized information database; and a deletion means for deleting information related to the answer and / or the prompt corresponding to the answer stored in the storage means in response to the addition, replacement, and / or deletion of the predetermined information by the information update means;

[19] A computer device comprising: a first acquisition means for acquiring an answer from a language model based on a prompt; a storage means for storing the answer acquired by the first acquisition means in association with information about the prompt corresponding to the answer; a first generation means for generating or acquiring a prompt to be input to the language model or a provisional prompt for generating the prompt; and an identification means for identifying an answer corresponding to the information about the prompt when the prompt or provisional prompt generated or acquired by the first generation means and information about a prompt that satisfies a predetermined condition are stored in the storage means;

[20] A method executed on at least one computer device, the method comprising: a first acquisition step of acquiring an answer from a language model based on a prompt; a storage step of associating the answer acquired in the first acquisition step with information about the prompt corresponding to the answer and storing the association; a first generation step of generating or acquiring a prompt to be input to the language model or a provisional prompt for generating the prompt; and a specification step of specifying an answer corresponding to the information about the prompt when the prompt or provisional prompt generated or acquired by the first generation means and information about a prompt that satisfies a predetermined condition are stored in the storage step; This can be solved by: [Effects of the Invention]

[0007] According to the present invention, it is possible to provide a system that allows a user to obtain an answer through simple input, and a system that reduces the number of times a language model outputs an answer. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a configuration of a system according to an embodiment of the present invention; [Figure 2] FIG. 2 is a block diagram showing a hardware configuration of a user terminal according to an embodiment of the present invention. [Figure 3] FIG. 2 is a block diagram showing a hardware configuration of a server device according to an embodiment of the present invention. [Figure 4] FIG. 10 is a flowchart showing a specialized information update process according to an embodiment of the present invention. [Figure 5] FIG. 10 is a flowchart showing a keyword setting process according to an embodiment of the present invention. [Figure 6] FIG. 10 is a flowchart showing an output process according to an embodiment of the present invention. [Figure 7] FIG. 10 is a flowchart showing a response acquisition process according to an embodiment of the present invention. [Figure 8] FIG. 10 is a flowchart illustrating another example of the response acquisition process according to the embodiment of the present invention. [Figure 9] FIG. 2 is a diagram showing an example of a display screen according to the embodiment of the present invention. [Figure 10] FIG. 2 is a diagram showing an example of a display screen according to the embodiment of the present invention. [Figure 11] FIG. 2 is a diagram showing an example of a display screen according to the embodiment of the present invention. [Figure 12] FIG. 2 is a diagram showing an example of a display screen according to the embodiment of the present invention. [Figure 13] FIG. 2 is a diagram showing an example of a display screen according to the embodiment of the present invention. [Figure 14] FIG. 10 is a flowchart showing a display order change process according to the embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0009] The following describes embodiments of the present invention, but the present invention is not limited to the following embodiments as long as they do not violate the spirit of the present invention. The order of each process constituting the flowcharts described below is random as long as no contradictions or inconsistencies occur in the process content. Furthermore, it is possible to omit some of the processes constituting the flowcharts or add new processes to each process constituting the flowcharts as long as they do not violate the spirit of the present invention. Furthermore, the device that executes each process constituting the flowcharts can be changed to another device as long as it does not violate the spirit of the present invention. In this case, the process content can be changed so as not to cause contradictions or inconsistencies in the process content.

[0010] The system according to the present invention can assist in searches to obtain answers related to specific information. The specific information is not particularly limited, and the system according to the present invention can be applied in various fields. The following mainly describes the application of the system according to the present invention in the field of long-term care insurance.

[0011] [System Configuration] FIG. 1 is a block diagram showing the configuration of a system according to an embodiment of the present invention. The system 10 includes at least one computer device. The system 10 includes, for example, a user terminal 1 and a server device 2. The system 10 may also include a language model server 3, a specialized information database 4, and an administrator terminal 5. The user terminal 1, the server device 2, the language model server 3, the specialized information database 4, and the administrator terminal 5 are communicably connected to each other via a communication network 6. In the system 10, any one of the user terminal 1, the server device 2, and the language model server 3 can function as an information processing device. When any one of the devices functions as an information processing device, information is transmitted and received between the user terminal 1, the server device 2, the language model server 3, and the specialized information database 4 as necessary.

[0012] The system 10 may include multiple user terminals 1, multiple server devices 2, multiple specialized information databases 4, and multiple administrator terminals 5. The server devices 2 may function in a distributed manner across multiple computer devices. For example, instead of the server devices 2, a distributed ledger technology such as a blockchain may be used.

[0013] [User device] The user terminal 1 is operated by a user of the system 10. The user terminal 1 is not particularly limited, but examples thereof include a conventional mobile phone, a tablet terminal, a smartphone, a laptop computer, and a desktop computer.

[0014] 2 is a block diagram showing the hardware configuration of a user terminal according to an embodiment of the present invention. The user terminal 1 includes a control unit 11, a RAM 12, a storage unit 13, an input unit 14, a display unit 15, and a communication interface 16, all of which are connected via a bus.

[0015] The control unit 11 is composed of a CPU and a ROM. The control unit 11 executes programs stored in the storage unit 13 and controls the user terminal 1. The RAM 12 is a work area for the control unit 11. The storage unit 13 is a memory area for saving programs and data. In other words, the storage unit 13 functions as a recording medium that stores programs. The control unit 11 performs arithmetic processing based on the programs and data read from the RAM 12 and data input via the input unit 14.

[0016] The display unit 15 has a display screen. The control unit 11 outputs a video signal for displaying an image on the display screen according to the result of the arithmetic processing. Here, the display screen of the display unit 15 may be a touch panel equipped with a touch sensor. In this case, the touch panel functions as the input unit 14. The communication interface 16 can be connected to the communication network 6 wirelessly or via a cable, and can send and receive data to and from other computer devices via the communication network 6. Data received via the communication interface 16 is loaded into the RAM 12, and the control unit 11 performs arithmetic processing.

[0017] [Server device] 3 is a block diagram showing a hardware configuration of a server device according to an embodiment of the present invention. The server device 2 includes at least a control unit 21, a RAM 22, a storage unit 23, and a communication interface 24, which are connected to each other via a bus.

[0018] The control unit 21 is composed of a CPU and a ROM, and executes programs stored in the storage unit 23 to control the server device 2. The control unit 21 also has an internal timer that measures time. The RAM 22 is a work area for the control unit 21. The storage unit 23 is a storage area for saving programs and data. In other words, the storage unit 23 functions as a recording medium that stores programs. The control unit 21 reads out the programs and data from the RAM 22, and performs program execution processing based on information received from the user terminal 1 or the language model server 3, etc.

[0019] [Language model server] The language model server 3 is a computer device that stores a language model for processing natural language. The hardware configuration of the language model server 3 can be appropriately adapted from the description of the hardware configuration of the server device 2. In this embodiment, the language model used is the LLM, but a language model other than the LLM may also be used as long as it can process natural language.

[0020] Note that the server device 2 may store a language model. When a language model is stored in the server device 2, the system 10 does not need to include the language model server 3. Also, a small-scale language model that is smaller in scale than an LLM may be stored in the server device 2 or the language model server 3. A small-scale language model is a natural language processing model trained based on less data than an LLM.

[0021] [Specialized information database] The specialized information database 4 is a database in which predetermined information is stored. In this embodiment, the predetermined information stored in the specialized information database 4 is also referred to as specialized information. The specialized information database 4 is stored in a computer device. The specialized information database 4 may be stored in the server device 2 or the language model server 3. The specialized information database 4 may be stored in a distributed manner across multiple computer devices. The specialized information database 4 may be constructed as a different database for each attribute of the predetermined information.

[0022] [Administrator's terminal] The administrator terminal 5 is operated by an administrator who manages the system 10. The administrator terminal 5 is not particularly limited, but examples thereof include conventional mobile phones, tablet terminals, smartphones, laptops, and desktop computers. The hardware configuration of the administrator terminal 5 can be appropriately adapted from the description of the hardware configuration of the user terminal 1.

[0023] In this embodiment, the program may be stored on a recording medium such as a CD-ROM. In this case, the program stored on the recording medium may be installed in the user terminal 1, the server device 2, or the language model server 3 to execute the predetermined functions. Alternatively, the program may be distributed from a computer device external to the system. In this case, the program distributed from the computer device external to the system may be installed in the user terminal 1, the server device 2, or the language model server 3 to execute the predetermined functions.

[0024] [Professional information update process] Next, the specialized information update process for storing specialized information in the specialized information database 4 will be described.

[0025] The specialized information stored in the specialized information database 4 is not particularly limited, but is preferably information related to the field in which the system 10 is used. For example, in the field of long-term care insurance, the specialized information may be information issued by the Ministry of Health, Labor and Welfare. The specialized information database 4 may be set for each department that uses the system 10. For example, information related to departments such as the general affairs department, human resources department, and accounting department may be stored in the specialized information database 4.

[0026] The specialized information stored in the specialized information database 4 may be, for example, text information, image information, video information, sound information, etc. The specialized information stored in the specialized information database 4 may be stored in association with vectorized numerical information obtained by performing vector calculations. The specialized information database 4 may be a vector database.

[0027] Registration of specialized information in the specialized information database 4 may be performed in response to an operation on the administrator terminal 5. Fig. 4 is a diagram showing a flowchart of specialized information update processing according to the embodiment of the present invention.

[0028] First, the administrator logs in to the system 10 by accessing the server device 2 from the administrator terminal 5 via a web browser. Alternatively, the administrator may start an application program (hereinafter referred to as a dedicated app) downloaded to the administrator terminal 5 and access the server device 2 to log in to the system 10.

[0029] When a user of the system 10 logs in to the system, the user may be required to input a user ID, a password, etc. The password may be set by the user. The password is stored in the system in association with the user ID. The user ID is identification information that can identify the user.

[0030] Next, the administrator terminal 5 accepts input of instruction information through operation by the administrator (step S11). The instruction information is information for storing specialized information in the specialized information database 4. The instruction information includes the specialized information and information regarding whether to add the specialized information to the specialized information database 4, replace the specialized information with already stored specialized information, or delete the specialized information from the specialized information database 4. The instruction information may also include information regarding the file name of the information, a comment to be displayed when the information is displayed on the user terminal 1, etc.

[0031] Next, the administrator terminal 5 transmits an update request to the server device 2 requesting that the specialized information database 4 be updated (step S12). The update request includes instruction information. Upon receiving the update request (step S13), the server device 2 updates the specialized information in the specialized information database 4 (step S14). If the specialized information database 4 is stored in the server device 2, step S14 is executed in the server device 2. If the specialized information database 4 is stored in a computer device other than the server device 2, the server device 2 transmits the update request received in step S13 to the computer device in which the specialized information database 4 is stored. The processing of step S14 is executed in that computer device.

[0032] Here, updating specialized information refers to a process of adding, replacing, and / or deleting predetermined information (specialized information) from the specialized information database 4. The specialized information may be stored in the specialized information database 4 in association with the file name of the information, a comment to be displayed on the user terminal 1, etc. Furthermore, information indicating that the addition, replacement, and / or deletion of predetermined information from the specialized information database 4 has been performed may be stored in association with information regarding the date and time of the execution, the administrator who instructed the execution, the file name, the comment, etc. The date and time of the execution may be any of the time when the instruction information is received in step S11, the time when the update request is sent in step S12, the time when the update request is received in step S13, and the time when the specialized information is updated in step S14.

[0033] After executing step S14, the server device 2 deletes the history information in response to the addition, replacement, and / or deletion of the specialized information in step S14 (step S15). The specialized information update process is completed by the processes of steps S11 to S15.

[0034] The history information stores an answer acquired from a language model in association with information about a prompt corresponding to the answer. In this embodiment, the system 10 can acquire an answer from a language model based on a prompt. "Acquiring an answer from a language model" means that a prompt is input to the language model, causing the language model to output an answer. The system 10 also stores an answer acquired from the language model in association with information about the prompt corresponding to the answer. The information about the prompt includes, for example, the prompt itself input to the language model, information about keywords and / or text information included in the prompt, information about the answer level included in the prompt, information about the output format of the answer included in the prompt, and a temporary prompt used to generate the prompt. The history information may also store attribute information about the user who input the prompt in association with information about the answer or prompt. The attribute information may include, for example, the user's job title, years of service, gender, age, etc.

[0035] In this embodiment, a question or instruction input into a language model to obtain an answer from the language model is defined as a "prompt," and information generated in the process of generating a prompt based on input and / or selection at the user terminal 1 is defined as a "temporary prompt."

[0036] The history information is stored, for example, in a database in the storage unit 23 of the server device 2. In step S15, the server device 2 can delete the answers stored in the database in the storage unit 23 and / or information related to the prompts corresponding to the answers.

[0037] Note that "deleting history information" in step S15 may mean completely erasing the information to be deleted from the database of the storage unit 23, or may mean setting a deletion flag on the information to be deleted. Information that has been flagged for deletion is excluded from the history information that is the subject of determination in step S61 or S71, which will be described later.

[0038] In step S15, the history information to be deleted may be all history information stored in the database, or may be history information related to the specialized information updated in step S14. History information related to specialized information may be, for example, history information associated with a prompt that includes the specialized information, history information associated with an answer that includes the specialized information, or history information associated with an answer that references the specialized information.

[0039] In the above, the processes of steps S11 and S12 are executed by the administrator terminal 5, but they may also be executed by the user terminal 1. Furthermore, instead of the processes of steps S11 to S13, the process of step S14 may be executed in response to a predetermined condition being satisfied. For example, when addition, replacement, and / or deletion of information is detected in a predetermined database, addition, replacement, and / or deletion of information may be executed in the specialized information database 4 so as to correspond to the information.

[0040] [Keyword setting process] Next, a keyword setting process for setting keywords corresponding to options displayed on the user terminal 1 will be described.

[0041] In this embodiment, a keyword is text information indicating a predetermined content. A keyword may be a single word or may include multiple words. In the system 10, keywords to be displayed as options on the user terminal 1 can be registered in the storage unit 23 by operating the administrator terminal 5. When registering a keyword, it is also possible to set attributes such as a major category, a medium category, and a small category for each keyword (two attributes of a major category and a small category may be used, and the number of attributes is not particularly limited. Attributes represented by numbers such as a first category, a second category, and a third category may also be used). For example, the major category, the medium category, and the small category may be higher-level concepts, lower-level concepts than the major category, and lower-level concepts than the medium category.

[0042] Furthermore, among the words constituting the prompt, the upstream concept for identifying the content of the prompt may be referred to as a major category, the downstream concept from the major category may be referred to as a medium category, and the downstream concept from the medium category may be referred to as a minor category. For example, if "home care" or "home nursing" is a keyword for the major category, "problem," "fee," and "method" may be keywords for the medium and small categories. By registering attributes to keywords in this manner, for example, multiple options for the major category are displayed on the user terminal 1, and when at least one of these options is selected, multiple options for the medium category are displayed. When at least one of the options for the displayed medium category is selected on the user terminal 1, multiple options for the small category are displayed, and it becomes possible to select at least one of these options.

[0043] Furthermore, when registering a keyword, the system 10 can register related keywords related to each keyword in the storage unit 23. The system 10 can register multiple related keywords for one keyword. Furthermore, when registering this related keyword, the system 10 can register related keywords related to this related keyword in the storage unit 23. In this case, multiple related keywords can also be registered for one related keyword. By registering related keywords in this way, for example, multiple options are displayed on the user terminal 1, and when at least one of these options is selected, options corresponding to the related keywords registered for the keyword corresponding to the selected option are displayed. Furthermore, when at least one of these options is selected, options corresponding to the related keywords registered for the related keyword corresponding to the selected option are displayed.

[0044] 5 is a flowchart of a keyword setting process according to an embodiment of the present invention. First, the administrator logs in to the system 10 from the administrator terminal 5. The process of logging in to the system 10 is the same as the specialized information update process, and therefore will not be described here.

[0045] Next, the administrator terminal 5 transmits a keyword setting request to the server device 2, requesting that a keyword be set by an operation of the administrator (step S21).

[0046] The keyword setting request sent in step S21 may include a prompt regarding what kind of keywords to set. For example, the prompt included in the keyword setting request may be, "Refer to the information stored in the specialized information database 4 regarding long-term care insurance, and set keywords by dividing into major, medium, and minor categories. Set the keywords for the medium categories to correspond to the keywords for the major categories and to subdivide each keyword. Set the keywords for the minor categories to correspond to the keywords for the medium categories and to subdivide each keyword."

[0047] When the server device 2 receives the keyword setting request (step S22), it extracts keyword information related to the keyword using the language model (step S23).

[0048] The processing of step S23 will be described. In step S23, the server device 2 transmits a keyword setting request to the language model server 3. Upon receiving the keyword setting request, the language model server 3 refers to the specialized information database 4 to extract predetermined keywords.

[0049] The server device 2 stores the keyword information extracted in step S23 (step S24), and deletes the history information (step S25). Through the above processes of steps S21 to S25, the keyword setting process ends.

[0050] The keyword information includes text information indicating the keyword and information about the keyword category, including information about the category to which the keyword belongs and the keyword to which the keyword is associated.

[0051] The history information in step S25 has the same meaning as the history information in step S15. The history information deleted in step S25 may be all history information stored in the database, or may be history information related to the keyword information stored in step S24. History information related to keyword information is, for example, information associated with information related to the keyword corresponding to the keyword information, or history information associated with a prompt including the keyword corresponding to the keyword information.

[0052] The process of step S25 may be omitted. If the language model is stored in the server device 2, step S23 is executed in the server device 2.

[0053] Note that, in place of the above-described processing of steps S21 to S23, or in addition to the processing of steps S21 to S23, the keyword setting processing may be performed by inputting keyword information to the administrator terminal 5, thereby executing the processing of step S24. For example, the administrator may be able to set a keyword by inputting information about a keyword that the administrator has created himself / herself to the administrator terminal 5.

[0054] After the process of step S23, the extracted keyword information may be controlled to be displayed on the administrator terminal 5. The administrator can check the displayed keywords and change, add, and / or delete the keywords by operating the administrator terminal 5. The input keyword information may be sent from the administrator terminal 5 to the server device 2, thereby executing the processes from step S24 onwards.

[0055] [Output Processing] Next, a description will be given of an output process in which a user displays a predetermined answer using the system 10. Fig. 6 is a diagram showing a flowchart of the output process according to this embodiment.

[0056] First, the user logs in to the system 10 from the user terminal 1. The operation of logging in to the system 10 is the same as the operation of the administrator terminal 5 in the specialized information update process, so it will not be explained here. It is preferable that the user registers attribute information about the user in the system 10 in advance, in association with the user ID.

[0057] When logging in to the system 10, the user terminal 1 displays a screen for inputting a question (step S31). In step S31, the system 10 controls the user terminal 1 to display options. At least one option is displayed on the display screen in step S31. One option corresponds to one keyword. Multiple options may be displayed on the display screen in step S31. Each of the multiple options corresponds to a different keyword. Details of the display screen will be described later. The user terminal 1 accepts input of one option from the options displayed on the screen (step S32).

[0058] The user terminal 1 transmits the input information input in step S32 to the server device 2 (step S33). The input information in step S33 includes information related to the options selected in step S32. The server device 2 receives the input information (step S34). Step S34 is a process of accepting the selection of one or more options from a plurality of options corresponding to each of a plurality of keywords in response to the input from the user terminal 1.

[0059] The server device 2 identifies the option to be displayed next (step S35). In step S35, the server device 2 refers to a database in which keywords are stored to identify the option to be displayed next. Specifically, the server device 2 identifies a keyword associated with the keyword corresponding to the option accepted in step S34. The identified keyword is the keyword corresponding to the option to be displayed next.

[0060] Next, the server device 2 generates a temporary prompt to be displayed on the user terminal 1 from the information about the options received in step S34 (step S36). In step S36, the temporary prompt is generated to generate a prompt to be input into the language model so as to include keywords corresponding to the options selected in step S32. The method of generating the temporary prompt in step S36 is not particularly limited.

[0061] In step S36, the temporary prompt may be generated, for example, by embedding keywords corresponding to the options selected in step S32 into a preset template. The template may vary depending on the number of options selected and / or whether or not text information, described below, has been input. That is, in step S34, the template to be referenced is identified depending on the number of options selected on the user terminal 1. The server device 2 can generate the temporary prompt by inserting keywords corresponding to the options into predetermined positions in the template.

[0062] For example, some standard phrases are, "Tell me about (keyword corresponding to option 1) in the long-term care insurance system," and "Tell me about (keyword corresponding to option 2) in (keyword corresponding to option 1) in long-term care insurance." Option 1 is the option selected first, and option 2 is the option selected second.

[0063] Alternatively, in step S36, a method of generating a temporary prompt may be to set up a table in which temporary prompts are stored in advance in association with keywords corresponding to options. The server device 2 may refer to the table to identify the temporary prompt corresponding to the keyword.

[0064] The server device 2 transmits option information related to the option identified in step S35 and the temporary prompt generated in step S36 to the user terminal 1 (step S37). The user terminal 1 receives the option information and the temporary prompt (step S38) and displays them on the screen (step S39). In step S39, the user terminal 1 is controlled to display the temporary prompt generated in step S36. The options displayed in step S39 are options corresponding to the keywords associated with the option selected in step S32.

[0065] The processing of steps S32 to S39 is repeated any number of times depending on the content of the question that the user wants to ask. That is, the system 10 can accept the selection of one or more options from the options controlled to be displayed in steps S31 and S39. The number of times steps S32 to S39 are repeated is set in advance by operating the administrator terminal 5. It is preferable that the administrator sets keyword items depending on the number of repetitions.

[0066] When the repeated processing of steps S32 to S39 is completed and the user selects an option corresponding to the keyword he or she wishes to select, the user terminal 1 accepts input of text information through a user operation (step S40). In step S40, it is preferable that a word is input as the text information. In step S40, information related to the answer level and / or information related to the output format of the answer may also be accepted. The user terminal 1 transmits the input information input in step S40 to the server device 2 (step S41). The input information in step S41 includes information related to the option selected in step S32 and the text information input in step S40. The input information in step S41 may also include information related to the answer level and / or information related to the output format. The server device 2 receives the input information (step S42). Step S42 is a process of accepting input of text information in response to an input from the user terminal.

[0067] Next, the server device 2 generates a provisional prompt to be displayed on the user terminal 1 based on the keyword corresponding to the option selected in step S32 and the text information input in step S40 (step S43). The process of step S43 is executed in the same manner as the process of step S36.

[0068] The server device 2 transmits the temporary prompt generated in step S43 to the user terminal 1 (step S44). The user terminal 1 receives the temporary prompt (step S45) and displays the temporary prompt on the screen (step S46).

[0069] The user checks the temporary prompt, and if the user determines that the question he or she wants to ask is expressed correctly, operates the user terminal 1, and the user terminal 1 transmits an answer request to the server device 2 (step S47). The answer request includes information about the temporary prompt. The answer request may include information about keywords included in the temporary prompt, text information, and information about the user's attributes. When the server device 2 receives the answer request (step S48), an answer acquisition process is executed to acquire answer information about the answer (step S49).

[0070] When the server device 2 acquires the answer information in step S49, it transmits the answer information to the user terminal 1 (step S50). The user terminal 1 receives the answer information (step S51). The answer information transmitted in step S50 is answer information corresponding to the answer request transmitted from the user terminal 1 in step S47. The user terminal 1 displays an answer on the screen from the received answer information (step S52). The answer information acquired in step S49 and the answer information displayed in step S52 do not have to match. The answer information displayed in step S52 may be a part of the answer information acquired in step S49. The server device 2 stores the answer acquired in step S49 as history information in the storage unit 23 (step S53). The output process is completed by the processes in steps S31 to S53.

[0071] The history information in step S53 has the same meaning as the history information in step S15. Regarding step S53, storage of the history information may be executed only when answer information is acquired in step S70 or S91 described below. Furthermore, in step S53, the server device 2 may store information related to keywords corresponding to the options selected in the user terminal 1. The information related to the keywords may be stored in association with the date and time of selection. The server device 2 can calculate the number of times a predetermined keyword has been selected within a predetermined period.

[0072] After the processing of step S52, input of evaluation information for evaluating the answer may be executed in response to an operation on the user terminal 1. The answer information transmitted in step S50 may include information requesting the user to evaluate the answer. In step S52, information for the user to evaluate the answer is displayed on the display screen. The evaluation information may be a graded evaluation of whether the answer was satisfactory, or may be information that accepts comments about the answer as text information. The evaluation information is stored in the storage unit 23 of the server device 2. The evaluation information may be stored in the storage unit 23 of the server device 2 in association with history information corresponding to the evaluation information. The evaluation information can be controlled to be displayed on the administrator terminal 1.

[0073] The order of the processes of steps S35 and S36 may be reversed. Furthermore, the processes of steps S35 and S36 and / or step S43 may be executed by the user terminal 1. In this case, the processes of steps S33, S34, S37 and S38 and / or steps S41, S42, S44 and S45 may be omitted.

[0074] The temporary prompt displayed in step S39 may be a prompt. In this case, steps S40 to S46, as well as step S63 (described later) or steps S83 to S85 (described later) are omitted. The system 10 may generate a prompt so as to include a keyword corresponding to the option selected in step S32. The temporary prompt displayed in step S46 may be a prompt. In this case, step S63 (described later) or steps S83 to S85 (described later) are omitted. The system 10 may generate a prompt based on the keyword corresponding to the option selected in step S32 and the text information, etc., input of which was accepted in step S40.

[0075] [Answer acquisition process] Next, the answer acquisition process in step S49 will be described. Fig. 7 is a diagram showing a flowchart of the answer acquisition process according to this embodiment. In the answer acquisition process shown in Fig. 7, specialized information is acquired by the language model server 3.

[0076] First, the server device 2 determines whether information relating to the temporary prompt received in step S48 and a prompt that satisfies a predetermined condition is stored (step S61). As described above, information relating to the prompt is stored as history information in the server device 2. In step S61, the server device 2 compares the temporary prompt with information relating to the prompt included in the history information to determine whether information relating to the temporary prompt and a prompt that satisfies a predetermined condition is stored.

[0077] The "predetermined condition" in step S61 may be, for example, that the information about the temporary prompt and the prompt match or are similar. The information about the temporary prompt and the prompt to be compared may include the temporary prompt itself, keywords and / or text information contained in the temporary prompt, attributes of the user who entered the options, the answer level, the output format, etc.

[0078] A match between the temporary prompt and the information about the prompt means that the comparison target is a complete match between the temporary prompt and the information about the prompt. A similarity between the temporary prompt and the information about the prompt means that the comparison target is similar between the temporary prompt and the information about the prompt. For example, if the comparison target is a keyword, the server device 2 may determine that the comparison target is similar if a predetermined threshold or more of the keywords (e.g., two or more out of three) match. If the comparison target is the temporary prompt itself, the server device 2 may determine that the comparison target is similar if the vector similarity between the temporary prompt and the prompt is a predetermined threshold or more (e.g., 0.5 or more).

[0079] When the comparison targets are keywords and / or text information, the server device 2 may determine whether the order in which the keywords and / or text information were selected or entered matches, in addition to the content of the keywords and / or text information. In other words, the server device 2 may determine whether the content and / or order of the keywords and / or text information included in the provisional prompt matches or is similar to that of the keywords and / or text information included in the prompt stored in the history information.

[0080] If information relating to the temporary prompt and a prompt that satisfies the predetermined conditions is stored (YES in step S61), the server device 2 acquires answer information by identifying an answer corresponding to the information relating to the prompt from the history information (step S62).On the other hand, if information relating to the temporary prompt and a prompt that satisfies the predetermined conditions is not stored (NO in step S61), the server device 2 generates a prompt from the temporary prompt (step S63).

[0081] In step S63, the server device 2 generates a prompt by adding predetermined information to the temporary prompt. The predetermined information is, for example, information about a keyword, answer level, and / or output format corresponding to an option not selected by the user in step S32 and / or step S40. Furthermore, the predetermined information is preferably information about a prompt that is not stored in the server device 2 as history information.

[0082] In step S63, the server device 2 identifies information about a prompt that is set in the system 10 but is not stored in the server device 2. The server device 2 then generates a temporary prompt by connecting the identified information to information of the same type as the identified information with a selective conjunction. Alternatively, the server device 2 generates a temporary prompt by replacing the identified information with information of the same type as the identified information in the temporary prompt. The server device 2 then generates a prompt by combining the temporary prompt received in step S48 with the generated temporary prompt.

[0083] In addition, information of the same type may be, for example, in the case of keywords, keywords of the same attribute; in the case of answer levels, information set as an answer level; and in the case of output formats, information set as an output format.

[0084] For example, if the temporary prompt received in step S48 is "Please tell me about keyword B of keyword A. Please output in output format X," the following process is executed in step S63. If output formats X, Y, and Z are set in the system 10, the information about the keyword and output format included in the temporary prompt is "keyword A, keyword B, and output format X," so the server device 2 adds information about output format Y and output format Z to the temporary prompt.

[0085] The server device 2 generates a prompt such as, for example, "Please tell me about keyword B of keyword A. Please output in output format X, Y, or Z." Alternatively, the server device 2 generates a prompt such as, for example, "Please tell me about keyword B of keyword A. Please output in output format X. Please tell me about keyword B of keyword A. Please output in output format Y. Please tell me about keyword B of keyword A. Please output in output format Z."

[0086] The server device 2 transmits the prompt generated in step S63 to the language model server 3 (step S64). Upon receiving the prompt (step S65), the language model server 3 acquires specialized information as related information from the specialized information database 4 based on the prompt (step S66).

[0087] In step S66, the language model server 3 can use a known method for the process of acquiring related information from the specialized information database 4. For example, information containing a keyword included in the prompt may be considered to be related information. The language model server 3 may acquire information containing a keyword included in the prompt from the specialized information database 4. Alternatively, the language model server 3 may acquire information containing a keyword corresponding to the option selected in step S32 from the specialized information database 4.

[0088] Alternatively, information having a vectorized value that is similar to the value obtained by vectorizing the prompt may be regarded as related information. The language model server 3 can acquire related information as follows. For example, the language model server 3 performs vector calculation on the prompt received in step S65 to vectorize the prompt. Furthermore, the specialized information stored in the specialized information database 4 has been vectorized by performing vector calculation. The server device 2 uses the vectorized prompt and the vectorized information in the specialized information database 4 to acquire information that provides a value similar to the value obtained from the vectorized prompt. In other words, if values ​​obtained from vectorized sentences are similar between text A and text B, text A and text B are determined to be related. Related information may also refer to similar vectorized values.

[0089] In the present embodiment, "approximate" means, for example, that the absolute value of the difference between the values ​​is equal to or less than a predetermined threshold (or less than the predetermined threshold). The predetermined threshold can be set as appropriate.

[0090] After acquiring the specialized information in step S66, the language model server 3 uses the specialized information and the prompt to output an answer from the language model (step S67). The language model server 3 transmits answer information related to the output answer to the server device 2 (step S68). The server device 2 receives the answer information (step S69) and acquires the answer information (step S70).

[0091] Next, the server device 2 associates the answer information with information related to the prompt (step S71). In step S63, the server device 2 generates a prompt that causes multiple answers to be output within one answer. Therefore, in step S71, the server device 2 executes a process of associating at least a portion of the acquired answer with information related to the prompt corresponding to at least a portion of the answer. For example, the server device 2 associates a first part included in the answer with information related to the prompt corresponding to the first part, and associates a second part included in the answer with information related to the prompt corresponding to the second part.

[0092] A known method can be used to identify which part of the answer acquired in step S70 relates to which keyword, answer level, and / or output format. For example, the system 10 may perform additional learning, such as fine-tuning, on the language model regarding how to output an answer. Alternatively, the system 10 may generate a prompt in step S63 to include a provisional prompt that specifies the output.

[0093] The answer information and information related to the prompt associated in step S70 are stored as history information in step S53. That is, the system 10 can store multiple pieces of history information by outputting an answer from the language model once. The answer acquisition process is completed by the above steps S61 to S71.

[0094] Next, another example of the answer acquisition process in step S49 will be described. Fig. 8 is a diagram showing a flowchart of another example of the answer acquisition process according to an embodiment of the present invention. The answer acquisition process shown in Fig. 8 differs from the answer acquisition process shown in Fig. 7 in that specialized information is acquired by the server device 2.

[0095] First, the server device 2 determines whether information relating to the temporary prompt received in step S48 and a prompt that satisfies a predetermined condition is stored (step S81). If information relating to the temporary prompt and a prompt that satisfies the predetermined condition is stored (YES in step S81), the server device 2 acquires answer information by identifying an answer corresponding to the information relating to the prompt from the history information (step S82). The processing in steps S81 and S82 can be the same as the processing in steps S61 and S62, and therefore a description thereof will be omitted.

[0096] If the server device 2 does not store information relating to the temporary prompt received in step S48 and a prompt that satisfies the predetermined conditions (NO in step S81), the server device 2 generates a temporary prompt (step S83). The processing in step S83 can be the same as the processing in step S63, except that the "prompt" to be generated is a "temporary prompt."

[0097] The server device 2 acquires specialized information as related information from the specialized information database 4 based on the keyword corresponding to the temporary prompt generated in step S83 or the option selected and accepted in step S32 (step S84).

[0098] In step S84, a known method can be used for the process in which the server device 2 acquires related information from the specialized information database 4. For example, the process in step S84 can be the same as the process in which the language model server 3 acquires related information from the specialized information database 4 (step S66) described above, except that the "prompt" is replaced with a "temporary prompt" and the "language model server 3" is replaced with the "server device 2."

[0099] When the specialized information is acquired in step S84, the server device 2 generates a prompt based on the information acquired in step S84 and the keyword corresponding to the temporary prompt received in step S48 or the option selected in step S32 (step S85).

[0100] In step S85, the server device 2 can generate a prompt by adding the specialized information acquired in step S84 to the temporary prompt received in step S48. Also, in step S85, the server device 2 can generate a prompt to be input to the language model so as to include the keyword corresponding to the option selected in step S32 and the text information input in step S40.

[0101] The server device 2 transmits the prompt generated in step S85 to the language model server 3 (step S86). The language model server 3 receives the prompt (step S87). The language model server 3 outputs an answer by inputting the prompt into a language model (step S88). The language model server 3 transmits answer information regarding the output answer to the server device 2 (step S89). The server device 2 receives the answer information (step S90) and acquires the answer information (step S91).

[0102] The server device 2 associates the answer information with information relating to the prompt (step S92). The process of step S92 can be the same as the process of step S71. After the processes of steps S81 to S92, the answer acquisition process ends.

[0103] In the above, the temporary prompts to be input to the language model are generated by the processing of steps S31 to S48, but the temporary prompts used in the answer acquisition process may be acquired by inputting them in another computer device. That is, instead of the processing of steps S31 to S48, the answer acquisition process may be executed by acquiring the temporary prompts input in another computer device.

[0104] Also, the processing of step S63 or S83 may be omitted. In this case, the processing of step S71 or S92 is also omitted. Furthermore, in this case, in the answer acquisition processing shown in Figure 7, the temporary prompt received in step S48 is used as the prompt. The prompt used in the answer acquisition processing may be obtained from one input in another computer device.

[0105] The processes of steps S63 to S71 and S53, or steps S83 to S92 and S53, may be executed in response to an operation on the administrator terminal 5. For example, the above processes may be executed after the keyword setting process. At this time, answers corresponding to temporary prompts that combine the set keywords are stored as history information. When answers corresponding to all combinations of the set keywords, answer levels, and output formats have been stored as history information, the processes of steps S63 to S71 or steps S83 to S92 may be omitted in the output process executed in response to an operation on the user terminal 1.

[0106] In the above-described answer acquisition process, related specialized information is acquired in step S66 or S84, but the process of step S66 or S84 may be omitted. If step S84 is omitted, the process of step S85 is also omitted. In this case, the temporary prompt displayed in step S39 or S46 may be input as a prompt to the language model. The system 10 can acquire an answer from the language model based on the prompt generated in step S36 or S43 or a prompt generated from the temporary prompt generated in step S36 or S43.

[0107] [Display screen explanation] Next, the display screen according to this embodiment will be described. Figures 9 to 13 are diagrams showing examples of the display screen according to this embodiment. Figure 9 shows a display screen 100a in step S31.

[0108] The display screen 100a is a screen for a user to input a question to the system 10. The display screen 100a has a first option display area 101, a second option display area 102, a third option display area 103, a free word input area 104, and a generation prompt display area 110. The display screen 100a may also have an answer level selection area 105 and / or an output format selection area 106.

[0109] The first option display area 101 is an area for displaying the first option that the user initially selects. It is preferable that the first option is always selected by the user. A plurality of first options 30, 31, 32, 33, and 34 are displayed in the first option display area 101. Also, first options 30a to 30j are displayed so as to correspond to the first option 30. Each of the keywords corresponding to the first options 30a to 30j is associated with the keyword corresponding to the first option 30.

[0110] Similarly, first options 31a to 31d corresponding to first option 31, first options 32a to 32c corresponding to first option 32, and first options 33a to 33c corresponding to first option 33 are displayed.

[0111] In this embodiment, among the multiple options displayed, the keyword associated with the first option is different from the keyword associated with the second option. That is, on the display screen 100a, the keyword associated with the keyword "home care" corresponding to the first option 30 is different from the keyword "facility care" corresponding to the first option 31. Note that among the multiple options displayed, there may be options in which some or all of the keywords associated with the options overlap.

[0112] In this embodiment, each option is displayed in a manner that allows the corresponding keyword to be understood. In Figures 9, 10, and 12, text indicating the content of the keyword corresponding to the option is displayed in a rectangular frame.

[0113] The second option display area 102 is an area for displaying a second option that the user selects second. The third option display area 103 is an area for displaying a third option that the user selects third. On the display screen 100a, options corresponding to the second option display area 102 and the third option display area 103 are not displayed. The free word input area 104 is an area for the user to input text information (also called a free word) in step S40.

[0114] The answer level selection area 105 is an area for displaying options related to the answer level selected by the user. Level options 105a to 105d are displayed in the answer level selection area 105. The system 10 pre-sets the level options in correspondence with keywords related to the answer level. The system 10 may also store temporary prompts corresponding to keywords related to the answer level. Keywords related to the answer level may be, for example, keywords related to the level of the answer, such as "easy to understand," "concise," "without using technical terms," ​​"so that even an elementary school student can understand," or "explained like an expert," or keywords related to the expression of the answer, such as "in the polite form" or "in the polite form."

[0115] The output format selection area 106 is an area for displaying options related to the output format selected by the user. The output format selection area 106 displays output format options 106a to 106d. The output format options 106a to 106d are options for the user to select the output format of the answer in step S40. The system 10 pre-sets the output format options in association with keywords related to the output format. The system 10 may also store temporary prompts corresponding to keywords related to the output format. The keywords related to the output format may be, for example, keywords related to the type of answer to be output, such as "item list," "table format," "FAQ format," or "unspecified," or keywords related to the number of characters to be output, such as "within 300 characters."

[0116] The generated prompt display area 110 is an area for displaying the temporary prompt generated in step S36 or S43.

[0117] The display screen 100a may have icons 121 to 124. When the icon 121 is selected, an answer request is sent to the server device 2 in step S47. The temporary prompt displayed in the generated prompt display area 110 when the icon 121 is selected becomes the temporary prompt included in the answer request. When the icon 122 is selected, the content selected or displayed on the display screen 100a is deleted. When the icon 123 is selected, the first option displayed in the first option display area 101 is deleted.

[0118] 10 shows the display screen 100b in step S39 after the first option is selected. In the following explanation, the contents explained with respect to the display screen 100a will be omitted to avoid duplication.

[0119] Display screen 100b is a display screen that is displayed after first option 30a is selected on display screen 100a. In first option display area 101 on display screen 100b, "Home care" corresponding to the selected first option 30a is displayed. In second option display area 102 on display screen 100b, second options 40a to 40c are displayed. Furthermore, the first option is not displayed on display screen 100b.

[0120] The second options 40a to 40c each correspond to a keyword associated with the keyword "home care" corresponding to the first option 30a.

[0121] Also, the temporary prompt generated in step S36, "Tell me about home nursing care under the nursing care insurance system," is displayed in generated prompt display area 110. As shown in Fig. 10, the temporary prompt displayed in generated prompt display area 110 displays "home nursing care" in bold. In this embodiment, system 10 controls so that the keyword corresponding to the option selected in step S32 is displayed in a different format from the other text included in the generated temporary prompt.

[0122] The different manner is preferably a manner in which the keyword is displayed more prominently than other text, for example, by making the keyword bold, blinking, changing the color of the keyword, changing the size of the keyword, etc.

[0123] In this embodiment, the system 10 may perform control so that the temporary prompt displayed in the generated prompt display area 110 cannot be edited from the user terminal 1. Alternatively, the system 10 may perform control so that the temporary prompt displayed in the generated prompt display area 110 can be edited from the user terminal 1. The processing from step S47 onwards is performed using the temporary prompt edited by operating the user terminal 1.

[0124] When icon 121 is selected on display screen 100b, an answer corresponding to the temporary prompt displayed in generated prompt display area 110 is output. Specifically, when icon 121 is selected, the processes from step S47 onwards are executed. Figure 11 corresponds to display screen 100c at step S52 after the answer has been output, with steps S40 to S46 omitted from display screen 100b shown in Figure 10.

[0125] The display screen 100c has a condition display area 130, a questionnaire input area 140, and an answer display area 150.

[0126] The condition display area 130 displays information about the conditions for outputting an answer. The condition display area 130 displays conditions 131 and a generation prompt 132. The conditions 131 display options selected by the user and / or text information entered by the user.

[0127] The generation prompt 132 displays the prompt that was input to the language model to output an answer. Note that the prompt displayed in the generation prompt 132 does not have to match the prompt that was actually input to the language model. The prompt displayed in the generation prompt 132 may be the same as the provisional prompt displayed in the generation prompt display area 110.

[0128] The questionnaire input area 140 is an area for inputting evaluation information. The questionnaire input area 140 is provided with a satisfaction level input area 141 and a reason input area 142. The user can operate the user terminal 1 to input the satisfaction level of the answer in the satisfaction level input area 141. The user can also operate the user terminal 1 to input the reason for the evaluation in the reason input area 142.

[0129] At least a part of the answer information acquired in step S49 is displayed in the answer display area 150. Information that can identify the specialized information that was acquired from the specialized information database 4 and referenced when acquiring the answer may be displayed in the answer display area 150. The information that can identify the specialized information may be the specialized information itself, a URL to the specialized information, or a comment when the specialized information is displayed on the user terminal 1.

[0130] FIG. 12 shows the display screen 100d in step S46 after the first and second options have been selected and text information has been input.

[0131] Display screen 100d is a display screen that is displayed after selecting second option 40a on display screen 100b and then entering "problem" as a free word. A first option display area 101 on display screen 100d displays "home care," which corresponds to the selected first option 30a, and a second option display area 102 displays "physical care," which corresponds to the selected second option 40a. Furthermore, a third option display area 103 on display screen 100d displays third options 50a-50f. Furthermore, display screen 100b does not display the first and second options.

[0132] The third options 50a to 50f each correspond to a keyword associated with the keyword "physical care" corresponding to the second option 40a.

[0133] Additionally, the generated prompt display area 110 displays the temporary prompt generated in step S43, "Tell me about the problems with physical care in home care under the long-term care insurance system." As shown in FIG. 12, the temporary prompt displayed in the generated prompt display area 110 displays "home care," "physical care," and "problems" in bold. In this embodiment, the system 10 controls the display of the keywords and text information corresponding to the option selected in step S32 in a manner different from other text included in the generated temporary prompt. Preferably, the different manner is a manner in which the keywords and text information are displayed more prominently than the other text, as described above.

[0134] When icon 121 is selected on display screen 100d, an answer corresponding to the provisional prompt displayed in generation prompt display area 110 is output. Specifically, when icon 121 is selected, the processes from step S47 onwards are executed. FIG. 13 shows display screen 100e in step S52 after an answer request is sent from display screen 100d displayed in FIG. 12 and an answer is output. The components displayed on display screen 100e are the same as those on display screen 100c. An answer corresponding to the prompt displayed in generation prompt 132 is displayed in answer display area 150 on display screen 100e.

[0135] [Display order change process] Next, a description will be given of a display order change process for changing, in accordance with predetermined information, the area in which options are displayed on the user terminal 1. Fig. 14 is a diagram showing a flowchart of the display order change process according to this embodiment.

[0136] The timing of executing the display order change process is not particularly limited, and may be executed in response to a request from the administrator terminal 5, or may be executed at predetermined intervals (for example, one month). The display order change process may be executed for all options, or for a predetermined range of options. The predetermined range of options refers to options associated with the same keyword (for example, the first options 30a to 30j), options displayed on the same display screen, etc.

[0137] First, the server device 2 identifies the number of times each option has been selected within a predetermined period for which the display order change process is to be executed (step S91). The predetermined period is not particularly limited, but may be, for example, one month, one week, one day, etc. The predetermined period may be the period from the last time the display order change process was executed until the next time the process is executed.

[0138] Next, the server device 2 changes the area in which each option is displayed in accordance with the information relating to the specified number of times (step S92). The information relating to the number of times is, for example, the number of times the option was selected in a predetermined period. The server device 2 stores the changed display area in association with the option (step S93). The display order change process is completed by the above steps S91 to S93.

[0139] Changing the display area in step S93 is a concept that includes changing the display order on the same display screen, changing the options displayed on the first display screen to be displayed on the second display screen, causing the options displayed on the first display screen to be further displayed on the second display screen, and displaying further options.

[0140] For example, step S93 may change the position of the first option 30j to the position of the first option 30b on the display screen 100a. Furthermore, for example, step S93 may change the positions of the first options 33a to 33c associated with the first option 33 to positions higher than the first option 30 on the display screen 100a. Furthermore, for example, step S93 may further display the first option 30b higher than the other first options on the display screen 100a. Furthermore, for example, step S93 may change the second option 40a that was displayed on the display screen 100b so that it is displayed on the display screen 100a. At this time, the second option 40a may be displayed near the first option 30a, and selecting the second option 40a on the display screen 100a may result in the selection of both the first option 30a and the second option 40a.

[0141] Note that the display mode of the options may be controlled to differ depending on the information regarding the number of times specified in step S91. For example, the server device 2 may display options that have been selected more frequently in a predetermined period in a more prominent manner than other options. The server device 2 may also display options that have been selected more frequently in a predetermined period in red, options that have been selected in the middle order in blue, and options that have been selected less frequently in black. In this case, the server device 2 may or may not change the display area of ​​the options.

[0142] In this embodiment, the system 10 controls to display at least two or more options in a list (see FIGS. 9, 10, and 12). By the processes of steps S91 to S93, the system 10 can control to change and display the area displaying each option in step S31, S39, or S46 depending on the information related to the number of times the option was selected in step S32.

[0143] In this embodiment, the system 10 controls the display screen to display the next option each time an option is selected, but it may also be controlled to display, for example, the first option, the second option, and the third option on one display screen.

[0144] The system 10 may also control the user terminal 1 to display search history information relating to the search history searched by the user operating the user terminal 1. The search history information is stored in association with keywords corresponding to selected options, input text information, information on answer levels, information on output formats, a user ID, and / or search date and time. The search history information may be displayed in a list on the user terminal 1. Furthermore, by operating the user terminal 1 to select one piece of search history information, the keywords, etc. corresponding to the search history information may be displayed in a selected state on the display screen 100a.

[0145] The system 10 may control the user terminal 1 to display a screen for selecting a specialized information database 4 and / or a language model server 3 before step S31. The system 10 may display a search screen similar to a portal site before step S31. The user can select a specialized information database 4 and / or a language model server 3 to be used to output an answer in the system 10. The system 10 may also be configured to search for and extract a predetermined specialized information database 4 and / or language model server 3 in response to an operation of the user terminal 1 on the screen for selecting the specialized information database 4 and / or the language model server 3. The system 10 may also control the user terminal 1 to display a list of selectable predetermined specialized information databases 4 and / or language model servers 3.

[0146] On the display screen of the user terminal 1, the specialized information database 4 is displayed in a manner that allows the information stored in the specialized information database 4 to be understood. For example, attributes of the information stored in the specialized information database 4 may be displayed. For example, the user terminal 1 displays information attributes such as "nursing care insurance field," "personnel recruitment information," "accounting information," and "customer service." By selecting the attribute of the information about which the user wants to ask a question, the selected specialized information database 4 and / or language model server 3 are used to execute output processing and answer output processing.

[0147] Note that the process of accepting input of text information in step S40 does not have to be provided. If the process of accepting input of text information is not provided, the processes of steps S40 to S46 are omitted. Alternatively, options regarding the answer level and / or output format are input, and the processes of steps S40 to S46 are executed. In this case, the free word input area 104 is not displayed on the display screen 100. At this time, the user is limited to inputting only the options displayed on the display screen 100. This allows the system 10 to limit questions input to the language model to only keywords intended by the administrator who manages the options, and to prevent the language model from outputting answers regarding unrelated matters. In this way, the system can provide answers to the user by limiting the content of the question input by the user.

[0148] In this embodiment, the system 10 stores evaluation information. The administrator can display the evaluation information on the administrator terminal 5 and review the template phrases used to generate temporary prompts for answers with low evaluations. The administrator can also consider problems and areas for improvement based on the evaluation information.

[0149] The above describes an aspect in which system 10 supports a search for obtaining an answer related to specific information. However, the process of supporting the generation of prompts by selecting options in system 10 is not limited to searches, and can be used to support the generation of prompts for a language model to produce various outputs. For example, system 10 can be used to generate prompts for a language model to summarize or proofread a sentence, or to generate prompts for a language model to generate sentences or images. The sentences or images generated based on a language model may be, for example, materials such as proposal materials, analytical reports for marketing, or program code.

[0150] In this way, the system includes at least one computer device, a selection means for accepting a selection of one or more options from a plurality of options corresponding to each of a plurality of keywords in response to an input from a user terminal operated by a user, and a first generation means for generating a prompt to be input to a language model so as to include a keyword corresponding to the option selected by the selection means, or for generating a provisional prompt for generating the prompt. This can assist the user in inputting a prompt to be input to the language model. Furthermore, by preparing options corresponding to keywords in advance, the burden on the user when generating a prompt can be reduced. Furthermore, the user can obtain an output from the language model with simple input. For example, the user can obtain an answer to a question from the language model by entering options.

[0151] Furthermore, by providing the system with a prompt display means for controlling the display of the prompt or provisional prompt generated by the first generating means on the user terminal, the user can confirm the prompt or provisional prompt generated based on the selected option. Furthermore, if the prompt or provisional prompt is different from the user's intention, the user can reselect an option.

[0152] Furthermore, in this way, the system includes option display means for controlling the user terminal to display options, the selection means accepts selection of one or more options from the options controlled to be displayed by the option display means, and when one option is selected from the multiple options by the selection means, the option display means controls to further display options corresponding to keywords associated with the selected one option, thereby making it possible to provide more detailed information about the content of the question the user asks the language model. Furthermore, in this way, among the multiple options displayed, the keywords associated with a first option and the keywords associated with a second option are different, making it possible to display the option intended by the user.

[0153] Furthermore, by controlling the prompt display means to display the keyword corresponding to the option selected by the selection means in a manner different from other text contained in the generated prompt or provisional prompt, the user can confirm that the keyword selected by the user is included in the prompt or provisional prompt.

[0154] In this way, the system is provided with an input means for accepting input of text information in response to input from the user terminal, and the first generation means generates the prompt or the provisional prompt based on the keyword corresponding to the option selected and accepted by the selection means and the text information accepted as input by the input means, thereby allowing the user to flexibly input the content of the question they want to ask in addition to input using pre-set options.

[0155] Furthermore, in this way, the first generation means generates the prompt or the provisional prompt by embedding keywords corresponding to the options selected by the selection means into a preset template, thereby reducing the processing burden on the computer device for generating the prompt or provisional prompt.

[0156] Furthermore, in this way, the system is provided with an answer acquisition means for acquiring an answer from a language model based on the prompt generated by the first generation means or a prompt generated from a provisional prompt, thereby making it possible to output an answer from the language model.

[0157] In this way, the system includes an information acquisition means for acquiring related information from a specialized information database storing predetermined information based on the prompt generated by the first generation means or a prompt generated from a provisional prompt in a language model, and an answer acquisition means for acquiring an answer from the language model using the information acquired by the information acquisition means and the prompt, thereby making it possible to output an answer based on the predetermined information from the language model.In this way, the system includes an information acquisition means for acquiring related information from a specialized information database storing predetermined information based on the generated provisional prompt or a keyword corresponding to an option selected by the system, a second generation means for generating a prompt based on the information acquired by the information acquisition means and the provisional prompt or the keyword, and an answer acquisition means for acquiring an answer from the language model based on the prompt generated by the second generation means, thereby making it possible to output an answer based on the predetermined information from the language model.This makes it possible to acquire an answer that includes information updated since the learning of the language model was completed.

[0158] In this way, the system is equipped with an extraction means that extracts specified keywords by having the language model refer to a specialized information database, and the selection means accepts the selection of an option from options corresponding to the keywords extracted by the extraction means, thereby reducing the burden on the administrator of setting keywords.

[0159] Furthermore, in this way, the system includes an option display means for controlling the user terminal to display options, a selection means for accepting the selection of one or more options from the options controlled to be displayed by the option display means, and the option display means for controlling the display of at least two or more options in a list, and the selection means controls the area for displaying each option to be changed according to information on the number of times the option has been selected, thereby making it possible to change the area for displaying options according to the selection history of the option.Furthermore, options that are frequently selected during a search can be changed to be displayed in an area that is easy for the user to select.

[0160] In this way, the system includes at least one computer device, a first acquisition means for acquiring an answer from a language model based on a prompt, a storage means for storing the answer acquired by the first acquisition means in association with information about the prompt corresponding to the answer, a first generation means for generating or acquiring a prompt to be input to the language model or a provisional prompt for generating the prompt, and an identification means for identifying an answer corresponding to the information about the prompt from the storage means when the prompt or provisional prompt generated or acquired by the generation means and information about a prompt that satisfies a predetermined condition are stored. This reduces the number of times an answer is output from the language model. Furthermore, reducing the number of times the language model is used can speed up the response time for outputting an answer. Furthermore, reducing the number of times the language model is used can reduce usage fees for using the language model.

[0161] Furthermore, in this way, when the system is provided with a second acquisition means that acquires an answer from a language model based on a prompt generated from a prompt or provisional prompt generated or acquired by a first generation means and information relating to a prompt that satisfies a specified condition is not stored, the system can output an answer to the user even if the answer is not stored in the system.

[0162] Furthermore, in this way, the system includes second generation means that generates a prompt by adding predetermined information to the temporary prompt, second acquisition means that acquires answers from a language model based on the prompt generated by the second generation means, and storage means that associates and stores at least some of the answers acquired by the second acquisition means with information on the prompt corresponding to at least some of the answers, thereby dividing the answers output from the language model and storing them as answers corresponding to multiple questions. This allows the system to store multiple answers by outputting one answer, thereby reducing the number of times answers need to be output from the language model.

[0163] In this way, the system is equipped with an information acquisition means that acquires related information from a specialized information database in which specified information is stored based on a prompt, a first acquisition means that acquires an answer from a language model using the related information and the prompt, an information update means that adds, replaces, and / or deletes specified information from the specialized information database, and a deletion means that deletes information about the answer stored in the storage means and / or the prompt corresponding to the answer in response to the addition, replacement, and / or deletion of specified information by the information update means, thereby making it possible to prevent answers output based on past specified information from being provided to the user.

[0164] 1 User terminal 2 Server device 3 Language model server 4. Specialized information database 5. Administrator terminal 6 Communication Network 10 Systems 11 control unit 12 RAM 13 storage unit 14 input unit 15 Display unit 16 Communication interface 21 control unit 22 RAM 23 storage unit 24 communication interface 101 First option display area 102 Second option display area 103 Third option display area 104 Free word input area 105 Answer level selection area 105a~105d Level options 106 Output format selection area 106a~106d Output format options 110 Generation prompt display area 121~124 Icons 130 Condition Display Area 131 Conditions 132 Generation Prompts 140 Questionnaire input area 141 Satisfaction input area 142 Reason input area 150 Answer display area

Claims

1. 1. A system comprising at least one computer device, a first acquisition means for acquiring an answer from a language model based on the prompt; a storage means for storing the answer acquired by the first acquisition means and information relating to the prompt corresponding to the answer in association with each other; a first generating means for generating or obtaining a prompt for input to a language model or a provisional prompt for generating the prompt; a specifying means for specifying an answer corresponding to the information about the prompt from the storage means when the prompt or provisional prompt generated or acquired by the generating means and information about the prompt that satisfies a predetermined condition are stored; A system comprising:

2. a second acquisition means for acquiring an answer from a language model based on a prompt generated from the prompt or provisional prompt generated or acquired by the first generation means when information relating to the prompt or provisional prompt that satisfies a predetermined condition is not stored; The system of claim 1 , comprising:

3. a second generating means for generating a prompt by adding predetermined information to the temporary prompt; Equipped with a second obtaining means for obtaining an answer from the language model based on the prompt generated by the second generating means; the storage means stores at least some of the answers acquired by the second acquisition means in association with information on prompts corresponding to at least some of the answers; The system of claim 2 .

4. An information acquisition means for acquiring related information from a specialized information database in which predetermined information is stored, based on a prompt. Equipped with a first obtaining means for obtaining an answer from a language model using the related information and the prompt; an information updating means for adding, replacing, and / or deleting predetermined information from the specialized information database; a deletion means for deleting information relating to the answer stored in the storage means and / or the prompt corresponding to the answer in response to the addition, replacement, and / or deletion of predetermined information by the information update means; The system according to any one of claims 1 to 3, comprising:

5. a first acquisition means for acquiring an answer from a language model based on the prompt; a storage means for storing the answer acquired by the first acquisition means and information relating to the prompt corresponding to the answer in association with each other; a first generating means for generating or obtaining a prompt for input to a language model or a provisional prompt for generating the prompt; a specifying means for specifying an answer corresponding to the information on a prompt when the information on the prompt or provisional prompt generated or acquired by the generating means and the prompt satisfying a predetermined condition is stored in the storage means; A computer device comprising:

6. 1. A method executed on at least one computer device, comprising: a first acquisition step of acquiring an answer from a language model based on the prompt; a storage step of storing the answer acquired in the first acquisition step in association with information about the prompt corresponding to the answer; a first generation step of generating or obtaining a prompt for input to a language model or a provisional prompt for generating the prompt; a specifying step of specifying an answer corresponding to the information about the prompt when the information about the prompt or provisional prompt generated or acquired by the generating means and the prompt satisfying a predetermined condition is stored in the storing step; A method comprising:

Images