Information processing device and program

Abstract

You can easily find past questions that have high reuse value. [Solution] The information processing device includes: an evaluation receiving unit that receives the user's evaluation of the answer to the question generated by the generation unit based on the user's question; a history information generation unit that generates history information including the question and ranking information based on the evaluation, which serves as a criterion for determining the priority order for displaying the question; and a display control unit that displays one or more of the questions, determined according to the level of priority, to the user.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus and a program.

Background Art

[0002] In recent years, the technology of large language models (LLMs) that perform advanced natural language processing has been developed and popularized. An LLM can generate an answer to a user question in a prompt. For example, Patent Document 1 discloses a technique for generating a desired answer by newly generating search question information corresponding to a user question and generating an answer from the question information.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Generally, it is known that the quality of the generated answer varies greatly depending on the way (content and sentence structure) of the user question. The creator of the user question improves the user question once or interactively to generate a satisfactory answer.

[0005] However, in order to access past user questions with high reuse value, it is common to manually search back through the conversation history continuously. Therefore, a great deal of labor and time are required for repeated conversations. In addition, there is a problem that the continuity of the work is interrupted and the overall work efficiency is reduced by continuously searching back through the conversation history during the work of generating a desired answer. Therefore, there has been a desire to find past user questions with high reuse value in a simple way.

[0006] Therefore, the present invention has been made in view of the above points, and aims to provide a technology that allows for the easy retrieval of past questions that have high reuse value. [Means for solving the problem]

[0007] One aspect of the present invention is an information processing device comprising: an evaluation receiving unit that receives the user's evaluation of the answer to the question generated by the generation unit based on the user's question; a history information generation unit that generates history information including the question and ranking information based on the evaluation, which serves as a criterion for determining the priority order for displaying the question; and a display control unit that causes the user to display one or more of the questions determined according to the level of priority.

[0008] Furthermore, in one embodiment of the present invention, the priority is determined by obtaining ranking information from the history information in response to a user operation that displays the question determined according to the priority level.

[0009] Furthermore, in one embodiment of the present invention, the ranking information includes information indicating the time series of a plurality of the questions, and the display control unit displays the questions with similar evaluation levels in chronological order.

[0010] Furthermore, in one embodiment of the present invention, the evaluation received by the evaluation receiving unit is in two stages.

[0011] Furthermore, in one aspect of the present invention, the display control unit displays an answer display operation unit that displays the answer in response to the user's operation, in association with the question determined according to the priority level.

[0012] Furthermore, in one embodiment of the present invention, the history information is information entered based on the user's operation after the generation of the answer to the question, and does not include related information associated with the question.

[0013] Furthermore, in one embodiment of the present invention, when the user evaluates the answer to the question, the input of related information regarding the question based on the user's actions is not accepted.

[0014] Furthermore, in one embodiment of the present invention, the history information includes information that is entered based on the user's actions after the generation of the answer to the question, and which is related to the question.

[0015] Furthermore, in one embodiment of the present invention, the history information for a second question created chronologically after the first question includes change information indicating the changes made from the first question to the second question.

[0016] Furthermore, one aspect of the present invention is a program that causes a computer to execute an evaluation reception step for receiving the user's evaluation of the answer to the question generated by a generation unit based on the user's question; a history information generation step for generating history information including the question and ranking information based on the evaluation, which serves as a criterion for determining the priority order for displaying the question; and a display control step for displaying one or more of the questions, determined according to the level of priority, to the user. [Effects of the Invention]

[0017] According to the present invention, past questions with high reuse value can be easily found. [Brief explanation of the drawing]

[0018] [Figure 1] This is a block diagram illustrating an example configuration of the information processing system 1 according to Embodiment 1. [Figure 2] This is a first sequence diagram illustrating an example of the processing flow between the devices of the information processing system 1 according to Embodiment 1. [Figure 3] This figure shows an example of the first display screen D1 that is shown during evaluation. [Figure 4]It is a diagram for explaining a first example of the history information H according to the embodiment. [Figure 5] It is a diagram for explaining a second example and a third example of the history information H according to the embodiment. [Figure 6] It is a diagram for explaining a fourth example of the history information H according to the embodiment. [Figure 7] It is a second sequence diagram for explaining an example of the processing flow between the devices included in the information processing system 1 according to Embodiment 1. [Figure 8] It is a diagram showing an example of a second display screen D2 on which a first list of questions is displayed. [Figure 9] It is a diagram showing an example of a third display screen D3 displayed when the answer display operation unit D202 is operated. [Figure 10] It is a diagram showing an example of a fourth display screen D4 on which a second list of questions is displayed. [Figure 11] It is a diagram showing an example of a fifth display screen D5 on which a third list of questions is displayed. [Figure 12] It is a block diagram for explaining a configuration example of the information processing apparatus 10A according to Embodiment 2. [Figure 13] It is a block diagram for explaining a configuration example of the information processing apparatus 10B according to Embodiment 3. [Figure 14] It is a diagram showing an example of a first question Q1. [Figure 15] It is a diagram showing an example of a second question Q2. [Figure 16] It is a diagram showing an outline of a hardware configuration example of the information processing apparatus 90 applied to the present embodiment. <000​​​​​​​​The information processing device and program according to this embodiment can reduce the time required to generate highly accurate and dialogue-appropriate answers (high-quality dialogue questions) by searching for highly reusable questions with very simple and short operations, such as a single non-descriptive operation. Furthermore, because the search can be performed with simple and short operations, the continuity of work can be maintained and the user's work efficiency can be improved. Thus, the technology according to this embodiment enables further reduction of the time required to generate desired answers and the generation of high-quality dialogue questions, resulting in immeasurable economic benefits.

[0020] [Embodiment 1] The information processing apparatus and program according to this embodiment will be described in detail below with reference to the attached drawings, with reference to preferred embodiments. In the drawings, identical or similar parts are denoted by the same or similar reference numerals. This embodiment is not limited to these embodiments and includes various modifications or improvements. In other words, the components described below include those that can be easily imagined by a person skilled in the art, and those that are substantially the same, and the components described below can be combined as appropriate. Furthermore, this embodiment may include various omissions, substitutions, or modifications of components without departing from the spirit of the present invention.

[0021] In all the figures used to illustrate the embodiments, components having the same function are given the same reference numerals, and repeated explanations are omitted. Furthermore, in this application, "based on XX" means "based on at least XX," and includes cases where it is based on other elements in addition to XX. Also, "based on XX" is not limited to cases where XX is used directly, but also includes cases where it is based on XX after calculations or processing have been performed on it. Furthermore, "based on XX" may include XX itself. "XX" is any element (for example, any information). Embodiments of the present invention will now be described with reference to the drawings.

[0022] Figure 1 is a block diagram illustrating an example configuration of an information processing system 1 according to Embodiment 1. The information processing system 1 comprises an information processing device 10, a user terminal 20, and a generation device 30. One user terminal 20 may be connected to one information processing device 10, or multiple user terminals 20 may be connected.

[0023] The information processing device 10 and the user terminal 20, and the information processing device 10 and the generation device 30 are connected to each other via a network NW (network NW1, network NW2, etc.). The network NW may be a wireless communication network or a wired communication network. The network NW may be configured using, for example, the Internet or a local area network (LAN). The network NW may be configured by combining multiple networks.

[0024] [Example of an information processing device configuration] The information processing device 10 comprises an arithmetic unit 11 and a storage unit 13.

[0025] The arithmetic unit 11 is equipped with a central processing unit (CPU) and operates based on the programs and data stored in the memory unit 13, providing various functions.

[0026] The storage unit 13 is composed of, for example, a hard disk drive or semiconductor memory (flash memory, RAM, ROM), and stores various types of information, such as programs and data read by the arithmetic unit 11. The storage unit 13 may also be implemented by a virtual storage device, such as a cloud server, located outside the information processing device 10.

[0027] [Example of user terminal configuration] The user terminal 20 is, for example, an information processing device such as a personal computer, tablet, or smartphone. The user terminal 20 comprises a user terminal display unit 21, a user terminal operation unit 22, a user terminal calculation unit 23, and a user terminal storage unit 24.

[0028] The user terminal display unit 21 is equipped with, for example, a liquid crystal display and displays various images. In the following description, the display of an image by the user terminal display unit 21 is also referred to as presenting an image to the user. A user is, for example, a person who uses the information processing device 10.

[0029] The user terminal operation unit 22 is equipped with, for example, a touch panel and detects user operations. The user terminal operation unit 22 may also acquire user operation information from input devices such as a keyboard, mouse, and microphone. User operations may be performed in various ways, such as touching buttons or other display parts on the user terminal operation unit 22, using predetermined keys or wheels on input devices, or using voice commands. The following description will explain the operation of the user terminal operation unit 22 as an example.

[0030] The user terminal processing unit 23 (not shown) is equipped with a central processing unit and operates based on programs and data stored in the user terminal storage unit 24 (not shown), providing various functions.

[0031] The user terminal storage unit 24 is composed of, for example, a hard disk drive or semiconductor memory, and stores various types of information, such as programs and data read by the user terminal processing unit 23. The user terminal storage unit 24 may also be implemented by a virtual storage device, such as a cloud server, located outside the user terminal 20.

[0032] [Example of a generating device configuration] The generation device 30 represents an AI that has been pre-trained using natural language, images, or audio. The generation device 30 may be built by the user or it may be built externally (for example, an LLM). Also, if the generation device 30 is built by the user, it may be provided within the information processing device 10. Hereinafter, the process of supplying information to the generation device 30 to generate desired information will be simply referred to as "generating". The generation device 30 may also be called a generation unit.

[0033] [Functions of the information processing device] The calculation unit 11 includes, as its functional units, a communication unit 110, an operation reception unit 111, a display control unit 112, a question acquisition unit 113, a supply unit 114, an answer acquisition unit 115, an evaluation reception unit 116, and a history information generation unit 117. Each of these functional units may be implemented using electronic circuits as needed. Furthermore, each functional unit does not have to be included in a single device, and the information processing device 10 may be configured from multiple devices.

[0034] The communications unit 110 communicates information with the user terminal 20.

[0035] The operation reception unit 111 receives various operations performed on the user terminal 20. The operation reception unit 111 activates each part of the calculation unit 11 according to the various operations received.

[0036] The display control unit 112 controls the display on the user terminal 20. Specifically, the display control unit 112 generates a screen to be displayed on the user terminal display unit 21 and transmits it to the user terminal 20 via the communication unit 110. The user terminal 20 displays the screen generated by the display control unit 112. The display control unit 112 may also provide audio, not just a screen. In this case, the display control unit 112 may be called the audio presentation control unit.

[0037] [Function of information processing device: Question evaluation] Figure 2 is a first sequence diagram illustrating an example of the processing flow between each device in the information processing system 1 according to Embodiment 1. The information processing device 10 generates history information H, which is used when searching for a question Q with high reusability value, through processing performed by the functional units from the question acquisition unit 113 to the history information generation unit 117.

[0038] (Step S201) The user inputs question Q by operating the user terminal 20. The user terminal 20 receives question Q. Question Q is, for example, text information entered into the user prompt.

[0039] Question Q may consist of one question sentence or multiple question sentences. For example, Question Q may include question sentences for each of the multiple perspectives from which an evaluation is performed when generating an overall evaluation of a predetermined item. Question Q is also a question sentence that generates a desired answer A with a single detailed input, such as a mega prompt or giga prompt. Question Q may be text information, audio information, or may include image information as needed.

[0040] (Step S101) The question acquisition unit 113 of the information processing device 10 acquires a question Q from the user terminal 20.

[0041] (Step S102) The supply unit 114 of the information processing device 10 supplies the acquired question Q to the generation device 30.

[0042] (Step S301) The generation device 30 obtains the user's question Q from the information processing device 10.

[0043] (Step S302) The generation device 30 generates an answer A to question Q based on question Q. Answer A may be, for example, text information, audio data, or may include image information as needed. The generation device 30 outputs the generated question Q to the information processing device 10.

[0044] (Step S103) The answer acquisition unit 115 of the information processing device 10 acquires the answer A generated from the generation device 30 based on the question Q. The display control unit 112 of the information processing device 10 displays the acquired answer A on the user terminal 20.

[0045] (Step S202) The user terminal 20 displays answer A to the user via the user terminal display unit 21. The user evaluates the displayed answer A.

[0046] (Step S203) The user terminal 20 obtains evaluation information K regarding the user's evaluation of answer A based on the user's operation to the user terminal operation unit 22. Hereinafter, obtaining information (evaluation information K) based on the user's operation will also be simply referred to as accepting the user's operation (evaluation operation). The evaluation information K includes information indicating the evaluation result. The evaluation information K may also include, for example, the ID of the user who performed the evaluation, an identifier that identifies the answer A or question Q to be evaluated (for example, a dialogue thread number), or information that is determined in conjunction with the evaluation, such as the evaluation time. The user terminal 20 outputs the evaluation information K to the information processing device 10.

[0047] Figure 3 shows an example of the first display screen D1 that is displayed during evaluation. The first display screen D1 has the following screen configuration: interaction display section D11, evaluation section D12, session history display section D13, and list display operation section D14.

[0048] The interaction display unit D11 displays the results of the interactive information exchange with the generation device 30. Specifically, the interaction display unit D11 may display information related to operations received from the user, such as question Q entered by the user, and information presented to the user by the control of the information processing device 10 and the user terminal calculation unit 23, such as the answer A generated in response to question Q and the evaluation field D12. The user confirms the input content on the interaction display unit D11 and supplies the information to the generation device 30, and also confirms the content generated by the generation device 30.

[0049] The evaluation field D12 is displayed, for example, within the interaction display unit D11. The evaluation field D12 accepts evaluations of answer A in response to user actions. The evaluation of answer A indicates the degree to which answer A is suitable as an answer to question Q. Since whether or not the desired answer A can be generated depends on the quality of the source question Q, the evaluation of answer A is also an evaluation of the quality of question Q that generated answer A. Hereinafter, evaluating answer A will also be referred to as evaluating question Q.

[0050] The level of evaluation may be expressed in two stages, high or low, or it may be expressed in three or more stages with more subdivisions. Using a two-stage evaluation makes the evaluation simpler. Using three or more stages allows for a more accurate evaluation of the quality of each question Q and answer A. In Figure 3, a "yes" to the question "Are you satisfied with the answer?" indicates a high evaluation, while a "no" indicates a low evaluation.

[0051] Generally, it is rare to generate the desired answer A in a single attempt. Users gradually improve question Q, resolving problems and dissatisfactions (hereinafter sometimes referred to as issues) of the generated answer A, and identifying question Q that can generate the desired answer A. Improvements include, for example, adding, modifying, or deleting specific wording. Question Q that can generate content closer to the desired answer A by including wording that solves the issues in generating answer A tends to receive high user ratings and has high reuse value. On the other hand, question Q that does not solve the issues, or generates answer A that is less important than newly arising issues, tends to receive low user ratings and has low reuse value.

[0052] Note that the evaluation field D12 does not necessarily have to display all selectable evaluation levels. Specifically, the option indicating the lowest evaluation does not need to be displayed, and if the user does not evaluate question Q, the lowest evaluation given may be accepted. In this case, the high-evaluation buttons displayed in the evaluation field D12 represent buttons indicating that question Q should be saved.

[0053] Furthermore, if it is explicitly stated to the user that each question Q should be evaluated, the answer choices do not need to be displayed. Users may also evaluate by performing key operations or voice commands corresponding to each evaluation.

[0054] The session history display unit D13 displays the thread names of previously created sessions (interaction threads) and the currently active session. When the session history display unit D13 is operated, the target thread is displayed on the interaction display unit D11.

[0055] The list display operation unit D14, when operated, displays one or more questions Q that have high reuse value. Details of the list display operation unit D14 will be described later.

[0056] (Step S104) The evaluation receiving unit 116 of the information processing device 10 receives evaluation information K from the user terminal 20 and accepts the user's evaluation of answer A and the question Q that generated answer A.

[0057] (Step S105) The history information generation unit 117 of the information processing device 10 generates history information H. The history information H is generated based on at least the question Q and the evaluation information K about the question Q.

[0058] [History Information] Figure 4 is a diagram illustrating a first example of history information H according to the embodiment. History information H is information used when determining which question Q to display. History information H includes at least the question Q and ranking information R, and this information is associated with each other. Ranking information R is information that serves as a criterion for determining the priority when displaying question Q. Ranking information R is, for example, information that serves as a criterion for determining whether or not to display a question Q if there is a set upper limit on the number of questions Q to display, the display order, the display location on the screen, or the display timing. The information included in ranking information R may differ depending on the method of displaying question Q. For example, if question Q is to be displayed in order of the most recent creation time, it may include information that can identify the time series of each question Q, such as the input time of question Q, the generation time of answer A, the evaluation time, the time period during which work related to question Q was performed, and information attached according to a predetermined criterion for identifying question Q (thread number, and if the thread names do not overlap, the thread name (thread name (1), thread name (2), ..., thread name (N))).

[0059] Matching information may involve generating a single piece of information based on multiple pieces of information, or it may involve adding information that links the pieces of information together. The history information generation unit 117 may, for example, acquire each piece of information and generate history information H by combining these pieces of information. Alternatively, the history information generation unit 117 may generate history information H by storing the information to be matched so that its relationship with pre-stored information can be understood. When matching multiple pieces of information without combining them, each piece of information is assigned identification information I that matches it and is stored. Identification information I is information that identifies which question Q the information pertains to. Identification information I is, for example, information attached according to predetermined criteria for identifying question Q, and may be, for example, a thread number, a thread name, etc. Note that identification information I and rank information R do not need to be separate pieces of information; they may be a single piece of information, for example, information attached according to predetermined criteria for identifying question Q, such as a thread number.

[0060] Specifically, Figure 4 is an example of history information H generated based on a two-tiered high-rating question Q (high or low rating), and displayed in reverse chronological order. The first history information H1, second history information H2, third history information H3, fourth history information H4, and fifth history information H5 illustrate multiple history information H, and when not distinguished, they may be simply referred to as history information H below. In history information H, for example, a question Q is associated with a dialogue thread number as rank information R. For example, in first history information H1, the question Q, "Question Text 1," is associated with the dialogue thread number, "1." In this case, the dialogue thread numbers are assigned in the order in which the threads were created, with smaller numbers indicating older threads and larger numbers indicating newer threads. According to this history information H, the information processing device 10 can perform first-in, last-out (FILO) based on the size of the dialogue thread number and display the high-rated questions Q in reverse chronological order of creation.

[0061] Figure 5 illustrates a second and third example of the history information H according to the embodiment. Figure 5(A) is a second example of the history information H, which differs from the first example of the history information H in that it generates the history information H regardless of whether it is highly rated or low rated. The history information H may be associated with, for example, a question Q, evaluation information K, and a dialogue thread number. According to this history information H, highly rated and new question Qs are displayed preferentially. That is, the evaluation information K and the dialogue thread number play the role of ranking information R. Users may want to refer to question Qs that were previously given a low rating, for example, to significantly change the question Q they are creating. By including evaluation information K in the history information H, users can easily find the question Q they want to refer to.

[0062] Figure 5(B) shows a third example of history information H, which differs from the second example of history information H in that question Q is evaluated using an index of three or more levels. Similar to the second example, history information H may associate question Q, evaluation information K, and dialogue thread number. Users can easily find question Q containing more effective wording by giving higher ratings to question Q that solves two problems in generating the desired answer A than to question Q that solves only one problem.

[0063] As shown in Figures 5(A) and 5(B), when evaluation information K and ranking information R are associated with history information H, it is preferable to give more importance to evaluation information K when determining priority. The information processing device 10, for example, sets a high priority for questions Q with high evaluations, and when the evaluations of multiple questions Q are similar, it determines the final priority using ranking information R. If ranking information R includes information indicating a time series, questions Q with similar evaluation levels are displayed in chronological order.

[0064] Figure 6 is a diagram illustrating a fourth example of the history information H according to the embodiment. The fourth example of history information H differs from the first example of history information H in that the answer A generated from question Q is associated with it. Users may want to check the answer A generated from the question Q they are referring to, for example, to decide which question Q to use as the basis for improvement. With the history information H including the answer A, users can easily find a question Q that is suitable as the basis for improvement.

[0065] (Step S106) The storage unit 13 of the information processing device 10 stores the history information H generated by the history information generation unit 117.

[0066] [Functions of the information processing device: Display of question list] Figure 7 is a second sequence diagram illustrating an example of the processing flow between the devices in the information processing system 1 according to Embodiment 1. The information processing device 10 presents the user with a question Q that has high reusability value based on the user's operation.

[0067] (Step S204) The user terminal 20 accepts an operation to display a list of questions (hereinafter sometimes referred to as a display operation), such as a tap operation, click operation, or voice operation on the list display operation unit D14. The user terminal 20 outputs operation information indicating the operation to the generation device 30.

[0068] (Step S107) The operation reception unit 111 of the information processing device 10 accepts a display operation by acquiring operation information from the user terminal 20.

[0069] (Step S108) When the information processing device 10 receives a display operation from the operation reception unit 111, it obtains history information H by referring to the storage unit 13.

[0070] (Step S109) Based on the history information H, the information processing device 10 determines the display of question Q, the display location, and the display order, etc., according to the priority level. The display control unit 112 of the information processing device 10 outputs control information to the user terminal 20 to display the determined question Q.

[0071] (Step S205) The user terminal 20 obtains control information from the information processing device 10. The user terminal 20 displays a list of questions Q according to the control information.

[0072] Although an example of displaying only question Q is shown above, this embodiment is not limited to this example. The information processing device 10 only needs to display at least question Q from the information contained in the history information H, and may also display information other than question Q contained in the history information H (for example, answer A). Hereinafter, displaying at least question Q from the history information H may simply be referred to as displaying question Q.

[0073] Figure 8 shows an example of the second display screen D2 on which the first list of questions is displayed. The second display screen D2 is the screen that is displayed when the list display operation unit D14 is operated, and it comprises multiple history information display units D20 as part of its screen configuration. The first history information display unit D21 to the fifth history information display unit D25 are examples of multiple history information display units D20, and when they are not distinguished, they are simply referred to as history information display units D20. The multiple history information display units D20 may be displayed, for example, within the interaction display unit D11, or they may be displayed in an area other than the interaction display unit D11.

[0074] The history information display unit D20 displays at least the content of question Q from the information included in the history information H. Multiple history information display units D20 are displayed in order based on the ranking information R. The history information display unit D20 may also include, for example, a question display unit D201 and an answer display operation unit D202 as part of its screen configuration.

[0075] The question display unit D201 displays the content of question Q. By checking each question display unit D201, users can easily find questions Q that have high reuse value.

[0076] In Figure 8, the order of the history information display unit D20 is an example of using the fourth example of history information H shown in Figure 6. When using the fourth example of history information H, each history information H is displayed in order from the dialogue thread number with the largest number. Specifically, the question display unit D201 of the first history information display unit D21 to the fifth history information display unit D25 displays the question Q (question text) contained in the 5th history information H5, the newest (highest dialogue thread number), the 4th history information H4, the 3rd history information H3, the 4th history information H2, and the 5th history information H1, respectively.

[0077] Figure 9 shows an example of a third display screen D3 that is displayed when the answer display operation unit D202 is operated. The third display screen D3 has a question display unit D201 and an answer display unit D31 as its screen configuration. When the answer display operation unit D202 is operated, it displays the answer A to question Q. The answer display operation unit D202 may display the answer display unit D31, or it may display the answer thread including the answer display unit D31. The user can check the answer A generated by operating the answer display operation unit D202 and consider the wording necessary to generate the desired answer A.

[0078] Figure 10 shows an example of the fourth display screen D4 where the second list of questions is displayed. In Figure 10, the order of the history information display unit D20 is an example of using the second example of history information H shown in Figure 5(A) with corresponding answers A (also simply referred to as the second example). When using the second example of history information H, each history information H is displayed in order from the highest-rated and newest. Specifically, the question display unit D201 of the first history information display unit D21 to the fifth history information display unit D25 displays the question Q included in the fifth history information H5, the newest among the highly-rated (○), the fourth history information H4, the second newest among the highly-rated, the third newest among the highly-rated, the third history information H3, the fourth newest among the highly-rated, and the first history information H1, the newest among the low-rated (×), respectively.

[0079] Figure 11 shows an example of the fifth display screen D5 where the third list of questions is displayed. In Figure 11, the order of the history information display unit D20 is an example of using the third example of history information H shown in Figure 5(B) with corresponding answers A (also simply referred to as the third example). When using the third example of history information H, each history information H is displayed in descending order of evaluation, and in the case of the same evaluation, in descending order of newest. Specifically, the question display unit D201 of the first history information display unit D21 to the fifth history information display unit D25 displays the question Q included in the fourth history information H4, the newest among the highest evaluation 5; the first history information H1, the second newest among evaluation 5; the fifth history information H5, the newest among evaluation 3; the third history information H3, the second newest among evaluation 3; and the second history information H2, the newest among evaluation 2.

[0080] Furthermore, as described above, when displaying a list of questions Q, the system does not require input fields for search conditions to limit the questions Q to be displayed, nor input fields for sort conditions to rearrange the displayed questions Q (corresponding to the ranking information R described later). In the process of improving questions Q to generate the desired answer A, the words included in questions Q when solving a certain problem, and the ideas used to solve the problem, are important and easily remembered by the user. Because the user has an image of the desired question Q in their mind, they can find the desired question Q sufficiently by comparing it with their memory, even with a display method that does not require setting detailed display conditions. In this case, the information processing device 10 plays a role in supplementing the user's memory when searching for questions Q to reuse. With the information processing device 10, which can find the desired question Q with a simple method of just one non-descriptive operation without requiring input of search conditions or sort conditions, the continuity of the user's work is not disrupted, and work efficiency can be improved.

[0081] Furthermore, in the first display screen D1 according to this embodiment, the input fields for search conditions, sorting conditions, etc., are not displayed. By not displaying these input fields, it is possible to prevent users who are unfamiliar with the services provided by the information processing device 10 from becoming confused when performing a search. In addition, users do not have to spend time and effort deciding whether to set search conditions, etc., when searching for questions Q that have high reusability value, thereby preventing an interruption in the continuity of their work.

[0082] Furthermore, on the first display screen D1, the information processing device 10 does not acquire information based on user operations other than evaluation, nor does it provide a display that allows user input. Specifically, the information processing device 10 does not acquire information related to question Q, such as comments indicating the basis for the evaluation or markers that highlight characteristic wording of question Q, based on user operations. Information that is entered based on user operations after the generation of answer A and associated with question Q or answer A by the user may simply be referred to as related information.

[0083] In the above description, it was explained that history information H is stored for each user, and that users can check a list of questions Q they have asked in the past. However, this embodiment is not limited to the example in which history information H is stored for each user; for example, history information H may be generated for each team to which the user belongs, or for each project in which the user is involved.

[0084] [Embodiment 2] Figure 12 is a block diagram illustrating an example configuration of the information processing device 10A according to Embodiment 2. The information processing device 10A according to Embodiment 2 differs from the information processing device 10 according to Embodiment 1 in that it associates related information with question Q. The calculation unit 11A of the information processing device 10A further comprises a related information acquisition unit 118 and an extraction unit 119 as its functional units.

[0085] The related information acquisition unit 118 acquires related information based on the user's input of related information. Related information broadly includes information associated with Question Q, such as marker information that highlights words in Question Q and Answer A, text information such as user comments and memos, and group information indicating each group set when Question Q and Answer A are grouped by the user. When the related information acquisition unit 118 acquires information, the first display screen D1 displayed during evaluation may have a related information input field for inputting text information such as comments and memos, or it may be possible to highlight by selecting any sentence from Question Q. The history information generation unit 117 generates history information H including related information. Since Answer A is associated with Question Q, associating related information with Answer A can also be said to be associating related information with Question Q.

[0086] The extraction unit 119 obtains extraction conditions based on user operations. The extraction conditions are the conditions for extracting question Q from the history information H stored in the storage unit 13, and may include, for example, the words contained in comments or question Q, a group set by the user, the level of evaluation, or the period during which question Q was last edited. By extracting question Q, the user can more easily find the question Q they want.

[0087] The display control unit 112 displays the question Q extracted by the extraction unit 119. Related information included in the history information H may be displayed, for example, in the history information display unit D20. By referring to comments, markers, etc., displayed together with the question Q in the history information display unit D20, the user can more accurately grasp characteristic phrases and their effects.

[0088] Furthermore, since the related information is entered based on user actions after the generation of response A, the related information does not include pre-configured information set by the user, such as a user ID that identifies the user who created or edited the dialogue thread, the team to which the user belongs, or the project the user is involved in, nor does it include information that is automatically associated by an unillustrated function of the information processing device 10, such as the dialogue thread number or the last edit time.

[0089] [Embodiment 3] Figure 13 is a block diagram illustrating an example configuration of the information processing device 10B according to Embodiment 3. The information processing device 10B according to Embodiment 3 differs from the information processing device 10A according to Embodiment 2 in that it automatically highlights the changes in question Q. The calculation unit 11B of the information processing device 10B further includes a change information generation unit 120 as its functional unit.

[0090] The change information generation unit 120 obtains a first question Q1 and a second question Q2 from question Q obtained by the question acquisition unit 113, question Q stored in the storage unit 13 (including question Q stored as history information H), etc. Figure 14 is a diagram showing an example of the first question Q1. Figure 15 is a diagram showing an example of the second question Q2. The second question Q2 is a question Q created later in time than the first question Q1. For example, the first question Q1 is a question Q that serves as the basis for an improved version of the second question Q2. For example, the display control unit 112 may display an operation unit such as a button to copy the question Q near the question display unit D201, and the change information generation unit 120 may determine the copied question Q as the first question Q1 when the operation unit is operated by the user. Furthermore, the first question Q1 may be determined by various methods, for example, it may be a question Q made immediately before the second question Q2, or it may be a question Q made immediately before the second question Q2 among question Qs that have received a predetermined or higher evaluation. The change information generation unit 120 determines the changes from the first question Q1 to the second question Q2 based on the first question Q1 and the second question Q2, and generates change information indicating the changes.

[0091] The history information generation unit 117 associates the change information generated by the change information generation unit 120 with the history information H of the second question Q2. The display control unit 112 highlights the parts of the question display unit D201 of the second question Q2 that are indicated by the change information, such as by drawing a marker. This allows the user to easily grasp characteristic phrases in question Q without having to perform operations such as leaving comments or drawing markers themselves.

[0092] [Summary of Embodiments] According to the embodiment described above, the information processing device 10 includes an evaluation receiving unit 116 that receives the user's evaluation of the answer A to question Q generated by the generation device 30 based on a question from the user; a history information generation unit 117 that generates history information H including question Q and ranking information R, which is information based on the evaluation of answer A and serves as a criterion for determining the priority of displaying question Q; and a display control unit 112 that displays one or more question Qs determined according to their priority to the user. Generally, it is rare to generate the desired answer A in a single attempt, and by gradually improving question Q, the problems with the generated answer A are solved, and question Qs capable of generating the desired answer A are created. Since the reuse value is evaluated by the user, question Qs can be presented to the user preferentially when searching the question history according to their reuse value, thereby reducing the effort required for the user to search. Therefore, the user's work efficiency can be improved.

[0093] Furthermore, according to the embodiment described above, the information processing device 10 receives a user operation (operation of the list display operation unit D14) to display a question Q determined according to its priority level, obtains ranking information R from history information H, and determines the priority for displaying the question Q. In other words, when the information processing device 10 displays a list of question Qs, the user does not need to input display conditions or sorting conditions for the question Qs. By reducing the time and effort required to consider search conditions, etc., in order to find question Qs with high reusability value, the continuity of the user's thinking is not impaired, and work efficiency can be improved.

[0094] Furthermore, according to the embodiment described above, the information processing device 10 includes information in the ranking information R that shows the time series of multiple questions Q, and the display control unit 112 displays questions Q with similar evaluation levels in chronological order. Users often refer to several questions Q from the most recent one in order to improve the questions Q in order to generate the desired answer A. Since the questions Q are displayed in chronological order, users can easily find past questions Q they want to refer to. Therefore, it is possible to prevent interruptions in the continuity of thought caused by the task of searching for a reference question Q. Thus, the user's work efficiency can be improved.

[0095] Furthermore, according to the embodiment described above, the evaluation received by the evaluation reception unit is in two stages. By making the evaluation in two stages, the evaluation becomes easier and the continuity of thought is prevented from being interrupted by the evaluation work. In addition, with the information processing device 10 that displays question Q in chronological order, it is possible to suitably find question Q with high reusability value with very few operations, such as selecting either a high evaluation or a low evaluation and operating the list display operation unit D14.

[0096] Furthermore, according to the embodiment described above, the display control unit 112 displays the answer display operation unit D202, which displays the answer A in response to user operation, in association with the question Q, which is determined according to its priority level. When generating an answer A in a single input using a question Q that is defined in detail, such as a mega prompt, the question Q and its answer A tend to be lengthy. If the answer A is displayed as is, the amount of information in each history information display unit D20 will increase, which may make it difficult to find the desired question Q. Also, when users are looking for a question Q with high reusability value, they tend to focus on the content of the question Q rather than the content of the answer A, so the importance of displaying the question Q is higher than that of the answer A. By displaying the content of the question Q and the operation unit that displays the answer A in response to user operation within the history information display unit D20, the user can efficiently find the desired question Q.

[0097] Furthermore, according to Embodiment 1 described above, the history information H is information that is entered based on user operations after the generation of answer A to question Q, and does not include related information associated with question Q. Also, when the user evaluates answer A to question Q, the information processing device 10 does not accept input of related information about question Q based on user operations. When continuously working to improve question Q, the user retains some memory of the reasons for high evaluations and characteristic wording. Therefore, by referring to the question display unit D201, the user can sufficiently recall characteristic wording and the effects obtained from such wording, even without this related information. Moreover, displaying a related information input field where this related information can be entered would complicate the evaluation process and could actually impair the continuity of the work. Thus, in order to maintain the continuity of the work, the information processing device 10 deliberately makes the tasks required during evaluation very simple.

[0098] Furthermore, according to Embodiment 2 described above, the history information H includes related information associated with question Q, which is input based on user operations after the generation of the answer A to question Q. It is not uncommon for question Q in mega prompts to be enormous, exceeding 100 lines, and if there is a long gap between tasks, it can be easy to forget which words in question Q had what effect. In the information processing device 10A according to Embodiment 2, by referring to comments, markers, etc., displayed together with question Q on the history information display unit D20, the user can more accurately grasp characteristic words and their effects. Also, even when viewing question Q created or edited by another user, the user who takes over the editing can easily grasp characteristic words and their effects to reuse by referring to comments, markers, etc. Therefore, the user's work efficiency can be improved.

[0099] Furthermore, according to Embodiment 3 described above, the history information H for the second question Q2, which is created chronologically after the first question Q1, includes change information indicating the changes from the first question Q1 to the second question Q2. This allows the user to easily grasp characteristic phrases in the question Q without having to perform tasks such as leaving comments or highlighting the question Q they have created. Therefore, according to the information processing device 10B of Embodiment 3, the task of leaving records becomes unnecessary, and the situation in which the continuity of the user's thinking is impaired by such tasks can be avoided. Thus, the user's work efficiency can be improved.

[0100] [Example Hardware Configuration] Figure 16 is a schematic diagram of an example hardware configuration of an information processing device 90 applied to this embodiment. The information processing device 90 comprises a processor 91, main memory 92, communication interface 93, auxiliary storage device 94, input / output interface 95, and internal bus 96. The processor 91, main memory 92, communication interface 93, auxiliary storage device 94, and input / output interface 95 are connected to each other via the internal bus 96 so as to be able to communicate with each other. The information processing device 90 may be applied to, for example, an information processing device 10. In this case, for example, the communication unit 110 may be configured using the communication interface 93. For example, the storage unit 13 may be configured using the auxiliary storage device 94. Also, the functional unit shown in the arithmetic unit 11 may be configured using the processor 91 and the main memory 92.

[0101] Furthermore, the change information generation unit 120 from the question acquisition unit 113 of the information processing device 10, information processing device 10A, or information processing device 10B may be implemented by the user terminal calculation unit 23 of the user terminal 20. In this case, the function performed by the storage unit 13 may be implemented by the user terminal storage unit 24 or a cloud server, etc.

[0102] The information processing device 10 may be implemented using multiple information processing devices. For example, the information processing device 10 may be implemented using a device such as a cloud. The arithmetic unit 11 and the storage unit 13 may each be implemented in different information processing devices. For example, in the information processing device 10, history information H, etc., may be stored in a distributed manner across multiple information processing devices.

[0103] Furthermore, the entirety or a part thereof of the functions of each part of the information processing device 10 in the above-described embodiment may be realized by recording a program for realizing these functions on a computer-readable recording medium, having a computer system read the program recorded on this recording medium, and executing it. The term "computer system" here includes hardware such as an operating system and peripheral devices.

[0104] Furthermore, "computer-readable recording media" refers to portable media such as flexible disks, magneto-optical disks, ROMs, and CD-ROMs, as well as recording units such as hard disks built into computer systems. In addition, "computer-readable recording media" may include those that dynamically hold programs for a short period of time, such as communication lines used when transmitting programs over networks such as the Internet or communication lines such as telephone lines, and those that hold programs for a certain period of time, such as volatile memory inside computer systems that act as servers or clients in such cases. Moreover, the above-mentioned program may be for the purpose of realizing some of the functions described above, and may also be able to realize the above-mentioned functions in combination with programs already recorded in the computer system.

[0105] Although one embodiment of this invention has been described in detail above with reference to the drawings, the specific configuration is not limited to that described above, and various design changes can be made without departing from the spirit of this invention. Furthermore, the configurations described in each embodiment and example above may be combined. [Explanation of Symbols]

[0106] 1... Information processing system, 10... Information processing device, 11... Calculation unit, 110... Communication unit, 111... Operation reception unit, 112... Display control unit, 113... Question acquisition unit, 114... Supply unit, 115... Answer acquisition unit, 116... Evaluation reception unit, 117... History information generation unit, 118... Related information acquisition unit, 119... Extraction unit, 120... Change information generation unit, 13... Storage unit, 20... User terminal, 21... User terminal display unit, 22... User terminal operation unit, 23... User terminal calculation unit, 24... User terminal storage unit, 30... Generation device, Q... Question, A... Answer, K... Evaluation information, H... History information, R... Ranking information, I... Identification information

Claims

1. An evaluation receiving unit that receives the user's evaluation of the answer to the question generated by the generation unit based on the user's question, A history information generation unit generates history information including the aforementioned questions and ranking information based on the evaluation, which serves as a criterion for determining the priority of displaying the aforementioned questions. A display control unit that displays one or more of the aforementioned questions, determined according to the priority level, to the user, An information processing device equipped with the following features.

2. In response to a user operation that displays the question determined according to the priority level, the system obtains ranking information from the history information and determines the priority level. The information processing apparatus according to claim 1.

3. The aforementioned ranking information includes information showing the time series of multiple aforementioned questions, The display control unit displays the questions with similar levels of evaluation in chronological order. The information processing apparatus according to claim 1.

4. The evaluations accepted by the aforementioned evaluation acceptance unit are in two stages. The information processing apparatus according to claim 3.

5. The display control unit displays an answer display operation unit that displays the answer in response to the user's operation, in association with the question determined according to the priority level. The information processing apparatus according to claim 1.

6. The aforementioned history information includes information entered based on the user's actions after the generation of the answer to the question, and does not include related information associated with the question. The information processing apparatus according to any one of claims 1 to 5.

7. When the user evaluates the answer to the question, the system does not accept input of the relevant information regarding the question based on the user's actions. The information processing apparatus according to claim 6.

8. The history information includes information entered based on the user's actions after the generation of the answer to the question, and includes related information associated with the question. The information processing apparatus according to any one of claims 1 to 5.

9. The historical information for the second question, which was created after the first question, includes change information indicating the changes made from the first question to the second question. The information processing apparatus according to any one of claims 1 to 5.

10. On the computer, An evaluation reception step that receives the user's evaluation of the answer to the question generated by the generation unit based on the user's question, A history information generation step that generates history information including the aforementioned questions and ranking information based on the evaluation, which serves as a criterion for determining the priority of displaying the aforementioned questions, A display control step that causes one or more of the aforementioned questions, determined according to the priority level, to be displayed to the user, A program that executes the command.

Images