Method of supporting preparation of question and server for supporting preparation of question
The method and server automate the process of generating questionnaires for collecting and evaluating ideas, reducing administrative burden and improving questionnaire quality by leveraging language models.
Patent Information
- Application Number
- JP2023204146
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-01
- Publication Date
- 2025-06-12
- Estimated Expiration
- 2043-12-01
AI Technical Summary
Designing appropriate questions for collecting and evaluating ideas is a challenging task that requires rich experience and high ability, leading to a high burden on administrators.
A method and server that use a creation support server to automatically generate prompts for language models, which then produce questionnaires for collecting and evaluating ideas based on the specified purpose.
This approach reduces the load on administrators by allowing them to easily obtain questionnaires and improves questionnaire quality through refinement based on generated questionnaires.
Smart Images

Figure 2025089128000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a method for assisting in creating questions for collecting ideas and questions for evaluating ideas. The present invention also relates to a server for assisting in creating questions for collecting ideas and questions for evaluating ideas.
Background Art
[0002] In the world, there are many situations where ideas are evaluated and some kind of decision is made according to the evaluation results. For example, in a familiar example, there are situations where business ideas are evaluated or corporate values are evaluated. Innovative businesses and companies with high growth potential would be promising as investment destinations. In addition, there are countless evaluation targets, and various evaluation targets exist in various fields such as politics, economy, society, industry, science, environment, and education. Also, within a company, there are various evaluation targets in various departments such as personnel, labor, education, accounting, legal affairs, business planning, technology development, security, information management, marketing, and sales.
[0003] When evaluating things, it is effective in enhancing the objectivity of evaluation to comprehensively evaluate not only the evaluation of one person but also the evaluations of multiple people. Also, due to the progress of Internet technology, it is possible to collect the evaluations of a large number of evaluators online.
[0004] In International Publication No. 2017 / 145765 (Patent Document 1), an online test method is disclosed that enables simple and objective measurement of the idea creativity of each test subject by determining the visual acuity of each test subject and reflecting the results in the evaluation of each test subject. Specifically, for a large number of test subjects, an online test is conducted in which a situation setting regarding 5W1H is selected from options and the operation of having them describe ideas based on it is repeated as many times as possible within a limited time. By assigning weights to the answers from the test subjects according to a predetermined standard and calculating the total score, an online test method is disclosed for evaluating innovation capabilities such as the ability to create many highly evaluated ideas, the ability to widely create highly evaluated ideas, or the ability to create rare and highly evaluated ideas.
[0005] In International Publication No. 2020 / 153383 (Patent Document 2), a problem collection and evaluation method and a solution collection and evaluation method are disclosed that include collecting various problems or solutions to problems from a plurality of test subjects via a computer network, having the test subjects conduct mutual evaluations, and scoring the problems or solutions to problems.
Prior Art Documents
Patent Documents
[0006]
Patent Document 1
Patent Document 2
Summary of the Invention
Problems to be Solved by the Invention
[0007] In order to implement an idea collection and evaluation method as described in Patent Document 1 and Patent Document 2, it is necessary for the administrator of the idea collection and evaluation test to design appropriate questions to prompt the test takers for answers regarding idea creation and idea evaluation according to the purpose of the organization. In order to design appropriate questions, it is also necessary for the administrator to assume the content of the answers from the test takers and the result analysis. However, designing appropriate questions that match the purpose of the organization requires rich experience and high ability, and there is a problem that the burden on the administrator is also high.
[0008] The present invention has been created in view of the above circumstances, and in one embodiment, an object is to provide a method for assisting in creating questions for collecting ideas. In another embodiment of the present invention, an object is to provide a method for assisting in creating questions for evaluating ideas. In still another embodiment of the present invention, an object is to provide a question creation support server for collecting ideas. In still another embodiment of the present invention, an object is to provide a question creation support server for evaluating ideas.
Means for Solving the Problems
[0009] The inventor of the present invention conducted intensive studies to solve the above problems, and as a result, created the following invention exemplified by using a creation support server that can automatically create appropriate prompts based on the purpose of collecting ideas, transmit them to a language model server, and receive responses from the language model server.
[0010] [Aspect 1] A method for assisting in creating questions for collecting ideas, comprising: Step A in which a creation support server receives information including the purpose of collecting ideas from a user terminal via a network 1 and Step B: The idea generation support server creates a first prompt including a command for the language model to generate at least one first questionnaire for collecting ideas according to the specified output format, with reference to the information including the purpose of collecting ideas received from the user terminal. 1 and Step C: The idea generation support server transmits the first prompt to the language model server equipped with the language model via the network. 1 and Step D: The idea generation support server receives a first response including the at least one first questionnaire according to the specified output format from the language model server via the network. 1 and Step E: The idea generation support server transmits the at least one first questionnaire included in the first response received from the language model server to the user terminal via the network. 1 and A method including the above steps. [Aspect 2] A method for assisting in creating questions for evaluating ideas, comprising: Step F: The idea evaluation support server receives information including the purpose of collecting ideas and at least one first question for collecting ideas from the user terminal via the network. 1 and Step G: The idea evaluation support server creates a second prompt including a command for the language model to generate at least one second questionnaire for evaluating ideas for the first question according to the specified output format, with reference to the information including the purpose of collecting ideas received from the user terminal and the at least one first question. 1 and Step H: The idea evaluation support server transmits the second prompt to the language model server equipped with the language model via the network. 1 and Step I: The idea evaluation support server receives a second response including the at least one second questionnaire according to the specified output format from the language model server via the network. 1 and Step J in which the creation support server transmits the at least one second question included in the second response received from the language model server to the user terminal via the network 1 and A method including [Aspect 3] A method for assisting in creating questions for collecting ideas and questions for evaluating ideas, comprising: Step A in which the creation support server receives information including the purpose of collecting ideas from the user terminal via the network 1 and Step B in which the creation support server refers to the information including the purpose of collecting ideas received from the user terminal and creates a first prompt including a command for the language model to generate at least one first question for collecting ideas according to the specified output format according to the purpose 1 and Step C in which the creation support server transmits the first prompt to the language model server equipped with the language model via the network 1 and Step D in which the creation support server receives a first response including the at least one first question according to the specified output format from the language model server via the network 1 and Step G in which the creation support server refers to the information including the purpose of collecting ideas and the at least one first question, and creates a second prompt including a command for the language model to generate at least one second question for evaluating ideas for the first question according to the specified output format 1 and Step H in which the creation support server transmits the second prompt to the language model server equipped with the language model via the network 1 and Step I in which the creation support server receives a second response including the at least one second question according to the specified output format from the language model server via the network 1 and Step J in which the creation support server transmits the at least one first questionnaire included in the first response received from the language model server and the at least one second questionnaire included in the second response to the user terminal via a network 1 and A method including [Aspect 4] A method for assisting in creating questions for collecting ideas and questions for evaluating ideas, Step A in which the creation support server receives information including the purpose of collecting ideas from the user terminal via a network 1 and Step B in which the creation support server refers to the information including the purpose of collecting ideas received from the user terminal and creates a first prompt including a command for the language model to generate at least one first questionnaire for collecting ideas according to the specified output format 1 and Step C in which the creation support server transmits the first prompt to the language model server equipped with the language model via a network 1 and Step D in which the creation support server receives a first response including the at least one first questionnaire according to the specified output format from the language model server via a network 1 and Step E in which the creation support server transmits the at least one first questionnaire included in the first response received from the language model server to the user terminal via a network 1 and Step F in which the creation support server receives at least one first question for collecting ideas determined by the user from the user terminal via a network 1 and Step G: The creation support server refers to the information including the purpose of collecting the ideas and the at least one first question determined by the user, and creates a second prompt including a command for the language model to generate at least one second question proposal for evaluating the ideas for the first question according to the specified output format. 1 and Step H: The creation support server transmits the second prompt to the language model server equipped with the language model via the network. 1 and Step I: The creation support server receives, via the network, from the language model server a second response including the at least one second question proposal according to the specified output format. 1 and Step J: The creation support server transmits, via the network, the at least one second question proposal included in the second response received from the language model server to the user terminal. 1 and A method comprising the above. [Aspect 5] Step A 1 wherein the information received by the creation support server includes supplementary information regarding the purpose of collecting ideas, and the creation support server refers to the supplementary information also in Step B 1 and creates the first prompt according to the method described in Aspect 1, 3 or 4. [Aspect 6] Step A 1 wherein the information received by the creation support server includes supplementary information regarding the purpose of collecting ideas, and the creation support server refers to the supplementary information also in Step G 1 and creates the second prompt according to any one of the methods described in Aspects 2 - 4. [Aspect 7] Step E 1 wherein the at least one first question proposal transmitted to the user terminal in Step E is displayed on the screen of the user terminal in a mode editable by the user according to any one of Aspects 1, 3 - 5. [Aspect 8] Step J 1The at least one second questionnaire sent to the user terminal is displayed on the screen of the user terminal in an editable manner according to the method described in any of Modes 2 to 4 and 6. [Mode 9] The first prompt is according to the method described in any of Modes 1, 3 to 5, and 7, including the specification of the number of first questionnaires to be generated by the language model. [Mode 10] The second prompt is according to the method described in any of Modes 2 to 4, 6, and 8, including the specification of the number of second questionnaires to be generated by the language model. [Mode 11] The first prompt further includes a command for the language model to generate, according to the specified output format, an example of at least one idea for the at least one first questionnaire. Step D 1 The first response received by the creation support server in step D further includes an example of at least one idea for the at least one first questionnaire according to the method described in any of Modes 1, 3 to 5, 7, and 9. [Mode 12] The second prompt further includes a command for the language model to generate, according to the specified output format, an example of at least one idea for the at least one first questionnaire. Step I 1 The second response received by the creation support server in step I further includes an example of at least one idea for the at least one first question according to the method described in any of Modes 2 to 4, 6, 8, and 10. [Mode 13] Step K where the creation support server creates a third prompt that includes a command for the language model to generate, according to the specified output format, an example of at least one idea for the at least one first questionnaire, without referring to the purpose of collecting the ideas. 1 and Step L where the creation support server transmits the third prompt to the language model server equipped with the language model via the network. 1 and Step M in which the creation support server receives, via a network, from the language model server a third response including examples of the at least one idea according to a specified output format 1 and Step N in which the creation support server transmits, via a network, to the user terminal the examples of the at least one idea included in the third response received from the language model server 1 and The method according to any one of Aspects 1, 3 to 5, 7, 9, 11 including the above [Aspect 14] Step K in which the creation support server refers to the purpose of collecting the ideas and the at least one first questionnaire, and creates a third prompt including a command for the language model to generate examples of the at least one idea for the first questionnaire according to a specified output format 1 and Step L in which the creation support server transmits, via a network, the third prompt to a language model server equipped with a language model 1 and Step M in which the creation support server receives, via a network, from the language model server a third response including examples of the at least one idea according to a specified output format 1 and Step N in which the creation support server transmits, via a network, to the user terminal the examples of the at least one idea included in the third response received from the language model server 1 and The method according to any one of Aspects 1, 3 to 5, 7, 9, 11 including the above [Aspect 15] Step K in which the creation support server refers to the at least one first question without referring to the purpose of collecting the ideas, and creates a third prompt including a command for the language model to generate examples of the at least one idea for the first question according to a specified output format 1 and Step L in which the creation support server transmits, via a network, the third prompt to a language model server equipped with a language model 1 and Step M in which the creation support server receives, via a network, from the language model server a third response including examples of the at least one idea according to a specified output format 1 and Step N in which the creation support server transmits, via a network, to the user terminal the examples of the at least one idea included in the third response received from the language model server 1 and The method according to aspect 2 or 4 including the above [Aspect 16] Step K in which the creation support server refers to the purpose of collecting the ideas and the at least one first question, and creates a third prompt including a command for the language model to generate examples of at least one idea for the first question according to a specified output format 1 and Step L in which the creation support server transmits, via a network, the third prompt to a language model server equipped with a language model 1 and Step M in which the creation support server receives, via a network, from the language model server a third response including examples of the at least one idea according to a specified output format 1 and Step N in which the creation support server transmits, via a network, to the user terminal the examples of the at least one idea included in the third response received from the language model server 1 and The method according to aspect 2 or 4 including the above [Aspect 17] A method for assisting in creating questions for collecting ideas and questions for evaluating ideas, comprising Step A in which the creation support server receives, via a network, from the user terminal information including the purpose of collecting ideas 2 and Step B: The idea generation support server creates a first prompt including a command for the language model to generate, according to the specified output format, at least one first questionnaire for collecting ideas corresponding to the purpose based on the information including the purpose of collecting the ideas received from the user terminal, and at least one second questionnaire for evaluating the ideas for the first questionnaire 2 and Step C: The idea generation support server transmits the first prompt to the language model server equipped with the language model via the network 2 and Step D: The idea generation support server receives, via the network, from the language model server a first response including the at least one first questionnaire and the at least one second questionnaire for evaluating the ideas for the first questionnaire according to the specified output format 2 and Step E: The idea generation support server transmits, via the network, the at least one first questionnaire and the at least one second questionnaire included in the first response received from the language model server to the user terminal 2 and A method comprising the above steps [Aspect 18] Step A 2 The information received by the idea generation support server in step A includes supplementary information regarding the purpose of collecting ideas, and the idea generation support server refers to the supplementary information also in step B 2 The method according to aspect 17, wherein the first prompt is created [Aspect 19] Step E 2 The method according to aspect 17 or 18, wherein the at least one first questionnaire and the at least one second questionnaire transmitted to the user terminal in step E are displayed on the screen of the user terminal in an editable manner by the user [Aspect 20] The method according to any one of aspects 17 to 19, wherein the first prompt includes a specification of the number of first questionnaires to be generated by the language model [Aspect 21] The first prompt further includes a command for the language model to generate, according to a specified output format, examples of at least one idea for the at least one first questionnaire. Step D 2 In step D, the method according to any one of aspects 17 to 20, wherein the first response received by the creation support server further includes examples of at least one idea for the at least one first questionnaire. [Aspect 22] Step F in which the creation support server receives, from the user terminal via the network, at least one first questionnaire for collecting ideas determined by the user 2 and Step G in which the creation support server creates a third prompt that includes a command for the language model to generate, according to a specified output format, examples of at least one idea for the at least one first questionnaire, with reference to the at least one first questionnaire determined by the user without referring to the purpose of collecting the ideas 2 and Step H in which the creation support server transmits the third prompt to the language model server equipped with the language model via the network 2 and Step I in which the creation support server receives, from the language model server via the network, a third response including examples of the at least one idea according to the specified output format 2 and Step J in which the creation support server transmits, to the user terminal via the network, the examples of the at least one idea included in the third response received from the language model server 2 and The method according to any one of aspects 17 to 21, including [Aspect 23] Step F in which the creation support server receives, from the user terminal via the network, at least one first questionnaire for collecting ideas determined by the user 2 and Step G in which the creation support server refers to the purpose of collecting the ideas and the at least one first question determined by the user, and creates a third prompt including a command for the language model to generate examples of at least one idea for the first question according to a specified output format 2 and Step H in which the creation support server transmits the third prompt to a language model server equipped with a language model via a network 2 and Step I in which the creation support server receives a third response including examples of the at least one idea according to the specified output format from the language model server via a network 2 and Step J in which the creation support server transmits the examples of the at least one idea included in the third response received from the language model server to the user terminal via a network 2 and The method according to any one of Aspects 17 to 21 including [Aspect 24] comprising a storage unit, a control unit, and a transmission / reception unit, the control unit has a first prompt creation unit and an information registration unit, Step A in which the transmission / reception unit receives information including the purpose of collecting ideas from the user terminal via a network 1 can be performed, the information registration unit can store the information including the purpose of collecting the ideas received from the user terminal in the storage unit, The first prompt creation unit refers to the information including the purpose of collecting the ideas stored in the storage unit, and creates a first prompt including a command for the language model to generate at least one first questionnaire for collecting ideas according to the corresponding purpose according to a specified output format in Step B 1 can be performed, Step C in which the transmission / reception unit transmits the first prompt to a language model server equipped with a language model via a network 1 can be performed, The transmitting / receiving unit receives, via a network from a language model server, a first response including the at least one first questionnaire according to a specified output format (step D). 1 It can perform The information registration unit can store the first response received from the language model server in the storage unit. The transmitting / receiving unit transmits, via a network to the user terminal, the at least one first questionnaire included in the first response (step E). 1 It can perform An inquiry creation support server for collecting ideas. [Aspect 25] It includes a storage unit, a control unit, and a transmitting / receiving unit. The control unit has a second prompt creation unit and an information registration unit. The transmitting / receiving unit receives, via a network from the user terminal, information including the purpose of collecting ideas and at least one first inquiry determined by the user for collecting ideas (step F). 1 It can perform The information registration unit can store in the storage unit the information including the purpose of collecting ideas received from the user terminal and the at least one first inquiry for collecting ideas. The second prompt creation unit refers to the information including the purpose of collecting ideas and the at least one first inquiry stored in the storage unit, and creates a second prompt including a command for the language model to generate at least one second questionnaire for evaluating ideas for the first inquiry according to a specified output format (step G). 1 It can perform The transmitting / receiving unit transmits, via a network to a language model server equipped with a language model, the second prompt (step H). 1 It can perform The transmitting / receiving unit receives, via a network from the language model server, a second response including the at least one second questionnaire according to a specified output format (step I). 1 It can perform The information registration unit can store the second response received from the language model server in the storage unit. The transmission / reception unit can perform step J of transmitting, via a network, the at least one second questionnaire included in the second response to the user terminal. 1 It can perform. An inquiry creation support server for evaluating ideas. [Aspect 26] It includes a storage unit, a control unit, and a transmission / reception unit. The control unit has a first prompt creation unit, a second prompt creation unit, and an information registration unit. The transmission / reception unit can perform step A of receiving, via a network, information including the purpose of collecting ideas from the user terminal. 1 It can perform. The information registration unit can store the information including the purpose of collecting the ideas received from the user terminal in the storage unit. The first prompt creation unit refers to the information including the purpose of collecting the ideas stored in the storage unit, and creates a first prompt including a command for the language model to generate at least one first questionnaire for collecting ideas according to the specified output format in step B. 1 It can perform. The transmission / reception unit can perform step C of transmitting the first prompt to the language model server equipped with the language model via a network. 1 It can perform. The transmission / reception unit can perform step D of receiving, via a network, a first response including the at least one first questionnaire according to the specified output format from the language model server. 1 It can perform. The information registration unit can store the first response received from the language model server in the storage unit. The second prompt creation unit refers to the information including the purpose of collecting the ideas stored in the storage unit and the first response including the at least one first questionnaire, and creates a second prompt including a command for the language model to generate at least one second questionnaire for evaluating the ideas for the first questionnaire according to the specified output format (step G). 1 can be performed The transceiver unit transmits the second prompt to a language model server equipped with a language model via a network (step H). 1 can be performed The transceiver unit receives a second response including the at least one second questionnaire according to the specified output format from the language model server via a network (step I). 1 can be performed The information registration unit can store the second response received from the language model server in the storage unit. The transceiver unit transmits the at least one first questionnaire included in the first response and the at least one second questionnaire included in the second response to the user terminal via a network (step J). 1 can be performed A questionnaire creation support server for collecting ideas and evaluating ideas. [Aspect 27] Comprising a storage unit, a control unit, and a transceiver unit. The control unit has a first prompt creation unit, a second prompt creation unit, and an information registration unit. The transceiver unit receives information including the purpose of collecting ideas from the user terminal via a network (step A). 1 can be performed The information registration unit can store the information including the purpose of collecting the ideas received from the user terminal in the storage unit. The first prompt creation unit refers to the information including the purpose of collecting the ideas stored in the storage unit, and creates a first prompt including a command for the language model to generate at least one first questionnaire for collecting ideas according to the corresponding purpose in the specified output format (step B).1 can be performed, The transceiver transmits the first prompt to the language model server equipped with the language model via the network in step C 1 can be performed, The transceiver receives, from the language model server via the network, a first response including the at least one first questionnaire according to the specified output format in step D 1 can be performed, The information registration unit can store the first response received from the language model server in the storage unit, The transceiver transmits, via the network, the at least one first questionnaire included in the first response to the user terminal in step E 1 can be performed, The transceiver receives, from the user terminal via the network, at least one first question for collecting ideas determined by the user in step F 1 can be performed, The information registration unit can store the at least one first question determined by the user in the storage unit, The second prompt creation unit refers to the information including the purpose of collecting the ideas stored in the storage unit and the at least one first question determined by the user, and creates a second prompt including a command for the language model to generate at least one second questionnaire for evaluating the ideas for the first question according to the specified output format in step G 1 can be performed, The transceiver transmits the second prompt to the language model server equipped with the language model via the network in step H 1 can be performed, The transceiver receives, from the language model server via the network, a second response including the at least one second questionnaire according to the specified output format in step I 1 can be performed, The information registration unit can store the second response received from the language model server in the storage unit, The transmitting and receiving unit transmits the at least one second questionnaire included in the second response to the user terminal via a network in step J 1 which can perform A questionnaire creation support server for collecting ideas and creating questionnaires for evaluating ideas [Aspect 28] Step A 1 wherein the information received by the creation support server in step A includes supplementary information regarding the purpose of collecting ideas, and the first prompt creation unit refers to the supplementary information also in step B 1 The creation support server according to aspect 24, 26 or 27 that creates the first prompt [Aspect 29] Step A 1 wherein the information received by the creation support server in step A includes supplementary information regarding the purpose of collecting ideas, and the second prompt creation unit refers to the supplementary information also in step G 1 The creation support server according to any one of aspects 25 to 27 that creates the second prompt [Aspect 30] The transmitting and receiving unit transmits the at least one first questionnaire to the user terminal in step E 1 so as to be displayed on the screen of the user terminal in a manner editable by the user. The creation support server according to any one of aspects 24, 26 to 28 [Aspect 31] The transmitting and receiving unit transmits the at least one second questionnaire to the user terminal in step J 1 so as to be displayed on the screen of the user terminal in a manner editable by the user. The creation support server according to any one of aspects 25 to 27, 29 [Aspect 32] The first prompt includes a specification of the number of first questionnaires to be generated by the language model. The creation support server according to any one of aspects 24, 26 to 28, 30 [Aspect 33] The second prompt includes a specification of the number of second questionnaires to be generated by the language model. The creation support server according to any one of aspects 25 to 27, 29, 31 [Aspect 34] The first prompt further includes a command for the language model to generate, according to a specified output format, examples of at least one idea for the at least one first questionnaire item. Step D 1 The first response received by the transceiver in is the creation support server according to any of aspects 24, 26 to 28, 30, 32, which further includes examples of at least one idea for the at least one first questionnaire item. [Aspect 35] The second prompt further includes a command for the language model to generate, according to a specified output format, examples of at least one idea for the at least one first question. Step I 1 The second response received by the transceiver in is the creation support server according to any of aspects 25 to 27, 29, 31, 33, which further includes examples of at least one idea for the at least one first question. [Aspect 36] The control unit has a third prompt creation unit. The third prompt creation unit refers to the at least one first questionnaire item stored in the storage unit without referring to the purpose of collecting the ideas stored in the storage unit, and creates a third prompt including a command for the language model to generate, according to a specified output format, examples of at least one idea for the first questionnaire item in step K. 1 can be performed. The transceiver can perform step L of transmitting the third prompt to the language model server equipped with the language model via the network. 1 can be performed. The transceiver can perform step M of receiving from the language model server via the network a third response including examples of the at least one idea according to the specified output format. 1 can be performed. The information registration unit can store the third response received from the language model server in the storage unit. The transceiver can perform step N of transmitting, via the network, the examples of the at least one idea included in the third response to the user terminal.1 can perform The creation support server according to any one of aspects 24, 26 to 28, 30, 32, and 34. [Aspect 37] The control unit has a third prompt creation unit. The third prompt creation unit refers to the purpose of collecting the ideas stored in the storage unit and the at least one first questionnaire, and creates a third prompt including a command for the language model to generate at least one example of an idea for the first questionnaire according to the specified output format. Step K 1 can perform The transmission / reception unit transmits the third prompt to the language model server equipped with the language model via the network in step L 1 can perform The transmission / reception unit receives a third response including at least one example of an idea according to the specified output format from the language model server via the network in step M 1 can perform The information registration unit can store the third response received from the language model server in the storage unit. The transmission / reception unit transmits at least one example of the idea included in the third response to the user terminal via the network in step N 1 can perform The creation support server according to any one of aspects 24, 26 to 28, 30, 32, and 34. [Aspect 38] The control unit has a third prompt creation unit. The third prompt creation unit creates a third prompt including a command for the language model to generate at least one example of an idea for the first question according to the specified output format by referring to the at least one first question stored in the storage unit without referring to the purpose of collecting the ideas stored in the storage unit. Step K 1 can perform The transmission / reception unit transmits the third prompt to the language model server equipped with the language model via the network in step L 1can be performed, The transmission / reception unit receives, via a network from a language model server, a third response including an example of the at least one idea according to a specified output format (step M). 1 can be performed, The information registration unit can store the third response received from the language model server in the storage unit. The transmission / reception unit transmits, via a network to a user terminal, an example of the at least one idea included in the third response (step N). 1 can be performed, The creation support server according to aspect 25 or 27 including the above. [Aspect 39] The control unit has a third prompt creation unit. The third prompt creation unit refers to the purpose of collecting the ideas stored in the storage unit and the at least one first question stored in the storage unit, and creates a third prompt including a command for the language model to generate an example of at least one idea for the first question according to a specified output format (step K). 1 can be performed, The transmission / reception unit transmits, via a network to a language model server equipped with a language model, the third prompt (step L). 1 can be performed, The transmission / reception unit receives, via a network from a language model server, a third response including an example of the at least one idea according to a specified output format (step M). 1 can be performed, The information registration unit can store the third response received from the language model server in the storage unit. The transmission / reception unit transmits, via a network to a user terminal, an example of the at least one idea included in the third response (step N). 1 can be performed, The creation support server according to aspect 25 or 27 including the above. [Aspect 40] comprising a storage unit, a control unit, and a transmission / reception unit. The control unit has a first prompt creation unit and an information registration unit, The transmission / reception unit performs step A of receiving information including the purpose of collecting ideas from the user terminal via the network. 2 It can perform, The information registration unit can store the information including the purpose of collecting the ideas received from the user terminal in the storage unit. The first prompt creation unit refers to the information including the purpose of collecting the ideas stored in the storage unit, and creates a first prompt including at least one first questionnaire for collecting ideas according to the purpose, and a command for the language model to generate at least one second questionnaire for evaluating the ideas for the first questionnaire according to the specified output format (step B). 2 It can perform, The transmission / reception unit performs step C of transmitting the first prompt to the language model server equipped with the language model via the network. 2 It can perform, The transmission / reception unit performs step D of receiving a first response including the at least one first questionnaire according to the specified output format and at least one second questionnaire for evaluating the ideas for the first questionnaire from the language model server via the network. 2 It can perform, The information registration unit can store the first response received from the language model server in the storage unit. The transmission / reception unit performs step E of transmitting the at least one first questionnaire and the at least one second questionnaire included in the first response to the user terminal via the network. 2 It can perform, An inquiry creation support server for inquiries for collecting ideas and inquiries for evaluating ideas. [Aspect 41] Step A 2 The information received by the creation support server in step A includes supplementary information regarding the purpose of collecting ideas, and the first prompt creation unit performs step B 2The creation support server according to mode 40 that creates the first prompt with reference to the supplementary information as well. [Mode 42] The transmission / reception unit is step E 2 The creation support server according to mode 40 or 41 that transmits the at least one first questionnaire and the at least one second questionnaire to the user terminal so as to be displayed on the screen of the user terminal in a mode editable by the user in step E. [Mode 43] The first prompt is the method according to any one of modes 40 to 42 that includes specifying the number of first questionnaires to be generated by the language model. [Mode 44] The first prompt further includes a command for the language model to generate, according to the specified output format, an example of at least one idea for the at least one first questionnaire. Step D 2 The first response received by the transmission / reception unit in step D further includes an example of at least one idea for the at least one first questionnaire. The method according to any one of modes 40 to 43. [Mode 45] The control unit has a third prompt creation unit. The transmission / reception unit receives, from the user terminal via the network, at least one first questionnaire for collecting ideas determined by the user in step F 2 and can perform The information registration unit can store the at least one first questionnaire determined by the user in the storage unit. The third prompt creation unit refers to the at least one first questionnaire determined by the user stored in the storage unit without referring to the purpose of collecting the ideas stored in the storage unit, and creates a third prompt including a command for the language model to generate an example of at least one idea for the first questionnaire according to the specified output format in step G 2 and can perform The transmission / reception unit transmits the third prompt to the language model server equipped with the language model via the network in step H2 can be performed, The transceiver receives, via a network from a language model server, a third response including an example of the at least one idea according to a specified output format (Step I) 2 can be performed, The information registration unit can store the third response received from the language model server in the storage unit, The transceiver transmits, via a network to a user terminal, an example of the at least one idea included in the third response (Step J) 2 can be performed, The creation support server according to any one of Aspects 40 to 45. [Aspect 46] The control unit has a third prompt creation unit, The transceiver receives, via a network from a user terminal, at least one first question for collecting an idea determined by the user (Step F) 2 can be performed, The information registration unit can store the at least one first question determined by the user in the storage unit, The third prompt creation unit refers to the purpose of collecting the ideas stored in the storage unit and the at least one first question determined by the user stored in the storage unit, and creates a third prompt including a command for a language model to generate an example of at least one idea for the first question according to a specified output format (Step G) 2 can be performed, The transceiver transmits, via a network to a language model server equipped with a language model, the third prompt (Step H) 2 can be performed, The transceiver receives, via a network from a language model server, a third response including an example of the at least one idea according to a specified output format (Step I) 2 can be performed, The information registration unit can store the third response received from the language model server in the storage unit, The transmitting / receiving unit transmits, to the user terminal via the network, an example of the at least one idea included in the third response (step J). 2 which can perform The creation support server according to any one of Aspects 40 to 45. [Aspect 47] A program for causing a computer to execute the method according to any one of Aspects 1 to 2. [Aspect 48] A computer-readable recording medium on which the program according to Aspect 47 is recorded. [Advantages of the Invention]
[0011] According to one embodiment of the present invention, a project manager can automatically obtain a questionnaire according to the purpose by simply inputting the purpose of collecting ideas on the terminal. For this reason, the load on the project manager for questionnaire design is reduced. In addition, since the project manager can modify the questionnaire to a further refined questionnaire based on a plurality of questionnaires generated by the language model, the quality of the questionnaire can be improved. The method and server according to the present invention can be widely used not only in tests for evaluating idea creativity but also in meetings, workshops, etc. for problem solving. [Brief Description of the Drawings]
[0012]
Figure 1
Figure 2
Figure 3-1
Figure 3-2
Figure 3-3
Figure 3-4
Figure 3-5
Figure 4-1
Figure 4-2
Figure 4-3A
Figure 4-3B
Figure 4-4
Figure 4-5
Figure 4-6A
Figure 4-6B
Figure 4-7
Figure 4-8
Figure 4-9
Figure 4-10A
Figure 4-10B
Figure 4-11
Figure 4-12A
Figure 4-12B
Figure 4-13
Figure 4-14
Figure 4-15
Figure 4-16
Figure 5-1
Figure 5-2
Figure 5-3A
Figure 5-3B
Figure 5-4
Figure 5-5
Figure 5-6
Figure 6
Embodiments for Carrying Out the Invention
[0013] Hereinafter, embodiments of a question creation support method and a question creation support server according to the present invention will be described in detail with reference to the drawings, but the present invention is not limited to these embodiments.
[0014] <1. System Configuration> FIG. 1 shows the overall configuration of a questionnaire creation support system according to an embodiment. This system includes a creation support server 11, a language model server 12 equipped with a language model, and a user terminal 13. The creation support server 11, the language model server 12, and the user terminal 13 are connected to be mutually communicable with the creation support server 11 through a computer network 14 such as the Internet, a dedicated line, or a public network.
[0015] [Network] The computer network 14 is not limited, but for example, it can be a wired network such as a LAN (Local Area Network) or a WAN (Wide Area Network), or a wireless network such as a WLAN (Wireless Local Area Network) using MIMO (Multiple-Input Multiple-Output). Alternatively, it may be through the Internet using a communication protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol), or through a base station (not shown) that serves as a so-called wireless LAN access point.
[0016] The server means a server computer and can be configured by the cooperation of one or more computers. The user terminal 13 can be realized by a personal computer equipped with a browser or a native app, but is not limited thereto, and can be composed of portable terminals such as smartphones, tablets, mobile phones, mobiles, and PDAs, and further devices and apparatuses capable of communication through a computer network such as digital TVs. For example, the user terminal 13 is operated by a project manager who needs to create a questionnaire for collecting ideas or create a questionnaire for evaluating ideas.
[0017] The basic hardware configurations of the creation support server 11, the language model server 12, and the user terminal 13 are common. As shown in FIG. 2, they can be realized by a computer 200 having an arithmetic unit 201, a storage device 202, an output device 203, an input device 204, and a communication device 205.
[0018] The arithmetic unit 201 refers to devices and circuits such as those that control the entire computer and execute arithmetic processing according to a program based on instructions, commands, and data input by the input device 204 and data stored in the storage device 202. As the arithmetic unit 201, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), etc. can be adopted.
[0019] The memory device 202 refers to a device, circuit, etc. that stores various data, an operating system (OS), network applications (e.g., web server software of the creation support server 11 and the language model server 12, browsers or native applications of the user terminal 13), and programs for executing various arithmetic processes. For example, a primary storage device mainly using a semiconductor memory, a secondary storage device (auxiliary storage device) mainly using a hard disk drive or a semiconductor disk, an offline storage mainly using a removable media drive such as a CD-ROM drive, a tape library, etc., and known storage devices can be used. More specifically, in addition to magnetic storage devices using magnetic recording media such as hard disk drives, floppy (registered trademark) disk drives, ZIP drives, and tape storage, storage circuits or devices using semiconductor memories such as registers, cache memories, ROMs, RAMs, flash memories (e.g., USB memories and solid state drives), semiconductor disks (e.g., RAM disks and virtual disks), optical storage devices using optical recording media such as CDs and DVDs, magneto-optical disks such as MOs, other storage devices using paper tapes and punch cards, storage devices using phase change recording technology called PRAM (Phase change RAM), holographic memories, storage devices using three-dimensional optical memories, and storage devices using molecular memories that store information by accumulating charges at the molecular level can be adopted.
[0020] The output device 203 is an interface of a device, circuit, etc. that realizes the output of data or instructions, and in addition to displays such as LCDs and organic ELs, printers, speakers, etc. can be adopted.
[0021] The input device 204 is an interface for giving data or instructions to the arithmetic device 201, and pointing devices such as keyboards, numeric keypads, and mice, touch panels, readers (OCR), input screens, voice input interfaces such as microphones, etc. can be adopted.
[0022] The communication device 205 is a device and circuit that realizes data transmission and reception with the outside of the device, and is an interface for connecting to a network such as a LAN port, a modem, a wireless LAN, or a router. It is possible to transmit and receive the processing result of the arithmetic device 201 and the information stored in the storage device 202 via the computer network 14.
[0023] [Creation Support Server] Examples of the functional block diagrams of the creation support server 11 are shown in FIGS. 3-1 to 3-5. The creation support server 11 includes a transmission / reception unit 330, a control unit 320, and a storage unit 340. FIG. 3-1 shows an example of a functional block diagram when the creation support server 11 outputs a questionnaire for collecting ideas. FIG. 3-2 shows an example of a functional block diagram when the creation support server 11 outputs a questionnaire for evaluating ideas. FIG. 3-3 shows a first example of a functional block diagram when the creation support server 11 outputs a questionnaire for collecting ideas and a questionnaire for evaluating ideas step by step. FIG. 3-4 shows a second example of a functional block diagram when the creation support server 11 outputs a questionnaire for collecting ideas and a questionnaire for evaluating ideas step by step. FIG. 3-5 shows an example of a functional block diagram when the creation support server 11 outputs a questionnaire for collecting ideas and a questionnaire for evaluating ideas all at once.
[0024] (A. Embodiment of a creation support server that outputs a questionnaire for collecting ideas) In the embodiment shown in FIG. 3-1, the creation support server 11 includes a storage unit 310, a control unit 320, and a transmission / reception unit 330. The control unit 320 includes a first prompt creation unit 321A, an information registration unit 322, and an information conversion unit 323. The transmission / reception unit 330 can perform step A of receiving information including the purpose of collecting ideas from the user terminal 13 via the network 14. 1 to perform. The information registration unit 322 can store the information 311 including the purpose of collecting the ideas received from the user terminal 13 in the storage unit 310. The first prompt creation unit 321A refers to the information 311 including the purpose of collecting the ideas stored in the storage unit 310, and creates a first prompt including a command for the language model to generate at least one first questionnaire for collecting ideas according to the purpose in a specified output format (step B). 1 This can be performed. The transceiver 330 transmits the first prompt to the language model server 12 equipped with the language model via the network 14 (step C). 1 This can be performed. The transceiver 330 receives a first response 312 including the at least one first questionnaire in a specified output format from the language model server 12 via the network 14 (step D). 1 This can be performed. The information registration unit 322 can store the first response 312 received from the language model server 12 in the storage unit 310. The information conversion unit 323 can convert the first response 312 into a predetermined format. The transceiver 330 transmits the at least one first questionnaire included in the first response 312 to the user terminal 13 via the network 14 (step E). 1 This can be performed. The transceiver 330, in step E 1 may transmit the first response 312 to the user terminal 13 so as to be displayed on the screen of the user terminal 13 in an editable manner for the user.
[0025] The user who has received the first response 312 on the user terminal 13 can select all or part of the at least one first questionnaire included in the first response 312 on the browser or native app of the user terminal 13, and determine the first questionnaire to be used in the idea collection and evaluation project. The user may also determine the first questionnaire to be used in the idea collection and evaluation project by editing the presented first questionnaire on the browser or native app of the user terminal 13.
[0026] The user may not be satisfied with any of the first questionnaires included in the first response 312. In such a case, the user may transmit, on the browser or native app of the user terminal 13, for the purpose of collecting ideas and / or supplementary information regarding the purpose of collecting ideas described later, to the creation support server 11 after modifying it, and on the condition that the creation support server 11 refers to the modification content, step B 1 to step E 1 may be instructed to perform again. Alternatively, without modifying the purpose of collecting ideas or the like, the creation support server 11 may be instructed to perform step B 1 to step E 1 again. When receiving the instruction, the creation support server 11 can perform step B 1 to step E 1 again. This is because when the creation support server 11 is instructed again to output a questionnaire for collecting ideas, even if the instruction content is the same, the obtained first response 312 may be different.
[0027] The first questionnaire determined by the user can be transmitted from the user terminal 13 to the creation support server 11 via the network 14. The transmission / reception unit 330 of the creation support server 11 can perform the step of receiving at least one first questionnaire 313 for collecting ideas determined by the user from the user terminal 13 via the network 14. The information registration unit 322 can store at least one first questionnaire 313 for collecting ideas received from the user terminal 13 in the storage unit 310.
[0028] (B. Embodiment of the creation support server that outputs a questionnaire for evaluating ideas) In the embodiment shown in FIG. 3-2, the creation support server 11 includes a storage unit 310, a control unit 320, and a transmission / reception unit 330. The control unit 320 includes a second prompt creation unit 321B, an information registration unit 322, and an information conversion unit 323. The transmission / reception unit 330 performs step F of receiving, from the user terminal 13 via the network 14, information 311 including the purpose of collecting ideas and at least one first question 313 for collecting ideas. 1 This can be done. The information registration unit 322 can store in the storage unit 310 the information 311 including the purpose of collecting ideas received from the user terminal 13 and at least one first question 313 for collecting ideas. The second prompt creation unit 321B performs step G of creating a second prompt including a command for the language model to generate, according to the specified output format, at least one second question scenario for evaluating ideas for the first question 313, by referring to the information 311 including the purpose of collecting ideas and the at least one first question 313 stored in the storage unit 310. 1 This can be done. The transmission / reception unit 330 performs step H of transmitting the second prompt to the language model server 12 equipped with the language model via the network 14. 1 This can be done. The transmission / reception unit 330 performs step I of receiving, from the language model server 12 via the network 14, a second response 314 including the at least one second question scenario according to the specified output format. 1 This can be done. The information registration unit 322 can store in the storage unit 310 the second response 314 received from the language model server 12. The information conversion unit 323 can convert the second response 314 into a predetermined format. The transmission / reception unit 330 performs step J of transmitting, to the user terminal 13 via the network 14, the at least one second question scenario included in the second response 314. 1 This can be done. In step J, the transmission / reception unit 330 1 may transmit the second response 314 to the user terminal 13 so as to be displayed on the screen of the user terminal 13 in an editable manner for the user.
[0029] The user who has received the second response 314 on the user terminal 13 can select all or part of at least one second questionnaire included in the second response 314 on the browser or native app of the user terminal 13, and determine the second questionnaire to be used in the idea collection and evaluation project. The user may also determine the second questionnaire to be used in the idea collection and evaluation project by editing the presented second questionnaire on the browser or native app of the user terminal 13.
[0030] The user may not be satisfied with any of the second questionnaires included in the second response 314. In such a case, the user modifies at least one of the purpose of collecting ideas, at least one of the first questionnaires for collecting ideas, and at least one of the supplementary information regarding the purpose of collecting ideas described later on the browser or native app of the user terminal 13 and transmits it to the creation support server 11. The creation support server 11 is requested to perform steps G 1 to step J 1 again on the condition that the modification content is referred to. Alternatively, without modifying the purpose of collecting ideas, etc., the creation support server 11 is requested to perform steps G 1 to step J 1 again. When receiving the instruction, the creation support server 11 can perform steps G 1 to step J 1 again. This is because when the creation support server 11 is instructed again to output a questionnaire for evaluating ideas, even if the instruction content is the same, the obtained second response 314 may be different.
[0031] The second question determined by the user can be transmitted from the user terminal 13 to the creation support server 11 via the network 14. The transmission / reception unit 330 of the creation support server 11 can perform the step of receiving at least one second question 315 for evaluating the idea determined by the user based on the second response 314 from the user terminal 13 via the network 14. The information registration unit 322 can store at least one second question 315 for evaluating the idea received from the user terminal 13 in the storage unit 310.
[0032] (C. Embodiment (1) of a creation support server that outputs questionnaires for collecting ideas and questionnaires for evaluating ideas step by step) In the embodiment shown in FIG. 3-3, the creation support server 11 includes a storage unit 310, a control unit 320, and a transmission / reception unit 330. The control unit 320 includes a first prompt creation unit 321A, a second prompt creation unit 321B, an information registration unit 322, and an information conversion unit 323. The transmission / reception unit 330 can perform step A of receiving information 311 including the purpose of collecting ideas from the user terminal 13 via the network 14 1 and can do so. The information registration unit 322 can store the information 311 including the purpose of collecting the idea received from the user terminal 13 in the storage unit 310. The first prompt creation unit 321A refers to the information 311 including the purpose of collecting the idea stored in the storage unit 310, and creates a first prompt including a command for the language model to generate at least one first questionnaire for collecting ideas according to the specified output format according to the purpose. Step B 1 and can do so. The transmission / reception unit 330 can perform step C of transmitting the first prompt to the language model server 12 equipped with the language model via the network 14 1 and can do so. The transmission / reception unit 330 receives, from the language model server 12 via the network 14, a first response 312 including the at least one first questionnaire according to a specified output format (step D). 1 This can be performed. The information registration unit 322 can store the first response 312 received from the language model server 12 in the storage unit 310. The first response 312 stored in the storage unit 310 may include, in addition to the at least one first questionnaire, metadata such as a language model ID, a process ID, and a status code that the language model server 12 adds to the response of the language model. The second prompt creation unit 321B refers to the information 311 including the purpose of collecting the ideas stored in the storage unit 310 and the first response 312 including the at least one first questionnaire, and creates a second prompt including a command for the language model to generate at least one second questionnaire for evaluating the ideas for the first questionnaire according to a specified output format (step G). 1 This can be performed. The transmission / reception unit 330 transmits the second prompt to the language model server 12 equipped with the language model via the network 14 (step H). 1 This can be performed. The transmission / reception unit 330 receives, from the language model server 12 via the network 14, a second response 314 including the at least one second questionnaire according to a specified output format (step I). 1 This can be performed. The information registration unit 322 can store the second response 314 received from the language model server 12 in the storage unit 310. The second response 314 stored in the storage unit 310 may include, in addition to the at least one second questionnaire, metadata such as a language model ID, a process ID, and a status code that the language model server 12 adds to the response of the language model. The information conversion unit 323 can convert the first response 312 and the second response 314 into a predetermined format. The transmitting / receiving unit 330 transmits the at least one first questionnaire included in the first response 312 and the at least one second questionnaire included in the second response 314 to the user terminal 13 via the network 14 in step J. 1 This can be performed. The transmitting / receiving unit 330 1 In step J, the at least one first questionnaire included in the first response 312 and the at least one second questionnaire included in the second response 314 may be transmitted to the user terminal 13 so as to be displayed on the screen of the user terminal 13 in an editable manner.
[0033] The user who has received the first response 312 on the user terminal 13 can select all or part of the at least one first questionnaire included in the first response 312 on the browser or native app of the user terminal 13 and determine the first questionnaire to be used in the idea collection and evaluation project. Also, the user who has received the second response 314 on the user terminal 13 can select all or part of the at least one second questionnaire included in the second response 314 on the browser or native app of the user terminal 13 and determine the second questionnaire to be used in the idea collection and evaluation project.
[0034] The user may determine the first questionnaire and / or the second questionnaire to be used in the idea collection and evaluation project by editing the presented first questionnaire and / or second questionnaire on the browser or native app of the user terminal 13.
[0035] The user may be satisfied with the questionnaire for evaluating ideas but not with the questionnaire for collecting ideas. In such a case, the user may instruct the creation support server 11 to output only the questionnaire for collecting ideas again. When receiving the instruction, the creation support server 11, according to the instruction content, performs steps B 1 to step E 1up to that point can be performed. This is because, even if the instruction content is the same, the first response 312 obtained may be different when the creation support server 11 is instructed again to output a questionnaire for collecting ideas.
[0036] The user may be satisfied with the questionnaire for collecting ideas but not satisfied with the questionnaire for evaluating ideas. In such a case, the user may instruct the creation support server 11 to output only the questionnaire for evaluating ideas again. When the creation support server 11 receives the instruction, according to the instruction content, it performs steps G 1 to step J 1 up to that point can be performed. This is because, even if the instruction content is the same, the second response 314 obtained may be different when the creation support server 11 is instructed again to output a questionnaire for evaluating ideas.
[0037] The user may not be satisfied with either the questionnaire for collecting ideas or the questionnaire for evaluating ideas. In such a case, the user modifies the purpose of collecting ideas and / or supplementary information regarding the purpose of collecting ideas described later on the browser or native app of the user terminal 13 and transmits it to the creation support server 11, and instructs the creation support server 11 to perform steps B 1 to step J 1 again on the condition that the modification content is referred to. Alternatively, without modifying the purpose of collecting ideas or the like, the user may instruct the creation support server 11 to perform steps B 1 to step J 1 again. When receiving the instruction, the creation support server 11 performs steps B 1 to step J 1This can be done again up to this point. When the creation support server 11 is instructed again to output a questionnaire for collecting ideas and a questionnaire for evaluating ideas, even if the instruction content is the same, the first response 312 and the second response 314 obtained may be different.
[0038] The first question and the second question determined by the user can be transmitted from the user terminal 13 to the creation support server 11 via the network 14. The transmission / reception unit 330 of the creation support server 11 can perform the step of receiving at least one first question 313 for collecting ideas determined by the user and at least one second question 315 for evaluating ideas determined by the user from the user terminal 13 via the network 14. The information registration unit 322 can store at least one first question 313 for collecting ideas received from the user terminal 13 and at least one second question 315 for evaluating ideas received from the user terminal 13 in the storage unit 310.
[0039] (D. Embodiment (2) of the creation support server that outputs questionnaires for collecting ideas and questionnaires for evaluating ideas step by step) In the embodiment shown in FIGS. 3-4, the creation support server 11 includes a storage unit 310, a control unit 320, and a transmission / reception unit 330. The control unit 320 includes a first prompt creation unit 321A, a second prompt creation unit 321B, an information registration unit 322, and an information conversion unit 323. The transmission / reception unit 330 can perform step A of receiving information 311 including the purpose of collecting ideas from the user terminal 13 via the network 14. 1 This can be done. The information registration unit 322 can store the information 311 including the purpose of collecting the ideas received from the user terminal 13 in the storage unit. The first prompt creation unit 321A refers to the information 311 including the purpose of collecting the ideas stored in the storage unit, and creates a first prompt including a command for the language model to generate at least one first questionnaire for collecting ideas according to the purpose in the specified output format in step B 1 It can be performed. The transceiver unit 330 transmits the first prompt to the language model server 12 equipped with the language model via the network 14 in step C 1 It can be performed. The transceiver unit 330 receives a first response 312 including the at least one first questionnaire according to the specified output format from the language model server 12 via the network 14 in step D 1 It can be performed. The information registration unit 322 can store the first response 312 received from the language model server 12 in the storage unit 310. The first response 312 stored in the storage unit 310 may include metadata such as a language model ID, a process ID, and a status code added by the language model server 12 to the response of the language model in addition to the at least one first questionnaire. The information conversion unit 323 can convert the first response 312 into a predetermined format. The transceiver unit 330 transmits the at least one first questionnaire included in the first response 312 to the user terminal 13 via the network 14 in step E 1 It can be performed. The transceiver unit 330 1 In step E, the first response 312 may be transmitted to the user terminal 13 so as to be displayed on the screen of the user terminal 13 in a mode editable by the user.
[0040] The user who has received the first response 312 on the user terminal 13 can select all or part of at least one first questionnaire included in the first response 312 on the browser or native app of the user terminal 13, and determine the first questionnaire to be used in the idea collection and evaluation project. The user may also determine the first questionnaire to be used in the idea collection and evaluation project by editing the presented first questionnaire on the browser or native app of the user terminal 13.
[0041] The user may not be satisfied with any of the first questionnaires included in the first response 312. In such a case, the user modifies the purpose of collecting ideas on the browser or native app of the user terminal 13 and / or supplementary information regarding the purpose of collecting ideas described later, and transmits it to the creation support server 11. On the condition that the creation support server 11 refers to the modification content, steps B 1 to step E 1 may be instructed to be performed again. Alternatively, without modifying the purpose of collecting ideas, etc., steps B 1 to step E 1 may be instructed to be performed again. Upon receiving the instruction, the creation support server 11 can perform steps B 1 to step E 1 again. This is because when the creation support server 11 is instructed again to output a questionnaire for collecting ideas, even if the instruction content is the same, the obtained first response 312 may be different.
[0042] The first questionnaire determined by the user can be transmitted from the user terminal 13 to the creation support server 11 via the network 14. The transmission and reception unit 330 of the creation support server 11 can perform step F of receiving at least one first questionnaire 313 for collecting ideas determined by the user from the user terminal 13 via the network 14. 1 can be done. The information registration unit 322 can store the at least one first question 313 determined by the user in the storage unit 310. The second prompt creation unit 321B refers to the information 311 including the purpose of collecting the ideas stored in the storage unit 310 and the at least one first question 313 determined by the user, and creates a second prompt including a command for the language model to generate at least one second question scenario for evaluating the ideas for the first question according to the specified output format (step G). 1 It can perform. The transmission / reception unit 330 transmits the second prompt to the language model server 12 equipped with the language model via the network 14 (step H). 1 It can perform. The transmission / reception unit 330 receives a second response 314 including the at least one second question scenario according to the specified output format from the language model server 12 via the network 14 (step I). 1 It can perform. The information registration unit 322 can store the second response 314 received from the language model server 12 in the storage unit 310. The second response 314 stored in the storage unit 310 may include, in addition to the at least one second question scenario, metadata such as a language model ID, a process ID, and a status code added by the language model server 12 to the response of the language model. The information conversion unit 323 can convert the second response 314 into a predetermined format. The transmission / reception unit 330 transmits the at least one second question scenario included in the second response 314 to the user terminal 13 via the network 14 (step J). 1 It can perform. The transmission / reception unit 330 1 In step J, the second response 314 may be transmitted to the user terminal 13 so as to be displayed on the screen of the user terminal 13 in an editable manner.
[0043] The user who has received the second response 314 on the user terminal 13 can select all or part of at least one second questionnaire included in the second response 314 on the browser or native app of the user terminal 13, and determine the second questionnaire to be used in the idea collection and evaluation project. The user may also determine the second questionnaire to be used in the idea collection and evaluation project by editing the presented second questionnaire on the browser or native app of the user terminal 13.
[0044] The user may not be satisfied with any of the second questionnaires included in the second response 314. In such a case, the user modifies at least one of the purpose of collecting ideas, at least one first questionnaire for collecting ideas, and at least one supplementary information regarding the purpose of collecting ideas described later on the browser or native app of the user terminal 13 and transmits it to the creation support server 11. To the creation support server 11, on the condition of referring to the modified content, step G 1 to step J 1 may be instructed to be performed again. Alternatively, without modifying the purpose of collecting ideas, etc., step G 1 to step J 1 may be instructed to be performed again. When receiving the instruction, the creation support server 11 performs step G 1 to step J 1 again. This is because, even if the instruction content is the same, the resulting second response 314 may be different when the creation support server 11 is instructed again to output the questionnaire for evaluating ideas.
[0045] The second question determined by the user can be transmitted from the user terminal 13 to the creation support server 11 via the network 14. The transmission / reception unit 330 of the creation support server 11 can perform the step of receiving at least one second question 315 for evaluating the idea determined by the user from the user terminal 13 via the network 14. The information registration unit 322 can store at least one second question 315 for evaluating the idea received from the user terminal 13 in the storage unit 310.
[0046] (Embodiment of a creation support server that collectively outputs question proposals for collecting ideas and question proposals for evaluating ideas) In the embodiment shown in FIGS. 3-5, the creation support server 11 includes a storage unit 310, a control unit 320, and a transmission / reception unit 330. The control unit 320 includes a first prompt creation unit 321A, an information registration unit 322, and an information conversion unit 323. The transmission / reception unit 330 can perform step A of receiving information including the purpose of collecting ideas from the user terminal 13 via the network 14 2 and can perform it. The information registration unit 322 can store the information including the purpose of collecting the idea received from the user terminal 13 in the storage unit 310. The first prompt creation unit 321A refers to the information 311 including the purpose of collecting the idea stored in the storage unit 310, and creates a first prompt including at least one first question proposal for collecting an idea corresponding to the purpose, and a command for the language model to generate at least one second question proposal for evaluating the idea for the first question proposal according to the specified output format (step B) 2 and can perform it. The transmission / reception unit 330 can perform step C of transmitting the first prompt to the language model server 12 equipped with the language model via the network 14 2 and can perform it. The transmission / reception unit 330 receives, from the language model server 12 via the network 14, a first response 312 including the at least one first questionnaire according to the specified output format and at least one second questionnaire for evaluating ideas for the first questionnaire (step D). 2 This can be performed. The information registration unit 322 can store the first response 312 received from the language model server 12 in the storage unit 310. The first response 312 stored in the storage unit 310 may include, in addition to the at least one first questionnaire, metadata such as a language model ID, a process ID, and a status code that the language model server 12 adds to the response of the language model. The information conversion unit 323 can convert the first response 312 into a predetermined format. The transmission / reception unit 330 transmits, to the user terminal 13 via the network 14, the at least one first questionnaire and the at least one second questionnaire included in the first response (step E). 2 This can be performed. The transmission / reception unit 330 2 In step E, the first response 312 may be transmitted to the user terminal 13 so as to be displayed on the screen of the user terminal 13 in a mode editable by the user.
[0047] The user who has received the first response 312 on the user terminal 13 can select all or part of the at least one first questionnaire included in the first response 312 on the browser or native app of the user terminal 13 and determine the first questionnaire to be used in the idea collection / evaluation project. Also, the user who has received the first response 312 on the user terminal 13 can select all or part of the at least one second questionnaire included in the first response 312 on the browser or native app of the user terminal 13 and determine the second questionnaire to be used in the idea collection / evaluation project.
[0048] The user may determine the first question and / or the second question to be used in the idea collection and evaluation project by editing the presented first questionnaire and / or the second questionnaire on the browser or native app of the user terminal 13.
[0049] The user may be satisfied with the questionnaire for evaluating ideas but not with the questionnaire for collecting ideas. In such a case, the user may instruct the creation support server 11 to output only the questionnaire for collecting ideas again. When receiving the instruction, the creation support server 11, according to the instruction content, performs steps B 1 to step E 1 as described in "B. Embodiment of the creation support server for outputting a questionnaire for collecting ideas". This is because even if the instruction content is the same, the obtained first response 312 may be different when the creation support server 11 is instructed to output the questionnaire for collecting ideas again.
[0050] The user may be satisfied with the questionnaire for collecting ideas but not with the questionnaire for evaluating ideas. In such a case, the user may instruct the creation support server 11 to output only the questionnaire for evaluating ideas again. When receiving the instruction, the creation support server 11, according to the instruction content, performs steps G 1 to step J 1 as described in "B. Embodiment of the creation support server for outputting a questionnaire for evaluating ideas" and can perform up to that point.
[0051] The user may not be satisfied with either the questionnaire for collecting ideas or the questionnaire for evaluating ideas. In such a case, the user corrects the purpose of collecting ideas on the browser or native app of the user terminal 13 and / or supplementary information regarding the purpose of collecting ideas described later, and sends it to the creation support server 11. The creation support server 11, on the condition of referring to the corrected content, performs steps B 2 to step E 2You may also instruct to perform the operations up to [a certain point] again. Alternatively, without modifying the purpose of collecting ideas or the like, you may instruct the creation support server 11 to perform the operations from step B 2 to step E 2 again. This is because, when you instruct the creation support server 11 again to output the questionnaire for collecting ideas and the questionnaire for evaluating ideas, even if the instruction content is the same, the obtained first response 312 may be different.
[0052] The first question and the second question determined by the user can be transmitted from the user terminal 13 to the creation support server 11 via the network 14. The transmission / reception unit 330 of the creation support server 11 can perform the step of receiving at least one first question 313 for collecting the ideas determined by the user and at least one second question 315 for evaluating the ideas determined by the user from the user terminal 13 via the network 14. The information registration unit 322 can store at least one first question 313 for collecting the ideas received from the user terminal 13 and at least one second question 315 for evaluating the ideas received from the user terminal 13 in the storage unit 310.
[0053] In any of the embodiments shown in FIGS. 3-1 to 3-5, the format of the data stored in the storage unit 310 may be appropriately selected according to the type of data. For example, it can be text data, image data, video data, audio data, or a combination of one or more of these. The data may be stored in the storage unit 310 as a file in a predetermined file format that is launched by various applications such as Adobe's PDF, Microsoft's Word / Excel / PowerPoint. Also, these data can be stored in a predetermined table in a database. In addition, the data may be stored in individual files according to the type of data, or multiple types of data may be grouped and stored in one file. Also, the data included in the same file name may be divided and stored in multiple files. The data stored in the database or various files can be stored temporarily or non-temporarily according to the type of data.
[0054] For the purpose of collecting ideas, for example, extraction of management issues and solutions, formulation of sales strategies, formulation of business improvement measures, copywriting, etc. can be mentioned. The purpose may be one or multiple.
[0055] In any of the embodiments shown in FIGS. 3-1 to 3-5, step A 1 or step A 2 It is preferable that the information 311 received by the creation support server 11 in includes supplementary information regarding the purpose of collecting ideas. By providing the supplementary information regarding the purpose of collecting ideas, the creation support server 11 also refers to the supplementary information and creates a first prompt including a generation command for a questionnaire for collecting ideas in step B 1 or step B 2 or creates a second prompt including a generation command for a questionnaire for evaluating ideas in step G 1 or step B 2Since it is possible to perform [the operation], it is possible to obtain from the language model server 12 a first response and a second response that are appropriate for the purpose of collecting ideas. Supplementary information regarding the purpose of collecting ideas includes, for example, the background of management issues, the market environment surrounding the business, basic information about the business content, and the like. The type of such supplementary information may be one or a plurality.
[0056] The purpose of collecting ideas included in the information 311 received by the creation support server 11 and the supplementary information regarding the purpose can be text data, image data, video data, audio data, or a combination of one or more of these. The information 311 received by the creation support server 11 may be the one that the user directly inputs on the browser or native app of the user terminal 13 and transmits to the creation support server 11, or the user may transmit an electronic file in which the information 311 is stored via the browser or native app of the user terminal 13 and transmit this to the creation support server 11.
[0057] The supplementary information may be included in the information 311 received by the creation support server 11. As an alternative, the supplementary information itself may not be included in the information 311 received by the creation support server 11, and information for accessing the supplementary information (an address on the network such as a URL) may be included. In any case, it can be considered that the supplementary information regarding the purpose of collecting ideas is included in the information 311 received by the creation support server 11.
[0058] (F. Example of the procedure for creating the first prompt) Here, in "A. Embodiment of the creation support server that outputs a questionnaire for collecting ideas", the first prompt creation unit 321A refers to the information 311 including the purpose of collecting ideas stored in the storage unit 310, and a first prompt including a command for the language model server 12 to generate at least one first questionnaire for collecting ideas corresponding to the purpose according to the specified output format is created in step B 1Specific procedures for performing this will be exemplarily described. The said procedures are also applicable when performing steps for creating similar prompts in other embodiments.
[0059] In one embodiment, the first prompt consists of a character string of a fixed sentence stating that a questionnaire for collecting ideas is requested from the language model server 12, a character string for the purpose of collecting ideas, and a character string specifying the output format. The character string consisting of the fixed sentence and the character string specifying the output format can be predetermined and stored in the storage unit 310 as the format of the first prompt. The first prompt creation unit 321A can create the first prompt by inserting the character string for the purpose of collecting ideas into a predetermined location in the format of the first prompt. In addition, the first prompt creation unit 321A can also create the first prompt by inserting a character string regarding one or two or more predetermined arbitrary matters into a predetermined location in the format of the first prompt. Note that characters include not only characters such as hiragana, katakana, Chinese characters, and alphabets, but also special characters such as symbols, signs, and numbers.
[0060] When the "purpose of collecting ideas" stored in the storage unit 310 is not text data, for example, when it includes image data, video data, audio data, or a combination of one or more of these, the first prompt creation unit 321A can create the character string of the "purpose of collecting ideas" by extracting text data from these data. In order to extract text data, the first prompt creation unit 321A can use software such as OCR, image recognition AI, and voice recognition AI.
[0061] Examples of the output format include JSON format, XML format, YAML format, CSV format, TSV format, Markdown format, plain text, etc. By specifying the output format for the language model server 12, the processing in the information registration unit 322 and the information conversion unit 323 becomes easier. Among these output formats, the JSON format is preferred for reasons such as the spread situation, the lightness of data, the flexibility of expression, and readability. When the language model server 12 is capable of processing, it is possible to more clearly specify the output format by sending a JSON Schema that defines the structure of the JSON data together with the prompt.
[0062] In a preferred embodiment, the first prompt includes a character string of supplementary information regarding the purpose of collecting ideas. The first prompt creation unit 321A can insert the character string of "supplementary information regarding the purpose of collecting ideas" into a predetermined location in the format of the first prompt. When the supplementary information regarding the purpose of collecting ideas stored in the storage unit 310 is not text data, for example, when it includes image data, video data, audio data, or a combination of one or more of these, the first prompt creation unit 321A can create a character string of supplementary information regarding the purpose of collecting ideas by extracting text data from these data. To extract text data, the first prompt creation unit 321A can utilize software such as OCR, image recognition AI, voice recognition AI, etc. When the supplementary information regarding the purpose of collecting ideas includes information for accessing the supplementary information (an address on the network such as a URL), the first prompt creation unit 321A may access the supplementary information, read the supplementary information, and insert the character string of supplementary information regarding the purpose of collecting ideas into a predetermined location in the format of the first prompt.
[0063] In a preferred embodiment, the first prompt includes a specification of the number of first questions to be generated by the language model. The first prompt creation unit 321A can insert a character string including a specification of the number of first questions to be generated by the language model into a predetermined location in the format of the first prompt. It is convenient for the user to be able to consider a large number of questions at once when the number of first questions generated by the language model server 12 at one time is large. Preferably, the lower limit of the number of first questions to be generated by the language model is, for example, 3 or more, and more preferably 5 or more. On the other hand, when the number of first questions to be generated by the language model is small, there is an advantage that the amount of data to be displayed on the user terminal 13 can be limited, or the load on the user for reading the first questions can be limited. Preferably, the upper limit of the number of first questions to be generated by the language model is, for example, 10 or less, and more preferably 7 or less. Therefore, the number of first questions to be generated by the language model is preferably 3 or more and 10 or less, and more preferably 5 or more and 7 or less.
[0064] When the language model server 12 can process it, the first prompt may include, in addition to the character string, image data, video data, audio data, or a combination of one or more of these.
[0065] The image data, video data, audio data, or a combination of one or more of these included in the first prompt created by the creation support server 11 may be transmitted as it is when the language model server 12 can process it, or may be transmitted after being encoded into a format that the language model server 12 can process.
[0066] (G. Example of the procedure for creating the second prompt) Next, in the "B. Embodiment of the creation support server that outputs a questionnaire for evaluating ideas", the second prompt creation unit 321B refers to the information 311 including the purpose of collecting ideas stored in the storage unit 310 and at least one first questionnaire 313, and the language model server 12 generates at least one second questionnaire for evaluating the ideas for the first questionnaire 313 according to the specified output format. Step G of creating a second prompt including a command for this 1 The specific procedure when performing this will be exemplarily described. This procedure is also applicable when performing the step of creating a similar prompt in other embodiments.
[0067] In one embodiment, the second prompt consists of a character string of a fixed-form sentence indicating that a questionnaire for evaluating ideas is requested from the language model server 12, a character string for the purpose of collecting ideas, a character string of at least one first questionnaire, and a character string specifying the output format. The character string consisting of the fixed-form sentence and the character string specifying the output format can be predetermined and stored in the storage unit 310 as the format of the second prompt. The second prompt creation unit 321B can create the second prompt by inserting the character string for the purpose of collecting ideas and the character string of at least one first questionnaire into the predetermined location of the format of the second prompt. In addition, the second prompt creation unit 321B can also create the second prompt by inserting a character string related to one or two or more predetermined matters into the predetermined location of the format of the second prompt.
[0068] When the "purpose of collecting ideas" stored in the storage unit 310 is not text data, for example, when it includes image data, video data, audio data, or a combination of one or more of these, the second prompt creation unit 321B can create the character string of the "purpose of collecting ideas" by extracting text data from these data. In order to extract text data, the second prompt creation unit 321B can use software such as OCR, image recognition AI, and voice recognition AI.
[0069] Examples of the output format include, for example, JSON format, XML format, YAML format, CSV format, TSV format, Markdown format, plain text, etc. By specifying the output format for the language model server 12, the processing in the information registration unit 322 and the information conversion unit 323 becomes easier. Among these output formats, the JSON format is preferred for reasons such as the popularity status, the lightness of the data, the flexibility of expression, and the readability. When the language model server 12 can process it, it is possible to more clearly specify the output format by sending a JSON Schema that defines the structure of the JSON data together with the prompt.
[0070] In a preferred embodiment, the second prompt includes a character string of supplementary information regarding the purpose of collecting ideas. The second prompt creation unit 321B can insert the character string of supplementary information regarding the purpose of collecting ideas into a predetermined location in the format of the second prompt. When the supplementary information regarding the purpose of collecting ideas stored in the storage unit 310 is not text data, for example, when it includes image data, video data, audio data, or a combination of one or more of these, the second prompt creation unit 321B can create a character string of supplementary information regarding the purpose of collecting ideas by extracting text data from these data. To extract the text data, the second prompt creation unit 321B can use software such as OCR, image recognition AI, voice recognition AI, etc. When the supplementary information regarding the purpose of collecting ideas includes information for accessing the supplementary information (an address on the network such as a URL), the second prompt creation unit 321B may access the supplementary information, read the supplementary information, and insert the character string of supplementary information regarding the purpose of collecting ideas into a predetermined location in the format of the second prompt.
[0071] In a preferred embodiment, the second prompt includes a specification of the number of second questionnaires to be generated by the language model. The second prompt creation unit 321B can insert a character string including a specification of the number of second questionnaires to be generated by the language model at a predetermined position in the format of the second prompt. It is convenient for the user to be able to consider a large number of questionnaires at once when the language model server 12 generates a large number of second questionnaires at a time. The lower limit of the number of second questionnaires to be generated by the language model is preferably, for example, 2 or more, and more preferably 3 or more. On the other hand, when the number of second questionnaires to be generated by the language model is small, there is an advantage that the amount of data to be displayed on the user terminal 13 can be limited, or the load on the user to read the second questionnaires can be limited. The upper limit of the number of second questionnaires to be generated by the language model is preferably, for example, 7 or less, and more preferably 5 or less. Therefore, the number of second questionnaires to be generated by the language model is preferably 2 or more and 7 or less, and more preferably 3 or more and 5 or less.
[0072] When the language model server 12 can process it, the second prompt may include, in addition to the character string, image data, video data, audio data, or a combination of one or more of these.
[0073] The image data, video data, audio data, or a combination of one or more of these included in the second prompt created by the creation support server 11 may be transmitted as it is when the language model server 12 can process it, or may be transmitted after being encoded into a format that the language model server 12 can process.
[0074] (Conversion by the H. Information Conversion Unit) In one embodiment, the information conversion unit 323 can convert the first response 312, the second response 314, and a third response 316 (to be described later) received from the language model server 12 into a predetermined format. In this case, the information registration unit 322 can store the first response 312, the second response 314, and the third response 316 that have been converted into the predetermined format by the information conversion unit 323 in the storage unit 310. As a result, the first response 312, the first response 312, the second response 314, and the third response can be decomposed into a plurality of items according to the predetermined format, and each item can be associated with and stored at the location assigned to each item. The predetermined format is not limited, but examples include a relational database (table format), a key-value store, a document-oriented database, a column-oriented database, and a file format. Among these, a relational database (table format) is preferred because data can be efficiently processed by columns with a fixed schema and the relationship between different data sets can be concisely expressed.
[0075] FIG. 6 shows an example of the structure of a database for storing various types of information in the storage unit 310 of the creation support server 11. In this example, various types of information are stored in the form of tables in a relational database, and five tables of "form", "form_generation", "ideate_question", "idea_example", and "evaluate_question" are shown. In the "form" table, the identifier (form_id) of the questionnaire form is stored in association with the identifier (form_generation_id) of the prompt creation. In the "form_generation" table, the purpose (purpose) and supplementary information (notes) of the project are stored in association with a predetermined identifier (form_generation_id). In the "ideate_question" table, the first question (ideate_question_sentence) for collecting ideas is stored in association with predetermined identifiers (ideate_question_id and form_id). In the "idea_example" table, an example of an idea (idea_example_sentence) is stored in association with predetermined identifiers (idea_example_id and ideate_question_id). In the "evaluate_question" table, the second question (evaluate_question_sentence) for evaluating ideas is stored in association with predetermined identifiers (evaluate_question_id and ideate_question_id). The "form" table may not exist, but by providing the "form" table, the following advantages can be obtained. · When the method for supporting the creation of questions according to the embodiment of the present invention is repeatedly implemented for the same questionnaire form, history management can be performed. For example, when at least one of the purpose and supplementary information of the project is different, different generation_ids can be assigned. Even if the purpose and supplementary information of the project are the same, different generation_ids can be assigned when using the same questionnaire form (form_id). · When questions are created by manual input by the user, the question form can be managed without using the "form_generation" table. · The correspondence relationship of a plurality of idea collection questions (the first questions for collecting ideas stored in the "ideate_question" table) belonging to the same question form can be managed without using the "form_generation" table.
[0076] Also, in one embodiment, the information conversion unit 323 can convert the first response 312, the second response 314, and the third response stored in the storage unit 310 into a predetermined format. In this case, the transmission / reception unit 330 can transmit the first response 312, the second response 314, and the third response converted into the predetermined format by the information conversion unit 323 to the user terminal 13 via the network 14. When transmitting the first response 312, the second response 314, and the third response to the user terminal 13, in addition to the content generated by the language model such as the first questionnaire, the second questionnaire, and examples of ideas included in these responses, all information such as the metadata included in the first response 312, the second response 314, and the third response received from the language model server 12 may be transmitted, but only the content generated by the language model such as the first questionnaire, the second questionnaire, and examples of ideas included in these responses may be extracted and transmitted. The predetermined format includes, but is not limited to, for example, JSON format, XML format, YAML format, HTML format, and may be transmitted in a format that can be processed by the browser or native app used by the user terminal 13.
[0077] (I. Embodiment of the creation support server for outputting examples of ideas) In the embodiments shown in FIGS. 3-1, 3-3, 3-4, and 3-5, the first prompt may further include a command for the language model server 12 to generate, according to a specified output format, an example of at least one idea for at least one first questionnaire. Similarly, in the embodiment shown in FIG. 3-2, the second prompt may further include a command for the language model server 12 to generate, according to a specified output format, an example of at least one idea for at least one first question.
[0078] By presenting an example of an idea for the first questionnaire or the first question, the user can preliminarily grasp what kind of ideas can be assumed. Also, by comparing the example of the idea presented by the language model server 12 with the ideas presented by the project participants when actually implementing the idea collection and evaluation project, it can also be used as a reference when evaluating the originality of the project participants.
[0079] In this case, step D 1 or step D 2 the first response 312 received by the transceiver 330 in will further include an example of at least one idea for at least one first questionnaire or the first question. Also, step E 1 step E 2 or step J 1 the first response 312 transmitted from the transceiver 330 to the user terminal 13 in can further include an example of at least one idea for at least one first questionnaire.
[0080] In the embodiments shown in FIGS. 3-1, 3-3, 3-4, and 3-5, the prompt including the instruction for causing the language model server 12 to generate an example idea may not be included in the first prompt and may be separately created at a timing different from the timing of creating the first prompt. Similarly, in the embodiment shown in FIG. 3-2, the prompt including the instruction for causing the language model server 12 to generate an example idea may not be included in the second prompt and may be separately created at a timing different from the timing of creating the second prompt.
[0081] By separately creating a prompt including an instruction for causing the language model server 12 to generate an example idea, it becomes possible to give step-by-step instructions to the language model server 12, and thereby an improvement in the quality of the example ideas generated is expected. Also, by generating step by step, it becomes possible to instruct the generation of an example idea for the first question that has received a correction from the user.
[0082] For this purpose, in one embodiment, the control unit 320 of the creation support server 11 refers to at least one first questionnaire or at least one first question stored in the storage unit 310 without referring to the purpose of collecting ideas stored in the storage unit 310, and includes an instruction for the language model server to generate at least one example idea for the first questionnaire or the first question according to the specified output format. Step K of creating the third prompt 1 Or step G 2 It can have a third prompt creation unit 321C that can perform the above. The transmission / reception unit 330 performs step L of transmitting the third prompt to the language model server 12 equipped with the language model via the network 14 1 Or step H 2 It can perform the above. The transmission / reception unit 330 performs step M of receiving from the language model server a third response 316 including the at least one example idea according to the specified output format via the network 14 1 Or step I2 can be performed. The information registration unit 322 can store the third response 316 received from the language model server 12 in the storage unit 310. The third response 316 stored in the storage unit 310 may include, in addition to at least one example of an idea, metadata such as a language model ID, a process ID, and a status code that the language model server 12 adds to the response of the language model. The information conversion unit 323 can convert the third response 316 stored in the storage unit 310 into a predetermined format. The transceiver unit 330 performs step N of transmitting, via the network 14 to the user terminal, the example of the at least one idea included in the third response 316 1 or step J 2 can be performed.
[0083] The above step K 1 or step G 2 In, the third prompt creation unit 321C may create a third prompt without referring to the purpose of collecting the ideas stored in the storage unit 310. The third prompt creation unit 321C may create a third prompt without referring to the purpose of collecting the ideas stored in the storage unit 310, but by referring to supplementary information regarding the purpose. The third prompt creation unit 321C may create a third prompt without referring to either the purpose of collecting the ideas stored in the storage unit 310 or the supplementary information regarding the purpose. When implementing an idea collection and evaluation project, project participants may participate without knowing the purpose of collecting ideas. Therefore, step K 1 or step G 2In this case, it can be expected that the third prompt creation unit 321C receives, from the language model server 12, examples of ideas under conditions close to those of the project participants, by creating a third prompt without referring to the purpose of collecting the ideas stored in the storage unit 310. This embodiment is also suitable for simulating whether the questions are such that project participants without background information can answer the ideas expected by the project manager.
[0084] As another method, the above step K 1 or step G 2 In this case, the third prompt creation unit 321C may create a third prompt with reference to the purpose of collecting the ideas stored in the storage unit 310. The third prompt creation unit 321C may create a third prompt with reference to both the purpose of collecting the ideas stored in the storage unit 310 and supplementary information regarding the purpose. When conducting an idea collection and evaluation project, project participants may participate after being informed of the purpose of collecting ideas. Therefore, it can be expected that the third prompt creation unit 321C receives, from the language model server 12, examples of ideas under conditions close to those of the project participants, by creating a third prompt with reference to the purpose of collecting the ideas stored in the storage unit 310. This embodiment is also suitable for simulating whether the questions are such that project participants with background information can answer the ideas expected by the project manager.
[0085] Furthermore, the third prompt creation unit 321C can be configured to perform both the case of creating the third prompt without referring to the purpose of collecting the ideas stored in the storage unit 310 (and furthermore the supplementary information regarding the purpose) and the case of creating the third prompt with reference to the purpose of collecting the ideas stored in the storage unit 310 (and furthermore the supplementary information regarding the purpose). Thereby, the project manager can obtain the third response 316 obtained from the language model server 12 when the third prompt creation unit 321C creates the third prompt without referring to the purpose of collecting the ideas stored in the storage unit 310, and the third response 316 obtained from the language model server 12 when the third prompt creation unit 321C creates the third prompt with reference to the purpose of collecting the ideas stored in the storage unit 310. Thereby, the project manager can obtain, for example, a hint when considering an introductory explanation to the project participants.
[0086] The transmission / reception unit 330 may transmit the third response 316 to the user terminal 13 so as to be displayed on the screen of the user terminal 13 in a mode editable by the user in step N 1 or step J 2 In this way, the user can edit the presented example of the idea on the browser or native app of the user terminal 13. The example of the idea before or after editing may be exemplarily presented to the project participants when implementing the idea collection and evaluation project.
[0087] In addition, by causing the language model server 12 to generate a second questionnaire for evaluating an idea in consideration of examples of ideas before or after editing, the second questionnaire may be more targeted. Therefore, in one embodiment, the transmission / reception unit 330 of the creation support server 11 can receive at least one example of an idea determined by the user from the user terminal 13 via the network 14. Then, the second prompt creation unit 321B also refers to at least one example of an idea determined by the user, and creates a second prompt including a command for the language model server 12 to generate at least one second questionnaire for evaluating the first questionnaire or the idea for the first questionnaire according to the specified output format.
[0088] (J. Example of the procedure for creating the third prompt) In "A. Embodiment of the creation support server that outputs a questionnaire for evaluating an idea", among the information 311 including the purpose of collecting ideas stored in the storage unit 310 by the third prompt creation unit 321C, with or without referring to the "purpose of collecting ideas", and referring to at least one first questionnaire 313, step K of creating a third prompt including a command for the language model server 12 to generate at least one example of an idea for the first questionnaire 313 according to the specified output format. 1 The specific procedure when performing this will be exemplarily described. This procedure is also applicable when performing the step of creating a similar prompt in other embodiments.
[0089] In one embodiment, the third prompt consists of a character string of a fixed sentence requesting an example of an idea for at least one first questionnaire for the language model server 12, a character string for the purpose of collecting ideas, a character string of at least one first question, and a character string specifying an output format. When creating the third prompt without referring to the purpose of collecting ideas, the character string for the purpose of collecting ideas is not included in the third prompt. The character string consisting of the fixed sentence and the character string specifying the output format can be predetermined and stored in the storage unit 310 as the format of the third prompt. The third prompt creation unit 321C can create the third prompt by inserting the character string for the purpose of collecting ideas (only when referring to the purpose of collecting ideas) and the character string of at least one first question into predetermined positions in the format of the third prompt. In addition, the third prompt creation unit 321C can also create the third prompt by inserting a character string related to one or more predetermined matters into a predetermined position in the format of the third prompt.
[0090] When the "purpose of collecting ideas" stored in the storage unit 310 is not text data, for example, when it includes image data, video data, audio data, or a combination of one or more of these, the third prompt creation unit 321C can create the character string of the "purpose of collecting ideas" by extracting text data from these data. To extract text data, the third prompt creation unit 321C can use software such as OCR, image recognition AI, and voice recognition AI.
[0091] Examples of the output format include JSON format, XML format, YAML format, CSV format, TSV format, Markdown format, plain text, etc. By specifying the output format for the language model server 12, the processing in the information registration unit 322 and the information conversion unit 323 becomes easier. Among these output formats, the JSON format is preferred for reasons such as the popularity status, lightness of data, flexibility of expression, readability, etc. When the language model server 12 is capable of processing, it is possible to more clearly specify the output format by sending a JSON Schema that defines the structure of the JSON data together with the prompt.
[0092] The third prompt may include a character string of supplementary information regarding the purpose of collecting ideas. The third prompt creation unit 321C can insert the character string of supplementary information regarding the purpose of collecting ideas into a predetermined location in the format of the third prompt. When the supplementary information regarding the purpose of collecting ideas stored in the storage unit 310 is not text data, for example, when it includes image data, video data, audio data, or a combination of one or more of these, the third prompt creation unit 321C can create a character string of supplementary information regarding the purpose of collecting ideas by extracting text data from these data. To extract text data, the third prompt creation unit 321C can use software such as OCR, image recognition AI, voice recognition AI, etc. When the supplementary information regarding the purpose of collecting ideas includes information for accessing the supplementary information (an address on the network such as a URL), the third prompt creation unit 321C may access the supplementary information, read the supplementary information, and insert the character string of supplementary information regarding the purpose of collecting ideas into a predetermined location in the format of the third prompt.
[0093] In a preferred embodiment, the third prompt includes a specification of the number of examples of ideas that the language model should generate. The third prompt creation unit 321C can insert a character string including a specification of the number of examples of ideas that the language model should generate into a predetermined location in the format of the third prompt. It is convenient for the user to be able to consider a large number of examples of ideas at once when the number of examples of ideas generated by the language model server 12 at one time is large. Preferably, the lower limit of the number of examples of ideas that the language model should generate is, for example, 2 or more, and more preferably 3 or more. On the other hand, when the number of examples of ideas that the language model should generate is small, there is an advantage that the amount of data to be displayed on the user terminal 13 can be limited, or the load on the user for reading the examples of ideas can be limited. Preferably, the upper limit of the number of examples of ideas that the language model should generate is, for example, 5 or less, and more preferably 4 or less. Therefore, the number of examples of ideas that the language model should generate is preferably 2 or more and 5 or less, and more preferably 3 or more and 4 or less.
[0094] When the language model server 12 can process it, the third prompt may include, in addition to the character string, image data, video data, audio data, or a combination of one or more of these.
[0095] The image data, video data, audio data, or a combination of one or more of these included in the third prompt created by the creation support server 11 may be transmitted as it is when the language model server 12 can process it, or may be transmitted after being encoded into a format that the language model server 12 can process.
[0096] [Language model server] The language model server 12 is a server equipped with a language model capable of natural language processing (NLP: Natural Language Processing). The language model server 12 can receive the various prompts described above from the creation support server 11 via the network 14, generate a response corresponding to the prompt, and transmit it to the creation support server 11 via the network 14. The language model server 12 is communicably connected to the creation support server 11 via the network 14 and can be linked, for example, using an API (Application Programing Interface).
[0097] A language model usually includes a neural network internally. To generate an appropriate response, the number of its parameters is preferably 300 million or more, more preferably 1 billion or more, and even more preferably 10 billion or more.
[0098] Examples of the neural network for the language model include RNN (Recurrent Neural Network), LSTM (Long Short-Term Memory), and Transformer. Specific examples of the language model include BERT (Bidirectional Encoder Representations from Transformers), XLNet, RoBERTa, DeBERTa, GPT (Generative Pre-trained Transformer), T5 (Text-to-Text Transfer Transformer), and BERT (Bidirectional Encoder Representations from Transformers).
[0099] <2. Procedure for question creation (when the creation support server 11 outputs questionnaires for collecting ideas and questionnaires for evaluating ideas step by step)> Next, an example of a screen displayed on the display of the user terminal 13 will be exemplarily described with reference to the procedure for stepwise creating questions for collecting ideas by the above-described system (hereinafter also referred to as "questions for idea collection") and questions for evaluating ideas (hereinafter also referred to as "questions for idea evaluation").
[0100] (2-1. Instruction for generating questions for idea collection from the user terminal and reception of the purpose of collecting ideas, etc.) FIG. 4-1 shows an example of a screen of an input form displayed on the display of the user terminal 13 when a project manager (user) accesses the server 11 by creating and inputting a predetermined URL from the user terminal 13. The screen of the input form can be configured with a browser or a native app so as to be displayed after a predetermined authentication procedure such as ID and PW verification. The project manager inputs the purpose of the project (corresponding to the purpose of collecting ideas) which is required to be input and supplementary information (corresponding to supplementary information regarding the purpose of collecting ideas) which is optional to be input into the text box displayed on the screen of the input form with the display of "Step 1: Input to AI" (FIG. 4-2). Next, the project manager presses the button of "Generation of questions for idea collection and answer examples" on the screen of the input form (FIGS. 4-3A and 4-3B). Then, the input content is transmitted from the user terminal 13 to the creation support server 11. The creation support server 11 receives the purpose of the project and the supplementary information from the user terminal 13 via the network 14 (step A 1 ).
[0101] (2-2. Creation of the first prompt and transmission to the language model server) The information registration unit 322 of the creation support server 11 stores the purpose and supplementary information of the project received from the user terminal 13 in the storage unit 310. The first prompt creation unit 321A refers to the purpose and supplementary information of the project stored in the storage unit 310, and creates a first prompt including a command for the language model server 12 to generate a question (first questionnaire) for collecting ideas according to the purpose in the specified output format, and a command for the language model server to generate an example answer (example of an idea) for the first questionnaire (step B 1 ).
[0102] Figure 4-3A shows an example of the created first prompt. "We are planning a questionnaire consisting of an idea collection session and an evaluation collection session. Please output the questions for the idea collection session according to the following purpose and examples of answers to them." is a character string including a fixed-form sentence requesting a questionnaire for collecting ideas from the language model server 12 and requesting an example of an idea for the questionnaire. "We want to plan measures to revitalize the Sakura Shopping Street." is a character string of the purpose of the project (the purpose of collecting ideas). "The Sakura Shopping Street is a shopping street lined with traditional individual stores. Although the product lineup of individual stores is inferior to that of large chains, it was bustling as a shopping street with a strong connection and warmth with local people. However, a large shopping mall was built in the neighborhood five years ago, so the flow of people has changed and the pedestrian traffic on the shopping street has decreased." is a character string of supplementary information regarding the purpose of the project (the purpose of collecting ideas). "The output should follow the following format. - {Question 1} - {Answer example 1-1} - {Answer example 1-2} - {Question 2} - {Answer example 2-1} - {Answer example 2-2}" It is a string that specifies that the output format is in Markdown format. Also, this string specifies that the language model server should generate about two idea collection questionnaires and about two example answers (idea examples) for each questionnaire. If you want to more precisely instruct the number of questionnaires and example answers, you may append an instruction text such as "Please propose 3 questionnaires. Please propose 4 example answers for each questionnaire." to the prompt. The creation support server 11 transmits the generated first prompt to the language model server 12 equipped with a language model via the network 14 (step C 1 ) Note that an example of the first prompt when specifying that the output format is in JSON format is described in FIG. 4-3B.
[0103] (2-3. Receiving the first response from the language model server and transmitting it to the user terminal) The language model server 12 that has received the first prompt via the network 14 transmits a first response 312 including a first questionnaire and example ideas for the first questionnaire according to the specified output format. The creation support server 11 receives the first response 312 via the network 14 (step D 1 ) An example of the received first response is shown in FIG. 4-4. The information registration unit 322 of the creation support server 11 stores the first response 312 received from the language model server 12 in the storage unit 310. The information conversion unit 323 can convert the first response 312 into a predetermined format.
[0104] The creation support server 11 transmits the first questionnaire and example ideas for the first questionnaire included in the first response 312 to the user terminal 13 via the network 14 (step E 1) As a result, on the screen of the display of the user terminal 13, the content corresponding to the first response 312 is displayed together with the title "Step 2: Creating Questions for Idea Collection". In FIG. 4-4, two idea collection question proposals (the first question proposal) and two answer examples (idea examples) for each question proposal are displayed in an editable manner.
[0105] (2-4. Receiving from the User Terminal of the First Question Determined by the User) The project manager can edit the received idea collection question proposal (the first question proposal) and / or answer example (idea example) on the user terminal 13 to determine the first question and / or answer example. As an editing method, there is a method in which the project manager edits by himself / herself within the text box displayed on the screen for the idea collection question proposal and / or answer example corresponding to the first response 312 received from the creation support server 11 (FIG. 4-5). If the user desires, the browser or native app may be configured so that any first question proposal displayed on the screen can be deleted by pressing the "Delete Question" button displayed on the screen of the user terminal 13.
[0106] When the editing of the idea collection question is completed and the project manager presses the "Generate Answer Example" button displayed below the text box on the screen of the user terminal 13, the selected idea collection question is transmitted from the user terminal 13 to the creation support server 11. The creation support server 11 receives the idea collection question from the user terminal 13 via the network 14 (FIG. 4-6A, FIG. 4-6B).
[0107] In addition, when the project manager presses the "Reset and Regenerate" button displayed on the screen, the creation support server 11 deletes all the first question proposals and can re-execute steps B 1 to step E 1 again.
[0108] (2-5. Creation of the Third Prompt and Transmission to the Language Model Server) The information registration unit 322 of the creation support server 11 stores the idea collection questionnaire (the first questionnaire 313) received from the user terminal 13 in the storage unit 310. The third prompt creation unit 321C refers to the first questionnaire 313 stored in the storage unit 310 and creates a third prompt including a command for the language model server to generate an example answer (an example of an idea) for the first questionnaire according to the specified output format (step K 1 ). The third prompt creation unit 321C may create the third prompt without referring to the purpose of the project, or may create the third prompt with reference to the purpose of the project.
[0109] FIGS. 4-6A show examples of the created third prompt. "We are planning a questionnaire consisting of an idea collection session and an evaluation collection session. Please output an example answer to the questionnaire for the idea collection session conducted under the following purpose." is a character string including a fixed sentence requesting an example of an idea for the idea collection questionnaire (the first questionnaire) from the language model server 12. "We want to plan measures to revitalize the Sakura Shopping Street." is a character string of the purpose of the project (the purpose of collecting ideas). "The Sakura Shopping Street is a shopping street lined with traditional individual stores. Although the product lineup of individual stores is inferior to that of large chains, it was bustling as a shopping street with a strong connection and warmth with local people. However, a large shopping mall was built in the neighborhood five years ago, so the flow of people has changed and the pedestrian traffic on the shopping street has decreased." is a character string of supplementary information regarding the purpose of the project (the purpose of collecting ideas). "What do you think is necessary to visit the Sakura Shopping Street more frequently?" is a character string of the first questionnaire. "The output should follow the following format. - {Answer example - 1} - {Answer example - 2}" is a string that specifies that the output format is in Markdown format. Also, this string specifies that there should be about two examples of ideas that the language model server should generate. If you want to more precisely indicate the number of examples of ideas, you may append an instruction such as "Please propose two answer examples." to the prompt. The creation support server 11 transmits the created third prompt to the language model server 12 equipped with the language model via the network 14 (step L 1 ). Note that an example of the third prompt when specifying that the output format is in JSON format is described in FIGS. 4-6B.
[0110] (2-6. Receiving from the language model server of the third response and transmitting to the user terminal) The language model server 12 that has received the third prompt via the network 14 transmits a third response 316 including examples of ideas for the first questionnaire according to the specified output format via the network 14. The creation support server 11 receives the third response 316 via the network 14 (step M 1 ). An example of the received third response is shown in FIG. 4-7. The information registration unit 322 of the creation support server 11 stores the third response 316 received from the language model server 12 in the storage unit 310. The information conversion unit 323 can convert the third response 316 into a predetermined format.
[0111] The creation support server 11 transmits the examples of ideas included in the third response 316 to the user terminal 13 via the network 14 (step N 1 ). As a result, the content corresponding to the third response 316 is displayed on the screen of the display of the user terminal 13. In FIG. 4-7, two answer examples (examples of ideas) for the idea collection questionnaire (the first questionnaire) edited by the user are displayed in an editable manner.
[0112] (2-7. Receiving from the user terminal of the newly created first questionnaire) The project manager may create a new first question on the user terminal 13. For example, when the "Add Question" button displayed on the screen of the user terminal 13 is pressed together with the title "Step 2: Create Questions for Idea Collection" (Fig. 4-8), a text box for entering a question appears on the screen, and the browser or native app can be configured so that the project manager can enter the first question in the text box. The project manager can create the idea collection question (the first question) by himself / herself by entering a new idea collection question in the text box displayed on the screen of the user terminal 13 (Fig. 4-9). When the creation of the idea collection question is completed and the project manager presses the "Generate Example Answer" button displayed below the text box on the screen of the user terminal 13, the idea collection question is sent from the user terminal 13 to the creation support server 11. The creation support server 11 receives the idea collection question from the user terminal 13 via the network 14 (Fig. 4-10A, Fig. 4-10B).
[0113] (2-8. Creation of the Third Prompt and Transmission to the Language Model Server) The information registration unit 322 of the creation support server 11 stores the idea collection question (the first question 313) received from the user terminal 13 in the storage unit 310. The third prompt creation unit 321C refers to the first question 313 stored in the storage unit 310 and creates a third prompt including a command for the language model server to generate an example answer (example of an idea) for the first question draft according to the specified output format (step K 1 ). The third prompt creation unit 321C may create the third prompt without referring to the purpose of the project, or may create the third prompt by referring to the purpose of the project.
[0114] Fig. 4-10A shows an example of the created third prompt. The character string "We are planning a questionnaire consisting of an idea collection session and an evaluation collection session. Please output an example answer to the questions in the idea collection session conducted for the following purpose." contains a fixed-form sentence requesting an example idea for the idea collection question (the first question) to the language model server 12. "We want to plan measures to revitalize the Sakura Shopping Street." is the character string of the purpose of the project (the purpose of collecting ideas). "The Sakura Shopping Street is a shopping street lined with traditional individual stores. Although the product lineup of individual stores is inferior to that of large chains, it was bustling as a shopping street with a strong connection and warmth with local people. However, a large shopping mall was built in the neighborhood five years ago, so the flow of people has changed and the pedestrian traffic on the shopping street has decreased." is the character string of supplementary information regarding the purpose of the project (the purpose of collecting ideas). "What value do you think the Sakura Shopping Street has for the region?" is the character string of the first question. "The output should follow the following format. - {Answer example - 1} - {Answer example - 2}" is a character string specifying that the output format is in Markdown format. Also, this character string specifies that there should be about two example ideas to be generated by the language model server. If you want to more precisely indicate the number of example ideas, you may add an instruction sentence such as "Please propose 3 example answers." to the prompt. The creation support server 11 transmits the created third prompt to the language model server 12 equipped with a language model via the network 14 (step L 1 ). Note that Fig. 4-10B shows an example of the third prompt when specifying that the output format is in JSON format.
[0115] (2-9. Receiving from the language model server of the third response and transmitting to the user terminal) The language model server 12 that has received the third prompt via the network 14 transmits a third response 316 including examples of ideas for the first questionnaire according to the specified output format via the network 14. The creation support server 11 receives the third response 316 via the network 14 (step M 1 ). Examples of the received third response are shown in FIGS. 4-11. The information registration unit 322 of the creation support server 11 stores the third response 316 received from the language model server 12 in the storage unit 310. The information conversion unit 323 can convert the third response 316 into a predetermined format.
[0116] The creation support server 11 transmits examples of ideas included in the third response 316 to the user terminal 13 via the network 14 (step N 1 ). As a result, the content corresponding to the third response 316 is displayed on the screen of the display of the user terminal 13. FIGS. 4-11 show two answer examples (idea examples) for the idea collection questionnaire (first questionnaire) created by the user in an editable manner.
[0117] (2-10. Instruction for generating an idea evaluation questionnaire from the user terminal and reception of the first questionnaire) When the project manager determines the idea collection questionnaire (first questionnaire) according to the above procedure, an instruction for generating an idea evaluation questionnaire can be given to the creation support server 11. The project manager presses the "Generate Idea Evaluation Questionnaire" button on the screen of the input form displayed as "Step 2: Create Idea Collection Questionnaire" (FIGS. 4-12A, 4-12B). Then, the idea collection questionnaire (first questionnaire) displayed on the screen of the input form is transmitted to the creation support server 11. The creation support server 11 receives the idea collection questionnaire (first questionnaire) from the user terminal 13 via the network 14 (step F 1 ).
[0118] (2-11. Generation of the second prompt and transmission to the language model server) The information registration unit 322 of the creation support server 11 stores the first question received from the user terminal 13 in the storage unit 310. The second prompt creation unit 321B refers to the purpose and supplementary information of the project stored in the storage unit 310 and the question for idea collection (the first question 313) determined by the user, and creates a second prompt including a command for the language model server 12 to generate a question sheet (the second question sheet) for evaluating the ideas for the first question according to the specified output format (step G 1 ).
[0119] FIG. 4-12A shows an example of the created second prompt. "We are planning a questionnaire consisting of an idea collection session and an evaluation collection session. Please output the questions for the evaluation collection session for the answers to the idea collection session conducted under the following purpose and questions." is a character string of a fixed-form sentence requesting a question sheet for evaluating ideas from the language model server 12. "We want to plan measures to revitalize Sakura Shopping Street." is a character string of the purpose of the project (the purpose of collecting ideas). "Sakura Shopping Street is a shopping street lined with traditional individual stores. Although the product lineup of individual stores is inferior to that of large chains, it was bustling as a warm and friendly shopping street with a strong connection with local people. However, a large shopping mall was built in the neighborhood 5 years ago, so the flow of people has changed and the foot traffic on the shopping street has decreased." is a character string of supplementary information regarding the purpose of the project (the purpose of collecting ideas). "- What is the main reason you visit Sakura Shopping Street? - What do you think is necessary to visit Sakura Shopping Street more frequently? - What value do you think Sakura Shopping Street has for the community?" is a character string of the question for idea collection (the first question). "The output should follow the following format. - What is the main reason you visit Sakura Shopping Street? - {Evaluation collection question 1-1} - {Evaluation collection question 1-2} - What do you think is necessary to visit the Cherry Blossom Shopping Street more frequently? - {Evaluation Collection Question 2-1} - {Evaluation Collection Question 2-2} - What value do you think the Cherry Blossom Shopping Street has for the region? - {Evaluation Collection Question 3-1} - {Evaluation Collection Question 3-2} is a string that specifies that the output format is in Markdown format. Also, the string specifies that the language model server should generate about two idea evaluation questionnaires for each first questionnaire. If you want to specify the number of questionnaires more precisely, you can append an instruction text such as "Please propose three questionnaires for each question for the evaluation collection." to the prompt. The creation support server 11 transmits the created second prompt to the language model server 12 equipped with a language model via the network 14 (step H 1 ). Note that an example of the second prompt when specifying that the output format is in JSON format is described in FIG. 4-12B.
[0120] (2-12. Reception from the language model server of the second response and transmission to the user terminal) The language model server 12 that has received the second prompt via the network 14 transmits a second response 314 including a second questionnaire according to the specified output format. The creation support server 11 receives the second response 314 via the network 14 (step I 1 ). An example of the received second response 314 is shown in FIG. 4-13. The information registration unit 322 of the creation support server 11 stores the second response 314 received from the language model server 12 in the storage unit 310. The information conversion unit 323 can convert the second response 314 into a predetermined format.
[0121] The creation support server 11 transmits the second questionnaire included in the second response 314 to the user terminal 13 via the network 14 (step J 1) As a result, on the screen of the display of the user terminal 13, the content corresponding to the second response 314 is displayed in an editable manner together with the title "Step 3: Creating Questions for Idea Evaluation". FIG. 4-13 shows a part of the questionnaire for idea evaluation (the second questionnaire) for the questionnaire for idea collection displayed on the screen of the display of the user terminal 13. On this screen, the first questionnaire corresponding to each second questionnaire, and an example answer (an example of an idea) for the first questionnaire can also be displayed together. The purpose of the project (the purpose of collecting ideas) and supplementary information regarding the purpose may be displayed.
[0122] (2-13. Receiving from the User Terminal the Second Questionnaire Determined by the User) The project manager can edit the received questionnaire for idea evaluation (the second questionnaire) on the user terminal 13 to determine the second questionnaire. As an editing method, there is a method in which the project manager edits by himself / herself within the text box displayed on the screen the questionnaire for idea evaluation corresponding to the second response 314 received from the creation support server 11 (FIG. 4-14). As an editing method, there is also a method of creating a new questionnaire by oneself. For example, when the "Add Question" button displayed on the screen of the user terminal 13 is pressed together with the title "Step 3: Creating Questions for Idea Evaluation", a text box for entering a question appears on the screen, and the browser or native app can be configured so that the project manager can enter the second question in the text box. If the user desires, the browser or native app may be configured so that any second questionnaire displayed on the screen can be deleted by pressing the "Delete Question" button displayed on the screen of the user terminal 13.
[0123] Also, the browser or native app can be configured so that the number of levels for evaluating ideas can be set. In the example screen shown in FIG. 4-14, the user can select the range of evaluation values (the minimum value and the maximum value) from a pull-down menu.
[0124] When the editing of the questions for idea evaluation is completed and the project manager presses the "Settings" button displayed at the bottom of the screen of the user terminal 13, the determined questions for idea evaluation are sent from the user terminal 13 to the creation support server 11 (Fig. 4-15). The creation support server 11 receives the questions for idea evaluation from the user terminal 13 via the network 14. The information registration unit 322 of the creation support server 11 stores the questions for idea evaluation (the second questions 315) received from the user terminal 13 in the storage unit 310.
[0125] (2-14. Reception from the User Terminal for Question Confirmation) Through the above procedure, the questions for collecting ideas (questions for idea collection) and the questions for evaluating ideas (questions for idea evaluation) are each determined, but the browser or native app may be configured to display a screen for final confirmation. For example, as shown in Fig. 4-16, the browser or native app may be configured so that the project manager can confirm all the questions for idea collection and the questions for idea evaluation on the screen displayed as "Step 4: Confirmation of Questions for Idea Collection and Idea Evaluation". When the project manager presses the "Complete" button on the screen, information indicating that the questions are confirmed is sent from the user terminal 13 to the creation support server 11. The creation support server 11 that has received the information indicating that the questions are confirmed can store information about the progress of the question creation process in a predetermined status file. If a correction point is discovered, the browser or native app may be configured so that the project manager can edit the questions again by pressing the "Back" button.
[0126] <3. Procedure for Question Creation (When the Creation Support Server 11 Outputs the Question Proposals for Collecting Ideas and the Question Proposals for Evaluating Ideas in a Batch)> Next, an example of a screen displayed on the display of the user terminal 13 will be exemplarily described with reference to the procedure for collectively creating questions for collecting ideas by the above-described system (hereinafter also referred to as "questions for idea collection") and questions for evaluating ideas (hereinafter also referred to as "questions for idea evaluation").
[0127] (3-1. Instruction for generating questions for idea collection from the user terminal and reception of the purpose of collecting ideas, etc.) FIG. 5-1 shows an example of a screen of an input form displayed on the display of the user terminal 13 when a project manager (user) accesses the server 11 by inputting a predetermined URL from the user terminal 13. The screen of the input form can be configured with a browser or a native app so as to be displayed after a predetermined authentication procedure such as ID and PW verification. On the screen of the input form displayed as "Step 1: Input to AI", the project manager inputs the purpose of the project (corresponding to the purpose of collecting ideas) which is mandatory for input and supplementary information (corresponding to supplementary information regarding the purpose of collecting ideas) which is optional for input (FIG. 5-2). Next, the project manager presses the button "Generate questions for idea collection and answer examples" on the screen of the input form. Then, the input content is transmitted from the user terminal 13 to the creation support server 11. The creation support server 11 receives the purpose of the project and the supplementary information from the user terminal 13 via the network 14 (step A 2 ).
[0128] (3-2. Generation of the first prompt and transmission to the language model server) The information registration unit 322 of the creation support server 11 stores the purpose and supplementary information of the project received from the user terminal 13 in the storage unit 310. The first prompt creation unit 321A refers to the purpose and supplementary information of the project stored in the storage unit 310, and creates a first prompt including a command for the language model server 12 to generate a questionnaire (first questionnaire) for collecting ideas according to the purpose, and a questionnaire (second questionnaire) for evaluating the ideas for the first questionnaire according to the specified output format (step B 2 ).
[0129] FIG. 5-3A shows an example of the created first prompt. "Planning a questionnaire consisting of an idea collection session and an evaluation collection session. Please output the questions for the evaluation collection session for the answers to the idea collection session conducted under the following purpose and questions." is a character string including a fixed phrase requesting a questionnaire for collecting ideas from the language model server 12 and requesting a questionnaire for evaluating the answers (ideas) for the questionnaire. "Want to plan measures to revitalize Sakura Shopping Street." is a character string for the purpose of collecting ideas. "Sakura Shopping Street is a shopping street lined with traditional individual stores. Although the product lineup of individual stores is inferior to that of large chains, it was bustling as a warm shopping street with a strong connection with local people. However, a large shopping mall was built in the neighborhood 5 years ago, so the flow of people has changed and the pedestrian traffic on the shopping street has decreased." is a character string of supplementary information regarding the purpose of collecting ideas. "Please output according to the following format. - {Idea collection question 1} - {Evaluation collection question 1-1} - {Evaluation collection question 1-2} - {Idea collection question 2} - {Evaluation collection question 2-1} - {Evaluation collection question 2-2} - {Idea collection question 3} - {Evaluation collection question 3-1} - {Evaluation collection question 3-2}" is a string that specifies that the output format is in Markdown format. Also, this string specifies that the idea collection questionnaire to be generated by the language model server should be about three, and the idea evaluation questionnaire to be generated by the language model server should be about two for each of the first questionnaires. If you want to more precisely indicate the number of idea collection questionnaires and idea evaluation questionnaires, you may append an instruction text such as "Please propose 3 idea collection questionnaires. Please propose 4 evaluation collection questionnaires for each idea collection questionnaire." to the prompt. The creation support server 11 transmits the created first prompt to the language model server 12 equipped with a language model via the network 14 (step C 2 ) In addition, an example of the first prompt when specifying that the output format is in JSON format is described in FIG. 5-3B.
[0130] (3-3. Receiving from the language model server of the first response and transmitting to the user terminal) The language model server 12 that has received the first prompt via the network 14 transmits a first response 312 including the at least one first questionnaire according to the specified output format and at least one second questionnaire for evaluating ideas for the first questionnaire. The creation support server 11 receives the first response 312 via the network 14 (step D 2 ) An example of the received first response is shown in FIG. 5-4. The information registration unit 322 of the creation support server 11 stores the first response 312 received from the language model server 12 in the storage unit 310. The information conversion unit 323 can convert the first response 312 into a predetermined format.
[0131] The creation support server 11 transmits the at least one first questionnaire and the at least one second questionnaire included in the first response 312 to the user terminal 13 via the network 14 (step E 2) As a result, on the screen of the display of the user terminal 13, the content corresponding to the first response 312 is displayed together with the title "Step 2: Questionnaire Creation for Idea Collection and Idea Evaluation". In FIG. 5-4, the questionnaire for idea collection (the first questionnaire) and the questionnaire for idea evaluation (the second questionnaire) are displayed in an editable manner.
[0132] (3-4. Reception from the User Terminal of the First Questionnaire Determined by the User) The project manager can edit the received questionnaire for idea collection (the first questionnaire) and / or the questionnaire for idea evaluation (the second questionnaire) on the user terminal 13 and determine the first questionnaire and / or the questionnaire for idea evaluation (the second questionnaire). As an editing method, there is a method in which the project manager edits by himself / herself in the text box displayed on the screen the questionnaire for idea collection and / or the questionnaire for idea evaluation (the second questionnaire) corresponding to the first response 312 received from the creation support server 11 (FIG. 5-4). If the user desires, the browser or the native app may be configured so that any first questionnaire displayed on the screen can be deleted by pressing the "Delete Questionnaire" button displayed on the screen of the user terminal 13.
[0133] Also, the browser or the native app can be configured so that the number of levels for evaluating ideas can be set. In the screen example shown in FIG. 5-4, the user can select the range of evaluation values (the minimum value and the maximum value) from the pull-down menu.
[0134] When the editing of the questions for idea collection is completed and the project manager presses the "Generate Example Answer" button displayed below the text box on the screen of the user terminal 13, the selected question for idea collection (the first question) is transmitted from the user terminal 13 to the creation support server 11. The creation support server 11 receives the selected question for idea collection from the user terminal 13 via the network 14, and receives an example answer (an example of an idea) for the question for idea collection (the first question) from the language model server 12 in the same procedure as before, and can transmit it to the user terminal 13.
[0135] When the editing of the questions for idea collection and / or the draft questions for idea evaluation is completed and the project manager presses the "Settings" button displayed at the lower part of the screen of the user terminal 13, the determined questions for idea collection and the questions for idea evaluation are transmitted from the user terminal 13 to the creation support server 11. The creation support server 11 receives the questions for idea collection and the questions for idea evaluation from the user terminal 13 via the network 14 (Fig. 5-5).
[0136] When the project manager presses the "Reset and Regenerate" button displayed on the screen, the creation support server 11 performs steps F 1 ~J 1 described in "B. Embodiment of the Creation Support Server for Outputting a Draft Questionnaire for Evaluating Ideas". As a result, the questions for idea evaluation are output again on the screen of the user terminal 13. This is because even if the instruction content is the same, the second response 314 obtained may be different when the creation support server 11 is instructed again to output a draft questionnaire for evaluating ideas.
[0137] (3-5. Reception from the User Terminal for Finalizing the Questions) Through the above procedure, questions for collecting ideas (questions for idea collection) and questions for evaluating ideas (questions for idea evaluation) are determined respectively, but the browser or native app may be configured so that a screen for final confirmation is displayed. For example, as shown in FIGS. 5-6, the browser or native app may be configured so that the project manager can check the questions for idea collection and the questions for idea evaluation on the screen displayed as "Step 3: Confirmation of Questions for Idea Collection and Idea Evaluation". When the project manager presses the "Complete" button on the screen, information indicating that the questions have been finalized is sent from the user terminal 13 to the creation support server 11. The creation support server that has received the information indicating that the questions have been finalized can store information about the progress of the question creation process in a predetermined status file. If a correction is found, the browser or native app may be configured so that the project manager can edit the questions again by pressing the "Back" button.
Explanation of Signs
[0138] 11: Creation support server 12: Language model server 13: User terminal 14: Computer network 200: Computer 201: Arithmetic unit 202: Storage device 203: Output device 204: Input device 205: Communication device 310: Storage unit 311: Information including the purpose of collecting ideas 312: First response 313: First question 314: Second response 315: Second question 316: Third response 320: Control unit 321A: First prompt creation unit 321B: Second prompt creation unit 321C: Third Prompt Creation Unit 321C: Third Prompt Creation Unit 322: Information Registration Unit 323: Information Conversion Unit 330: Transmission / Reception Unit 340: Memory Unit
Claims
1. A method for assisting in creating questions for collecting ideas, comprising: Step A in which a creation support server receives information including the purpose of collecting ideas from a user terminal via a network 1 and Step B of creating a first prompt that includes a command for a language model to generate at least one first questionnaire for collecting ideas according to a specified output format, with reference to information including the purpose of collecting the ideas received from the user terminal 1 and Step C in which the creation support server transmits a first prompt to a language model server equipped with a language model via a network 1 and Step D in which the creation support server receives, via a network, from the language model server a first response including the at least one first questionnaire according to a specified output format 1 and Step E in which the creation support server transmits the at least one first questionnaire included in the first response received from the language model server to the user terminal via the network 1 and A method including the above.
2. A method for assisting in creating questions for evaluating ideas, comprising: Step F in which a creation support server receives, via a network, information including an object of collecting ideas and at least one first question for collecting ideas from a user terminal 1 and Step G of creating a second prompt that includes a command for a language model to generate, according to a specified output format, at least one second questionnaire for evaluating ideas for the first questionnaire, with reference to information including the purpose of collecting the ideas received from the user terminal by the creation support server and the at least one first questionnaire 1 and Step H in which the creation support server transmits a second prompt to a language model server equipped with a language model via a network 1 and Step I in which the creation support server receives, via a network, from the language model server a second response including the at least one second questionnaire according to a specified output format 1 and Step J in which the creation support server transmits the at least one second question included in the second response received from the language model server to the user terminal via a network 1 and A method including the above.
3. A method for assisting in creating questions for collecting ideas and questions for evaluating ideas, comprising: Step A in which a creation support server receives information including the purpose of collecting ideas from a user terminal via a network 1 and Step B of creating a first prompt that includes a command for a language model to generate at least one first questionnaire for collecting ideas according to the purpose, with reference to information including the purpose of collecting the ideas received from the user terminal 1 and Step C in which the creation support server transmits a first prompt to a language model server equipped with a language model via a network 1 and Step D in which the creation support server receives, via a network, from the language model server a first response including the at least one first questionnaire according to a specified output format 1 and Step G in which the creation support server refers to the information including the purpose of collecting the ideas and the at least one first questionnaire, and creates a second prompt including a command for the language model to generate at least one second questionnaire for evaluating the ideas for the first questionnaire according to the specified output format 1 and Step H in which the creation support server transmits a second prompt to a language model server equipped with a language model via a network 1 and Step I in which the creation support server receives, via a network, from the language model server a second response including the at least one second questionnaire according to a specified output format 1 and Step J in which the creation support server transmits the at least one first questionnaire included in the first response received from the language model server and the at least one second questionnaire included in the second response to the user terminal via a network 1 and A method including the above.
4. A method for assisting in creating questions for collecting ideas and questions for evaluating ideas, comprising: Step A in which a creation support server receives information including the purpose of collecting ideas from a user terminal via a network 1 and Step B of creating a first prompt that includes a command for a language model to generate at least one first questionnaire for collecting ideas according to a specified output format by referring to information including the purpose of collecting the ideas received from the user terminal 1 and Step C in which the creation support server transmits a first prompt to a language model server equipped with a language model via a network 1 and Step D in which the creation support server receives, via a network, from the language model server a first response including the at least one first questionnaire according to a specified output format 1 and Step E in which the creation support server transmits the at least one first questionnaire included in the first response received from the language model server to the user terminal via a network 1 and Step F in which a creation support server receives, via a network, at least one first question for collecting ideas determined by a user from a user terminal 1 and Step G of creating a second prompt in which the creation support server refers to information including the purpose of collecting the idea and the at least one first question determined by the user, and includes a command for the language model to generate at least one second questionnaire for evaluating the idea for the first question according to the specified output format 1 and Step H in which the creation support server transmits a second prompt to a language model server equipped with a language model via a network 1 and Step I in which the creation support server receives, via a network, from the language model server a second response including the at least one second questionnaire according to a specified output format 1 and Step J in which the creation support server transmits the at least one second questionnaire included in the second response received from the language model server to the user terminal via the network 1 and A method including the above.
5. Step A 1 wherein the information received by the creation support server in [Step A] includes supplementary information regarding the purpose of collecting ideas, and the creation support server proceeds to Step B 1 The method according to claim 1, 3, or 4, wherein in [Step B], the creation support server also refers to the supplementary information and creates a first prompt.
6. Step A 1 wherein the information received by the creation support server includes supplementary information regarding the purpose of collecting ideas, and the creation support server refers to the supplementary information also in 1 Step G to create a second prompt, the method according to any one of claims 2 to 4.
7. Step E 1 The at least one first questionnaire sent to the user terminal in 1 is displayed on the screen of the user terminal in a manner editable by the user, according to the method of claim 1, 3 or 4.
8. Step J 1 The at least one second questionnaire sent to the user terminal in [Step J] is displayed on the screen of the user terminal in an editable manner, according to any one of claims 2 to 4 of the method.
9. The method according to claim 1, 3 or 4, wherein the first prompt includes specifying the number of first question drafts to be generated by the language model.
10. The method according to any one of claims 2 to 4, wherein the second prompt includes specifying the number of second question drafts to be generated by the language model.
11. The first prompt further includes a command for the language model to generate, according to a specified output format, examples of at least one idea for at least one of the at least one first question draft. Step D 1 The method according to claim 1, 3 or 4, wherein the first response received by the creation support server in 1 further includes at least one example of an idea for the at least one first questionnaire item.
12. The second prompt further includes a command for the language model to generate, according to a specified output format, examples of at least one idea for at least one of the at least one first question draft. Step I 1 The method according to any one of claims 2 to 4, wherein the second response received by the creation support server in further includes examples of at least one idea for the at least one first question.
13. Step K in which the creation support server creates a third prompt that refers to the at least one first questionnaire without referring to the purpose of collecting the ideas and includes a command for the language model to generate, according to a specified output format, an example of at least one idea for the first questionnaire 1 and Step L in which the creation support server transmits a third prompt to a language model server equipped with a language model via a network 1 and Step M in which the creation support server receives, via a network, from the language model server a third response including an example of the at least one idea according to the specified output format 1 and Step N in which the creation support server transmits, via a network, an example of the at least one idea included in the third response received from the language model server to the user terminal 1 and The method according to claim 1, 3 or 4, including the above.
14. Step K in which the creation support server refers to the purpose of collecting the idea and the at least one first questionnaire, and creates a third prompt including a command for the language model to generate at least one example of an idea for the first questionnaire according to the specified output format 1 and Step L in which the creation support server transmits a third prompt to a language model server equipped with a language model via a network 1 and Step M in which the creation support server receives, via a network, from the language model server a third response including an example of the at least one idea according to the specified output format 1 and Step N in which the creation support server transmits, via a network, an example of the at least one idea included in the third response received from the language model server to the user terminal 1 and The method according to claim 1, 3 or 4, including the above.
15. Step K in which the creation support server creates a third prompt that refers to the at least one first question and includes a command for the language model to generate, according to a specified output format, an example of at least one idea without referring to the purpose of collecting the ideas 1 and Step L in which the creation support server transmits a third prompt to a language model server equipped with a language model via a network 1 and Step M in which the creation support server receives, via a network, from the language model server a third response including an example of the at least one idea according to the specified output format 1 and Step N in which the creation support server transmits, via a network, an example of the at least one idea included in the third response received from the language model server to the user terminal 1 and The method according to claim 2 or 4, including the above.
16. Step K in which the creation support server refers to the purpose of collecting the idea and the at least one first question, and creates a third prompt including a command for the language model to generate an example of at least one idea for the first question according to a specified output format 1 and Step L in which the creation support server transmits a third prompt to a language model server equipped with a language model via a network 1 and Step M in which the creation support server receives, via a network, from the language model server a third response including an example of the at least one idea according to a specified output format 1 and Step N in which the creation support server transmits, via a network, an example of the at least one idea included in the third response received from the language model server to the user terminal 1 and The method according to claim 2 or 4, including the above.
17. A method for assisting in creating questions for collecting ideas and questions for evaluating ideas, comprising: Step A in which a creation support server receives information including the purpose of collecting ideas from a user terminal via a network 2 and Step B of creating a first prompt that includes a command for a language model to generate, according to a specified output format, at least one first questionnaire for collecting ideas corresponding to a purpose, and at least one second questionnaire for evaluating ideas for the first questionnaire, by referring to information including the purpose of collecting the ideas received from the user terminal 2 and Step C in which the creation support server transmits a first prompt to a language model server equipped with a language model via a network 2 and Step D in which the creation support server receives, via a network, from the language model server a first response including the at least one first questionnaire according to the specified output format and at least one second questionnaire for evaluating ideas for the first questionnaire 2 and Step E in which the creation support server transmits the at least one first questionnaire and the at least one second questionnaire included in the first response received from the language model server to the user terminal via a network 2 and A method including the above.
18. Step A 2 wherein the information received by the creation support server includes supplementary information regarding the purpose of collecting ideas, and the creation support server proceeds to Step B 2 The method according to claim 17, wherein the creation support server also refers to the supplementary information in Step B to create a first prompt.
19. Step E 2 The method according to claim 17, wherein the at least one first questionnaire and the at least one second questionnaire transmitted to the user terminal in step E are displayed on the screen of the user terminal in a mode editable by the user.
20. The method according to claim 17, wherein the first prompt includes specifying the number of first question drafts to be generated by the language model.
21. The first prompt further includes a command for the language model to generate, according to a specified output format, examples of at least one idea for at least one of the at least one first question draft. Step D 2 The method according to claim 17, wherein the first response received by the creation support server in 2 further includes at least one example of an idea for the at least one first questionnaire item.
22. Step F in which the creation support server receives, via a network, from a user terminal at least one first question for collecting ideas determined by a user 2 and Step G in which the creation support server creates a third prompt that refers to the at least one first question determined by the user without referring to the purpose of collecting the idea, and includes a command for the language model to generate, according to a specified output format, an example of at least one idea for the first question 2 and Step H in which the creation support server transmits a third prompt to a language model server equipped with a language model via a network 2 and Step I where the creation support server receives, via a network, from the language model server a third response including an example of the at least one idea according to a specified output format 2 and Step J in which the creation support server transmits, via a network, an example of the at least one idea included in the third response received from the language model server to the user terminal 2 and The method according to claim 17, including the above.
23. Step F in which a creation support server receives, via a network, at least one first question for collecting ideas determined by a user from a user terminal 2 and Step G in which the creation support server refers to the purpose of collecting the idea and the at least one first question determined by the user, and creates a third prompt including a command for the language model to generate an example of at least one idea for the first question according to the specified output format 2 and Step H in which the creation support server transmits a third prompt to a language model server equipped with a language model via a network 2 and Step I where the creation support server receives, via a network from the language model server, a third response including an example of the at least one idea according to the specified output format 2 and Step J in which the creation support server transmits, via a network, an example of the at least one idea included in the third response received from the language model server to the user terminal 2 and The method according to claim 17, including the above.
24. Comprising a storage unit, a control unit, and a transmission / reception unit, The control unit has a first prompt creation unit and an information registration unit, The transmitting / receiving unit performs step A of receiving information including information for the purpose of collecting ideas from the user terminal via the network. 1 It can perform The information registration unit can store in the storage unit information including the purpose of collecting the ideas received from the user terminal. The first prompt creation unit refers to information including the purpose of collecting the ideas stored in the storage unit, and creates a first prompt including a command for a language model to generate at least one first questionnaire for collecting ideas according to the purpose according to the specified output format (step B). 1 can perform The transmission / reception unit performs step C of transmitting a first prompt to a language model server equipped with a language model via a network. 1 This can be done. Step D in which the transmission / reception unit receives, via a network, from the language model server, a first response including the at least one first questionnaire according to a specified output format 1 can be performed The information registration unit can store the first response received from the language model server in the storage unit. Step E in which the transmission / reception unit transmits the at least one first questionnaire included in the first response to the user terminal via the network 1 can be performed A question creation support server for collecting ideas.
25. Comprising a storage unit, a control unit, and a transmission / reception unit. The control unit has a second prompt creation unit and an information registration unit. The transmitting / receiving unit performs step F of receiving, from the user terminal via the network, information including the purpose of collecting ideas and at least one first question determined by the user for collecting ideas. 1 and can perform The information registration unit can store in the storage unit the information including the purpose of collecting the ideas received from the user terminal and at least one first question for collecting the ideas. The second prompt creation unit refers to the information including the purpose of collecting the ideas stored in the storage unit and the at least one first question, and creates a second prompt including a command for the language model to generate at least one second questionnaire for evaluating the ideas for the first question according to the specified output format in step G 1 which can be performed The transmission / reception unit can perform step H of transmitting the second prompt to a language model server equipped with a language model via a network. 1 and Step I in which the transmission / reception unit receives, via a network, from the language model server a second response including the at least one second questionnaire according to a specified output format 1 can be performed The information registration unit can store the second response received from the language model server in the storage unit. Step J in which the transmission / reception unit transmits the at least one second questionnaire included in the second response to the user terminal via a network 1 can be performed A question creation support server for evaluating ideas.
26. Comprising a storage unit, a control unit, and a transmission / reception unit. The control unit has a first prompt creation unit, a second prompt creation unit, and an information registration unit. The transmitting / receiving unit performs step A of receiving information including information for the purpose of collecting ideas from the user terminal via the network. 1 and can perform The information registration unit can store in the storage unit the information including the purpose of collecting the ideas received from the user terminal. The first prompt creation unit refers to information including the purpose of collecting the ideas stored in the storage unit, and creates a first prompt including a command for the language model to generate at least one first questionnaire for collecting ideas according to the purpose, in accordance with the specified output format. Step B 1 can be performed, The transmitting and receiving unit performs step C of transmitting a first prompt to a language model server equipped with a language model via a network. 1 This can be done. Step D in which the transmission / reception unit receives, via a network, from the language model server, a first response including the at least one first questionnaire according to a specified output format 1 can be performed The information registration unit can store the first response received from the language model server in the storage unit. The second prompt creation unit refers to the information including the purpose of collecting the ideas stored in the storage unit and the first response including the at least one first questionnaire, and creates a second prompt including a command for the language model to generate at least one second questionnaire for evaluating the ideas for the first questionnaire according to the specified output format (step G). 1 which can be performed The transmitting / receiving unit can perform step H of transmitting a second prompt to a language model server equipped with a language model via a network. 1 and can Step I in which the transmission / reception unit receives, via a network, from the language model server, a second response including the at least one second questionnaire according to a specified output format 1 can be performed The information registration unit can store the second response received from the language model server in the storage unit. Step J in which the transmission / reception unit transmits, via a network, the at least one first questionnaire included in the first response and the at least one second questionnaire included in the second response to the user terminal 1 which can be performed A question creation support server for collecting questions for collecting ideas and questions for evaluating ideas.
27. Comprising a storage unit, a control unit, and a transmission / reception unit. The control unit has a first prompt creation unit, a second prompt creation unit, and an information registration unit. The transmitting / receiving unit performs step A of receiving information including the purpose of collecting ideas from the user terminal via the network. 1 This can be done. The information registration unit can store in the storage unit the information including the purpose of collecting the ideas received from the user terminal. The first prompt creation unit refers to information including the purpose of collecting the ideas stored in the storage unit, and creates a first prompt including a command for the language model to generate at least one first questionnaire for collecting ideas according to the purpose, in accordance with the specified output format. Step B 1 can be performed, The transmitting / receiving unit performs step C of transmitting a first prompt to a language model server equipped with a language model via a network. 1 This can be done. Step D in which the transmission / reception unit receives, via a network, from the language model server, a first response including the at least one first questionnaire according to a specified output format 1 can be performed The information registration unit can store the first response received from the language model server in the storage unit. Step E in which the transmission / reception unit transmits, via a network, the at least one first questionnaire included in the first response to the user terminal 1 can be performed Step F in which the transmission / reception unit receives, via a network, at least one first question for collecting an idea determined by a user from a user terminal 1 can be performed The information registration unit can store in the storage unit the at least one first question determined by the user. The second prompt creation unit refers to the information including the purpose of collecting the ideas stored in the storage unit and the at least one first question determined by the user, and creates a second prompt including a command for the language model to generate at least one second questionnaire for evaluating the ideas for the first question according to the specified output format in step G 1 which can be performed The transmitting / receiving unit can perform step H of transmitting a second prompt to a language model server equipped with a language model via a network. 1 and Step I in which the transmission / reception unit receives, via a network, from the language model server a second response including the at least one second questionnaire according to a specified output format 1 can be performed The information registration unit can store the second response received from the language model server in the storage unit. Step J in which the transmission / reception unit transmits the at least one second questionnaire included in the second response to the user terminal via a network 1 which can be performed A question creation support server for collecting questions for collecting ideas and questions for evaluating ideas.
28. Step A 1 wherein the information received by the creation support server includes supplementary information regarding the purpose of collecting ideas, and the first prompt creation unit refers to the supplementary information also in 1 Step B to create a first prompt, the creation support server according to claim 24, 26 or 27.
29. Step A 1 wherein the information received by the creation support server includes supplementary information regarding the purpose of collecting ideas, and the second prompt creation unit refers to the supplementary information also in 1 Step G to create a second prompt, the creation support server according to any one of claims 25 to 27.
30. The transmission / reception unit is step E 1 The creation support server according to claim 24, 26, or 27, which transmits the at least one first questionnaire to the user terminal so as to be displayed on the screen of the user terminal in a manner editable by the user in step E
31. The transmission / reception unit is step J 1 The creation support server according to any one of claims 25 to 27, which transmits the at least one second questionnaire to the user terminal so as to be displayed on the screen of the user terminal in a mode editable by the user in
32. The first prompt includes specifying the number of first question drafts to be generated by the language model. The creation support server according to claim 24, 26, or 27.
33. The second prompt includes specifying the number of second question drafts to be generated by the language model. The creation support server according to any one of claims 25 to 27.
34. The first prompt further includes a command for the language model to generate, according to a specified output format, examples of at least one idea for the at least one first questionnaire item. Step D 1 The creation support server according to claim 24, 26 or 27, wherein the first response received by the transmission / reception unit in 1 further includes at least one example of an idea for the at least one first questionnaire item.
35. The second prompt further includes a command for the language model to generate, according to a specified output format, examples of at least one idea for the at least one first question. Step I 1 The creation support server according to claim 25, wherein the second response received by the transmission / reception unit in 1 further includes an example of at least one idea for at least one of the at least one first question.
36. The control unit has a third prompt creation unit. The third prompt creation unit creates a third prompt that refers to the at least one first questionnaire stored in the storage unit and includes a command for the language model to generate, according to a specified output format, an example of at least one idea for the first questionnaire, without referring to the purpose of collecting the ideas stored in the storage unit (step K). 1 can be performed The transmission / reception unit performs step L of transmitting a third prompt to a language model server equipped with a language model via a network. 1 This can be done. The transmitting / receiving unit receives, via a network, from the language model server, a third response including an example of the at least one idea according to a specified output format (step M). 1 This can be performed The information registration unit can store the third response received from the language model server in the storage unit. Step N in which the transmission / reception unit transmits, via a network, an example of the at least one idea included in the third response to the user terminal 1 can be performed The creation support server according to claim 24 or 26.
37. The control unit has a third prompt creation unit. The third prompt creation unit refers to the purpose of collecting the ideas stored in the storage unit and the at least one first questionnaire, and creates a third prompt including a command for the language model to generate an example of at least one idea for the first questionnaire according to the specified output format in step K 1 which can be performed The transmission / reception unit performs step L of transmitting a third prompt to a language model server equipped with a language model via a network. 1 This can be done. Step M in which the transmission / reception unit receives, via a network, from the language model server a third response including an example of the at least one idea according to a specified output format 1 can be performed The information registration unit can store the third response received from the language model server in the storage unit. Step N in which the transmission / reception unit transmits, via a network, an example of the at least one idea included in the third response to the user terminal 1 can be performed The creation support server according to claim 24 or 26.
38. The control unit has a third prompt creation unit. The third prompt creation unit creates a third prompt that refers to the at least one first question determined by the user stored in the storage unit, without referring to the purpose of collecting the ideas stored in the storage unit, and includes a command for the language model to generate examples of at least one idea for the first question according to the specified output format (step K). 1 can perform The transmitting / receiving unit can perform step L of transmitting a third prompt to a language model server equipped with a language model via a network. 1 and Step M in which the transmission / reception unit receives, via a network, from the language model server, a third response including an example of the at least one idea according to the specified output format 1 can be performed The information registration unit can store the third response received from the language model server in the storage unit. Step N in which the transmission / reception unit transmits, via a network, an example of the at least one idea included in the third response to the user terminal 1 which can perform The creation support server according to claim 25 or 27, including...
39. The control unit has a third prompt creation unit. The third prompt creation unit refers to the purpose of collecting the ideas stored in the storage unit and the at least one first question determined by the user stored in the storage unit, and creates a third prompt including a command for the language model to generate an example of at least one idea for the first question according to the specified output format. Step K 1 can be performed, The transmitting / receiving unit performs step L of transmitting a third prompt to a language model server equipped with a language model via a network. 1 This can be done. Step M in which the transmitting / receiving unit receives, via a network, from the language model server a third response including an example of the at least one idea according to a specified output format 1 can be performed The information registration unit can store the third response received from the language model server in the storage unit. Step N in which the transmission / reception unit transmits, via a network, an example of the at least one idea included in the third response to the user terminal 1 can be performed The creation support server according to claim 25 or 27, including...
40. Comprising a storage unit, a control unit, and a transceiver unit. The control unit has a first prompt creation unit and an information registration unit. The transmitting / receiving unit performs step A of receiving information including the purpose of collecting ideas from the user terminal via the network. 2 This can be done. The information registration unit can store in the storage unit information including the purpose of collecting the ideas received from the user terminal. The first prompt creation unit refers to information including the purpose of collecting the ideas stored in the storage unit, creates a first prompt including at least one first questionnaire for collecting ideas corresponding to the purpose, and a command for the language model to generate at least one second questionnaire for evaluating the ideas for the first questionnaire according to the specified output format, step B 2 can be performed The transmitting / receiving unit performs step C of transmitting a first prompt to a language model server equipped with a language model via a network. 2 This can be done. Step D in which the transmission / reception unit receives, via a network, from a language model server, a first response including the at least one first questionnaire according to a specified output format and at least one second questionnaire for evaluating ideas for the first questionnaire 2 can be performed The information registration unit can store the first response received from the language model server in the storage unit. The transmitting and receiving unit performs step E of transmitting, via a network, the at least one first questionnaire and the at least one second questionnaire included in the first response to the user terminal. 2 which can be performed A creation support server for creating questions for collecting ideas and questions for evaluating ideas.
41. Step A 2 In which the information received by the creation support server includes supplementary information regarding the purpose of collecting ideas, and the first prompt creation unit proceeds to Step B 2 The creation support server according to claim 40, wherein the first prompt creation unit also refers to the supplementary information in Step B and creates a first prompt.
42. The transmission / reception unit is step E 2 The creation support server according to claim 40, which transmits the at least one first questionnaire and the at least one second questionnaire to the user terminal so as to be displayed on the screen of the user terminal in a mode editable by the user in
43. The method according to claim 40, wherein the first prompt includes a specification of the number of first questionnaire items to be generated by the language model.
44. The first prompt further includes a command for the language model to generate, according to a specified output format, examples of at least one idea for the at least one first questionnaire item. Step D 2 The method according to claim 40, wherein the first response received by the transceiver in 2 further includes at least one example of an idea for at least one of the at least one first questionnaire.
45. The control unit has a third prompt creation unit. Step F in which the transmission / reception unit receives, via a network, from a user terminal at least one first question for collecting an idea determined by a user 2 can be performed The information registration unit can store in the storage unit the at least one first question determined by the user. The third prompt creation unit creates a third prompt that includes a command for the language model to generate, according to a specified output format, examples of at least one idea for the at least one first question determined by the user and stored in the storage unit, without referring to the purpose of collecting the ideas stored in the storage unit. Step G 2 can be performed, The transmitting / receiving unit performs step H of transmitting a third prompt to a language model server equipped with a language model via a network. 2 This can be done. Step I in which the transmitting / receiving unit receives, via a network, from the language model server a third response including an example of the at least one idea according to a specified output format 2 can be performed The information registration unit can store the third response received from the language model server in the storage unit. Step J in which the transmission / reception unit transmits, via a network, an example of the at least one idea included in the third response to the user terminal 2 can be performed The creation support server according to claim 40.
46. The control unit has a third prompt creation unit, Step F in which the transmission / reception unit receives, via a network, from a user terminal at least one first question for collecting an idea determined by a user 2 can be performed The information registration unit can store the at least one first question determined by the user in the storage unit, The third prompt creation unit refers to the purpose of collecting the ideas stored in the storage unit and the at least one first question determined by the user stored in the storage unit, and creates a third prompt including a command for the language model to generate an example of at least one idea for the first question according to the specified output format. Step G 2 can be performed, The transmitting / receiving unit can perform step H of transmitting a third prompt to a language model server equipped with a language model via a network. 2 and Step I where the transmission / reception unit receives, via a network, from the language model server a third response including an example of the at least one idea according to a specified output format 2 can be performed The information registration unit can store the third response received from the language model server in the storage unit, Step J in which the transmission / reception unit transmits an example of the at least one idea included in the third response to the user terminal via the network 2 can be performed The creation support server according to claim 40.
47. A program for causing a computer to execute the method according to any one of claims 1 to 4 and 17.
48. A computer-readable recording medium on which the program according to claim 47 is recorded.
Citation Information
Patent Citations
Text generation device and text generation method
JP7325152B1
Online test method and online test server for evaluating creativity for ideas
WO2017145765A1
Problem collection / evaluation method, proposed solution collection / evaluation method, server for problem collection / evaluation, server for proposed solution collection / evaluation, and server for collection / evaluation of problem and proposed solution thereto
WO2020153383A1