Information processing apparatus and program

Abstract

To provide a technique to create questions with assistance allowing an answerer to compare the score with that of another answerer.SOLUTION: An information processing apparatus according to an aspect of the present disclosure comprises: a question creation unit that creates a plurality of gradual question sets with assistance in which a plurality of gradual descriptions for assisting an answerer to give answers are added to an original question set constituting a test that was carried out in the past; and a point allotment determination unit that determines allotment of points to the plurality of questions with assistance constituting each of the plurality of gradual question sets with assistance, according to the plurality of gradual descriptions.SELECTED DRAWING: Figure 10

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device and a program. [Background technology]

[0002] Conventionally, techniques have been proposed that devise question selection and answering methods to maintain the learner's motivation to learn.

[0003] For example, Patent Document 1 discloses a technique in which points are deducted each time a solver sees a hint to a question, depending on the time limit.

[0004] Furthermore, for example, Patent Document 2 discloses a technology that provides appropriate study content according to the answerer's level of understanding and the selected level of difficulty. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2001-282090 [Patent Document 2] Japanese Patent Application Laid-Open No. 2015-75547 Summary of the Invention [Problem to be solved by the invention]

[0006] The technology disclosed in Patent Document 1 uses a method in which the contestant selects the hint they want from multiple hints, and since the order in which the hints are selected varies from contestant to contestant, it is not possible to compare scores with other contestants.

[0007] In the technology disclosed in Patent Document 2, the learning content is changed according to the respondent's level of understanding and the selected difficulty level, so different learning content is provided for each respondent, and it is not possible to compare scores with other respondents.

[0008] In view of the above, the present disclosure aims to provide a technology for creating assisted questions that allow a user to compare their scores with those of other solvers. [Means for solving the problem]

[0009] An information processing device according to one aspect of the present disclosure includes a question creation unit that creates a plurality of assisted question sets, each of which has a plurality of assisted descriptions added thereto to assist test takers in answering original question sets that constitute tests that have been administered in the past, and a score determination unit that determines score allocations for a plurality of assisted questions that constitute each of the plurality of assisted question sets in accordance with the plurality of assisted descriptions. [Effects of the Invention]

[0010] According to one aspect of the present disclosure, it is possible to create questions with assistance that allow a tester to compare their scores with those of other test takers. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a block diagram illustrating an example of a schematic configuration of a question creation system according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a block diagram showing an example of the hardware configuration of the question creation device according to the embodiment. [Figure 3] FIG. 2 is a block diagram showing an example of the functional configuration of a question creation device according to the embodiment; [Figure 4] FIG. 2 is a block diagram showing an example of a hardware configuration of the answer generation device according to the embodiment; [Figure 5] FIG. 2 is a block diagram showing an example of a functional configuration of the answer generation device according to the embodiment; [Figure 6] FIG. 10 is a diagram showing examples of original questions, answers, and explanations stored in a question information storage unit according to the embodiment. [Figure 7A] FIG. 7 is a diagram showing an example of an ancillary question in which an ancillary description is added to the original question shown in FIG. 6 according to the embodiment. [Figure 7B] FIG. 7 is a diagram showing another example of an auxiliary question in which an auxiliary statement is added to the original question shown in FIG. 6 according to the embodiment. [Figure 8A] FIG. 10 shows an example of a prompt for creating a plurality of step-by-step auxiliary questions, each of which has step-by-step auxiliary descriptions added to the original question, based on the original question, answer, and explanation stored in the question information storage unit, according to the embodiment. [Figure 8B] FIG. 10 is a diagram showing another example of a prompt for creating a plurality of step-by-step auxiliary questions, each of which has step-by-step auxiliary descriptions added to the original question, based on the original question, answer, and explanation stored in the question information storage unit, according to the embodiment. [Figure 9] FIG. 8C shows an example of a plurality of step-by-step auxiliary questions in which step-by-step auxiliary descriptions are added to the original questions shown in FIG. 8A or FIG. 8B according to the embodiment. [Figure 10] A flowchart showing an example of the operation of the question creation system according to the embodiment. [Figure 11] A flowchart showing an example of the operation of the question creation system according to the embodiment. [Figure 12] A flowchart showing an example of the operation of the question creation system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. However, the scope of the invention is not limited to the examples shown in the drawings. In the following description, components having the same functions and configurations are designated by the same reference numerals, and their description will be omitted.

[0013] [Embodiment] <Summary> According to one embodiment of the present disclosure, an information processing device (for example, a question creation device 10 described below) includes a question creation unit and a score determination unit. The question creation unit creates a plurality of graded, assisted question sets, each of which is provided with a plurality of graded descriptions to assist test takers in answering questions from an original question set that constitutes a previously administered test. The score determination unit determines score allocations for the plurality of assisted questions that constitute each of the plurality of graded, assisted question sets, in accordance with the plurality of graded descriptions.

[0014] In this way, the information processing device creates a plurality of tiered assisted problem sets, each of which has a plurality of tiered descriptions added to assist the solver in solving the original problem set, and in which the score allocations for the assisted problems have been determined, so that it is possible to create assisted problems whose scores can be compared with those of other solvers.

[0015] <Question creation system configuration> FIG. 1 is a block diagram illustrating a schematic configuration example of a question creation system according to an embodiment of the present disclosure.

[0016] 1, the question creation system 1 includes a question creation device 10, an answer generation device 20, a first user device 30, and a second user device 40. The question creation device 10, the answer generation device 20, the first user device 30, and the second user device 40 are communicably connected to each other via a network 50. The network 50 may be a LAN (Local Area Network), the Internet, an intranet, a VPN (Virtual Private Network), a mobile communication network, or a combination thereof.

[0017] In response to a request for creating an ancillary question from a first user (a teacher or other instructor at a school, cram school, prep school, or the like) of a first user device 30, the question creation system 1 creates ancillary questions by adding auxiliary information to previously administered exams (such as mock exams, regular exams, and entrance exams) to be presented to a second user (a student or other test taker or question solver) of a second user device 40, and determines the point allocation for the ancillary questions. Then, before or during the exam taken by the second user of the second user device 40, the question creation system 1 selects or determines the ancillary questions to present to the second user from among the ancillary questions that have been created, and transmits the selected or determined ancillary questions to the second user device 40.

[0018] The question creation device 10 is installed in, for example, a cloud environment. For example, the question creation device 10 may be operated by an educational business such as a school, a cram school, or a preparatory school.

[0019] The question creation device 10 receives a request for creating an auxiliary question from the first user device 30 via the network 50. In response to the auxiliary question creation request, the question creation device 10 creates a plurality of tiered auxiliary question sets by adding a plurality of tiered auxiliary descriptions to a problem set (referred to as an original problem set) constituting a past exam specified by the first user, and determines the score allocation for each of the auxiliary questions included in the plurality of tiered auxiliary question sets. The plurality of tiered auxiliary question sets may be created as specified by the first user (for example, by adding explanations (auxiliary descriptions) in which specified descriptions in the explanations of the problem set are masked), or may be created by inputting a prompt (a question sentence or an instruction sentence) for creating an auxiliary question into a generation AI (artificial intelligence) (a trained large-scale language model). The question creation device 10 determines the score allocation for the plurality of tiered auxiliary questions constituting each of the plurality of tiered auxiliary question sets according to the tiered auxiliary descriptions (or the assistance rate described below).

[0020] The question creation device 10 receives a test request from the second user device 40 via the network 50. In response to the test request, the question creation device 10 selects a plurality of subsidized questions (referred to as subsidized current questions) to be presented to the second user from the created set of multiple tiered subsidized questions. The question creation device 10 may receive a question selection instruction from the second user device 40 via the network 50 indicating the assistance rate (subsidized question) selected by the second user while the second user is taking the test, and select a subsidized current question in accordance with the received question selection instruction. The question creation device 10 transmits test information including the selected plurality of subsidized questions to the second user device 40 via the network 50 so as to cause the second user device 40 to display the selected plurality of subsidized questions.

[0021] The answer generation device 20 is installed in, for example, a cloud environment.

[0022] The answer generation device 20 receives a prompt (question sentence) for creating an assisted question from the question creation device 10 via the network 50. The answer generation device 20 generates an answer (assisted question or assisted question set) to the received question sentence. Specifically, the answer generation device 20 generates an answer to the received question sentence using a trained large language model (LLM). The answer generation device 20 transmits the generated answer to the question creation device 10 via the network 50.

[0023] The answer generation device 20 may be a device that provides an existing interactive AI service, such as ChatGPT provided by OpenAI or Gemini provided by Google (registered trademark). In this case, the question creation device 10 can use an API for using such an interactive AI service to send a question to the answer generation device 20 and receive an answer to the question from the answer generation device 20. Alternatively, the answer generation device 20 may provide an interactive AI service by training an LLM such as the one described above using training data such as text data made public on the web.

[0024] In response to input from the first user of the first user device 30 to the first user device 30, the first user device 30 sends a request to the question creation device 10 via the network 50 to create questions for the exam indicated by the input.

[0025] In response to an input from the first user of the first user device 30 to the first user device 30, the first user device 30 may transmit an auxiliary description indicated by the input (specified by the first user) to the question creation device 10 via the network 50 (for example, the first user may specify that an explanation (auxiliary description) be added in which a specified description in the explanation of the original question set is masked).

[0026] In response to an input from the first user of the first user device 30 to the first user device 30, the first user device 30 may transmit the assistance rate indicated by the input (specified by the first user) to the question creation device 10 via the network 50. In this case, the first user of the first user device 30 may specify an assistance rate for the entire assisted problem set or for each assisted problem included in the assisted problem set individually, and cause the first user device 30 to transmit the specified assistance rate to the question creation device 10. Here, the assistance rate refers to the proportion of auxiliary description added to the original problem (20%, 50%, 80%, etc.) and corresponds to the level among multiple levels (when the level is the Nth level, it is also referred to as level N). Note that levels may also be referred to as divisions. In this specification, the smaller N is, the more assistance is provided (larger), but it may also be assumed that the larger N is, the less assistance is provided (smaller).

[0027] In response to an input to the second user device 40 by the second user of the second user device 40, the second user device 40 transmits, via the network 50, to the question creation device 10, a request to take the test indicated by the input.

[0028] In response to an input made by the second user of the second user device 40 to the second user device 40, the second user device 40 may transmit a subsidy rate indicated by the input (specified by the second user) to the question creation device 10 via the network 50. At this time, the second user of the second user device 40 may specify a subsidy rate for the entire subsidized problem set or for each subsidized question included in the subsidized problem set, and cause the second user device 40 to transmit the specified subsidy rate to the question creation device 10. The subsidy rate may be included in the test request or may be transmitted separately from the test request. Furthermore, the second user device 40 may transmit a question selection instruction indicating the subsidy rate (subsidized question) selected by the second user while the second user is taking the test via the network 50.

[0029] In response to the transmitted test request, the second user device 40 receives and displays the aided questions from the question generation device 10 via the network 50.

[0030] 1 shows one each of the first user device 30 and the second user device 40, there may be multiple first user devices 30 and multiple second user devices 40. The user devices may also be called information terminals, user terminals, terminals, clients, client devices, etc.

[0031] <Configuration of the question creation device> 2 is a block diagram showing an example of the hardware configuration of the question creation device according to this embodiment. The question creation device 10 may be realized by a computing device (calculator, computer) such as a server or an information processing device.

[0032] 2, the question creation device 10 may include a storage device 11, a processing device 12, a user interface (UI) device 13, a communication device 14, and a bus 15. The storage device 11, the processing device 12, the UI device 13, and the communication device 14 may be connected to each other via the bus 15.

[0033] The programs or instructions that realize the functions and processes of the question generation device 10 described above and below may be downloaded from some external device (e.g., a server) via a network, etc. Furthermore, such programs or instructions may be provided from a removable storage medium such as a CD-ROM (Compact Disc Read Only Memory) or flash memory.

[0034] Storage device 11 may be implemented by RAM (Random Access Memory), flash memory, a hard disk drive, etc., and stores installed programs or instructions as well as files, data, etc. used to execute the programs or instructions. Storage device 11 may also include a non-transitory storage medium.

[0035] The processing device 12 may be realized, for example, by a general-purpose processor or controller (circuit), or by a dedicated processor or controller (circuit). When realized by a general-purpose processor, the processing device 12 may be realized by one or more central processing units (CPUs), graphics processing units (GPUs), processing circuitry, etc., each of which may be composed of one or more processor cores. In this case, the processing device 12 performs the functions and processing of the question creation device 10 described above and below in accordance with programs or instructions stored in the storage device 11, data such as parameters used to execute the programs or instructions, etc. Such a program, when executed by a computer or processing device 12, may cause the computer or processing device 12 to function as the question creation device 10 according to the present disclosure. Furthermore, such a program, when executed by a computer or processing device 12, may cause the computer or processing device 12 to execute a method for question creation according to the present disclosure.

[0036] The UI device 13 may be composed of input devices such as a keyboard, mouse, camera, microphone, etc., output devices such as a display, speaker, headset, printer, etc., and input / output devices such as a haptic device, touch panel, etc., and realizes an interface between the user of the question creation device 10 and the question creation device 10. For example, the user of the question creation device 10 operates the question creation device 10 by operating a graphical user interface (GUI) displayed on a display or touch panel using a keyboard, mouse, etc.

[0037] The communication device 14 may be realized by various communication circuits that execute communication processes with external devices and communication networks such as the Internet, LAN, and VPN.

[0038] The above-described hardware configuration of the question creation device 10 is merely an example, and the question creation device 10 according to the present disclosure may be realized by any other appropriate hardware configuration.

[0039] FIG. 3 is a block diagram showing an example of the functional configuration of the question creation device according to this embodiment.

[0040] 3, the question creation device 10 includes a question creation unit 101, a score determination unit 102, a question selection unit 103, a question information storage unit 151, and a grade information storage unit 152. The question creation unit 101, the score determination unit 102, and the question selection unit 103 may be realized as hardware, software, or a combination of hardware and software by the processing device 12. The question information storage unit 151 and the grade information storage unit 152 may be realized by the storage device 11.

[0041] The question creation unit 101 receives a request for creating an assisted question from the first user device 30 via the communication device 14. In response to the request for creating an assisted question, the question creation unit 101 creates a plurality of tiered assisted question sets, each of which has a plurality of tiered descriptions added to assist the respondent in answering an original question set constituting a previously administered test. The assisted question creation request may include information specifying a previously administered test by the first user of the first user device 30, information specifying the number of subsidy levels or categories, and the like. Before creating the assisted question set, the question creation unit 101 sets the number of subsidy level levels or categories in accordance with the information specifying the number of subsidy level levels or categories.

[0042] The creation of assisted questions by the question creator 101 includes first question creation involving manual creation by the first user of the first user device 30 and second question creation using the answer generation device 20.

[0043] For example, the description added by the question creating unit 101 may be part of an answer or explanation stored in the question information storage unit 151 described later.

[0044] In creating the first question, the question creation unit 101 may transmit the answers and explanations together with the questions to the first user device 30 via the communication device 14 so that the answers and explanations stored in the question information storage unit 151 are displayed on the first user device 30. The question creation unit 101 may then receive from the first user device 30 via the communication device 14 some of the answers and explanations that have been gradually masked by the first user of the first user device 30, and create an aided question set by adding some of these answers and explanations to the original question set. For example, the question creation unit 101 may create a plurality of staged aided question sets, each of which adds some of the answers and explanations that have been gradually masked, which are a plurality of staged descriptions, received from the first user device 30 associated with the first user who is authorized to create aided questions.

[0045] In the second problem creation, the question creation unit 101 may generate a prompt (a question sentence or an instruction sentence) for creating a plurality of tiered-assisted problem sets, each of which has a plurality of tiered descriptions added thereto, based on the problem, answer, explanation, etc. stored in the problem information storage unit 151, and transmit the generated question sentence to the answer generation device 20 via the communication device 14. Then, the question creation unit 101 may receive an answer to the transmitted question sentence from the answer generation device 20 via the communication device 14, and create a plurality of tiered-assisted problem sets based on the received answer. For example, the question creation unit 101 may create a plurality of tiered-assisted problem sets by inputting an instruction sentence for generating a plurality of tiered-assisted problem sets, each of which has a plurality of tiered descriptions added thereto, into a trained model (i.e., a trained LLM).

[0046] The question creation unit 101 stores the created subsidized question set in the question information storage unit 151.

[0047] The question creation unit 101 outputs to the score determination unit 102 a set of multiple tiered subsidized questions created by the question creation unit 101, along with multiple tiered descriptions or stages (divisions) used by the question creation unit 101 to create the subsidized questions.

[0048] The exemplary creation of the first question and the second question by the question creator 101 will be described in detail later.

[0049] In the case of a CBT (Computer Based Testing) format, when an examinee encounters a question that he or she does not understand while taking the test, it is expected that the examinee will randomly select an answer from the options. On the other hand, when questions with assistance are created by the question creation device 10 (question creation unit 101), the examinee can select an answer with confidence according to the assistance rate, rather than selecting an answer at random.

[0050] The score determination unit 102 determines the score allocations of the multiple subsidized questions that make up each of the multiple subsidized question sets created by the question creation unit 101, in accordance with the multiple step-by-step descriptions used by the question creation unit 101 to create the subsidized questions.

[0051] For example, the score determination unit 102 determines the score for a plurality of stepwise supported questions created from the same original question so that the more support (supporting description) there is, the lower the score is allocated.

[0052] For example, the score determination unit 102 may determine the score for the subsidized question as a value obtained by multiplying the score for the original question corresponding to the subsidized question by a predetermined ratio (e.g., subsidy rate) according to each stage (category or subsidy rate) corresponding to each of the multiple staged descriptions. For example, if the number of stages is three, the score for the subsidized question in stage 1, which provides the most support (e.g., 80% subsidy rate), may be 0.8 times the score for the original question, the score for the subsidized question in stage 2, which provides the second most support (e.g., 50% subsidy rate), may be 0.5 times the score for the original question, and the score for the subsidized question in stage 3, which provides the third most (least) support (e.g., 20% subsidy rate), may be 0.2 times the score for the original question.

[0053] The mark allocation determination unit 102 stores the determined mark allocation in the question information storage unit 151 in association with the subsidized question.

[0054] The question selection unit 103 receives an exam request from the second user device 40 via the communication device 14. In response to the exam request (the exam taken in response to the exam request is called the current exam), the question selection unit 103 selects, from the multiple staged aided question sets, multiple ancillary current questions that constitute the currently administered ancillary current exam, which correspond to multiple original past questions that constitute the original question set. The exam request may include information by the second user of the second user device 40 specifying the subject to be taken, the ancillary question set to be taken, and the past exam (the original question set) that corresponds to the ancillary question set.

[0055] For example, the problem selection unit 103 may select one of a plurality of aided problem sets as the plurality of aided current questions, or may select an aided question included in one of a plurality of staged aided problem sets corresponding to each of the plurality of original past questions as each of the plurality of aided current questions. The aided current questions may be specified by the first user of the first user device 30, may be specified by the second user of the second user device 40, or may be selected by the problem selection unit 103 itself before the current test starts.

[0056] Furthermore, for example, the question selection unit 103 may select multiple subsidized current questions based on the learning level or learning history of the examinee (the second user of the second user device 40) taking the subsidized current test. As an example, the learning level may be a deviation value (or a similar learning evaluation value), and as an example, the question selection unit 103 may select multiple subsidized current questions based on the deviation value information of the examinee stored in the storage device 11 and deviation value-subsidized rate association information that associates the deviation value with the subsidized rate stored in the storage device 11 (for example, if the deviation value of the examinee is "50" and the deviation value "50" is associated with the subsidized rate "50%), the question selection unit 103 may select multiple subsidized current questions corresponding to a subsidized rate of 50% (or a subsidized rate closest to 50%)). For example, the learning history may be the test taker's performance (score) on past subsidized exams that consist of subsidized past questions selected from multiple, staged subsidized question sets in the past. For example, if the second user's previous score was 50%, the question selection unit 103 may select multiple subsidized current questions corresponding to a subsidized rate of 50% (or a subsidized rate closest to 50%). As another example, the learning history may be the test taker's achievement level for learning content provided by an educational business or the like. Multiple subsidized current questions may be selected based on the test taker's achievement level stored in the storage device 11 and the achievement level-subsidized rate association information that associates the achievement level with the subsidized rate stored in the storage device 11 (for example, if the test taker's achievement level is "50%" and the achievement level "50%" is associated with the subsidized rate "50%), the question selection unit 103 may select multiple subsidized current questions corresponding to a subsidized rate of 50% (or a subsidized rate closest to 50%)). In the above case, the assisted current question may be selected by the question selection unit 103 itself before the current test begins.

[0057] Furthermore, for example, the question selection unit 103 may select a plurality of subsidized current questions in accordance with a question selection instruction indicating a subsidy rate received from a second user device associated with a second user taking the subsidized current test. The subsidy rate may be specified by the second user for each subsidized current question.

[0058] The question selection unit 103 transmits test information (also referred to as current test information) including the selected plurality of auxiliary current questions to the second user device 40 via the communication device 14 so that the selected plurality of auxiliary current questions are displayed on the second user device 40.

[0059] The question information storage unit 151 stores original questions, point allocations, answers, explanations, etc. that make up mock exams, etc. that have been conducted in the past by educational businesses such as preparatory schools, along with information that identifies the mock exams, original questions, etc. The question information storage unit 151 also stores subsidized questions created by the question creation unit 101, the corresponding subsidy rates, point allocations determined by the point allocation determination unit 102, etc., along with information that identifies the subsidized questions, the mock exams and original questions that are the basis for the subsidized questions, etc.

[0060] The score information storage unit 152 stores information including the results of the test taken by the second user of the second user device 40 (such as the assistance rate for each subsidized question, the point allocation, the score, and the total score). For example, the grading unit (not shown) of the question creation device 10 receives the second user's answers to the subsidized question set from the second user device 40 via the communication device 14. The grading unit may then perform grading based on the received answers and the answers stored in the question information storage unit 151 and store the grading results in the score information storage unit 152, or may receive the grading results by the first user of the first user device 30 from the first user device 30 via the communication device 14 and store the received grading results in the score information storage unit 152.

[0061] Table 1 shows some of the scoring results of the second user of the second user device 40, which are stored in the score information storage unit 152. [Table 1]

[0062] This allows the instructor (first user) to consider the examinee's (second user's) level of understanding of the test questions not only from the correct answer rate but also from the subsidy rate usage rate.

[0063] <Configuration of the answer generation device> 4 is a block diagram showing an example of the hardware configuration of the answer generation device according to this embodiment. The answer generation device 20 may be realized by a calculation device (calculator, computer) such as a server or an information processing device.

[0064] 4, the answer generation device 20 may include a storage device 21, a processing device 22, a UI device 23, a communication device 24, and a bus 25. The storage device 21, the processing device 22, the UI device 23, and the communication device 24 may be connected to each other via the bus 25.

[0065] The programs or instructions for realizing the functions and processes of the answer generation device 20 described above and below may be downloaded from some external device (e.g., a server) via a network, etc. Furthermore, such programs or instructions may be provided from a removable storage medium such as a CD-ROM or flash memory.

[0066] The storage device 21 may be implemented by RAM, flash memory, a hard disk drive, or the like, and stores installed programs or instructions as well as files, data, and the like used in executing the programs or instructions. The storage device 21 may also include a non-transitory storage medium.

[0067] The processing device 22 may be realized, for example, by a general-purpose processor or controller (circuit), or by a dedicated processor or controller (circuit). When realized by a general-purpose processor, the processing device 22 may be realized by one or more CPUs, GPUs, processing circuits, etc., each of which may be composed of one or more processor cores. In this case, the processing device 22 performs the functions and processing of the answer generation device 20 described above and below in accordance with programs or instructions stored in the storage device 21, data such as parameters used to execute the programs or instructions, and the like. Such a program, when executed by a computer or processing device 22, may cause the computer or processing device 22 to function as the answer generation device 20 according to the present disclosure. Furthermore, such a program, when executed by a computer or processing device 22, may cause the computer or processing device 22 to execute a method for question creation according to the present disclosure.

[0068] The UI device 23 may be composed of input devices such as a keyboard, a mouse, a camera, a microphone, etc., output devices such as a display, a speaker, a headset, a printer, etc., and input / output devices such as a haptic device, a touch panel, etc., and realizes an interface between the user of the answer generation device 20 and the answer generation device 20. For example, the user operates the answer generation device 20 by operating the GUI displayed on the display or touch panel using a keyboard, a mouse, etc.

[0069] The communication device 24 may be realized by various communication circuits that execute communication processes with external devices and communication networks such as the Internet, LAN, and VPN.

[0070] The above-described hardware configuration of the answer generation device 20 is merely an example, and the answer generation device 20 according to the present disclosure may be realized by any other appropriate hardware configuration.

[0071] FIG. 5 is a block diagram showing an example of the functional configuration of the answer generation device according to this embodiment.

[0072] 5, the answer generation device 20 includes a question acquisition unit 201 and an answer processing unit 202. The question acquisition unit 201 and the answer processing unit 202 may be realized by the processing device 22 as hardware, software, or a combination of hardware and software.

[0073] The question acquisition unit 201 acquires the question by receiving the question from the question creation device 10 via the communication device 24. The question acquisition unit 201 outputs the question to the answer processing unit 202.

[0074] The answer processing unit 202 generates an answer (a question with assistance) to the question by inputting the question output by the question acquisition unit 201 into the trained LLM, which is a trained model. The answer processing unit 202 transmits the generated answer to the question creation device 10 via the communication device 24.

[0075] <Creating subsidized questions> Next, the creation of exemplary subsidized questions by the question creator 101 will be described in detail.

[0076] FIG. 6 is a diagram showing examples of original questions, answers, and explanations stored in the question information storage unit according to this embodiment.

[0077] In the example shown in Figure 6, an original math question in the fill-in-the-blank format (fill in the blanks with symbols or numbers) is shown, along with the answer and explanation. In this example, the question is worth 30 points.

[0078] 7A and 7B are diagrams showing examples of ancillary questions in which auxiliary descriptions are added to the original question shown in FIG. 6 according to the embodiment. 7A and 7B are examples of the first question creation described above. In these examples, the question creation unit 101 always masks the answers (after making the first user of the first user device 30 always mask the answers), receives parts of the explanations that have been masked in stages by the first user of the first user device 30, and creates ancillary questions in which parts of these explanations are added to the original question.

[0079] The assistance (part of the explanation) in the example shown in Fig. 7A is less than the assistance (another part of the explanation) in the example shown in Fig. 7B. Therefore, the score determination unit 102 allocates a higher score (20 points) to the subsidized question in the example shown in Fig. 7A than the score (10 points) to the subsidized question in the example shown in Fig. 7B.

[0080] 8A and 8B are diagrams showing examples of prompts for creating a plurality of step-by-step auxiliary questions by adding step-by-step auxiliary descriptions to the original questions based on the original questions, answers, and explanations stored in the question information storage unit according to this embodiment. Figures 8A and 8B are examples of the second question creation described above.

[0081] The examples shown in Figures 8A and 8B show a prompt that includes a multiple-choice chemistry (original) question, its answer, explanation, and instructions to create three (three levels) of subsidized questions based on these (subsidized question: small (little support), subsidized question: medium (moderate support), and subsidized question: large (large support)). The difference between the example shown in Figure 8A and the example shown in Figure 8B is that the prompt in Figure 8B includes a statement for generating the desired sentence (a statement requesting a more specific sentence (the content of which is omitted) that appears after "subsidized question: small").

[0082] FIG. 9 is a diagram showing examples of supplemented questions in which stepwise supplementary descriptions are added to the original questions shown in FIG. 8A or 8, respectively, according to the embodiment.

[0083] 9(a), (b), and (c) show examples of subsidized questions: small, medium, and large, respectively, generated by the answer generation device 20 based on the example prompts shown in FIG. 8A or FIG. 8B.

[0084] It should be noted that when the same prompt is input multiple times to the trained LLM of the answer generation device 20, the same answer (subsidized question) may not necessarily be generated.

[0085] Furthermore, the questions with the aids and masked explanations shown in FIGS. 7A and 7B can also be created using the answer generation device 20.

[0086] <How the question creation system works> Next, an example of the operation of the question creation system 1 will be described with reference to FIGS.

[0087] Fig. 10 is a flowchart showing an example of the operation of the question creation system according to this embodiment. This example relates to the creation of subsidized questions. Below, an example of creating multiple subsidized questions in stages for one original question is described. In practice, however, the processes shown in Figs. 10 and 11 may be applied to an original question set including multiple original questions.

[0088] In step S11, the question creation device 10 sets the number of categories (number of stages) of the subsidy rate. Step S11 may be executed by the question creation unit 101.

[0089] In step S12, the question creation device 10 sets N=1. The value of N corresponds to the division (stage) N. Step S12 may be executed by the question creation unit 101.

[0090] In step S13, the question creation device 10 creates a subsidized question. Step S13 may be executed by the question creation unit 101. Details of step S13 will be described with reference to FIG.

[0091] In step S14, the question creation device 10 determines the points to be allocated to the subsidized question. Step S14 may be executed by the point allocation determination unit 102.

[0092] 11 is a flowchart showing an example of the operation of the question creation system according to this embodiment. This example of the operation relates to step S13 shown in FIG.

[0093] In step S21, the question creation device 10 determines whether the method for creating the assisted question is first question creation involving manual creation by the first user of the first user device 30, or second question creation using the answer generation device 20. Whether the first question or the second question is created may be specified by the first user.

[0094] In the case of first question creation (step S21: manual), in step S22, the question creation device 10 creates an assisted question corresponding to category N, including an explanation masked as specified by the first user. The question creation device 10 causes the first user to perform masking (controls) so as to control the amount of masking according to the value of N.

[0095] In step S23, the question creation device 10 determines whether the subsidized question created in step S22 is to be modified. This determination may be made by receiving an instruction from the first user indicating whether the subsidized question is to be modified.

[0096] If the subsidized problem is to be corrected (step S23: YES), the flow returns to step S22.

[0097] On the other hand, if the subsidized problem is not to be modified (step S23: NO), then in step S24, question creation device 10 finalizes the subsidized problem created in step S22.

[0098] In step S25, the question generation device 10 increments N by one.

[0099] In step S26, the question creation device 10 determines whether N is equal to (the number of categories set in step S11 shown in FIG. 10)+1.

[0100] If they are not equal (step S26: NO), the flow returns to step S22.

[0101] If they are equal (step S26: YES), the flow ends.

[0102] If a second question is to be created in step S21 (step S21: AI), in step S27, the question creation device 10 generates a question sentence for creating multiple (N categories) step-by-step auxiliary questions, each with multiple step-by-step descriptions added, and transmits the question sentence to the answer generation device 20.

[0103] In step S28, the question creation device 10 receives the answers to the question (subject-attached questions with N categories) from the answer generation device 20.

[0104] In step S29, the question creation device 10 determines whether the subsidized question received in step S28 is to be modified. This determination may be made by receiving an instruction from the first user indicating whether the subsidized question is to be modified.

[0105] If the subsidized problem is not modified (step S29: NO), the flow proceeds to step S30.

[0106] On the other hand, if the subsidized question is to be modified (step S29: YES), then in step S31, question creation device 10 determines whether the instruction in step S29 is to modify the entire subsidized question.

[0107] If the correction is for the entire subsidized problem (step S31: YES), the flow returns to step S21.

[0108] On the other hand, if the correction is not to the entire subsidized question (the instruction is to part of the subsidized question) (step S31: NO), in step S32, the question creation device 10 makes the correction specified by the first user to part of the subsidized question, and the flow proceeds to step S30.

[0109] In step S30, the question creation device 10 determines the subsidized question (set), and the flow ends.

[0110] 12 is a flowchart showing an example of the operation of the question creation system according to this embodiment. This example of operation relates to setting the subsidy rate (i.e., which of a plurality of step-by-step subsidized questions is to be selected).

[0111] In step S41, the question creation device 10 determines whether or not to set a subsidy rate before the second user of the second user device 40 takes the test. Step S41 may be executed by the question selection unit 103. This determination may be made by accepting an instruction from the second user indicating whether or not to set a subsidy rate before the test, or by accepting an instruction from the first user of the first user device 30 indicating whether or not to set a subsidy rate before the test.

[0112] If the subsidy rate is not set before the test (step S41: NO), the question creation device 10 performs the test processing (conducts the test) in step S42. During step S42 (during the test), the second user of the second user device 40 can change the subsidy rate, but the first user of the first user device 30 cannot change the subsidy rate.

[0113] On the other hand, if the subsidy rate is set before the test (step S41: YES), in step S43, the question creation device 10 determines whether the subsidy rate setting method involves manual setting by the second user or the first user (hereinafter simply referred to as the user), or automatic setting by the question creation device 10. Step S43 may be executed by the question selection unit 103.

[0114] If the subsidy rate setting method involves manual setting by the user (step S43: manual), in step S44, the question creation device 10 sets the subsidy rate specified by the user based on the user input. Step S43 may be executed by the question selection unit 103. Then, the flow proceeds to step S46.

[0115] On the other hand, if the subsidy rate is set automatically by the question creation device 10 (step S43: automatic), then in step S45, the question creation device 10 automatically sets the subsidy rate. Step S45 may be executed by the question selection unit 103. For example, if this is the first time a subsidized question corresponding to the original question set is being taken, the question selection unit 103 may set a preset subsidy rate (a subsidized question with the least subsidy), or may set the subsidy rate randomly. Also, for example, if this is the second time a subsidized question corresponding to the original question set is being taken, the question selection unit 103 may set the subsidy rate based on the results of the previous attempt (for example, if the previous score was 50%, the question selection unit 103 may select multiple current subsidized questions with a subsidy rate of 50% (or a subsidy rate closest to 50%)). The flow then proceeds to step S46.

[0116] In step S46, the question creation device 10 performs the examination process (conducts the test). Unlike step S42, during step S46 (during the test), the second user (as well as the first user and the question creation device 10) cannot change the subsidy rate.

[0117] <Modifications of the embodiment> Some or all of the functions described in the above embodiments may be executed by another device shown in the drawings or another device not shown and described. For example, the second user device 40 may execute the functions executed by the question creation device 10 without communicating with the question creation device 10. That is, the second user device 40 may include functional units corresponding to the question creation unit 101, the score determination unit 102, the question selection unit 103, the question information storage unit 151, the grade information storage unit 152, etc. Furthermore, the question information storage unit 151 and the grade information storage unit 152 may be included in a database device such as an information management device different from the question creation device 10. Furthermore, for example, the question creation device 10, the first user device 30, and / or the second user device 40 may execute the functions executed by the answer generation device 20. That is, the question creation device 10, the first user device 30, and / or the second user device 40 may include functional units corresponding to the question acquisition unit 201, the answer processing unit 202, etc.

[0118] The functional units described and illustrated in the above embodiments may be divided into multiple functional units, or two or more functional units may be integrated into one functional unit. Furthermore, the names of the functional units are merely examples and may be changed as appropriate.

[0119] The steps in the flowcharts described and illustrated in the above embodiments may be executed in a different order or in parallel, as appropriate.

[0120] <Effects of the embodiment> As described above, the question creation device 10 according to this embodiment uses the question creation unit 101 to create a plurality of tiered-aided question sets, each of which has a tiered description added to an original question set constituting a previously administered test to assist the solver in answering the question. The question creation device 10 then uses the score allocation determination unit 102 to determine the score allocations of the tiered-aided questions constituting each of the plurality of tiered-aided question sets, in accordance with the tiered descriptions (assistance rates). In this way, the question creation device 10 creates a plurality of tiered-aided question sets, each of which has a tiered description added to an original question set to assist the solver in answering the question, and for which the score allocations of the tiered-aided questions have been determined. Therefore, it is possible to create assisted questions that enable the solver to compare their scores with those of other solvers.

[0121] <Summary of the embodiment> An information processing device according to one aspect of the present disclosure includes a question creation unit that creates a plurality of assisted question sets, each of which has a plurality of assisted descriptions added thereto to assist test takers in answering original question sets that constitute tests that have been administered in the past, and a score determination unit that determines score allocations for a plurality of assisted questions that constitute each of the plurality of assisted question sets in accordance with the plurality of assisted descriptions.

[0122] In one example, the information processing device further includes a problem selection unit that selects, from the plurality of staged assisted problem sets, a plurality of assisted current problems that constitute the assisted current test currently being administered, which correspond to a plurality of original past problems that constitute the original problem set.

[0123] In one example, the problem selector selects one of the plurality of assisted problem sets as the plurality of assisted current problems.

[0124] In one example, the problem selection unit selects, as each of the plurality of assisted current problems, an assisted problem included in one of the plurality of staged assisted problem sets that corresponds to each of the plurality of original past problems.

[0125] In one example, the question selection unit selects the plurality of aided current questions based on the learning level or learning history of the examinee taking the aided current test.

[0126] In one example, the question selection unit selects the plurality of aided current questions in accordance with a question selection instruction received from a terminal associated with the examinee taking the aided current test.

[0127] In one example, the problem creation unit creates the plurality of assisted problem sets by inputting instructions to a trained model that generate the plurality of assisted problem sets, each of which has the plurality of assisted descriptions added thereto.

[0128] In one example, the question creation unit creates a set of multiple step-by-step assisted questions, each of which includes the multiple step-by-step descriptions received from a terminal associated with a person who has the authority to create assisted questions.

[0129] A program according to one aspect of the present disclosure is a program for causing an information processing device to execute a process including creating a plurality of tiered assisted question sets, each of which is provided with a plurality of tiered descriptions to assist test takers in answering original question sets that constitute tests that have been administered in the past, and determining the point allocations of a plurality of assisted questions that constitute each of the plurality of tiered assisted question sets in accordance with the plurality of tiered descriptions.

[0130] Although the embodiments of the present disclosure have been described above with reference to the drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications or alterations within the scope of the claims. It is understood that such modifications or alterations also fall within the technical scope of the present disclosure. Furthermore, the components and features of the embodiments (including modified examples) may be combined in any manner without departing from the spirit of the present disclosure.

[0131] The present disclosure can be realized in software, hardware, or software in conjunction with hardware. [Industrial Applicability]

[0132] One aspect of the present disclosure is useful as an information processing device for creating assisted questions. [Explanation of symbols]

[0133] 1. Question Creation System 10 Question Creation Device 11 Storage device 12 Processing equipment 13 User Interface (UI) Devices 14. Communications equipment 101 Question Creation Department 102 Scoring Department 103 Question Selection Section 151 Question information storage unit 152 Grade information storage unit 20 Answer generator 21 Storage device 22 Processing equipment 23 User Interface (UI) Devices 24 Communication equipment 201 Question acquisition part 202 Response processing section 30 First User Device 40 Secondary User Device

Claims

1. a question creation unit that creates a plurality of step-by-step supplemented question sets, each of which is provided with a plurality of step-by-step descriptions to assist test takers in answering questions from original question sets that constitute tests that have been conducted in the past; a score determination unit that determines score allocations for a plurality of auxiliary questions constituting each of the plurality of staged auxiliary question sets in accordance with the plurality of staged descriptions; An information processing device comprising:

2. a problem selection section for selecting, from the plurality of staged aided problem sets, a plurality of aided current problems constituting an aided current test currently being conducted, which correspond to a plurality of original past problems constituting the original problem set; The information processing device according to claim 1 , further comprising:

3. the problem selection unit selects one of the plurality of assisted problem sets as the plurality of assisted current problems. The information processing device according to claim 2 .

4. the problem selection unit selects, as each of the plurality of assisted current problems, an assisted problem included in one of the plurality of staged assisted problem sets corresponding to each of the plurality of original past problems; The information processing device according to claim 2 .

5. the question selection unit selects the plurality of auxiliary current questions based on the learning level or learning history of the examinee taking the auxiliary current test; The information processing device according to claim 2 .

6. the question selection unit selects the plurality of aided current questions in accordance with a question selection instruction received from a terminal associated with the examinee taking the aided current test; The information processing device according to claim 2 .

7. the problem creation unit creates the plurality of staged auxiliary problem sets by inputting, into a trained model, instructions for generating the plurality of staged auxiliary problem sets, each of which has the plurality of staged descriptions added thereto; The information processing device according to claim 1 .

8. the question creation unit creates a set of the plurality of staged assisted questions to which the plurality of staged descriptions received from a terminal associated with a person authorized to create assisted questions are respectively added; The information processing device according to claim 1 .

9. Creating a plurality of step-by-step assisted problem sets, each of which is provided with a plurality of step-by-step descriptions to assist test takers in answering the original problem sets that constitute the test conducted in the past; determining score allocations for a plurality of auxiliary questions constituting each of the plurality of staged auxiliary question sets according to the plurality of staged descriptions; A program for causing an information processing device to execute a process including the steps of:

Images