Learning Support System

Abstract

To provide a learning support system that can support learning regarding problems not managed by a learning system. [Solution] The information processing device 100 includes a receiving unit 1332 that receives data regarding a specified problem from the learner's terminal device, an identifying unit 1333 that identifies the unit to which the problem belongs based on the data, an acquiring unit 1334 that acquires hint information and / or explanation information for the problem based on the identified unit, and output units 1331, 1338 that output the hint information and / or explanation information to the terminal device.

Description

[Technical Field]

[0001] The present invention relates to a learning support system. [Background technology]

[0002] 2. Description of the Related Art Systems for supporting learning have been developed for some time.

[0003] For example, Patent Document 1 describes an education system in which one or more learner terminals and an education server are connected via a network, and the education server performs operations including, in response to a request from the learner terminal, transmitting teaching material information to the requesting learner terminal, receiving from the learner terminal learning result information that is the result of learning using the teaching material information, and transmitting evaluation information for the received learning result information to the recipient learner terminal. The education server transmits questions to the learner terminal as teaching material information, receives answers to the questions from the learning terminal as learning result information, and can then display explanations for the questions in response to a request from the learning terminal. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2001-350400 Summary of the Invention [Problem to be solved by the invention]

[0005] However, conventional learning systems could only provide learning support for problems that the learning system managed, and could not provide learning support for problems that the learning system did not manage.

[0006] Therefore, an object of the present invention is to provide a learning support system that can support learning for questions that are not managed by the learning system. [Means for solving the problem]

[0007] An information processing device according to one embodiment of the present disclosure includes a receiving unit that receives data regarding a specific problem from a learner's terminal device, an identifying unit that identifies the unit to which the problem belongs based on the data, an acquiring unit that acquires hint information and / or explanation information for the problem based on the identified unit, and an output unit that outputs the hint information and / or explanation information to the terminal device.

[0008] According to this aspect, it is possible to provide support for learning about questions that are not managed by the learning support system.

[0009] In the information processing device, the identification unit may further identify a subject to which the question belongs based on the data. According to this aspect, the information processing device can provide the user with detailed hint information and / or explanation information identified at the unit level across multiple subjects.

[0010] In the information processing device, the data related to the predetermined problem may be an image including the predetermined problem, and the identifying unit may identify the unit to which the problem included in the image belongs based on the image. According to this aspect, a user can easily use the service provided by the information processing device by simply taking a picture of the problem using a camera of the terminal device and transmitting the taken image to the information processing device.

[0011] In the information processing device, the acquisition unit may acquire the explanation information in a format in which the answer to the question is broken down into a predetermined number of steps. According to this aspect, the information processing device can help the user to understand the step in which the user has trouble.

[0012] In the information processing device, the acquisition unit may acquire commentary information describing each of the decomposed steps within a predetermined number of characters and a detailed commentary for each step that explains each step in detail. According to this aspect, the information processing device can provide the user with necessary and sufficient information by first presenting simple commentary information to the user and then presenting detailed commentary information for steps for which the user desires more detailed information.

[0013] In the information processing device, the receiving unit may further receive the grade of the learner, and the acquiring unit may acquire the commentary information generated within the scope of knowledge possessed by the user of the grade. According to this aspect, the information processing device can provide commentary information that matches the progress of learning.

[0014] The information processing device may further include a reinforcing unit that uses graphic data to reinforce the hint information and / or commentary information based on the identified unit and hint information and / or commentary information of the question. According to this aspect, the information processing device can further enhance the user's understanding from a visual perspective.

[0015] The information processing device may further include a first storage unit that stores one or more representative diagrams associated with a specific unit, and a second storage unit that stores information on a drawing tool for drawing a diagram for the specific unit, and the reinforcing unit may call up the drawing tool associated with the identified unit and reinforce the hint information and / or the explanatory information using graphic data created based on the data in the first storage unit. According to this aspect, the information processing device can efficiently create diagrams specific to the unit using fewer resources.

[0016] In the information processing device, the acquisition unit may transmit, to the AI ​​server device, instructions including information for acquiring hint information and / or commentary information based on the question information and the identified unit, and receive the hint information and / or commentary information in response. According to this aspect, the information processing device can acquire highly reliable hint information and / or commentary information derived from a huge amount of data.

[0017] In the above information processing device, when generating a response, the AI ​​server device may acquire data from a knowledge storage unit that stores a question database that stores, for each question, the unit to which the question belongs, hints, and explanations, and a knowledge database that stores knowledge associated with the units, and generate a response based on the instructions and data. According to this aspect, the information processing device can acquire hint information and / or explanation information that utilizes know-how accumulated in the learning support system.

[0018] The information processing device may further include a storage unit that stores one or more videos associated with a predetermined unit, and a video acquisition unit that acquires information on the one or more videos from the storage unit based on the identified unit, and the output unit may output information on the one or more videos. According to this aspect, the information processing device can provide the user with a video related to the problem, thereby further enhancing the user's understanding from a visual perspective.

[0019] The information processing device may further include a storage unit that stores one or more questions in association with a predetermined unit, and a question acquisition unit that acquires information on the one or more questions from the storage unit based on the identified unit, and the output unit outputs information on the one or more questions. According to this aspect, the information processing device can provide the user with questions related to the questions, and can further enhance the user's understanding in terms of the number of questions to be performed.

[0020] A method according to another aspect of the present disclosure includes an information processing device receiving data regarding a predetermined problem from a learner's terminal device, identifying a unit to which the problem belongs based on the data, obtaining hint information and / or explanation information for the problem based on the identified unit, and outputting the hint information and / or explanation information to the terminal device.

[0021] A program according to another aspect of the present disclosure causes one or more computers to perform the following processes: receiving data regarding a specific problem from a learner's terminal device; identifying the unit to which the problem belongs based on the data; obtaining hint information and / or explanation information for the problem based on the identified unit; and outputting the hint information and / or explanation information to the terminal device. [Effects of the Invention]

[0022] According to the present invention, it is possible to provide a learning support system that can support learning for questions that are not managed by the learning system. [Brief explanation of the drawings]

[0023] [Figure 1] FIG. 2 is a schematic diagram illustrating processing of an information processing system according to an embodiment of the present invention. [Figure 2] 1 is a schematic configuration diagram of a learning support system according to an embodiment of the present invention. [Figure 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of a server device according to an embodiment of the present invention. [Figure 4] 1 is a schematic configuration diagram showing a server device according to an embodiment of the present invention from a functional viewpoint; [Figure 5] FIG. 10 is a diagram illustrating an example of a question specification screen. [Figure 6] FIG. 10 is a diagram illustrating an example of a hint screen. [Figure 7] FIG. 10 is a diagram showing an example of an explanation screen. [Figure 8] 10 is a flowchart illustrating an example of processing performed by a server device and a terminal device according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0024] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that the same elements are given the same reference numerals, and duplicate explanations will be omitted. Furthermore, the following embodiments are merely examples for explaining the present invention, and are not intended to limit the present invention to only these embodiments. Furthermore, the present invention can be modified in various ways without departing from the gist of the invention.

[0025] <Outline of Learning Support System 1> 1 is a schematic diagram illustrating the processing of a learning support system 1 according to one embodiment of the present invention. As shown in the figure, a server device 100 and a learner's terminal device 200 are connected via a network N so that they can communicate with each other, thereby configuring the learning support system 1.

[0026] The server device 100 is a server computer connected to the network N, and is configured to realize server functions by running a predetermined server program on the server computer. In this embodiment, as shown in Fig. 1, when the server device 100 receives data including a problem from a learner, it can provide hint information and step-by-step explanation information for solving the problem included in the received data to the learner's terminal device 200.

[0027] A step-by-step explanation is an explanation that breaks down how to solve a problem into a series of steps.

[0028] The terminal device 200 is a computer connected to the network N and capable of accessing the server device 100, and is configured to realize its functions by running a predetermined learner terminal program on the computer. A user of the terminal device 200 can take a picture of a question using the camera of the terminal device 200 and send the captured image data to the server device 100, thereby receiving hint information and step-by-step explanation information from the server device 100 and displaying them on the terminal device 200, as described above.

[0029] In this embodiment, the user is a student, but is not limited to this and may be any user. In this embodiment, an example will be described in which a student user studies using the terminal device 200.

[0030] In this embodiment, the terminal device 200 is preferably assumed to be a smartphone (multi-function mobile phone). However, in the present invention, the terminal device 200 is not limited to a smartphone, and may be a PC (personal computer, including a notebook computer), a tablet terminal, a home game device (including a portable game device), a mobile phone (a so-called feature phone), a personal digital assistant (PDA), a portable music player, an e-book reader, or other computer devices.

[0031] The network N is a communication line or network related to information processing, including, for example, the Internet or a LAN (local area network) constructed within a home, and its specific configuration is not particularly limited as long as it is configured to enable data transmission and reception between the server device 100 and the terminal device 200, and it does not matter whether it is wired or wireless.

[0032] The network N may be configured to include multiple types of communication lines or networks and various network devices. For example, the network N may include a base station or a wireless LAN access point (such as a WiFi router) wirelessly connected to the terminal device 200, a mobile communication network connected to the base station, a telephone line connected from the access point via a router or modem, a public line such as a cable television line or an optical communication line, the Internet connected to the server device 100, and a gateway device connecting the mobile communication network or the public line to the Internet.

[0033] <Detailed configuration of Learning Support System 1> Next, a detailed configuration of the learning assistance system 1 of this embodiment will be described with reference to Fig. 2. The learning assistance system 1 includes a server device 100, a terminal device 200, an LLM (Large Language Model) server device 300, and a knowledge storage unit 400.

[0034] The terminal device 200 includes an input interface, an output interface, and a communication interface. The input interface is an interface through which the terminal device 200 receives input from a user. The input interface may be a touch panel, a microphone, a camera, a keyboard, a mouse, etc. The output interface is an interface through which information is transmitted to the user by images, sounds, etc. The output interface is an interface through which a display (which may also serve as a touch panel) and a speaker, etc. The communication interface is an interface through which communication with other devices is realized via the communication network N. The communication interface may be a wireless communication interface or a wired communication interface. The terminal device 200 may access a service provided by the server device 100 via, for example, a web browser, or may access the service by installing dedicated software.

[0035] The LLM server device 300 is a device that provides services using LLM and is an example of an AI server device. The LLM may be a deep learning model that has hundreds of millions of parameters and has learned data related to natural languages ​​from hundreds of gigabytes of data. An example of an LLM is gpt-4o. In one example, the LLM server device 300 provides services using LLM via an API (Application Programming Interface).

[0036] In one embodiment, the LLM server device 300 receives input of instructions (which may also be called prompts) from other devices and returns a response according to the instructions to the other devices. In one example, the instructions and responses are at least one of text and images.

[0037] In this embodiment, when generating a response to an instruction, the LLM server device 300 can obtain unique data from the knowledge memory unit 400, which stores data on the company that manages the server device 100 that sends the instruction, and generate a response based on the instruction and the unique data.

[0038] For example, the knowledge storage unit 400 stores a question DB 401, a knowledge DB 402, and a teaching viewpoint DB 403.

[0039] The question DB 401 includes at least a question ID, subject, unit, grade, question, hint, answer, and explanation. The question ID is information for uniquely identifying a question. The subject is information for identifying the subject to which the question belongs. Subjects include, for example, Japanese, mathematics, English, and essays. The unit is information for identifying the learning category to which the question belongs.

[0040] Grade is information that identifies the grade of the learner who is expected to study the aforementioned unit. Question is information about the problem. Hint is information that may be a hint for solving the problem. Answer is information about the answer. Explanation is information that explains the answer.

[0041] The knowledge DB 402 includes at least the fields of subject, unit, grade, and knowledge. The knowledge stores information necessary to solve problems belonging to the corresponding unit. For example, in the case of mathematics, formulas can be stored as knowledge, in the case of English, grammar can be stored as knowledge, and in the case of chemistry, rules can be stored.

[0042] The teaching perspective DB 403 includes at least the subject, unit, grade, goal, and teaching perspective. The goal is information on the goal to be achieved through the study of the relevant unit. The teaching perspective stores information on the teaching perspective for achieving the goal. In one example, the teaching perspective stores multiple teaching perspectives in accordance with the learning flow for achieving the goal.

[0043] <Hardware configuration of the server device 100> 3 is a diagram (system block diagram) showing an example of the hardware configuration of a server device 100 according to one embodiment of the present invention. As shown in the diagram, the server device 100 includes an arithmetic processing unit (processor) 101 such as a CPU or an MPU, a ROM 102 and a RAM 103 as storage devices, an external interface 104 connected to an input unit 105 and an external memory 106, an image processing unit 107 connected to a display monitor 111, a slot drive 108 in which a disk or a memory device or the like is housed or connected, an audio processing unit 109 connected to a speaker device 112, and a network interface 110.

[0044] The individual units are connected to one another via a transmission path 120, such as a system bus including an internal bus, an external bus, and an expansion bus. Note that input / output devices such as the input unit 105, the external memory 106, the display monitor 111, and the speaker device 112 may be omitted as needed, and even if they are provided, they do not need to be constantly connected to the transmission path 120.

[0045] The arithmetic processing unit 101 controls the overall operation of the server device 100, transmits and receives control signals and information signals (data) to and from the other components described above, and performs various arithmetic processing required to execute learning support. For this reason, the arithmetic processing unit 101 is configured to be able to perform arithmetic operations such as addition, subtraction, multiplication, and division using a numerical calculation unit or the like, logical operations such as logical sum, logical product, and logical negation, bit operations such as bit sum, bit product, bit inversion, bit shift, and bit rotation, and further saturation operations, trigonometric functions, vector operations, etc., as necessary, on a high-speed accessible storage area such as a register.

[0046] The ROM 102 generally stores an IPL (Initial Program Loader), which is executed first after power is turned on. When this IPL is executed, the server program and learning support program stored on a disk or memory device housed in or connected to the slot drive 108 are temporarily read into the RAM 103 by the processing unit 101, and the program is executed by the processing unit 101. Furthermore, the ROM 102 stores an operating system program and various other data required for controlling the operation of the entire server device 100.

[0047] RAM 103 is used to temporarily store the server program, the learning support program, and various data. As described above, the read server program, learning support program, and other data necessary for learning content and communication between multiple terminal devices 200 are stored in RAM 103. The learning support program may be recorded on an external recording medium and installed into RAM 103 from the external recording medium.

[0048] Furthermore, the calculation processing unit 101 sets a variable area in RAM 103 and performs direct calculations using a numerical calculation unit on the values ​​stored in that variable area, or temporarily copies or moves and stores the values ​​stored in RAM 103 in a register and performs direct calculations on that register, and even writes the results of these calculations back to RAM 103.

[0049] The input unit 105 connected via the external interface 104 accepts various operational inputs made by users of the provider that provides the learning support service using the server device 100. The input unit 105 may be a keyboard, touchpad, touch panel, or, for example, a voice input device, and the type of device is not particularly limited as long as it is possible to input instructions such as various operational inputs, decision operations, cancellation operations, menu display, etc.

[0050] The RAM 103 and the external memory 106, which is detachably connected via the external interface 104, store rewritable data indicating the operating status of the server device 100, the access status of each terminal device 200, the content distribution status of each terminal device 200, etc.

[0051] The image processing unit 107 processes various data read from the slot drive 108 by the arithmetic processing unit 101 or by the image processing unit 107 itself, and then records the processed image information in a frame memory or the like. The image information recorded in this frame memory is converted into a video signal at a predetermined synchronous timing and output to a display monitor 111 connected to the image processing unit 107. This makes it possible to display various images. In addition, image information related to learning support is sent from the image processing unit 107 and / or the arithmetic processing unit 101 to each terminal device 200 through collaborative processing with the arithmetic processing unit 101, etc.

[0052] Furthermore, the audio processing unit 109 converts various data read from the slot drive 108 into audio signals and outputs them from a speaker device 112 connected to the audio processing unit 109. Furthermore, audio information related to learning support is sent from the audio processing unit 109 and / or the arithmetic processing unit 101 to each terminal device 200 through collaborative processing with the arithmetic processing unit 101, etc.

[0053] The network interface 110 is used to connect the server device 100 to the network N, and is composed of, for example, a device that conforms to the standards used to construct a LAN, an analog modem, an ISDN modem, an ADSL modem, a cable modem for connecting to the Internet, etc. using a cable television line, and a communication interface circuit for connecting these to the arithmetic processing unit 101 via the transmission path 120.

[0054] The server device 100 may be configured as a single computer, or may be configured as a so-called cloud computing system consisting of multiple computers distributed over a network, or may be configured as a single computer having multiple server functions.

[0055] <Functional configuration of the server device 100> 4 is a schematic configuration diagram (functional configuration diagram) showing, from a functional perspective, the server device 100 according to one embodiment of the present invention. The server device 100 is intended to support the learning of the learner of the terminal device 200, and includes at least a server communication unit 131, a server storage unit 132, and a server processing unit 133 as functions for this purpose.

[0056] The server communication unit 131 communicates between the server device 100 and the network N, and has the function of supplying data received from the terminal device 200 and the LLM server device 300 to the server processing unit 133, and transmitting data supplied from the server processing unit 133 to the terminal device 200 and the LLM server device 300. Specifically, the server communication unit 131 is composed of at least the network interface 110 shown in Figure 3 described above.

[0057] The server storage unit 132 is for storing various programs and various data, and specifically may be composed of at least one of the ROM 102, RAM 103, external memory 106, and slot drive 108 shown in FIG. 3. The program stored in the server storage unit 132 is a learning support application program that executes the processing procedures described below. The server storage unit 132 also stores data related to such learning support, display data, data on various calculation results, and the like.

[0058] For example, the server storage unit 132 stores a representative diagram DB 1321, a drawing tool DB 1322, a moving image DB 1323, and a similar question DB 1324.

[0059] The representative diagram DB 1321 includes at least the following fields: subject, unit, grade, representative diagram ID, representative diagram name, and representative diagram. The representative diagram can include any diagram used to explain the problems in the unit. The representative diagram ID is information for uniquely identifying the representative diagram. The representative diagram name is information indicating the name of the representative diagram. The representative diagram stores information necessary for drawing the representative diagram. For example, for a diagram for the mathematics unit "Quadratic Functions," information on the diagram, including the x-axis, y-axis, graph, vertices, graph axes, auxiliary lines, etc., can be stored in the representative diagram. For another example, for a diagram for the physics unit "Inertial Force," information on the diagram, including inertial force, mass, acceleration, auxiliary lines, etc., can be stored in the representative diagram. The representative diagram DB 1321 can store one or more representative diagrams associated with a specific subject, unit, and grade.

[0060] The drawing tool DB 1322 includes at least the subject, unit, and reference. The reference is information for calling a tool for drawing a diagram for a specific subject or unit. The drawing tool DB 1322 may further include information on the grade level.

[0061] The video DB 1323 includes at least a video ID, a subject, a unit, and a video. The video ID is information for uniquely identifying a video. The video DB 1323 may further include information on the school year.

[0062] The similar question DB 1324 includes at least a question ID, a subject, a unit, a question, a hint, an answer, and an explanation. The similar question DB 1324 may store the same data as the question DB 401 of the knowledge storage unit 400, or may store different data. The similar question DB 1324 may further include information on the grade level.

[0063] Returning to Fig. 4, the server processing unit 133 is composed of the arithmetic processing unit 101 shown in Fig. 3, and processes are executed by each functional module described below based on control commands from the arithmetic processing unit 101. That is, the arithmetic processing unit 101 functions as the server processing unit 133 in this embodiment. Explaining this further using the learning support in this embodiment as an example, the functional modules include a screen transmission unit 1331, a request reception unit 1332, an identification unit 1333, an explanation acquisition unit 1334, a reinforcement unit 1335, a video acquisition unit 1336, a similar question acquisition unit 1337, and a distribution unit 1338. The functional modules are realized by the various programs executed by the processor of the arithmetic processing unit 101, or may be implemented in the arithmetic processing unit 101 as firmware.

[0064] In response to an input or the like from the user of the terminal device 200, the screen transmission unit 1331 generates corresponding screen information and transmits it to the terminal device 200. Specifically, the screen transmission unit 1331 transmits, for example, question specification screen information for specifying a question for which the user wishes to receive an explanation to the terminal device 200. The screen transmission unit 1331 also generates hint screen information including hint information for solving the question and explanation screen information including step-by-step explanation information for the question and transmits it to the terminal device 200. Note that the hint information and explanation information are not limited to text data and may include graphic data such as diagrams and animations, image data, and audio data.

[0065] The request receiving unit 1332 receives a request from the terminal device 200 requesting the provision of an explanation for a predetermined problem. In this embodiment, the request receiving unit 1332 receives a request including user information and problem information. In one embodiment, the request receiving unit 1332 receives the problem information as image data. The image data may be a still image or a moving image.

[0066] The identification unit 1333 identifies the subject and unit to which a problem included in the problem information received from the terminal device 200 belongs. In this embodiment, the identification unit 1333 identifies the subject and unit to which a problem belongs by inputting the problem information into a machine learning model. In one example, the machine learning model is constructed by learning learning data including a combination of the problem information and the subject and unit to which the problem belongs. Note that the machine learning model may be an LLM hosted on the LLM server device 300, or may be a machine learning model other than an LLM hosted on the server device 100.

[0067] In this embodiment, the identification unit 1333 identifies the subject and unit by inputting an instruction (hereinafter referred to as a "unit identification instruction") including information for identifying the subject and unit to which the question belongs, to the LLM based on the question information received by the request receiving unit 1332. In one example, the unit identification instruction includes an instruction to select the subject and unit to which the question belongs from data in which multiple units are specified for each subject.

[0068] The explanation acquisition unit 1334 acquires hint information and / or explanation information for the problem included in the problem information received from the terminal device 200. In this embodiment, the explanation acquisition unit 1334 transmits to the LLM server device 300 an instruction (hereinafter referred to as an "explanation acquisition instruction") including information for acquiring hint information for solving the problem and step-by-step explanation information based on the grade and problem information identified from the user information received by the request receiving unit 1332 and the subject and unit identified by the identification unit 1333, and receives the hint information and step-by-step explanation information in response.

[0069] In one example, the instruction to obtain an explanation includes an instruction to generate explanation information in a format in which the answer is broken down into 3 to 10 steps. Furthermore, in one example, the instruction to obtain an explanation may include an instruction to generate step-by-step explanation information in which the answer is broken down into 3 to 10 steps and each step is described in a predetermined number of characters or less, and detailed explanations for each step that explain each step in more detail.

[0070] Furthermore, the instruction to obtain an explanation may include an instruction to generate explanation information within the scope of knowledge possessed by a grade identified from the user information received by the request receiving unit 1332. For example, when there are several solutions to a mathematical proof problem, it is desirable to include in the explanation information a solution that is configured with the knowledge possessed by the target user out of the multiple solutions.

[0071] The explanation acquisition unit 1334 may also acquire hint information and explanation information using other information about the user, such as the user's desired school, the user's target learning level, the user's current learning level, etc. For example, the explanation acquisition instruction may include an instruction to generate hint information and explanation information within the range of knowledge expected of a user aiming for a certain desired school, or an instruction to generate hint information and explanation information in accordance with the user's learning level (for example, the highest level out of five levels).

[0072] The reinforcing unit 1335 reinforces the hint information and / or commentary information acquired by the commentary acquisition unit 1334. In this embodiment, the reinforcing unit 1335 reinforces the hint information and / or commentary information using information from the representative image DB 1321 and the drawing tool DB 1322. In one example, the reinforcing unit 1335 references the representative image DB 1321 based on the subject and unit identified by the identification unit 1333, and determines whether or not there is a representative image corresponding to the hint information and / or commentary information. If there is a corresponding representative image, the reinforcing unit 1335 acquires a reference destination for the target unit from the drawing tool DB 1322 and calls a drawing tool to reinforce the hint information and / or commentary information. In addition, in one embodiment, when the hint information and / or commentary information acquired by the commentary acquisition unit 1334 includes a drawing instruction, the reinforcing unit 1335 reinforces the hint information and / or commentary information regardless of whether or not there is a corresponding representative image.

[0073] The drawing tool may create new diagrams or animations to be used for the hints and / or explanations based on the hint information and / or explanation information and the representative diagram and include them in the hint information and / or explanation information, or may modify the diagrams or animations included in the hint information and / or explanation information.

[0074] The video acquisition unit 1336 acquires videos related to the questions included in the question information received from the terminal device 200. In this embodiment, the video acquisition unit 1336 acquires information on one or more videos that explain the unit from the video DB 1323, based on the subject and unit identified by the identification unit 1333.

[0075] The similar question acquisition unit 1337 acquires similar questions to the questions included in the question information received from the terminal device 200. In this embodiment, the similar question acquisition unit 1337 acquires information on one or more questions from the similar question DB 1324 based on the subject and unit identified by the identification unit 1333.

[0076] The distribution unit 1338 distributes information about videos and similar questions to the terminal device 200. In this embodiment, the distribution unit 1338 distributes information about videos acquired by the video acquisition unit 1336 and information about questions acquired by the similar question acquisition unit 1337 to the terminal device 200.

[0077] <Example of a screen on the terminal device 200> Next, an example of a screen of the learning support service in the embodiment will be described. Fig. 5 is a diagram showing an example of a question specification screen. In the example shown in Fig. 5, an example is shown in which an area of ​​a question for which an explanation is desired to be provided is selected from image data captured using the camera of the terminal device 200.

[0078] The question specification screen includes an imaging data display area 501, a question selection control 502, and a request transmission control 503. In this embodiment, the user can operate the question selection control 502 to select the area of ​​the question for which the user wishes to receive an explanation, and then select the request transmission control 503 to transmit a request to the server device 100.

[0079] 6 is a diagram showing an example of a hint screen. In the example shown in FIG. 6, the hint screen includes a problem area 601 that displays a problem, a hint area 602 that displays a hint for solving the problem, a hint area 603 that displays steps leading to the solution, and an explanation request control 604. The hint screen may be displayed in response to an explicit request from the user, or may be displayed before the explanation screen is displayed in response to a request from the request transmission control 503. In addition, in this embodiment, the user can request an explanation screen from the server device 100 by selecting the explanation request control 604.

[0080] FIG. 7 is a diagram illustrating an example of an explanation screen. In the example illustrated in FIG. 7, the explanation screen includes multiple step areas 701 and multiple detail request controls 702 as a step-by-step explanation. In the example illustrated in FIG. 7, a parabola diagram is included in the lower left area of ​​each step area 701. As described above, the diagram included in the explanation screen may be a diagram newly created using a drawing tool or a diagram included in the acquired explanation information. Note that the explanation screen may be an illustration as shown in FIG. 7, or an explanation without a diagram. The explanation screen may be displayed in response to a request from the request send control 503 on the problem specification screen or in response to a request from the explanation request control 604 on the hint screen. In addition, in this embodiment, a user can request a detailed explanation that provides more detailed information about the corresponding step from the server device 100 by selecting the detail request control 702.

[0081] <Operation> Next, the operation of the learning support system 1 will be described. In this embodiment, an example will be described in which a learner 2, a second-year high school student, requests an explanation for a problem assigned to him / her in school as homework. FIG. 8 is a flowchart showing an example of the processing of the server device and terminal device according to one embodiment of the present invention. In this embodiment, it is assumed that, before the processing of FIG. 8 is performed, various data are stored in the representative diagram DB 1321, drawing tool DB 1322, video DB 1323, and similar question DB 1324 under the management of an administrator of the server device 100.

[0082] In this embodiment, it is assumed that a user who uses the services of the learning support system 1 has signed a service contract for the service using the present invention. A learner ID is assigned to the user through the service contract, and the server device 100 stores the grade of the learner in association with the learner ID.

[0083] When a learner 2, who is a user of the learning support system 1, performs a login process using the input interface of the terminal device 200 (S101), a learning support screen dedicated to the logged-in learner is displayed on the output interface. After that, when the learner requests a question capture screen using the input interface (S102), the screen sending unit 1331 of the server device 100 generates question capture screen information and sends it to the terminal device 200 (S103, 104).

[0084] When the terminal device 200 receives the question photographing screen information from the screen transmitting unit 1331 (S105), it generates a question photographing screen and displays it on the output interface (S106). When the learner 2 photographs a textbook including questions using the camera of the terminal device 200 in accordance with the instructions on the question photographing screen, the terminal device 200 generates a question specification screen including the photographed data in the image data display area 501 and displays it on the output interface (S107). Here, it is assumed that the terminal device 200 displays a question specification screen such as that shown in Fig. 5 on the output interface.

[0085] When learner 2 specifies a question via question selection control 502 displayed on the question specification screen and selects request transmission control 503, terminal device 200 sends a request including the learner ID and question information to server device 100 (S108).

[0086] When the request receiving unit 1332 of the server device 100 receives a request from the terminal device 200 (S109), the identifying unit 1333 of the server device 100 identifies the subject and unit to which the question included in the received question information belongs (S110).

[0087] In this embodiment, the identification unit 1333 identifies the subject and unit to which the question belongs by inputting the question information into a machine learning model. Here, the identification unit 1333 identifies the subject and unit by inputting an instruction including information for identifying the subject and unit to which the question belongs to, based on the question information received by the request receiving unit 1332, into the LLM.

[0088] Next, the explanation acquisition unit 1334 of the server device 100 acquires hint information and / or explanation information for the problem included in the problem information received from the terminal device 200 (S111). In this embodiment, the explanation acquisition unit 1334 transmits to the LLM server device 300 an instruction (hereinafter referred to as an "explanation acquisition instruction") including information for acquiring hint information for solving the problem and step-by-step explanation information based on the grade and problem information identified from the user information received by the request receiving unit 1332 and the subject and unit identified by the identification unit 1333, and receives the hint information and step-by-step explanation information in response.

[0089] Here, the explanation acquisition unit 1334 breaks down the answer into 3 to 10 steps, and includes in the explanation acquisition instruction an instruction to generate step-by-step explanation information that describes each step within a specified number of characters, as well as detailed explanations for each step that provide further details about each step.

[0090] Furthermore, the explanation acquisition unit 1334 includes in the explanation acquisition instruction an instruction to generate explanation information within the scope of knowledge possessed by the second-year high school student identified from the user information received by the request receiving unit 1332.

[0091] Next, the reinforcing unit 1335 of the server device 100 reinforces the hint information and / or commentary information acquired by the commentary acquisition unit 1334 (S112). In this embodiment, the reinforcing unit 1335 refers to the representative diagram DB 1321 based on the subject and unit identified by the identification unit 1333, and determines whether there is a representative diagram corresponding to the hint information and / or commentary information. If there is a corresponding representative diagram, the reinforcing unit 1335 acquires a reference destination of the target unit from the drawing tool DB 1322, and calls a drawing tool to reinforce the hint information and / or commentary information.

[0092] Here, it is determined that a representative diagram corresponding to the hint information and / or explanatory information is in the representative diagram DB 1321, and the drawing tool called from the reinforcement section 1335 creates a new diagram to be used for the hint and / or explanatory information based on the hint information and / or explanatory information and the representative diagram, and includes the new diagram in the hint information and / or explanatory information.

[0093] Thereafter, the screen transmission unit 1331 generates hint screen information and / or comment screen information based on the hint information and / or comment information, and transmits the generated hint screen information and / or comment screen information to the terminal device 200 (S113).

[0094] When the hint screen information and / or explanation screen information is received from the screen transmission unit 1331 (S114), the terminal device 200 generates the hint screen and / or explanation screen and displays it on the output interface (S115).

[0095] Furthermore, the video acquisition unit 1336 of the server device 100 acquires videos related to the questions included in the question information received from the terminal device 200 (S116). In this embodiment, the video acquisition unit 1336 acquires information on one or more videos that explain the subject and unit identified by the identification unit 1333 from the video DB 1323.

[0096] Furthermore, the similar question acquisition unit 1337 of the server device 100 acquires similar questions to the questions included in the question information received from the terminal device 200 (S117). In this embodiment, the similar question acquisition unit 1337 acquires information on one or more questions from the similar question DB 1324 based on the subject and unit identified by the identification unit 1333.

[0097] Finally, the distribution unit 1338 of the server device 100 distributes the video information and the similar question information to the terminal device 200 (S118). In this embodiment, the distribution unit 1338 distributes the video information acquired by the video acquisition unit 1336 and the similar question information acquired by the similar question acquisition unit 1337 to the terminal device 200. After receiving the video information and the similar question information from the distribution unit 1338 (S119), the terminal device 200 generates a screen based on the received information and displays it on the output interface (S120).

[0098] The identifying unit 1333 may identify one unit to which the question belongs, or may identify multiple units to which the question belongs.

[0099] In addition, in this embodiment, an example is described in which the subject and unit to which a question belongs is identified across multiple subjects, not just a specific subject, but in another embodiment, it may be possible to limit the identification to a specific subject and identify a unit within that subject.

[0100] As described above, according to this embodiment, the server device 100 can support learning for questions that are not managed by the learning support system 1 by identifying the unit to which the question included in the image belongs and providing the user with hint information and / or explanation information obtained based on the identified unit.

[0101] In addition, the server device 100 can identify the subject and unit to which the question contained in the image belongs, and can therefore provide the user with detailed hint information and / or explanation information identified at the unit level across multiple subjects.

[0102] Furthermore, the server device 100 can help the user understand the step where the user had trouble by acquiring and outputting explanation information in a format in which the answer to the question is broken down into a predetermined number of steps.

[0103] In addition, the server device 100 can provide the user with sufficient information by first presenting simple explanatory information to the user and then presenting detailed explanatory information for steps for which the user would like more detailed information, by acquiring explanatory information for each of the broken down steps, which is written within a specified number of characters, and detailed explanations for each step that provide detailed explanations for each step.

[0104] Furthermore, the server device 100 can acquire commentary information generated within the scope of knowledge possessed by the user of the school year, and can therefore provide commentary information that matches the progress of the student's studies.

[0105] Furthermore, the server device 100 can further enhance the user's understanding from a visual perspective by reinforcing hint information and / or commentary information using graphic data.

[0106] In addition, the server device 100 is provided with a representative diagram DB 1321 that stores one or more representative diagrams associated with a specific unit, and a drawing tool DB 1322 that stores information on drawing tools for drawing diagrams of the specific unit, thereby enabling the efficient creation of unit-specific diagrams with minimal resources.

[0107] Furthermore, the server device 100 can obtain hint information and / or commentary information using the LLM server device 300, thereby obtaining highly reliable hint information and / or commentary information derived from a huge amount of data.

[0108] In addition, the server device 100 can obtain hint information and / or explanatory information that utilizes the know-how accumulated in the learning support system 1 by having the LLM server device 300 generate a response using data obtained from the question database accumulated in the learning support system 1 and the knowledge database that stores knowledge in association with units.

[0109] In addition, the server device 100 acquires and outputs one or more videos acquired based on the identified unit, thereby providing the user with videos related to the problem contained in the image, thereby further enhancing the user's understanding from a visual perspective.

[0110] In addition, the server device 100 acquires and outputs information on one or more questions acquired based on the identified unit, thereby providing the user with questions related to the questions included in the image, thereby further enhancing the user's understanding in terms of the number of questions performed. [Explanation of symbols]

[0111] 1...Learning support system, 100...information processing device, 101...arithmetic processing unit, 102...ROM, 103...RAM, 104...external interface, 105...input unit, 106...external memory, 107...image processing unit, 108...slot drive, 109...audio processing unit, 110...network interface, 111...display monitor, 112...speaker device, 120...transmission path, 131...server communication unit, 132...server memory unit, 1321...representative diagram DB (first memory unit), 1322...drawing tool DB (second memory unit), 1323...video DB, 1324...similar question DB, 133...server processing unit, 1331...screen transmission unit (output unit), 1332...Request receiving unit (receiving unit), 1333...Identifying unit, 1334...Explanation acquiring unit (acquisition unit), 1335...Reinforcing unit, 1336...Video acquiring unit, 1337...Similar question acquiring unit (question acquiring unit), 1338...Distribution unit (output unit), 200...Terminal device, 300...LLM server device, 400...Knowledge storage unit, 401...Question DB, 402...Knowledge DB, 403...Teaching viewpoint DB, 501...Image data display area, 502...Question selection control, 503...Request sending control, 601...Question area, 602, 603...Hint area, 604...Explanation request control, 701...Step area 701, 702...Detail request control, N...Network

Claims

1. a receiving unit that receives data relating to predetermined questions from a learner's terminal device; an identification unit that identifies a unit to which the question belongs based on the data; an acquisition unit that acquires the hint information and / or the commentary information by transmitting an instruction to an AI server device including information for acquiring hint information and / or commentary information for the question based on information about the question included in the data and the identified unit, and receiving the hint information and / or the commentary information in response; an output unit that outputs the hint information and / or the commentary information to the terminal device; Equipped with When generating the response, the AI ​​server device acquires data from a knowledge storage unit that stores a question database that stores, for each question, the unit to which the question belongs, hints, and explanations, and a knowledge database that stores knowledge associated with the unit, and generates the response based on the instructions and the data.

2. The information processing device according to claim 1 , wherein the identifying unit further identifies a subject to which the question belongs based on the data.

3. the data relating to the predetermined question is an image including the predetermined question, the identification unit identifies a unit to which a question included in the image belongs, based on the image.

3. The information processing device according to claim 1 or 2.

4. the acquisition unit acquires the commentary information in a format in which the answer to the question is broken down into a predetermined number of steps.

3. The information processing device according to claim 1 or 2.

5. The acquisition unit acquires commentary information describing each of the decomposed steps within a predetermined number of characters and a detailed commentary for each step that provides a detailed explanation of each step. The information processing device according to claim 4 .

6. The receiving unit further receives the grade of the learner; the acquisition unit acquires commentary information generated within the scope of knowledge possessed by users of the grade.

3. The information processing device according to claim 1 or 2.

7. a reinforcing unit that uses graphic data to reinforce the hint information and / or commentary information of the specified unit and the question based on the hint information and / or commentary information of the question; The information processing device according to claim 1 , further comprising:

8. a first storage unit that stores one or more representative diagrams in association with a predetermined unit; a second storage unit that stores information on a drawing tool for drawing a diagram of a predetermined unit in association with the predetermined unit; the reinforcing unit calls a drawing tool associated with the identified unit and reinforces the hint information and / or commentary information using graphic data created based on the data in the first storage unit. The information processing device according to claim 7 .

9. a storage unit that stores one or more videos in association with a predetermined unit; a video acquisition unit that acquires information on one or more videos from the storage unit based on the identified unit; Furthermore, The information processing device according to claim 1 , wherein the output unit outputs information about the one or more moving images.

10. a storage unit that stores one or more questions in association with a predetermined unit; a question acquisition unit that acquires information on one or more questions from the storage unit based on the identified unit; Furthermore, The information processing device according to claim 1 , wherein the output unit outputs information about the one or more questions.

11. The information processing device receiving data relating to a predetermined question from a learner's terminal device; Identifying a unit to which the question belongs based on the data; transmitting to an AI server device an instruction including information for acquiring hint information and / or commentary information for the question based on information about the question included in the data and the identified unit, and receiving the hint information and / or commentary information in response, thereby acquiring the hint information and / or commentary information; outputting the hint information and / or the commentary information to the terminal device; Including, A method in which, when generating the response, the AI ​​server device obtains data from a knowledge storage unit that stores a question database that stores, for each question, the unit to which the question belongs, hints, and explanations, and a knowledge database that stores knowledge associated with units, and generates the response based on the instructions and the data.

12. On one or more computers, receiving data relating to a predetermined question from a learner's terminal device; A process of identifying a unit to which the question belongs based on the data; a process of transmitting to an AI server device an instruction including information for acquiring hint information and / or commentary information for the question based on information about the question included in the data and the identified unit, and receiving the hint information and / or commentary information in response, thereby acquiring the hint information and / or commentary information; a process of outputting the hint information and / or the commentary information to the terminal device; Execute When generating the response, the AI ​​server device obtains data from a knowledge storage unit that stores a question database that stores, for each question, the unit to which the question belongs, hints, and explanations, and a knowledge database that stores knowledge associated with units, and generates the response based on the instructions and the data.

Images