system

Abstract

Provide a system. A database for storing educational data; a processing means for selecting an educational question to be presented to a student and corresponding incorrect answer data; a display means for presenting educational questions and incorrect answer data to students; an input means for inputting student responses; evaluation means for evaluating the input answers; a feedback mechanism to provide feedback to students based on the assessment results; education system, including

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In traditional educational systems, teachers provide knowledge in a one-way manner, and students passively receive it, which often makes it difficult to promote independent learning. Furthermore, systems that only provide correct answers leave students with few opportunities to think for themselves, which can prevent them from gaining a deeper understanding. As a result, students' critical thinking and problem-solving skills are not fully developed. [Means for solving the problem]

[0005] In order to solve the above problems, the present invention provides an educational system with the following features. First, the system has a database for storing educational data and processing means for selecting educational questions and incorrect answer data to be presented to students from this database. Next, the system has display means for presenting the educational questions and incorrect answer data to students and input means for inputting students' answers. Furthermore, the system has feedback means for evaluating the input answers and providing feedback to students based on the evaluation results. Furthermore, by including processing means for randomly selecting incorrect answer data and processing means for comparing students' answers with correct answer data and evaluating them, the system promotes students' independent learning and improvement of their critical thinking skills.

[0006] "Educational data" is a collection of information including a range of questions to be presented to students and associated correct and incorrect answer data.

[0007] A "database" is a system for efficiently storing, managing, and searching educational data.

[0008] A "processing means" is a combination of hardware and software for performing a particular task.

[0009] "Incorrect answer data" refers to intentionally set incorrect answers to educational questions, and serves as support material for students to derive the correct answer themselves.

[0010] "Display means" refers to a device or software that visually presents educational questions and incorrect answer data to students.

[0011] "Input means" is an interface through which students input their answers.

[0012] The "evaluation means" is a function that compares the student's input answers with correct answer data and determines whether they are correct or not.

[0013] "Feedback tools" are functions for notifying students of their learning outcomes and areas for improvement based on the evaluation results.

[0014] "Correct answer data" is information that contains the only correct answer to an educational question.

[0015] "Random selection" is the process of selecting items at random in an unpredictable manner.

[0016] "Independent learning" is the act of students deepening their learning by thinking, judging, and acting on their own.

[0017] "Critical thinking" is the ability to organize and analyze information and evaluate its validity and reliability. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11]FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] The present invention is an educational system that includes a database for storing educational data, a processing means for selecting educational questions and incorrect answer data, a display means for presenting the educational questions and incorrect answer data to students, an input means for inputting students' answers, an evaluation means for evaluating the answers, and a feedback means for providing feedback to students based on the evaluation results.

[0040] Program processing

[0041] Initialization

[0042] 1. Server:

[0043] The server first initializes a database containing educational data, which stores educational questions for each subject, correct answer data, and corresponding incorrect answer data.

[0044] For example, the educational questions in the "Mathematics" category include "2+2" and "3+5", and the corresponding incorrect answer data include "2+2=5" and "3+5=9".

[0045] Problem Statement

[0046] 2. Terminal:

[0047] When a student requests a "math" problem, the terminal sends the request to the server.

[0048] When the server receives the request, it randomly selects one problem from the "Math" category, let's say "2+2".

[0049] The server prepares the incorrect answer data "2+2=5" for the selected question and sends it to the terminal.

[0050] 3. Terminal:

[0051] The terminal visually displays the questions and incorrect answers to the user (student). The displayed content is as follows:

[0052] Problem: 2+2

[0053] Choices: 5

[0054] The device also has an input field for students to enter their answers.

[0055] User Answers

[0056] 4. User:

[0057] The user looks at the question and options displayed on the terminal, thinks about their answer, and if they think "2+2=4," they enter "4" into the terminal.

[0058] Submitting and rating answers

[0059] 5. Terminal:

[0060] The terminal sends the student's inputted answers to the server.

[0061] 6. Server:

[0062] The server compares the received answer "4" with the correct answer data for "2+2." Since the correct answer data for "2+2" is "4," the server confirms that the student's answer is correct.

[0063] If the answer to the question is correct, the evaluation result "correct" is returned to the terminal, and if the answer is incorrect, the evaluation result "incorrect" is returned to the terminal.

[0064] Feedback of evaluation results

[0065] 7. Terminal:

[0066] The terminal receives the evaluation results from the server and notifies the student, displaying a message like the following:

[0067] "Correct" or "Incorrect"

[0068] Flow of specific example

[0069] Mathematical Example

[0070] 1. Server:

[0071] During the initialization process, the server stores the correct answer "2+2=4" and the incorrect answer "2+2=5" in a database.

[0072] 2. Terminal:

[0073] The terminal requests "math" problems from the server in response to a user request.

[0074] 3. Server:

[0075] The server selects the problem "2+2," prepares the corresponding incorrect answer data "2+2=5," and sends it to the terminal.

[0076] 4. Terminal:

[0077] The device displays "Question: 2+2, Choices: 5" to the student and provides a field for entering the answer.

[0078] 5. User:

[0079] The user enters what they believe to be the correct answer, "4," into the terminal.

[0080] 6. Terminal:

[0081] The terminal sends the entered answer "4" to the server.

[0082] 7. Server:

[0083] The server evaluates the answer and, since "2+2=4" is the correct answer, sends the "correct answer" result to the terminal.

[0084] 8. Terminal:

[0085] The terminal displays the message "Correct" to the user.

[0086] In this way, students are provided with opportunities for independent learning and can develop critical thinking skills.

[0087] The processing flow will be explained below.

[0088] Step 1:

[0089] server:

[0090] When the program starts, the server initializes and loads educational data into a database. This database stores questions, correct answers, and incorrect answers for each subject. For example, the "Mathematics" category contains the question "2+2" and the corresponding correct answer "4" and incorrect answer "2+2=5."

[0091] Step 2:

[0092] Device:

[0093] The terminal displays an input interface for users (students) to request problems. An input field is provided for users to request "math" problems, and students can enter "math".

[0094] Step 3:

[0095] User:

[0096] The user (student) requests a "math" problem through the interface displayed on the terminal. Specifically, they enter "math" in the input field and press the send button.

[0097] Step 4:

[0098] Device:

[0099] The terminal receives the user's request and sends the request to the server.

[0100] Step 5:

[0101] server:

[0102] The server randomly selects one problem from the "Mathematics" category. If the selected problem is "2+2," it prepares the corresponding incorrect answer data "2+2=5."

[0103] Step 6:

[0104] server:

[0105] The server sends the selected question "2+2" and the incorrect answer data "2+2=5" to the terminal.

[0106] Step 7:

[0107] Device:

[0108] The device displays the question selected by the user, "2+2," and the incorrect answer, "2+2=5." Specifically,

[0109] Problem: 2+2

[0110] Choices: 5

[0111] and provides a field where the user can enter their answer.

[0112] Step 8:

[0113] User:

[0114] The user (student) looks at the question, thinks for himself / herself, decides on the correct answer "4", and enters "4" in the input field on the terminal.

[0115] Step 9:

[0116] Device:

[0117] The terminal sends the answer "4" entered by the user to the server.

[0118] Step 10:

[0119] server:

[0120] The server compares the received user answer "4" with the correct answer data "4" for the question "2+2." In this case, it matches the correct answer data, so it is determined to be the correct answer.

[0121] Step 11:

[0122] server:

[0123] The server sends the "correct answer" as the evaluation result to the terminal.

[0124] Step 12:

[0125] Device:

[0126] The terminal notifies the user of the evaluation result received from the server. Specifically, a message stating "The answer is correct" is displayed on the terminal.

[0127] In this way, the system can present students with problems, give them the opportunity to think for themselves, and provide feedback to further their learning.

[0128] Example 1

[0129] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0130] In conventional educational systems, students do not receive timely feedback on their answers, which can lead to a decline in motivation to learn and makes it difficult to grasp their level of understanding.In addition, the provision of incorrect answer data is fixed, which makes it difficult to cover the various mistakes made by students, making it difficult to resolve students' lack of understanding.

[0131] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0132] In this invention, the server includes a means for initializing a database that stores educational data, a means for randomly selecting educational questions and corresponding incorrect answer data requested by students and presenting them to the students, and a means for comparing the input answers with the correct answer data and generating evaluation results, thereby enabling the presentation of appropriate questions in response to requests and real-time feedback.

[0133] "Educational data" is a general term for information including educational questions, correct answer data, and incorrect answer data.

[0134] A "database" is a system that can systematically store, manage, and search educational data.

[0135] A "request" is the act of a student requesting the server for the question they wish to answer, or the information about that question.

[0136] A "problem" is an educational task or question posed to students.

[0137] "Incorrect answer data" is information about incorrect answers to questions.

[0138] "Correct answer data" is information on the correct answer to a question.

[0139] "Evaluation results" are information on the results obtained after comparing the student's answers with the correct answer data.

[0140] "Feedback" refers to replies and comments based on the evaluation results of students' answers.

[0141] An "input field" is an area on the device screen where a student enters an answer.

[0142] A "server" is a computer system that processes requests, selects questions, evaluates answers, and provides feedback.

[0143] A "terminal" is a device that students directly operate to display questions and input answers.

[0144] This invention is an educational system that utilizes a database for storing educational data, and is particularly equipped with a structure for smoothly carrying out a series of processes from presenting questions to evaluating answers and providing feedback. This invention is realized primarily through the interaction of three parties: a server, a terminal, and a user. The specific configuration and processing for implementing this system are described below.

[0145] Initialization

[0146] The server initializes a database that stores educational data. This database stores educational questions, correct answer data, and incorrect answer data for each subject. For example, a relational database management system (RDBMS) such as MySQL (registered trademark) or PostgreSQL is used as the database management system. During initialization, "2 + 2" and "3 + 5" are entered as educational questions for a specific subject (e.g., "Mathematics"), and the correct answer data ("4" and "8") and incorrect answer data ("2 + 2 = 5" and "3 + 5 = 9") for each are stored.

[0147] Problem Statement

[0148] The device receives requests for educational questions from the user. If the user requests a "Mathematics" question, the request is sent from the device to the server. This request is made, for example, via an HTTP request using a RESTful API. When the server receives the request, it randomly selects a question for the relevant subject from the database. The selected question and its incorrect answer data are packaged in JSON format and sent to the device.

[0149] The device visually displays the received educational questions and incorrect answer data to the user. As an example, it presents the question "2+2" and the answer choice "5." It also provides an input field for students to enter their answers. The user interface is dynamically generated using HTML, CSS, and JavaScript (registered trademark).

[0150] User Answers

[0151] The user looks at the displayed question and options, thinks of their answer, and enters the answer, for example, "4." This input is done by keyboard operation or by clicking the submit button. The entered answer is sent to the server by the terminal. The transmission uses the HTTP protocol and a data package in JSON format.

[0152] Submitting and rating answers

[0153] The server compares the received user answer with the correct answer data. The server retrieves the correct answer data ("4") for the problem "2+2" from the database and compares it with the answer ("4") provided by the user. If the answer is correct, the server evaluates it as "correct," and if it is incorrect, it evaluates it as "incorrect." This evaluation result is again packaged in JSON format and sent back to the terminal.

[0154] Feedback of evaluation results

[0155] The terminal notifies the user of the evaluation result received from the server, for example by displaying a message such as "Correct" or "Incorrect." The display of the feedback is also implemented using HTML, CSS, and JavaScript.

[0156] Example prompt

[0157] Here are some example prompts to input to the generative AI model:

[0158] Example questions to the generative AI model:

[0159] Please suggest what options should be presented as incorrect answers in mathematics problems provided by the education system. For example, for the problem "2 + 2," please list some appropriate incorrect answers in addition to the correct answer. Also, please explain the rationale for these incorrect answers.

[0160] As described above, the present invention realizes an efficient education system by linking together the elements of the server, terminal, and user.

[0161] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0162] Step 1:

[0163] The server initializes a database that stores educational data. The database registers educational questions, correct answer data, and incorrect answer data for each subject. As a concrete example, the "Mathematics" category contains the problems "2+2" and "3+5," and the correct answer data "4" and "8" are stored, along with the corresponding incorrect answer data "2+2=5" and "3+5=9." The input is the educational dataset, and the output is the initialized database.

[0164] Step 2:

[0165] The user requests a "math" problem from the device. This request is sent as an HTTP request using, for example, a RESTful API. The input is the request information from the user, and the output is an HTTP request that sends that request to the server. The specific operation is the act of the user requesting a problem using the device interface.

[0166] Step 3:

[0167] When the server receives the request, it randomly selects a problem in the "Mathematics" category from the database. This selection is performed using an SQL query. For example, select the problem "2+2" and prepare the corresponding incorrect answer data "2+2=5". The input is the user's request and the database, and the output is a JSON response containing the selected problem and the incorrect answer data.

[0168] Step 4:

[0169] The device visually displays the questions and incorrect answer data received from the server to the user. An example display is "Question: 2+2, Choices: 5." This display is styled with HTML and CSS and dynamically updated with JavaScript. The input is the JSON response from the server, and the output is a screen that the user can visually confirm.

[0170] Step 5:

[0171] The user looks at the displayed question and options, thinks of an answer, and enters the answer, for example, "4." This input involves the specific action of entering a number on the keyboard into the input field of the terminal. The input is the user's answer, and the output is the data sent to the terminal.

[0172] Step 6:

[0173] The terminal sends the entered answer to the server. This data is again sent using the HTTP protocol. The input is the user's answer data, and the output is the HTTP request sent to the server.

[0174] Step 7:

[0175] The server checks the received answer data against the correct answer data. It compares the correct answer data "4" for "2+2" with the user's answer "4". If the answer is correct, it generates an evaluation of "correct", and if the answer is incorrect, it generates an evaluation of "incorrect". The input is the user's answer and correct answer data, and the output is a JSON response as the evaluation result.

[0176] Step 8:

[0177] The device receives the evaluation results from the server and displays them to the user. For example, it displays a message on the screen saying "Your answer is correct." This display is also constructed using HTML and CSS and updated using JavaScript. The input is the JSON response from the server, and the output is a feedback message that the user can visually confirm.

[0178] (Application example 1)

[0179] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0180] Existing educational systems are primarily aimed at providing students with basic learning, but do not address the acquisition of specialized skills, particularly the operational skills required for factory operators. Because operating factory equipment incorrectly can lead to serious accidents, effective education is needed to prevent operational errors. Furthermore, interactive usability, which allows operators to learn while actually operating the equipment, is also important. A system that can solve these problems is needed.

[0181] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0182] In this invention, the server includes a database means for storing educational data, a processing means for selecting educational questions to be presented to the user and corresponding incorrect answer data, and a display means for presenting the educational questions and incorrect answer data to the user. This makes it possible to receive learning requests from operators and provide appropriate educational questions. Furthermore, a visual display means corresponding to smart glasses or a head-mounted display allows operators to solve educational questions in the actual field, experience incorrect operations, and learn correct operations. Furthermore, by using a feedback means for evaluating input answers and providing feedback based on the evaluation results, it becomes easier for operators to immediately understand correct operating methods.

[0183] "Educational data" refers to data that includes the learning materials and questions necessary for the user to study, as well as related information.

[0184] A "database" is a data storage system that stores educational data and allows it to be searched and retrieved as needed.

[0185] "Processing means" refers to a computing device or algorithm that selects educational questions and incorrect answer data based on given input data and presents them to the user at the appropriate time.

[0186] "Display means" refers to a device for visually presenting the selected educational question and incorrect answer data to the user, and specifically includes smart glasses and a head-mounted display.

[0187] "Input means" refers to an interface that allows a user to input answers to educational questions, such as a keyboard or touch panel.

[0188] "Evaluation means" refers to a device or algorithm that compares the inputted user's answer with correct answer data and evaluates it based on the results.

[0189] "Feedback means" refers to a mechanism for informing users of correct operation methods and learning content based on the evaluation results.

[0190] "Server means" refers to a computer system for managing an educational database and processing requests from users.

[0191] "Visual display means" refers to a device for displaying educational questions and feedback through smart glasses or a head-mounted display worn by the user.

[0192] "Educational questions related to the operation of factory equipment" are questions related to the operation of machinery in a factory, and include content for learning operating procedures and points to note.

[0193] "Incorrect answer data" is data that includes incorrect options or operation procedures for correct answers, and is a means of learning mistakes that users often make.

[0194] "Feedback to help learn how to operate" refers to information that shows the correct operating procedure when the user gives an incorrect answer, and provides advice and assistance so that the user can get the correct answer the next time.

[0195] This invention is an educational system specialized for training factory robot operators. By using smart glasses or a head-mounted display, users can learn about operational problems and examples of incorrect operation of factory equipment in real time and master the correct operation methods.

[0196] First, this system uses a database that stores a large amount of training data. This database contains training questions about various factory equipment operations and the corresponding incorrect answers. For example, the correct way to "start a conveyor belt" is to "press the start button," while an example of an incorrect operation is to "not press the start button."

[0197] The server receives the user's learning request, and based on that request, selects corresponding educational questions and incorrect answer data using a processing means and randomly presents them. Smart glasses or a head-mounted display are used as a display means. This allows the user to visually check the educational questions and incorrect answer data as they progress through their learning.

[0198] The user inputs answers to the displayed questions using the input means of the smart glasses or head-mounted display. This input data is sent to the server, where it is compared with the correct answer data by the server's evaluation means. Based on the evaluation results, if the operation is correct, it is judged as "correct," and if the operation is incorrect, it is judged as "incorrect," and the result is fed back to the user's smart glasses or head-mounted display.

[0199] For example, if a user incorrectly inputs "Do not press the start button" in response to a question about "starting the conveyor belt," this incorrect operation will be evaluated as an "incorrect answer" on the server side, and feedback such as "Incorrect. Please press the start button" will be displayed on the smart glasses or head-mounted display.

[0200] The implementation of this system requires the following hardware and software:

[0201] Hardware: Smart glasses (e.g., Google® Glass®), head-mounted displays (e.g., Oculus Rift)

[0202] Software: Server software (Apache Tomcat), database (MySQL), application for smart glasses and head-mounted displays (Python + OpenCV)

[0203] In addition, by using a generative AI model, it is possible to generate educational questions and incorrect answer data, and provide feedback based on evaluation results.

[0204] Here is an example of a prompt to input to a generative AI model:

[0205] In a factory robot operation training system, an operator requests learning how to "start a conveyor belt" through smart glasses. To help the operator learn the correct operation, the server needs to provide data on the correct operation ("press the start button") and the incorrect operation ("not pressing the start button"). Please specifically explain how to provide feedback to help the operator correct the problem and perform the correct operation.

[0206] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0207] Step 1:

[0208] The server initializes the database that stores the training data and registers the factory equipment operation questions and incorrect answer data. Specifically, the correct way to "start the conveyor belt" is to "press the start button," and an example of an incorrect operation is to "not press the start button," and these are added to the database.

[0209] Step 2:

[0210] The user puts on smart glasses or a head-mounted display and inputs a learning request for operation training. The user's request (e.g., "I would like to learn how to start a conveyor belt") is input.

[0211] Step 3:

[0212] The terminal sends the user's learning request to the server. The input is the request entered by the user, and the output is the request reaching the server.

[0213] Step 4:

[0214] The server randomly selects the corresponding training questions and incorrect answer data from the database based on the received learning request. The input is the user's request, and the output is the training questions and incorrect answer data extracted from the database.

[0215] Step 5:

[0216] The server sends the selected educational questions and incorrect answer data to the terminal. The input is the extracted educational questions and incorrect answer data, and the output is the transmission of the data.

[0217] Step 6:

[0218] The device visually presents the educational questions and incorrect answer data to the user. Specifically, the questions and incorrect answer data are displayed on the screen of smart glasses or a head-mounted display. The input is the educational questions and incorrect answer data sent from the server, and the output is the displayed educational content.

[0219] Step 7:

[0220] The user inputs an answer based on the presented question. Specifically, the user inputs the answer through the input interface of smart glasses or a head-mounted display. The input is the answer entered by the user, and the output is the answer data.

[0221] Step 8:

[0222] The terminal sends the user's answer to the server. The input is the user's answer and the output is the transmission.

[0223] Step 9:

[0224] The server receives the user's answer and evaluates it by comparing it with the correct answer data. Specifically, the server retrieves the correct answer data from the database and compares it with the answer. The input is the user's answer and the correct answer data, and the output is the evaluation result (correct / incorrect).

[0225] Step 10:

[0226] The server generates feedback content based on the evaluation results and sends it to the terminal. The input is the evaluation results, and the output is the transmission of the generated feedback content.

[0227] Step 11:

[0228] The device visually notifies the user of the received feedback. Specifically, the feedback content (e.g., "Incorrect. Please press the start button.") is displayed on the screen of the smart glasses or head-mounted display. The input is the feedback content sent from the server, and the output is the displayed feedback.

[0229] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0230] The present invention is an educational system that includes a database for storing educational data, a processing means for selecting educational questions and corresponding incorrect answer data, a display means for presenting the educational questions and incorrect answer data to students, an input means for inputting students' answers, an evaluation means for evaluating the input answers, a feedback means for providing feedback to students based on the evaluation results, and an emotion engine that recognizes the user's emotions and adjusts the feedback.

[0231] Program processing

[0232] Initialization

[0233] 1. Server:

[0234] When the program starts, the server initializes and loads educational data into a database. This database stores questions, correct answers, and incorrect answers for each subject. For example, the "Mathematics" category contains the question "2+2" and the corresponding correct answer "4" and incorrect answer "2+2=5."

[0235] The emotion engine is also initialized at the same time to prepare for recognizing student emotions. This engine monitors the student's facial expressions, tone of voice, keyboard typing speed, etc.

[0236] Problem Statement

[0237] 2. Terminal:

[0238] When a student requests a problem, the device sends the request to the server. The request includes, for example, a "math" problem.

[0239] When the server receives the request, it randomly selects one problem from the "Math" category, let's say "2+2".

[0240] The server prepares the incorrect answer data "2+2=5" for the selected question and sends it to the terminal.

[0241] 3. Terminal:

[0242] The terminal visually displays the questions and incorrect answers to the user (student). The displayed content is as follows:

[0243] Problem: 2+2

[0244] Choices: 5

[0245] The device also has an input field for students to enter their answers.

[0246] Recognizing user responses and emotions

[0247] 4. User:

[0248] The user (student) looks at the question, thinks for himself / herself, decides on the correct answer "4", and enters "4" in the input field on the terminal.

[0249] At the same time, the emotion engine analyzes the student's facial expressions, tone of voice, typing speed, etc. to recognize the student's current emotional state.

[0250] Submitting and rating answers

[0251] 5. Terminal:

[0252] The terminal sends the answer "4" entered by the user to the server.

[0253] 6. Server:

[0254] The server compares the received user answer "4" with the correct answer data "4" for the question "2+2." In this case, it matches the correct answer data, so it is determined to be the correct answer.

[0255] If the answer to the question is correct, the evaluation result "correct" is returned to the terminal, and if the answer is incorrect, the evaluation result "incorrect" is returned to the terminal.

[0256] Feedback on evaluation results and reflection of emotions

[0257] 7. Terminal:

[0258] The device receives the evaluation results from the server and notifies the student by displaying a message saying "Correct" or "Incorrect."

[0259] Based on the recognition results of the emotion engine, the feedback of the assessment results is adjusted. For example, if a student is nervous, an encouraging message is displayed to help them relax.

[0260] Flow of specific example

[0261] Mathematical Example

[0262] 1. Server:

[0263] During the initialization process, the server stores the correct answer "2+2=4" and the incorrect answer "2+2=5" in the database and also initializes the emotion engine.

[0264] 2. Terminal:

[0265] The terminal requests "math" problems from the server in response to a user request.

[0266] 3. Server:

[0267] The server selects the problem "2+2," prepares the corresponding incorrect answer data "2+2=5," and sends it to the terminal.

[0268] 4. Terminal:

[0269] The device displays "Question: 2+2, Choices: 5" to the student and provides a field for entering the answer.

[0270] 5. User:

[0271] The user enters the answer they believe to be correct, "4," into the device. At the same time, the emotion engine analyzes the student's facial expressions, tone of voice, and keyboard typing speed to recognize their emotions.

[0272] 6. Terminal:

[0273] The terminal sends the entered answer "4" to the server.

[0274] 7. Server:

[0275] The server evaluates the answer and, since "2+2=4" is the correct answer, sends the "correct answer" result to the terminal.

[0276] 8. Terminal:

[0277] The device displays the message "That's correct" to the user, and, based on the recognition results of the emotion engine, displays messages of encouragement or support as needed.

[0278] In this way, the system can present students with problems, provide them with opportunities to think for themselves, and even recognize their emotions and provide appropriate feedback to deepen their learning.

[0279] The processing flow will be explained below.

[0280] Step 1:

[0281] server:

[0282] The server initializes itself when the program starts. First, it loads educational data into a database. This database stores questions, correct answers, and incorrect answers for each subject. For example, the "Mathematics" category contains the question "2+2" and the corresponding correct answer "4" and incorrect answer "2+2=5." The server also initializes the emotion engine, setting parameters for emotion recognition, such as the student's facial expression, tone of voice, and keyboard typing speed.

[0283] Step 2:

[0284] Device:

[0285] The terminal displays an input interface for users (students) to request problems. For example, if a user requests a "Mathematics" problem, the terminal provides a field for entering the request and a submit button.

[0286] Step 3:

[0287] User:

[0288] The user (student) requests a "math" problem through the interface displayed on the terminal. Specifically, they enter "math" in the input field and press the send button.

[0289] Step 4:

[0290] Device:

[0291] The terminal receives the user's request and sends the content ("mathematics") to the server.

[0292] Step 5:

[0293] server:

[0294] The server analyzes the received request and randomly selects one problem from the "Mathematics" category. Let's take "2+2" as an example. Then, it prepares the correct answer data and incorrect answer data for the selected problem. For example, it prepares "2+2=5" as the incorrect answer data for the problem "2+2".

[0295] Step 6:

[0296] server:

[0297] The server sends the selected question "2+2" and the incorrect answer data "2+2=5" to the terminal.

[0298] Step 7:

[0299] Device:

[0300] The device visually displays the received question "2+2" and the incorrect answer "2+2=5" to the user. Specifically, it displays the following:

[0301] Problem: 2+2

[0302] Choices: 5

[0303] It also provides an input field for the user to enter their answer.

[0304] Step 8:

[0305] User:

[0306] The user (student) looks at the presented question, thinks for himself / herself, decides on the correct answer "4", and enters "4" in the input field on the terminal.

[0307] Step 9:

[0308] Emotion Engine (Device):

[0309] At the same time, the emotion engine analyzes the user's facial expressions, tone of voice, and keyboard input speed to recognize the user's emotional state (e.g., whether they are nervous or relaxed). The recognized emotion data is used for subsequent feedback.

[0310] Step 10:

[0311] Device:

[0312] The terminal sends the answer "4" entered by the user to the server.

[0313] Step 11:

[0314] server:

[0315] The server compares the received user answer "4" with the correct answer data "4" for the question "2+2." In this case, it matches the correct answer data, so it is determined to be the correct answer.

[0316] Step 12:

[0317] server:

[0318] The server sends the evaluation result ("correct" or "incorrect") to the terminal.

[0319] Step 13:

[0320] Device:

[0321] The device receives the evaluation result from the server and notifies the user of the result, specifically by displaying "Correct" or "Incorrect."

[0322] Step 14:

[0323] Feedback method (terminal):

[0324] It also tailors the feedback based on the emotion engine's recognition results: for example, if the user is nervous, it displays an encouraging message like, "You're doing great! Keep it up!"

[0325] In this way, the system can present students with problems, provide them with opportunities to think for themselves, and even recognize their emotions and provide appropriate feedback to deepen their learning.

[0326] Example 2

[0327] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0328] In conventional educational systems, feedback to students is constant and does not take into account the emotional state of the student, and feedback is not provided at an appropriate time or in an appropriate manner. Furthermore, problems are not presented efficiently according to the student's level of understanding, and incorrect answers are not presented, making it difficult to improve students' learning effectiveness.

[0329] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a storage device for storing educational data, a processing device for selecting educational questions to be presented to the learner and corresponding incorrect answer data, a display device for presenting the educational questions and incorrect answer data to the learner, an input device for inputting the learner's answers, an evaluation device for evaluating the input answers, a feedback device for providing feedback to the learner based on the evaluation results, and an emotion recognition device for recognizing the learner's emotions and adjusting the feedback. This makes it possible to provide feedback at an appropriate time and in an appropriate manner taking into account the student's emotional state, which is expected to improve the student's learning effectiveness.

[0330] "Educational data" refers to information such as questions, answers, and explanations that are primarily used for educational purposes.

[0331] "Storage device" refers to a medium that can save, store, read, and write data, and examples include hard disks, SSDs, and cloud storage.

[0332] "Incorrect answer data" refers to data on incorrect answers that may be other than the correct answer, and is used to check a student's understanding or correct misunderstandings.

[0333] A "processing device" is a device that performs various calculations and data processing within a computer, and includes CPUs and GPUs.

[0334] "Display device" refers to a device that visually presents data or information to a user, and includes monitors, smartphones, tablets, etc.

[0335] An "input device" is a device that allows a user to input information or data into a system, such as a keyboard, mouse, or touch panel.

[0336] An "evaluation device" is a device that analyzes data input from users and performs evaluations and judgments. For example, it has the role of comparing students' answers with correct answer data and making an evaluation.

[0337] A "feedback device" is a device that provides students with appropriate advice and information based on the evaluation results, and feedback is given in the form of text, audio, video, etc.

[0338] An "emotion recognition device" is a device that analyzes and recognizes a user's emotional state in real time, using, for example, facial expression analysis, voice tone analysis, keyboard input speed, etc.

[0339] The present invention is a storage device for storing educational data, a system for presenting educational questions and corresponding incorrect answer data to a learner, and a system for evaluating the learner's answers and providing feedback based on the evaluation results.

[0340] The server has a storage device for storing educational data. This storage device stores questions, correct answers, and incorrect answer data for each subject. For example, the educational data for "Mathematics" includes the problem "2+2," its correct answer data "4," and incorrect answer data "2+2=5." When presenting a question to a student, the server selects the necessary question and incorrect answer data from this database.

[0341] When a learner requests a question using a device, the device sends the request to the server. The server receives the request, randomly selects one question from a specified subject, such as the "Mathematics" category, and prepares the wrong answer data. This data is sent to the device and displayed to the student.

[0342] The device visually displays the questions and incorrect answers it receives, as follows:

[0343] Problem: 2+2

[0344] Choices: 5

[0345] Furthermore, the terminal is provided with an input field for the learner to enter their answer. The learner enters the answer they believe to be correct into the input field.

[0346] When the learner enters an answer, the device sends the answer to the server. The server compares the received answer with the correct answer data stored in the memory device. If the answer is correct, it is judged to be "correct" and the result is returned to the device. If the answer is incorrect, it is returned as "incorrect."

[0347] A unique feature of this system is that it takes into account the learner's emotional state when providing feedback. The emotion recognition device analyzes the learner's current emotional state in real time based on facial expressions, tone of voice, keyboard typing speed, etc. The feedback is adjusted based on the analysis results. For example, if the learner is nervous, an encouraging message to help them relax will be displayed, such as:

[0348] Correct! Great! Relax and do your best on the next question.

[0349] For example, the following prompts can be used:

[0350] Problem: 2+2

[0351] Choices: 5

[0352] This system not only presents learners with problems and gives them the opportunity to think for themselves, but also takes their emotional state into account to maximize learning effectiveness.

[0353] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0354] Step 1:

[0355] server:

[0356] When the program starts, the server performs initialization and loads the educational data into the storage device. The questions, correct answers, and incorrect answers for each subject are stored in the storage device. For example, the mathematics category contains the question "2+2," the correct answer "4," and the incorrect answer "2+2=5." The emotion recognition device is also initialized at the same time, and is ready to monitor the learner's facial expressions, tone of voice, keyboard input speed, etc. In this case, the input is the educational data file, and the output is the educational data loaded into the storage device.

[0357] Step 2:

[0358] Device:

[0359] When a learner requests a question, the device sends the request details (such as the subject category) to the server. The request details may include, for example, "Give me a math question." This request is the input data, and the request sent from the device to the server is the output.

[0360] Step 3:

[0361] server:

[0362] The server receives a request from the terminal and randomly selects one problem from the specified subject category ("Mathematics" in this case). For example, it selects the problem "2+2" and the corresponding incorrect answer data "2+2=5". This problem and the incorrect answer data become output data based on the input data and are sent to the terminal.

[0363] Step 4:

[0364] Device:

[0365] The terminal visually displays the questions and incorrect answers received from the server to the learner. The display contents are as follows:

[0366] Problem: 2+2

[0367] Choices: 5

[0368] In addition, an input field is provided for the learner to enter their answers. The input data to the terminal is the question data and incorrect answer data from the server, and the output is displayed to the learner.

[0369] Step 5:

[0370] User:

[0371] The user (learner) checks the question, thinks of the correct answer "4", and enters it into the input field on the device. At this time, the emotion recognition device monitors the learner's facial expressions, tone of voice, and keyboard input speed. The user's input data is the answer "4", and the output is the data entered into the input field on the device.

[0372] Step 6:

[0373] Device:

[0374] The terminal sends the answer "4" entered by the learner to the server. The input data is the learner's answer "4", and the output is to send that data to the server.

[0375] Step 7:

[0376] server:

[0377] The server compares the received answer "4" with the correct answer data "4" stored in the memory device. In this case, it matches the correct answer data for "2+2," which is "4," so it is determined to be the correct answer. The input data is the learner's answer "4," and the output data is "correct answer." This evaluation result is sent to the terminal.

[0378] Step 8:

[0379] Device:

[0380] The device notifies the learner of the evaluation results received from the server. Feedback such as "Your answer is correct" is displayed. At the same time, based on the analysis results of the emotion recognition device, an encouraging message such as "Relax and do your best on the next question" is displayed. The input data are the evaluation results from the server and the analysis results of the emotion recognition device, and the output is the display of the feedback message to the learner.

[0381] (Application example 2)

[0382] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0383] In conventional educational systems, feedback to students is uniform, making it difficult to respond appropriately to students' emotions and learning progress. As a result, the stress and confusion students feel during the learning process can have a negative impact on their learning outcomes. Furthermore, the method of presenting incorrect answer data is fixed, resulting in a lack of ingenuity to improve the quality of the educational experience.

[0384] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a database for storing educational data, a processing means for selecting educational questions to be presented to students and corresponding incorrect answer data, and a display means for presenting the educational questions and incorrect answer data to students. This enables real-time feedback adjustment for students based on their individual emotional states. Furthermore, by using an emotion engine, it is possible to recognize students' emotions and adjust feedback, thereby reducing stress and confusion for students and supporting effective learning. Furthermore, by randomly selecting incorrect answer data, the quality of the educational experience can be improved.

[0385] "Educational data" refers to the learning content, questions, and answer data presented to students.

[0386] A "database" is a system for systematically storing and managing educational data.

[0387] "Processing means" refers to a device or algorithm for selecting educational questions and corresponding incorrect answer data.

[0388] "Display means" means a screen, display, or visual display device for presenting educational questions and incorrect answer data to a student.

[0389] An "input means" is a keyboard, touch screen, or other input device through which a student enters their answer.

[0390] The "evaluation means" refers to a device or logic that collates the input answer with the correct answer data and evaluates it based on the results.

[0391] A "feedback means" is a device or logic for providing feedback to students based on the assessment results.

[0392] The "emotion engine" is a system that analyzes information such as students' facial expressions, tone of voice, and typing speed to recognize their emotions.

[0393] The "real-time feedback adjustment means" refers to a device or logic for adjusting the feedback content in real time based on the recognition results of the emotion engine.

[0394] The term "system" refers to a set of devices and software including the various means described above.

[0395] System Overview

[0396] The present invention relates to an educational system, and an embodiment of the system includes a database for storing educational data, a processing means for selecting questions and incorrect answer data, a display means, an input means, an evaluation means, a feedback means, an emotion engine, and a real-time feedback adjustment means. Specifically, the present invention is embodied in the form of a learning support application called "EduVision."

[0397] Program processing

[0398] server

[0399] During initialization, the server loads educational data into the database. The educational data includes questions, correct answers, and incorrect answers for each subject. The emotion engine is also initialized at the same time, preparing to recognize students' emotions. This engine monitors students' facial expressions, tone of voice, keyboard typing speed, etc.

[0400] In response to a request, the server randomly selects questions from a specific subject, such as "Mathematics." For the selected questions, incorrect answer data is also randomly selected and sent to the terminal via the display means.

[0401] Terminal

[0402] Based on the student's request, the device receives questions and incorrect answers from the server and visually displays them to the student. The student looks at the presented questions and options and enters their answer using the input means. At the same time, the emotion engine recognizes the student's emotions and analyzes the results.

[0403] The device sends the entered answer to the server, which compares it with the correct answer data. Based on the comparison result, an evaluation result of whether the answer is correct or incorrect is returned to the device. The device provides feedback to the student based on the evaluation result and adjusts the feedback based on the recognition results of the emotion engine.

[0404] Hardware and software processing

[0405] Hardware: Servers, terminals (PCs, smartphones, tablets, smart glasses, head-mounted displays)

[0406] Software: Educational database, emotion engine, feedback adjustment program

[0407] Example: The emotion engine uses a webcam to capture the student's facial expressions and a microphone to analyze the tone of their voice.

[0408] The evaluation means uses an algorithm that compares input data with ground truth data stored in a database.

[0409] Examples and prompts

[0410] As a concrete example, imagine a situation where the options "1. 7," "2. 8," and "3. 9" are displayed for the math problem "3 + 5 = ?". The user selects and enters the option they think is correct.

[0411] Example prompt sentence:

[0412] “Let’s solve a math problem. Answer the following question: 3 + 5 = ?

[0413] Select from:

[0414] 1. 7

[0415] 2.8

[0416] 3.9

[0417] What's your answer?

[0418] Now, let's think about it. It's okay if you make a mistake. Don't worry!

[0419] The prompts allow students to calmly tackle the problems, improving their learning effectiveness. Feedback adjustments by the emotion engine optimize the learning experience for each individual student.

[0420] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0421] Step 1:

[0422] The server starts the initialization process and loads the educational data into the database. The database stores questions, correct answers, and incorrect answers for each subject. At the same time, it initializes the emotion engine and prepares it to recognize students' emotions.

[0423] Input: Educational data

[0424] Output: Initialized database and emotion engine

[0425] Step 2:

[0426] The device sends the student's request to the server, which may include, for example, a "math" question.

[0427] Input: Student Request

[0428] Output: Request data to the server

[0429] Step 3:

[0430] When the server receives the request, it randomly selects one question from a specific subject (for example, "Mathematics") and also randomly selects the wrong answer data corresponding to that question.

[0431] Input: Student Request

[0432] Output: Selected questions and incorrect answers

[0433] Step 4:

[0434] The device receives the selected question and incorrect answer data and visually displays it to the student. The displayed content includes the question text and the incorrect answer options.

[0435] Input: Questions and incorrect answers sent from the server

[0436] Output: Questions and choices displayed on the device screen

[0437] Step 5:

[0438] The user (student) looks at the presented question and enters their answer. At the same time, the emotion engine monitors the student's facial expression, tone of voice, keyboard typing speed, etc. to analyze their emotional state.

[0439] Input: Data about student responses and student emotions

[0440] Output: Parsed emotional state and student response data

[0441] Step 6:

[0442] The device sends the student's answer to the server. The server compares the received answer with the correct answer data and evaluates the result. If the answer is correct, the result "correct" is returned, and if the answer is incorrect, the result "incorrect" is returned.

[0443] Input: Student response data

[0444] Output: Evaluation result (correct or incorrect)

[0445] Step 7:

[0446] The device receives the evaluation results from the server and provides feedback to the student. It also adjusts the feedback based on the recognition results of the emotion engine. For example, it adds an encouraging message to a nervous student.

[0447] Input: Evaluation results from the server and recognition results from the emotion engine

[0448] Output: Adjusted feedback content

[0449] Step 8:

[0450] The device displays the adjusted feedback to the student, who can then proceed to the next question or review the feedback. The cycle starts again when the student requests the next question.

[0451] Input: Adjusted feedback, student's next request

[0452] Output: Feedback shown to the student and preparation for the next question

[0453] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0454] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0455] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0456] [Second embodiment]

[0457] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0458] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0459] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0460] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0461] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0462] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0463] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0464] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0465] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0466] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0467] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0468] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0469] The present invention is an educational system that includes a database for storing educational data, a processing means for selecting educational questions and incorrect answer data, a display means for presenting the educational questions and incorrect answer data to students, an input means for inputting students' answers, an evaluation means for evaluating the answers, and a feedback means for providing feedback to students based on the evaluation results.

[0470] Program processing

[0471] Initialization

[0472] 1. Server:

[0473] The server first initializes a database containing educational data, which stores educational questions for each subject, correct answer data, and corresponding incorrect answer data.

[0474] For example, the educational questions in the "Mathematics" category include "2+2" and "3+5", and the corresponding incorrect answer data include "2+2=5" and "3+5=9".

[0475] Problem Statement

[0476] 2. Terminal:

[0477] When a student requests a "math" problem, the terminal sends the request to the server.

[0478] When the server receives the request, it randomly selects one problem from the "Math" category, let's say "2+2".

[0479] The server prepares the incorrect answer data "2+2=5" for the selected question and sends it to the terminal.

[0480] 3. Terminal:

[0481] The terminal visually displays the questions and incorrect answers to the user (student). The displayed content is as follows:

[0482] Problem: 2+2

[0483] Choices: 5

[0484] The device also has an input field for students to enter their answers.

[0485] User Answers

[0486] 4. User:

[0487] The user looks at the question and options displayed on the terminal, thinks about their answer, and if they think "2+2=4," they enter "4" into the terminal.

[0488] Submitting and rating answers

[0489] 5. Terminal:

[0490] The terminal sends the student's inputted answers to the server.

[0491] 6. Server:

[0492] The server compares the received answer "4" with the correct answer data for "2+2." Since the correct answer data for "2+2" is "4," the server confirms that the student's answer is correct.

[0493] If the answer to the question is correct, the evaluation result "correct" is returned to the terminal, and if the answer is incorrect, the evaluation result "incorrect" is returned to the terminal.

[0494] Feedback of evaluation results

[0495] 7. Terminal:

[0496] The terminal receives the evaluation results from the server and notifies the student, displaying a message like the following:

[0497] "Correct" or "Incorrect"

[0498] Flow of specific example

[0499] Mathematical Example

[0500] 1. Server:

[0501] During the initialization process, the server stores the correct answer "2+2=4" and the incorrect answer "2+2=5" in a database.

[0502] 2. Terminal:

[0503] The terminal requests "math" problems from the server in response to a user request.

[0504] 3. Server:

[0505] The server selects the problem "2+2," prepares the corresponding incorrect answer data "2+2=5," and sends it to the terminal.

[0506] 4. Terminal:

[0507] The device displays "Question: 2+2, Choices: 5" to the student and provides a field for entering the answer.

[0508] 5. User:

[0509] The user enters what they believe to be the correct answer, "4," into the terminal.

[0510] 6. Terminal:

[0511] The terminal sends the entered answer "4" to the server.

[0512] 7. Server:

[0513] The server evaluates the answer and, since "2+2=4" is the correct answer, sends the "correct answer" result to the terminal.

[0514] 8. Terminal:

[0515] The terminal displays the message "Correct" to the user.

[0516] In this way, students are provided with opportunities for independent learning and can develop critical thinking skills.

[0517] The processing flow will be explained below.

[0518] Step 1:

[0519] server:

[0520] When the program starts, the server initializes and loads educational data into a database. This database stores questions, correct answers, and incorrect answers for each subject. For example, the "Mathematics" category contains the question "2+2" and the corresponding correct answer "4" and incorrect answer "2+2=5."

[0521] Step 2:

[0522] Device:

[0523] The terminal displays an input interface for users (students) to request problems. An input field is provided for users to request "math" problems, and students can enter "math".

[0524] Step 3:

[0525] User:

[0526] The user (student) requests a "math" problem through the interface displayed on the terminal. Specifically, they enter "math" in the input field and press the send button.

[0527] Step 4:

[0528] Device:

[0529] The terminal receives the user's request and sends the request to the server.

[0530] Step 5:

[0531] server:

[0532] The server randomly selects one problem from the "Mathematics" category. If the selected problem is "2+2," it prepares the corresponding incorrect answer data "2+2=5."

[0533] Step 6:

[0534] server:

[0535] The server sends the selected question "2+2" and the incorrect answer data "2+2=5" to the terminal.

[0536] Step 7:

[0537] Device:

[0538] The device displays the question selected by the user, "2+2," and the incorrect answer, "2+2=5." Specifically,

[0539] Problem: 2+2

[0540] Choices: 5

[0541] and provides a field where the user can enter their answer.

[0542] Step 8:

[0543] User:

[0544] The user (student) looks at the question, thinks for himself / herself, decides on the correct answer "4", and enters "4" in the input field on the terminal.

[0545] Step 9:

[0546] Device:

[0547] The terminal sends the answer "4" entered by the user to the server.

[0548] Step 10:

[0549] server:

[0550] The server compares the received user answer "4" with the correct answer data "4" for the question "2+2." In this case, it matches the correct answer data, so it is determined to be the correct answer.

[0551] Step 11:

[0552] server:

[0553] The server sends the "correct answer" as the evaluation result to the terminal.

[0554] Step 12:

[0555] Device:

[0556] The terminal notifies the user of the evaluation result received from the server. Specifically, a message stating "The answer is correct" is displayed on the terminal.

[0557] In this way, the system can present students with problems, give them the opportunity to think for themselves, and provide feedback to further their learning.

[0558] Example 1

[0559] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0560] In conventional educational systems, students do not receive timely feedback on their answers, which can lead to a decline in motivation to learn and makes it difficult to grasp their level of understanding.In addition, the provision of incorrect answer data is fixed, which makes it difficult to cover the various mistakes made by students, making it difficult to resolve students' lack of understanding.

[0561] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0562] In this invention, the server includes a means for initializing a database that stores educational data, a means for randomly selecting educational questions and corresponding incorrect answer data requested by students and presenting them to the students, and a means for comparing the input answers with the correct answer data and generating evaluation results, thereby enabling the presentation of appropriate questions in response to requests and real-time feedback.

[0563] "Educational data" is a general term for information including educational questions, correct answer data, and incorrect answer data.

[0564] A "database" is a system that can systematically store, manage, and search educational data.

[0565] A "request" is the act of a student requesting the server for the question they wish to answer, or the information about that question.

[0566] A "problem" is an educational task or question posed to students.

[0567] "Incorrect answer data" is information about incorrect answers to questions.

[0568] "Correct answer data" is information on the correct answer to a question.

[0569] "Evaluation results" are information on the results obtained after comparing the student's answers with the correct answer data.

[0570] "Feedback" refers to replies and comments based on the evaluation results of students' answers.

[0571] An "input field" is an area on the device screen where a student enters an answer.

[0572] A "server" is a computer system that processes requests, selects questions, evaluates answers, and provides feedback.

[0573] A "terminal" is a device that students directly operate to display questions and input answers.

[0574] This invention is an educational system that utilizes a database for storing educational data, and is particularly equipped with a structure for smoothly carrying out a series of processes from presenting questions to evaluating answers and providing feedback. This invention is realized primarily through the interaction of three parties: a server, a terminal, and a user. The specific configuration and processing for implementing this system are described below.

[0575] Initialization

[0576] The server initializes a database that stores educational data. This database stores educational questions, correct answer data, and incorrect answer data for each subject. For example, a relational database management system (RDBMS) such as MySQL or PostgreSQL is used as the database management system. During initialization, "2 + 2" and "3 + 5" are entered as educational questions for a specific subject (e.g., "Mathematics"), and the correct answer data ("4" and "8") and incorrect answer data ("2 + 2 = 5" and "3 + 5 = 9") for each are stored.

[0577] Problem Statement

[0578] The device receives requests for educational questions from the user. If the user requests a "Mathematics" question, the request is sent from the device to the server. This request is made, for example, via an HTTP request using a RESTful API. When the server receives the request, it randomly selects a question for the relevant subject from the database. The selected question and its incorrect answer data are packaged in JSON format and sent to the device.

[0579] The device visually displays the received educational questions and incorrect answer data to the user. As an example, it shows the question "2+2" and the answer choice "5." It also provides an input field for students to enter their answers. The user interface is dynamically generated using HTML, CSS, and JavaScript.

[0580] User Answers

[0581] The user looks at the displayed question and options, thinks of their answer, and enters the answer, for example, "4." This input is done by keyboard operation or by clicking the submit button. The entered answer is sent to the server by the terminal. The transmission uses the HTTP protocol and a data package in JSON format.

[0582] Submitting and rating answers

[0583] The server compares the received user answer with the correct answer data. The server retrieves the correct answer data ("4") for the problem "2+2" from the database and compares it with the answer ("4") provided by the user. If the answer is correct, the server evaluates it as "correct," and if it is incorrect, it evaluates it as "incorrect." This evaluation result is again packaged in JSON format and sent back to the terminal.

[0584] Feedback of evaluation results

[0585] The terminal notifies the user of the evaluation result received from the server, for example by displaying a message such as "Correct" or "Incorrect." The display of the feedback is also implemented using HTML, CSS, and JavaScript.

[0586] Example prompt

[0587] Here are some example prompts to input to the generative AI model:

[0588] Example questions to the generative AI model:

[0589] Please suggest what options should be presented as incorrect answers in mathematics problems provided by the education system. For example, for the problem "2 + 2," please list some appropriate incorrect answers in addition to the correct answer. Also, please explain the rationale for these incorrect answers.

[0590] As described above, the present invention realizes an efficient education system by linking together the elements of the server, terminal, and user.

[0591] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0592] Step 1:

[0593] The server initializes a database that stores educational data. The database registers educational questions, correct answer data, and incorrect answer data for each subject. As a concrete example, the "Mathematics" category contains the problems "2+2" and "3+5," and the correct answer data "4" and "8" are stored, along with the corresponding incorrect answer data "2+2=5" and "3+5=9." The input is the educational dataset, and the output is the initialized database.

[0594] Step 2:

[0595] The user requests a "math" problem from the device. This request is sent as an HTTP request using, for example, a RESTful API. The input is the request information from the user, and the output is an HTTP request that sends that request to the server. The specific operation is the act of the user requesting a problem using the device interface.

[0596] Step 3:

[0597] When the server receives the request, it randomly selects a problem in the "Mathematics" category from the database. This selection is performed using an SQL query. For example, select the problem "2+2" and prepare the corresponding incorrect answer data "2+2=5". The input is the user's request and the database, and the output is a JSON response containing the selected problem and the incorrect answer data.

[0598] Step 4:

[0599] The device visually displays the questions and incorrect answer data received from the server to the user. An example display is "Question: 2+2, Choices: 5." This display is styled with HTML and CSS and dynamically updated with JavaScript. The input is the JSON response from the server, and the output is a screen that the user can visually confirm.

[0600] Step 5:

[0601] The user looks at the displayed question and options, thinks of an answer, and enters the answer, for example, "4." This input involves the specific action of entering a number on the keyboard into the input field of the terminal. The input is the user's answer, and the output is the data sent to the terminal.

[0602] Step 6:

[0603] The terminal sends the entered answer to the server. This data is again sent using the HTTP protocol. The input is the user's answer data, and the output is the HTTP request sent to the server.

[0604] Step 7:

[0605] The server checks the received answer data against the correct answer data. It compares the correct answer data "4" for "2+2" with the user's answer "4". If the answer is correct, it generates an evaluation of "correct", and if the answer is incorrect, it generates an evaluation of "incorrect". The input is the user's answer and correct answer data, and the output is a JSON response as the evaluation result.

[0606] Step 8:

[0607] The device receives the evaluation results from the server and displays them to the user. For example, it displays a message on the screen saying "Your answer is correct." This display is also constructed using HTML and CSS and updated using JavaScript. The input is the JSON response from the server, and the output is a feedback message that the user can visually confirm.

[0608] (Application example 1)

[0609] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0610] Existing educational systems are primarily aimed at providing students with basic learning, but do not address the acquisition of specialized skills, particularly the operational skills required for factory operators. Because operating factory equipment incorrectly can lead to serious accidents, effective education is needed to prevent operational errors. Furthermore, interactive usability, which allows operators to learn while actually operating the equipment, is also important. A system that can solve these problems is needed.

[0611] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0612] In this invention, the server includes a database means for storing educational data, a processing means for selecting educational questions to be presented to the user and corresponding incorrect answer data, and a display means for presenting the educational questions and incorrect answer data to the user. This makes it possible to receive learning requests from operators and provide appropriate educational questions. Furthermore, a visual display means corresponding to smart glasses or a head-mounted display allows operators to solve educational questions in the actual field, experience incorrect operations, and learn correct operations. Furthermore, by using a feedback means for evaluating input answers and providing feedback based on the evaluation results, it becomes easier for operators to immediately understand correct operating methods.

[0613] "Educational data" refers to data that includes the learning materials and questions necessary for the user to study, as well as related information.

[0614] A "database" is a data storage system that stores educational data and allows it to be searched and retrieved as needed.

[0615] "Processing means" refers to a computing device or algorithm that selects educational questions and incorrect answer data based on given input data and presents them to the user at the appropriate time.

[0616] "Display means" refers to a device for visually presenting the selected educational question and incorrect answer data to the user, and specifically includes smart glasses and a head-mounted display.

[0617] "Input means" refers to an interface that allows a user to input answers to educational questions, such as a keyboard or touch panel.

[0618] "Evaluation means" refers to a device or algorithm that compares the inputted user's answer with correct answer data and evaluates it based on the results.

[0619] "Feedback means" refers to a mechanism for informing users of correct operation methods and learning content based on the evaluation results.

[0620] "Server means" refers to a computer system for managing an educational database and processing requests from users.

[0621] "Visual display means" refers to a device for displaying educational questions and feedback through smart glasses or a head-mounted display worn by the user.

[0622] "Educational questions related to the operation of factory equipment" are questions related to the operation of machinery in a factory, and include content for learning operating procedures and points to note.

[0623] "Incorrect answer data" is data that includes incorrect options or operation procedures for correct answers, and is a means of learning mistakes that users often make.

[0624] "Feedback to help learn how to operate" refers to information that shows the correct operating procedure when the user gives an incorrect answer, and provides advice and assistance so that the user can get the correct answer the next time.

[0625] This invention is an educational system specialized for training factory robot operators. By using smart glasses or a head-mounted display, users can learn about operational problems and examples of incorrect operation of factory equipment in real time and master the correct operation methods.

[0626] First, this system uses a database that stores a large amount of training data. This database contains training questions about various factory equipment operations and the corresponding incorrect answers. For example, the correct way to "start a conveyor belt" is to "press the start button," while an example of an incorrect operation is to "not press the start button."

[0627] The server receives the user's learning request, and based on that request, selects corresponding educational questions and incorrect answer data using a processing means and randomly presents them. Smart glasses or a head-mounted display are used as a display means. This allows the user to visually check the educational questions and incorrect answer data as they progress through their learning.

[0628] The user inputs answers to the displayed questions using the input means of the smart glasses or head-mounted display. This input data is sent to the server, where it is compared with the correct answer data by the server's evaluation means. Based on the evaluation results, if the operation is correct, it is judged as "correct," and if the operation is incorrect, it is judged as "incorrect," and the result is fed back to the user's smart glasses or head-mounted display.

[0629] For example, if a user incorrectly inputs "Do not press the start button" in response to a question about "starting the conveyor belt," this incorrect operation will be evaluated as an "incorrect answer" on the server side, and feedback such as "Incorrect. Please press the start button" will be displayed on the smart glasses or head-mounted display.

[0630] The implementation of this system requires the following hardware and software:

[0631] Hardware: Smart glasses (e.g., Google Glass), head-mounted displays (e.g., Oculus Rift)

[0632] Software: Server software (Apache Tomcat), database (MySQL), application for smart glasses and head-mounted displays (Python + OpenCV)

[0633] In addition, by using a generative AI model, it is possible to generate educational questions and incorrect answer data, and provide feedback based on evaluation results.

[0634] Here is an example of a prompt to input to a generative AI model:

[0635] In a factory robot operation training system, an operator requests learning how to "start a conveyor belt" through smart glasses. To help the operator learn the correct operation, the server needs to provide data on the correct operation ("press the start button") and the incorrect operation ("not pressing the start button"). Please specifically explain how to provide feedback to help the operator correct the problem and perform the correct operation.

[0636] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0637] Step 1:

[0638] The server initializes the database that stores the training data and registers the factory equipment operation questions and incorrect answer data. Specifically, the correct way to "start the conveyor belt" is to "press the start button," and an example of an incorrect operation is to "not press the start button," and these are added to the database.

[0639] Step 2:

[0640] The user puts on smart glasses or a head-mounted display and inputs a learning request for operation training. The user's request (e.g., "I would like to learn how to start a conveyor belt") is input.

[0641] Step 3:

[0642] The terminal sends the user's learning request to the server. The input is the request entered by the user, and the output is the request reaching the server.

[0643] Step 4:

[0644] The server randomly selects the corresponding training questions and incorrect answer data from the database based on the received learning request. The input is the user's request, and the output is the training questions and incorrect answer data extracted from the database.

[0645] Step 5:

[0646] The server sends the selected educational questions and incorrect answer data to the terminal. The input is the extracted educational questions and incorrect answer data, and the output is the transmission of the data.

[0647] Step 6:

[0648] The device visually presents the educational questions and incorrect answer data to the user. Specifically, the questions and incorrect answer data are displayed on the screen of smart glasses or a head-mounted display. The input is the educational questions and incorrect answer data sent from the server, and the output is the displayed educational content.

[0649] Step 7:

[0650] The user inputs an answer based on the presented question. Specifically, the user inputs the answer through the input interface of smart glasses or a head-mounted display. The input is the answer entered by the user, and the output is the answer data.

[0651] Step 8:

[0652] The terminal sends the user's answer to the server. The input is the user's answer and the output is the transmission.

[0653] Step 9:

[0654] The server receives the user's answer and evaluates it by comparing it with the correct answer data. Specifically, the server retrieves the correct answer data from the database and compares it with the answer. The input is the user's answer and the correct answer data, and the output is the evaluation result (correct / incorrect).

[0655] Step 10:

[0656] The server generates feedback content based on the evaluation results and sends it to the terminal. The input is the evaluation results, and the output is the transmission of the generated feedback content.

[0657] Step 11:

[0658] The device visually notifies the user of the received feedback. Specifically, the feedback content (e.g., "Incorrect. Please press the start button.") is displayed on the screen of the smart glasses or head-mounted display. The input is the feedback content sent from the server, and the output is the displayed feedback.

[0659] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0660] The present invention is an educational system that includes a database for storing educational data, a processing means for selecting educational questions and corresponding incorrect answer data, a display means for presenting the educational questions and incorrect answer data to students, an input means for inputting students' answers, an evaluation means for evaluating the input answers, a feedback means for providing feedback to students based on the evaluation results, and an emotion engine that recognizes the user's emotions and adjusts the feedback.

[0661] Program processing

[0662] Initialization

[0663] 1. Server:

[0664] When the program starts, the server initializes and loads educational data into a database. This database stores questions, correct answers, and incorrect answers for each subject. For example, the "Mathematics" category contains the question "2+2" and the corresponding correct answer "4" and incorrect answer "2+2=5."

[0665] The emotion engine is also initialized at the same time to prepare for recognizing student emotions. This engine monitors the student's facial expressions, tone of voice, keyboard typing speed, etc.

[0666] Problem Statement

[0667] 2. Terminal:

[0668] When a student requests a problem, the device sends the request to the server. The request includes, for example, a "math" problem.

[0669] When the server receives the request, it randomly selects one problem from the "Math" category, let's say "2+2".

[0670] The server prepares the incorrect answer data "2+2=5" for the selected question and sends it to the terminal.

[0671] 3. Terminal:

[0672] The terminal visually displays the questions and incorrect answers to the user (student). The displayed content is as follows:

[0673] Problem: 2+2

[0674] Choices: 5

[0675] The device also has an input field for students to enter their answers.

[0676] Recognizing user responses and emotions

[0677] 4. User:

[0678] The user (student) looks at the question, thinks for himself / herself, decides on the correct answer "4", and enters "4" in the input field on the terminal.

[0679] At the same time, the emotion engine analyzes the student's facial expressions, tone of voice, typing speed, etc. to recognize the student's current emotional state.

[0680] Submitting and rating answers

[0681] 5. Terminal:

[0682] The terminal sends the answer "4" entered by the user to the server.

[0683] 6. Server:

[0684] The server compares the received user answer "4" with the correct answer data "4" for the question "2+2." In this case, it matches the correct answer data, so it is determined to be the correct answer.

[0685] If the answer to the question is correct, the evaluation result "correct" is returned to the terminal, and if the answer is incorrect, the evaluation result "incorrect" is returned to the terminal.

[0686] Feedback on evaluation results and reflection of emotions

[0687] 7. Terminal:

[0688] The device receives the evaluation results from the server and notifies the student by displaying a message saying "Correct" or "Incorrect."

[0689] Based on the recognition results of the emotion engine, the feedback of the assessment results is adjusted. For example, if a student is nervous, an encouraging message is displayed to help them relax.

[0690] Flow of specific example

[0691] Mathematical Example

[0692] 1. Server:

[0693] During the initialization process, the server stores the correct answer "2+2=4" and the incorrect answer "2+2=5" in the database and also initializes the emotion engine.

[0694] 2. Terminal:

[0695] The terminal requests "math" problems from the server in response to a user request.

[0696] 3. Server:

[0697] The server selects the problem "2+2," prepares the corresponding incorrect answer data "2+2=5," and sends it to the terminal.

[0698] 4. Terminal:

[0699] The device displays "Question: 2+2, Choices: 5" to the student and provides a field for entering the answer.

[0700] 5. User:

[0701] The user enters the answer they believe to be correct, "4," into the device. At the same time, the emotion engine analyzes the student's facial expressions, tone of voice, and keyboard typing speed to recognize their emotions.

[0702] 6. Terminal:

[0703] The terminal sends the entered answer "4" to the server.

[0704] 7. Server:

[0705] The server evaluates the answer and, since "2+2=4" is the correct answer, sends the "correct answer" result to the terminal.

[0706] 8. Terminal:

[0707] The device displays the message "That's correct" to the user, and, based on the recognition results of the emotion engine, displays messages of encouragement or support as needed.

[0708] In this way, the system can present students with problems, provide them with opportunities to think for themselves, and even recognize their emotions and provide appropriate feedback to deepen their learning.

[0709] The processing flow will be explained below.

[0710] Step 1:

[0711] server:

[0712] The server initializes itself when the program starts. First, it loads educational data into a database. This database stores questions, correct answers, and incorrect answers for each subject. For example, the "Mathematics" category contains the question "2+2" and the corresponding correct answer "4" and incorrect answer "2+2=5." The server also initializes the emotion engine, setting parameters for emotion recognition, such as the student's facial expression, tone of voice, and keyboard typing speed.

[0713] Step 2:

[0714] Device:

[0715] The terminal displays an input interface for users (students) to request problems. For example, if a user requests a "Mathematics" problem, the terminal provides a field for entering the request and a submit button.

[0716] Step 3:

[0717] User:

[0718] The user (student) requests a "math" problem through the interface displayed on the terminal. Specifically, they enter "math" in the input field and press the send button.

[0719] Step 4:

[0720] Device:

[0721] The terminal receives the user's request and sends the content ("mathematics") to the server.

[0722] Step 5:

[0723] server:

[0724] The server analyzes the received request and randomly selects one problem from the "Mathematics" category. Let's take "2+2" as an example. Then, it prepares the correct answer data and incorrect answer data for the selected problem. For example, it prepares "2+2=5" as the incorrect answer data for the problem "2+2".

[0725] Step 6:

[0726] server:

[0727] The server sends the selected question "2+2" and the incorrect answer data "2+2=5" to the terminal.

[0728] Step 7:

[0729] Device:

[0730] The device visually displays the received question "2+2" and the incorrect answer "2+2=5" to the user. Specifically, it displays the following:

[0731] Problem: 2+2

[0732] Choices: 5

[0733] It also provides an input field for the user to enter their answer.

[0734] Step 8:

[0735] User:

[0736] The user (student) looks at the presented question, thinks for himself / herself, decides on the correct answer "4", and enters "4" in the input field on the terminal.

[0737] Step 9:

[0738] Emotion Engine (Device):

[0739] At the same time, the emotion engine analyzes the user's facial expressions, tone of voice, and keyboard input speed to recognize the user's emotional state (e.g., whether they are nervous or relaxed). The recognized emotion data is used for subsequent feedback.

[0740] Step 10:

[0741] Device:

[0742] The terminal sends the answer "4" entered by the user to the server.

[0743] Step 11:

[0744] server:

[0745] The server compares the received user answer "4" with the correct answer data "4" for the question "2+2." In this case, it matches the correct answer data, so it is determined to be the correct answer.

[0746] Step 12:

[0747] server:

[0748] The server sends the evaluation result ("correct" or "incorrect") to the terminal.

[0749] Step 13:

[0750] Device:

[0751] The device receives the evaluation result from the server and notifies the user of the result, specifically by displaying "Correct" or "Incorrect."

[0752] Step 14:

[0753] Feedback method (terminal):

[0754] It also tailors the feedback based on the emotion engine's recognition results: for example, if the user is nervous, it displays an encouraging message like, "You're doing great! Keep it up!"

[0755] In this way, the system can present students with problems, provide them with opportunities to think for themselves, and even recognize their emotions and provide appropriate feedback to deepen their learning.

[0756] Example 2

[0757] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0758] In conventional educational systems, feedback to students is constant and does not take into account the emotional state of the student, and feedback is not provided at an appropriate time or in an appropriate manner. Furthermore, problems are not presented efficiently according to the student's level of understanding, and incorrect answers are not presented, making it difficult to improve students' learning effectiveness.

[0759] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a storage device for storing educational data, a processing device for selecting educational questions to be presented to the learner and corresponding incorrect answer data, a display device for presenting the educational questions and incorrect answer data to the learner, an input device for inputting the learner's answers, an evaluation device for evaluating the input answers, a feedback device for providing feedback to the learner based on the evaluation results, and an emotion recognition device for recognizing the learner's emotions and adjusting the feedback. This makes it possible to provide feedback at an appropriate time and in an appropriate manner taking into account the student's emotional state, which is expected to improve the student's learning effectiveness.

[0760] "Educational data" refers to information such as questions, answers, and explanations that are primarily used for educational purposes.

[0761] "Storage device" refers to a medium that can save, store, read, and write data, and examples include hard disks, SSDs, and cloud storage.

[0762] "Incorrect answer data" refers to data on incorrect answers that may be other than the correct answer, and is used to check a student's understanding or correct misunderstandings.

[0763] A "processing device" is a device that performs various calculations and data processing within a computer, and includes CPUs and GPUs.

[0764] "Display device" refers to a device that visually presents data or information to a user, and includes monitors, smartphones, tablets, etc.

[0765] An "input device" is a device that allows a user to input information or data into a system, such as a keyboard, mouse, or touch panel.

[0766] An "evaluation device" is a device that analyzes data input from users and performs evaluations and judgments. For example, it has the role of comparing students' answers with correct answer data and making an evaluation.

[0767] A "feedback device" is a device that provides students with appropriate advice and information based on the evaluation results, and feedback is given in the form of text, audio, video, etc.

[0768] An "emotion recognition device" is a device that analyzes and recognizes a user's emotional state in real time, using, for example, facial expression analysis, voice tone analysis, keyboard input speed, etc.

[0769] The present invention is a storage device for storing educational data, a system for presenting educational questions and corresponding incorrect answer data to a learner, and a system for evaluating the learner's answers and providing feedback based on the evaluation results.

[0770] The server has a storage device for storing educational data. This storage device stores questions, correct answers, and incorrect answer data for each subject. For example, the educational data for "Mathematics" includes the problem "2+2," its correct answer data "4," and incorrect answer data "2+2=5." When presenting a question to a student, the server selects the necessary question and incorrect answer data from this database.

[0771] When a learner requests a question using a device, the device sends the request to the server. The server receives the request, randomly selects one question from a specified subject, such as the "Mathematics" category, and prepares the wrong answer data. This data is sent to the device and displayed to the student.

[0772] The device visually displays the questions and incorrect answers it receives, as follows:

[0773] Problem: 2+2

[0774] Choices: 5

[0775] Furthermore, the terminal is provided with an input field for the learner to enter their answer. The learner enters the answer they believe to be correct into the input field.

[0776] When the learner enters an answer, the device sends the answer to the server. The server compares the received answer with the correct answer data stored in the memory device. If the answer is correct, it is judged to be "correct" and the result is returned to the device. If the answer is incorrect, it is returned as "incorrect."

[0777] A unique feature of this system is that it takes into account the learner's emotional state when providing feedback. The emotion recognition device analyzes the learner's current emotional state in real time based on facial expressions, tone of voice, keyboard typing speed, etc. The feedback is adjusted based on the analysis results. For example, if the learner is nervous, an encouraging message to help them relax will be displayed, such as:

[0778] Correct! Great! Relax and do your best on the next question.

[0779] For example, the following prompts can be used:

[0780] Problem: 2+2

[0781] Choices: 5

[0782] This system not only presents learners with problems and gives them the opportunity to think for themselves, but also takes their emotional state into account to maximize learning effectiveness.

[0783] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0784] Step 1:

[0785] server:

[0786] When the program starts, the server performs initialization and loads the educational data into the storage device. The questions, correct answers, and incorrect answers for each subject are stored in the storage device. For example, the mathematics category contains the question "2+2," the correct answer "4," and the incorrect answer "2+2=5." The emotion recognition device is also initialized at the same time, and is ready to monitor the learner's facial expressions, tone of voice, keyboard input speed, etc. In this case, the input is the educational data file, and the output is the educational data loaded into the storage device.

[0787] Step 2:

[0788] Device:

[0789] When a learner requests a question, the device sends the request details (such as the subject category) to the server. The request details may include, for example, "Give me a math question." This request is the input data, and the request sent from the device to the server is the output.

[0790] Step 3:

[0791] server:

[0792] The server receives a request from the terminal and randomly selects one problem from the specified subject category ("Mathematics" in this case). For example, it selects the problem "2+2" and the corresponding incorrect answer data "2+2=5". This problem and the incorrect answer data become output data based on the input data and are sent to the terminal.

[0793] Step 4:

[0794] Device:

[0795] The terminal visually displays the questions and incorrect answers received from the server to the learner. The display contents are as follows:

[0796] Problem: 2+2

[0797] Choices: 5

[0798] In addition, an input field is provided for the learner to enter their answers. The input data to the terminal is the question data and incorrect answer data from the server, and the output is displayed to the learner.

[0799] Step 5:

[0800] User:

[0801] The user (learner) checks the question, thinks of the correct answer "4", and enters it into the input field on the device. At this time, the emotion recognition device monitors the learner's facial expressions, tone of voice, and keyboard input speed. The user's input data is the answer "4", and the output is the data entered into the input field on the device.

[0802] Step 6:

[0803] Device:

[0804] The terminal sends the answer "4" entered by the learner to the server. The input data is the learner's answer "4", and the output is to send that data to the server.

[0805] Step 7:

[0806] server:

[0807] The server compares the received answer "4" with the correct answer data "4" stored in the memory device. In this case, it matches the correct answer data for "2+2," which is "4," so it is determined to be the correct answer. The input data is the learner's answer "4," and the output data is "correct answer." This evaluation result is sent to the terminal.

[0808] Step 8:

[0809] Device:

[0810] The device notifies the learner of the evaluation results received from the server. Feedback such as "Your answer is correct" is displayed. At the same time, based on the analysis results of the emotion recognition device, an encouraging message such as "Relax and do your best on the next question" is displayed. The input data are the evaluation results from the server and the analysis results of the emotion recognition device, and the output is the display of the feedback message to the learner.

[0811] (Application example 2)

[0812] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0813] In conventional educational systems, feedback to students is uniform, making it difficult to respond appropriately to students' emotions and learning progress. As a result, the stress and confusion students feel during the learning process can have a negative impact on their learning outcomes. Furthermore, the method of presenting incorrect answer data is fixed, resulting in a lack of ingenuity to improve the quality of the educational experience.

[0814] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a database for storing educational data, a processing means for selecting educational questions to be presented to students and corresponding incorrect answer data, and a display means for presenting the educational questions and incorrect answer data to students. This enables real-time feedback adjustment for students based on their individual emotional states. Furthermore, by using an emotion engine, it is possible to recognize students' emotions and adjust feedback, thereby reducing stress and confusion for students and supporting effective learning. Furthermore, by randomly selecting incorrect answer data, the quality of the educational experience can be improved.

[0815] "Educational data" refers to the learning content, questions, and answer data presented to students.

[0816] A "database" is a system for systematically storing and managing educational data.

[0817] "Processing means" refers to a device or algorithm for selecting educational questions and corresponding incorrect answer data.

[0818] "Display means" means a screen, display, or visual display device for presenting educational questions and incorrect answer data to a student.

[0819] An "input means" is a keyboard, touch screen, or other input device through which a student enters their answer.

[0820] The "evaluation means" refers to a device or logic that collates the input answer with the correct answer data and evaluates it based on the results.

[0821] A "feedback means" is a device or logic for providing feedback to students based on the assessment results.

[0822] The "emotion engine" is a system that analyzes information such as students' facial expressions, tone of voice, and typing speed to recognize their emotions.

[0823] The "real-time feedback adjustment means" refers to a device or logic for adjusting the feedback content in real time based on the recognition results of the emotion engine.

[0824] The term "system" refers to a set of devices and software including the various means described above.

[0825] System Overview

[0826] The present invention relates to an educational system, and an embodiment of the system includes a database for storing educational data, a processing means for selecting questions and incorrect answer data, a display means, an input means, an evaluation means, a feedback means, an emotion engine, and a real-time feedback adjustment means. Specifically, the present invention is embodied in the form of a learning support application called "EduVision."

[0827] Program processing

[0828] server

[0829] During initialization, the server loads educational data into the database. The educational data includes questions, correct answers, and incorrect answers for each subject. The emotion engine is also initialized at the same time, preparing to recognize students' emotions. This engine monitors students' facial expressions, tone of voice, keyboard typing speed, etc.

[0830] In response to a request, the server randomly selects questions from a specific subject, such as "Mathematics." For the selected questions, incorrect answer data is also randomly selected and sent to the terminal via the display means.

[0831] Terminal

[0832] Based on the student's request, the device receives questions and incorrect answers from the server and visually displays them to the student. The student looks at the presented questions and options and enters their answer using the input means. At the same time, the emotion engine recognizes the student's emotions and analyzes the results.

[0833] The device sends the entered answer to the server, which compares it with the correct answer data. Based on the comparison result, an evaluation result of whether the answer is correct or incorrect is returned to the device. The device provides feedback to the student based on the evaluation result and adjusts the feedback based on the recognition results of the emotion engine.

[0834] Hardware and software processing

[0835] Hardware: Servers, terminals (PCs, smartphones, tablets, smart glasses, head-mounted displays)

[0836] Software: Educational database, emotion engine, feedback adjustment program

[0837] Example: The emotion engine uses a webcam to capture the student's facial expressions and a microphone to analyze the tone of their voice.

[0838] The evaluation means uses an algorithm that compares input data with ground truth data stored in a database.

[0839] Examples and prompts

[0840] As a concrete example, imagine a situation where the options "1. 7," "2. 8," and "3. 9" are displayed for the math problem "3 + 5 = ?". The user selects and enters the option they think is correct.

[0841] Example prompt sentence:

[0842] “Let’s solve a math problem. Answer the following question: 3 + 5 = ?

[0843] Select from:

[0844] 1. 7

[0845] 2.8

[0846] 3.9

[0847] What's your answer?

[0848] Now, let's think about it. It's okay if you make a mistake. Don't worry!

[0849] The prompts allow students to calmly tackle the problems, improving their learning effectiveness. Feedback adjustments by the emotion engine optimize the learning experience for each individual student.

[0850] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0851] Step 1:

[0852] The server starts the initialization process and loads the educational data into the database. The database stores questions, correct answers, and incorrect answers for each subject. At the same time, it initializes the emotion engine and prepares it to recognize students' emotions.

[0853] Input: Educational data

[0854] Output: Initialized database and emotion engine

[0855] Step 2:

[0856] The device sends the student's request to the server, which may include, for example, a "math" question.

[0857] Input: Student Request

[0858] Output: Request data to the server

[0859] Step 3:

[0860] When the server receives the request, it randomly selects one question from a specific subject (for example, "Mathematics") and also randomly selects the wrong answer data corresponding to that question.

[0861] Input: Student Request

[0862] Output: Selected questions and incorrect answers

[0863] Step 4:

[0864] The device receives the selected question and incorrect answer data and visually displays it to the student. The displayed content includes the question text and the incorrect answer options.

[0865] Input: Questions and incorrect answers sent from the server

[0866] Output: Questions and choices displayed on the device screen

[0867] Step 5:

[0868] The user (student) looks at the presented question and enters their answer. At the same time, the emotion engine monitors the student's facial expression, tone of voice, keyboard typing speed, etc. to analyze their emotional state.

[0869] Input: Data about student responses and student emotions

[0870] Output: Parsed emotional state and student response data

[0871] Step 6:

[0872] The device sends the student's answer to the server. The server compares the received answer with the correct answer data and evaluates the result. If the answer is correct, the result "correct" is returned, and if the answer is incorrect, the result "incorrect" is returned.

[0873] Input: Student response data

[0874] Output: Evaluation result (correct or incorrect)

[0875] Step 7:

[0876] The device receives the evaluation results from the server and provides feedback to the student. It also adjusts the feedback based on the recognition results of the emotion engine. For example, it adds an encouraging message to a nervous student.

[0877] Input: Evaluation results from the server and recognition results from the emotion engine

[0878] Output: Adjusted feedback content

[0879] Step 8:

[0880] The device displays the adjusted feedback to the student, who can then proceed to the next question or review the feedback. The cycle starts again when the student requests the next question.

[0881] Input: Adjusted feedback, student's next request

[0882] Output: Feedback shown to the student and preparation for the next question

[0883] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0884] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0885] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0886] [Third embodiment]

[0887] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0888] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0889] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0890] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0891] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0892] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0893] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0894] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0895] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0896] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0897] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0898] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0899] The present invention is an educational system that includes a database for storing educational data, a processing means for selecting educational questions and incorrect answer data, a display means for presenting the educational questions and incorrect answer data to students, an input means for inputting students' answers, an evaluation means for evaluating the answers, and a feedback means for providing feedback to students based on the evaluation results.

[0900] Program processing

[0901] Initialization

[0902] 1. Server:

[0903] The server first initializes a database containing educational data, which stores educational questions for each subject, correct answer data, and corresponding incorrect answer data.

[0904] For example, the educational questions in the "Mathematics" category include "2+2" and "3+5", and the corresponding incorrect answer data include "2+2=5" and "3+5=9".

[0905] Problem Statement

[0906] 2. Terminal:

[0907] When a student requests a "math" problem, the terminal sends the request to the server.

[0908] When the server receives the request, it randomly selects one problem from the "Math" category, let's say "2+2".

[0909] The server prepares the incorrect answer data "2+2=5" for the selected question and sends it to the terminal.

[0910] 3. Terminal:

[0911] The terminal visually displays the questions and incorrect answers to the user (student). The displayed content is as follows:

[0912] Problem: 2+2

[0913] Choices: 5

[0914] The device also has an input field for students to enter their answers.

[0915] User Answers

[0916] 4. User:

[0917] The user looks at the question and options displayed on the terminal, thinks about their answer, and if they think "2+2=4," they enter "4" into the terminal.

[0918] Submitting and rating answers

[0919] 5. Terminal:

[0920] The terminal sends the student's inputted answers to the server.

[0921] 6. Server:

[0922] The server compares the received answer "4" with the correct answer data for "2+2." Since the correct answer data for "2+2" is "4," the server confirms that the student's answer is correct.

[0923] If the answer to the question is correct, the evaluation result "correct" is returned to the terminal, and if the answer is incorrect, the evaluation result "incorrect" is returned to the terminal.

[0924] Feedback of evaluation results

[0925] 7. Terminal:

[0926] The terminal receives the evaluation results from the server and notifies the student, displaying a message like the following:

[0927] "Correct" or "Incorrect"

[0928] Flow of specific example

[0929] Mathematical Example

[0930] 1. Server:

[0931] During the initialization process, the server stores the correct answer "2+2=4" and the incorrect answer "2+2=5" in a database.

[0932] 2. Terminal:

[0933] The terminal requests "math" problems from the server in response to a user request.

[0934] 3. Server:

[0935] The server selects the problem "2+2," prepares the corresponding incorrect answer data "2+2=5," and sends it to the terminal.

[0936] 4. Terminal:

[0937] The device displays "Question: 2+2, Choices: 5" to the student and provides a field for entering the answer.

[0938] 5. User:

[0939] The user enters what they believe to be the correct answer, "4," into the terminal.

[0940] 6. Terminal:

[0941] The terminal sends the entered answer "4" to the server.

[0942] 7. Server:

[0943] The server evaluates the answer and, since "2+2=4" is the correct answer, sends the "correct answer" result to the terminal.

[0944] 8. Terminal:

[0945] The terminal displays the message "Correct" to the user.

[0946] In this way, students are provided with opportunities for independent learning and can develop critical thinking skills.

[0947] The processing flow will be explained below.

[0948] Step 1:

[0949] server:

[0950] When the program starts, the server initializes and loads educational data into a database. This database stores questions, correct answers, and incorrect answers for each subject. For example, the "Mathematics" category contains the question "2+2" and the corresponding correct answer "4" and incorrect answer "2+2=5."

[0951] Step 2:

[0952] Device:

[0953] The terminal displays an input interface for users (students) to request problems. An input field is provided for users to request "math" problems, and students can enter "math".

[0954] Step 3:

[0955] User:

[0956] The user (student) requests a "math" problem through the interface displayed on the terminal. Specifically, they enter "math" in the input field and press the send button.

[0957] Step 4:

[0958] Device:

[0959] The terminal receives the user's request and sends the request to the server.

[0960] Step 5:

[0961] server:

[0962] The server randomly selects one problem from the "Mathematics" category. If the selected problem is "2+2," it prepares the corresponding incorrect answer data "2+2=5."

[0963] Step 6:

[0964] server:

[0965] The server sends the selected question "2+2" and the incorrect answer data "2+2=5" to the terminal.

[0966] Step 7:

[0967] Device:

[0968] The device displays the question selected by the user, "2+2," and the incorrect answer, "2+2=5." Specifically,

[0969] Problem: 2+2

[0970] Choices: 5

[0971] and provides a field where the user can enter their answer.

[0972] Step 8:

[0973] User:

[0974] The user (student) looks at the question, thinks for himself / herself, decides on the correct answer "4", and enters "4" in the input field on the terminal.

[0975] Step 9:

[0976] Device:

[0977] The terminal sends the answer "4" entered by the user to the server.

[0978] Step 10:

[0979] server:

[0980] The server compares the received user answer "4" with the correct answer data "4" for the question "2+2." In this case, it matches the correct answer data, so it is determined to be the correct answer.

[0981] Step 11:

[0982] server:

[0983] The server sends the "correct answer" as the evaluation result to the terminal.

[0984] Step 12:

[0985] Device:

[0986] The terminal notifies the user of the evaluation result received from the server. Specifically, a message stating "The answer is correct" is displayed on the terminal.

[0987] In this way, the system can present students with problems, give them the opportunity to think for themselves, and provide feedback to further their learning.

[0988] Example 1

[0989] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0990] In conventional educational systems, students do not receive timely feedback on their answers, which can lead to a decline in motivation to learn and makes it difficult to grasp their level of understanding.In addition, the provision of incorrect answer data is fixed, which makes it difficult to cover the various mistakes made by students, making it difficult to resolve students' lack of understanding.

[0991] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0992] In this invention, the server includes a means for initializing a database that stores educational data, a means for randomly selecting educational questions and corresponding incorrect answer data requested by students and presenting them to the students, and a means for comparing the input answers with the correct answer data and generating evaluation results, thereby enabling the presentation of appropriate questions in response to requests and real-time feedback.

[0993] "Educational data" is a general term for information including educational questions, correct answer data, and incorrect answer data.

[0994] A "database" is a system that can systematically store, manage, and search educational data.

[0995] A "request" is the act of a student requesting the server for the question they wish to answer, or the information about that question.

[0996] A "problem" is an educational task or question posed to students.

[0997] "Incorrect answer data" is information about incorrect answers to questions.

[0998] "Correct answer data" is information on the correct answer to a question.

[0999] "Evaluation results" are information on the results obtained after comparing the student's answers with the correct answer data.

[1000] "Feedback" refers to replies and comments based on the evaluation results of students' answers.

[1001] An "input field" is an area on the device screen where a student enters an answer.

[1002] A "server" is a computer system that processes requests, selects questions, evaluates answers, and provides feedback.

[1003] A "terminal" is a device that students directly operate to display questions and input answers.

[1004] This invention is an educational system that utilizes a database for storing educational data, and is particularly equipped with a structure for smoothly carrying out a series of processes from presenting questions to evaluating answers and providing feedback. This invention is realized primarily through the interaction of three parties: a server, a terminal, and a user. The specific configuration and processing for implementing this system are described below.

[1005] Initialization

[1006] The server initializes a database that stores educational data. This database stores educational questions, correct answer data, and incorrect answer data for each subject. For example, a relational database management system (RDBMS) such as MySQL or PostgreSQL is used as the database management system. During initialization, "2 + 2" and "3 + 5" are entered as educational questions for a specific subject (e.g., "Mathematics"), and the correct answer data ("4" and "8") and incorrect answer data ("2 + 2 = 5" and "3 + 5 = 9") for each are stored.

[1007] Problem Statement

[1008] The device receives requests for educational questions from the user. If the user requests a "Mathematics" question, the request is sent from the device to the server. This request is made, for example, via an HTTP request using a RESTful API. When the server receives the request, it randomly selects a question for the relevant subject from the database. The selected question and its incorrect answer data are packaged in JSON format and sent to the device.

[1009] The device visually displays the received educational questions and incorrect answer data to the user. As an example, it shows the question "2+2" and the answer choice "5." It also provides an input field for students to enter their answers. The user interface is dynamically generated using HTML, CSS, and JavaScript.

[1010] User Answers

[1011] The user looks at the displayed question and options, thinks of their answer, and enters the answer, for example, "4." This input is done by keyboard operation or by clicking the submit button. The entered answer is sent to the server by the terminal. The transmission uses the HTTP protocol and a data package in JSON format.

[1012] Submitting and rating answers

[1013] The server compares the received user answer with the correct answer data. The server retrieves the correct answer data ("4") for the problem "2+2" from the database and compares it with the answer ("4") provided by the user. If the answer is correct, the server evaluates it as "correct," and if it is incorrect, it evaluates it as "incorrect." This evaluation result is again packaged in JSON format and sent back to the terminal.

[1014] Feedback of evaluation results

[1015] The terminal notifies the user of the evaluation result received from the server, for example by displaying a message such as "Correct" or "Incorrect." The display of the feedback is also implemented using HTML, CSS, and JavaScript.

[1016] Example prompt

[1017] Here are some example prompts to input to the generative AI model:

[1018] Example questions to the generative AI model:

[1019] Please suggest what options should be presented as incorrect answers in mathematics problems provided by the education system. For example, for the problem "2 + 2," please list some appropriate incorrect answers in addition to the correct answer. Also, please explain the rationale for these incorrect answers.

[1020] As described above, the present invention realizes an efficient education system by linking together the elements of the server, terminal, and user.

[1021] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1022] Step 1:

[1023] The server initializes a database that stores educational data. The database registers educational questions, correct answer data, and incorrect answer data for each subject. As a concrete example, the "Mathematics" category contains the problems "2+2" and "3+5," and the correct answer data "4" and "8" are stored, along with the corresponding incorrect answer data "2+2=5" and "3+5=9." The input is the educational dataset, and the output is the initialized database.

[1024] Step 2:

[1025] The user requests a "math" problem from the device. This request is sent as an HTTP request using, for example, a RESTful API. The input is the request information from the user, and the output is an HTTP request that sends that request to the server. The specific operation is the act of the user requesting a problem using the device interface.

[1026] Step 3:

[1027] When the server receives the request, it randomly selects a problem in the "Mathematics" category from the database. This selection is performed using an SQL query. For example, select the problem "2+2" and prepare the corresponding incorrect answer data "2+2=5". The input is the user's request and the database, and the output is a JSON response containing the selected problem and the incorrect answer data.

[1028] Step 4:

[1029] The device visually displays the questions and incorrect answer data received from the server to the user. An example display is "Question: 2+2, Choices: 5." This display is styled with HTML and CSS and dynamically updated with JavaScript. The input is the JSON response from the server, and the output is a screen that the user can visually confirm.

[1030] Step 5:

[1031] The user looks at the displayed question and options, thinks of an answer, and enters the answer, for example, "4." This input involves the specific action of entering a number on the keyboard into the input field of the terminal. The input is the user's answer, and the output is the data sent to the terminal.

[1032] Step 6:

[1033] The terminal sends the entered answer to the server. This data is again sent using the HTTP protocol. The input is the user's answer data, and the output is the HTTP request sent to the server.

[1034] Step 7:

[1035] The server checks the received answer data against the correct answer data. It compares the correct answer data "4" for "2+2" with the user's answer "4". If the answer is correct, it generates an evaluation of "correct", and if the answer is incorrect, it generates an evaluation of "incorrect". The input is the user's answer and correct answer data, and the output is a JSON response as the evaluation result.

[1036] Step 8:

[1037] The device receives the evaluation results from the server and displays them to the user. For example, it displays a message on the screen saying "Your answer is correct." This display is also constructed using HTML and CSS and updated using JavaScript. The input is the JSON response from the server, and the output is a feedback message that the user can visually confirm.

[1038] (Application example 1)

[1039] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1040] Existing educational systems are primarily aimed at providing students with basic learning, but do not address the acquisition of specialized skills, particularly the operational skills required for factory operators. Because operating factory equipment incorrectly can lead to serious accidents, effective education is needed to prevent operational errors. Furthermore, interactive usability, which allows operators to learn while actually operating the equipment, is also important. A system that can solve these problems is needed.

[1041] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1042] In this invention, the server includes a database means for storing educational data, a processing means for selecting educational questions to be presented to the user and corresponding incorrect answer data, and a display means for presenting the educational questions and incorrect answer data to the user. This makes it possible to receive learning requests from operators and provide appropriate educational questions. Furthermore, a visual display means corresponding to smart glasses or a head-mounted display allows operators to solve educational questions in the actual field, experience incorrect operations, and learn correct operations. Furthermore, by using a feedback means for evaluating input answers and providing feedback based on the evaluation results, it becomes easier for operators to immediately understand correct operating methods.

[1043] "Educational data" refers to data that includes the learning materials and questions necessary for the user to study, as well as related information.

[1044] A "database" is a data storage system that stores educational data and allows it to be searched and retrieved as needed.

[1045] "Processing means" refers to a computing device or algorithm that selects educational questions and incorrect answer data based on given input data and presents them to the user at the appropriate time.

[1046] "Display means" refers to a device for visually presenting the selected educational question and incorrect answer data to the user, and specifically includes smart glasses and a head-mounted display.

[1047] "Input means" refers to an interface that allows a user to input answers to educational questions, such as a keyboard or touch panel.

[1048] "Evaluation means" refers to a device or algorithm that compares the inputted user's answer with correct answer data and evaluates it based on the results.

[1049] "Feedback means" refers to a mechanism for informing users of correct operation methods and learning content based on the evaluation results.

[1050] "Server means" refers to a computer system for managing an educational database and processing requests from users.

[1051] "Visual display means" refers to a device for displaying educational questions and feedback through smart glasses or a head-mounted display worn by the user.

[1052] "Educational questions related to the operation of factory equipment" are questions related to the operation of machinery in a factory, and include content for learning operating procedures and points to note.

[1053] "Incorrect answer data" is data that includes incorrect options or operation procedures for correct answers, and is a means of learning mistakes that users often make.

[1054] "Feedback to help learn how to operate" refers to information that shows the correct operating procedure when the user gives an incorrect answer, and provides advice and assistance so that the user can get the correct answer the next time.

[1055] This invention is an educational system specialized for training factory robot operators. By using smart glasses or a head-mounted display, users can learn about operational problems and examples of incorrect operation of factory equipment in real time and master the correct operation methods.

[1056] First, this system uses a database that stores a large amount of training data. This database contains training questions about various factory equipment operations and the corresponding incorrect answers. For example, the correct way to "start a conveyor belt" is to "press the start button," while an example of an incorrect operation is to "not press the start button."

[1057] The server receives the user's learning request, and based on that request, selects corresponding educational questions and incorrect answer data using a processing means and randomly presents them. Smart glasses or a head-mounted display are used as a display means. This allows the user to visually check the educational questions and incorrect answer data as they progress through their learning.

[1058] The user inputs answers to the displayed questions using the input means of the smart glasses or head-mounted display. This input data is sent to the server, where it is compared with the correct answer data by the server's evaluation means. Based on the evaluation results, if the operation is correct, it is judged as "correct," and if the operation is incorrect, it is judged as "incorrect," and the result is fed back to the user's smart glasses or head-mounted display.

[1059] For example, if a user incorrectly inputs "Do not press the start button" in response to a question about "starting the conveyor belt," this incorrect operation will be evaluated as an "incorrect answer" on the server side, and feedback such as "Incorrect. Please press the start button" will be displayed on the smart glasses or head-mounted display.

[1060] The implementation of this system requires the following hardware and software:

[1061] Hardware: Smart glasses (e.g., Google Glass), head-mounted displays (e.g., Oculus Rift)

[1062] Software: Server software (Apache Tomcat), database (MySQL), application for smart glasses and head-mounted displays (Python + OpenCV)

[1063] In addition, by using a generative AI model, it is possible to generate educational questions and incorrect answer data, and provide feedback based on evaluation results.

[1064] Here is an example of a prompt to input to a generative AI model:

[1065] In a factory robot operation training system, an operator requests learning how to "start a conveyor belt" through smart glasses. To help the operator learn the correct operation, the server needs to provide data on the correct operation ("press the start button") and the incorrect operation ("not pressing the start button"). Please specifically explain how to provide feedback to help the operator correct the problem and perform the correct operation.

[1066] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1067] Step 1:

[1068] The server initializes the database that stores the training data and registers the factory equipment operation questions and incorrect answer data. Specifically, the correct way to "start the conveyor belt" is to "press the start button," and an example of an incorrect operation is to "not press the start button," and these are added to the database.

[1069] Step 2:

[1070] The user puts on smart glasses or a head-mounted display and inputs a learning request for operation training. The user's request (e.g., "I would like to learn how to start a conveyor belt") is input.

[1071] Step 3:

[1072] The terminal sends the user's learning request to the server. The input is the request entered by the user, and the output is the request reaching the server.

[1073] Step 4:

[1074] The server randomly selects the corresponding training questions and incorrect answer data from the database based on the received learning request. The input is the user's request, and the output is the training questions and incorrect answer data extracted from the database.

[1075] Step 5:

[1076] The server sends the selected educational questions and incorrect answer data to the terminal. The input is the extracted educational questions and incorrect answer data, and the output is the transmission of the data.

[1077] Step 6:

[1078] The device visually presents the educational questions and incorrect answer data to the user. Specifically, the questions and incorrect answer data are displayed on the screen of smart glasses or a head-mounted display. The input is the educational questions and incorrect answer data sent from the server, and the output is the displayed educational content.

[1079] Step 7:

[1080] The user inputs an answer based on the presented question. Specifically, the user inputs the answer through the input interface of smart glasses or a head-mounted display. The input is the answer entered by the user, and the output is the answer data.

[1081] Step 8:

[1082] The terminal sends the user's answer to the server. The input is the user's answer and the output is the transmission.

[1083] Step 9:

[1084] The server receives the user's answer and evaluates it by comparing it with the correct answer data. Specifically, the server retrieves the correct answer data from the database and compares it with the answer. The input is the user's answer and the correct answer data, and the output is the evaluation result (correct / incorrect).

[1085] Step 10:

[1086] The server generates feedback content based on the evaluation results and sends it to the terminal. The input is the evaluation results, and the output is the transmission of the generated feedback content.

[1087] Step 11:

[1088] The device visually notifies the user of the received feedback. Specifically, the feedback content (e.g., "Incorrect. Please press the start button.") is displayed on the screen of the smart glasses or head-mounted display. The input is the feedback content sent from the server, and the output is the displayed feedback.

[1089] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1090] The present invention is an educational system that includes a database for storing educational data, a processing means for selecting educational questions and corresponding incorrect answer data, a display means for presenting the educational questions and incorrect answer data to students, an input means for inputting students' answers, an evaluation means for evaluating the input answers, a feedback means for providing feedback to students based on the evaluation results, and an emotion engine that recognizes the user's emotions and adjusts the feedback.

[1091] Program processing

[1092] Initialization

[1093] 1. Server:

[1094] When the program starts, the server initializes and loads educational data into a database. This database stores questions, correct answers, and incorrect answers for each subject. For example, the "Mathematics" category contains the question "2+2" and the corresponding correct answer "4" and incorrect answer "2+2=5."

[1095] The emotion engine is also initialized at the same time to prepare for recognizing student emotions. This engine monitors the student's facial expressions, tone of voice, keyboard typing speed, etc.

[1096] Problem Statement

[1097] 2. Terminal:

[1098] When a student requests a problem, the device sends the request to the server. The request includes, for example, a "math" problem.

[1099] When the server receives the request, it randomly selects one problem from the "Math" category, let's say "2+2".

[1100] The server prepares the incorrect answer data "2+2=5" for the selected question and sends it to the terminal.

[1101] 3. Terminal:

[1102] The terminal visually displays the questions and incorrect answers to the user (student). The displayed content is as follows:

[1103] Problem: 2+2

[1104] Choices: 5

[1105] The device also has an input field for students to enter their answers.

[1106] Recognizing user responses and emotions

[1107] 4. User:

[1108] The user (student) looks at the question, thinks for himself / herself, decides on the correct answer "4", and enters "4" in the input field on the terminal.

[1109] At the same time, the emotion engine analyzes the student's facial expressions, tone of voice, typing speed, etc. to recognize the student's current emotional state.

[1110] Submitting and rating answers

[1111] 5. Terminal:

[1112] The terminal sends the answer "4" entered by the user to the server.

[1113] 6. Server:

[1114] The server compares the received user answer "4" with the correct answer data "4" for the question "2+2." In this case, it matches the correct answer data, so it is determined to be the correct answer.

[1115] If the answer to the question is correct, the evaluation result "correct" is returned to the terminal, and if the answer is incorrect, the evaluation result "incorrect" is returned to the terminal.

[1116] Feedback on evaluation results and reflection of emotions

[1117] 7. Terminal:

[1118] The device receives the evaluation results from the server and notifies the student by displaying a message saying "Correct" or "Incorrect."

[1119] Based on the recognition results of the emotion engine, the feedback of the assessment results is adjusted. For example, if a student is nervous, an encouraging message is displayed to help them relax.

[1120] Flow of specific example

[1121] Mathematical Example

[1122] 1. Server:

[1123] During the initialization process, the server stores the correct answer "2+2=4" and the incorrect answer "2+2=5" in the database and also initializes the emotion engine.

[1124] 2. Terminal:

[1125] The terminal requests "math" problems from the server in response to a user request.

[1126] 3. Server:

[1127] The server selects the problem "2+2," prepares the corresponding incorrect answer data "2+2=5," and sends it to the terminal.

[1128] 4. Terminal:

[1129] The device displays "Question: 2+2, Choices: 5" to the student and provides a field for entering the answer.

[1130] 5. User:

[1131] The user enters the answer they believe to be correct, "4," into the device. At the same time, the emotion engine analyzes the student's facial expressions, tone of voice, and keyboard typing speed to recognize their emotions.

[1132] 6. Terminal:

[1133] The terminal sends the entered answer "4" to the server.

[1134] 7. Server:

[1135] The server evaluates the answer and, since "2+2=4" is the correct answer, sends the "correct answer" result to the terminal.

[1136] 8. Terminal:

[1137] The device displays the message "That's correct" to the user, and, based on the recognition results of the emotion engine, displays messages of encouragement or support as needed.

[1138] In this way, the system can present students with problems, provide them with opportunities to think for themselves, and even recognize their emotions and provide appropriate feedback to deepen their learning.

[1139] The processing flow will be explained below.

[1140] Step 1:

[1141] server:

[1142] The server initializes itself when the program starts. First, it loads educational data into a database. This database stores questions, correct answers, and incorrect answers for each subject. For example, the "Mathematics" category contains the question "2+2" and the corresponding correct answer "4" and incorrect answer "2+2=5." The server also initializes the emotion engine, setting parameters for emotion recognition, such as the student's facial expression, tone of voice, and keyboard typing speed.

[1143] Step 2:

[1144] Device:

[1145] The terminal displays an input interface for users (students) to request problems. For example, if a user requests a "Mathematics" problem, the terminal provides a field for entering the request and a submit button.

[1146] Step 3:

[1147] User:

[1148] The user (student) requests a "math" problem through the interface displayed on the terminal. Specifically, they enter "math" in the input field and press the send button.

[1149] Step 4:

[1150] Device:

[1151] The terminal receives the user's request and sends the content ("mathematics") to the server.

[1152] Step 5:

[1153] server:

[1154] The server analyzes the received request and randomly selects one problem from the "Mathematics" category. Let's take "2+2" as an example. Then, it prepares the correct answer data and incorrect answer data for the selected problem. For example, it prepares "2+2=5" as the incorrect answer data for the problem "2+2".

[1155] Step 6:

[1156] server:

[1157] The server sends the selected question "2+2" and the incorrect answer data "2+2=5" to the terminal.

[1158] Step 7:

[1159] Device:

[1160] The device visually displays the received question "2+2" and the incorrect answer "2+2=5" to the user. Specifically, it displays the following:

[1161] Problem: 2+2

[1162] Choices: 5

[1163] It also provides an input field for the user to enter their answer.

[1164] Step 8:

[1165] User:

[1166] The user (student) looks at the presented question, thinks for himself / herself, decides on the correct answer "4", and enters "4" in the input field on the terminal.

[1167] Step 9:

[1168] Emotion Engine (Device):

[1169] At the same time, the emotion engine analyzes the user's facial expressions, tone of voice, and keyboard input speed to recognize the user's emotional state (e.g., whether they are nervous or relaxed). The recognized emotion data is used for subsequent feedback.

[1170] Step 10:

[1171] Device:

[1172] The terminal sends the answer "4" entered by the user to the server.

[1173] Step 11:

[1174] server:

[1175] The server compares the received user answer "4" with the correct answer data "4" for the question "2+2." In this case, it matches the correct answer data, so it is determined to be the correct answer.

[1176] Step 12:

[1177] server:

[1178] The server sends the evaluation result ("correct" or "incorrect") to the terminal.

[1179] Step 13:

[1180] Device:

[1181] The device receives the evaluation result from the server and notifies the user of the result, specifically by displaying "Correct" or "Incorrect."

[1182] Step 14:

[1183] Feedback method (terminal):

[1184] It also tailors the feedback based on the emotion engine's recognition results: for example, if the user is nervous, it displays an encouraging message like, "You're doing great! Keep it up!"

[1185] In this way, the system can present students with problems, provide them with opportunities to think for themselves, and even recognize their emotions and provide appropriate feedback to deepen their learning.

[1186] Example 2

[1187] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1188] In conventional educational systems, feedback to students is constant and does not take into account the emotional state of the student, and feedback is not provided at an appropriate time or in an appropriate manner. Furthermore, problems are not presented efficiently according to the student's level of understanding, and incorrect answers are not presented, making it difficult to improve students' learning effectiveness.

[1189] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a storage device for storing educational data, a processing device for selecting educational questions to be presented to the learner and corresponding incorrect answer data, a display device for presenting the educational questions and incorrect answer data to the learner, an input device for inputting the learner's answers, an evaluation device for evaluating the input answers, a feedback device for providing feedback to the learner based on the evaluation results, and an emotion recognition device for recognizing the learner's emotions and adjusting the feedback. This makes it possible to provide feedback at an appropriate time and in an appropriate manner taking into account the student's emotional state, which is expected to improve the student's learning effectiveness.

[1190] "Educational data" refers to information such as questions, answers, and explanations that are primarily used for educational purposes.

[1191] "Storage device" refers to a medium that can save, store, read, and write data, and examples include hard disks, SSDs, and cloud storage.

[1192] "Incorrect answer data" refers to data on incorrect answers that may be other than the correct answer, and is used to check a student's understanding or correct misunderstandings.

[1193] A "processing device" is a device that performs various calculations and data processing within a computer, and includes CPUs and GPUs.

[1194] "Display device" refers to a device that visually presents data or information to a user, and includes monitors, smartphones, tablets, etc.

[1195] An "input device" is a device that allows a user to input information or data into a system, such as a keyboard, mouse, or touch panel.

[1196] An "evaluation device" is a device that analyzes data input from users and performs evaluations and judgments. For example, it has the role of comparing students' answers with correct answer data and making an evaluation.

[1197] A "feedback device" is a device that provides students with appropriate advice and information based on the evaluation results, and feedback is given in the form of text, audio, video, etc.

[1198] An "emotion recognition device" is a device that analyzes and recognizes a user's emotional state in real time, using, for example, facial expression analysis, voice tone analysis, keyboard input speed, etc.

[1199] The present invention is a storage device for storing educational data, a system for presenting educational questions and corresponding incorrect answer data to a learner, and a system for evaluating the learner's answers and providing feedback based on the evaluation results.

[1200] The server has a storage device for storing educational data. This storage device stores questions, correct answers, and incorrect answer data for each subject. For example, the educational data for "Mathematics" includes the problem "2+2," its correct answer data "4," and incorrect answer data "2+2=5." When presenting a question to a student, the server selects the necessary question and incorrect answer data from this database.

[1201] When a learner requests a question using a device, the device sends the request to the server. The server receives the request, randomly selects one question from a specified subject, such as the "Mathematics" category, and prepares the wrong answer data. This data is sent to the device and displayed to the student.

[1202] The device visually displays the questions and incorrect answers it receives, as follows:

[1203] Problem: 2+2

[1204] Choices: 5

[1205] Furthermore, the terminal is provided with an input field for the learner to enter their answer. The learner enters the answer they believe to be correct into the input field.

[1206] When the learner enters an answer, the device sends the answer to the server. The server compares the received answer with the correct answer data stored in the memory device. If the answer is correct, it is judged to be "correct" and the result is returned to the device. If the answer is incorrect, it is returned as "incorrect."

[1207] A unique feature of this system is that it takes into account the learner's emotional state when providing feedback. The emotion recognition device analyzes the learner's current emotional state in real time based on facial expressions, tone of voice, keyboard typing speed, etc. The feedback is adjusted based on the analysis results. For example, if the learner is nervous, an encouraging message to help them relax will be displayed, such as:

[1208] Correct! Great! Relax and do your best on the next question.

[1209] For example, the following prompts can be used:

[1210] Problem: 2+2

[1211] Choices: 5

[1212] This system not only presents learners with problems and gives them the opportunity to think for themselves, but also takes their emotional state into account to maximize learning effectiveness.

[1213] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1214] Step 1:

[1215] server:

[1216] When the program starts, the server performs initialization and loads the educational data into the storage device. The questions, correct answers, and incorrect answers for each subject are stored in the storage device. For example, the mathematics category contains the question "2+2," the correct answer "4," and the incorrect answer "2+2=5." The emotion recognition device is also initialized at the same time, and is ready to monitor the learner's facial expressions, tone of voice, keyboard input speed, etc. In this case, the input is the educational data file, and the output is the educational data loaded into the storage device.

[1217] Step 2:

[1218] Device:

[1219] When a learner requests a question, the device sends the request details (such as the subject category) to the server. The request details may include, for example, "Give me a math question." This request is the input data, and the request sent from the device to the server is the output.

[1220] Step 3:

[1221] server:

[1222] The server receives a request from the terminal and randomly selects one problem from the specified subject category ("Mathematics" in this case). For example, it selects the problem "2+2" and the corresponding incorrect answer data "2+2=5". This problem and the incorrect answer data become output data based on the input data and are sent to the terminal.

[1223] Step 4:

[1224] Device:

[1225] The terminal visually displays the questions and incorrect answers received from the server to the learner. The display contents are as follows:

[1226] Problem: 2+2

[1227] Choices: 5

[1228] In addition, an input field is provided for the learner to enter their answers. The input data to the terminal is the question data and incorrect answer data from the server, and the output is displayed to the learner.

[1229] Step 5:

[1230] User:

[1231] The user (learner) checks the question, thinks of the correct answer "4", and enters it into the input field on the device. At this time, the emotion recognition device monitors the learner's facial expressions, tone of voice, and keyboard input speed. The user's input data is the answer "4", and the output is the data entered into the input field on the device.

[1232] Step 6:

[1233] Device:

[1234] The terminal sends the answer "4" entered by the learner to the server. The input data is the learner's answer "4", and the output is to send that data to the server.

[1235] Step 7:

[1236] server:

[1237] The server compares the received answer "4" with the correct answer data "4" stored in the memory device. In this case, it matches the correct answer data for "2+2," which is "4," so it is determined to be the correct answer. The input data is the learner's answer "4," and the output data is "correct answer." This evaluation result is sent to the terminal.

[1238] Step 8:

[1239] Device:

[1240] The device notifies the learner of the evaluation results received from the server. Feedback such as "Your answer is correct" is displayed. At the same time, based on the analysis results of the emotion recognition device, an encouraging message such as "Relax and do your best on the next question" is displayed. The input data are the evaluation results from the server and the analysis results of the emotion recognition device, and the output is the display of the feedback message to the learner.

[1241] (Application example 2)

[1242] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1243] In conventional educational systems, feedback to students is uniform, making it difficult to respond appropriately to students' emotions and learning progress. As a result, the stress and confusion students feel during the learning process can have a negative impact on their learning outcomes. Furthermore, the method of presenting incorrect answer data is fixed, resulting in a lack of ingenuity to improve the quality of the educational experience.

[1244] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a database for storing educational data, a processing means for selecting educational questions to be presented to students and corresponding incorrect answer data, and a display means for presenting the educational questions and incorrect answer data to students. This enables real-time feedback adjustment for students based on their individual emotional states. Furthermore, by using an emotion engine, it is possible to recognize students' emotions and adjust feedback, thereby reducing stress and confusion for students and supporting effective learning. Furthermore, by randomly selecting incorrect answer data, the quality of the educational experience can be improved.

[1245] "Educational data" refers to the learning content, questions, and answer data presented to students.

[1246] A "database" is a system for systematically storing and managing educational data.

[1247] "Processing means" refers to a device or algorithm for selecting educational questions and corresponding incorrect answer data.

[1248] "Display means" means a screen, display, or visual display device for presenting educational questions and incorrect answer data to a student.

[1249] An "input means" is a keyboard, touch screen, or other input device through which a student enters their answer.

[1250] The "evaluation means" refers to a device or logic that collates the input answer with the correct answer data and evaluates it based on the results.

[1251] A "feedback means" is a device or logic for providing feedback to students based on the assessment results.

[1252] The "emotion engine" is a system that analyzes information such as students' facial expressions, tone of voice, and typing speed to recognize their emotions.

[1253] The "real-time feedback adjustment means" refers to a device or logic for adjusting the feedback content in real time based on the recognition results of the emotion engine.

[1254] The term "system" refers to a set of devices and software including the various means described above.

[1255] System Overview

[1256] The present invention relates to an educational system, and an embodiment of the system includes a database for storing educational data, a processing means for selecting questions and incorrect answer data, a display means, an input means, an evaluation means, a feedback means, an emotion engine, and a real-time feedback adjustment means. Specifically, the present invention is embodied in the form of a learning support application called "EduVision."

[1257] Program processing

[1258] server

[1259] During initialization, the server loads educational data into the database. The educational data includes questions, correct answers, and incorrect answers for each subject. The emotion engine is also initialized at the same time, preparing to recognize students' emotions. This engine monitors students' facial expressions, tone of voice, keyboard typing speed, etc.

[1260] In response to a request, the server randomly selects questions from a specific subject, such as "Mathematics." For the selected questions, incorrect answer data is also randomly selected and sent to the terminal via the display means.

[1261] Terminal

[1262] Based on the student's request, the device receives questions and incorrect answers from the server and visually displays them to the student. The student looks at the presented questions and options and enters their answer using the input means. At the same time, the emotion engine recognizes the student's emotions and analyzes the results.

[1263] The device sends the entered answer to the server, which compares it with the correct answer data. Based on the comparison result, an evaluation result of whether the answer is correct or incorrect is returned to the device. The device provides feedback to the student based on the evaluation result and adjusts the feedback based on the recognition results of the emotion engine.

[1264] Hardware and software processing

[1265] Hardware: Servers, terminals (PCs, smartphones, tablets, smart glasses, head-mounted displays)

[1266] Software: Educational database, emotion engine, feedback adjustment program

[1267] Example: The emotion engine uses a webcam to capture the student's facial expressions and a microphone to analyze the tone of their voice.

[1268] The evaluation means uses an algorithm that compares input data with ground truth data stored in a database.

[1269] Examples and prompts

[1270] As a concrete example, imagine a situation where the options "1. 7," "2. 8," and "3. 9" are displayed for the math problem "3 + 5 = ?". The user selects and enters the option they think is correct.

[1271] Example prompt sentence:

[1272] “Let’s solve a math problem. Answer the following question: 3 + 5 = ?

[1273] Select from:

[1274] 1. 7

[1275] 2.8

[1276] 3.9

[1277] What's your answer?

[1278] Now, let's think about it. It's okay if you make a mistake. Don't worry!

[1279] The prompts allow students to calmly tackle the problems, improving their learning effectiveness. Feedback adjustments by the emotion engine optimize the learning experience for each individual student.

[1280] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1281] Step 1:

[1282] The server starts the initialization process and loads the educational data into the database. The database stores questions, correct answers, and incorrect answers for each subject. At the same time, it initializes the emotion engine and prepares it to recognize students' emotions.

[1283] Input: Educational data

[1284] Output: Initialized database and emotion engine

[1285] Step 2:

[1286] The device sends the student's request to the server, which may include, for example, a "math" question.

[1287] Input: Student Request

[1288] Output: Request data to the server

[1289] Step 3:

[1290] When the server receives the request, it randomly selects one question from a specific subject (for example, "Mathematics") and also randomly selects the wrong answer data corresponding to that question.

[1291] Input: Student Request

[1292] Output: Selected questions and incorrect answers

[1293] Step 4:

[1294] The device receives the selected question and incorrect answer data and visually displays it to the student. The displayed content includes the question text and the incorrect answer options.

[1295] Input: Questions and incorrect answers sent from the server

[1296] Output: Questions and choices displayed on the device screen

[1297] Step 5:

[1298] The user (student) looks at the presented question and enters their answer. At the same time, the emotion engine monitors the student's facial expression, tone of voice, keyboard typing speed, etc. to analyze their emotional state.

[1299] Input: Data about student responses and student emotions

[1300] Output: Parsed emotional state and student response data

[1301] Step 6:

[1302] The device sends the student's answer to the server. The server compares the received answer with the correct answer data and evaluates the result. If the answer is correct, the result "correct" is returned, and if the answer is incorrect, the result "incorrect" is returned.

[1303] Input: Student response data

[1304] Output: Evaluation result (correct or incorrect)

[1305] Step 7:

[1306] The device receives the evaluation results from the server and provides feedback to the student. It also adjusts the feedback based on the recognition results of the emotion engine. For example, it adds an encouraging message to a nervous student.

[1307] Input: Evaluation results from the server and recognition results from the emotion engine

[1308] Output: Adjusted feedback content

[1309] Step 8:

[1310] The device displays the adjusted feedback to the student, who can then proceed to the next question or review the feedback. The cycle starts again when the student requests the next question.

[1311] Input: Adjusted feedback, student's next request

[1312] Output: Feedback shown to the student and preparation for the next question

[1313] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1314] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1315] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1316] [Fourth embodiment]

[1317] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1318] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1319] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1320] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1321] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1322] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1323] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1324] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1325] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1326] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1327] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1328] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1329] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1330] The present invention is an educational system that includes a database for storing educational data, a processing means for selecting educational questions and incorrect answer data, a display means for presenting the educational questions and incorrect answer data to students, an input means for inputting students' answers, an evaluation means for evaluating the answers, and a feedback means for providing feedback to students based on the evaluation results.

[1331] Program processing

[1332] Initialization

[1333] 1. Server:

[1334] The server first initializes a database containing educational data, which stores educational questions for each subject, correct answer data, and corresponding incorrect answer data.

[1335] For example, the educational questions in the "Mathematics" category include "2+2" and "3+5", and the corresponding incorrect answer data include "2+2=5" and "3+5=9".

[1336] Problem Statement

[1337] 2. Terminal:

[1338] When a student requests a "math" problem, the terminal sends the request to the server.

[1339] When the server receives the request, it randomly selects one problem from the "Math" category, let's say "2+2".

[1340] The server prepares the incorrect answer data "2+2=5" for the selected question and sends it to the terminal.

[1341] 3. Terminal:

[1342] The terminal visually displays the questions and incorrect answers to the user (student). The displayed content is as follows:

[1343] Problem: 2+2

[1344] Choices: 5

[1345] The device also has an input field for students to enter their answers.

[1346] User Answers

[1347] 4. User:

[1348] The user looks at the question and options displayed on the terminal, thinks about their answer, and if they think "2+2=4," they enter "4" into the terminal.

[1349] Submitting and rating answers

[1350] 5. Terminal:

[1351] The terminal sends the student's inputted answers to the server.

[1352] 6. Server:

[1353] The server compares the received answer "4" with the correct answer data for "2+2." Since the correct answer data for "2+2" is "4," the server confirms that the student's answer is correct.

[1354] If the answer to the question is correct, the evaluation result "correct" is returned to the terminal, and if the answer is incorrect, the evaluation result "incorrect" is returned to the terminal.

[1355] Feedback of evaluation results

[1356] 7. Terminal:

[1357] The terminal receives the evaluation results from the server and notifies the student, displaying a message like the following:

[1358] "Correct" or "Incorrect"

[1359] Flow of specific example

[1360] Mathematical Example

[1361] 1. Server:

[1362] During the initialization process, the server stores the correct answer "2+2=4" and the incorrect answer "2+2=5" in a database.

[1363] 2. Terminal:

[1364] The terminal requests "math" problems from the server in response to a user request.

[1365] 3. Server:

[1366] The server selects the problem "2+2," prepares the corresponding incorrect answer data "2+2=5," and sends it to the terminal.

[1367] 4. Terminal:

[1368] The device displays "Question: 2+2, Choices: 5" to the student and provides a field for entering the answer.

[1369] 5. User:

[1370] The user enters what they believe to be the correct answer, "4," into the terminal.

[1371] 6. Terminal:

[1372] The terminal sends the entered answer "4" to the server.

[1373] 7. Server:

[1374] The server evaluates the answer and, since "2+2=4" is the correct answer, sends the "correct answer" result to the terminal.

[1375] 8. Terminal:

[1376] The terminal displays the message "Correct" to the user.

[1377] In this way, students are provided with opportunities for independent learning and can develop critical thinking skills.

[1378] The processing flow will be explained below.

[1379] Step 1:

[1380] server:

[1381] When the program starts, the server initializes and loads educational data into a database. This database stores questions, correct answers, and incorrect answers for each subject. For example, the "Mathematics" category contains the question "2+2" and the corresponding correct answer "4" and incorrect answer "2+2=5."

[1382] Step 2:

[1383] Device:

[1384] The terminal displays an input interface for users (students) to request problems. An input field is provided for users to request "math" problems, and students can enter "math".

[1385] Step 3:

[1386] User:

[1387] The user (student) requests a "math" problem through the interface displayed on the terminal. Specifically, they enter "math" in the input field and press the send button.

[1388] Step 4:

[1389] Device:

[1390] The terminal receives the user's request and sends the request to the server.

[1391] Step 5:

[1392] server:

[1393] The server randomly selects one problem from the "Mathematics" category. If the selected problem is "2+2," it prepares the corresponding incorrect answer data "2+2=5."

[1394] Step 6:

[1395] server:

[1396] The server sends the selected question "2+2" and the incorrect answer data "2+2=5" to the terminal.

[1397] Step 7:

[1398] Device:

[1399] The device displays the question selected by the user, "2+2," and the incorrect answer, "2+2=5." Specifically,

[1400] Problem: 2+2

[1401] Choices: 5

[1402] and provides a field where the user can enter their answer.

[1403] Step 8:

[1404] User:

[1405] The user (student) looks at the question, thinks for himself / herself, decides on the correct answer "4", and enters "4" in the input field on the terminal.

[1406] Step 9:

[1407] Device:

[1408] The terminal sends the answer "4" entered by the user to the server.

[1409] Step 10:

[1410] server:

[1411] The server compares the received user answer "4" with the correct answer data "4" for the question "2+2." In this case, it matches the correct answer data, so it is determined to be the correct answer.

[1412] Step 11:

[1413] server:

[1414] The server sends the "correct answer" as the evaluation result to the terminal.

[1415] Step 12:

[1416] Device:

[1417] The terminal notifies the user of the evaluation result received from the server. Specifically, a message stating "The answer is correct" is displayed on the terminal.

[1418] In this way, the system can present students with problems, give them the opportunity to think for themselves, and provide feedback to further their learning.

[1419] Example 1

[1420] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1421] In conventional educational systems, students do not receive timely feedback on their answers, which can lead to a decline in motivation to learn and makes it difficult to grasp their level of understanding.In addition, the provision of incorrect answer data is fixed, which makes it difficult to cover the various mistakes made by students, making it difficult to resolve students' lack of understanding.

[1422] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1423] In this invention, the server includes a means for initializing a database that stores educational data, a means for randomly selecting educational questions and corresponding incorrect answer data requested by students and presenting them to the students, and a means for comparing the input answers with the correct answer data and generating evaluation results, thereby enabling the presentation of appropriate questions in response to requests and real-time feedback.

[1424] "Educational data" is a general term for information including educational questions, correct answer data, and incorrect answer data.

[1425] A "database" is a system that can systematically store, manage, and search educational data.

[1426] A "request" is the act of a student requesting the server for the question they wish to answer, or the information about that question.

[1427] A "problem" is an educational task or question posed to students.

[1428] "Incorrect answer data" is information about incorrect answers to questions.

[1429] "Correct answer data" is information on the correct answer to a question.

[1430] "Evaluation results" are information on the results obtained after comparing the student's answers with the correct answer data.

[1431] "Feedback" refers to replies and comments based on the evaluation results of students' answers.

[1432] An "input field" is an area on the device screen where a student enters an answer.

[1433] A "server" is a computer system that processes requests, selects questions, evaluates answers, and provides feedback.

[1434] A "terminal" is a device that students directly operate to display questions and input answers.

[1435] This invention is an educational system that utilizes a database for storing educational data, and is particularly equipped with a structure for smoothly carrying out a series of processes from presenting questions to evaluating answers and providing feedback. This invention is realized primarily through the interaction of three parties: a server, a terminal, and a user. The specific configuration and processing for implementing this system are described below.

[1436] Initialization

[1437] The server initializes a database that stores educational data. This database stores educational questions, correct answer data, and incorrect answer data for each subject. For example, a relational database management system (RDBMS) such as MySQL or PostgreSQL is used as the database management system. During initialization, "2 + 2" and "3 + 5" are entered as educational questions for a specific subject (e.g., "Mathematics"), and the correct answer data ("4" and "8") and incorrect answer data ("2 + 2 = 5" and "3 + 5 = 9") for each are stored.

[1438] Problem Statement

[1439] The device receives requests for educational questions from the user. If the user requests a "Mathematics" question, the request is sent from the device to the server. This request is made, for example, via an HTTP request using a RESTful API. When the server receives the request, it randomly selects a question for the relevant subject from the database. The selected question and its incorrect answer data are packaged in JSON format and sent to the device.

[1440] The device visually displays the received educational questions and incorrect answer data to the user. As an example, it shows the question "2+2" and the answer choice "5." It also provides an input field for students to enter their answers. The user interface is dynamically generated using HTML, CSS, and JavaScript.

[1441] User Answers

[1442] The user looks at the displayed question and options, thinks of their answer, and enters the answer, for example, "4." This input is done by keyboard operation or by clicking the submit button. The entered answer is sent to the server by the terminal. The transmission uses the HTTP protocol and a data package in JSON format.

[1443] Submitting and rating answers

[1444] The server compares the received user answer with the correct answer data. The server retrieves the correct answer data ("4") for the problem "2+2" from the database and compares it with the answer ("4") provided by the user. If the answer is correct, the server evaluates it as "correct," and if it is incorrect, it evaluates it as "incorrect." This evaluation result is again packaged in JSON format and sent back to the terminal.

[1445] Feedback of evaluation results

[1446] The terminal notifies the user of the evaluation result received from the server, for example by displaying a message such as "Correct" or "Incorrect." The display of the feedback is also implemented using HTML, CSS, and JavaScript.

[1447] Example prompt

[1448] Here are some example prompts to input to the generative AI model:

[1449] Example questions to the generative AI model:

[1450] Please suggest what options should be presented as incorrect answers in mathematics problems provided by the education system. For example, for the problem "2 + 2," please list some appropriate incorrect answers in addition to the correct answer. Also, please explain the rationale for these incorrect answers.

[1451] As described above, the present invention realizes an efficient education system by linking together the elements of the server, terminal, and user.

[1452] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1453] Step 1:

[1454] The server initializes a database that stores educational data. The database registers educational questions, correct answer data, and incorrect answer data for each subject. As a concrete example, the "Mathematics" category contains the problems "2+2" and "3+5," and the correct answer data "4" and "8" are stored, along with the corresponding incorrect answer data "2+2=5" and "3+5=9." The input is the educational dataset, and the output is the initialized database.

[1455] Step 2:

[1456] The user requests a "math" problem from the device. This request is sent as an HTTP request using, for example, a RESTful API. The input is the request information from the user, and the output is an HTTP request that sends that request to the server. The specific operation is the act of the user requesting a problem using the device interface.

[1457] Step 3:

[1458] When the server receives the request, it randomly selects a problem in the "Mathematics" category from the database. This selection is performed using an SQL query. For example, select the problem "2+2" and prepare the corresponding incorrect answer data "2+2=5". The input is the user's request and the database, and the output is a JSON response containing the selected problem and the incorrect answer data.

[1459] Step 4:

[1460] The device visually displays the questions and incorrect answer data received from the server to the user. An example display is "Question: 2+2, Choices: 5." This display is styled with HTML and CSS and dynamically updated with JavaScript. The input is the JSON response from the server, and the output is a screen that the user can visually confirm.

[1461] Step 5:

[1462] The user looks at the displayed question and options, thinks of an answer, and enters the answer, for example, "4." This input involves the specific action of entering a number on the keyboard into the input field of the terminal. The input is the user's answer, and the output is the data sent to the terminal.

[1463] Step 6:

[1464] The terminal sends the entered answer to the server. This data is again sent using the HTTP protocol. The input is the user's answer data, and the output is the HTTP request sent to the server.

[1465] Step 7:

[1466] The server checks the received answer data against the correct answer data. It compares the correct answer data "4" for "2+2" with the user's answer "4". If the answer is correct, it generates an evaluation of "correct", and if the answer is incorrect, it generates an evaluation of "incorrect". The input is the user's answer and correct answer data, and the output is a JSON response as the evaluation result.

[1467] Step 8:

[1468] The device receives the evaluation results from the server and displays them to the user. For example, it displays a message on the screen saying "Your answer is correct." This display is also constructed using HTML and CSS and updated using JavaScript. The input is the JSON response from the server, and the output is a feedback message that the user can visually confirm.

[1469] (Application example 1)

[1470] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1471] Existing educational systems are primarily aimed at providing students with basic learning, but do not address the acquisition of specialized skills, particularly the operational skills required for factory operators. Because operating factory equipment incorrectly can lead to serious accidents, effective education is needed to prevent operational errors. Furthermore, interactive usability, which allows operators to learn while actually operating the equipment, is also important. A system that can solve these problems is needed.

[1472] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1473] In this invention, the server includes a database means for storing educational data, a processing means for selecting educational questions to be presented to the user and corresponding incorrect answer data, and a display means for presenting the educational questions and incorrect answer data to the user. This makes it possible to receive learning requests from operators and provide appropriate educational questions. Furthermore, a visual display means corresponding to smart glasses or a head-mounted display allows operators to solve educational questions in the actual field, experience incorrect operations, and learn correct operations. Furthermore, by using a feedback means for evaluating input answers and providing feedback based on the evaluation results, it becomes easier for operators to immediately understand correct operating methods.

[1474] "Educational data" refers to data that includes the learning materials and questions necessary for the user to study, as well as related information.

[1475] A "database" is a data storage system that stores educational data and allows it to be searched and retrieved as needed.

[1476] "Processing means" refers to a computing device or algorithm that selects educational questions and incorrect answer data based on given input data and presents them to the user at the appropriate time.

[1477] "Display means" refers to a device for visually presenting the selected educational question and incorrect answer data to the user, and specifically includes smart glasses and a head-mounted display.

[1478] "Input means" refers to an interface that allows a user to input answers to educational questions, such as a keyboard or touch panel.

[1479] "Evaluation means" refers to a device or algorithm that compares the inputted user's answer with correct answer data and evaluates it based on the results.

[1480] "Feedback means" refers to a mechanism for informing users of correct operation methods and learning content based on the evaluation results.

[1481] "Server means" refers to a computer system for managing an educational database and processing requests from users.

[1482] "Visual display means" refers to a device for displaying educational questions and feedback through smart glasses or a head-mounted display worn by the user.

[1483] "Educational questions related to the operation of factory equipment" are questions related to the operation of machinery in a factory, and include content for learning operating procedures and points to note.

[1484] "Incorrect answer data" is data that includes incorrect options or operation procedures for correct answers, and is a means of learning mistakes that users often make.

[1485] "Feedback to help learn how to operate" refers to information that shows the correct operating procedure when the user gives an incorrect answer, and provides advice and assistance so that the user can get the correct answer the next time.

[1486] This invention is an educational system specialized for training factory robot operators. By using smart glasses or a head-mounted display, users can learn about operational problems and examples of incorrect operation of factory equipment in real time and master the correct operation methods.

[1487] First, this system uses a database that stores a large amount of training data. This database contains training questions about various factory equipment operations and the corresponding incorrect answers. For example, the correct way to "start a conveyor belt" is to "press the start button," while an example of an incorrect operation is to "not press the start button."

[1488] The server receives the user's learning request, and based on that request, selects corresponding educational questions and incorrect answer data using a processing means and randomly presents them. Smart glasses or a head-mounted display are used as a display means. This allows the user to visually check the educational questions and incorrect answer data as they progress through their learning.

[1489] The user inputs answers to the displayed questions using the input means of the smart glasses or head-mounted display. This input data is sent to the server, where it is compared with the correct answer data by the server's evaluation means. Based on the evaluation results, if the operation is correct, it is judged as "correct," and if the operation is incorrect, it is judged as "incorrect," and the result is fed back to the user's smart glasses or head-mounted display.

[1490] For example, if a user incorrectly inputs "Do not press the start button" in response to a question about "starting the conveyor belt," this incorrect operation will be evaluated as an "incorrect answer" on the server side, and feedback such as "Incorrect. Please press the start button" will be displayed on the smart glasses or head-mounted display.

[1491] The implementation of this system requires the following hardware and software:

[1492] Hardware: Smart glasses (e.g., Google Glass), head-mounted displays (e.g., Oculus Rift)

[1493] Software: Server software (Apache Tomcat), database (MySQL), application for smart glasses and head-mounted displays (Python + OpenCV)

[1494] In addition, by using a generative AI model, it is possible to generate educational questions and incorrect answer data, and provide feedback based on evaluation results.

[1495] Here is an example of a prompt to input to a generative AI model:

[1496] In a factory robot operation training system, an operator requests learning how to "start a conveyor belt" through smart glasses. To help the operator learn the correct operation, the server needs to provide data on the correct operation ("press the start button") and the incorrect operation ("not pressing the start button"). Please specifically explain how to provide feedback to help the operator correct the problem and perform the correct operation.

[1497] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1498] Step 1:

[1499] The server initializes the database that stores the training data and registers the factory equipment operation questions and incorrect answer data. Specifically, the correct way to "start the conveyor belt" is to "press the start button," and an example of an incorrect operation is to "not press the start button," and these are added to the database.

[1500] Step 2:

[1501] The user puts on smart glasses or a head-mounted display and inputs a learning request for operation training. The user's request (e.g., "I would like to learn how to start a conveyor belt") is input.

[1502] Step 3:

[1503] The terminal sends the user's learning request to the server. The input is the request entered by the user, and the output is the request reaching the server.

[1504] Step 4:

[1505] The server randomly selects the corresponding training questions and incorrect answer data from the database based on the received learning request. The input is the user's request, and the output is the training questions and incorrect answer data extracted from the database.

[1506] Step 5:

[1507] The server sends the selected educational questions and incorrect answer data to the terminal. The input is the extracted educational questions and incorrect answer data, and the output is the transmission of the data.

[1508] Step 6:

[1509] The device visually presents the educational questions and incorrect answer data to the user. Specifically, the questions and incorrect answer data are displayed on the screen of smart glasses or a head-mounted display. The input is the educational questions and incorrect answer data sent from the server, and the output is the displayed educational content.

[1510] Step 7:

[1511] The user inputs an answer based on the presented question. Specifically, the user inputs the answer through the input interface of smart glasses or a head-mounted display. The input is the answer entered by the user, and the output is the answer data.

[1512] Step 8:

[1513] The terminal sends the user's answer to the server. The input is the user's answer and the output is the transmission.

[1514] Step 9:

[1515] The server receives the user's answer and evaluates it by comparing it with the correct answer data. Specifically, the server retrieves the correct answer data from the database and compares it with the answer. The input is the user's answer and the correct answer data, and the output is the evaluation result (correct / incorrect).

[1516] Step 10:

[1517] The server generates feedback content based on the evaluation results and sends it to the terminal. The input is the evaluation results, and the output is the transmission of the generated feedback content.

[1518] Step 11:

[1519] The device visually notifies the user of the received feedback. Specifically, the feedback content (e.g., "Incorrect. Please press the start button.") is displayed on the screen of the smart glasses or head-mounted display. The input is the feedback content sent from the server, and the output is the displayed feedback.

[1520] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1521] The present invention is an educational system that includes a database for storing educational data, a processing means for selecting educational questions and corresponding incorrect answer data, a display means for presenting the educational questions and incorrect answer data to students, an input means for inputting students' answers, an evaluation means for evaluating the input answers, a feedback means for providing feedback to students based on the evaluation results, and an emotion engine that recognizes the user's emotions and adjusts the feedback.

[1522] Program processing

[1523] Initialization

[1524] 1. Server:

[1525] When the program starts, the server initializes and loads educational data into a database. This database stores questions, correct answers, and incorrect answers for each subject. For example, the "Mathematics" category contains the question "2+2" and the corresponding correct answer "4" and incorrect answer "2+2=5."

[1526] The emotion engine is also initialized at the same time to prepare for recognizing student emotions. This engine monitors the student's facial expressions, tone of voice, keyboard typing speed, etc.

[1527] Problem Statement

[1528] 2. Terminal:

[1529] When a student requests a problem, the device sends the request to the server. The request includes, for example, a "math" problem.

[1530] When the server receives the request, it randomly selects one problem from the "Math" category, let's say "2+2".

[1531] The server prepares the incorrect answer data "2+2=5" for the selected question and sends it to the terminal.

[1532] 3. Terminal:

[1533] The terminal visually displays the questions and incorrect answers to the user (student). The displayed content is as follows:

[1534] Problem: 2+2

[1535] Choices: 5

[1536] The device also has an input field for students to enter their answers.

[1537] Recognizing user responses and emotions

[1538] 4. User:

[1539] The user (student) looks at the question, thinks for himself / herself, decides on the correct answer "4", and enters "4" in the input field on the terminal.

[1540] At the same time, the emotion engine analyzes the student's facial expressions, tone of voice, typing speed, etc. to recognize the student's current emotional state.

[1541] Submitting and rating answers

[1542] 5. Terminal:

[1543] The terminal sends the answer "4" entered by the user to the server.

[1544] 6. Server:

[1545] The server compares the received user answer "4" with the correct answer data "4" for the question "2+2." In this case, it matches the correct answer data, so it is determined to be the correct answer.

[1546] If the answer to the question is correct, the evaluation result "correct" is returned to the terminal, and if the answer is incorrect, the evaluation result "incorrect" is returned to the terminal.

[1547] Feedback on evaluation results and reflection of emotions

[1548] 7. Terminal:

[1549] The device receives the evaluation results from the server and notifies the student by displaying a message saying "Correct" or "Incorrect."

[1550] Based on the recognition results of the emotion engine, the feedback of the assessment results is adjusted. For example, if a student is nervous, an encouraging message is displayed to help them relax.

[1551] Flow of specific example

[1552] Mathematical Example

[1553] 1. Server:

[1554] During the initialization process, the server stores the correct answer "2+2=4" and the incorrect answer "2+2=5" in the database and also initializes the emotion engine.

[1555] 2. Terminal:

[1556] The terminal requests "math" problems from the server in response to a user request.

[1557] 3. Server:

[1558] The server selects the problem "2+2," prepares the corresponding incorrect answer data "2+2=5," and sends it to the terminal.

[1559] 4. Terminal:

[1560] The device displays "Question: 2+2, Choices: 5" to the student and provides a field for entering the answer.

[1561] 5. User:

[1562] The user enters the answer they believe to be correct, "4," into the device. At the same time, the emotion engine analyzes the student's facial expressions, tone of voice, and keyboard typing speed to recognize their emotions.

[1563] 6. Terminal:

[1564] The terminal sends the entered answer "4" to the server.

[1565] 7. Server:

[1566] The server evaluates the answer and, since "2+2=4" is the correct answer, sends the "correct answer" result to the terminal.

[1567] 8. Terminal:

[1568] The device displays the message "That's correct" to the user, and, based on the recognition results of the emotion engine, displays messages of encouragement or support as needed.

[1569] In this way, the system can present students with problems, provide them with opportunities to think for themselves, and even recognize their emotions and provide appropriate feedback to deepen their learning.

[1570] The processing flow will be explained below.

[1571] Step 1:

[1572] server:

[1573] The server initializes itself when the program starts. First, it loads educational data into a database. This database stores questions, correct answers, and incorrect answers for each subject. For example, the "Mathematics" category contains the question "2+2" and the corresponding correct answer "4" and incorrect answer "2+2=5." The server also initializes the emotion engine, setting parameters for emotion recognition, such as the student's facial expression, tone of voice, and keyboard typing speed.

[1574] Step 2:

[1575] Device:

[1576] The terminal displays an input interface for users (students) to request problems. For example, if a user requests a "Mathematics" problem, the terminal provides a field for entering the request and a submit button.

[1577] Step 3:

[1578] User:

[1579] The user (student) requests a "math" problem through the interface displayed on the terminal. Specifically, they enter "math" in the input field and press the send button.

[1580] Step 4:

[1581] Device:

[1582] The terminal receives the user's request and sends the content ("mathematics") to the server.

[1583] Step 5:

[1584] server:

[1585] The server analyzes the received request and randomly selects one problem from the "Mathematics" category. Let's take "2+2" as an example. Then, it prepares the correct answer data and incorrect answer data for the selected problem. For example, it prepares "2+2=5" as the incorrect answer data for the problem "2+2".

[1586] Step 6:

[1587] server:

[1588] The server sends the selected question "2+2" and the incorrect answer data "2+2=5" to the terminal.

[1589] Step 7:

[1590] Device:

[1591] The device visually displays the received question "2+2" and the incorrect answer "2+2=5" to the user. Specifically, it displays the following:

[1592] Problem: 2+2

[1593] Choices: 5

[1594] It also provides an input field for the user to enter their answer.

[1595] Step 8:

[1596] User:

[1597] The user (student) looks at the presented question, thinks for himself / herself, decides on the correct answer "4", and enters "4" in the input field on the terminal.

[1598] Step 9:

[1599] Emotion Engine (Device):

[1600] At the same time, the emotion engine analyzes the user's facial expressions, tone of voice, and keyboard input speed to recognize the user's emotional state (e.g., whether they are nervous or relaxed). The recognized emotion data is used for subsequent feedback.

[1601] Step 10:

[1602] Device:

[1603] The terminal sends the answer "4" entered by the user to the server.

[1604] Step 11:

[1605] server:

[1606] The server compares the received user answer "4" with the correct answer data "4" for the question "2+2." In this case, it matches the correct answer data, so it is determined to be the correct answer.

[1607] Step 12:

[1608] server:

[1609] The server sends the evaluation result ("correct" or "incorrect") to the terminal.

[1610] Step 13:

[1611] Device:

[1612] The device receives the evaluation result from the server and notifies the user of the result, specifically by displaying "Correct" or "Incorrect."

[1613] Step 14:

[1614] Feedback method (terminal):

[1615] It also tailors the feedback based on the emotion engine's recognition results: for example, if the user is nervous, it displays an encouraging message like, "You're doing great! Keep it up!"

[1616] In this way, the system can present students with problems, provide them with opportunities to think for themselves, and even recognize their emotions and provide appropriate feedback to deepen their learning.

[1617] Example 2

[1618] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1619] In conventional educational systems, feedback to students is constant and does not take into account the emotional state of the student, and feedback is not provided at an appropriate time or in an appropriate manner. Furthermore, problems are not presented efficiently according to the student's level of understanding, and incorrect answers are not presented, making it difficult to improve students' learning effectiveness.

[1620] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a storage device for storing educational data, a processing device for selecting educational questions to be presented to the learner and corresponding incorrect answer data, a display device for presenting the educational questions and incorrect answer data to the learner, an input device for inputting the learner's answers, an evaluation device for evaluating the input answers, a feedback device for providing feedback to the learner based on the evaluation results, and an emotion recognition device for recognizing the learner's emotions and adjusting the feedback. This makes it possible to provide feedback at an appropriate time and in an appropriate manner taking into account the student's emotional state, which is expected to improve the student's learning effectiveness.

[1621] "Educational data" refers to information such as questions, answers, and explanations that are primarily used for educational purposes.

[1622] "Storage device" refers to a medium that can save, store, read, and write data, and examples include hard disks, SSDs, and cloud storage.

[1623] "Incorrect answer data" refers to data on incorrect answers that may be other than the correct answer, and is used to check a student's understanding or correct misunderstandings.

[1624] A "processing device" is a device that performs various calculations and data processing within a computer, and includes CPUs and GPUs.

[1625] "Display device" refers to a device that visually presents data or information to a user, and includes monitors, smartphones, tablets, etc.

[1626] An "input device" is a device that allows a user to input information or data into a system, such as a keyboard, mouse, or touch panel.

[1627] An "evaluation device" is a device that analyzes data input from users and performs evaluations and judgments. For example, it has the role of comparing students' answers with correct answer data and making an evaluation.

[1628] A "feedback device" is a device that provides students with appropriate advice and information based on the evaluation results, and feedback is given in the form of text, audio, video, etc.

[1629] An "emotion recognition device" is a device that analyzes and recognizes a user's emotional state in real time, using, for example, facial expression analysis, voice tone analysis, keyboard input speed, etc.

[1630] The present invention is a storage device for storing educational data, a system for presenting educational questions and corresponding incorrect answer data to a learner, and a system for evaluating the learner's answers and providing feedback based on the evaluation results.

[1631] The server has a storage device for storing educational data. This storage device stores questions, correct answers, and incorrect answer data for each subject. For example, the educational data for "Mathematics" includes the problem "2+2," its correct answer data "4," and incorrect answer data "2+2=5." When presenting a question to a student, the server selects the necessary question and incorrect answer data from this database.

[1632] When a learner requests a question using a device, the device sends the request to the server. The server receives the request, randomly selects one question from a specified subject, such as the "Mathematics" category, and prepares the wrong answer data. This data is sent to the device and displayed to the student.

[1633] The device visually displays the questions and incorrect answers it receives, as follows:

[1634] Problem: 2+2

[1635] Choices: 5

[1636] Furthermore, the terminal is provided with an input field for the learner to enter their answer. The learner enters the answer they believe to be correct into the input field.

[1637] When the learner enters an answer, the device sends the answer to the server. The server compares the received answer with the correct answer data stored in the memory device. If the answer is correct, it is judged to be "correct" and the result is returned to the device. If the answer is incorrect, it is returned as "incorrect."

[1638] A unique feature of this system is that it takes into account the learner's emotional state when providing feedback. The emotion recognition device analyzes the learner's current emotional state in real time based on facial expressions, tone of voice, keyboard typing speed, etc. The feedback is adjusted based on the analysis results. For example, if the learner is nervous, an encouraging message to help them relax will be displayed, such as:

[1639] Correct! Great! Relax and do your best on the next question.

[1640] For example, the following prompts can be used:

[1641] Problem: 2+2

[1642] Choices: 5

[1643] This system not only presents learners with problems and gives them the opportunity to think for themselves, but also takes their emotional state into account to maximize learning effectiveness.

[1644] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1645] Step 1:

[1646] server:

[1647] When the program starts, the server performs initialization and loads the educational data into the storage device. The questions, correct answers, and incorrect answers for each subject are stored in the storage device. For example, the mathematics category contains the question "2+2," the correct answer "4," and the incorrect answer "2+2=5." The emotion recognition device is also initialized at the same time, and is ready to monitor the learner's facial expressions, tone of voice, keyboard input speed, etc. In this case, the input is the educational data file, and the output is the educational data loaded into the storage device.

[1648] Step 2:

[1649] Device:

[1650] When a learner requests a question, the device sends the request details (such as the subject category) to the server. The request details may include, for example, "Give me a math question." This request is the input data, and the request sent from the device to the server is the output.

[1651] Step 3:

[1652] server:

[1653] The server receives a request from the terminal and randomly selects one problem from the specified subject category ("Mathematics" in this case). For example, it selects the problem "2+2" and the corresponding incorrect answer data "2+2=5". This problem and the incorrect answer data become output data based on the input data and are sent to the terminal.

[1654] Step 4:

[1655] Device:

[1656] The terminal visually displays the questions and incorrect answers received from the server to the learner. The display contents are as follows:

[1657] Problem: 2+2

[1658] Choices: 5

[1659] In addition, an input field is provided for the learner to enter their answers. The input data to the terminal is the question data and incorrect answer data from the server, and the output is displayed to the learner.

[1660] Step 5:

[1661] User:

[1662] The user (learner) checks the question, thinks of the correct answer "4", and enters it into the input field on the device. At this time, the emotion recognition device monitors the learner's facial expressions, tone of voice, and keyboard input speed. The user's input data is the answer "4", and the output is the data entered into the input field on the device.

[1663] Step 6:

[1664] Device:

[1665] The terminal sends the answer "4" entered by the learner to the server. The input data is the learner's answer "4", and the output is to send that data to the server.

[1666] Step 7:

[1667] server:

[1668] The server compares the received answer "4" with the correct answer data "4" stored in the memory device. In this case, it matches the correct answer data for "2+2," which is "4," so it is determined to be the correct answer. The input data is the learner's answer "4," and the output data is "correct answer." This evaluation result is sent to the terminal.

[1669] Step 8:

[1670] Device:

[1671] The device notifies the learner of the evaluation results received from the server. Feedback such as "Your answer is correct" is displayed. At the same time, based on the analysis results of the emotion recognition device, an encouraging message such as "Relax and do your best on the next question" is displayed. The input data are the evaluation results from the server and the analysis results of the emotion recognition device, and the output is the display of the feedback message to the learner.

[1672] (Application example 2)

[1673] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1674] In conventional educational systems, feedback to students is uniform, making it difficult to respond appropriately to students' emotions and learning progress. As a result, the stress and confusion students feel during the learning process can have a negative impact on their learning outcomes. Furthermore, the method of presenting incorrect answer data is fixed, resulting in a lack of ingenuity to improve the quality of the educational experience.

[1675] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a database for storing educational data, a processing means for selecting educational questions to be presented to students and corresponding incorrect answer data, and a display means for presenting the educational questions and incorrect answer data to students. This enables real-time feedback adjustment for students based on their individual emotional states. Furthermore, by using an emotion engine, it is possible to recognize students' emotions and adjust feedback, thereby reducing stress and confusion for students and supporting effective learning. Furthermore, by randomly selecting incorrect answer data, the quality of the educational experience can be improved.

[1676] "Educational data" refers to the learning content, questions, and answer data presented to students.

[1677] A "database" is a system for systematically storing and managing educational data.

[1678] "Processing means" refers to a device or algorithm for selecting educational questions and corresponding incorrect answer data.

[1679] "Display means" means a screen, display, or visual display device for presenting educational questions and incorrect answer data to a student.

[1680] An "input means" is a keyboard, touch screen, or other input device through which a student enters their answer.

[1681] The "evaluation means" refers to a device or logic that collates the input answer with the correct answer data and evaluates it based on the results.

[1682] A "feedback means" is a device or logic for providing feedback to students based on the assessment results.

[1683] The "emotion engine" is a system that analyzes information such as students' facial expressions, tone of voice, and typing speed to recognize their emotions.

[1684] The "real-time feedback adjustment means" refers to a device or logic for adjusting the feedback content in real time based on the recognition results of the emotion engine.

[1685] The term "system" refers to a set of devices and software including the various means described above.

[1686] System Overview

[1687] The present invention relates to an educational system, and an embodiment of the system includes a database for storing educational data, a processing means for selecting questions and incorrect answer data, a display means, an input means, an evaluation means, a feedback means, an emotion engine, and a real-time feedback adjustment means. Specifically, the present invention is embodied in the form of a learning support application called "EduVision."

[1688] Program processing

[1689] server

[1690] During initialization, the server loads educational data into the database. The educational data includes questions, correct answers, and incorrect answers for each subject. The emotion engine is also initialized at the same time, preparing to recognize students' emotions. This engine monitors students' facial expressions, tone of voice, keyboard typing speed, etc.

[1691] In response to a request, the server randomly selects questions from a specific subject, such as "Mathematics." For the selected questions, incorrect answer data is also randomly selected and sent to the terminal via the display means.

[1692] Terminal

[1693] Based on the student's request, the device receives questions and incorrect answers from the server and visually displays them to the student. The student looks at the presented questions and options and enters their answer using the input means. At the same time, the emotion engine recognizes the student's emotions and analyzes the results.

[1694] The device sends the entered answer to the server, which compares it with the correct answer data. Based on the comparison result, an evaluation result of whether the answer is correct or incorrect is returned to the device. The device provides feedback to the student based on the evaluation result and adjusts the feedback based on the recognition results of the emotion engine.

[1695] Hardware and software processing

[1696] Hardware: Servers, terminals (PCs, smartphones, tablets, smart glasses, head-mounted displays)

[1697] Software: Educational database, emotion engine, feedback adjustment program

[1698] Example: The emotion engine uses a webcam to capture the student's facial expressions and a microphone to analyze the tone of their voice.

[1699] The evaluation means uses an algorithm that compares input data with ground truth data stored in a database.

[1700] Examples and prompts

[1701] As a concrete example, imagine a situation where the options "1. 7," "2. 8," and "3. 9" are displayed for the math problem "3 + 5 = ?". The user selects and enters the option they think is correct.

[1702] Example prompt sentence:

[1703] “Let’s solve a math problem. Answer the following question: 3 + 5 = ?

[1704] Select from:

[1705] 1. 7

[1706] 2.8

[1707] 3.9

[1708] What's your answer?

[1709] Now, let's think about it. It's okay if you make a mistake. Don't worry!

[1710] The prompts allow students to calmly tackle the problems, improving their learning effectiveness. Feedback adjustments by the emotion engine optimize the learning experience for each individual student.

[1711] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1712] Step 1:

[1713] The server starts the initialization process and loads the educational data into the database. The database stores questions, correct answers, and incorrect answers for each subject. At the same time, it initializes the emotion engine and prepares it to recognize students' emotions.

[1714] Input: Educational data

[1715] Output: Initialized database and emotion engine

[1716] Step 2:

[1717] The device sends the student's request to the server, which may include, for example, a "math" question.

[1718] Input: Student Request

[1719] Output: Request data to the server

[1720] Step 3:

[1721] When the server receives the request, it randomly selects one question from a specific subject (for example, "Mathematics") and also randomly selects the wrong answer data corresponding to that question.

[1722] Input: Student Request

[1723] Output: Selected questions and incorrect answers

[1724] Step 4:

[1725] The device receives the selected question and incorrect answer data and visually displays it to the student. The displayed content includes the question text and the incorrect answer options.

[1726] Input: Questions and incorrect answers sent from the server

[1727] Output: Questions and choices displayed on the device screen

[1728] Step 5:

[1729] The user (student) looks at the presented question and enters their answer. At the same time, the emotion engine monitors the student's facial expression, tone of voice, keyboard typing speed, etc. to analyze their emotional state.

[1730] Input: Data about student responses and student emotions

[1731] Output: Parsed emotional state and student response data

[1732] Step 6:

[1733] The device sends the student's answer to the server. The server compares the received answer with the correct answer data and evaluates the result. If the answer is correct, the result "correct" is returned, and if the answer is incorrect, the result "incorrect" is returned.

[1734] Input: Student response data

[1735] Output: Evaluation result (correct or incorrect)

[1736] Step 7:

[1737] The device receives the evaluation results from the server and provides feedback to the student. It also adjusts the feedback based on the recognition results of the emotion engine. For example, it adds an encouraging message to a nervous student.

[1738] Input: Evaluation results from the server and recognition results from the emotion engine

[1739] Output: Adjusted feedback content

[1740] Step 8:

[1741] The device displays the adjusted feedback to the student, who can then proceed to the next question or review the feedback. The cycle starts again when the student requests the next question.

[1742] Input: Adjusted feedback, student's next request

[1743] Output: Feedback shown to the student and preparation for the next question

[1744] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1745] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1746] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1747] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1748] FIG. 9 illustrates an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and behaviors arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1749] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1750] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1751] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1752] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1753] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1754] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1755] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1756] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1757] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1758] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1759] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1760] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1761] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1762] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1763] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1764] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1765] The following is further disclosed regarding the above embodiment.

[1766] (Claim 1)

[1767] a database for storing educational data;

[1768] a processing means for selecting an educational question to be presented to a student and corresponding incorrect answer data;

[1769] a display means for presenting educational questions and incorrect answer data to students;

[1770] an input means for inputting student responses;

[1771] evaluation means for evaluating the input answers;

[1772] a feedback mechanism to provide feedback to students based on the assessment results;

[1773] education system, including

[1774] (Claim 2)

[1775] 2. The education system according to claim 1, further comprising processing means for randomly selecting incorrect answer data when presenting an educational question to a student.

[1776] (Claim 3)

[1777] 2. The education system according to claim 1, wherein the evaluation means includes processing means for comparing the answers of the students with correct answer data and evaluating the students based on the comparison results.

[1778] "Example 1"

[1779] (Claim 1)

[1780] A means for initializing a database for storing educational data;

[1781] A means for randomly selecting and presenting to the student the educational questions and corresponding incorrect answer data requested by the student;

[1782] a means for visually displaying the educational questions and incorrect answer data presented to the student and providing input fields;

[1783] a means for transmitting the answers entered by the student to a server;

[1784] A means for comparing the input answers with correct answer data and generating an evaluation result;

[1785] a means of providing students with feedback based on the assessment results;

[1786] A system including:

[1787] (Claim 2)

[1788] 2. The system according to claim 1, further comprising means for randomly selecting incorrect answer data when presenting an educational question to a student.

[1789] (Claim 3)

[1790] 2. The system according to claim 1, wherein the evaluation means includes means for comparing the student's answer with correct answer data and evaluating the student based on the comparison result.

[1791] "Application Example 1"

[1792] (Claim 1)

[1793] a database for storing educational data;

[1794] a processing means for selecting an educational question to be presented to a user and corresponding incorrect answer data;

[1795] a display means for presenting the educational questions and incorrect answer data to the user;

[1796] an input means for inputting a user's answer;

[1797] evaluation means for evaluating the input answers;

[1798] a feedback means for providing feedback to the user based on the evaluation result;

[1799] a server means for generating learning requests for operators and transmitting training questions;

[1800] a visual display means compatible with smart glasses or a head-mounted display;

[1801] a processing means for processing data containing training questions and incorrect answers relating to the operation of factory equipment;

[1802] a means of providing feedback to help users learn how to operate the device;

[1803] A system including:

[1804] (Claim 2)

[1805] 2. The system according to claim 1, further comprising processing means for randomly selecting incorrect answer data when presenting an educational question to a user.

[1806] (Claim 3)

[1807] 2. The system according to claim 1, wherein the evaluation means includes processing means for comparing the user's answer with correct answer data and evaluating the answer based on the comparison result.

[1808] "Example 2: Combining Emotion Engines"

[1809] (Claim 1)

[1810] a storage device for storing educational data;

[1811] a processing device for selecting educational questions to be presented to a learner and corresponding incorrect answer data;

[1812] a display device that presents educational questions and incorrect answer data to a learner;

[1813] an input device for inputting learner responses;

[1814] an evaluation device that evaluates the input answers;

[1815] a feedback device that provides feedback to the learner based on the evaluation result;

[1816] an emotion recognition device that recognizes the learner's emotions and adjusts feedback;

[1817] A system including:

[1818] (Claim 2)

[1819] 2. The system according to claim 1, further comprising a processing device that randomly selects incorrect answer data when presenting an educational question to a learner.

[1820] (Claim 3)

[1821] 2. The system according to claim 1, wherein the evaluation device includes a processing device that checks the learner's answer against correct answer data and evaluates the learner based on the check result.

[1822] "Application example 2 when combining emotion engines"

[1823] (Claim 1)

[1824] a database for storing educational data;

[1825] a processing means for selecting an educational question to be presented to a student and corresponding incorrect answer data;

[1826] a display means for presenting educational questions and incorrect answer data to students;

[1827] an input means for inputting student responses;

[1828] evaluation means for evaluating the input answers;

[1829] a feedback mechanism to provide feedback to students based on the assessment results;

[1830] a means including an emotion engine for recognizing student emotions and adjusting feedback;

[1831] Real-time emotion-based feedback adjustment measures;

[1832] A system including:

[1833] (Claim 2)

[1834] 2. The system according to claim 1, further comprising processing means for randomly selecting incorrect answer data when presenting an educational question to a student.

[1835] (Claim 3)

[1836] 2. The system according to claim 1, wherein the evaluation means includes processing means for comparing the student's answer with correct answer data and evaluating the student based on the comparison result. [Explanation of symbols]

[1837] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a database for storing educational data; a processing means for selecting an educational question to be presented to a student and corresponding incorrect answer data; a display means for presenting educational questions and incorrect answer data to students; an input means for inputting student responses; evaluation means for evaluating the input answers; a feedback mechanism to provide feedback to students based on the assessment results; education system, including

2. 2. The education system according to claim 1, further comprising processing means for randomly selecting incorrect answer data when presenting an educational question to a student.

3. 2. The education system according to claim 1, wherein the evaluation means includes processing means for comparing the answers of the students with correct answer data and evaluating the students based on the comparison results.

Images