System

Abstract

To provide a system.SOLUTION: A system includes means for generating answers to questions in the form of text and comics using a generative AI model based on prompt sentences generated from the questions input by a user, means for generating customized educational documents according to the interests of the user based on an analysis result of analyzing the emotions of the user using an emotion engine, and means for transmitting the customized educational documents to a user terminal.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including a description and related instruction sentence regarding the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-180282 A Summary of the Invention [Problem to be solved by the invention]

[0004] With traditional educational methods, many elementary and junior high school students have no interest in studying, which results in a lack of motivation to learn and the lack of expected learning outcomes. [Means for solving the problem]

[0005] To solve this problem, the present invention provides a means for elementary and junior high school students to ask questions and for AI to respond in the form of text or comics, a means for elementary and junior high school students to tailor the questions to their preferences, and a means for students to create their own textbooks. This allows students to tailor their learning content themselves, makes it possible for them to study with interest, and is expected to increase their motivation to learn. [Brief description of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Diagram 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. FIG. [Diagram 3] FIG. 11 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Diagram 5] FIG. 13 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 13 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 13 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a process flow of the data processing system in the first embodiment of the first form example. [Figure 12] FIG. 11 is a sequence diagram showing a process flow of the data processing system in the application example 1 of the first embodiment. [Figure 13] FIG. 11 is a sequence diagram showing a process flow of the data processing system in the second embodiment of the second embodiment. [Figure 14] FIG. 13 is a sequence diagram showing a process flow of the data processing system in application example 2 of embodiment 2. [Figure 15] FIG. 13 is a sequence diagram showing a process flow of a data processing system in a third embodiment of the present invention. [Figure 16]FIG. 13 is a sequence diagram showing a process flow of the data processing system in the third application example of the third embodiment. [Figure 17] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when combined with an emotion engine. [Figure 19] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system according to the embodiment 2 of the second embodiment in the case where an emotion engine is combined. [Figure 20] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when combined with an emotion engine. [Figure 21] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in the embodiment 3 of the form example 3 in the case where an emotion engine is combined. [Figure 22] FIG. 13 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when combined with an emotion engine. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a signed processor (hereinafter simply referred to as a "processor") may be one arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be one type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a signed RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by the processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a code is an interface including a communication processor and an antenna. The communication I / F controls communication between multiple computers. An example of a communication standard applied to the communication I / F is a wireless communication standard including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. In addition, in this specification, the same idea as "A and / or B" is also applied when three or more things are expressed by connecting them with "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A and a microphone 38B, and receives user input. The touch panel 38A detects contact with a pointer (e.g., a pen or a finger) to receive user input by the touch of the pointer. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (e.g., voice and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs voice according to instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a Complementary Metal-Oxide-Semiconductor (CMOS) image sensor or a Charge Coupled Device (CCD) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of main functions of the data processing device 12 and the smart device 14.

[0023] As shown in Fig. 2, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32. The specific process program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific process program 56 from the storage 32, and executes the read specific process program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific process program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores a reception output program 60. The reception output program 60 is used together with the specific processing program 56 by the data processing system 10. The processor 46 reads out the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1"

[0028] In one embodiment of the present invention, there is an application that is installed on a device (e.g., a PC, a tablet, etc.) used by elementary and junior high school students. This application provides an interface for elementary and junior high school students to input questions, and transmits the input questions to an AI engine. The AI ​​engine generates answers to the questions and provides the answers in the form of text or comics. Elementary and junior high school students can tailor the questions to their preferences and create their own personalized textbooks.

[0029] "Example 2"

[0030] As a specific example, if an elementary or junior high school student inputs the question "Why is the Earth round?" into the application, the AI ​​engine will generate a text answer such as "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical." In response to the same question, the engine will also generate a cartoon depicting the process by which the Earth becomes round, providing a deeper visual understanding.

[0031] "Example 3"

[0032] In addition, a function will be provided for elementary and junior high school students to create their own textbooks. For example, elementary and junior high school students can select topics that interest them, such as "shape of the Earth," "gravity of the Earth," and "rotation of the Earth," and create a textbook by collecting questions and answers related to those topics. This allows students to adjust the content of their studies themselves and study in a way that interests them.

[0033] The process flow of each embodiment will be described below.

[0034] "Example 1"

[0035] Step 1: Elementary and junior high school students operate a device (e.g., a computer or tablet) and launch an application.

[0036] Step 2: The application provides an interface through which the student inputs a question. The student inputs a question through the interface.

[0037] Step 3: The application sends the entered question to the AI ​​engine.

[0038] Step 4: The AI ​​engine generates answers to the questions and provides the answers in the form of text or comics.

[0039] Step 5: Students review the answers generated and adjust questions as needed.

[0040] Step 6: Primary and secondary school students can use the Create Your Own Textbook feature to create a textbook by collecting questions and answers related to topics that interest them.

[0041] "Example 2"

[0042] Step 1: Elementary and middle school students enter the question "Why is the Earth round?" into the application.

[0043] Step 2: The application sends this question to the AI ​​engine.

[0044] Step 3: The AI ​​engine generates a text answer that says, "The Earth is round because the Earth's gravity acts equally in all directions, so objects naturally take on a spherical shape."

[0045] Step 4: The AI ​​engine responds to the same question by generating a cartoon depicting the process by which the Earth becomes round.

[0046] Step 5: Primary and secondary school students review the generated text answers and cartoons to deepen their understanding.

[0047] "Example 3"

[0048] Step 1: Elementary and junior high school students can use the feature to create their own textbooks.

[0049] Step 2: Elementary and middle school students choose a topic that interests them, such as "The Shape of the Earth," "The Earth's Gravity," or "The Earth's Rotation."

[0050] Step 3: Primary and secondary school students will create a textbook with questions and answers related to the topic they have chosen.

[0051] Step 4: Elementary and junior high school students will be able to adjust their learning content themselves and learn with interest through their own textbooks.

[0052] Example 1

[0053] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal".

[0054] Conventional educational systems make it difficult for elementary and junior high school students to progress through their studies at their own pace, and lack the ingenuity to make learning interesting. In particular, answers to questions are given one-sidedly, making it difficult to customize them to meet the needs of individual learners. Also, answers in text format alone can be difficult to understand, and visual aids are often required.

[0055] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0056] In this invention, the server includes a means for elementary and junior high school students to input questions, a means for the terminal to transmit the questions to the server, a means for the server to transmit the questions to the generative AI model, a means for the generative AI model to generate answers to the questions, a means for the server to transmit the generated answers to the terminal, a means for the terminal to display the answers to the user, and a means for elementary and junior high school students to adjust questions to their own preferences and create their own textbooks. This allows elementary and junior high school students to study at their own pace and learn with interest. Also, providing answers in both text format and comic format can help with visual understanding.

[0057] "Elementary and junior high school students" refers to children and students in the primary and secondary education stages.

[0058] "Means for inputting a question" refers to a function that provides an interface for a user to input a question through a text box, voice input, or the like.

[0059] "Terminal" refers to a computing device used by a user, such as a PC or tablet.

[0060] A "server" refers to a computer system that communicates with terminals via a network and processes and stores data.

[0061] A "generative AI model" refers to an algorithm or program that uses artificial intelligence technology to generate answers to user questions.

[0062] "Means for generating an answer" refers to the ability of a generative AI model to create an appropriate answer based on a user's question.

[0063] "Text format" refers to a format in which answers are provided using textual information.

[0064] "Comic format" refers to a format in which answers are provided using visual illustrations or diagrams.

[0065] "Means for adjusting questions" refers to functionality that allows a user to modify a question entered or to ask an additional question.

[0066] "Means for creating textbooks" refers to a function that allows users to create their own study materials based on the answers generated.

[0067] "Educational content" refers to information or explanations that deepen learners' knowledge and understanding.

[0068] "Means of making learning fun and motivating" refers to the devices and functions that encourage learners to become interested and actively engage in their studies.

[0069] This invention is implemented using an application installed on a device (e.g., a PC, a tablet, etc.) used by elementary and junior high school students. The application provides an interface for elementary and junior high school students to input questions and transmits the input questions to an AI engine. The AI ​​engine generates answers to the questions and provides the answers in the form of text or comics. Elementary and junior high school students can tailor the questions to their preferences and create their own personalized textbooks.

[0070] Hardware and Software Used

[0071] Hardware:

[0072] Devices: PC, tablet

[0073] software:

[0074] Application: HTML and JavaScript to provide the user interface

[0075] Server: Python using the Flask framework

[0076] Generative AI models: For example, GPT-4 (registered trademark) from OpenAI (registered trademark)

[0077] Image generation models: For example, DALL-E

[0078] Program Processing

[0079] A user launches an application installed on the device. The application provides an interface for the user to input a question. When the user inputs a question, the terminal sends the question to a server. The server sends the received question to a generative AI model. The generative AI model generates an answer to the question. The answer is provided in text format or comic format. To generate an answer in comic format, the AI ​​engine further uses an image generation model. The generated answer is sent to the terminal via the server. The terminal displays the received answer to the user. Based on the displayed answer, the user can adjust the question to suit his / her preferences and create his / her own textbook.

[0080] Examples

[0081] For example, consider a user entering a question such as "Tell me about the planets in the solar system." This question is sent from the device to a server, which then sends the question to a generative AI model. The generative AI model generates an answer like this:

[0082] Example of a text response:

[0083] "There are eight planets in our solar system. Each planet has a different distance from the sun, size, and composition. For example, Mercury is closest to the sun and is very hot. On the other hand, Jupiter is the largest planet in the solar system and has many moons."

[0084] Example answer in comic form:

[0085] The generative AI model uses an image generation model to generate cartoons illustrating the planets in our solar system, visually illustrating each planet's characteristics and relative positions.

[0086] Example prompt:

[0087] "Tell me about the planets in our solar system. Generate answers in both text and comic form."

[0088] In this way, users can tailor information to their own learning style.

[0089] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0090] Step 1:

[0091] The user enters a question.

[0092] A user starts an application installed on a device, inputs a question in a text box, for example, "Tell me about the planets in the solar system," and clicks the "Submit" button. The input data is the question text entered by the user.

[0093] Step 2:

[0094] The terminal sends a question to the server.

[0095] The device sends the question entered by the user to the server as an HTTP POST request. The input data is the question text entered by the user, and the output data is the request sent to the server. Specifically, the device converts the question text into JSON format and sends it to the server's API endpoint.

[0096] Step 3:

[0097] The server sends the question to the generative AI model.

[0098] The server creates an API request to send the received question to the generative AI model. The input data is the question text received from the device, and the output data is the request to be sent to the generative AI model. Specifically, the server converts the question text into an appropriate format and sends it to the API endpoint of the generative AI model.

[0099] Step 4:

[0100] A generative AI model generates answers to questions.

[0101] The generative AI model generates an answer based on the received question. The input data is the question text received from the server, and the output data is the generated answer text or data in the form of a comic. In concrete terms, the generative AI model analyzes the question text and generates an appropriate answer.

[0102] Step 5:

[0103] The server sends the generated answer to the terminal.

[0104] The server sends the answer received from the generative AI model to the terminal. The input data is the answer data received from the generative AI model, and the output data is the response sent to the terminal. Specifically, the server converts the answer data into JSON format and sends it to the terminal's API endpoint.

[0105] Step 6:

[0106] The terminal displays the answer to the user.

[0107] The terminal displays the received answers to the user. The input data is the answer data received from the server, and the output data is the answer text or comic-style data displayed to the user. Specifically, the terminal analyzes the answer data and displays it on the user interface using HTML and JavaScript.

[0108] Step 7:

[0109] Users can then tailor the questions based on the answers to create their own personalized textbook.

[0110] The user can further refine the question based on the displayed answer. For example, add a question such as "Tell me more about Mars." The input data is the answer the user was shown, and the output data is the newly entered question text. In concrete terms, the user can enter a new question and click the "Submit" button again, starting the process from step 1 again.

[0111] (Application example 1)

[0112] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0113] In conventional education systems, it is difficult for elementary and junior high school students to learn at their own pace, and there is a lack of ingenuity to maintain their interest. In addition, answers to questions are one-sided, making it difficult to customize according to the needs of individual learners. Furthermore, there is insufficient means to save the generated learning content and refer to it later, which can hinder continuity of learning.

[0114] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0115] In this invention, the server includes a means for elementary and junior high school students to ask questions and for the AI ​​to respond in the form of text or comics, a means for elementary and junior high school students to tailor the questions to their preferences, a means for elementary and junior high school students to create their own textbooks, a means for saving the generated answers and for later reference, a means including an application to be installed on a smartphone, a means for generating answers to questions using an AI engine, and a means for saving the generated answers in a text file. This allows elementary and junior high school students to learn at their own pace and maintain their interest. It also facilitates customization according to the needs of individual learners, and the continuity of learning is improved because the generated learning content can be saved and referenced later.

[0116] "Ask a question" refers to the act of elementary and junior high school students inputting their doubts or the things they want to learn.

[0117] "AI responds in the form of text or comics" means that artificial intelligence provides answers to input questions in the form of text or visual comics.

[0118] "Adjusting questions" means that elementary and junior high school students change the content and format of the questions according to their own level of understanding and interests.

[0119] "Creating your own textbook" means that elementary and junior high school students collect generated answers and create their own customized study materials.

[0120] "Save the generated answers for later reference" means that the answers generated by the AI ​​are saved in digital format so that they can be reviewed again if needed.

[0121] An "application installed on a smartphone" is software that is downloaded to a mobile information terminal and used.

[0122] "Using an AI engine to generate answers to questions" means using an artificial intelligence algorithm to generate answers to input questions.

[0123] "Saving the generated answers in a text file" means recording the answers generated by the AI ​​as text information in a file.

[0124] The system for implementing this invention mainly consists of three elements: a server, a terminal, and a user. The server is responsible for generating answers to questions using an AI engine. The terminal is a mobile information terminal such as a smartphone or tablet, and provides an interface for users to input questions and receive the generated answers. The users are elementary and junior high school students who input their questions and the content they want to learn.

[0125] Server Processing

[0126] The server receives questions sent by users and generates answers using an AI engine. The AI ​​engine uses a generative AI model to create the best answer to the question. The answer is generated in text or comic form. The generated answer is saved by the server for later reference by the user.

[0127] Terminal handling

[0128] The terminal provides an interface for the user to enter a question, which is then sent to the server. The server returns a generated answer, which the terminal displays. The user can save the generated answer as a text file, or the user can adjust the question to suit their preferences and send it back to the server.

[0129] User Actions

[0130] Users use the device to input questions and receive answers. For example, if you input a question like "What is photosynthesis?", the server uses an AI engine to generate an answer and sends it back to the device. Users can save the answer as a text file and create their own textbook.

[0131] Hardware and Software Used

[0132] Hardware: Smartphones, tablets, servers

[0133] Software: AI engine (generative AI model), question input interface, answer display interface, text file saving function

[0134] Examples of concrete examples and prompts

[0135] The following questions and answers are examples of such questions and answers:

[0136] Question: "What is photosynthesis?"

[0137] Answer (in text): "Photosynthesis is the process by which plants use light energy to produce oxygen and glucose from carbon dioxide and water."

[0138] Example prompt:

[0139] Question: What is photosynthesis?

[0140] Answer (text format):

[0141] In this way, users can get answers to their questions and save them for later reference, allowing elementary and middle school students to learn at their own pace and sustain their interest.

[0142] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0143] Step 1:

[0144] The user uses the terminal to input a question.

[0145] Input: The user types the question in text form into the terminal interface.

[0146] Specific behavior: A user uses a keyboard to type a question into an input field displayed on the device screen, for example, "What is photosynthesis?"

[0147] Output: The entered question is temporarily stored in the device's memory.

[0148] Step 2:

[0149] The terminal transmits the entered question to the server.

[0150] Input: The question text saved on your device.

[0151] Specific operation: The terminal sends the entered question to the server via the network. The terminal sends the question data to the server using an HTTP request.

[0152] Output: The question text reaches the server.

[0153] Step 3:

[0154] The server receives the question and sends it to the AI ​​engine.

[0155] Input: The question text as it reaches the server.

[0156] Specific operation: The server analyzes the received question and sends it to the AI ​​engine as a prompt sentence. For example, it sends it in the form of "Question: What is photosynthesis? Answer (text format):".

[0157] Output: The AI ​​engine receives the prompt.

[0158] Step 4:

[0159] The AI ​​engine generates answers to questions.

[0160] Input: The prompt sent to the AI ​​engine.

[0161] What it does: The AI ​​engine uses the generative AI model to generate an answer based on the prompt sentence, for example, "Photosynthesis is the process by which plants use light energy to produce oxygen and glucose from carbon dioxide and water."

[0162] Output: The generated answer text.

[0163] Step 5:

[0164] The server receives the generated response and transmits it to the terminal.

[0165] Input: The answer text returned by the AI ​​engine.

[0166] Specific operation: The server receives the generated answer and sends it to the terminal as an HTTP response.

[0167] Output: The answer text arrives at the terminal.

[0168] Step 6:

[0169] The terminal will display the generated answer.

[0170] Input: The answer text sent by the server.

[0171] Specific operation: The device displays the received answer on the screen, for example, "Photosynthesis is the process by which plants use light energy to produce oxygen and glucose from carbon dioxide and water."

[0172] Output: The user can visually confirm their answer.

[0173] Step 7:

[0174] The user saves the generated answers.

[0175] Input: The answer text displayed on the terminal.

[0176] Specific operation: The user uses the device's save function to save the generated answer as a text file. For example, the user clicks the "Save" button to save the answer to "my_textbook.txt".

[0177] Output: The answer text is saved to the device storage.

[0178] Example 2

[0179] Next, a second embodiment of the second embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0180] In traditional education systems, it can be difficult for elementary and junior high school students to get the right answers when they ask questions. There is also a need to provide visual explanations in addition to text to deepen their understanding. Furthermore, there is a lack of ways for elementary and junior high school students to tailor questions to their preferences and create their own textbooks.

[0181] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0182] In this invention, the server includes means for a user to input a question, means for the terminal to transmit the question to the server, means for the server to analyze the question, means for the server to generate a text answer, means for the server to generate a visual explanation, means for the server to transmit the generated result to the terminal, means for the terminal to display the result to the user, means for elementary and junior high school students to adjust the question to their own preferences, and means for elementary and junior high school students to create their own textbooks. This enables elementary and junior high school students to obtain appropriate text answers and visual explanations for their questions, and further enables them to create teaching materials that match their own learning styles.

[0183] "Users" are those who use the system to input questions and receive answers, including elementary and junior high school students.

[0184] A "terminal" is a device through which a user inputs questions and communicates with the server, and includes smartphones, tablets, PCs, etc.

[0185] A "server" is a central processing unit that receives questions from users and performs analysis and generation of answers.

[0186] The "means for inputting a question" is an interface that allows a user to input a question to the system through a terminal.

[0187] The "means for transmitting a question to a server" is a communication function that enables the terminal to transmit a question input by a user to a server.

[0188] The "means for analyzing a question" is a function for analyzing a question received by the server using natural language processing technology and creating a prompt sentence for generating an appropriate answer.

[0189] "Means for generating a text answer" refers to a function in which the server uses a generative AI model to generate a text answer to the analyzed question.

[0190] "Means for generating a visual explanation" refers to a function in which the server uses image generation technology to generate a visual explanation (e.g., a cartoon or illustration) for a question.

[0191] The "means for transmitting the generated results to the terminal" is a communication function for transmitting the text answers and visual explanations generated by the server to the terminal.

[0192] The "means for displaying results to a user" is an interface through which the terminal displays to the user the text answers and visual explanations received from the server.

[0193] "Means for tailoring questions to your preferences" refers to a function that allows users to change the content and format of questions to suit their own learning style.

[0194] The "means of creating your own textbook" is a feature that allows users to combine generated answers and visual explanations to create their own customized learning materials.

[0195] This invention is a system that provides appropriate text answers and visual explanations when elementary and junior high school students ask questions. The system includes a series of processes in which a user inputs a question, a server analyzes the question, generates an answer, and displays the result to the user through a terminal.

[0196] Hardware and Software Used

[0197] Hardware

[0198] Device: The device, such as a smartphone, tablet, or computer, through which a user enters a question and receives results.

[0199] Server: A central processing unit that analyzes questions and generates answers.

[0200] software

[0201] Natural Language Processing Engine: Software for parsing questions. As an example, we will use OpenAI's GPT-4.

[0202] Generative AI model: Software for generating text answers to questions. We use OpenAI's GPT-4 as an example.

[0203] Image Generation Engine: Software for generating visual explanations. We use DALL-E as an example.

[0204] Data processing and calculation

[0205] Enter and submit your question

[0206] A user inputs a question through an application on the device, for example, "Why is the Earth round?" The device sends this question to the server in an appropriate format (e.g., JSON format).

[0207] Parsing the Question

[0208] The server uses a natural language processing engine to analyze the received question, understand the intent of the question, and create a prompt to generate an appropriate answer.

[0209] Example prompt: "Please briefly explain why the Earth is round. Please provide a scientific explanation that is easy for elementary and middle school students to understand."

[0210] Generate text answers

[0211] The server inputs the prompt sentence into the generative AI model and generates a text answer, for example, "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical."

[0212] Generate visual explanations

[0213] The server uses an image generation engine to generate a visual illustration, specifically a cartoon depicting the process of the Earth becoming round.

[0214] Sending and viewing results

[0215] The server transmits the generated text answer and visual explanation to the terminal. The terminal displays the information to the user. The user can check the text answer and visual explanation through the terminal to deepen his / her understanding.

[0216] Adding concrete examples

[0217] For example, if an elementary or junior high school student inputs the question "Why is the Earth round?" into an application, the server processes it as follows:

[0218] 1. Enter a question: The user enters "Why is the Earth round?"

[0219] 2. Sending a question: The device sends a question to the server.

[0220] 3. Question analysis: The server analyzes the question and generates a prompt such as, "Please briefly explain why the Earth is round. Please answer in a way that is easy for elementary and junior high school students to understand and include scientific reasons."

[0221] 4. Generate text answer: The server inputs the prompt text into the generative AI model, which generates an answer such as, "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical."

[0222] 5. Generate visual explanation: The server uses an image generation engine to generate a cartoon illustrating the process of the Earth becoming round.

[0223] 6. Sending and displaying the results: The server sends the generated text answers and cartoons to the device, which displays them to the user.

[0224] In this way, users can get relevant answers and visual explanations to their questions.

[0225] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0226] Step 1:

[0227] The user enters a question.

[0228] A user opens an application on the device and enters a question into an input field, for example, "Why is the Earth round?" The entered question is temporarily stored in the device's memory.

[0229] Step 2:

[0230] The terminal sends a question to the server.

[0231] The terminal converts the question entered by the user into an appropriate format (e.g., JSON format) and sends it to the server. The transmitted data is received by the server's receiving module.

[0232] Step 3:

[0233] The server parses the question.

[0234] The server inputs the received question into a natural language processing engine and analyzes the intent of the question. Specifically, it creates a prompt sentence to understand the content of the question and generate an appropriate answer. For example, a prompt sentence such as "Please briefly explain why the Earth is round. Please provide an answer that is easy to understand for elementary and junior high school students and includes scientific evidence" is generated.

[0235] Step 4:

[0236] The server generates a text answer.

[0237] The server inputs the prompt sentence into the generative AI model and generates a text answer. The generated text answer contains an appropriate explanation for the user's question. For example, the answer "The reason the Earth is round is because the gravity of the Earth acts equally in all directions, so objects naturally become spherical."

[0238] Step 5:

[0239] The server generates the visual description.

[0240] The server inputs prompts into an image generation engine to generate a visual explanation. Specifically, it generates a cartoon that illustrates the process of the Earth becoming round. The generated cartoon is provided to the user as a visual aid to deepen their understanding.

[0241] Step 6:

[0242] The server transmits the generated results to the terminal.

[0243] The server converts the generated text answers and visual explanations into an appropriate format (e.g., JSON format) and sends them to the terminal. The transmitted data is received by the terminal's receiving module.

[0244] Step 7:

[0245] The terminal displays the results to the user.

[0246] The terminal analyzes the text answer and visual explanation received from the server and displays them on the application screen. The user can check this information through the terminal and understand the answer to the question. For example, the text answer and the cartoon are displayed on the screen and the user can read them.

[0247] (Application example 2)

[0248] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0249] In conventional educational systems, when elementary and junior high school students ask questions, they can only get answers in the form of text, and there is a lack of means to deepen their visual understanding. In addition, there are no applications available in education-related stores, and in-store learning support is not sufficient. Furthermore, there are limited ways for elementary and junior high school students to tailor questions to their preferences or create their own textbooks. To solve these problems, a more effective educational support system is needed.

[0250] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0251] In this invention, the server includes a means for elementary and junior high school students to ask questions and for AI to respond in the form of text or comics, a means for elementary and junior high school students to adjust the questions to suit their preferences, a means for elementary and junior high school students to create their own textbooks, a means for providing a smartphone application that can be used in education-related stores, a means for generating text answers to the questions, a means for generating comics related to the questions, and a means for displaying the generated text answers and comics. This allows elementary and junior high school students to visually deepen their understanding of the questions, and enables learning support in education-related stores. Also, elementary and junior high school students can adjust the questions to suit their preferences and create their own textbooks.

[0252] "Asking a question" refers to the act of elementary and junior high school students inputting their doubts or things they want to know.

[0253] "AI responds in the form of text or comics" means that artificial intelligence provides answers to input questions by generating text or visual comics.

[0254] "Adjusting questions to suit one's preferences" means that elementary and junior high school students change the content and format of questions according to their interests and level of understanding.

[0255] "Creating your own textbook" means that elementary and junior high school students create individual learning materials tailored to their own learning content and progress.

[0256] "Smartphone applications that can be used in education-related stores" refers to smartphone software intended as educational support that can be used in bookstores, educational facilities, etc.

[0257] "Generating a text answer to a question" means that artificial intelligence creates a sentence-based answer to an input question.

[0258] "Generating comics related to a question" means that artificial intelligence creates comics to visually aid understanding of an input question.

[0259] "Displaying generated text answers and comics" means showing the user the text and comics created by artificial intelligence.

[0260] The system for implementing this invention is configured as follows: First, a user inputs a question through a smartphone application. The server receives the question and generates a text answer using a generative AI model. Furthermore, it generates a comic to deepen visual understanding of the same question.

[0261] The server uses the following hardware and software: A smartphone is used as the hardware, and Python, OpenAI API, Matplotlib, PIL (Python Imaging Library), and Requests are used as the software.

[0262] Specifically, the user first launches a smartphone application and inputs a question. For example, the user inputs a question such as "Why is the Earth round?" The server receives this question and uses OpenAI's text generation API (text-davinci-003) to generate a text answer to the question. The generated text answer is "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical."

[0263] The server then uses OpenAI's image generation API to generate a cartoon related to the question, which visually explains the process of the Earth becoming round, allowing users to deepen their understanding of the question through both the text answer and the cartoon.

[0264] The generated text answers and cartoons are displayed to the user through a smartphone application, where the user can view them and further adjust the questions or create their own personalized textbook.

[0265] An example of a prompt is as follows:

[0266] Question: Why is the Earth round?

[0267] Text Answer: The Earth is round because gravity acts equally in all directions, so objects naturally take on a spherical shape.

[0268] Cartoon: A cartoon depicting the process of the Earth becoming round

[0269] In this way, this invention allows elementary and junior high school students to visually deepen their understanding of the questions, and enables learning support in educational stores. Also, elementary and junior high school students can tailor the questions to their preferences and create their own textbooks.

[0270] The flow of the specific process in the application example 2 will be described with reference to FIG.

[0271] Step 1:

[0272] The user launches the smartphone application and enters a question.

[0273] Input: A question typed by the user (e.g. "Why is the Earth round?")

[0274] Output: The input question data

[0275] Specific behavior: The user enters a question into the application's input field and presses the submit button.

[0276] Step 2:

[0277] The terminal transmits the entered question to the server.

[0278] Input: Question data entered by the user

[0279] Output: The question data sent to the server

[0280] Specific operation: The smartphone application sends the question data to the server as an HTTP request.

[0281] Step 3:

[0282] The server receives the question data and generates text answers using a generative AI model.

[0283] Input: The query data sent to the server

[0284] Output: Generated text answer (e.g. "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally take on a spherical shape.")

[0285] Specific operation: The server calls OpenAI's text generation API (text-davinci-003) to generate a text answer to the question.

[0286] Step 4:

[0287] The server generates a manga for the same question using a generative AI model.

[0288] Input: The query data sent to the server

[0289] Output: The generated cartoon image

[0290] Specific operation: The server calls OpenAI's image generation API and generates a comic related to the question.

[0291] Step 5:

[0292] The server transmits the generated text answers and cartoons to the terminal.

[0293] Input: Generated text answers and cartoon images

[0294] Output: Text response and cartoon image sent to the device

[0295] Specific operation: The server sends the generated text answer and cartoon image to the smartphone application as an HTTP response.

[0296] Step 6:

[0297] The terminal displays the received text response and the cartoon to the user.

[0298] Input: Text answers and cartoon images sent from the server

[0299] Output: The text answer and the cartoon image displayed to the user

[0300] Specific operation: The smartphone application displays the received text response and cartoon image on the screen.

[0301] Step 7:

[0302] Users can view the displayed text answers and cartoons and further refine their questions or create their own personalized textbook.

[0303] Input: Text answer and cartoon image displayed

[0304] Output: User understanding and adjustment of learning

[0305] What happens: The user views the information displayed and, if necessary, asks a new question or customizes their learning experience.

[0306] Example 3

[0307] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0308] In the conventional education system, it was difficult for elementary and junior high school students to adjust their learning content to suit their interests and preferences, making it difficult to maintain their motivation to learn. In addition, existing textbooks had the same content, and there was a problem that they could not be customized according to each student's level of understanding and interests. Furthermore, answers to questions were one-sided, and there was a lack of interactive learning experiences.

[0309] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0310] In this invention, the server includes a means for elementary and junior high school students to select a topic, a means for an artificial intelligence to generate questions related to the selected topic, a means for elementary and junior high school students to input answers to the generated questions, a means for the server to store the input answers, and a means for elementary and junior high school students to create textbooks based on the stored questions and answers. This allows elementary and junior high school students to tailor their learning content to their interests and preferences and create their own textbooks. Also, providing an interactive learning experience can increase motivation to learn.

[0311] "Elementary and junior high school students" refers to students in the primary and secondary education stages.

[0312] "Question" refers to the doubts or inquiries that learners pose in order to deepen their understanding.

[0313] "Artificial intelligence" refers to technology that enables computer systems to behave in a way that mimics human intelligence, and includes generative AI models.

[0314] "Text" refers to documents or sentences that contain textual information.

[0315] "Manga" refers to a format that includes illustrations or pictures to convey information visually.

[0316] "Textbook" refers to learning materials used by students, including those created by elementary and junior high school students themselves.

[0317] A "topic" refers to a particular theme or subject that interests a learner.

[0318] "Generate" refers to the AI ​​creating new questions or information based on the prompt.

[0319] "Answer" refers to the answer or explanation provided by a learner in response to a question.

[0320] "Saving" refers to recording the input data in a storage device such as a database.

[0321] A "server" refers to a computer system that processes and stores data on a network.

[0322] "Terminal" refers to a device operated by a user, and includes PCs, tablets, and smartphones.

[0323] A "system" refers to a set of mechanisms in which multiple elements work together.

[0324] This invention is a system that allows elementary and junior high school students to tailor their learning content to suit their interests and preferences and create their own textbooks. A specific embodiment of this system will be described below.

[0325] Hardware and Software Used

[0326] Hardware: Servers, terminals (PCs, tablets, smartphones)

[0327] Software: Generative AI models (e.g. GPT-4), database management systems (e.g. MySQL), web application frameworks (e.g. Django)

[0328] System Overview

[0329] 1. User selects a topic

[0330] A user accesses the web application from a terminal, logs in, and then selects a topic of interest (e.g., "Shape of the Earth") from a list of topics displayed on the dashboard screen.

[0331] 2. The server generates questions related to the topic

[0332] Based on the received topic information, the server sends a prompt to the generative AI model (e.g., GPT-4). An example of a prompt is "Generate a question about the shape of the Earth."

[0333] The generative AI model analyzes the prompt and generates a relevant question, which is sent back to the server and displayed on the user's device.

[0334] 3. The user enters the answer to the question

[0335] The user inputs answers to questions displayed on the terminal. For example, in response to the question "What determines the shape of the Earth?", the user inputs "The Earth's shape is an ellipse due to gravity and rotation."

[0336] 4. The server stores the answer

[0337] The server saves the received answers in a database (e.g. MySQL) along with information such as the user ID, topic ID, question, and answer.

[0338] 5. Users create textbooks

[0339] Users can review the list of questions and answers saved on their device, select the ones they want to include in the textbook, and then click the "Create Textbook" button.

[0340] The server generates a textbook in PDF format based on the selected questions and answers, and provides the textbook to the user's device as a download link.

[0341] Examples

[0342] Example prompt: "Generate a question about the shape of the Earth."

[0343] Generated question: "What determines the shape of the Earth?"

[0344] User answer: "The Earth's shape is elliptical due to gravity and rotation."

[0345] In this way, users can create their own textbooks and tailor their learning content to suit their own needs. In addition, by using the generative AI model, questions based on the user's interests can be automatically generated to provide an interactive learning experience. The flow of the identification process in the third embodiment will be described with reference to FIG. 15.

[0346] Step 1:

[0347] User selects a topic

[0348] Specific operation: A user accesses the web application from a terminal, logs in, and then clicks to select a topic of interest (e.g., "Shape of the Earth") from the list of topics displayed on the dashboard screen.

[0349] Input: User selected topic information

[0350] Output: Selected topic information is sent to the server

[0351] Step 2:

[0352] The server generates questions related to the topic

[0353] Specific operation: Based on the received topic information, the server sends a prompt to the generative AI model (e.g., GPT-4). An example of a prompt is "Please generate a question about the shape of the Earth." The generative AI model analyzes the prompt and generates a related question.

[0354] Input: topic information, prompt

[0355] Data processing: A generative AI model analyzes the prompt and generates relevant questions

[0356] Output: The generated question is sent back to the server and displayed on the user's terminal.

[0357] Step 3:

[0358] The user enters the answer to the question

[0359] Specific operation: The user inputs a response to a question displayed on the terminal. For example, in response to the question "What determines the shape of the Earth?", the user inputs "The Earth's shape is an ellipse due to gravity and rotation."

[0360] Input: Generated question, user answer

[0361] Output: The answer entered is sent to the server.

[0362] Step 4:

[0363] The server stores the answer

[0364] Specific operation: The server saves the received answer in a database (e.g. MySQL) along with information such as the user ID, topic ID, question, and answer.

[0365] Input: User answer, User ID, Topic ID, Question

[0366] Data processing: Save the received data in a database

[0367] Output: A message is sent to the user's device confirming the save.

[0368] Step 5:

[0369] Users create textbooks

[0370] Specific operation: The user checks the list of saved questions and answers on the device and selects the questions and answers they want to include in the textbook. Once the selection is complete, the user clicks the "Create Textbook" button. The server generates a textbook in PDF format based on the selected questions and answers. The generated textbook is provided to the user's device as a download link.

[0371] Input: List of saved questions and answers, user selection

[0372] Data processing: Generate a PDF textbook based on selected questions and answers

[0373] Output: A download link for the generated textbook is provided to the user's device.

[0374] (Application example 3)

[0375] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0376] In the conventional education system, it was difficult for elementary and junior high school students to adjust their learning content based on their own interests, and it was difficult to maintain their motivation to learn. In addition, there was a lack of means to provide educational content that met individual learning needs, which led to a problem of reduced learning efficiency. Furthermore, there were limited means to provide learning experiences in virtual space, which made it difficult to increase the enjoyment of learning.

[0377] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0378] In this invention, the server includes a means for elementary and junior high school students to ask questions and for the generative AI model to respond in the form of text or comics, a means for elementary and junior high school students to adjust the questions to suit their preferences, a means for elementary and junior high school students to create their own textbooks, a means for elementary and junior high school students to select topics that interest them and collect related questions and answers using the generative AI model, a means for editing the collected questions and answers and compiling them into a textbook, and a means for viewing the completed textbook in a virtual space. This allows elementary and junior high school students to adjust their learning content based on their interests, provides educational content according to their individual learning needs, and allows them to enjoy a learning experience in a virtual space.

[0379] A "generative AI model" is a type of artificial intelligence that generates answers or content in natural language based on user input.

[0380] "A means to tailor questions" is a feature that allows users to change the content and format of questions to suit their preferences.

[0381] "A means to create a textbook" is a function that allows users to edit the questions and answers they have collected and compile them into a textbook.

[0382] A "way to choose a topic" is a feature that allows users to choose a particular topic or topic that interests them.

[0383] "Means for collecting questions and answers" refers to a function that uses a generative AI model to collect questions and answers related to a selected topic.

[0384] "Means of compiling into a textbook" refers to the function of editing the collected questions and answers, systematically organizing them, and compiling them into a textbook.

[0385] "Means for viewing in a virtual space" refers to a function that allows completed textbooks to be viewed in a virtual reality or augmented reality environment.

[0386] The system for implementing this invention consists of three main components: a server, a terminal, and a user. The server uses a generative AI model to generate answers to user questions, and the terminal provides an interface for users to enter questions and view the generated answers. Users can select topics of interest, tailor their questions, and create their own personalized textbooks.

[0387] The server includes the following means:

[0388] 1. A way for elementary and middle school students to ask questions and have a generative AI model respond in the form of text or comics.

[0389] 2. A way for primary and secondary school students to tailor questions to their own preferences.

[0390] 3. A means for elementary and junior high school students to create their own textbooks.

[0391] 4. A way for primary and secondary school students to select topics that interest them and use generative AI models to collect related questions and answers.

[0392] 5. A means of compiling the collected questions and answers into a textbook.

[0393] 6. A means to view completed textbooks in a virtual space.

[0394] Specifically, the server uses OpenAI's generative AI model (e.g., GPT-3 (registered trademark)) to generate answers to questions entered by the user. The user enters questions and views the generated answers using a device such as a smartphone or head-mounted display. When the user selects a topic that interests them, the server generates questions and answers related to that topic, which the user can then edit and compile into a textbook.

[0395] For example, if a user selects the topic "Shape of the Earth," the following prompt is input to the generative AI model:

[0396] Generate questions and answers about the shape of the Earth.

[0397] Based on this prompt, the generative AI model generates relevant questions and answers, which users can then edit and compile into a textbook. The completed textbook can then be viewed in a virtual space, allowing users to enjoy a learning experience in a virtual reality or augmented reality environment.

[0398] This system allows elementary and junior high school students to tailor their learning based on their interests, receive educational content tailored to their individual learning needs, and enjoy a learning experience in a virtual space.

[0399] The flow of the specific process in the application example 3 will be described with reference to FIG.

[0400] Step 1:

[0401] The user uses the terminal to select a topic in which he or she is interested.

[0402] Input: A topic selected by the user (e.g. "Shape of the Earth")

[0403] Output: Selected topic information

[0404] Specific operation: Through the terminal interface, the user selects a topic that interests them, and the information is sent to the server.

[0405] Step 2:

[0406] The server inputs a prompt sentence into the generative AI model based on the selected topic.

[0407] Input: Selected topic information

[0408] Output: A prompt to be input to the generative AI model (e.g., "Generate questions and answers about the shape of the Earth.")

[0409] Specific operation: The server receives the selected topic information, generates an appropriate prompt sentence based on it, and inputs it into the generative AI model.

[0410] Step 3:

[0411] A generative AI model generates questions and answers based on the prompt.

[0412] Input: The prompt text entered into the generative AI model

[0413] Output: Generated questions and answers in text format

[0414] How it works: The generative AI model analyzes the prompt, generates relevant questions and answers, and returns the results to the server.

[0415] Step 4:

[0416] The server transmits the generated questions and answers to the terminal.

[0417] Input: Generated question and answer text data

[0418] Output: Question and answer text data sent to the device

[0419] Specific operation: The server sends the questions and answers received from the generative AI model to the terminal, where they can be viewed by the user.

[0420] Step 5:

[0421] The user can use the terminal to edit the generated questions and answers to create his or her own textbook.

[0422] Input: Text data of questions and answers displayed on the terminal

[0423] Output: Edited textbook data

[0424] Specific operation: The user edits the generated questions and answers through the terminal interface and compiles them into a textbook.

[0425] Step 6:

[0426] The server converts the edited textbooks into a format that can be viewed in a virtual space.

[0427] Input: Edited textbook text data

[0428] Output: Textbook data viewable in virtual space

[0429] Specific operation: The server receives the edited textbook text data and converts it into a format that can be viewed in the virtual space.

[0430] Step 7:

[0431] A user uses a terminal to view a textbook in a virtual space.

[0432] Input: Textbook data viewable in virtual space

[0433] Output: Textbook displayed in virtual space

[0434] Specific actions: The user uses a head-mounted display or smartphone to view a textbook in a virtual space and enjoy a learning experience.

[0435] Furthermore, an emotion engine that estimates the emotion of the user may be combined. That is, the identification processing unit 290 may estimate the emotion of the user using the emotion identification model 59, and perform identification processing using the emotion of the user.

[0436] "Example 1"

[0437] In one embodiment of the present invention, an emotion engine is incorporated. This emotion engine recognizes the student's emotions regarding learning. Specifically, the emotion is estimated from the student's facial expression, tone of voice, usage pattern, etc. while using the application. For example, if the student shows a confused expression, the emotion engine captures that information and issues instructions to the AI. Based on the instructions, the AI ​​provides more detailed explanations and illustrations to help the student understand.

[0438] "Example 2"

[0439] The emotion engine also has the ability to create personalized textbooks based on students' emotions about learning. For example, if a student shows excitement or interest in a particular topic, the emotion engine will capture that information and prioritize adding questions and answers related to that topic to the textbook. This allows students to study based on their interests, making learning more effective.

[0440] "Example 3"

[0441] In addition, the emotion engine tracks the changes in students' emotions as they progress through their studies. For example, it can detect information such as if a student was excited when they first started learning, but became bored as time went on. Based on this information, the AI ​​can adjust the learning content to keep students interested. This allows students to stay focused and continue learning for long periods of time.

[0442] The process flow of each embodiment will be described below.

[0443] "Example 1"

[0444] Step 1: Elementary and middle school students start their application.

[0445] Step 2: The emotion engine infers emotions from elementary and junior high school students' facial expressions, tone of voice, usage patterns, etc.

[0446] Step 3: If the emotion engine determines that the student looks confused, it issues instructions to the AI.

[0447] Step 4: Based on the instructions, the AI ​​will provide more detailed explanations and illustrations to help elementary and junior high school students understand.

[0448] "Example 2"

[0449] Step 1: If the emotion engine senses that a student is excited or interested in a particular topic, it captures that information.

[0450] Step 2: The sentiment engine uses that information to prioritize questions and answers related to that topic and add them to the textbook.

[0451] Step 3: This allows elementary and junior high school students to study based on their own interests, making their learning more effective.

[0452] "Example 3"

[0453] Step 1: The emotion engine tracks changes in emotions as students progress through their learning. Step 2: It detects information such as students being excited when they first start learning, but becoming bored as time goes on.

[0454] Step 3: Based on this information, the AI ​​will adjust the learning content to keep elementary and middle school students interested.

[0455] Step 4: This will help students stay focused and engaged for longer periods of time.

[0456] Example 1

[0457] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal".

[0458] In conventional educational systems, it is sometimes difficult for elementary and junior high school students to get appropriate answers when they ask questions. In addition, there is a lack of means to immediately respond to confusion or lack of understanding that arises during the learning process, which can lead to a loss of motivation to learn. Furthermore, it is difficult to provide educational content customized to the emotions and level of understanding of each individual learner.

[0459] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0460] In this invention, the server includes a means for elementary and junior high school students to ask questions and for the AI ​​to respond in the form of text or comics, a means for elementary and junior high school students to adjust questions to their preferences, a means for elementary and junior high school students to create their own textbooks, a means including an emotion engine that analyzes the user's emotion data and issues instructions to the AI, and a means for generating additional explanations and illustrations based on the instructions of the emotion engine. This allows elementary and junior high school students to obtain appropriate answers to their questions and to immediately respond to confusion and lack of understanding that occurs during the course of learning. In addition, it is possible to provide educational content customized to the emotions and level of understanding of each individual learner, thereby improving their motivation to learn.

[0461] "Elementary and junior high school students" refers to children and students in the primary and secondary education stages.

[0462] "Question" refers to the doubts or inquiries that learners pose in order to deepen their understanding.

[0463] "AI" refers to artificial intelligence, specifically the technology of using natural language processing and generative models to generate answers to questions.

[0464] "Text" refers to content in the form of text using character information.

[0465] "Manga" refers to content that includes illustrations and diagrams to convey information visually.

[0466] "Answer" refers to information or explanation provided in response to a question.

[0467] A "textbook" refers to teaching materials used by students to organize their learning content and deepen their understanding.

[0468] "Emotional data" refers to information about emotions obtained from learners' facial expressions, tone of voice, usage patterns, etc.

[0469] An "emotion engine" refers to technology for analyzing emotional data and inferring a learner's emotions.

[0470] "Additional clarification" refers to detailed information or additional explanations provided beyond the basic answer.

[0471] "Illustration" refers to a diagram or illustration that conveys information visually.

[0472] The present invention is implemented using an application installed on a device (such as a personal computer or tablet) used by elementary and junior high school students. The program processing of this system will be specifically described below.

[0473] Hardware and Software Used

[0474] Hardware: PC, tablet

[0475] Software: Applications, AI engines, emotion engines

[0476] Explanation of program processing

[0477] Subject: User

[0478] A user (elementary or junior high school student) starts an application installed on the device and inputs a question. For example, the user inputs, "Please tell me about photosynthesis in plants." The user sends the question to the server through the application.

[0479] Subject: Terminal

[0480] The device sends the question entered by the user to the server. Specifically, the application sends the question data to the server as an HTTP request. When the answer is returned from the server, the device displays the answer. In addition, the device sends the user's facial expressions, tone of voice, and usage patterns to the emotion engine.

[0481] Subject: Server

[0482] The server receives questions entered by users through applications installed on their devices. The server sends the questions to an AI engine, which generates answers to the questions. The answers are returned to the server in text or comic book format. The server then sends the answers to the users' devices, where they can be viewed by the users.

[0483] Examples

[0484] Example 1: Entering a question and generating an answer

[0485] The user types the question into the application: "Tell me about photosynthesis in plants." The device sends the question to the server, which passes it to the AI ​​engine. The AI ​​engine generates an answer: "Plants use light to produce oxygen and glucose from carbon dioxide and water," and returns it to the server. The server sends the answer to the device, where the user can view it.

[0486] Example 2: Using the Emotion Engine

[0487] If a user is using an application while showing a confused expression, the device sends the facial expression data to the emotion engine. The emotion engine assumes that the user is confused and instructs the AI ​​engine to provide a detailed explanation and illustration. The AI ​​engine generates an "illustration showing the photosynthesis process" and provides it to the user via the server.

[0488] Examples of prompt statements

[0489] "Please tell me about photosynthesis in plants. If possible, please provide an illustration."

[0490] By feeding this prompt into a generative AI model, an answer is generated that includes detailed explanations and illustrations.

[0491] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0492] Step 1:

[0493] The user enters a question.

[0494] The user starts an application installed on the device and inputs a question. For example, the user inputs, "Please tell me about photosynthesis in plants." The input question is stored as text data within the application.

[0495] Step 2:

[0496] The terminal sends a question to the server.

[0497] The terminal sends the question entered by the user to the server. Specifically, the application sends the question data to the server as an HTTP request. The input is the user's question text, and the output is an HTTP request to the server.

[0498] Step 3:

[0499] The server passes the question to the AI ​​engine.

[0500] The server passes the received question to the AI ​​engine. Specifically, the server sends the question data to the AI ​​engine's API. The input is the question text received by the server, and the output is an API request to the AI ​​engine.

[0501] Step 4:

[0502] The AI ​​engine generates the answer.

[0503] The AI ​​engine uses a generative AI model to generate an answer to a question, for example, "Plants use light to produce oxygen and glucose from carbon dioxide and water." The input is the question text received by the AI ​​engine, and the output is the generated answer text.

[0504] Step 5:

[0505] The server sends the response to the terminal.

[0506] The server sends the answer received from the AI ​​engine to the terminal. Specifically, it returns the answer data to the terminal as an HTTP response. The input is the answer text received from the AI ​​engine, and the output is the HTTP response to the terminal.

[0507] Step 6:

[0508] The terminal displays the answer to the user.

[0509] The terminal displays the answers received from the server to the user. The user can view the answers in text form or comic form. The input is the answer text received from the server, and the output is the display to the user.

[0510] Step 7:

[0511] The terminal transmits the user's emotion data to the emotion engine.

[0512] The terminal transmits emotion data such as the user's facial expressions, tone of voice, and usage patterns to the emotion engine. Specifically, the terminal collects data using a camera and microphone and transmits it to the emotion engine. The input is the user's emotion data, and the output is the transmission of data to the emotion engine.

[0513] Step 8:

[0514] The emotion engine analyzes emotions and issues instructions to the AI ​​engine.

[0515] The emotion engine analyzes the received emotion data and infers the user's emotion. For example, if the user is inferred to be confused, the emotion engine instructs the AI ​​engine to provide a detailed explanation or illustration. The input is emotion data, and the output is instructions to the AI ​​engine.

[0516] Step 9:

[0517] An AI engine generates additional explanations and illustrations.

[0518] The AI ​​engine generates additional explanations and diagrams based on instructions from the emotion engine. For example, it generates an "illustration showing the photosynthesis process." The input is instructions from the emotion engine, and the output is additional explanations and diagrams.

[0519] Step 10:

[0520] The server sends additional explanations and illustrations to the terminal.

[0521] The server sends the additional explanations and illustrations received from the AI ​​engine to the terminal. Specifically, it returns the additional explanations and illustrations data to the terminal as an HTTP response. The input is the additional explanations and illustrations received from the AI ​​engine, and the output is the HTTP response to the terminal.

[0522] Step 11:

[0523] The terminal displays additional explanations and illustrations to the user.

[0524] The terminal displays the additional explanations and illustrations received from the server to the user. The user can deepen his / her understanding by viewing the detailed explanations and illustrations. The input is the additional explanations and illustrations received from the server, and the output is the display to the user.

[0525] (Application example 1)

[0526] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0527] In conventional educational systems, it was difficult to provide appropriate answers based on the individual level of understanding and emotions when elementary and junior high school students asked questions. In addition, in virtual stores, when users asked questions about products, it was not possible to provide detailed explanations or illustrations based on emotions. This led to problems such as a decrease in users' understanding and satisfaction.

[0528] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0529] In this invention, the server includes a means for elementary and junior high school students to ask questions and an AI to respond in the form of text or comics, a means for elementary and junior high school students to tailor questions to their preferences, a means for elementary and junior high school students to create their own textbooks, a means for recognizing a user's emotions and tailoring responses based on the emotions, a means for inputting questions about products in a virtual store and an AI to generate responses, and a means for providing detailed explanations and illustrations based on the emotions. This enables elementary and junior high school students and users of the virtual store to receive appropriate responses according to their individual levels of understanding and emotions.

[0530] "Elementary and junior high school students" refers to children and students in the primary and secondary education stages.

[0531] A "question" is a word or statement posed to request information or knowledge.

[0532] "AI" is an abbreviation for artificial intelligence, and refers to the technology that allows computers to imitate human intelligence to learn and make inferences.

[0533] "Text" refers to information or text written in text.

[0534] "Manga" refers to a form of media that conveys stories and information by combining pictures and text.

[0535] "Answer" refers to information or explanation provided in response to a question.

[0536] A "preference" refers to an individual's particular like or preference for a particular option over others.

[0537] "Textbook" refers to books and teaching materials used for education.

[0538] "Emotion" refers to the psychological response a human being has to a particular situation or stimulus.

[0539] "Virtual store" refers to a virtual shopping mall operated on the Internet.

[0540] "Goods" means goods or services that are the subject of sale or trade.

[0541] A "detailed description" refers to a detailed and specific description of a particular matter.

[0542] "Illustration" refers to a diagram or illustration that visually represents information or concepts.

[0543] The system for implementing this invention provides a function whereby elementary and junior high school students can ask questions and AI can respond in the form of text or comics. It also includes a function to recognize the user's emotions and adjust the response based on the emotions. A specific embodiment of this system will be described below.

[0544] System Configuration

[0545] The system uses the following hardware and software:

[0546] Hardware: Smartphones, smart glasses, head-mounted displays

[0547] Software: Python, OpenCV, Transformers library, EmotionRecognizer library

[0548] Program processing explanation

[0549] The server provides an interface for users to input questions, which are then sent to the AI ​​engine, which generates answers to the questions and provides them in the form of text or comics.

[0550] Additionally, it analyzes the user's facial expressions and tone of voice to recognize their emotions. This is done by analyzing the user's image using OpenCV and inferring the emotion using the EmotionRecognizer library. If the emotion is something like "confused," the AI ​​engine will provide additional detailed explanations and illustrations.

[0551] Examples

[0552] For example, if a user asks, "How do I use this product?" and looks confused, the AI ​​will provide detailed instructions and illustrations. The process goes like this:

[0553] 1. The user enters a question.

[0554] 2. The server captures the user's image and recognizes emotions.

[0555] 3. The AI ​​engine generates an answer to the question.

[0556] 4. Based on the emotion, add detailed explanations and illustrations as necessary.

[0557] 5. Provide the user with a final answer.

[0558] Examples of prompt statements

[0559] Below are examples of prompts to be input to a generative AI model.

[0560] Question: "How do I use this product?"

[0561] Emotion: "confused"

[0562] Using this prompt, the AI ​​engine can generate appropriate answers and provide additional information based on the sentiment.

[0563] The flow of the specific process in the application example 1 will be described with reference to FIG.

[0564] Step 1:

[0565] The user enters a question.

[0566] The user uses a smartphone or a head-mounted display to access an interface where they can enter questions, which are then sent to the server.

[0567] Input: The question entered by the user

[0568] Output: The question data sent to the server.

[0569] Step 2:

[0570] The server captures the user's image and recognizes emotions.

[0571] The server retrieves image data from the user's device, analyzes the image using OpenCV, and estimates emotions from the user's facial expressions using the EmotionRecognizer library.

[0572] Input: User image data

[0573] Output: Estimated emotion data

[0574] Step 3:

[0575] The server sends the question to an AI engine, which generates an answer.

[0576] The server sends the user's question and estimated emotion data to the AI ​​engine, which generates an answer to the question and outputs it in the form of text or comics.

[0577] Input: User question data, estimated emotion data

[0578] Output: Answer data generated by the AI ​​engine

[0579] Step 4:

[0580] The server tailors the answer based on the sentiment.

[0581] The server then adjusts the answers generated by the AI ​​engine based on the estimated emotion data, for example adding detailed explanations and illustrations if the emotion is "confusion."

[0582] Input: Estimated emotion data, response data generated by the AI ​​engine

[0583] Output: Adjusted response data

[0584] Step 5:

[0585] The server provides the final answer to the user.

[0586] The server transmits the adjusted answer data to the user's device and displays it to the user, who can review the answer in text or comic form.

[0587] Input: Adjusted response data

[0588] Output: The final answer displayed on the user's device.

[0589] Example 2

[0590] Next, a second embodiment of the second embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0591] In the conventional education system, it was difficult for elementary and junior high school students to learn with interest, and it was not possible to provide customized teaching materials according to individual interests and emotions. In addition, there were limited means to deepen understanding through visual content. This resulted in a decrease in the effectiveness of learning and a decrease in motivation to learn.

[0592] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0593] In this invention, the server includes a means for elementary and junior high school students to ask questions and for artificial intelligence to respond in text or visual form, a means for elementary and junior high school students to tailor questions to their preferences, a means for elementary and junior high school students to create their own teaching materials, a means for analyzing user emotion data and preferentially adding questions and answers related to topics of interest to the teaching materials, a means for analyzing the intent of the question using a natural language processing engine, a means for inputting prompt sentences into a generation AI model and generating appropriate text responses, and a means for generating visual content using an image generation model. This allows elementary and junior high school students to study with interest, and makes it possible to provide customized teaching materials according to individual interests and emotions.

[0594] "Elementary and junior high school students" refers to children and students in the primary and secondary education stages.

[0595] A "question" refers to an inquiry that a user inputs to the system regarding information that the user wants to know or about which the user wants to understand more.

[0596] "Artificial intelligence" refers to technology that enables computer systems to mimic human intelligence and learn, reason, and self-correct.

[0597] "Text" refers to sentences or explanations expressed using character information.

[0598] "Visual format" refers to visual means of conveying information, such as pictures, cartoons, diagrams, etc.

[0599] An "answer" refers to information or explanation provided by the system in response to a user's question.

[0600] "Preferences" refer to topics or content that are of particular interest to a user.

[0601] "Instructional Materials" refers to materials and content provided to support learning.

[0602] "Emotion data" refers to information that indicates the user's emotional state, including facial expressions, voice, behavior, and the like.

[0603] A "natural language processing engine" refers to software technology for understanding and analyzing human language.

[0604] "Generative AI model" refers to an artificial intelligence model that generates new text or content based on input prompts.

[0605] A "prompt" refers to an instruction or question that is input to a generative AI model.

[0606] "Image generation model" refers to an artificial intelligence model that generates new images or visual content based on input information.

[0607] The present invention is a system in which elementary and junior high school students ask questions, artificial intelligence generates answers in text or visual form, and further analyzes the user's emotion data to provide customized educational materials. A specific embodiment of the system is described below.

[0608] System Configuration

[0609] Hardware

[0610] Server: Use a server with powerful processors and large memory capacity to run the artificial intelligence models, analyze the data, and manage the generated content.

[0611] Terminal: A device used by elementary and junior high school students, including computers, tablets, smartphones, etc. Terminals receive user input and communicate with the server.

[0612] software

[0613] Natural Language Processing Engine: Use a natural language processing library such as "spaCy" or "BERT" to analyze the intent of the question.

[0614] Generative AI models: Use generative AI models such as GPT-4 to generate text answers.

[0615] Image generation model: To generate visual content, we use image generation models such as "DALL-E" and "MidJourney (registered trademark)".

[0616] Sentiment engine: An engine that analyzes users' sentiment data and prioritizes questions and answers related to topics of interest to add to the learning materials.

[0617] System Operation

[0618] User question input

[0619] A user uses a terminal to input a question, for example, "Why is the Earth round?"

[0620] Parsing the Question

[0621] The server analyzes the questions received from the terminal using a natural language processing engine. Specifically, it uses "spaCy" and "BERT" to analyze the intent of the question and extract keywords and context.

[0622] Generate answers

[0623] The server inputs a prompt sentence into the generative AI model based on the analysis results and generates an appropriate text answer. An example of a prompt sentence is, "Please generate an answer when an elementary or junior high school student asks, 'Why is the Earth round?'" The generative AI model uses "GPT-4" and generates an answer such as, "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical."

[0624] Visual content generation

[0625] To provide a deeper visual understanding of the same question, the server uses image generation models to generate cartoons. Specifically, it uses "DALL-E" and "MidJourney" to generate a cartoon depicting the process of the Earth becoming round.

[0626] Learning support using emotion engine

[0627] The device sends the user's emotional data to the emotion engine. For example, if the user is interested in "space," the emotion engine analyzes that information and prioritizes questions and answers related to the topic of interest to add them to the learning materials.

[0628] Providing customized learning materials

[0629] The server generates customized learning materials for the user based on the analysis results of the emotion engine and transmits them to the terminal. The user can use these learning materials to advance learning based on their interests.

[0630] In this way, the system can provide text answers and visual content to user questions and use the emotion engine to provide a customized learning experience.

[0631] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0632] Step 1:

[0633] User question input

[0634] Input: The user types a question using a terminal.

[0635] What happens: A user opens the app and types the question, "Why is the Earth round?"

[0636] Output: The terminal sends the entered question to the server.

[0637] Step 2:

[0638] Parsing the Question

[0639] Input: The question data sent from the terminal.

[0640] What happens: The server uses a natural language processing engine (e.g., "spaCy" or "BERT") to analyze the intent of the question.

[0641] Data processing: Extract keywords and context from the question and generate prompts suitable for the generative AI model.

[0642] Output: The generated prompt statement.

[0643] Step 3:

[0644] Generate answers

[0645] Input: The parsed result of the question and the generated prompt text.

[0646] How it works: The server inputs a prompt sentence into a generative AI model (e.g., GPT-4) and generates an appropriate text answer.

[0647] Data computation: The generative AI model generates a text answer based on the prompt.

[0648] Output: The generated text answer.

[0649] Step 4:

[0650] Visual content generation

[0651] Input: The parsed result of the question and the generated prompt text.

[0652] Specific operation: The server generates visual content using an image generation model (e.g., "DALL-E" or "MidJourney").

[0653] Data computation: The image generation model generates visual content (e.g., a cartoon) based on a prompt.

[0654] Output: The generated visual content.

[0655] Step 5:

[0656] Learning support using emotion engine

[0657] Input: User emotion data.

[0658] Specific operation: The device sends the user's emotion data to the emotion engine. For example, if the user is interested in "space," the device sends that information.

[0659] Data processing: The emotion engine analyzes users' emotion data and prioritizes questions and answers related to topics of interest to add them to the learning materials.

[0660] Output: Customized teaching material content.

[0661] Step 6:

[0662] Providing customized learning materials

[0663] Input: Sentiment engine analysis results.

[0664] Specific operation: The server generates customized teaching materials for the user based on the analysis results of the emotion engine.

[0665] Data processing: The content of the teaching materials is organized based on the user's interests.

[0666] Output: The generated customized teaching materials.

[0667] In this way, the system can provide text answers and visual content to user questions and use an emotion engine to provide a customized learning experience.

[0668] (Application example 2)

[0669] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0670] In conventional educational systems, when elementary and junior high school students asked questions, they could only receive text-based answers, and there was a lack of means to deepen their visual understanding. It was also difficult to provide customized educational materials based on the learners' emotions and interests, which made it difficult to increase their motivation to learn. Furthermore, the provision of educational content within virtual stores was limited, and learning experiences using smartphones and head-mounted displays were not adequately provided.

[0671] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0672] In this invention, the server includes a means for elementary and junior high school students to ask questions and for the AI ​​to respond in the form of text or comics, a means for elementary and junior high school students to tailor questions to their preferences, a means for elementary and junior high school students to create their own textbooks, a means for an emotion engine to generate customized educational materials based on the emotions of elementary and junior high school students, a means for providing educational content in a virtual store, and a means including an application to be installed on a smartphone or a head-mounted display. This allows elementary and junior high school students to visually deepen their understanding and increase their motivation to learn. In addition, a variety of educational content can be provided in the virtual store, providing a learning experience using a smartphone or a head-mounted display.

[0673] "Elementary and junior high school students" refers to children and students in the primary and secondary education stages.

[0674] A "question" refers to a question posed by a learner in search of knowledge or information.

[0675] "AI" is an abbreviation for artificial intelligence, and refers to technology that uses machine learning and natural language processing to think like a human and generate answers.

[0676] "Text" refers to data in the form of text using character information.

[0677] "Manga" refers to data in a storytelling format that uses illustrations and pictures to convey information visually.

[0678] "Answer" refers to information or explanation provided in response to a question.

[0679] "Preferences" refer to certain tendencies or choices that an individual feels are particularly fond of.

[0680] "Textbook" refers to books and digital content used as learning materials by learners.

[0681] An "emotion engine" refers to technology that analyzes learners' emotions and generates appropriate responses and content based on the results.

[0682] "Customized educational materials" refers to educational content that is specially created based on the learner's individual interests and feelings.

[0683] "Virtual store" refers to a virtual shop operated on the Internet, including a platform that provides educational content.

[0684] "Educational content" refers to information and materials that students use to learn.

[0685] A "smartphone" is a type of mobile phone and a multi-function device that can connect to the Internet and use applications.

[0686] A "head-mounted display" is a display device worn on the head that provides virtual reality and augmented reality experiences.

[0687] "Application" means a software program designed to provide a specific function or service.

[0688] The system for implementing the present invention includes a server, a user terminal, and an AI engine. The server receives questions from users and generates text answers and comic-style answers using the AI ​​engine. Furthermore, the server analyzes the user's emotions using the emotion engine and generates customized educational materials.

[0689] System Configuration

[0690] 1. Server:

[0691] The server receives questions from users and sends them to the AI ​​engine.

[0692] The server receives the response from the AI ​​engine and transmits it to the user's device.

[0693] The server uses an emotion engine to analyze the user's emotions and generate customized educational materials.

[0694] 2. User device:

[0695] User terminals include devices such as smartphones and head-mounted displays.

[0696] The user terminal provides an interface for the user to input a question.

[0697] The user terminal displays the answers and educational materials received from the server.

[0698] 3. AI engine:

[0699] The AI ​​engine uses a generative AI model to generate text answers to user questions.

[0700] The AI ​​engine uses a cartoon generation feature to generate visual answers.

[0701] 4. Emotion Engine:

[0702] The emotion engine analyzes the user's emotions and generates customized educational materials based on the results.

[0703] Data processing and calculation

[0704] 1. Receiving and sending questions:

[0705] The server receives questions from the user's device and sends them to the AI ​​engine.

[0706] Example: A user types a question: "Why is the Earth round?"

[0707] 2. Generate text answers:

[0708] The AI ​​engine uses a generative AI model to generate text answers to questions.

[0709] Example: "The reason the Earth is round is because gravity acts equally in all directions, so objects naturally take on a spherical shape."

[0710] 3. Manga generation:

[0711] The AI ​​engine uses cartoon generation to generate visual answers to questions.

[0712] Example: A cartoon showing the process of the Earth becoming round.

[0713] 4. Sentiment analysis and customised educational materials:

[0714] The emotion engine analyzes the user's emotions and generates customized educational materials based on the results.

[0715] Example: If a user expresses excitement or interest, prioritize adding questions and answers related to that topic to your textbook.

[0716] Examples

[0717] A user uses a smartphone to input a question such as "Why is the Earth round?" The server receives this question and sends it to the AI ​​engine. The AI ​​engine uses a generative AI model to generate a text answer such as "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical." It also generates a cartoon depicting the process by which the Earth became round. These answers are sent to the user's device via the server, and the user can view them on their smartphone. Furthermore, the emotion engine analyzes the user's emotions and generates a customized textbook with additional related topics if the user is interested.

[0718] Example prompt:

[0719] Q: Why is the Earth round?

[0720] A: The reason the Earth is round is because gravity acts equally in all directions, so objects naturally take on a spherical shape.

[0721] The flow of the identification process in the application example 2 will be described with reference to FIG.

[0722] Step 1:

[0723] The user inputs a question using a terminal. The user uses a smartphone or a head-mounted display to input a question such as "Why is the Earth round?" into the interface. The input question is sent from the terminal to the server.

[0724] Step 2:

[0725] The server receives the question and sends it to the AI ​​engine. The server analyzes the question received from the user, converts it into an appropriate format, and sends it to the AI ​​engine. The input is the user's question, and the output is the prompt sentence sent to the AI ​​engine.

[0726] Step 3:

[0727] The AI ​​engine generates a text answer. The AI ​​engine uses a generative AI model to generate a text answer based on the received prompt. The input is the prompt, and the output is the generated text answer. Specifically, in response to the question "Why is the Earth round?", the AI ​​engine generates the answer "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical."

[0728] Step 4:

[0729] The AI ​​engine generates a cartoon. The AI ​​engine uses the cartoon generation function to generate a visual answer to the question. The input is the prompt text, and the output is the generated cartoon. Specifically, a cartoon is generated that depicts the process of the Earth becoming round.

[0730] Step 5:

[0731] The server receives the text answer and the comic and sends it to the user's terminal. The server sends the text answer and the comic received from the AI ​​engine to the user's terminal. The input is the answer data from the AI ​​engine, and the output is the data to be sent to the user's terminal.

[0732] Step 6:

[0733] The user terminal displays the text answers and the comics. The user terminal displays the text answers and the comics received from the server. The input is the data sent from the server, and the output is the information displayed to the user. The user views these answers through a smartphone or a head-mounted display.

[0734] Step 7:

[0735] The server analyzes the user's emotions. The server uses an emotion engine to analyze the user's emotions. The input is the user's reaction and behavior data, and the output is the analysis results. Specifically, it determines whether the user is excited or interested.

[0736] Step 8:

[0737] The emotion engine generates customized educational materials. Based on the analysis results, the emotion engine generates customized educational materials according to the user's interests. The input is the result of the emotion analysis, and the output is customized educational materials. Specifically, a textbook is generated with added questions and answers related to the topics that the user has shown interest in.

[0738] Step 9:

[0739] The server transmits the customized educational materials to the user terminal. The server transmits the customized educational materials received from the emotion engine to the user terminal. The input is the educational materials from the emotion engine, and the output is the transmission data to the user terminal.

[0740] Step 10:

[0741] The user terminal displays the customized educational materials. The user terminal displays the customized educational materials received from the server. The input is the data transmitted from the server, and the output is the customized educational materials displayed to the user. The user views these materials through a smartphone or a head-mounted display.

[0742] Example 3

[0743] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0744] In the conventional education system, it was difficult for elementary and junior high school students to adjust their learning content to suit their interests and learning progress, which led to a decline in motivation to learn. In addition, it was not possible to respond to changes in emotions during learning, making it difficult to concentrate for long periods of time. This hindered effective learning, which was an issue.

[0745] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0746] In this invention, the server includes a means for elementary and junior high school students to ask questions and for the AI ​​to respond in the form of text or comics, a means for elementary and junior high school students to tailor the questions to their preferences, a means for elementary and junior high school students to create their own textbooks, a means for acquiring data based on topics selected by the elementary and junior high school students, a means for organizing the acquired data and generating textbooks, a means for tracking changes in the emotions of the elementary and junior high school students using an emotion engine, and a means for adjusting the learning content based on the changes in emotions, thereby enabling elementary and junior high school students to adjust the learning content to suit their interests and learning progress, and to continue concentrating on their studies for long periods of time.

[0747] "Asking a question" refers to the act of elementary and junior high school students making inquiries to the system about questions they have about the content they are learning or about topics that interest them.

[0748] "Artificial intelligence" is a technology that enables computer systems to mimic human intelligence and generate answers to questions through natural language processing and data analysis.

[0749] "Answering in the form of text or comics" means that the artificial intelligence will provide information in the form of written or visual storyboards in response to questions from elementary and junior high school students.

[0750] "Adjusting questions" refers to the act of elementary and junior high school students changing or modifying the questions they ask the system based on their own interests and learning progress.

[0751] "Creating a textbook" refers to the act of collecting related questions and answers based on a topic chosen by elementary and junior high school students and compiling them into a single learning resource.

[0752] "Acquiring data based on a topic" means that the server searches and collects information related to the learning topic selected by the elementary and junior high school students from the database.

[0753] "Organizing data and generating textbooks" means systematically organizing the information acquired by the server and creating learning materials in a format that is easy for users to understand.

[0754] The "emotion engine" is a technology that tracks and analyzes changes in a user's emotions in real time while they are learning.

[0755] "Adjusting the learning content based on changes in emotions" means that the server changes the learning content and the content it provides in response to changes in the user's emotions detected by the emotion engine.

[0756] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0757] This invention is a system that allows elementary and junior high school students to adjust their learning content to suit their interests and learning progress, and to continue studying with concentration for long periods of time. This system works in cooperation with a server, a terminal, and a user.

[0758] 1. Generate the system program

[0759] The server uses the generative AI model to generate a program that allows elementary and junior high school students to create their own textbooks. The program allows users to select a topic that interests them and collect related questions and answers to create a textbook.

[0760] 2. Explain the program's processing in natural language

[0761] Based on the user's selected topic, the server retrieves relevant questions and answers from a database that contains a wealth of education-related information. The server then organizes the retrieved information and generates a textbook in a format that is easy for the user to understand. In the process, the server uses natural language processing techniques to ensure the information is consistent and coherent.

[0762] It also uses an emotion engine to track changes in a user's emotions as they progress through the course. For example, if a user is excited when they first start learning but grows bored over time, the server can use this information to adjust the learning experience, perhaps offering new topics or interactive content to keep the user engaged.

[0763] 3. Examples and prompts

[0764] As a concrete example, consider a case where an elementary school student user selects the topics "Shape of the Earth," "Gravity of the Earth," and "Rotation of the Earth." The server retrieves questions and answers related to these topics from the database and generates a textbook. For example, in response to the question "Why is the Earth round?", the server provides the answer "The Earth is spherical due to gravity."

[0765] Example prompt:

[0766] Create a textbook on "Shape of the Earth", "Earth's Gravity" and "Earth's Rotation". Include questions and answers related to each topic.

[0767] By inputting these prompts into a generative AI model, a textbook based on the topic the user is interested in is generated, allowing users to self-adjust their learning content and stay engaged while they learn.

[0768] Hardware and Software Used

[0769] Server: A server with high-performance data processing capabilities is required, specifically a server equipped with a database management system (DBMS) and a natural language processing (NLP) engine.

[0770] Devices: The devices used by elementary and junior high school students are tablets and computers with internet access.

[0771] Generative AI models: AI models for generating education-related questions and answers, for example using advanced natural language processing models such as GPT-3.

[0772] This system allows elementary and junior high school students to adjust their learning content to suit their interests and learning progress, and to continue studying with concentration for a long period of time. The flow of the specific process in the third embodiment will be described with reference to FIG.

[0773] Program processing flow

[0774] Step 1: User Selects a Topic

[0775] A user logs into the system using a terminal. After logging in, the user is directed to a screen where he or she can select a topic of interest. For example, topics such as "Shape of the Earth", "Gravity of the Earth", and "Rotation of the Earth" are displayed. The user selects the topic that interests them.

[0776] Input: The topic selected by the user

[0777] Output: Selected topic information

[0778] Step 2: The server retrieves data based on the selected topic

[0779] When a user selects a topic, the server retrieves questions and answers related to that topic from the database. The database contains a wealth of educational information. For example, if the topic "Shape of the Earth" is selected, the server retrieves the question "Why is the Earth round?" and its answer.

[0780] Input: Selected topic information

[0781] Output: Question and answer data related to the topic

[0782] Step 3: The server organizes the acquired data and generates textbooks

[0783] The server organizes the questions and answers obtained and generates a textbook in a format that is easy for users to understand. In the process, the server uses natural language processing technology to ensure the consistency and integrity of the information. The generated textbook is provided to the user in a format that can be viewed on their device.

[0784] Input: Question and answer data related to the topic

[0785] Output: Organized textbook data

[0786] Step 4: The server uses the emotion engine to track the user's emotions

[0787] As the user works through the textbook, the server uses the emotion engine to track the user's changing emotions. For example, if the user is excited when he or she starts learning but becomes bored as time goes on, the server gets this information from the emotion engine.

[0788] Input: User behavior data during learning

[0789] Output: User's emotional state data

[0790] Step 5: The server coordinates the learning

[0791] The server adjusts the learning content based on the information obtained from the emotion engine. Specifically, it provides new topics and interactive content to keep the user interested. For example, if the user gets bored with "The Shape of the Earth," the server will suggest new related topics such as "The Internal Structure of the Earth" and "The History of the Earth."

[0792] Input: User emotional state data

[0793] Output: Adjusted learning content data

[0794] Specific examples of operation

[0795] If a user selects the topic "Shape of the Earth," the server retrieves from the database the question "Why is the Earth round?" and the answer "The Earth is spherical due to gravity." The server then organizes this information and generates a textbook. The generated textbook is provided to the user in PDF format for viewing on their device.

[0796] As the user works through the textbook, the server uses the emotion engine to track the user's emotional changes. For example, if the user is excited when he or she first starts learning, but becomes bored over time, the server gets this information from the emotion engine. The server uses this information to provide new topics and interactive content to keep the user interested. For example, it suggests new related topics such as "The Earth's Internal Structure" and "The Earth's History."

[0797] (Application example 3)

[0798] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0799] In conventional educational systems, it is difficult for elementary and junior high school students to adjust their learning content based on their own interests, and the learning content cannot be dynamically adjusted to respond to emotional changes during learning, which leads to a decline in motivation to learn. Furthermore, there is a lack of means to provide personalized educational content to individual learners. This makes it difficult for elementary and junior high school students to concentrate and continue studying for long periods of time.

[0800] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0801] In this invention, the server includes a means for elementary and junior high school students to ask questions and for the artificial intelligence to respond in the form of text or comics, a means for elementary and junior high school students to tailor questions to their preferences, a means for elementary and junior high school students to create their own textbooks, a means for tracking the emotions of elementary and junior high school students and dynamically adjusting the learning content, and a means for suggesting additional information and quizzes to maintain the interest of elementary and junior high school students. This allows elementary and junior high school students to adjust the learning content based on their interests and dynamically adjust the learning content in response to emotional changes during learning.

[0802] "Asking a question" refers to the act of elementary and junior high school students asking the system questions about their studies or topics that interest them.

[0803] "Artificial intelligence" refers to the technology that enables computer systems to mimic human intelligence: learning, reasoning, and problem-solving.

[0804] "Answering in the form of text or comics" means that the artificial intelligence will provide answers to questions from elementary and junior high school students in the form of written or visual storytelling.

[0805] "Adjusting questions" refers to the act of elementary and junior high school students changing the questions they ask the system based on their own interests and their learning progress.

[0806] "Creating a textbook" means compiling topics and questions and answers selected by elementary and junior high school students, and editing and generating them into a single learning resource.

[0807] "Tracking emotions" means that the system monitors and analyzes emotional changes of elementary and junior high school students in real time while they are learning.

[0808] "Dynamic adjustment of learning content" means that the system changes the educational content it provides in real time according to the emotions and learning progress of elementary and junior high school students.

[0809] "Suggest additional information or quizzes" means that the system provides relevant new information or questions to keep elementary and junior high school students interested.

[0810] A system for implementing this invention has the following configuration. The system includes a terminal used by a user, a server, and artificial intelligence (AI). The terminal is a device such as a smartphone or tablet, and the server is responsible for data processing and storage. The AI ​​generates answers to user questions using a generative AI model.

[0811] Hardware and Software Used

[0812] Hardware: Smartphones, tablets

[0813] Software: Python, TENSORFLOW(R), Keras, OpenCV, Emotion API (Microsoft(R) Azure(R)), Natural Language Processing (NLP) models (GPT-3, etc.)

[0814] Data processing and calculation

[0815] 1. User Interface:

[0816] The terminal provides an interface that allows users to select topics of interest and enter questions and answers.

[0817] For example, choose topics such as "Shape of the Earth", "Earth's Gravity", or "Earth's Rotation".

[0818] 2. Emotion Engine:

[0819] The device's camera is used to capture the user's facial expressions in real time.

[0820] Use OpenCV and the Emotion API to analyze user emotions (excitement, boredom, concentration, etc.).

[0821] For example, tracking emotional changes such as "excitement" when you first start learning, and "boredom" as time passes.

[0822] 3. Adjust your learning:

[0823] The server dynamically adjusts the learning content using an NLP model (such as GPT-3) based on the data obtained from the emotion engine.

[0824] Example: If the user gets bored, suggest new interesting topics or quizzes.

[0825] 4. Textbook Generation:

[0826] The server compiles the topics and questions / answers selected by the user to generate a digital textbook.

[0827] The generated textbook can be saved and shared in PDF format.

[0828] Examples and prompts

[0829] Examples:

[0830] A user is interested in "Earth's gravity" and types a related question: "How is Earth's gravity measured?"

[0831] The emotion engine analyzes the user's facial expressions and detects excitement.

[0832] NLP models suggest relevant follow-up information and quizzes to keep users engaged.

[0833] Example prompt:

[0834] A user types a question about "Earth's Gravity." You analyze the user's facial expressions and detect that they are excited. Suggest additional information or a quiz that is related to the question.

[0835] In this way, the system allows students to tailor their learning content based on their interests and dynamically adjusts the learning content in response to emotional changes during learning, helping students stay focused and engaged for extended periods of time.

[0836] The flow of the specific process in the application example 3 will be described with reference to FIG.

[0837] Step 1:

[0838] A user uses a terminal to select a topic of interest and enter a question.

[0839] Input: The topic and question selected by the user.

[0840] Output: Topic and question data.

[0841] Specific actions: Through the device's user interface, the user selects a topic such as "Earth's gravity" and enters a question such as "How is the Earth's gravity measured?"

[0842] Step 2:

[0843] The terminal transmits the entered question to the server.

[0844] Input: Topic and question data.

[0845] Output: The question data sent to the server.

[0846] Specific operation: The device receives user input and sends the data to a server via the Internet.

[0847] Step 3:

[0848] The server receives the question data and generates an answer using a generative AI model.

[0849] Input: The question data sent to the server.

[0850] Output: The generated response data.

[0851] What it does: A server receives question data and uses an NLP model (such as GPT-3) to generate an answer to the question "How is the Earth's gravity measured?"

[0852] Step 4:

[0853] The server sends the generated answer to the terminal.

[0854] Input: The generated answer data.

[0855] Output: The response data sent to the device.

[0856] Specific operations: The server generates a response and sends it to the terminal via the Internet.

[0857] Step 5:

[0858] The terminal displays the answers and the user begins learning.

[0859] Input: The response data sent to the device.

[0860] Output: The answer displayed on the terminal.

[0861] Specific operation: The device displays the received answers on the user interface and the user begins learning.

[0862] Step 6:

[0863] The device's camera captures the user's facial expressions in real time, and the emotion engine analyzes them.

[0864] Input: User's facial expression data.

[0865] Output: The parsed emotion data.

[0866] Specific operation: The device camera captures the user's facial expressions and analyzes the user's emotions (excitement, boredom, concentration, etc.) using OpenCV and the Emotion API.

[0867] Step 7:

[0868] The server receives the emotion data and dynamically adjusts the learning content.

[0869] Input: Parsed emotion data.

[0870] Output: Adjusted learning content data.

[0871] What it does: The server receives the sentiment data and uses NLP models to suggest new topics and quizzes to keep the user engaged.

[0872] Step 8:

[0873] The server transmits the adjusted learning content to the terminal.

[0874] Input: Adjusted learning content data.

[0875] Output: The learning data sent to the device.

[0876] Specific operations: The server sends the adjusted learning content to the terminal via the Internet.

[0877] Step 9:

[0878] The terminal displays the adjusted learning content, and the user continues learning.

[0879] Input: Learning content data sent to the terminal.

[0880] Output: The adjusted learning content displayed on your terminal.

[0881] Specific operation: The device displays the adjusted learning content received on the user interface, and the user continues learning.

[0882] Step 10:

[0883] After the user finishes learning, the terminal transmits the learning contents to the server and generates a textbook.

[0884] Input: Learning content data.

[0885] Output: The generated digital textbook.

[0886] How it works: The device sends the learning content to the server, and the server compiles the user's selected topics and questions and answers to create a digital textbook.

[0887] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires a voice indicating a user input for the result of the specific processing. The control unit 46A transmits the voice data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[0888] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0889] Another example of generative AI is Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) are mentioned.

[0890] In the above embodiment, an example has been given in which the specific process is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0891] [Second embodiment]

[0892] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0893] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0894] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0895] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0896] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs the voice according to instructions from the processor 46.

[0897] Camera 42 is a small digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (e.g., an imaging range defined by an angle of view equivalent to the width of the field of vision of an average healthy person).

[0898] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54. The transmission and reception of various types of information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is performed in a secure state.

[0899] Fig. 4 shows an example of main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0900] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32, and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0901] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0902] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0903] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0904] "Example 1"

[0905] In one embodiment of the present invention, there is an application that is installed on a device (e.g., a PC, a tablet, etc.) used by elementary and junior high school students. This application provides an interface for elementary and junior high school students to input questions, and transmits the input questions to an AI engine. The AI ​​engine generates answers to the questions and provides the answers in the form of text or comics. Elementary and junior high school students can tailor the questions to their preferences and create their own personalized textbooks.

[0906] "Example 2"

[0907] As a specific example, if an elementary or junior high school student inputs the question "Why is the Earth round?" into the application, the AI ​​engine will generate a text answer such as "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical." In response to the same question, the engine will also generate a cartoon depicting the process by which the Earth becomes round, providing a deeper visual understanding.

[0908] "Example 3"

[0909] In addition, a function will be provided for elementary and junior high school students to create their own textbooks. For example, elementary and junior high school students can select topics that interest them, such as "shape of the Earth," "gravity of the Earth," and "rotation of the Earth," and create a textbook by collecting questions and answers related to those topics. This allows students to adjust the content of their studies themselves and study in a way that interests them.

[0910] The process flow of each embodiment will be described below.

[0911] "Example 1"

[0912] Step 1: Elementary and junior high school students operate a device (e.g., a computer or tablet) and launch an application.

[0913] Step 2: The application provides an interface through which the student inputs a question. The student inputs a question through the interface.

[0914] Step 3: The application sends the entered question to the AI ​​engine.

[0915] Step 4: The AI ​​engine generates answers to the questions and provides the answers in the form of text or comics.

[0916] Step 5: Students review the answers generated and adjust questions as needed.

[0917] Step 6: Primary and secondary school students can use the Create Your Own Textbook feature to create a textbook by collecting questions and answers related to topics that interest them.

[0918] "Example 2"

[0919] Step 1: Elementary and middle school students enter the question "Why is the Earth round?" into the application.

[0920] Step 2: The application sends this question to the AI ​​engine.

[0921] Step 3: The AI ​​engine generates a text answer that says, "The Earth is round because the Earth's gravity acts equally in all directions, so objects naturally take on a spherical shape."

[0922] Step 4: The AI ​​engine responds to the same question by generating a cartoon depicting the process by which the Earth becomes round.

[0923] Step 5: Primary and secondary school students review the generated text answers and cartoons to deepen their understanding.

[0924] "Example 3"

[0925] Step 1: Elementary and junior high school students can use the feature to create their own textbooks.

[0926] Step 2: Elementary and middle school students choose a topic that interests them, such as "The Shape of the Earth," "The Earth's Gravity," or "The Earth's Rotation."

[0927] Step 3: Primary and secondary school students will create a textbook with questions and answers related to the topic they have chosen.

[0928] Step 4: Elementary and junior high school students will be able to adjust their learning content themselves and learn with interest through their own textbooks.

[0929] Example 1

[0930] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0931] Conventional educational systems make it difficult for elementary and junior high school students to progress through their studies at their own pace, and lack the ingenuity to make learning interesting. In particular, answers to questions are given one-sidedly, making it difficult to customize them to meet the needs of individual learners. Also, answers in text format alone can be difficult to understand, and visual aids are often required.

[0932] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0933] In this invention, the server includes a means for elementary and junior high school students to input questions, a means for the terminal to transmit the questions to the server, a means for the server to transmit the questions to the generative AI model, a means for the generative AI model to generate answers to the questions, a means for the server to transmit the generated answers to the terminal, a means for the terminal to display the answers to the user, and a means for elementary and junior high school students to adjust questions to their own preferences and create their own textbooks. This allows elementary and junior high school students to study at their own pace and learn with interest. Also, providing answers in both text format and comic format can help with visual understanding.

[0934] "Elementary and junior high school students" refers to children and students in the primary and secondary education stages.

[0935] "Means for inputting a question" refers to a function that provides an interface for a user to input a question through a text box, voice input, or the like.

[0936] "Terminal" refers to a computing device used by a user, such as a PC or tablet.

[0937] A "server" refers to a computer system that communicates with terminals via a network and processes and stores data.

[0938] A "generative AI model" refers to an algorithm or program that uses artificial intelligence technology to generate answers to user questions.

[0939] "Means for generating an answer" refers to the ability of a generative AI model to create an appropriate answer based on a user's question.

[0940] "Text format" refers to a format in which answers are provided using textual information.

[0941] "Comic format" refers to a format in which answers are provided using visual illustrations or diagrams.

[0942] "Means for adjusting questions" refers to functionality that allows a user to modify a question entered or to ask an additional question.

[0943] "Means for creating textbooks" refers to a function that allows users to create their own study materials based on the answers generated.

[0944] "Educational content" refers to information or explanations that deepen learners' knowledge and understanding.

[0945] "Means of making learning fun and motivating" refers to the devices and functions that encourage learners to become interested and actively engage in their studies.

[0946] This invention is implemented using an application installed on a device (e.g., a PC, a tablet, etc.) used by elementary and junior high school students. The application provides an interface for elementary and junior high school students to input questions and transmits the input questions to an AI engine. The AI ​​engine generates answers to the questions and provides the answers in the form of text or comics. Elementary and junior high school students can tailor the questions to their preferences and create their own personalized textbooks.

[0947] Hardware and Software Used

[0948] Hardware:

[0949] Devices: PC, tablet

[0950] software:

[0951] Application: HTML and JavaScript to provide the user interface

[0952] Server: Python using the Flask framework

[0953] Generative AI models: For example, OpenAI's GPT-4

[0954] Image generation models: For example, DALL-E

[0955] Program Processing

[0956] A user launches an application installed on the device. The application provides an interface for the user to input a question. When the user inputs a question, the terminal sends the question to a server. The server sends the received question to a generative AI model. The generative AI model generates an answer to the question. The answer is provided in text format or comic format. To generate an answer in comic format, the AI ​​engine further uses an image generation model. The generated answer is sent to the terminal via the server. The terminal displays the received answer to the user. Based on the displayed answer, the user can adjust the question to suit his / her preferences and create his / her own textbook.

[0957] Examples

[0958] For example, consider a user entering a question such as "Tell me about the planets in the solar system." This question is sent from the device to a server, which then sends the question to a generative AI model. The generative AI model generates an answer like this:

[0959] Example of a text response:

[0960] "There are eight planets in our solar system. Each planet has a different distance from the sun, size, and composition. For example, Mercury is closest to the sun and is very hot. On the other hand, Jupiter is the largest planet in the solar system and has many moons."

[0961] Example answer in comic form:

[0962] The generative AI model uses an image generation model to generate cartoons illustrating the planets in our solar system, visually illustrating each planet's characteristics and relative positions.

[0963] Example prompt:

[0964] "Tell me about the planets in our solar system. Generate answers in both text and comic form."

[0965] In this way, users can tailor information to their own learning style.

[0966] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0967] Step 1:

[0968] The user enters a question.

[0969] A user starts an application installed on a device, inputs a question in a text box, for example, "Tell me about the planets in the solar system," and clicks the "Submit" button. The input data is the question text entered by the user.

[0970] Step 2:

[0971] The terminal sends a question to the server.

[0972] The device sends the question entered by the user to the server as an HTTP POST request. The input data is the question text entered by the user, and the output data is the request sent to the server. Specifically, the device converts the question text into JSON format and sends it to the server's API endpoint.

[0973] Step 3:

[0974] The server sends the question to the generative AI model.

[0975] The server creates an API request to send the received question to the generative AI model. The input data is the question text received from the device, and the output data is the request to be sent to the generative AI model. Specifically, the server converts the question text into an appropriate format and sends it to the API endpoint of the generative AI model.

[0976] Step 4:

[0977] A generative AI model generates answers to questions.

[0978] The generative AI model generates an answer based on the received question. The input data is the question text received from the server, and the output data is the generated answer text or data in the form of a comic. In concrete terms, the generative AI model analyzes the question text and generates an appropriate answer.

[0979] Step 5:

[0980] The server sends the generated answer to the terminal.

[0981] The server sends the answer received from the generative AI model to the terminal. The input data is the answer data received from the generative AI model, and the output data is the response sent to the terminal. Specifically, the server converts the answer data into JSON format and sends it to the terminal's API endpoint.

[0982] Step 6:

[0983] The terminal displays the answer to the user.

[0984] The terminal displays the received answers to the user. The input data is the answer data received from the server, and the output data is the answer text or comic-style data displayed to the user. Specifically, the terminal analyzes the answer data and displays it on the user interface using HTML and JavaScript.

[0985] Step 7:

[0986] Users can then tailor the questions based on the answers to create their own personalized textbook.

[0987] The user can further refine the question based on the displayed answer. For example, add a question such as "Tell me more about Mars." The input data is the answer the user was shown, and the output data is the newly entered question text. In concrete terms, the user can enter a new question and click the "Submit" button again, starting the process from step 1 again.

[0988] (Application example 1)

[0989] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0990] In conventional education systems, it is difficult for elementary and junior high school students to learn at their own pace, and there is a lack of ingenuity to maintain their interest. In addition, answers to questions are one-sided, making it difficult to customize according to the needs of individual learners. Furthermore, there is insufficient means to save the generated learning content and refer to it later, which can hinder continuity of learning.

[0991] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0992] In this invention, the server includes a means for elementary and junior high school students to ask questions and for the AI ​​to respond in the form of text or comics, a means for elementary and junior high school students to tailor the questions to their preferences, a means for elementary and junior high school students to create their own textbooks, a means for saving the generated answers and for later reference, a means including an application to be installed on a smartphone, a means for generating answers to questions using an AI engine, and a means for saving the generated answers in a text file. This allows elementary and junior high school students to learn at their own pace and maintain their interest. It also facilitates customization according to the needs of individual learners, and the continuity of learning is improved because the generated learning content can be saved and referenced later.

[0993] "Ask a question" refers to the act of elementary and junior high school students inputting their doubts or the things they want to learn.

[0994] "AI responds in the form of text or comics" means that artificial intelligence provides answers to input questions in the form of text or visual comics.

[0995] "Adjusting questions" means that elementary and junior high school students change the content and format of the questions according to their own level of understanding and interests.

[0996] "Creating your own textbook" means that elementary and junior high school students collect generated answers and create their own customized study materials.

[0997] "Save the generated answers for later reference" means that the answers generated by the AI ​​are saved in digital format so that they can be reviewed again if needed.

[0998] An "application installed on a smartphone" is software that is downloaded to a mobile information terminal and used.

[0999] "Using an AI engine to generate answers to questions" means using an artificial intelligence algorithm to generate answers to input questions.

[1000] "Saving the generated answers in a text file" means recording the answers generated by the AI ​​as text information in a file.

[1001] The system for implementing this invention mainly consists of three elements: a server, a terminal, and a user. The server is responsible for generating answers to questions using an AI engine. The terminal is a mobile information terminal such as a smartphone or tablet, and provides an interface for users to input questions and receive the generated answers. The users are elementary and junior high school students who input their questions and the content they want to learn.

[1002] Server Processing

[1003] The server receives questions sent by users and generates answers using an AI engine. The AI ​​engine uses a generative AI model to create the best answer to the question. The answer is generated in text or comic form. The generated answer is saved by the server for later reference by the user.

[1004] Terminal handling

[1005] The terminal provides an interface for the user to enter a question, which is then sent to the server. The server returns a generated answer, which the terminal displays. The user can save the generated answer as a text file, or the user can adjust the question to suit their preferences and send it back to the server.

[1006] User Actions

[1007] Users use the device to input questions and receive answers. For example, if you input a question like "What is photosynthesis?", the server uses an AI engine to generate an answer and sends it back to the device. Users can save the answer as a text file and create their own textbook.

[1008] Hardware and Software Used

[1009] Hardware: Smartphones, tablets, servers

[1010] Software: AI engine (generative AI model), question input interface, answer display interface, text file saving function

[1011] Examples of concrete examples and prompts

[1012] The following questions and answers are examples of such questions and answers:

[1013] Question: "What is photosynthesis?"

[1014] Answer (in text): "Photosynthesis is the process by which plants use light energy to produce oxygen and glucose from carbon dioxide and water."

[1015] Example prompt:

[1016] Question: What is photosynthesis?

[1017] Answer (text format):

[1018] In this way, users can get answers to their questions and save them for later reference, allowing elementary and middle school students to learn at their own pace and sustain their interest.

[1019] The flow of the specific process in the application example 1 will be described with reference to FIG.

[1020] Step 1:

[1021] The user uses the terminal to input a question.

[1022] Input: The user types the question in text form into the terminal interface.

[1023] Specific behavior: A user uses a keyboard to type a question into an input field displayed on the device screen, for example, "What is photosynthesis?"

[1024] Output: The entered question is temporarily stored in the device's memory.

[1025] Step 2:

[1026] The terminal transmits the entered question to the server.

[1027] Input: The question text saved on your device.

[1028] Specific operation: The terminal sends the entered question to the server via the network. The terminal sends the question data to the server using an HTTP request.

[1029] Output: The question text reaches the server.

[1030] Step 3:

[1031] The server receives the question and sends it to the AI ​​engine.

[1032] Input: The question text as it reaches the server.

[1033] Specific operation: The server analyzes the received question and sends it to the AI ​​engine as a prompt sentence. For example, it sends it in the form of "Question: What is photosynthesis? Answer (text format):".

[1034] Output: The AI ​​engine receives the prompt.

[1035] Step 4:

[1036] The AI ​​engine generates answers to questions.

[1037] Input: The prompt sent to the AI ​​engine.

[1038] What it does: The AI ​​engine uses the generative AI model to generate an answer based on the prompt sentence, for example, "Photosynthesis is the process by which plants use light energy to produce oxygen and glucose from carbon dioxide and water."

[1039] Output: The generated answer text.

[1040] Step 5:

[1041] The server receives the generated response and transmits it to the terminal.

[1042] Input: The answer text returned by the AI ​​engine.

[1043] Specific operation: The server receives the generated answer and sends it to the terminal as an HTTP response.

[1044] Output: The answer text arrives at the terminal.

[1045] Step 6:

[1046] The terminal will display the generated answer.

[1047] Input: The answer text sent by the server.

[1048] Specific operation: The device displays the received answer on the screen, for example, "Photosynthesis is the process by which plants use light energy to produce oxygen and glucose from carbon dioxide and water."

[1049] Output: The user can visually confirm their answer.

[1050] Step 7:

[1051] The user saves the generated answers.

[1052] Input: The answer text displayed on the terminal.

[1053] Specific operation: The user uses the device's save function to save the generated answer as a text file. For example, the user clicks the "Save" button to save the answer to "my_textbook.txt".

[1054] Output: The answer text is saved to the device storage.

[1055] Example 2

[1056] Next, a description will be given of Example 2 of the embodiment 2. In the following description, the data processing device 12 is referred to as a "server" and the smart glasses 214 are referred to as a "terminal".

[1057] In traditional education systems, it can be difficult for elementary and junior high school students to get the right answers when they ask questions. There is also a need to provide visual explanations in addition to text to deepen their understanding. Furthermore, there is a lack of ways for elementary and junior high school students to tailor questions to their preferences and create their own textbooks.

[1058] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1059] In this invention, the server includes means for a user to input a question, means for the terminal to transmit the question to the server, means for the server to analyze the question, means for the server to generate a text answer, means for the server to generate a visual explanation, means for the server to transmit the generated result to the terminal, means for the terminal to display the result to the user, means for elementary and junior high school students to adjust the question to their own preferences, and means for elementary and junior high school students to create their own textbooks. This enables elementary and junior high school students to obtain appropriate text answers and visual explanations for their questions, and further enables them to create teaching materials that match their own learning styles.

[1060] "Users" are those who use the system to input questions and receive answers, including elementary and junior high school students.

[1061] A "terminal" is a device through which a user inputs questions and communicates with the server, and includes smartphones, tablets, PCs, etc.

[1062] A "server" is a central processing unit that receives questions from users and performs analysis and generation of answers.

[1063] The "means for inputting a question" is an interface that allows a user to input a question to the system through a terminal.

[1064] The "means for transmitting a question to a server" is a communication function that enables the terminal to transmit a question input by a user to a server.

[1065] The "means for analyzing a question" is a function for analyzing a question received by the server using natural language processing technology and creating a prompt sentence for generating an appropriate answer.

[1066] "Means for generating a text answer" refers to a function in which the server uses a generative AI model to generate a text answer to the analyzed question.

[1067] "Means for generating a visual explanation" refers to a function in which the server uses image generation technology to generate a visual explanation (e.g., a cartoon or illustration) for a question.

[1068] The "means for transmitting the generated results to the terminal" is a communication function for transmitting the text answers and visual explanations generated by the server to the terminal.

[1069] The "means for displaying results to a user" is an interface through which the terminal displays to the user the text answers and visual explanations received from the server.

[1070] "Means for tailoring questions to your preferences" refers to a function that allows users to change the content and format of questions to suit their own learning style.

[1071] The "means of creating your own textbook" is a feature that allows users to combine generated answers and visual explanations to create their own customized learning materials.

[1072] This invention is a system that provides appropriate text answers and visual explanations when elementary and junior high school students ask questions. The system includes a series of processes in which a user inputs a question, a server analyzes the question, generates an answer, and displays the result to the user through a terminal.

[1073] Hardware and Software Used

[1074] Hardware

[1075] Device: The device, such as a smartphone, tablet, or computer, through which a user enters a question and receives results.

[1076] Server: A central processing unit that analyzes questions and generates answers.

[1077] software

[1078] Natural Language Processing Engine: Software for parsing questions. As an example, we will use OpenAI's GPT-4.

[1079] Generative AI model: Software for generating text answers to questions. We use OpenAI's GPT-4 as an example.

[1080] Image Generation Engine: Software for generating visual explanations. We use DALL-E as an example.

[1081] Data processing and calculation

[1082] Enter and submit your question

[1083] A user inputs a question through an application on the device, for example, "Why is the Earth round?" The device sends this question to the server in an appropriate format (e.g., JSON format).

[1084] Parsing the Question

[1085] The server uses a natural language processing engine to analyze the received question, understand the intent of the question, and create a prompt to generate an appropriate answer.

[1086] Example prompt: "Please briefly explain why the Earth is round. Please provide a scientific explanation that is easy for elementary and middle school students to understand."

[1087] Generate text answers

[1088] The server inputs the prompt sentence into the generative AI model and generates a text answer, for example, "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical."

[1089] Generate visual explanations

[1090] The server uses an image generation engine to generate a visual illustration, specifically a cartoon depicting the process of the Earth becoming round.

[1091] Sending and viewing results

[1092] The server transmits the generated text answer and visual explanation to the terminal. The terminal displays the information to the user. The user can check the text answer and visual explanation through the terminal to deepen his / her understanding.

[1093] Adding concrete examples

[1094] For example, if an elementary or junior high school student inputs the question "Why is the Earth round?" into an application, the server processes it as follows:

[1095] 1. Enter a question: The user enters "Why is the Earth round?"

[1096] 2. Sending a question: The device sends a question to the server.

[1097] 3. Question analysis: The server analyzes the question and generates a prompt such as, "Please briefly explain why the Earth is round. Please answer in a way that is easy for elementary and junior high school students to understand and include scientific reasons."

[1098] 4. Generate text answer: The server inputs the prompt text into the generative AI model, which generates an answer such as, "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical."

[1099] 5. Generate visual explanation: The server uses an image generation engine to generate a cartoon illustrating the process of the Earth becoming round.

[1100] 6. Sending and displaying the results: The server sends the generated text answers and cartoons to the device, which displays them to the user.

[1101] In this way, users can get relevant answers and visual explanations to their questions.

[1102] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1103] Step 1:

[1104] The user enters a question.

[1105] A user opens an application on the device and enters a question into an input field, for example, "Why is the Earth round?" The entered question is temporarily stored in the device's memory.

[1106] Step 2:

[1107] The terminal sends a question to the server.

[1108] The terminal converts the question entered by the user into an appropriate format (e.g., JSON format) and sends it to the server. The transmitted data is received by the server's receiving module.

[1109] Step 3:

[1110] The server parses the question.

[1111] The server inputs the received question into a natural language processing engine and analyzes the intent of the question. Specifically, it creates a prompt sentence to understand the content of the question and generate an appropriate answer. For example, a prompt sentence such as "Please briefly explain why the Earth is round. Please provide an answer that is easy to understand for elementary and junior high school students and includes scientific evidence" is generated.

[1112] Step 4:

[1113] The server generates a text answer.

[1114] The server inputs the prompt sentence into the generative AI model and generates a text answer. The generated text answer contains an appropriate explanation for the user's question. For example, the answer "The reason the Earth is round is because the gravity of the Earth acts equally in all directions, so objects naturally become spherical."

[1115] Step 5:

[1116] The server generates the visual description.

[1117] The server inputs prompts into an image generation engine to generate a visual explanation. Specifically, it generates a cartoon that illustrates the process of the Earth becoming round. The generated cartoon is provided to the user as a visual aid to deepen their understanding.

[1118] Step 6:

[1119] The server transmits the generated results to the terminal.

[1120] The server converts the generated text answers and visual explanations into an appropriate format (e.g., JSON format) and sends them to the terminal. The transmitted data is received by the terminal's receiving module.

[1121] Step 7:

[1122] The terminal displays the results to the user.

[1123] The terminal analyzes the text answer and visual explanation received from the server and displays them on the application screen. The user can check this information through the terminal and understand the answer to the question. For example, the text answer and the cartoon are displayed on the screen and the user can read them.

[1124] (Application example 2)

[1125] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[1126] In conventional educational systems, when elementary and junior high school students ask questions, they can only get answers in the form of text, and there is a lack of means to deepen their visual understanding. In addition, there are no applications available in education-related stores, and in-store learning support is not sufficient. Furthermore, there are limited ways for elementary and junior high school students to tailor questions to their preferences or create their own textbooks. To solve these problems, a more effective educational support system is needed.

[1127] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1128] In this invention, the server includes a means for elementary and junior high school students to ask questions and for AI to respond in the form of text or comics, a means for elementary and junior high school students to adjust the questions to suit their preferences, a means for elementary and junior high school students to create their own textbooks, a means for providing a smartphone application that can be used in education-related stores, a means for generating text answers to the questions, a means for generating comics related to the questions, and a means for displaying the generated text answers and comics. This allows elementary and junior high school students to visually deepen their understanding of the questions, and enables learning support in education-related stores. Also, elementary and junior high school students can adjust the questions to suit their preferences and create their own textbooks.

[1129] "Asking a question" refers to the act of elementary and junior high school students inputting their doubts or things they want to know.

[1130] "AI responds in the form of text or comics" means that artificial intelligence provides answers to input questions by generating text or visual comics.

[1131] "Adjusting questions to suit one's preferences" means that elementary and junior high school students change the content and format of questions according to their interests and level of understanding.

[1132] "Creating your own textbook" means that elementary and junior high school students create individual learning materials tailored to their own learning content and progress.

[1133] "Smartphone applications that can be used in education-related stores" refers to smartphone software intended as educational support that can be used in bookstores, educational facilities, etc.

[1134] "Generating a text answer to a question" means that artificial intelligence creates a sentence-based answer to an input question.

[1135] "Generating comics related to a question" means that artificial intelligence creates comics to visually aid understanding of an input question.

[1136] "Displaying generated text answers and comics" means showing the user the text and comics created by artificial intelligence.

[1137] The system for implementing this invention is configured as follows: First, a user inputs a question through a smartphone application. The server receives the question and generates a text answer using a generative AI model. Furthermore, it generates a comic to deepen visual understanding of the same question.

[1138] The server uses the following hardware and software: A smartphone is used as the hardware, and Python, OpenAI API, Matplotlib, PIL (Python Imaging Library), and Requests are used as the software.

[1139] Specifically, the user first launches a smartphone application and inputs a question. For example, the user inputs a question such as "Why is the Earth round?" The server receives this question and uses OpenAI's text generation API (text-davinci-003) to generate a text answer to the question. The generated text answer is "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical."

[1140] The server then uses OpenAI's image generation API to generate a cartoon related to the question, which visually explains the process of the Earth becoming round, allowing users to deepen their understanding of the question through both the text answer and the cartoon.

[1141] The generated text answers and cartoons are displayed to the user through a smartphone application, where the user can view them and further adjust the questions or create their own personalized textbook.

[1142] An example of a prompt is as follows:

[1143] Question: Why is the Earth round?

[1144] Text Answer: The Earth is round because gravity acts equally in all directions, so objects naturally take on a spherical shape.

[1145] Cartoon: A cartoon depicting the process of the Earth becoming round

[1146] In this way, this invention allows elementary and junior high school students to visually deepen their understanding of the questions, and enables learning support in educational stores. Also, elementary and junior high school students can tailor the questions to their preferences and create their own textbooks.

[1147] The flow of the specific process in the application example 2 will be described with reference to FIG.

[1148] Step 1:

[1149] The user launches the smartphone application and enters a question.

[1150] Input: A question typed by the user (e.g. "Why is the Earth round?")

[1151] Output: The input question data

[1152] Specific behavior: The user enters a question into the application's input field and presses the submit button.

[1153] Step 2:

[1154] The terminal transmits the entered question to the server.

[1155] Input: Question data entered by the user

[1156] Output: The question data sent to the server

[1157] Specific operation: The smartphone application sends the question data to the server as an HTTP request.

[1158] Step 3:

[1159] The server receives the question data and generates text answers using a generative AI model.

[1160] Input: The query data sent to the server

[1161] Output: Generated text answer (e.g. "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally take on a spherical shape.")

[1162] Specific operation: The server calls OpenAI's text generation API (text-davinci-003) to generate a text answer to the question.

[1163] Step 4:

[1164] The server generates a manga for the same question using a generative AI model.

[1165] Input: The query data sent to the server

[1166] Output: The generated cartoon image

[1167] Specific operation: The server calls OpenAI's image generation API and generates a comic related to the question.

[1168] Step 5:

[1169] The server transmits the generated text answers and cartoons to the terminal.

[1170] Input: Generated text answers and cartoon images

[1171] Output: Text response and cartoon image sent to the device

[1172] Specific operation: The server sends the generated text answer and cartoon image to the smartphone application as an HTTP response.

[1173] Step 6:

[1174] The terminal displays the received text response and the cartoon to the user.

[1175] Input: Text answers and cartoon images sent from the server

[1176] Output: The text answer and the cartoon image displayed to the user

[1177] Specific operation: The smartphone application displays the received text response and cartoon image on the screen.

[1178] Step 7:

[1179] Users can view the displayed text answers and cartoons and further refine their questions or create their own personalized textbook.

[1180] Input: Text answer and cartoon image displayed

[1181] Output: User understanding and adjustment of learning

[1182] What happens: The user views the information displayed and, if necessary, asks a new question or customizes their learning experience.

[1183] Example 3

[1184] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[1185] In the conventional education system, it was difficult for elementary and junior high school students to adjust their learning content to suit their interests and preferences, making it difficult to maintain their motivation to learn. In addition, existing textbooks had the same content, and there was a problem that they could not be customized according to each student's level of understanding and interests. Furthermore, answers to questions were one-sided, and there was a lack of interactive learning experiences.

[1186] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1187] In this invention, the server includes a means for elementary and junior high school students to select a topic, a means for an artificial intelligence to generate questions related to the selected topic, a means for elementary and junior high school students to input answers to the generated questions, a means for the server to store the input answers, and a means for elementary and junior high school students to create textbooks based on the stored questions and answers. This allows elementary and junior high school students to tailor their learning content to their interests and preferences and create their own textbooks. Also, providing an interactive learning experience can increase motivation to learn.

[1188] "Elementary and junior high school students" refers to students in the primary and secondary education stages.

[1189] "Question" refers to the doubts or inquiries that learners pose in order to deepen their understanding.

[1190] "Artificial intelligence" refers to technology that enables computer systems to behave in a way that mimics human intelligence, and includes generative AI models.

[1191] "Text" refers to documents or sentences that contain textual information.

[1192] "Manga" refers to a format that includes illustrations or pictures to convey information visually.

[1193] "Textbook" refers to learning materials used by students, including those created by elementary and junior high school students themselves.

[1194] A "topic" refers to a particular theme or subject that interests a learner.

[1195] "Generate" refers to the AI ​​creating new questions or information based on the prompt.

[1196] "Answer" refers to the answer or explanation provided by a learner in response to a question.

[1197] "Saving" refers to recording the input data in a storage device such as a database.

[1198] A "server" refers to a computer system that processes and stores data on a network.

[1199] "Terminal" refers to a device operated by a user, and includes PCs, tablets, and smartphones.

[1200] A "system" refers to a set of mechanisms in which multiple elements work together.

[1201] This invention is a system that allows elementary and junior high school students to tailor their learning content to suit their interests and preferences and create their own textbooks. A specific embodiment of this system will be described below.

[1202] Hardware and Software Used

[1203] Hardware: Servers, terminals (PCs, tablets, smartphones)

[1204] Software: Generative AI models (e.g. GPT-4), database management systems (e.g. MySQL), web application frameworks (e.g. Django)

[1205] System Overview

[1206] 1. User selects a topic

[1207] A user accesses the web application from a terminal, logs in, and then selects a topic of interest (e.g., "Shape of the Earth") from a list of topics displayed on the dashboard screen.

[1208] 2. The server generates questions related to the topic

[1209] Based on the received topic information, the server sends a prompt to the generative AI model (e.g., GPT-4). An example of a prompt is "Generate a question about the shape of the Earth."

[1210] The generative AI model analyzes the prompt and generates a relevant question, which is sent back to the server and displayed on the user's device.

[1211] 3. The user enters the answer to the question

[1212] The user inputs answers to questions displayed on the terminal. For example, in response to the question "What determines the shape of the Earth?", the user inputs "The Earth's shape is an ellipse due to gravity and rotation."

[1213] 4. The server stores the answer

[1214] The server saves the received answers in a database (e.g. MySQL) along with information such as the user ID, topic ID, question, and answer.

[1215] 5. Users create textbooks

[1216] Users can review the list of questions and answers saved on their device, select the ones they want to include in the textbook, and then click the "Create Textbook" button.

[1217] The server generates a textbook in PDF format based on the selected questions and answers, and provides the textbook to the user's device as a download link.

[1218] Examples

[1219] Example prompt: "Generate a question about the shape of the Earth."

[1220] Generated question: "What determines the shape of the Earth?"

[1221] User answer: "The Earth's shape is elliptical due to gravity and rotation."

[1222] In this way, users can create their own textbooks and tailor their learning content to suit their own needs. In addition, by using the generative AI model, questions based on the user's interests can be automatically generated to provide an interactive learning experience. The flow of the identification process in the third embodiment will be described with reference to FIG. 15.

[1223] Step 1:

[1224] User selects a topic

[1225] Specific operation: A user accesses the web application from a terminal, logs in, and then clicks to select a topic of interest (e.g., "Shape of the Earth") from the list of topics displayed on the dashboard screen.

[1226] Input: User selected topic information

[1227] Output: Selected topic information is sent to the server

[1228] Step 2:

[1229] The server generates questions related to the topic

[1230] Specific operation: Based on the received topic information, the server sends a prompt to the generative AI model (e.g., GPT-4). An example of a prompt is "Please generate a question about the shape of the Earth." The generative AI model analyzes the prompt and generates a related question.

[1231] Input: topic information, prompt

[1232] Data processing: A generative AI model analyzes the prompt and generates relevant questions

[1233] Output: The generated question is sent back to the server and displayed on the user's terminal.

[1234] Step 3:

[1235] The user enters the answer to the question

[1236] Specific operation: The user inputs a response to a question displayed on the terminal. For example, in response to the question "What determines the shape of the Earth?", the user inputs "The Earth's shape is an ellipse due to gravity and rotation."

[1237] Input: Generated question, user answer

[1238] Output: The answer entered is sent to the server.

[1239] Step 4:

[1240] The server stores the answer

[1241] Specific operation: The server saves the received answer in a database (e.g. MySQL) along with information such as the user ID, topic ID, question, and answer.

[1242] Input: User answer, User ID, Topic ID, Question

[1243] Data processing: Save the received data in a database

[1244] Output: A message is sent to the user's device confirming the save.

[1245] Step 5:

[1246] Users create textbooks

[1247] Specific operation: The user checks the list of saved questions and answers on the device and selects the questions and answers they want to include in the textbook. Once the selection is complete, the user clicks the "Create Textbook" button. The server generates a textbook in PDF format based on the selected questions and answers. The generated textbook is provided to the user's device as a download link.

[1248] Input: List of saved questions and answers, user selection

[1249] Data processing: Generate a PDF textbook based on selected questions and answers

[1250] Output: A download link for the generated textbook is provided to the user's device.

[1251] (Application example 3)

[1252] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[1253] In the conventional education system, it was difficult for elementary and junior high school students to adjust their learning content based on their own interests, and it was difficult to maintain their motivation to learn. In addition, there was a lack of means to provide educational content that met individual learning needs, which led to a problem of reduced learning efficiency. Furthermore, there were limited means to provide learning experiences in virtual space, which made it difficult to increase the enjoyment of learning.

[1254] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1255] In this invention, the server includes a means for elementary and junior high school students to ask questions and for the generative AI model to respond in the form of text or comics, a means for elementary and junior high school students to adjust the questions to suit their preferences, a means for elementary and junior high school students to create their own textbooks, a means for elementary and junior high school students to select topics that interest them and collect related questions and answers using the generative AI model, a means for editing the collected questions and answers and compiling them into a textbook, and a means for viewing the completed textbook in a virtual space. This allows elementary and junior high school students to adjust their learning content based on their interests, provides educational content according to their individual learning needs, and allows them to enjoy a learning experience in a virtual space.

[1256] A "generative AI model" is a type of artificial intelligence that generates answers or content in natural language based on user input.

[1257] "A means to tailor questions" is a feature that allows users to change the content and format of questions to suit their preferences.

[1258] "A means to create a textbook" is a function that allows users to edit the questions and answers they have collected and compile them into a textbook.

[1259] A "way to choose a topic" is a feature that allows users to choose a particular topic or topic that interests them.

[1260] "Means for collecting questions and answers" refers to a function that uses a generative AI model to collect questions and answers related to a selected topic.

[1261] "Means of compiling into a textbook" refers to the function of editing the collected questions and answers, systematically organizing them, and compiling them into a textbook.

[1262] "Means for viewing in a virtual space" refers to a function that allows completed textbooks to be viewed in a virtual reality or augmented reality environment.

[1263] The system for implementing this invention consists of three main components: a server, a terminal, and a user. The server uses a generative AI model to generate answers to user questions, and the terminal provides an interface for users to enter questions and view the generated answers. Users can select topics of interest, tailor their questions, and create their own personalized textbooks.

[1264] The server includes the following means:

[1265] 1. A way for elementary and middle school students to ask questions and have a generative AI model respond in the form of text or comics.

[1266] 2. A way for primary and secondary school students to tailor questions to their own preferences.

[1267] 3. A means for elementary and junior high school students to create their own textbooks.

[1268] 4. A way for primary and secondary school students to select topics that interest them and use generative AI models to collect related questions and answers.

[1269] 5. A means of compiling the collected questions and answers into a textbook.

[1270] 6. A means to view completed textbooks in a virtual space.

[1271] Specifically, the server uses OpenAI's generative AI model (e.g. GPT-3) to generate answers to questions entered by the user. The user enters questions and views the generated answers using a device such as a smartphone or head-mounted display. When the user selects a topic that interests them, the server generates questions and answers related to that topic, which the user can then edit and compile into a textbook.

[1272] For example, if a user selects the topic "Shape of the Earth," the following prompt is input to the generative AI model:

[1273] Generate questions and answers about the shape of the Earth.

[1274] Based on this prompt, the generative AI model generates relevant questions and answers, which users can then edit and compile into a textbook. The completed textbook can then be viewed in a virtual space, allowing users to enjoy a learning experience in a virtual reality or augmented reality environment.

[1275] This system allows elementary and junior high school students to tailor their learning based on their interests, receive educational content tailored to their individual learning needs, and enjoy a learning experience in a virtual space.

[1276] The flow of the specific process in the application example 3 will be described with reference to FIG.

[1277] Step 1:

[1278] The user uses the terminal to select a topic in which he or she is interested.

[1279] Input: A topic selected by the user (e.g. "Shape of the Earth")

[1280] Output: Selected topic information

[1281] Specific operation: Through the terminal interface, the user selects a topic that interests them, and the information is sent to the server.

[1282] Step 2:

[1283] The server inputs a prompt sentence into the generative AI model based on the selected topic.

[1284] Input: Selected topic information

[1285] Output: A prompt to be input to the generative AI model (e.g., "Generate questions and answers about the shape of the Earth.")

[1286] Specific operation: The server receives the selected topic information, generates an appropriate prompt sentence based on it, and inputs it into the generative AI model.

[1287] Step 3:

[1288] A generative AI model generates questions and answers based on the prompt.

[1289] Input: The prompt text entered into the generative AI model

[1290] Output: Generated questions and answers in text format

[1291] How it works: The generative AI model analyzes the prompt, generates relevant questions and answers, and returns the results to the server.

[1292] Step 4:

[1293] The server transmits the generated questions and answers to the terminal.

[1294] Input: Generated question and answer text data

[1295] Output: Question and answer text data sent to the device

[1296] Specific operation: The server sends the questions and answers received from the generative AI model to the terminal, where they can be viewed by the user.

[1297] Step 5:

[1298] The user can use the terminal to edit the generated questions and answers to create his or her own textbook.

[1299] Input: Text data of questions and answers displayed on the terminal

[1300] Output: Edited textbook data

[1301] Specific operation: The user edits the generated questions and answers through the terminal interface and compiles them into a textbook.

[1302] Step 6:

[1303] The server converts the edited textbooks into a format that can be viewed in a virtual space.

[1304] Input: Edited textbook text data

[1305] Output: Textbook data viewable in virtual space

[1306] Specific operation: The server receives the edited textbook text data and converts it into a format that can be viewed in the virtual space.

[1307] Step 7:

[1308] A user uses a terminal to view a textbook in a virtual space.

[1309] Input: Textbook data viewable in virtual space

[1310] Output: Textbook displayed in virtual space

[1311] Specific actions: The user uses a head-mounted display or smartphone to view a textbook in a virtual space and enjoy a learning experience.

[1312] In addition, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1313] "Example 1"

[1314] In one embodiment of the present invention, an emotion engine is incorporated. This emotion engine recognizes the student's emotions regarding learning. Specifically, the emotion is estimated from the student's facial expression, tone of voice, usage pattern, etc. while using the application. For example, if the student shows a confused expression, the emotion engine captures that information and issues instructions to the AI. Based on the instructions, the AI ​​provides more detailed explanations and illustrations to help the student understand.

[1315] "Example 2"

[1316] The emotion engine also has the ability to create personalized textbooks based on students' emotions about learning. For example, if a student shows excitement or interest in a particular topic, the emotion engine will capture that information and prioritize adding questions and answers related to that topic to the textbook. This allows students to study based on their interests, making learning more effective.

[1317] "Example 3"

[1318] In addition, the emotion engine tracks the changes in students' emotions as they progress through their studies. For example, it can detect information such as if a student was excited when they first started learning, but became bored as time went on. Based on this information, the AI ​​can adjust the learning content to keep students interested. This allows students to stay focused and continue learning for long periods of time.

[1319] The process flow of each embodiment will be described below.

[1320] "Example 1"

[1321] Step 1: Elementary and middle school students start their application.

[1322] Step 2: The emotion engine infers emotions from elementary and junior high school students' facial expressions, tone of voice, usage patterns, etc.

[1323] Step 3: If the emotion engine determines that the student looks confused, it issues instructions to the AI.

[1324] Step 4: Based on the instructions, the AI ​​will provide more detailed explanations and illustrations to help elementary and junior high school students understand.

[1325] "Example 2"

[1326] Step 1: If the emotion engine senses that a student is excited or interested in a particular topic, it captures that information.

[1327] Step 2: The sentiment engine uses that information to prioritize questions and answers related to that topic and add them to the textbook.

[1328] Step 3: This allows elementary and junior high school students to study based on their own interests, making their learning more effective.

[1329] "Example 3"

[1330] Step 1: The emotion engine tracks changes in emotions as students progress through their learning. Step 2: It detects information such as students being excited when they first start learning, but becoming bored as time goes on.

[1331] Step 3: Based on this information, the AI ​​will adjust the learning content to keep elementary and middle school students interested.

[1332] Step 4: This will help students stay focused and engaged for longer periods of time.

[1333] Example 1

[1334] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[1335] In conventional educational systems, even if elementary and junior high school students ask questions, it can be difficult to get appropriate answers. In addition, there is a lack of means to immediately respond to confusion or lack of understanding that arises during the learning process, which can lead to a loss of motivation to learn. Furthermore, it is difficult to provide educational content customized to the feelings and level of understanding of each individual learner.

[1336] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1337] In this invention, the server includes a means for elementary and junior high school students to ask questions and for the AI ​​to respond in the form of text or comics, a means for elementary and junior high school students to adjust questions to their preferences, a means for elementary and junior high school students to create their own textbooks, a means including an emotion engine that analyzes the user's emotion data and issues instructions to the AI, and a means for generating additional explanations and illustrations based on the instructions of the emotion engine. This allows elementary and junior high school students to obtain appropriate answers to their questions and to immediately respond to confusion and lack of understanding that occurs during the course of learning. In addition, it is possible to provide educational content customized to the emotions and level of understanding of each individual learner, thereby improving their motivation to learn.

[1338] "Elementary and junior high school students" refers to children and students in the primary and secondary education stages.

[1339] "Question" refers to the doubts or inquiries that learners pose in order to deepen their understanding.

[1340] "AI" refers to artificial intelligence, specifically the technology of using natural language processing and generative models to generate answers to questions.

[1341] "Text" refers to content in the form of text using character information.

[1342] "Manga" refers to content that includes illustrations and diagrams to convey information visually.

[1343] "Answer" refers to information or explanation provided in response to a question.

[1344] A "textbook" refers to teaching materials used by students to organize their learning content and deepen their understanding.

[1345] "Emotional data" refers to information about emotions obtained from learners' facial expressions, tone of voice, usage patterns, etc.

[1346] An "emotion engine" refers to technology for analyzing emotional data and inferring a learner's emotions.

[1347] "Additional clarification" refers to detailed information or additional explanations provided beyond the basic answer.

[1348] "Illustration" refers to a diagram or illustration that conveys information visually.

[1349] The present invention is implemented using an application installed on a device (such as a personal computer or tablet) used by elementary and junior high school students. The program processing of this system will be specifically described below.

[1350] Hardware and Software Used

[1351] Hardware: PC, tablet

[1352] Software: Applications, AI engines, emotion engines

[1353] Explanation of program processing

[1354] Subject: User

[1355] A user (elementary or junior high school student) starts an application installed on the device and inputs a question. For example, the user inputs, "Please tell me about photosynthesis in plants." The user sends the question to the server through the application.

[1356] Subject: Terminal

[1357] The device sends the question entered by the user to the server. Specifically, the application sends the question data to the server as an HTTP request. When the answer is returned from the server, the device displays the answer. In addition, the device sends the user's facial expressions, tone of voice, and usage patterns to the emotion engine.

[1358] Subject: Server

[1359] The server receives questions entered by users through applications installed on their devices. The server sends the questions to an AI engine, which generates answers to the questions. The answers are returned to the server in text or comic book format. The server then sends the answers to the users' devices, where they can be viewed by the users.

[1360] Examples

[1361] Example 1: Entering a question and generating an answer

[1362] The user types the question into the application: "Tell me about photosynthesis in plants." The device sends the question to the server, which passes it to the AI ​​engine. The AI ​​engine generates an answer: "Plants use light to produce oxygen and glucose from carbon dioxide and water," and returns it to the server. The server sends the answer to the device, where the user can view it.

[1363] Example 2: Using the Emotion Engine

[1364] If a user is using an application while showing a confused expression, the device sends the facial expression data to the emotion engine. The emotion engine assumes that the user is confused and instructs the AI ​​engine to provide a detailed explanation and illustration. The AI ​​engine generates an "illustration showing the photosynthesis process" and provides it to the user via the server.

[1365] Examples of prompt statements

[1366] "Please tell me about photosynthesis in plants. If possible, please provide an illustration."

[1367] By feeding this prompt into a generative AI model, an answer is generated that includes detailed explanations and illustrations.

[1368] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1369] Step 1:

[1370] The user enters a question.

[1371] The user starts an application installed on the device and inputs a question. For example, the user inputs, "Please tell me about photosynthesis in plants." The input question is stored as text data within the application.

[1372] Step 2:

[1373] The terminal sends a question to the server.

[1374] The terminal sends the question entered by the user to the server. Specifically, the application sends the question data to the server as an HTTP request. The input is the user's question text, and the output is an HTTP request to the server.

[1375] Step 3:

[1376] The server passes the question to the AI ​​engine.

[1377] The server passes the received question to the AI ​​engine. Specifically, the server sends the question data to the AI ​​engine's API. The input is the question text received by the server, and the output is an API request to the AI ​​engine.

[1378] Step 4:

[1379] The AI ​​engine generates the answer.

[1380] The AI ​​engine uses a generative AI model to generate an answer to a question, for example, "Plants use light to produce oxygen and glucose from carbon dioxide and water." The input is the question text received by the AI ​​engine, and the output is the generated answer text.

[1381] Step 5:

[1382] The server sends the response to the terminal.

[1383] The server sends the answer received from the AI ​​engine to the terminal. Specifically, it returns the answer data to the terminal as an HTTP response. The input is the answer text received from the AI ​​engine, and the output is the HTTP response to the terminal.

[1384] Step 6:

[1385] The terminal displays the answer to the user.

[1386] The terminal displays the answers received from the server to the user. The user can view the answers in text form or comic form. The input is the answer text received from the server, and the output is the display to the user.

[1387] Step 7:

[1388] The terminal transmits the user's emotion data to the emotion engine.

[1389] The terminal transmits emotion data such as the user's facial expressions, tone of voice, and usage patterns to the emotion engine. Specifically, the terminal collects data using a camera and microphone and transmits it to the emotion engine. The input is the user's emotion data, and the output is the transmission of data to the emotion engine.

[1390] Step 8:

[1391] The emotion engine analyzes emotions and issues instructions to the AI ​​engine.

[1392] The emotion engine analyzes the received emotion data and infers the user's emotion. For example, if the user is inferred to be confused, the emotion engine instructs the AI ​​engine to provide a detailed explanation or illustration. The input is emotion data, and the output is instructions to the AI ​​engine.

[1393] Step 9:

[1394] An AI engine generates additional explanations and illustrations.

[1395] The AI ​​engine generates additional explanations and diagrams based on instructions from the emotion engine. For example, it generates an "illustration showing the photosynthesis process." The input is instructions from the emotion engine, and the output is additional explanations and diagrams.

[1396] Step 10:

[1397] The server sends additional explanations and illustrations to the terminal.

[1398] The server sends the additional explanations and illustrations received from the AI ​​engine to the terminal. Specifically, it returns the additional explanations and illustrations data to the terminal as an HTTP response. The input is the additional explanations and illustrations received from the AI ​​engine, and the output is the HTTP response to the terminal.

[1399] Step 11:

[1400] The terminal displays additional explanations and illustrations to the user.

[1401] The terminal displays the additional explanations and illustrations received from the server to the user. The user can deepen his / her understanding by viewing the detailed explanations and illustrations. The input is the additional explanations and illustrations received from the server, and the output is the display to the user.

[1402] (Application example 1)

[1403] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[1404] In conventional educational systems, it was difficult to provide appropriate answers based on the individual level of understanding and emotions when elementary and junior high school students asked questions. In addition, in virtual stores, when users asked questions about products, it was not possible to provide detailed explanations or illustrations based on emotions. This led to problems such as a decrease in users' understanding and satisfaction.

[1405] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1406] In this invention, the server includes a means for elementary and junior high school students to ask questions and an AI to respond in the form of text or comics, a means for elementary and junior high school students to tailor questions to their preferences, a means for elementary and junior high school students to create their own textbooks, a means for recognizing a user's emotions and tailoring responses based on the emotions, a means for inputting questions about products in a virtual store and an AI to generate responses, and a means for providing detailed explanations and illustrations based on the emotions. This enables elementary and junior high school students and users of the virtual store to receive appropriate responses according to their individual levels of understanding and emotions.

[1407] "Elementary and junior high school students" refers to children and students in the primary and secondary education stages.

[1408] A "question" is a word or statement posed to request information or knowledge.

[1409] "AI" is an abbreviation for artificial intelligence, and refers to the technology that allows computers to imitate human intelligence to learn and make inferences.

[1410] "Text" refers to information or text written in text.

[1411] "Manga" refers to a form of media that conveys stories and information by combining pictures and text.

[1412] "Answer" refers to information or explanation provided in response to a question.

[1413] A "preference" refers to an individual's particular like or preference for a particular option over others.

[1414] "Textbook" refers to books and teaching materials used for education.

[1415] "Emotion" refers to the psychological response a human being has to a particular situation or stimulus.

[1416] "Virtual store" refers to a virtual shopping mall operated on the Internet.

[1417] "Goods" means goods or services that are the subject of sale or trade.

[1418] A "detailed description" refers to a detailed and specific description of a particular matter.

[1419] "Illustration" refers to a diagram or illustration that visually represents information or concepts.

[1420] The system for implementing this invention provides a function whereby elementary and junior high school students can ask questions and AI can respond in the form of text or comics. It also includes a function to recognize the user's emotions and adjust the response based on the emotions. A specific embodiment of this system will be described below.

[1421] System Configuration

[1422] The system uses the following hardware and software:

[1423] Hardware: Smartphones, smart glasses, head-mounted displays

[1424] Software: Python, OpenCV, Transformers library, EmotionRecognizer library

[1425] Program processing explanation

[1426] The server provides an interface for users to input questions, which are then sent to the AI ​​engine, which generates answers to the questions and provides them in the form of text or comics.

[1427] Additionally, it analyzes the user's facial expressions and tone of voice to recognize their emotions. This is done by analyzing the user's image using OpenCV and inferring the emotion using the EmotionRecognizer library. If the emotion is something like "confused," the AI ​​engine will provide additional detailed explanations and illustrations.

[1428] Examples

[1429] For example, if a user asks, "How do I use this product?" and looks confused, the AI ​​will provide detailed instructions and illustrations. The process goes like this:

[1430] 1. The user enters a question.

[1431] 2. The server captures the user's image and recognizes emotions.

[1432] 3. The AI ​​engine generates an answer to the question.

[1433] 4. Based on the emotion, add detailed explanations and illustrations as necessary.

[1434] 5. Provide the user with a final answer.

[1435] Examples of prompt statements

[1436] Below are examples of prompts to be input to a generative AI model.

[1437] Question: "How do I use this product?"

[1438] Emotion: "confused"

[1439] Using this prompt, the AI ​​engine can generate appropriate answers and provide additional information based on the sentiment.

[1440] The flow of the specific process in the application example 1 will be described with reference to FIG.

[1441] Step 1:

[1442] The user enters a question.

[1443] The user uses a smartphone or a head-mounted display to access an interface where they can enter questions, which are then sent to the server.

[1444] Input: The question entered by the user

[1445] Output: The question data sent to the server.

[1446] Step 2:

[1447] The server captures the user's image and recognizes emotions.

[1448] The server retrieves image data from the user's device, analyzes the image using OpenCV, and estimates emotions from the user's facial expressions using the EmotionRecognizer library.

[1449] Input: User image data

[1450] Output: Estimated emotion data

[1451] Step 3:

[1452] The server sends the question to an AI engine, which generates an answer.

[1453] The server sends the user's question and estimated emotion data to the AI ​​engine, which generates an answer to the question and outputs it in the form of text or comics.

[1454] Input: User question data, estimated emotion data

[1455] Output: Answer data generated by the AI ​​engine

[1456] Step 4:

[1457] The server tailors the answer based on the sentiment.

[1458] The server then adjusts the answers generated by the AI ​​engine based on the estimated emotion data, for example adding detailed explanations and illustrations if the emotion is "confusion."

[1459] Input: Estimated emotion data, response data generated by the AI ​​engine

[1460] Output: Adjusted response data

[1461] Step 5:

[1462] The server provides the final answer to the user.

[1463] The server transmits the adjusted answer data to the user's device and displays it to the user, who can review the answer in text or comic form.

[1464] Input: Adjusted response data

[1465] Output: The final answer displayed on the user's device.

[1466] Example 2

[1467] Next, a description will be given of Example 2 of the embodiment 2. In the following description, the data processing device 12 is referred to as a "server" and the smart glasses 214 are referred to as a "terminal".

[1468] In the conventional education system, it was difficult for elementary and junior high school students to learn with interest, and it was not possible to provide customized teaching materials according to individual interests and emotions. In addition, there were limited means to deepen understanding through visual content. This resulted in a decrease in the effectiveness of learning and a decrease in motivation to learn.

[1469] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1470] In this invention, the server includes a means for elementary and junior high school students to ask questions and for artificial intelligence to respond in text or visual form, a means for elementary and junior high school students to tailor questions to their preferences, a means for elementary and junior high school students to create their own teaching materials, a means for analyzing user emotion data and preferentially adding questions and answers related to topics of interest to the teaching materials, a means for analyzing the intent of the question using a natural language processing engine, a means for inputting prompt sentences into a generation AI model and generating appropriate text responses, and a means for generating visual content using an image generation model. This allows elementary and junior high school students to study with interest, and makes it possible to provide customized teaching materials according to individual interests and emotions.

[1471] "Elementary and junior high school students" refers to children and students in the primary and secondary education stages.

[1472] A "question" refers to an inquiry that a user inputs to the system regarding information that the user wants to know or about which the user wants to understand more.

[1473] "Artificial intelligence" refers to technology that enables computer systems to mimic human intelligence and learn, reason, and self-correct.

[1474] "Text" refers to sentences or explanations expressed using character information.

[1475] "Visual format" refers to visual means of conveying information, such as pictures, cartoons, diagrams, etc.

[1476] An "answer" refers to information or explanation provided by the system in response to a user's question.

[1477] "Preferences" refer to topics or content that are of particular interest to a user.

[1478] "Instructional Materials" refers to materials and content provided to support learning.

[1479] "Emotion data" refers to information that indicates the user's emotional state, including facial expressions, voice, behavior, and the like.

[1480] A "natural language processing engine" refers to software technology for understanding and analyzing human language.

[1481] "Generative AI model" refers to an artificial intelligence model that generates new text or content based on input prompts.

[1482] A "prompt" refers to an instruction or question that is input to a generative AI model.

[1483] "Image generation model" refers to an artificial intelligence model that generates new images or visual content based on input information.

[1484] The present invention is a system in which elementary and junior high school students ask questions, artificial intelligence generates answers in text or visual form, and further analyzes the user's emotion data to provide customized educational materials. A specific embodiment of the system is described below.

[1485] System Configuration

[1486] Hardware

[1487] Server: Use a server with powerful processors and large memory capacity to run the artificial intelligence models, analyze the data, and manage the generated content.

[1488] Terminal: A device used by elementary and junior high school students, including computers, tablets, smartphones, etc. Terminals receive user input and communicate with the server.

[1489] software

[1490] Natural Language Processing Engine: Use a natural language processing library such as "spaCy" or "BERT" to analyze the intent of the question.

[1491] Generative AI models: Use generative AI models such as GPT-4 to generate text answers.

[1492] Image generation models: To generate visual content, we use image generation models such as "DALL-E" and "MidJourney".

[1493] Sentiment engine: An engine that analyzes users' sentiment data and prioritizes questions and answers related to topics of interest to add to the learning materials.

[1494] System Operation

[1495] User question input

[1496] A user uses a terminal to input a question, for example, "Why is the Earth round?"

[1497] Parsing the Question

[1498] The server analyzes the questions received from the terminal using a natural language processing engine. Specifically, it uses "spaCy" and "BERT" to analyze the intent of the question and extract keywords and context.

[1499] Generate answers

[1500] The server inputs a prompt sentence into the generative AI model based on the analysis results and generates an appropriate text answer. An example of a prompt sentence is, "Please generate an answer when an elementary or junior high school student asks, 'Why is the Earth round?'" The generative AI model uses "GPT-4" and generates an answer such as, "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical."

[1501] Visual content generation

[1502] To provide a deeper visual understanding of the same question, the server uses image generation models to generate cartoons. Specifically, it uses "DALL-E" and "MidJourney" to generate a cartoon depicting the process of the Earth becoming round.

[1503] Learning support using emotion engine

[1504] The device sends the user's emotional data to the emotion engine. For example, if the user is interested in "space," the emotion engine analyzes that information and prioritizes questions and answers related to the topic of interest to add them to the learning materials.

[1505] Providing customized learning materials

[1506] The server generates customized learning materials for the user based on the analysis results of the emotion engine and transmits them to the terminal. The user can use these learning materials to advance learning based on their interests.

[1507] In this way, the system can provide text answers and visual content to user questions and use the emotion engine to provide a customized learning experience.

[1508] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1509] Step 1:

[1510] User question input

[1511] Input: The user types a question using a terminal.

[1512] What happens: A user opens the app and types the question, "Why is the Earth round?"

[1513] Output: The terminal sends the entered question to the server.

[1514] Step 2:

[1515] Parsing the Question

[1516] Input: The question data sent from the terminal.

[1517] What happens: The server uses a natural language processing engine (e.g., "spaCy" or "BERT") to analyze the intent of the question.

[1518] Data processing: Extract keywords and context from the question and generate prompts suitable for the generative AI model.

[1519] Output: The generated prompt statement.

[1520] Step 3:

[1521] Generate answers

[1522] Input: The parsed result of the question and the generated prompt text.

[1523] How it works: The server inputs a prompt sentence into a generative AI model (e.g., GPT-4) and generates an appropriate text answer.

[1524] Data computation: The generative AI model generates a text answer based on the prompt.

[1525] Output: The generated text answer.

[1526] Step 4:

[1527] Visual content generation

[1528] Input: The parsed result of the question and the generated prompt text.

[1529] Specific operation: The server generates visual content using an image generation model (e.g., "DALL-E" or "MidJourney").

[1530] Data computation: The image generation model generates visual content (e.g., a cartoon) based on a prompt.

[1531] Output: The generated visual content.

[1532] Step 5:

[1533] Learning support using emotion engine

[1534] Input: User emotion data.

[1535] Specific operation: The device sends the user's emotion data to the emotion engine. For example, if the user is interested in "space," the device sends that information.

[1536] Data processing: The emotion engine analyzes users' emotion data and prioritizes questions and answers related to topics of interest to add them to the learning materials.

[1537] Output: Customized teaching material content.

[1538] Step 6:

[1539] Providing customized learning materials

[1540] Input: Sentiment engine analysis results.

[1541] Specific operation: The server generates customized teaching materials for the user based on the analysis results of the emotion engine.

[1542] Data processing: The content of the teaching materials is organized based on the user's interests.

[1543] Output: The generated customized teaching materials.

[1544] In this way, the system can provide text answers and visual content to user questions and use an emotion engine to provide a customized learning experience.

[1545] (Application example 2)

[1546] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[1547] In conventional educational systems, when elementary and junior high school students asked questions, they could only receive text-based answers, and there was a lack of means to deepen their visual understanding. It was also difficult to provide customized educational materials based on the learners' emotions and interests, which made it difficult to increase their motivation to learn. Furthermore, the provision of educational content within virtual stores was limited, and learning experiences using smartphones and head-mounted displays were not adequately provided.

[1548] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1549] In this invention, the server includes a means for elementary and junior high school students to ask questions and for the AI ​​to respond in the form of text or comics, a means for elementary and junior high school students to tailor questions to their preferences, a means for elementary and junior high school students to create their own textbooks, a means for an emotion engine to generate customized educational materials based on the emotions of elementary and junior high school students, a means for providing educational content in a virtual store, and a means including an application to be installed on a smartphone or a head-mounted display. This allows elementary and junior high school students to visually deepen their understanding and increase their motivation to learn. In addition, a variety of educational content can be provided in the virtual store, providing a learning experience using a smartphone or a head-mounted display.

[1550] "Elementary and junior high school students" refers to children and students in the primary and secondary education stages.

[1551] A "question" refers to a question posed by a learner in search of knowledge or information.

[1552] "AI" is an abbreviation for artificial intelligence, and refers to technology that uses machine learning and natural language processing to think like a human and generate answers.

[1553] "Text" refers to data in the form of text using character information.

[1554] "Manga" refers to data in a storytelling format that uses illustrations and pictures to convey information visually.

[1555] "Answer" refers to information or explanation provided in response to a question.

[1556] "Preferences" refer to certain tendencies or choices that an individual feels are particularly fond of.

[1557] "Textbook" refers to books and digital content used as learning materials by learners.

[1558] An "emotion engine" refers to technology that analyzes learners' emotions and generates appropriate responses and content based on the results.

[1559] "Customized educational materials" refers to educational content that is specially created based on the learner's individual interests and feelings.

[1560] "Virtual store" refers to a virtual shop operated on the Internet, including a platform that provides educational content.

[1561] "Educational content" refers to information and materials that students use to learn.

[1562] A "smartphone" is a type of mobile phone and a multi-function device that can connect to the Internet and use applications.

[1563] A "head-mounted display" is a display device worn on the head that provides virtual reality and augmented reality experiences.

[1564] "Application" means a software program designed to provide a specific function or service.

[1565] The system for implementing the present invention includes a server, a user terminal, and an AI engine. The server receives questions from users and generates text answers and comic-style answers using the AI ​​engine. Furthermore, the server analyzes the user's emotions using the emotion engine and generates customized educational materials.

[1566] System Configuration

[1567] 1. Server:

[1568] The server receives questions from users and sends them to the AI ​​engine.

[1569] The server receives the response from the AI ​​engine and transmits it to the user's device.

[1570] The server uses an emotion engine to analyze the user's emotions and generate customized educational materials.

[1571] 2. User device:

[1572] User terminals include devices such as smartphones and head-mounted displays.

[1573] The user terminal provides an interface for the user to input a question.

[1574] The user terminal displays the answers and educational materials received from the server.

[1575] 3. AI engine:

[1576] The AI ​​engine uses a generative AI model to generate text answers to user questions.

[1577] The AI ​​engine uses a cartoon generation feature to generate visual answers.

[1578] 4. Emotion Engine:

[1579] The emotion engine analyzes the user's emotions and generates customized educational materials based on the results.

[1580] Data processing and calculation

[1581] 1. Receiving and sending questions:

[1582] The server receives questions from the user's device and sends them to the AI ​​engine.

[1583] Example: A user types a question: "Why is the Earth round?"

[1584] 2. Generate text answers:

[1585] The AI ​​engine uses a generative AI model to generate text answers to questions.

[1586] Example: "The reason the Earth is round is because gravity acts equally in all directions, so objects naturally take on a spherical shape."

[1587] 3. Manga generation:

[1588] The AI ​​engine uses cartoon generation to generate visual answers to questions.

[1589] Example: A cartoon showing the process of the Earth becoming round.

[1590] 4. Sentiment analysis and customised educational materials:

[1591] The emotion engine analyzes the user's emotions and generates customized educational materials based on the results.

[1592] Example: If a user expresses excitement or interest, prioritize adding questions and answers related to that topic to your textbook.

[1593] Examples

[1594] A user uses a smartphone to input a question such as "Why is the Earth round?" The server receives this question and sends it to the AI ​​engine. The AI ​​engine uses a generative AI model to generate a text answer such as "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical." It also generates a cartoon depicting the process by which the Earth became round. These answers are sent to the user's device via the server, and the user can view them on their smartphone. Furthermore, the emotion engine analyzes the user's emotions and generates a customized textbook with additional related topics if the user is interested.

[1595] Example prompt:

[1596] Q: Why is the Earth round?

[1597] A: The reason the Earth is round is because gravity acts equally in all directions, so objects naturally take on a spherical shape.

[1598] The flow of the identification process in the application example 2 will be described with reference to FIG.

[1599] Step 1:

[1600] The user inputs a question using a terminal. The user uses a smartphone or a head-mounted display to input a question such as "Why is the Earth round?" into the interface. The input question is sent from the terminal to the server.

[1601] Step 2:

[1602] The server receives the question and sends it to the AI ​​engine. The server analyzes the question received from the user, converts it into an appropriate format, and sends it to the AI ​​engine. The input is the user's question, and the output is the prompt sentence sent to the AI ​​engine.

[1603] Step 3:

[1604] The AI ​​engine generates a text answer. The AI ​​engine uses a generative AI model to generate a text answer based on the received prompt. The input is the prompt, and the output is the generated text answer. Specifically, in response to the question "Why is the Earth round?", the AI ​​engine generates the answer "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical."

[1605] Step 4:

[1606] The AI ​​engine generates a cartoon. The AI ​​engine uses the cartoon generation function to generate a visual answer to the question. The input is the prompt text, and the output is the generated cartoon. Specifically, a cartoon is generated that depicts the process of the Earth becoming round.

[1607] Step 5:

[1608] The server receives the text answer and the comic and sends it to the user's terminal. The server sends the text answer and the comic received from the AI ​​engine to the user's terminal. The input is the answer data from the AI ​​engine, and the output is the data to be sent to the user's terminal.

[1609] Step 6:

[1610] The user terminal displays the text answers and the comics. The user terminal displays the text answers and the comics received from the server. The input is the data sent from the server, and the output is the information displayed to the user. The user views these answers through a smartphone or a head-mounted display.

[1611] Step 7:

[1612] The server analyzes the user's emotions. The server uses an emotion engine to analyze the user's emotions. The input is the user's reaction and behavior data, and the output is the analysis results. Specifically, it determines whether the user is excited or interested.

[1613] Step 8:

[1614] The emotion engine generates customized educational materials. Based on the analysis results, the emotion engine generates customized educational materials according to the user's interests. The input is the result of the emotion analysis, and the output is customized educational materials. Specifically, a textbook is generated with added questions and answers related to the topics that the user has shown interest in.

[1615] Step 9:

[1616] The server transmits the customized educational materials to the user terminal. The server transmits the customized educational materials received from the emotion engine to the user terminal. The input is the educational materials from the emotion engine, and the output is the transmission data to the user terminal.

[1617] Step 10:

[1618] The user terminal displays the customized educational materials. The user terminal displays the customized educational materials received from the server. The input is the data transmitted from the server, and the output is the customized educational materials displayed to the user. The user views these materials through a smartphone or a head-mounted display.

[1619] Example 3

[1620] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[1621] In the conventional education system, it was difficult for elementary and junior high school students to adjust their learning content to suit their interests and learning progress, which led to a decline in motivation to learn. In addition, it was not possible to respond to changes in emotions during learning, making it difficult to concentrate for long periods of time. This hindered effective learning, which was an issue.

[1622] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1623] In this invention, the server includes a means for elementary and junior high school students to ask questions and for the AI ​​to respond in the form of text or comics, a means for elementary and junior high school students to tailor the questions to their preferences, a means for elementary and junior high school students to create their own textbooks, a means for acquiring data based on topics selected by the elementary and junior high school students, a means for organizing the acquired data and generating textbooks, a means for tracking changes in the emotions of the elementary and junior high school students using an emotion engine, and a means for adjusting the learning content based on the changes in emotions, thereby enabling elementary and junior high school students to adjust the learning content to suit their interests and learning progress, and to continue concentrating on their studies for long periods of time.

[1624] "Asking a question" refers to the act of elementary and junior high school students making inquiries to the system about questions they have about the content they are learning or about topics that interest them.

[1625] "Artificial intelligence" is a technology that enables computer systems to mimic human intelligence and generate answers to questions through natural language processing and data analysis.

[1626] "Answering in the form of text or comics" means that the artificial intelligence will provide information in the form of written or visual storyboards in response to questions from elementary and junior high school students.

[1627] "Adjusting questions" refers to the act of elementary and junior high school students changing or modifying the questions they ask the system based on their own interests and learning progress.

[1628] "Creating a textbook" refers to the act of collecting related questions and answers based on a topic chosen by elementary and junior high school students and compiling them into a single learning resource.

[1629] "Acquiring data based on a topic" means that the server searches and collects information related to the learning topic selected by the elementary and junior high school students from the database.

[1630] "Organizing data and generating textbooks" means systematically organizing the information acquired by the server and creating learning materials in a format that is easy for users to understand.

[1631] The "emotion engine" is a technology that tracks and analyzes changes in a user's emotions in real time while they are learning.

[1632] "Adjusting the learning content based on changes in emotions" means that the server changes the learning content and the content it provides in response to changes in the user's emotions detected by the emotion engine.

[1633] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[1634] This invention is a system that allows elementary and junior high school students to adjust their learning content to suit their interests and learning progress, and to continue studying with concentration for long periods of time. This system works in cooperation with a server, a terminal, and a user.

[1635] 1. Generate the system program

[1636] The server uses the generative AI model to generate a program that allows elementary and junior high school students to create their own textbooks. The program allows users to select a topic that interests them and collect related questions and answers to create a textbook.

[1637] 2. Explain the program's processing in natural language

[1638] Based on the user's selected topic, the server retrieves relevant questions and answers from a database that contains a wealth of education-related information. The server then organizes the retrieved information and generates a textbook in a format that is easy for the user to understand. In the process, the server uses natural language processing techniques to ensure the information is consistent and coherent.

[1639] It also uses an emotion engine to track changes in a user's emotions as they progress through the course. For example, if a user is excited when they first start learning but grows bored over time, the server can use this information to adjust the learning experience, perhaps offering new topics or interactive content to keep the user engaged.

[1640] 3. Examples and prompts

[1641] As a concrete example, consider a case where an elementary school student user selects the topics "Shape of the Earth," "Gravity of the Earth," and "Rotation of the Earth." The server retrieves questions and answers related to these topics from the database and generates a textbook. For example, in response to the question "Why is the Earth round?", the server provides the answer "The Earth is spherical due to gravity."

[1642] Example prompt:

[1643] Create a textbook on "Shape of the Earth", "Earth's Gravity" and "Earth's Rotation". Include questions and answers related to each topic.

[1644] By inputting these prompts into a generative AI model, a textbook based on the topic the user is interested in is generated, allowing users to self-adjust their learning content and stay engaged while they learn.

[1645] Hardware and Software Used

[1646] Server: A server with high-performance data processing capabilities is required, specifically a server equipped with a database management system (DBMS) and a natural language processing (NLP) engine.

[1647] Devices: The devices used by elementary and junior high school students are tablets and computers with internet access.

[1648] Generative AI models: AI models for generating education-related questions and answers, for example using advanced natural language processing models such as GPT-3.

[1649] This system allows elementary and junior high school students to adjust their learning content to suit their interests and learning progress, and to continue studying with concentration for a long period of time. The flow of the specific process in the third embodiment will be described with reference to FIG.

[1650] Program processing flow

[1651] Step 1: User Selects a Topic

[1652] A user logs into the system using a terminal. After logging in, the user is directed to a screen where he or she can select a topic of interest. For example, topics such as "Shape of the Earth", "Gravity of the Earth", and "Rotation of the Earth" are displayed. The user selects the topic that interests them.

[1653] Input: The topic selected by the user

[1654] Output: Selected topic information

[1655] Step 2: The server retrieves data based on the selected topic

[1656] When a user selects a topic, the server retrieves questions and answers related to that topic from the database. The database contains a wealth of educational information. For example, if the topic "Shape of the Earth" is selected, the server retrieves the question "Why is the Earth round?" and its answer.

[1657] Input: Selected topic information

[1658] Output: Question and answer data related to the topic

[1659] Step 3: The server organizes the acquired data and generates textbooks

[1660] The server organizes the questions and answers obtained and generates a textbook in a format that is easy for users to understand. In the process, the server uses natural language processing technology to ensure the consistency and integrity of the information. The generated textbook is provided to the user in a format that can be viewed on their device.

[1661] Input: Question and answer data related to the topic

[1662] Output: Organized textbook data

[1663] Step 4: The server uses the emotion engine to track the user's emotions

[1664] As the user works through the textbook, the server uses the emotion engine to track the user's changing emotions. For example, if the user is excited when he or she starts learning but becomes bored as time goes on, the server gets this information from the emotion engine.

[1665] Input: User behavior data during learning

[1666] Output: User's emotional state data

[1667] Step 5: The server coordinates the learning

[1668] The server adjusts the learning content based on the information obtained from the emotion engine. Specifically, it provides new topics and interactive content to keep the user interested. For example, if the user gets bored with "The Shape of the Earth," the server will suggest new related topics such as "The Internal Structure of the Earth" and "The History of the Earth."

[1669] Input: User emotional state data

[1670] Output: Adjusted learning content data

[1671] Specific examples of operation

[1672] If a user selects the topic "Shape of the Earth," the server retrieves from the database the question "Why is the Earth round?" and the answer "The Earth is spherical due to gravity." The server then organizes this information and generates a textbook. The generated textbook is provided to the user in PDF format for viewing on their device.

[1673] As the user works through the textbook, the server uses the emotion engine to track the user's emotional changes. For example, if the user is excited when he or she first starts learning, but becomes bored over time, the server gets this information from the emotion engine. The server uses this information to provide new topics and interactive content to keep the user interested. For example, it suggests new related topics such as "The Earth's Internal Structure" and "The Earth's History."

[1674] (Application example 3)

[1675] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server", and the smart glasses 214 will be referred to as a "terminal".

[1676] In conventional educational systems, it is difficult for elementary and junior high school students to adjust their learning content based on their own interests, and the learning content cannot be dynamically adjusted to respond to emotional changes during learning, which leads to a decline in motivation to learn. Furthermore, there is a lack of means to provide personalized educational content to individual learners. This makes it difficult for elementary and junior high school students to concentrate and continue studying for long periods of time.

[1677] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1678] In this invention, the server includes a means for elementary and junior high school students to ask questions and for the artificial intelligence to respond in the form of text or comics, a means for elementary and junior high school students to tailor questions to their preferences, a means for elementary and junior high school students to create their own textbooks, a means for tracking the emotions of elementary and junior high school students and dynamically adjusting the learning content, and a means for suggesting additional information and quizzes to maintain the interest of elementary and junior high school students. This allows elementary and junior high school students to adjust the learning content based on their interests and dynamically adjust the learning content in response to emotional changes during learning.

[1679] "Asking a question" refers to the act of elementary and junior high school students asking the system questions about their studies or topics that interest them.

[1680] "Artificial intelligence" refers to the technology that enables computer systems to mimic human intelligence: learning, reasoning, and problem-solving.

[1681] "Answering in the form of text or comics" means that the artificial intelligence will provide answers to questions from elementary and junior high school students in the form of written or visual storytelling.

[1682] "Adjusting questions" refers to the act of elementary and junior high school students changing the questions they ask the system based on their own interests and their learning progress.

[1683] "Creating a textbook" means compiling topics and questions and answers selected by elementary and junior high school students, and editing and generating them into a single learning resource.

[1684] "Tracking emotions" means that the system monitors and analyzes emotional changes of elementary and junior high school students in real time while they are learning.

[1685] "Dynamic adjustment of learning content" means that the system changes the educational content it provides in real time according to the emotions and learning progress of elementary and junior high school students.

[1686] "Suggest additional information or quizzes" means that the system provides relevant new information or questions to keep elementary and junior high school students interested.

[1687] A system for implementing this invention has the following configuration. The system includes a terminal used by a user, a server, and artificial intelligence (AI). The terminal is a device such as a smartphone or tablet, and the server is responsible for data processing and storage. The AI ​​generates answers to user questions using a generative AI model.

[1688] Hardware and Software Used

[1689] Hardware: Smartphones, tablets

[1690] Software: Python, TensorFlow, Keras, OpenCV, Emotion API (Microsoft Azure), Natural Language Processing (NLP) models (GPT-3, etc.)

[1691] Data processing and calculation

[1692] 1. User Interface:

[1693] The terminal provides an interface that allows users to select topics of interest and enter questions and answers.

[1694] For example, choose topics such as "Shape of the Earth", "Earth's Gravity", or "Earth's Rotation".

[1695] 2. Emotion Engine:

[1696] The device's camera is used to capture the user's facial expressions in real time.

[1697] Use OpenCV and the Emotion API to analyze user emotions (excitement, boredom, concentration, etc.).

[1698] For example, tracking emotional changes such as "excitement" when you first start learning, and "boredom" as time passes.

[1699] 3. Adjust your learning:

[1700] The server dynamically adjusts the learning content using an NLP model (such as GPT-3) based on the data obtained from the emotion engine.

[1701] Example: If the user gets bored, suggest new interesting topics or quizzes.

[1702] 4. Textbook Generation:

[1703] The server compiles the topics and questions / answers selected by the user to generate a digital textbook.

[1704] The generated textbook can be saved and shared in PDF format.

[1705] Examples and prompts

[1706] Examples:

[1707] A user is interested in "Earth's gravity" and types a related question: "How is Earth's gravity measured?"

[1708] The emotion engine analyzes the user's facial expressions and detects excitement.

[1709] NLP models suggest relevant follow-up information and quizzes to keep users engaged.

[1710] Example prompt:

[1711] A user types a question about "Earth's Gravity." You analyze the user's facial expressions and detect that they are excited. Suggest additional information or a quiz that is related to the question.

[1712] In this way, the system allows students to tailor their learning content based on their interests and dynamically adjusts the learning content in response to emotional changes during learning, helping students stay focused and engaged for extended periods of time.

[1713] The flow of the specific process in the application example 3 will be described with reference to FIG.

[1714] Step 1:

[1715] A user uses a terminal to select a topic of interest and enter a question.

[1716] Input: The topic and question selected by the user.

[1717] Output: Topic and question data.

[1718] Specific actions: Through the device's user interface, the user selects a topic such as "Earth's gravity" and enters a question such as "How is the Earth's gravity measured?"

[1719] Step 2:

[1720] The terminal transmits the entered question to the server.

[1721] Input: Topic and question data.

[1722] Output: The question data sent to the server.

[1723] Specific operation: The device receives user input and sends the data to a server via the Internet.

[1724] Step 3:

[1725] The server receives the question data and generates an answer using a generative AI model.

[1726] Input: The question data sent to the server.

[1727] Output: The generated response data.

[1728] What it does: A server receives question data and uses an NLP model (such as GPT-3) to generate an answer to the question "How is the Earth's gravity measured?"

[1729] Step 4:

[1730] The server sends the generated answer to the terminal.

[1731] Input: The generated answer data.

[1732] Output: The response data sent to the device.

[1733] Specific operations: The server generates a response and sends it to the terminal via the Internet.

[1734] Step 5:

[1735] The terminal displays the answers and the user begins learning.

[1736] Input: The response data sent to the device.

[1737] Output: The answer displayed on the terminal.

[1738] Specific operation: The device displays the received answers on the user interface and the user begins learning.

[1739] Step 6:

[1740] The device's camera captures the user's facial expressions in real time, and the emotion engine analyzes them.

[1741] Input: User's facial expression data.

[1742] Output: The parsed emotion data.

[1743] Specific operation: The device camera captures the user's facial expressions and analyzes the user's emotions (excitement, boredom, concentration, etc.) using OpenCV and the Emotion API.

[1744] Step 7:

[1745] The server receives the emotion data and dynamically adjusts the learning content.

[1746] Input: Parsed emotion data.

[1747] Output: Adjusted learning content data.

[1748] What it does: The server receives the sentiment data and uses NLP models to suggest new topics and quizzes to keep the user engaged.

[1749] Step 8:

[1750] The server transmits the adjusted learning content to the terminal.

[1751] Input: Adjusted learning content data.

[1752] Output: The learning data sent to the device.

[1753] Specific operations: The server sends the adjusted learning content to the terminal via the Internet.

[1754] Step 9:

[1755] The terminal displays the adjusted learning content, and the user continues learning.

[1756] Input: Learning content data sent to the terminal.

[1757] Output: The adjusted learning content displayed on your terminal.

[1758] Specific operation: The device displays the adjusted learning content received on the user interface, and the user continues learning.

[1759] Step 10:

[1760] After the user finishes learning, the terminal transmits the learning contents to the server and generates a textbook.

[1761] Input: Learning content data.

[1762] Output: The generated digital textbook.

[1763] How it works: The device sends the learning content to the server, and the server compiles the user's selected topics and questions and answers to create a digital textbook.

[1764] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires a voice indicating a user input for the result of the specific processing. The control unit 46A transmits the voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1765] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1766] Another example of generative AI is Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) are mentioned.

[1767] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1768] [Third embodiment]

[1769] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1770] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1771] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[1772] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1773] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs the voice according to instructions from the processor 46.

[1774] Camera 42 is a small digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (e.g., an imaging range defined by an angle of view equivalent to the width of the field of vision of an average healthy person).

[1775] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54. The transmission and reception of various types of information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is performed in a secure state.

[1776] Fig. 6 shows an example of main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1777] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32, and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1778] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1779] do.

[1780] In the headset type terminal 314, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1781] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1782] "Example 1"

[1783] In one embodiment of the present invention, there is an application that is installed on a device (e.g., a PC, a tablet, etc.) used by elementary and junior high school students. This application provides an interface for elementary and junior high school students to input questions, and transmits the input questions to an AI engine. The AI ​​engine generates answers to the questions and provides the answers in the form of text or comics. Elementary and junior high school students can tailor the questions to their preferences and create their own personalized textbooks.

[1784] "Example 2"

[1785] As a specific example, if an elementary or junior high school student inputs the question "Why is the Earth round?" into the application, the AI ​​engine will generate a text answer such as "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical." In response to the same question, the engine will also generate a cartoon depicting the process by which the Earth becomes round, providing a deeper visual understanding.

[1786] "Example 3"

[1787] In addition, a function will be provided for elementary and junior high school students to create their own textbooks. For example, elementary and junior high school students can select topics that interest them, such as "shape of the Earth," "gravity of the Earth," and "rotation of the Earth," and create a textbook by collecting questions and answers related to those topics. This allows students to adjust the content of their studies themselves and study in a way that interests them.

[1788] The process flow of each embodiment will be described below.

[1789] "Example 1"

[1790] Step 1: Elementary and junior high school students operate a device (e.g., a computer or tablet) and launch an application.

[1791] Step 2: The application provides an interface through which the student inputs a question. The student inputs a question through the interface.

[1792] Step 3: The application sends the entered question to the AI ​​engine.

[1793] Step 4: The AI ​​engine generates answers to the questions and provides the answers in the form of text or comics.

[1794] Step 5: Students review the answers generated and adjust questions as needed.

[1795] Step 6: Primary and secondary school students can use the Create Your Own Textbook feature to create a textbook by collecting questions and answers related to topics that interest them.

[1796] "Example 2"

[1797] Step 1: Elementary and middle school students enter the question "Why is the Earth round?" into the application.

[1798] Step 2: The application sends this question to the AI ​​engine.

[1799] Step 3: The AI ​​engine generates a text answer that says, "The Earth is round because the Earth's gravity acts equally in all directions, so objects naturally take on a spherical shape."

[1800] Step 4: The AI ​​engine responds to the same question by generating a cartoon depicting the process by which the Earth becomes round.

[1801] Step 5: Primary and secondary school students review the generated text answers and cartoons to deepen their understanding.

[1802] "Example 3"

[1803] Step 1: Elementary and junior high school students can use the feature to create their own textbooks.

[1804] Step 2: Elementary and middle school students choose a topic that interests them, such as "The Shape of the Earth," "The Earth's Gravity," or "The Earth's Rotation."

[1805] Step 3: Primary and secondary school students will create a textbook with questions and answers related to the topic they have chosen.

[1806] Step 4: Elementary and junior high school students will be able to adjust their learning content themselves and learn with interest through their own textbooks.

[1807] Example 1

[1808] Next, a description will be given of Example 1 of the embodiment 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[1809] Conventional educational systems make it difficult for elementary and junior high school students to progress through their studies at their own pace, and lack the ingenuity to make learning interesting. In particular, answers to questions are given one-sidedly, making it difficult to customize them to meet the needs of individual learners. Also, answers in text format alone can be difficult to understand, and visual aids are often required.

[1810] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1811] In this invention, the server includes a means for elementary and junior high school students to input questions, a means for the terminal to transmit the questions to the server, a means for the server to transmit the questions to the generative AI model, a means for the generative AI model to generate answers to the questions, a means for the server to transmit the generated answers to the terminal, a means for the terminal to display the answers to the user, and a means for elementary and junior high school students to adjust questions to their own preferences and create their own textbooks. This allows elementary and junior high school students to study at their own pace and learn with interest. Also, providing answers in both text format and comic format can help with visual understanding.

[1812] "Elementary and junior high school students" refers to children and students in the primary and secondary education stages.

[1813] "Means for inputting a question" refers to a function that provides an interface for a user to input a question through a text box, voice input, or the like.

[1814] "Terminal" refers to a computing device used by a user, such as a PC or tablet.

[1815] A "server" refers to a computer system that communicates with terminals via a network and processes and stores data.

[1816] A "generative AI model" refers to an algorithm or program that uses artificial intelligence technology to generate answers to user questions.

[1817] "Means for generating an answer" refers to the ability of a generative AI model to create an appropriate answer based on a user's question.

[1818] "Text format" refers to a format in which answers are provided using textual information.

[1819] "Comic format" refers to a format in which answers are provided using visual illustrations or diagrams.

[1820] "Means for adjusting questions" refers to functionality that allows a user to modify a question entered or to ask an additional question.

[1821] "Means for creating textbooks" refers to a function that allows users to create their own study materials based on the answers generated.

[1822] "Educational content" refers to information or explanations that deepen learners' knowledge and understanding.

[1823] "Means of making learning fun and motivating" refers to the devices and functions that encourage learners to become interested and actively engage in their studies.

[1824] This invention is implemented using an application installed on a device (e.g., a PC, a tablet, etc.) used by elementary and junior high school students. The application provides an interface for elementary and junior high school students to input questions and transmits the input questions to an AI engine. The AI ​​engine generates answers to the questions and provides the answers in the form of text or comics. Elementary and junior high school students can tailor the questions to their preferences and create their own personalized textbooks.

[1825] Hardware and Software Used

[1826] Hardware:

[1827] Devices: PC, tablet

[1828] software:

[1829] Application: HTML and JavaScript to provide the user interface

[1830] Server: Python using the Flask framework

[1831] Generative AI models: For example, OpenAI's GPT-4

[1832] Image generation models: For example, DALL-E

[1833] Program Processing

[1834] A user launches an application installed on the device. The application provides an interface for the user to input a question. When the user inputs a question, the terminal sends the question to a server. The server sends the received question to a generative AI model. The generative AI model generates an answer to the question. The answer is provided in text format or comic format. To generate an answer in comic format, the AI ​​engine further uses an image generation model. The generated answer is sent to the terminal via the server. The terminal displays the received answer to the user. Based on the displayed answer, the user can adjust the question to suit his / her preferences and create his / her own textbook.

[1835] Examples

[1836] For example, consider a user entering a question such as "Tell me about the planets in the solar system." This question is sent from the device to a server, which then sends the question to a generative AI model. The generative AI model generates an answer like this:

[1837] Example of a text response:

[1838] "There are eight planets in our solar system. Each planet has a different distance from the sun, size, and composition. For example, Mercury is closest to the sun and is very hot. On the other hand, Jupiter is the largest planet in the solar system and has many moons."

[1839] Example answer in comic form:

[1840] The generative AI model uses an image generation model to generate cartoons illustrating the planets in our solar system, visually illustrating each planet's characteristics and relative positions.

[1841] Example prompt:

[1842] "Tell me about the planets in our solar system. Generate answers in both text and comic form."

[1843] In this way, users can tailor information to their own learning style.

[1844] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1845] Step 1:

[1846] The user enters a question.

[1847] A user starts an application installed on a device, inputs a question in a text box, for example, "Tell me about the planets in the solar system," and clicks the "Submit" button. The input data is the question text entered by the user.

[1848] Step 2:

[1849] The terminal sends a question to the server.

[1850] The device sends the question entered by the user to the server as an HTTP POST request. The input data is the question text entered by the user, and the output data is the request sent to the server. Specifically, the device converts the question text into JSON format and sends it to the server's API endpoint.

[1851] Step 3:

[1852] The server sends the question to the generative AI model.

[1853] The server creates an API request to send the received question to the generative AI model. The input data is the question text received from the device, and the output data is the request to be sent to the generative AI model. Specifically, the server converts the question text into an appropriate format and sends it to the API endpoint of the generative AI model.

[1854] Step 4:

[1855] A generative AI model generates answers to questions.

[1856] The generative AI model generates an answer based on the received question. The input data is the question text received from the server, and the output data is the generated answer text or data in the form of a comic. In concrete terms, the generative AI model analyzes the question text and generates an appropriate answer.

[1857] Step 5:

[1858] The server sends the generated answer to the terminal.

[1859] The server sends the answer received from the generative AI model to the terminal. The input data is the answer data received from the generative AI model, and the output data is the response sent to the terminal. Specifically, the server converts the answer data into JSON format and sends it to the terminal's API endpoint.

[1860] Step 6:

[1861] The terminal displays the answer to the user.

[1862] The terminal displays the received answers to the user. The input data is the answer data received from the server, and the output data is the answer text or comic-style data displayed to the user. Specifically, the terminal analyzes the answer data and displays it on the user interface using HTML and JavaScript.

[1863] Step 7:

[1864] Users can then tailor the questions based on the answers to create their own personalized textbook.

[1865] The user can further refine the question based on the displayed answer. For example, add a question such as "Tell me more about Mars." The input data is the answer the user was shown, and the output data is the newly entered question text. In concrete terms, the user can enter a new question and click the "Submit" button again, starting the process from step 1 again.

[1866] (Application example 1)

[1867] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server", and the headset type terminal 314 will be referred to as a "terminal".

[1868] In conventional education systems, it is difficult for elementary and junior high school students to learn at their own pace, and there is a lack of ingenuity to maintain their interest. In addition, answers to questions are one-sided, making it difficult to customize according to the needs of individual learners. Furthermore, there is insufficient means to save the generated learning content and refer to it later, which can hinder continuity of learning.

[1869] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1870] In this invention, the server includes a means for elementary and junior high school students to ask questions and for the AI ​​to respond in the form of text or comics, a means for elementary and junior high school students to tailor the questions to their preferences, a means for elementary and junior high school students to create their own textbooks, a means for saving the generated answers and for later reference, a means including an application to be installed on a smartphone, a means for generating answers to questions using an AI engine, and a means for saving the generated answers in a text file. This allows elementary and junior high school students to learn at their own pace and maintain their interest. It also facilitates customization according to the needs of individual learners, and the continuity of learning is improved because the generated learning content can be saved and referenced later.

[1871] "Ask a question" refers to the act of elementary and junior high school students inputting their doubts or the things they want to learn.

[1872] "AI responds in the form of text or comics" means that artificial intelligence provides answers to input questions in the form of text or visual comics.

[1873] "Adjusting questions" means that elementary and junior high school students change the content and format of the questions according to their own level of understanding and interests.

[1874] "Creating your own textbook" means that elementary and junior high school students collect generated answers and create their own customized study materials.

[1875] "Save the generated answers for later reference" means that the answers generated by the AI ​​are saved in digital format so that they can be reviewed again if needed.

[1876] An "application installed on a smartphone" is software that is downloaded to a mobile information terminal and used.

[1877] "Using an AI engine to generate answers to questions" means using an artificial intelligence algorithm to generate answers to input questions.

[1878] "Saving the generated answers in a text file" means recording the answers generated by the AI ​​as text information in a file.

[1879] The system for implementing this invention mainly consists of three elements: a server, a terminal, and a user. The server is responsible for generating answers to questions using an AI engine. The terminal is a mobile information terminal such as a smartphone or tablet, and provides an interface for users to input questions and receive the generated answers. The users are elementary and junior high school students who input their questions and the content they want to learn.

[1880] Server Processing

[1881] The server receives questions sent by users and generates answers using an AI engine. The AI ​​engine uses a generative AI model to create the best answer to the question. The answer is generated in text or comic form. The generated answer is saved by the server for later reference by the user.

[1882] Terminal handling

[1883] The terminal provides an interface for the user to enter a question, which is then sent to the server. The server returns a generated answer, which the terminal displays. The user can save the generated answer as a text file, or the user can adjust the question to suit their preferences and send it back to the server.

[1884] User Actions

[1885] Users use the device to input questions and receive answers. For example, if you input a question like "What is photosynthesis?", the server uses an AI engine to generate an answer and sends it back to the device. Users can save the answer as a text file and create their own textbook.

[1886] Hardware and Software Used

[1887] Hardware: Smartphones, tablets, servers

[1888] Software: AI engine (generative AI model), question input interface, answer display interface, text file saving function

[1889] Examples of concrete examples and prompts

[1890] The following questions and answers are examples of such questions and answers:

[1891] Question: "What is photosynthesis?"

[1892] Answer (in text): "Photosynthesis is the process by which plants use light energy to produce oxygen and glucose from carbon dioxide and water."

[1893] Example prompt:

[1894] Question: What is photosynthesis?

[1895] Answer (text format):

[1896] In this way, users can get answers to their questions and save them for later reference, allowing elementary and middle school students to learn at their own pace and sustain their interest.

[1897] The flow of the specific process in the application example 1 will be described with reference to FIG.

[1898] Step 1:

[1899] The user uses the terminal to input a question.

[1900] Input: The user types the question in text form into the terminal interface.

[1901] Specific behavior: A user uses a keyboard to type a question into an input field displayed on the device screen, for example, "What is photosynthesis?"

[1902] Output: The entered question is temporarily stored in the device's memory.

[1903] Step 2:

[1904] The terminal transmits the entered question to the server.

[1905] Input: The question text saved on your device.

[1906] Specific operation: The terminal sends the entered question to the server via the network. The terminal sends the question data to the server using an HTTP request.

[1907] Output: The question text reaches the server.

[1908] Step 3:

[1909] The server receives the question and sends it to the AI ​​engine.

[1910] Input: The question text as it reaches the server.

[1911] Specific operation: The server analyzes the received question and sends it to the AI ​​engine as a prompt sentence. For example, it sends it in the form of "Question: What is photosynthesis? Answer (text format):".

[1912] Output: The AI ​​engine receives the prompt.

[1913] Step 4:

[1914] The AI ​​engine generates answers to questions.

[1915] Input: The prompt sent to the AI ​​engine.

[1916] What it does: The AI ​​engine uses the generative AI model to generate an answer based on the prompt sentence, for example, "Photosynthesis is the process by which plants use light energy to produce oxygen and glucose from carbon dioxide and water."

[1917] Output: The generated answer text.

[1918] Step 5:

[1919] The server receives the generated response and transmits it to the terminal.

[1920] Input: The answer text returned by the AI ​​engine.

[1921] Specific operation: The server receives the generated answer and sends it to the terminal as an HTTP response.

[1922] Output: The answer text arrives at the terminal.

[1923] Step 6:

[1924] The terminal will display the generated answer.

[1925] Input: The answer text sent by the server.

[1926] Specific operation: The device displays the received answer on the screen, for example, "Photosynthesis is the process by which plants use light energy to produce oxygen and glucose from carbon dioxide and water."

[1927] Output: The user can visually confirm their answer.

[1928] Step 7:

[1929] The user saves the generated answers.

[1930] Input: The answer text displayed on the terminal.

[1931] Specific operation: The user uses the device's save function to save the generated answer as a text file. For example, the user clicks the "Save" button to save the answer to "my_textbook.txt".

[1932] Output: The answer text is saved to the device storage.

[1933] Example 2

[1934] Next, a second embodiment of the second form will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal".

[1935] In traditional education systems, it can be difficult for elementary and junior high school students to get the right answers when they ask questions. There is also a need to provide visual explanations in addition to text to deepen their understanding. Furthermore, there is a lack of ways for elementary and junior high school students to tailor questions to their preferences and create their own textbooks.

[1936] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1937] In this invention, the server includes means for a user to input a question, means for the terminal to transmit the question to the server, means for the server to analyze the question, means for the server to generate a text answer, means for the server to generate a visual explanation, means for the server to transmit the generated result to the terminal, means for the terminal to display the result to the user, means for elementary and junior high school students to adjust the question to their own preferences, and means for elementary and junior high school students to create their own textbooks. This enables elementary and junior high school students to obtain appropriate text answers and visual explanations for their questions, and further enables them to create teaching materials that match their own learning styles.

[1938] "Users" are those who use the system to input questions and receive answers, including elementary and junior high school students.

[1939] A "terminal" is a device through which a user inputs questions and communicates with the server, and includes smartphones, tablets, PCs, etc.

[1940] A "server" is a central processing unit that receives questions from users and performs analysis and generation of answers.

[1941] The "means for inputting a question" is an interface that allows a user to input a question to the system through a terminal.

[1942] The "means for transmitting a question to a server" is a communication function that enables the terminal to transmit a question input by a user to a server.

[1943] The "means for analyzing a question" is a function for analyzing a question received by the server using natural language processing technology and creating a prompt sentence for generating an appropriate answer.

[1944] "Means for generating a text answer" refers to a function in which the server uses a generative AI model to generate a text answer to the analyzed question.

[1945] "Means for generating a visual explanation" refers to a function in which the server uses image generation technology to generate a visual explanation (e.g., a cartoon or illustration) for a question.

[1946] The "means for transmitting the generated results to the terminal" is a communication function for transmitting the text answers and visual explanations generated by the server to the terminal.

[1947] The "means for displaying results to a user" is an interface through which the terminal displays to the user the text answers and visual explanations received from the server.

[1948] "Means for tailoring questions to your preferences" refers to a function that allows users to change the content and format of questions to suit their own learning style.

[1949] The "means of creating your own textbook" is a feature that allows users to combine generated answers and visual explanations to create their own customized learning materials.

[1950] This invention is a system that provides appropriate text answers and visual explanations when elementary and junior high school students ask questions. The system includes a series of processes in which a user inputs a question, a server analyzes the question, generates an answer, and displays the result to the user through a terminal.

[1951] Hardware and Software Used

[1952] Hardware

[1953] Device: The device, such as a smartphone, tablet, or computer, through which a user enters a question and receives results.

[1954] Server: A central processing unit that analyzes questions and generates answers.

[1955] software

[1956] Natural Language Processing Engine: Software for parsing questions. As an example, we will use OpenAI's GPT-4.

[1957] Generative AI model: Software for generating text answers to questions. We use OpenAI's GPT-4 as an example.

[1958] Image Generation Engine: Software for generating visual explanations. We use DALL-E as an example.

[1959] Data processing and calculation

[1960] Enter and submit your question

[1961] A user inputs a question through an application on the device, for example, "Why is the Earth round?" The device sends this question to the server in an appropriate format (e.g., JSON format).

[1962] Parsing the Question

[1963] The server uses a natural language processing engine to analyze the received question, understand the intent of the question, and create a prompt to generate an appropriate answer.

[1964] Example prompt: "Please briefly explain why the Earth is round. Please provide a scientific explanation that is easy for elementary and middle school students to understand."

[1965] Generate text answers

[1966] The server inputs the prompt sentence into the generative AI model and generates a text answer, for example, "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical."

[1967] Generate visual explanations

[1968] The server uses an image generation engine to generate a visual illustration, specifically a cartoon depicting the process of the Earth becoming round.

[1969] Sending and viewing results

[1970] The server transmits the generated text answer and visual explanation to the terminal. The terminal displays the information to the user. The user can check the text answer and visual explanation through the terminal to deepen his / her understanding.

[1971] Adding concrete examples

[1972] For example, if an elementary or junior high school student inputs the question "Why is the Earth round?" into an application, the server processes it as follows:

[1973] 1. Enter a question: The user enters "Why is the Earth round?"

[1974] 2. Sending a question: The device sends a question to the server.

[1975] 3. Question analysis: The server analyzes the question and generates a prompt such as, "Please briefly explain why the Earth is round. Please answer in a way that is easy for elementary and junior high school students to understand and include scientific reasons."

[1976] 4. Generate text answer: The server inputs the prompt text into the generative AI model, which generates an answer such as, "The reason the Earth is round is because the Earth's gravity acts equally in all directions, so objects naturally become spherical."

[1977] 5. Generate visual explanation: The server uses an image generation engine to generate a cartoon illustrating the process of the Earth becoming round.

[1978] 6. Sending and displaying the results: The server sends the generated text answers and cartoons to the device, which displays them to the user.

[1979] In this way, users can get relevant answers and visual explanations to their questions.

[1980] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1981] Step 1:

[1982] The user enters a question.

[1983] A user opens an application on the device and enters a question into an input field, for example, "Why is the Earth round?" The entered question is temporarily stored in the device's memory.

[1984] Step 2:

[1985] The terminal sends a question to the server.

[1986] The terminal converts the question entered by the user into an appropriate format (e.g., JSON format) and sends it to the server. The transmitted data is received by the server's receiving module.

[1987] Step 3:

[1988] The server parses the question.

[1989] The server inputs the received question into a natural language processing engine and analyzes the intent of the question. Specifically, it creates a prompt sentence to understand the content of the question and generate an appropriate answer. For example, a prompt sentence such as "Please briefly explain why the Earth is round. Please provide an answer that is easy to understand for elementary and junior high school students and includes scientific evidence" is generated.

[1990] Step 4:

[1991] The server generates a text answer.

[1992] The server inputs the prompt sentence into the generative AI model and generates a text answer. The generated text answer contains an appropriate explanation for the user's question. For example, the answer "The reason the Earth is round is because the gravity of the Earth acts equally in all directions, so objects naturally become spherical."

[1993] Step 5:

[1994] The server generates the visual description.

[1995] The server inputs the prompts into an image generation engine to generate a visual explanation. Specifically, it generates a cartoon that depicts the process of the Earth becoming round. The generated cartoon is provided to the user as a visual aid to deepen their understanding.

[1996] Step 6:

[1997] The server transmits the generated results to the terminal.

[1998] The server converts the generated text answers and visual explanations into an appropriate format (e.g., JSON format) and sends them to the terminal. The transmitted data is received by the terminal's receiving module.

[1999] Step 7:

[2000] The terminal displays the results to the user.

[2001] The terminal analyzes the text answer and visual explanation received from the server and displays them on the application screen. The user can check this information through the terminal and understand the answer to the question. For example, the text answer and the cartoon are displayed on the screen and the user can read them.

[2002] (Application example 2)

[2003] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server", and the headset type terminal 314 will be referred to as a "terminal".

[2004] In conventional educational systems, when elementary and junior high school students ask questions, they can only get answers in the form of text, and there is a lack of means to deepen their visual understanding. In addition, there are no applications available in education-related stores, and in-store learning support is not sufficient. Furthermore, there are limited ways for elementary and junior high school students to tailor questions to their preferences or create their own textbooks. To solve these problems, a more effective educational support system is needed.

[2005] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2006] In this invention, the server includes a means for elementary and junior high school students to ask questions and for AI to respond in the form of text or comics, a means for elementary and junior high school students to adjust the questions to suit their preferences, a means for elementary and junior high school students to create their own textbooks, a means for providing a smartphone application that can be used in education-related stores, a means for generating text answers to the questions, a means for generating comics related to the questions, and a means for displaying the generated text answers and comics. This allows elementary and junior high school students to visually deepen their understanding of the questions, and enables learning support in education-related stores. Also, elementary and junior high school students can adjust the questions to suit their preferences an...

Claims

1. A means for generating answers to a question input by a user using a generative AI model based on a prompt sentence generated from the question; and a means for generating educational materials customized according to the interests of the user based on an analysis result of the user's emotions analyzed using an emotion engine; means for transmitting the customized educational material to a user terminal; A system including:

2. The system of claim 1 further comprising means for providing the customized educational materials within a virtual storefront.

3. The system of claim 1 , further comprising an application installed on said user terminal for inputting said questions and displaying said educational material.

Images