System
The system addresses the limitations of traditional exam prep by providing individualized curricula, real-time feedback, and community interaction, improving learning efficiency and motivation for university entrance exams.
Patent Information
- Application Number
- JP2024126286
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-01
- Publication Date
- 2026-02-13
AI Technical Summary
Existing university entrance exam preparation methods are expensive, offer uniform curricula that fail to meet individual needs, lack real-time progress tracking and feedback, and limit knowledge sharing among students.
A system that includes inputting user information to generate an individualized curriculum, automatically generate questions, provide real-time feedback, and facilitate a knowledge-sharing community for students.
Enables efficient learning through customized study plans, real-time feedback, and community interaction, enhancing learning effectiveness and motivation.
Smart Images

Figure 2026023965000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] When preparing for university entrance exams, many students rely on expensive prep schools and commercially available learning materials, but these methods are expensive and offer uniform curricula, making them unable to meet individual needs. Furthermore, for users to study efficiently, it is important to be able to track their progress in real time and receive appropriate feedback. However, this is difficult to achieve with traditional learning methods, resulting in inefficient learning. Furthermore, there are limited opportunities to share knowledge and study strategies with other students. [Means for solving the problem]
[0005] The present invention provides a system including: means for inputting and registering information such as a user's desired educational institution and current academic level; means including a computer device for generating an individualized curriculum based on the inputted and registered user information; means including a computer device for automatically generating questions based on the user's desired educational institution's trends and level; means for the user to input answers to the questions provided; means including a computer device for receiving the user's answers, determining whether they are correct, and generating feedback in real time; means including a computer device for analyzing the user's learning progress and identifying areas for improvement; and means for the user to share information with other test-takers in a knowledge-sharing community. This system allows users to study efficiently through the individualized curriculum and automatically generated questions, and maximize learning effectiveness through real-time feedback and progress analysis. Furthermore, users can exchange information with other test-takers through the knowledge-sharing community, enriching their learning experience.
[0006] "User" refers to users such as students who use the system to study for university entrance exams.
[0007] "Educational institution" refers to an organization that provides higher education, such as a university or vocational school.
[0008] "Academic level" refers to a user's current level of knowledge and skill in a particular academic field.
[0009] A "means" refers to a method or device used to achieve a particular purpose.
[0010] "Computing device" refers to a computer, server, or other hardware used for data processing.
[0011] "Individualized curriculum" refers to a learning plan that is customized to meet the needs and goals of a specific user.
[0012] "Automatic generation" refers to the process of using AI or algorithms to generate some data or information without manual input.
[0013] "Answer" means the answer entered by a User in response to a provided question.
[0014] "Feedback" refers to the evaluation and advice the system provides in response to a user's answer.
[0015] "Progress" refers to a user's learning progress and achievements.
[0016] "Analysis" refers to the process of examining data or information in detail and drawing specific conclusions or insights.
[0017] "Improvement points" refer to specific knowledge or skills that a user needs to learn more about or improve.
[0018] A "knowledge sharing community" refers to an online platform where users can exchange information and advice with each other. [Brief explanation of the drawings]
[0019] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0020] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0021] First, the terms used in the following description will be explained.
[0022] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0023] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0024] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0025] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0026] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0027] [First embodiment]
[0028] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0029] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0030] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0031] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0032] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0033] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0034] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0035] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0036] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0037] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0038] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0039] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0040] The embodiment of the system according to the present invention is as follows: This system is targeted at university entrance exam candidates and provides individually customized study plans and past exam questions using generative AI.
[0041] 1. User registration and information entry
[0042] User: When using this system for the first time, the user accesses the platform and opens the page to create an account. The user enters their name, email address, preferred educational institution, and current academic level (e.g., mathematics, English, etc.), and presses the registration button. This allows the user's basic information to be collected.
[0043] Terminal: The entered information is sent to the server via the terminal.
[0044] 2. Creating an individual curriculum
[0045] Server: Based on the received user information, the server uses an AI module to generate a personalized curriculum for each specific user, customized based on the user's desired educational institution entrance exam trends and current academic level.
[0046] Terminal: The generated individual curriculum is displayed to the user via the terminal, allowing the user to proceed with their studies according to the curriculum.
[0047] 3. Automatic question generation
[0048] Server: The AI module installed on the server automatically generates new questions based on past exam questions and question trends from the educational institution the user is applying to. This problem generation function allows users to tackle the latest questions.
[0049] Terminal: The automatically generated questions are provided to the user via the terminal, where the user can answer them.
[0050] 4. Answer entry and feedback
[0051] User: Enters the answer to the provided question and presses the submit button. The entered answer is sent to the server via the terminal.
[0052] Server: The server checks the answers received and determines whether they are correct. Using an AI module, it generates real-time feedback and provides it to the user. This feedback allows the user to check their understanding and further their learning.
[0053] Terminal: Feedback is displayed to the user via the terminal.
[0054] 5. Progress Management and Analysis
[0055] Server: Stores the user's answer history in a database and analyzes the user's learning progress based on this. It uses an AI module to identify areas that the user needs to improve and generate further learning advice.
[0056] Device: Progress analysis results are displayed to users via their device, allowing them to understand their learning progress in real time and plan their learning accordingly.
[0057] 6. Knowledge Sharing Community
[0058] Users can join the knowledge-sharing community on the platform and exchange information and advice with other test-takers, which not only helps users deepen their own knowledge but also helps them stay motivated by learning together with other test-takers.
[0059] Device: Through the community feature, users can post and receive feedback from other users.
[0060] Server: Manages posts and comments within the community and provides users with appropriate information as needed.
[0061] Specific examples
[0062] For example, if a user selects the University of Tokyo as their preferred university, the following will occur:
[0063] User: Access the platform, select the University of Tokyo as their preferred university, enter their current academic level in English, mathematics (Math III), etc., and register.
[0064] Device: Sends registration information to the server.
[0065] Server: Based on the received information, the AI generates an individual curriculum and provides a learning plan suited to the user. It also automatically generates new questions based on past questions and question trends from the University of Tokyo and provides them to the user via their device.
[0066] User: Enters answers to the questions provided and submits them to the server.
[0067] Server: Checks answers, generates real-time feedback and provides it to users via their devices. It also analyzes users' answer history to identify progress and areas for improvement.
[0068] Users: Study based on the feedback provided and share information with other test takers in the community.
[0069] In this way, the system based on the present invention enables users to efficiently prepare for university entrance exams through individually customized study plans and questions, real-time feedback, progress management, and a knowledge-sharing community.
[0070] The processing flow will be explained below.
[0071] Step 1:
[0072] User: Access the platform and enter your name, email address, desired educational institution, and current academic level (e.g., mathematics, English, etc.) on the account creation page, then press the registration button.
[0073] Step 2:
[0074] Terminal: Sends the entered information to the server. If the transmission to the server is successful, displays a confirmation message to the user.
[0075] Step 3:
[0076] Server: Stores the received user information in a database and sends a confirmation message to the device that the information has been saved.
[0077] Step 4:
[0078] Server: Based on the saved user information, an AI module is used to generate an individual curriculum, which is customized according to the entrance exam trends and academic ability level of the educational institution the user wishes to attend.
[0079] Step 5:
[0080] Device: The generated individual curriculum is displayed to the user, who then proceeds with their studies based on the curriculum.
[0081] Step 6:
[0082] Server: Generates automatically generated past exam questions using an AI module based on the question trends of the educational institution the user is applying to.
[0083] Step 7:
[0084] Terminal: Automatically generated past questions are displayed to the user, who then works on the questions.
[0085] Step 8:
[0086] User: Enters the answer to the provided question and presses the submit button. The answer is sent to the server via the terminal.
[0087] Step 9:
[0088] Server: Compares the received answers with a database of correct answers and generates real-time feedback. Feedback is automatically generated based on the user's input.
[0089] Step 10:
[0090] Terminal: Feedback is displayed to the user, who can review the feedback and deepen their understanding.
[0091] Step 11:
[0092] Server: Stores the user's answer history in a database and manages and analyzes the progress using an AI module, thereby identifying areas where the user needs to improve.
[0093] Step 12:
[0094] Device: Progress management and analysis results are displayed to the user, allowing the user to check their own learning progress and take necessary measures.
[0095] Step 13:
[0096] Users: Access knowledge sharing communities to share study tips and advice with other test takers. Gain more insight through posts and comments.
[0097] Step 14:
[0098] Server: Manage posts and comments within the community, moderate them as needed, and help ensure the right information is shared.
[0099] Step 15:
[0100] On your device: Show users the latest community posts and comments. Users can use the community feature to interact with other test-takers.
[0101] Through the above process, the system based on the present invention enables users to study efficiently through individually customized study plans and automatically generated past questions, and maximizes overall learning effectiveness through real-time feedback, progress management, and community interaction.
[0102] Example 1
[0103] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0104] Conventional learning support systems often lack the ability to customize to meet the individual learning needs of each user, and instead provide a standardized learning method. As a result, users' learning efficiency and motivation decline, and it becomes difficult to manage individual progress and identify areas for improvement. In addition, real-time feedback functions are limited, making it difficult for users to immediately correct their learning direction.
[0105] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0106] In this invention, the server includes: means for inputting and registering information such as the user's desired educational institution and current academic level; means including a generative AI model for generating an individual curriculum based on the input and registered user information; means including a computer device for automatically generating questions based on the user's desired educational institution and level; means for the user to input answers to the questions provided; means including a computer device for receiving the user's answers, determining whether they are correct, and generating feedback in real time; means for analyzing the user's learning progress, identifying areas for improvement, analyzing the answer data based on the user's past answer history, and visualizing the learning progress; and means for the user to share information with other test-takers in a knowledge-sharing community. This enables customized learning according to individual learning needs, and significantly improves user learning efficiency by enhancing real-time feedback and progress management.
[0107] "User" refers to an individual who uses this system to learn.
[0108] "Educational institution" refers to an organization such as a school or university to which the user aspires.
[0109] "Academic ability level" refers to a numerical value or evaluation that indicates the user's current level of understanding and knowledge in each subject (e.g., mathematics, English, etc.).
[0110] "Individual curriculum" refers to a customized study plan based on the entrance exam trends of the educational institution the user wishes to attend and their current academic level.
[0111] "Generative AI models" refer to artificial intelligence technology that generates curriculum and questions based on user information. Specifically, they use algorithms for natural language processing and machine learning.
[0112] "Computer device" refers to a computer system or part thereof that performs various calculations and data processing.
[0113] "Real-time feedback" refers to the immediate evaluation and advice that users receive immediately after answering a question.
[0114] "Learning progress" refers to an indicator that shows how much understanding a user has gained as they progress through their studies and how close they are to achieving their goals.
[0115] "Improvement points" refer to the learning content or skills that users need to focus on improving or strengthening through further study.
[0116] "Answer history" refers to data that records the results and process of all questions that a user has answered within the system.
[0117] A "knowledge sharing community" refers to an online forum for exchanging information and advice with other users of the system.
[0118] An embodiment of a system according to the present invention is described in detail below: The invention provides individually customized study plans and past exam questions for university entrance exam candidates.
[0119] The system begins with users accessing the learning platform, creating an account, and registering their academic ability information. Next, it uses a generative AI model to generate a personalized curriculum optimized for the user, including the automatic generation of questions. It then receives answers from users, provides real-time feedback, analyzes their progress, and identifies areas for improvement. Finally, users can exchange information with other test-takers in a knowledge-sharing community.
[0120] Hardware / Software Configuration
[0121] server:
[0122] 1. Database: A database such as MySQL is used to store user information, answer history, and progress data.
[0123] 2. Generative AI models: Generative AI models such as OpenAI GPT-3 are used to generate individualized curricula and automatically generate questions.
[0124] 3. Feedback module: Uses an AI module to receive the user's answers and generate feedback in real time.
[0125] 4. Progress Analysis Module: Uses data analysis tools to analyze users' learning progress and identify areas for improvement.
[0126] Device:
[0127] 1. User Interface: Provides an interface for users to enter information and answer questions, typically in the form of a web browser or mobile app.
[0128] 2. Display module: displays the curriculum, questions, feedback, and progress data sent from the server.
[0129] user:
[0130] 1. Enter information: The user enters their name, email address, preferred educational institution, and current academic level into the input fields on the device.
[0131] 2. Answering questions: The user enters answers to the provided learning questions and submits them via the terminal.
[0132] 3. Receiving feedback: The feedback sent from the server is checked through the display module on the device, and the learning course is corrected.
[0133] 4. Knowledge sharing: Use the community feature to share information with other users.
[0134] Examples of concrete examples and prompts
[0135] For example, if a user selects "University A" as the university of choice and enters "Mathematics (Math III)" and "English" as their current academic level, the following processing will occur.
[0136] Example prompt sentence:
[0137] 1. When registering as a user: "Please enter the educational institution you wish to apply to and your current academic level."
[0138] 2. When generating a curriculum: "Generate a personalized curriculum based on the academic level and desired educational institution you enter."
[0139] 3. When automatically generating questions: "Please generate new questions based on past questions and question trends from University A."
[0140] 4. When generating feedback: "Check the user's answers and generate feedback in real time."
[0141] The system allows users to work on customized study curriculums and questions based on the entrance exam trends of their desired universities, and improves study efficiency by receiving real-time feedback. It also allows users to study while exchanging information with other test-takers through progress visualization and a knowledge-sharing community.
[0142] As described above, the system of the present invention provides each user with an optimized learning experience, realizing effective learning support that meets individual needs.
[0143] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0144] Step 1: User Access and Account Creation
[0145] User: Visits the system's website or app, opens the account creation page, and enters their name, email address, preferred educational institution, and current academic level.
[0146] Input: Name, email address, desired educational institution, current academic level
[0147] Output: Information entered by the user
[0148] Specific operation: When the user presses the registration button, the input information is sent from the device to the server.
[0149] Step 2: Send and store user information
[0150] Device: Sends user input information to the server via an API request.
[0151] Server: Stores the received user information in a database.
[0152] Input: Information entered by the user
[0153] Output: User information stored in the database
[0154] Specific operation: The server receives the user information and stores it in a database such as MySQL.
[0155] Step 3: Create an individual curriculum
[0156] Server: Retrieves user information from a database and passes it as input to a generative AI model (e.g., OpenAI GPT-3).
[0157] Input: User information retrieved from the database
[0158] Output: Generated individual curriculum
[0159] How it works: The AI model generates a customized curriculum based on the user's academic level and preferred educational institution data, and sends it to the user's device.
[0160] Step 4: Submit and view the curriculum
[0161] Server: Sends the generated individual curriculum to the user's device.
[0162] Terminal: Display the received curriculum on the screen.
[0163] Input: Generated individual curriculum
[0164] Output: Individual curriculum displayed on the device
[0165] Specific behavior: The user progresses through the learning process based on the curriculum.
[0166] Step 5: Automatic question generation
[0167] Server: New questions are generated using a generative AI model based on the user's learning progress and past exam data from the educational institution of their choice.
[0168] Input: User's learning progress data, past exam data from the educational institution of choice
[0169] Output: New automatically generated questions
[0170] Specific operation: The AI model analyzes past exam data, generates new questions, and sends them to the device.
[0171] Step 6: Submit and view the issue
[0172] Server: Sends the generated new questions to the user's device.
[0173] Terminal: Displays received questions on the screen.
[0174] Input: The new question to be generated
[0175] Output: The problem displayed on the terminal
[0176] Specific behavior: The user answers the displayed question.
[0177] Step 7: Enter your answers
[0178] User: Enter the answer to the displayed question and press the submit button.
[0179] Input: Answer to the question
[0180] Output: Submitted answer data
[0181] Specific operation: The user's answer data is sent to the server via the device.
[0182] Step 8: Submitting and judging your answers
[0183] Terminal: Sends the user's answer data to the server.
[0184] Server: The AI module analyzes the received answer data and determines whether it is correct or incorrect.
[0185] Input: Submitted answer data
[0186] Output: Correctness of the answer
[0187] Specific operation: The AI module analyzes the answer and determines whether it is correct or incorrect.
[0188] Step 9: Generate and submit feedback
[0189] Server: Generates real-time feedback based on the correctness of the answers.
[0190] Input: Correct / incorrect answer result
[0191] Output: Generated real-time feedback
[0192] Specific operation: The server generates feedback including the percentage of correct answers, explanations, and further study advice, and sends it to the device.
[0193] Step 10: View feedback
[0194] Terminal: Display received feedback to the user.
[0195] Input: Generated real-time feedback
[0196] Output: Feedback displayed on the terminal
[0197] What happens: Users use the feedback to make course corrections.
[0198] Step 11: Track your progress and focus
[0199] Server: Analyzes progress data based on the user's answer history and identifies areas for improvement.
[0200] Input: Answer history data
[0201] Output: Progress data and identified areas for improvement
[0202] Specific operation: The server sends progress data and enhancement points to the user's device.
[0203] Step 12: Viewing your progress and improvement points
[0204] Terminal: Displays progress data and enhancement points on the screen.
[0205] Input: Progress data and identified areas for improvement
[0206] Output: Progress data and improvement points displayed on the terminal
[0207] Specific action: The user uses this to revise their study plan.
[0208] Step 13: Join a knowledge sharing community
[0209] Users: Use the community feature to exchange information and advice with other test takers.
[0210] Input: Post content, comment
[0211] Output: Share information with other users, feedback
[0212] What it does: Users post questions and experiences and receive comments and advice from other users.
[0213] The above is a detailed flow of program processing in this system.
[0214] (Application example 1)
[0215] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0216] In recent years, the learning needs of university entrance exam candidates have become more diverse, requiring individually customized study plans and questions based on the latest exam trends. However, manually creating individual curricula, providing real-time feedback on question answers, and efficiently managing progress are extremely difficult, making it difficult to provide the efficient learning environment that test takers require. Furthermore, knowledge sharing and information exchange with other test takers are also important elements, but no system exists that can consistently provide these. To solve these problems, a system that provides individually customized study plans using generative AI is needed.
[0217] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0218] In this invention, the server includes: means for inputting and registering information such as the user's desired educational institution and current academic level; means including a computer device for generating an individualized curriculum based on the inputted and registered user information; means including a computer device for automatically generating questions based on the user's desired educational institution and level; means for the user to input answers to the provided questions; means including a computer device for receiving the user's answers, determining whether they are correct, and generating feedback in real time; means including a computer device for analyzing the user's learning progress and identifying areas for improvement; means for the user to share information with other test takers in a knowledge sharing community; communication means for transmitting user information and answer data from the terminal to the server; means for providing the individualized curriculum and automatically generated questions based on the generative AI model to the user terminal; and means for generating prompts to input to the generative AI model. This dramatically improves the efficiency and effectiveness of university entrance exam preparation and enables test takers to easily use a study plan that is tailored to them.
[0219] The "desired educational institution" is an educational institution such as a university or vocational school that the user wishes to enroll in.
[0220] "Current academic level" is an indicator that shows the user's level of understanding and proficiency in each subject.
[0221] "Means for input / registration" refers to an interface that allows users to provide the system with information such as their desired educational institution and academic level.
[0222] An "individualized curriculum" is a customized learning plan based on the user's goals and current academic ability.
[0223] A "computer device" is a device that includes hardware and software for performing data processing and calculations.
[0224] "Automatically generating questions" means that the system automatically creates new questions based on past questions and question trends.
[0225] "Means for inputting answers" refers to an interface that allows a user to input answers to questions into the system.
[0226] "Determine correctness and generate feedback in real time" means instantly determining whether a user's answer is correct or incorrect and providing immediate evaluation and advice.
[0227] "Analyzing learning progress and identifying areas for improvement" means analyzing the user's learning data and identifying areas that need particular focus and weak points.
[0228] A "knowledge sharing community" is an online platform where users can exchange information and advice with each other.
[0229] "Communication means" means the technical means for transmitting and receiving information and data between a user terminal and a server.
[0230] A "generative AI model" is an algorithm that uses artificial intelligence to create individual curricula and automatically generated questions.
[0231] A "means for generating prompt sentences" is a method or device that creates input sentences to instruct a generative AI model.
[0232] A "user terminal" is a device (smartphone, tablet, PC, etc.) that a user uses to access and operate the system.
[0233] This invention is a learning support system using generative AI for university entrance exam candidates. The system allows users to input and register information such as their desired educational institution and current academic level, generates an individual curriculum, and then automatically generates questions and provides feedback.
[0234] 1. Registration and information entry
[0235] User: When using the system for the first time, the user creates an account using the user interface (smartphone app or web browser). The user enters information such as their name, preferred educational institution, and current academic level to register in the system.
[0236] 2. Creating an individual curriculum
[0237] Server: Once the user's registration information is sent to the server, the server uses a generative AI model to generate an individual curriculum based on the user's information. This generative AI model analyzes past test data and question trends to provide an optimal study plan.
[0238] 3. Automatic question generation
[0239] Server: The server automatically generates new questions using a generative AI model, based on past questions and question trends from the educational institution of the student's choice. This problem generation function ensures that questions are always in line with the latest trends.
[0240] 4. Answers and Feedback
[0241] User: The user enters the answer to the provided question and submits it.
[0242] Server: The server receives the user's answer, uses a generative AI model to determine whether it is correct, and generates real-time feedback on the answer that is returned to the user. This feedback may include an explanation for the answer or suggested next steps.
[0243] 5. Progress Management and Analysis
[0244] Server: The user's answer history is stored in a database, and the generative AI model analyzes their learning progress based on this information. It provides advice based on the user's improvement points and level of understanding, and customizes the next learning step.
[0245] 6. Knowledge Sharing Community
[0246] Users: Users can join a knowledge-sharing community where they can exchange information with other test-takers. This community feature allows test-takers to share advice and information with each other.
[0247] Server: The server manages community posts and comments and provides appropriate information when needed.
[0248] Hardware and software used
[0249] Hardware: The servers use Amazon Web Services (AWS) and Google Cloud Platform (GCP) to provide computing resources, while users use devices such as smartphones and tablets.
[0250] Software: The server uses a Python and Flask web framework and OpenAI's generative AI models as an API.
[0251] Examples and prompts
[0252] Examples:
[0253] If a user is applying to a university in Tokyo and enters their current academic level as "Mathematics: Intermediate, English: Advanced," the server will send the following prompt to the generative AI model.
[0254] Example prompt sentence:
[0255] For curriculum generation: "Generate an individual curriculum based on user information: {'University of choice': 'University in Tokyo', 'Academic level': {'Mathematics': 'Intermediate', 'English': 'Advanced'}}."
[0256] For question generation: "Please create new questions based on past questions and question trends. I am applying to a university in Tokyo."
[0257] This system allows users to prepare for university entrance exams efficiently and effectively.
[0258] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0259] Program processing flow
[0260] Step 1: User registration and information entry
[0261] user:
[0262] A user accesses the system and creates an account by entering the following information: name, email address, desired educational institution, and current academic level. The user enters this information and presses the "Register" button.
[0263] Input: Name, email address, preferred educational institution, current academic level
[0264] Output: User information sent to the server
[0265] Step 2: Creating an individual curriculum
[0266] server:
[0267] Based on the received user information, the server sends prompts to the generative AI model to generate an individual curriculum.
[0268] Input: User information
[0269] Prompt: "Generate a personalized curriculum for your desired university based on your user information: {user information}."
[0270] Output: Individual curriculum
[0271] Step 3: Providing an individualized curriculum
[0272] server:
[0273] The generated individual curriculum is sent to the user's terminal.
[0274] Input: Individualized Curriculum
[0275] Output: Individual curriculum displayed on the user's device
[0276] Step 4: Automatic question generation
[0277] server:
[0278] Based on past questions and question trends from the educational institution of interest, prompts are sent to a generative AI model to generate new questions.
[0279] Input: Information about the educational institution you are applying to
[0280] Prompt: "Based on past exam questions and exam trends, please create a new question for your desired university: {your desired educational institution}."
[0281] Output: New problem
[0282] Step 5: Submit the problem
[0283] server:
[0284] The generated questions are sent to the user's device.
[0285] Input: New problem
[0286] Output: The new problem displayed on the user's terminal
[0287] Step 6: Enter your answers
[0288] user:
[0289] The user enters the answer to the provided question and presses the submit button.
[0290] Input: Answer
[0291] Output: Answer data sent to the server
[0292] Step 7: Validate the answer and generate feedback
[0293] server:
[0294] Based on the received answer data, a generative AI model is used to determine whether the answer is correct or incorrect, and feedback is generated in real time.
[0295] Input: Answer data
[0296] Output: Feedback
[0297] Step 8: Provide feedback
[0298] server:
[0299] The generated feedback is sent to the user device.
[0300] Input: Feedback
[0301] Output: Feedback displayed on the user's terminal
[0302] Step 9: Track and analyze progress
[0303] server:
[0304] The user's answer history is stored in a database, and a generative AI model is used to analyze progress and identify areas for improvement.
[0305] Input: Answer history
[0306] Output: Improvement points and next steps
[0307] Step 10: Provide progress updates
[0308] server:
[0309] The analysis results and points for improvement are sent to the user's device.
[0310] Input: Analysis results, improvement points
[0311] Output: Progress information displayed on the user's terminal
[0312] Step 11: Knowledge Sharing Community
[0313] user:
[0314] Exchange information with other test takers registered in the system.
[0315] Input: Community posts and comments
[0316] Output: Knowledge and information shared within the community
[0317] Step 12: Managing Your Community
[0318] server:
[0319] Moderate posts and comments within the community and provide appropriate information.
[0320] Input: Community data
[0321] Output: Providing appropriate information and community management
[0322] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0323] The embodiments for implementing the system according to the present invention are as follows: In particular, by combining an emotion engine that recognizes the user's emotions, a more efficient and effective learning experience is provided.
[0324] 1. User registration and information entry
[0325] User: When accessing the system for the first time, users enter their name, email address, preferred educational institution, and current academic level (e.g., mathematics, English, etc.) on the account creation page and press the registration button. Registration information also includes basic data for identifying emotions, such as the user's facial expressions and voice data.
[0326] Terminal: Sends the entered information to the server.
[0327] 2. Creating an individual curriculum
[0328] Server: Based on the received user information and emotional data, the AI module generates an individualized curriculum for the specific user. The individualized curriculum is customized based on the user's desired educational institution entrance exam trends, academic level, and current emotional state.
[0329] Terminal: Displays the generated personalized curriculum to the user.
[0330] 3. Automatic question generation
[0331] Server: Using an AI module, it automatically generates past exam questions based on the trends and level of the educational institution the user is applying to, taking into account the user's emotional data and adjusting the difficulty of the questions as necessary.
[0332] Terminal: Automatically generated past questions are displayed to the user.
[0333] 4. Answer entry and feedback
[0334] User: Enters the answer to the provided question and presses the submit button. The answer is sent to the server via the terminal.
[0335] Server: Checks answers against a database of correct answers and generates real-time feedback, taking into account the user's emotional data to provide feedback with the appropriate tone and content.
[0336] Terminal: Display feedback to the user.
[0337] 5. Progress Management and Analysis
[0338] Server: Stores the user's answer history in a database, manages progress and analyzes it along with emotional data, and uses an AI module to identify areas where the user needs to improve.
[0339] Terminal: Progress analysis results are displayed to the user via the terminal.
[0340] 6. Knowledge Sharing Community
[0341] Users: Join the knowledge-sharing community on the platform to exchange information and advice with other test-takers, and an emotion engine supports interactions within the community.
[0342] Device: Through the community feature, users can post and receive feedback from other users.
[0343] Server: Manages posts and comments within the community and provides users with appropriate information as needed.
[0344] Specific examples
[0345] For example, if a user selects "Example University" as their preferred university, the results will be as follows:
[0346] 1. User registration and information entry
[0347] User: Access the platform, select the "example university" as the university of choice, and register by entering their current academic level (e.g., intermediate English, advanced mathematics) and emotional data via facial expressions and voice.
[0348] Device: Sends registration information to the server.
[0349] 2. Creating an individual curriculum
[0350] Server: Based on the received information, the AI generates an individual curriculum and provides a learning plan suited to the user. It also takes into account the user's emotional data and adjusts the curriculum to the appropriate level of difficulty and pace.
[0351] Device: Display the learning plan to the user.
[0352] 3. Automatic question generation
[0353] Server: Recognizes the user's emotional state from facial expressions and voice data, and generates past questions with adjusted difficulty to match the user's emotions.
[0354] Terminal: Provides study questions to users.
[0355] 4. Answer entry and feedback
[0356] User: Answers the questions provided and submits them to the server.
[0357] Server: Checks answers and provides real-time feedback. Feedback content and tone are adjusted based on the user's emotional data.
[0358] Terminal: Display feedback to the user.
[0359] 5. Progress Management and Analysis
[0360] Server: Based on the user's answer history and emotional data, the server analyzes the user's progress in detail and identifies areas where the user needs to improve.
[0361] Terminal: Display progress to the user.
[0362] 6. Knowledge Sharing Community
[0363] Users: Exchange information with other test takers and use the emotion engine to facilitate smooth interactions within the community.
[0364] Device: View posts and comments within the community and encourage interaction with other users.
[0365] In this way, the system according to the present invention can provide a more personalized learning experience by recognizing the user's emotions and incorporating them into adjustments to the learning plan and feedback.
[0366] The processing flow will be explained below.
[0367] Step 1:
[0368] User: Access the platform and enter your name, email address, desired educational institution, current academic level (e.g., mathematics, English, etc.), and facial and voice data on the account creation page, then press the registration button.
[0369] Step 2:
[0370] Terminal: Sends the entered information to the server. If the transmission to the server is successful, displays a confirmation message to the user.
[0371] Step 3:
[0372] Server: Stores the received user information and emotion data in a database. Sends a confirmation message to the device that the data has been saved.
[0373] Step 4:
[0374] Server: Based on the stored user information and emotional data, an AI module is used to generate a personalized curriculum, which is customized based on the user's desired educational institution entrance exam trends, academic level, and current emotional state.
[0375] Step 5:
[0376] Device: The generated individual curriculum is displayed to the user, who then proceeds with their studies based on the curriculum.
[0377] Step 6:
[0378] Server: Based on the question trends of the educational institution the user is applying to, the server uses an AI module to automatically generate past exam questions, taking into account the user's emotional data and adjusting the difficulty of the questions as necessary.
[0379] Step 7:
[0380] Terminal: Automatically generated past questions are displayed to the user, who then works on the questions.
[0381] Step 8:
[0382] User: Enters the answer to the provided question and presses the submit button. The answer is sent to the server via the terminal.
[0383] Step 9:
[0384] Server: Compares the received answers with a database of correct answers and generates feedback in real time. The server also takes into account the user's emotional data to provide appropriate feedback in terms of content and tone.
[0385] Step 10:
[0386] Terminal: Feedback is displayed to the user, who can review the feedback and deepen their understanding.
[0387] Step 11:
[0388] Server: Stores the user's answer history and emotional data in a database, and manages and analyzes the progress using an AI module, thereby identifying areas where the user needs to improve.
[0389] Step 12:
[0390] Device: Progress management and analysis results are displayed to the user, allowing the user to check their own learning progress and take necessary measures.
[0391] Step 13:
[0392] Users: Access knowledge sharing communities to share learning information and advice with other test-takers, and use an emotion engine to support interactions within the community.
[0393] Step 14:
[0394] Server: Analyzes posts and comments within the community using an emotion engine and provides appropriate feedback, thereby providing support that takes into account the user's emotions.
[0395] Step 15:
[0396] On your device: Show users the latest community posts and comments. Users can use the community feature to interact with other test-takers.
[0397] Through the above process, the system based on the present invention enables users to study efficiently through individually customized study plans and automatically generated past questions, and maximizes overall learning effectiveness through real-time feedback, progress management, and community interaction. Furthermore, by using an emotion engine, it provides a learning experience that takes users' emotions into consideration.
[0398] Example 2
[0399] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0400] While conventional learning support systems can provide a curriculum based on a user's learning progress and preferred educational institution, they lack the ability to provide a personalized learning experience that takes into account the user's emotional state. Furthermore, they do not provide feedback that appropriately reflects the user's emotional state during the learning process, nor do they provide questions with difficulty levels that are adjusted according to the user's emotions. As a result, improvements in learning efficiency and motivation cannot be expected. Furthermore, knowledge-sharing communities lacked interaction support based on emotional state, which led to a decline in the quality of communication between users.
[0401] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0402] In this invention, the server includes: means for collecting a user's facial expression data and voice data and identifying emotional data; means including a computer device for generating an individual curriculum based on the input and registered user information and emotional data; and means including a computer device for automatically generating questions based on the trends and level of the educational institution the user is aiming for, and adjusting the difficulty level by taking the user's emotional data into consideration. This makes it possible to generate an individual curriculum and provide questions that take the user's emotional state into consideration, and to adjust the tone and content of feedback according to the user's emotional state. Furthermore, by supporting interactions in knowledge sharing communities using an emotional engine, communication between users can be facilitated, which is expected to improve the quality of learning and motivation.
[0403] "User information" refers to data such as the user's personal information, academic level, and preferred educational institution that is entered into the learning system.
[0404] "Emotional data" refers to data that represents a user's psychological or emotional state obtained from facial expressions and voice analysis.
[0405] "Individualized curriculum" refers to a customized learning plan based on the user's academic level, the requirements of the educational institution of their choice, and their emotional state.
[0406] "Computer device" refers to a computer system or hardware that performs various calculation processes based on user information and emotional data.
[0407] "Auto-generation" refers to the process of using AI modules or algorithms to create specific data (here, questions or curriculum) without human intervention.
[0408] "Feedback" refers to the correctness or incorrectness of the answers entered by the user and advice provided in real time.
[0409] "Progress management" is the process of tracking a user's learning progress and grade changes and identifying areas that need improvement.
[0410] A "knowledge sharing community" is an online forum or platform where candidates and learners can come together to exchange information and advice.
[0411] An "emotion engine" is an algorithm or software that analyzes a user's emotional data and appropriately adjusts interactions based on that data.
[0412] The system based on the present invention aims to utilize user emotional data to personalize the entire learning process, from generating an individual curriculum to providing questions, feedback, progress management, and a knowledge sharing community.
[0413] User registration and information entry
[0414] When a user first accesses the platform, they enter their name, email address, preferred educational institution, and current academic level (e.g., math, English) on the account creation page. The device also uses a camera and microphone to collect facial and voice data, which is then saved as emotion data. The device then packages this information and data and sends it to the server. The server then stores the received information in a database and notifies the user that registration is complete.
[0415] Creating an individual curriculum
[0416] The server uses an AI module to analyze the stored user information and emotional data. This AI module takes into account the user's entrance exam trends, academic level, and emotional state to generate an individualized learning plan. The generated curriculum includes optimal learning content and progress pace and is displayed to the user via their device.
[0417] Automatic question generation
[0418] The server uses an AI model to automatically generate past exam questions tailored to the trends and level of the educational institution the user is applying to. It also takes into account the user's emotional data and adjusts the difficulty of the questions as needed. The generated questions are then provided to the user via their device.
[0419] Answer entry and feedback
[0420] When a user enters an answer to a given question and presses the submit button, the answer data is sent to the server via the device. The server compares the received answer with a database of correct answers and generates feedback in real time. The feedback takes into account the user's emotional data and adjusts the tone and content appropriately. This feedback information is displayed to the user via the device.
[0421] Progress management and analysis
[0422] The server stores the user's answer history and emotional data in a database, and manages and analyzes their progress. The AI module analyzes this data, identifies areas where the user needs to improve, and generates advice based on that. The analysis results are displayed to the user via their device.
[0423] Knowledge Sharing Community
[0424] Users can join the knowledge-sharing community on the platform and exchange information and advice with other test-takers. An emotion engine supports smooth interactions with posts and comments within the community. The device displays community posts and comments, encouraging interaction with other users.
[0425] Examples of concrete examples and prompts
[0426] For example, if a user is applying to "Example University" and has set their current academic level as intermediate in English and advanced in mathematics, they would input the following prompt sentence into the generative AI model.
[0427] "Please write AI code that allows a user to select the 'example university' as their preferred university, set their current academic level as intermediate in English and advanced in mathematics, and generate an individualized curriculum based on that."
[0428] In this way, the system based on the present invention realizes advanced personalization that utilizes the user's emotional data, thereby maximizing the learning experience.
[0429] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0430] Step 1:
[0431] User registration and information entry
[0432] When a user first accesses the system, they enter their name, email address, preferred educational institution, and current academic level on the account creation page. The system also uses a camera and microphone to collect facial expression and voice data, and the input information registered as emotion data includes text and multimedia data.
[0433] Terminal: Packages input information and sends it to the server. Specifically, it bundles text and multimedia files entered in web forms or smartphone apps into a single request and sends it using the HTTP protocol.
[0434] Step 2:
[0435] Receiving and storing information
[0436] Server: The received user information and emotion data are stored in a database. Furthermore, the server generates user identification information based on the stored data and sends a confirmation email. The received data includes the user's personal information, academic achievement information, and emotion data. This data is stored in a database management system such as MySQL or PostgreSQL.
[0437] Step 3:
[0438] Creating an individual curriculum
[0439] Server: Analyzes the stored user information and emotional data and generates an individualized curriculum using a specific algorithm. Specifically, a machine learning model (using, for example, TensorFlow or PyTorch) is used to customize a learning plan based on the user's academic level and the trends of the educational institution they wish to attend. Emotional data is also input into the AI model to adjust the difficulty and pace of the lesson. The generated curriculum is sent to the device in JSON format.
[0440] Step 4:
[0441] View Curriculum
[0442] Device: The device displays the received personalized curriculum to the user. The curriculum is rendered as a user interface using HTML and CSS, and interactive elements are added using JavaScript as needed, allowing the user to see the learning plan that best suits them.
[0443] Step 5:
[0444] Automatic question generation
[0445] Server: Using an AI model, past exam questions are generated that are tailored to the trends and level of the educational institution the user is applying to. Emotional data is also taken into account to adjust the difficulty of the questions. The generated questions are then converted back into JSON format and sent to the device. Specifically, the AI model references a database of past entrance exam questions and constructs questions based on specific rules.
[0446] Step 6:
[0447] Displaying past questions
[0448] Terminal: The generated past questions are displayed to the user. The questions are dynamically rendered using JavaScript using HTML templates. Specific instructions for entering answers are also displayed.
[0449] Step 7:
[0450] Enter and submit your answers
[0451] User: Enters the answer to the provided question and presses the submit button. The answer is sent in text format to the server via the terminal. Specifically, when the user enters the answer in the input form and presses the submit button, the data is sent to the server as an HTTP request using JavaScript.
[0452] Step 8:
[0453] Receiving answers and feedback
[0454] Server: Compares the received answers with a database of correct answers and generates real-time feedback using an AI model. It takes into account emotional data and adjusts the tone and content of the feedback. Feedback based on the comparison results is generated in JSON format and sent to the device.
[0455] Step 9:
[0456] View Feedback
[0457] Device: Displays feedback information to the user. The display is done using HTML and CSS, and the content and tone of the feedback are adjusted based on the user's emotional state. Specifically, it parses the feedback data in JSON format, inserts it into an HTML template, and displays it.
[0458] Step 10:
[0459] Progress management and analysis
[0460] Server: Stores the user's answer history and sentiment data in a database, and manages and analyzes their progress. It uses AI models to identify the user's weaknesses and areas for improvement, and adjusts their learning plan accordingly. Specifically, it periodically analyzes the stored data and updates the individual curriculum and learning advice based on the results.
[0461] Step 11:
[0462] View progress results
[0463] Device: Receives the analysis results and displays them to the user. The user can check their progress and understand what they are being evaluated on and what they should study next. The analysis results are displayed visually in an easy-to-understand manner using HTML and CSS.
[0464] Step 12:
[0465] Join our knowledge sharing community
[0466] Users: Join the knowledge-sharing community on the platform and exchange information and advice with other test-takers. An emotion engine supports user-to-user interactions. Posts and comments are in text format, and the interface is rendered using HTML and JavaScript.
[0467] Step 13:
[0468] Community Management
[0469] Server: Moderates posts and comments within the community and provides appropriate information to users when necessary. This includes filtering inappropriate posts. It also uses AI models to support positive interactions based on sentiment data.
[0470] (Application example 2)
[0471] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0472] Conventional learning systems lack the ability to recognize users' emotions in real time and optimize learning content and feedback based on that. Furthermore, virtual shopping environments lack product recommendations and customer service that take user emotions into account, leaving a need for improved user experience. Given this situation, it is necessary to develop a system that recognizes users' emotions in real time and provides personalized learning and shopping experiences accordingly.
[0473] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0474] In this invention, the server includes: means for inputting and registering information such as the user's desired educational institution and current academic level; means including a computer device for generating an individual curriculum based on the inputted and registered user information; means including a computer device for automatically generating questions based on the user's desired educational institution and level; means for the user to input answers to the provided questions; means including a computer device for receiving the user's answers, determining whether they are correct or incorrect, and generating feedback in real time; means including a computer device for analyzing the user's learning progress and identifying areas for improvement; means for the user to share information with other test takers in a knowledge-sharing community; and means for recognizing the user's emotions in real time and providing personalized product suggestions and customer service, thereby enabling a personalized learning and virtual shopping experience based on the user's emotions.
[0475] "User" means an individual who uses the system to learn or shop.
[0476] "Educational institution" refers to a place of learning such as a school, university, or vocational school that the user wishes to attend.
[0477] "Academic level" refers to a number or rating entered by the user that indicates the current level of knowledge and skill in each subject.
[0478] "Individual Curriculum" refers to a customized learning plan generated based on the characteristics of the educational institution the user is interested in, as well as the user's academic level and emotional data.
[0479] "Emotional data" refers to information that indicates the emotional state of the user, obtained from facial expressions, voice, etc.
[0480] "Computer equipment" means a device that includes hardware and software for inputting and registering information, generating individualized curriculum, automatically generating questions, analyzing answers, providing real-time feedback, and analyzing progress.
[0481] "Automatic question generation" refers to the process of using an AI module to generate appropriate study questions based on the trends and academic level of the educational institution the user is applying to.
[0482] "Answer" refers to the answer that a user enters in response to a given question.
[0483] "Feedback" refers to the evaluation and advice provided to users based on real-time judgment of whether their answers are correct or incorrect.
[0484] "Analyzing learning progress" refers to the process of identifying a user's learning progress and areas for improvement based on the user's answer history and sentiment data.
[0485] A "knowledge sharing community" is an online platform where users can exchange study information and advice with other test takers.
[0486] "Means for recognizing emotions in real time" refers to technology that analyzes a user's facial expressions and voice to instantly determine their current emotional state.
[0487] "Personalized product suggestions" refers to the process of recommending products that are suited to individual users based on their emotional data and purchasing history.
[0488] "Customer service" refers to the assistance and support provided to users by avatars and chatbots in virtual stores.
[0489] The embodiment of the system according to the present invention is as follows: In particular, to provide a learning system and a virtual shopping environment combined with an emotion engine, the system includes the following specific steps:
[0490] First, the user accesses the system and registers and enters information. The user enters their name, email address, favorite categories (learning or shopping), past progress and purchase history, and emotional data such as facial expressions and voice data. This information is then sent to the server via the device.
[0491] The server generates personalized curriculum and product recommendations based on the received user information and emotional data. In the case of the learning system, the personalized curriculum is customized based on the user's educational preference, academic level, and current emotional state. In the case of virtual shopping, product recommendations are made in real time based on the emotional data.
[0492] The generated individual curriculum and product suggestions are displayed to the user via their device, allowing them to have a personalized learning plan and shopping experience.
[0493] In the learning system, the server automatically generates questions based on the trends and level of the educational institution the user is applying to. The generated questions are then sent to the server, with the user entering the answers via their device. The server then judges the answers in real time and generates feedback. The content and tone of the feedback are adjusted based on the user's emotional data.
[0494] The server also stores the user's answer history and emotional data in a database. Based on the stored data, the server analyzes the user's learning progress and identifies areas that need improvement. The user is notified of the analysis results via their device.
[0495] In the knowledge sharing community, users can share information and advice with other test-takers and shoppers. The server manages posts and comments within the community and supports smooth interactions with an emotion engine.
[0496] For example, if a user is wearing smart glasses in a virtual shopping environment, the system will highlight related product suggestions if the user's facial expression indicates interest. Conversely, if the user indicates dissatisfaction, the system will suggest products in a different category. Furthermore, if the user gazes at a particular item for a long time, the system will automatically display reviews and detailed information related to that item.
[0497] The prompt sentences include the following:
[0498] "Capture facial expression data in real time while the user is wearing the glasses, perform sentiment analysis, and optimize product suggestions in the virtual store. Specifically, if the user expresses positive sentiment toward a certain product, immediately recommend related products. Also, if the user expresses negative sentiment, build a system that suggests products from a different category."
[0499] The system based on this invention uses cloud services such as TensorFlow, Amazon Web Services (AWS), and Google Cloud to analyze emotional data and provide customized learning plans and product recommendations, thereby enabling personalized learning and virtual shopping experiences based on the user's emotions.
[0500] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0501] Step 1:
[0502] The user accesses the system. They input their name, email address, favorite category (study or shopping), past progress and purchase history, and emotional data such as facial expressions and voice data, and send this data to the server from their device. The input data also includes the user's preferred educational institution and academic level.
[0503] Step 2:
[0504] The server analyzes the received user information and emotional data. Specifically, it uses an AI module to generate an individualized curriculum, taking into account the trends of the user's preferred educational institution and their academic level. The emotional data is also analyzed, and the difficulty and content of the curriculum are adjusted based on the user's current emotional state. The output is a customized learning plan or product recommendations.
[0505] Step 3:
[0506] The generated personalized curriculum and product suggestions are displayed to the user via their device. The user can then review the displayed curriculum and products. The displayed content reflects the user's emotional state in real time and dynamically changes according to the user's interests and dissatisfaction.
[0507] Step 4:
[0508] In the case of the learning system, the server automatically generates questions based on the trends of the educational institution the user is applying to and their academic level. Using past exam questions and mock test data, the AI module generates appropriate questions. Emotional data is also taken into account, and adjustments are made, such as lowering the difficulty of questions if the user is feeling stressed.
[0509] In the case of a shopping system, the server provides detailed information about a particular product and displays related product lists and promotional information.
[0510] Step 5:
[0511] The user enters the answer to the generated question and sends it to the server via their device. The server compares the answer with a database of correct answers and generates real-time feedback. This feedback is also adjusted based on the emotional data, and is presented to the user with an appropriate tone and content.
[0512] Step 6:
[0513] The server stores the user's answer history and emotional data in a database. The stored data is used to analyze the user's learning progress. This analysis includes the accuracy and speed of the user's answers, changes in their emotional state, etc. The progress is analyzed in detail to identify areas that need improvement.
[0514] Step 7:
[0515] In the knowledge sharing community, users can share information and advice with other test takers and shoppers. The terminal uses an emotion engine to support interactions within the community and improve the user experience. The server manages posts and comments within the community and provides users with appropriate information as needed.
[0516] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0517] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0518] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0519] [Second embodiment]
[0520] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0521] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0522] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0523] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0524] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0525] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0526] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0527] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0528] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0529] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0530] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0531] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0532] The embodiment of the system according to the present invention is as follows: This system is targeted at university entrance exam candidates and provides individually customized study plans and past exam questions using generative AI.
[0533] 1. User registration and information entry
[0534] User: When using this system for the first time, the user accesses the platform and opens the page to create an account. The user enters their name, email address, preferred educational institution, and current academic level (e.g., mathematics, English, etc.), and presses the registration button. This allows the user's basic information to be collected.
[0535] Terminal: The entered information is sent to the server via the terminal.
[0536] 2. Creating an individual curriculum
[0537] Server: Based on the received user information, the server uses an AI module to generate a personalized curriculum for each specific user, customized based on the user's desired educational institution entrance exam trends and current academic level.
[0538] Terminal: The generated individual curriculum is displayed to the user via the terminal, allowing the user to proceed with their studies according to the curriculum.
[0539] 3. Automatic question generation
[0540] Server: The AI module installed on the server automatically generates new questions based on past exam questions and question trends from the educational institution the user is applying to. This problem generation function allows users to tackle the latest questions.
[0541] Terminal: The automatically generated questions are provided to the user via the terminal, where the user can answer them.
[0542] 4. Answer entry and feedback
[0543] User: Enters the answer to the provided question and presses the submit button. The entered answer is sent to the server via the terminal.
[0544] Server: The server checks the answers received and determines whether they are correct. Using an AI module, it generates real-time feedback and provides it to the user. This feedback allows the user to check their understanding and further their learning.
[0545] Terminal: Feedback is displayed to the user via the terminal.
[0546] 5. Progress Management and Analysis
[0547] Server: Stores the user's answer history in a database and analyzes the user's learning progress based on this. It uses an AI module to identify areas that the user needs to improve and generate further learning advice.
[0548] Device: Progress analysis results are displayed to users via their device, allowing them to understand their learning progress in real time and plan their learning accordingly.
[0549] 6. Knowledge Sharing Community
[0550] Users can join the knowledge-sharing community on the platform and exchange information and advice with other test-takers, which not only helps users deepen their own knowledge but also helps them stay motivated by learning together with other test-takers.
[0551] Device: Through the community feature, users can post and receive feedback from other users.
[0552] Server: Manages posts and comments within the community and provides users with appropriate information as needed.
[0553] Specific examples
[0554] For example, if a user selects the University of Tokyo as their preferred university, the following will occur:
[0555] User: Access the platform, select the University of Tokyo as their preferred university, enter their current academic level in English, mathematics (Math III), etc., and register.
[0556] Device: Sends registration information to the server.
[0557] Server: Based on the received information, the AI generates an individual curriculum and provides a learning plan suited to the user. It also automatically generates new questions based on past questions and question trends from the University of Tokyo and provides them to the user via their device.
[0558] User: Enters answers to the questions provided and submits them to the server.
[0559] Server: Checks answers, generates real-time feedback and provides it to users via their devices. It also analyzes users' answer history to identify progress and areas for improvement.
[0560] Users: Study based on the feedback provided and share information with other test takers in the community.
[0561] In this way, the system based on the present invention enables users to efficiently prepare for university entrance exams through individually customized study plans and questions, real-time feedback, progress management, and a knowledge-sharing community.
[0562] The processing flow will be explained below.
[0563] Step 1:
[0564] User: Access the platform and enter your name, email address, desired educational institution, and current academic level (e.g., mathematics, English, etc.) on the account creation page, then press the registration button.
[0565] Step 2:
[0566] Terminal: Sends the entered information to the server. If the transmission to the server is successful, displays a confirmation message to the user.
[0567] Step 3:
[0568] Server: Stores the received user information in a database and sends a confirmation message to the device that the information has been saved.
[0569] Step 4:
[0570] Server: Based on the saved user information, an AI module is used to generate an individual curriculum, which is customized according to the entrance exam trends and academic ability level of the educational institution the user wishes to attend.
[0571] Step 5:
[0572] Device: The generated individual curriculum is displayed to the user, who then proceeds with their studies based on the curriculum.
[0573] Step 6:
[0574] Server: Generates automatically generated past exam questions using an AI module based on the question trends of the educational institution the user is applying to.
[0575] Step 7:
[0576] Terminal: Automatically generated past questions are displayed to the user, who then works on the questions.
[0577] Step 8:
[0578] User: Enters the answer to the provided question and presses the submit button. The answer is sent to the server via the terminal.
[0579] Step 9:
[0580] Server: Compares the received answers with a database of correct answers and generates real-time feedback. Feedback is automatically generated based on the user's input.
[0581] Step 10:
[0582] Terminal: Feedback is displayed to the user, who can review the feedback and deepen their understanding.
[0583] Step 11:
[0584] Server: Stores the user's answer history in a database and manages and analyzes the progress using an AI module, thereby identifying areas where the user needs to improve.
[0585] Step 12:
[0586] Device: Progress management and analysis results are displayed to the user, allowing the user to check their own learning progress and take necessary measures.
[0587] Step 13:
[0588] Users: Access knowledge sharing communities to share study tips and advice with other test takers. Gain more insight through posts and comments.
[0589] Step 14:
[0590] Server: Manage posts and comments within the community, moderate them as needed, and help ensure the right information is shared.
[0591] Step 15:
[0592] On your device: Show users the latest community posts and comments. Users can use the community feature to interact with other test-takers.
[0593] Through the above process, the system based on the present invention enables users to study efficiently through individually customized study plans and automatically generated past questions, and maximizes overall learning effectiveness through real-time feedback, progress management, and community interaction.
[0594] Example 1
[0595] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0596] Conventional learning support systems often lack the ability to customize to meet the individual learning needs of each user, and instead provide a standardized learning method. As a result, users' learning efficiency and motivation decline, and it becomes difficult to manage individual progress and identify areas for improvement. In addition, real-time feedback functions are limited, making it difficult for users to immediately correct their learning direction.
[0597] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0598] In this invention, the server includes: means for inputting and registering information such as the user's desired educational institution and current academic level; means including a generative AI model for generating an individual curriculum based on the input and registered user information; means including a computer device for automatically generating questions based on the user's desired educational institution and level; means for the user to input answers to the questions provided; means including a computer device for receiving the user's answers, determining whether they are correct, and generating feedback in real time; means for analyzing the user's learning progress, identifying areas for improvement, analyzing the answer data based on the user's past answer history, and visualizing the learning progress; and means for the user to share information with other test-takers in a knowledge-sharing community. This enables customized learning according to individual learning needs, and significantly improves user learning efficiency by enhancing real-time feedback and progress management.
[0599] "User" refers to an individual who uses this system to learn.
[0600] "Educational institution" refers to an organization such as a school or university to which the user aspires.
[0601] "Academic ability level" refers to a numerical value or evaluation that indicates the user's current level of understanding and knowledge in each subject (e.g., mathematics, English, etc.).
[0602] "Individual curriculum" refers to a customized study plan based on the entrance exam trends of the educational institution the user wishes to attend and their current academic level.
[0603] "Generative AI models" refer to artificial intelligence technology that generates curriculum and questions based on user information. Specifically, they use algorithms for natural language processing and machine learning.
[0604] "Computer device" refers to a computer system or part thereof that performs various calculations and data processing.
[0605] "Real-time feedback" refers to the immediate evaluation and advice that users receive immediately after answering a question.
[0606] "Learning progress" refers to an indicator that shows how much understanding a user has gained as they progress through their studies and how close they are to achieving their goals.
[0607] "Improvement points" refer to the learning content or skills that users need to focus on improving or strengthening through further study.
[0608] "Answer history" refers to data that records the results and process of all questions that a user has answered within the system.
[0609] A "knowledge sharing community" refers to an online forum for exchanging information and advice with other users of the system.
[0610] An embodiment of a system according to the present invention is described in detail below: The invention provides individually customized study plans and past exam questions for university entrance exam candidates.
[0611] The system begins with users accessing the learning platform, creating an account, and registering their academic ability information. Next, it uses a generative AI model to generate a personalized curriculum optimized for the user, including the automatic generation of questions. It then receives answers from users, provides real-time feedback, analyzes their progress, and identifies areas for improvement. Finally, users can exchange information with other test-takers in a knowledge-sharing community.
[0612] Hardware / Software Configuration
[0613] server:
[0614] 1. Database: A database such as MySQL is used to store user information, answer history, and progress data.
[0615] 2. Generative AI models: Generative AI models such as OpenAI GPT-3 are used to generate individualized curricula and automatically generate questions.
[0616] 3. Feedback module: Uses an AI module to receive the user's answers and generate feedback in real time.
[0617] 4. Progress Analysis Module: Uses data analysis tools to analyze users' learning progress and identify areas for improvement.
[0618] Device:
[0619] 1. User Interface: Provides an interface for users to enter information and answer questions, typically in the form of a web browser or mobile app.
[0620] 2. Display module: displays the curriculum, questions, feedback, and progress data sent from the server.
[0621] user:
[0622] 1. Enter information: The user enters their name, email address, preferred educational institution, and current academic level into the input fields on the device.
[0623] 2. Answering questions: The user enters answers to the provided learning questions and submits them via the terminal.
[0624] 3. Receiving feedback: The feedback sent from the server is checked through the display module on the device, and the learning course is corrected.
[0625] 4. Knowledge sharing: Use the community feature to share information with other users.
[0626] Examples of concrete examples and prompts
[0627] For example, if a user selects "University A" as the university of choice and enters "Mathematics (Math III)" and "English" as their current academic level, the following processing will occur.
[0628] Example prompt sentence:
[0629] 1. When registering as a user: "Please enter the educational institution you wish to apply to and your current academic level."
[0630] 2. When generating a curriculum: "Generate a personalized curriculum based on the academic level and desired educational institution you enter."
[0631] 3. When automatically generating questions: "Please generate new questions based on past questions and question trends from University A."
[0632] 4. When generating feedback: "Check the user's answers and generate feedback in real time."
[0633] The system allows users to work on customized study curriculums and questions based on the entrance exam trends of their desired universities, and improves study efficiency by receiving real-time feedback. It also allows users to study while exchanging information with other test-takers through progress visualization and a knowledge-sharing community.
[0634] As described above, the system of the present invention provides each user with an optimized learning experience, realizing effective learning support that meets individual needs.
[0635] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0636] Step 1: User Access and Account Creation
[0637] User: Visits the system's website or app, opens the account creation page, and enters their name, email address, preferred educational institution, and current academic level.
[0638] Input: Name, email address, desired educational institution, current academic level
[0639] Output: Information entered by the user
[0640] Specific operation: When the user presses the registration button, the input information is sent from the device to the server.
[0641] Step 2: Send and store user information
[0642] Device: Sends user input information to the server via an API request.
[0643] Server: Stores the received user information in a database.
[0644] Input: Information entered by the user
[0645] Output: User information stored in the database
[0646] Specific operation: The server receives the user information and stores it in a database such as MySQL.
[0647] Step 3: Create an individual curriculum
[0648] Server: Retrieves user information from a database and passes it as input to a generative AI model (e.g., OpenAI GPT-3).
[0649] Input: User information retrieved from the database
[0650] Output: Generated individual curriculum
[0651] How it works: The AI model generates a customized curriculum based on the user's academic level and preferred educational institution data, and sends it to the user's device.
[0652] Step 4: Submit and view the curriculum
[0653] Server: Sends the generated individual curriculum to the user's device.
[0654] Terminal: Display the received curriculum on the screen.
[0655] Input: Generated individual curriculum
[0656] Output: Individual curriculum displayed on the device
[0657] Specific behavior: The user progresses through the learning process based on the curriculum.
[0658] Step 5: Automatic question generation
[0659] Server: New questions are generated using a generative AI model based on the user's learning progress and past exam data from the educational institution of their choice.
[0660] Input: User's learning progress data, past exam data from the educational institution of choice
[0661] Output: New automatically generated questions
[0662] Specific operation: The AI model analyzes past exam data, generates new questions, and sends them to the device.
[0663] Step 6: Submit and view the issue
[0664] Server: Sends the generated new questions to the user's device.
[0665] Terminal: Displays received questions on the screen.
[0666] Input: The new question to be generated
[0667] Output: The problem displayed on the terminal
[0668] Specific behavior: The user answers the displayed question.
[0669] Step 7: Enter your answers
[0670] User: Enter the answer to the displayed question and press the submit button.
[0671] Input: Answer to the question
[0672] Output: Submitted answer data
[0673] Specific operation: The user's answer data is sent to the server via the device.
[0674] Step 8: Submitting and judging your answers
[0675] Terminal: Sends the user's answer data to the server.
[0676] Server: The AI module analyzes the received answer data and determines whether it is correct or incorrect.
[0677] Input: Submitted answer data
[0678] Output: Correctness of the answer
[0679] Specific operation: The AI module analyzes the answer and determines whether it is correct or incorrect.
[0680] Step 9: Generate and submit feedback
[0681] Server: Generates real-time feedback based on the correctness of the answers.
[0682] Input: Correct / incorrect answer result
[0683] Output: Generated real-time feedback
[0684] Specific operation: The server generates feedback including the percentage of correct answers, explanations, and further study advice, and sends it to the device.
[0685] Step 10: View feedback
[0686] Terminal: Display received feedback to the user.
[0687] Input: Generated real-time feedback
[0688] Output: Feedback displayed on the terminal
[0689] What happens: Users use the feedback to make course corrections.
[0690] Step 11: Track your progress and focus
[0691] Server: Analyzes progress data based on the user's answer history and identifies areas for improvement.
[0692] Input: Answer history data
[0693] Output: Progress data and identified areas for improvement
[0694] Specific operation: The server sends progress data and enhancement points to the user's device.
[0695] Step 12: Viewing your progress and improvement points
[0696] Terminal: Displays progress data and enhancement points on the screen.
[0697] Input: Progress data and identified areas for improvement
[0698] Output: Progress data and improvement points displayed on the terminal
[0699] Specific action: The user uses this to revise their study plan.
[0700] Step 13: Join a knowledge sharing community
[0701] Users: Use the community feature to exchange information and advice with other test takers.
[0702] Input: Post content, comment
[0703] Output: Share information with other users, feedback
[0704] What it does: Users post questions and experiences and receive comments and advice from other users.
[0705] The above is a detailed flow of program processing in this system.
[0706] (Application example 1)
[0707] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0708] In recent years, the learning needs of university entrance exam candidates have become more diverse, requiring individually customized study plans and questions based on the latest exam trends. However, manually creating individual curricula, providing real-time feedback on question answers, and efficiently managing progress are extremely difficult, making it difficult to provide the efficient learning environment that test takers require. Furthermore, knowledge sharing and information exchange with other test takers are also important elements, but no system exists that can consistently provide these. To solve these problems, a system that provides individually customized study plans using generative AI is needed.
[0709] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0710] In this invention, the server includes: means for inputting and registering information such as the user's desired educational institution and current academic level; means including a computer device for generating an individualized curriculum based on the inputted and registered user information; means including a computer device for automatically generating questions based on the user's desired educational institution and level; means for the user to input answers to the provided questions; means including a computer device for receiving the user's answers, determining whether they are correct, and generating feedback in real time; means including a computer device for analyzing the user's learning progress and identifying areas for improvement; means for the user to share information with other test takers in a knowledge sharing community; communication means for transmitting user information and answer data from the terminal to the server; means for providing the individualized curriculum and automatically generated questions based on the generative AI model to the user terminal; and means for generating prompts to input to the generative AI model. This dramatically improves the efficiency and effectiveness of university entrance exam preparation and enables test takers to easily use a study plan that is tailored to them.
[0711] The "desired educational institution" is an educational institution such as a university or vocational school that the user wishes to enroll in.
[0712] "Current academic level" is an indicator that shows the user's level of understanding and proficiency in each subject.
[0713] "Means for input / registration" refers to an interface that allows users to provide the system with information such as their desired educational institution and academic level.
[0714] An "individualized curriculum" is a customized learning plan based on the user's goals and current academic ability.
[0715] A "computer device" is a device that includes hardware and software for performing data processing and calculations.
[0716] "Automatically generating questions" means that the system automatically creates new questions based on past questions and question trends.
[0717] "Means for inputting answers" refers to an interface that allows a user to input answers to questions into the system.
[0718] "Determine correctness and generate feedback in real time" means instantly determining whether a user's answer is correct or incorrect and providing immediate evaluation and advice.
[0719] "Analyzing learning progress and identifying areas for improvement" means analyzing the user's learning data and identifying areas that need particular focus and weak points.
[0720] A "knowledge sharing community" is an online platform where users can exchange information and advice with each other.
[0721] "Communication means" means the technical means for transmitting and receiving information and data between a user terminal and a server.
[0722] A "generative AI model" is an algorithm that uses artificial intelligence to create individual curricula and automatically generated questions.
[0723] A "means for generating prompt sentences" is a method or device that creates input sentences to instruct a generative AI model.
[0724] A "user terminal" is a device (smartphone, tablet, PC, etc.) that a user uses to access and operate the system.
[0725] This invention is a learning support system using generative AI for university entrance exam candidates. The system allows users to input and register information such as their desired educational institution and current academic level, generates an individual curriculum, and then automatically generates questions and provides feedback.
[0726] 1. Registration and information entry
[0727] User: When using the system for the first time, the user creates an account using the user interface (smartphone app or web browser). The user enters information such as their name, preferred educational institution, and current academic level to register in the system.
[0728] 2. Creating an individual curriculum
[0729] Server: Once the user's registration information is sent to the server, the server uses a generative AI model to generate an individual curriculum based on the user's information. This generative AI model analyzes past test data and question trends to provide an optimal study plan.
[0730] 3. Automatic question generation
[0731] Server: The server automatically generates new questions using a generative AI model, based on past questions and question trends from the educational institution of the student's choice. This problem generation function ensures that questions are always in line with the latest trends.
[0732] 4. Answers and Feedback
[0733] User: The user enters the answer to the provided question and submits it.
[0734] Server: The server receives the user's answer, uses a generative AI model to determine whether it is correct, and generates real-time feedback on the answer that is returned to the user. This feedback may include an explanation for the answer or suggested next steps.
[0735] 5. Progress Management and Analysis
[0736] Server: The user's answer history is stored in a database, and the generative AI model analyzes their learning progress based on this information. It provides advice based on the user's improvement points and level of understanding, and customizes the next learning step.
[0737] 6. Knowledge Sharing Community
[0738] Users: Users can join a knowledge-sharing community where they can exchange information with other test-takers. This community feature allows test-takers to share advice and information with each other.
[0739] Server: The server manages community posts and comments and provides appropriate information when needed.
[0740] Hardware and software used
[0741] Hardware: The servers use Amazon Web Services (AWS) and Google Cloud Platform (GCP) to provide computing resources, while users use devices such as smartphones and tablets.
[0742] Software: The server uses a Python and Flask web framework and OpenAI's generative AI models as an API.
[0743] Examples and prompts
[0744] Examples:
[0745] If a user is applying to a university in Tokyo and enters their current academic level as "Mathematics: Intermediate, English: Advanced," the server will send the following prompt to the generative AI model.
[0746] Example prompt sentence:
[0747] For curriculum generation: "Generate an individual curriculum based on user information: {'University of choice': 'University in Tokyo', 'Academic level': {'Mathematics': 'Intermediate', 'English': 'Advanced'}}."
[0748] For question generation: "Please create new questions based on past questions and question trends. I am applying to a university in Tokyo."
[0749] This system allows users to prepare for university entrance exams efficiently and effectively.
[0750] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0751] Program processing flow
[0752] Step 1: User registration and information entry
[0753] user:
[0754] A user accesses the system and creates an account by entering the following information: name, email address, desired educational institution, and current academic level. The user enters this information and presses the "Register" button.
[0755] Input: Name, email address, preferred educational institution, current academic level
[0756] Output: User information sent to the server
[0757] Step 2: Creating an individual curriculum
[0758] server:
[0759] Based on the received user information, the server sends prompts to the generative AI model to generate an individual curriculum.
[0760] Input: User information
[0761] Prompt: "Generate a personalized curriculum for your desired university based on your user information: {user information}."
[0762] Output: Individual curriculum
[0763] Step 3: Providing an individualized curriculum
[0764] server:
[0765] The generated individual curriculum is sent to the user's terminal.
[0766] Input: Individualized Curriculum
[0767] Output: Individual curriculum displayed on the user's device
[0768] Step 4: Automatic question generation
[0769] server:
[0770] Based on past questions and question trends from the educational institution of interest, prompts are sent to a generative AI model to generate new questions.
[0771] Input: Information about the educational institution you are applying to
[0772] Prompt: "Based on past exam questions and exam trends, please create a new question for your desired university: {your desired educational institution}."
[0773] Output: New problem
[0774] Step 5: Submit the problem
[0775] server:
[0776] The generated questions are sent to the user's device.
[0777] Input: New problem
[0778] Output: The new problem displayed on the user's terminal
[0779] Step 6: Enter your answers
[0780] user:
[0781] The user enters the answer to the provided question and presses the submit button.
[0782] Input: Answer
[0783] Output: Answer data sent to the server
[0784] Step 7: Validate the answer and generate feedback
[0785] server:
[0786] Based on the received answer data, a generative AI model is used to determine whether the answer is correct or incorrect, and feedback is generated in real time.
[0787] Input: Answer data
[0788] Output: Feedback
[0789] Step 8: Provide feedback
[0790] server:
[0791] The generated feedback is sent to the user device.
[0792] Input: Feedback
[0793] Output: Feedback displayed on the user's terminal
[0794] Step 9: Track and analyze progress
[0795] server:
[0796] The user's answer history is stored in a database, and a generative AI model is used to analyze progress and identify areas for improvement.
[0797] Input: Answer history
[0798] Output: Improvement points and next steps
[0799] Step 10: Provide progress updates
[0800] server:
[0801] The analysis results and points for improvement are sent to the user's device.
[0802] Input: Analysis results, improvement points
[0803] Output: Progress information displayed on the user's terminal
[0804] Step 11: Knowledge Sharing Community
[0805] user:
[0806] Exchange information with other test takers registered in the system.
[0807] Input: Community posts and comments
[0808] Output: Knowledge and information shared within the community
[0809] Step 12: Managing Your Community
[0810] server:
[0811] Moderate posts and comments within the community and provide appropriate information.
[0812] Input: Community data
[0813] Output: Providing appropriate information and community management
[0814] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0815] The embodiments for implementing the system according to the present invention are as follows: In particular, by combining an emotion engine that recognizes the user's emotions, a more efficient and effective learning experience is provided.
[0816] 1. User registration and information entry
[0817] User: When accessing the system for the first time, users enter their name, email address, preferred educational institution, and current academic level (e.g., mathematics, English, etc.) on the account creation page and press the registration button. Registration information also includes basic data for identifying emotions, such as the user's facial expressions and voice data.
[0818] Terminal: Sends the entered information to the server.
[0819] 2. Creating an individual curriculum
[0820] Server: Based on the received user information and emotional data, the AI module generates an individualized curriculum for the specific user. The individualized curriculum is customized based on the user's desired educational institution entrance exam trends, academic level, and current emotional state.
[0821] Terminal: Displays the generated personalized curriculum to the user.
[0822] 3. Automatic question generation
[0823] Server: Using an AI module, it automatically generates past exam questions based on the trends and level of the educational institution the user is applying to, taking into account the user's emotional data and adjusting the difficulty of the questions as necessary.
[0824] Terminal: Automatically generated past questions are displayed to the user.
[0825] 4. Answer entry and feedback
[0826] User: Enters the answer to the provided question and presses the submit button. The answer is sent to the server via the terminal.
[0827] Server: Checks answers against a database of correct answers and generates real-time feedback, taking into account the user's emotional data to provide feedback with the appropriate tone and content.
[0828] Terminal: Display feedback to the user.
[0829] 5. Progress Management and Analysis
[0830] Server: Stores the user's answer history in a database, manages progress and analyzes it along with emotional data, and uses an AI module to identify areas where the user needs to improve.
[0831] Terminal: Progress analysis results are displayed to the user via the terminal.
[0832] 6. Knowledge Sharing Community
[0833] Users: Join the knowledge-sharing community on the platform to exchange information and advice with other test-takers, and an emotion engine supports interactions within the community.
[0834] Device: Through the community feature, users can post and receive feedback from other users.
[0835] Server: Manages posts and comments within the community and provides users with appropriate information as needed.
[0836] Specific examples
[0837] For example, if a user selects "Example University" as their preferred university, the results will be as follows:
[0838] 1. User registration and information entry
[0839] User: Access the platform, select the "example university" as the university of choice, and register by entering their current academic level (e.g., intermediate English, advanced mathematics) and emotional data via facial expressions and voice.
[0840] Device: Sends registration information to the server.
[0841] 2. Creating an individual curriculum
[0842] Server: Based on the received information, the AI generates an individual curriculum and provides a learning plan suited to the user. It also takes into account the user's emotional data and adjusts the curriculum to the appropriate level of difficulty and pace.
[0843] Device: Display the learning plan to the user.
[0844] 3. Automatic question generation
[0845] Server: Recognizes the user's emotional state from facial expressions and voice data, and generates past questions with adjusted difficulty to match the user's emotions.
[0846] Terminal: Provides study questions to users.
[0847] 4. Answer entry and feedback
[0848] User: Answers the questions provided and submits them to the server.
[0849] Server: Checks answers and provides real-time feedback. Feedback content and tone are adjusted based on the user's emotional data.
[0850] Terminal: Display feedback to the user.
[0851] 5. Progress Management and Analysis
[0852] Server: Based on the user's answer history and emotional data, the server analyzes the user's progress in detail and identifies areas where the user needs to improve.
[0853] Terminal: Display progress to the user.
[0854] 6. Knowledge Sharing Community
[0855] Users: Exchange information with other test takers and use the emotion engine to facilitate smooth interactions within the community.
[0856] Device: View posts and comments within the community and encourage interaction with other users.
[0857] In this way, the system according to the present invention can provide a more personalized learning experience by recognizing the user's emotions and incorporating them into adjustments to the learning plan and feedback.
[0858] The processing flow will be explained below.
[0859] Step 1:
[0860] User: Access the platform and enter your name, email address, desired educational institution, current academic level (e.g., mathematics, English, etc.), and facial and voice data on the account creation page, then press the registration button.
[0861] Step 2:
[0862] Terminal: Sends the entered information to the server. If the transmission to the server is successful, displays a confirmation message to the user.
[0863] Step 3:
[0864] Server: Stores the received user information and emotion data in a database. Sends a confirmation message to the device that the data has been saved.
[0865] Step 4:
[0866] Server: Based on the stored user information and emotional data, an AI module is used to generate a personalized curriculum, which is customized based on the user's desired educational institution entrance exam trends, academic level, and current emotional state.
[0867] Step 5:
[0868] Device: The generated individual curriculum is displayed to the user, who then proceeds with their studies based on the curriculum.
[0869] Step 6:
[0870] Server: Based on the question trends of the educational institution the user is applying to, the server uses an AI module to automatically generate past exam questions, taking into account the user's emotional data and adjusting the difficulty of the questions as necessary.
[0871] Step 7:
[0872] Terminal: Automatically generated past questions are displayed to the user, who then works on the questions.
[0873] Step 8:
[0874] User: Enters the answer to the provided question and presses the submit button. The answer is sent to the server via the terminal.
[0875] Step 9:
[0876] Server: Compares the received answers with a database of correct answers and generates feedback in real time. The server also takes into account the user's emotional data to provide appropriate feedback in terms of content and tone.
[0877] Step 10:
[0878] Terminal: Feedback is displayed to the user, who can review the feedback and deepen their understanding.
[0879] Step 11:
[0880] Server: Stores the user's answer history and emotional data in a database, and manages and analyzes the progress using an AI module, thereby identifying areas where the user needs to improve.
[0881] Step 12:
[0882] Device: Progress management and analysis results are displayed to the user, allowing the user to check their own learning progress and take necessary measures.
[0883] Step 13:
[0884] Users: Access knowledge sharing communities to share learning information and advice with other test-takers, and use an emotion engine to support interactions within the community.
[0885] Step 14:
[0886] Server: Analyzes posts and comments within the community using an emotion engine and provides appropriate feedback, thereby providing support that takes into account the user's emotions.
[0887] Step 15:
[0888] On your device: Show users the latest community posts and comments. Users can use the community feature to interact with other test-takers.
[0889] Through the above process, the system based on the present invention enables users to study efficiently through individually customized study plans and automatically generated past questions, and maximizes overall learning effectiveness through real-time feedback, progress management, and community interaction. Furthermore, by using an emotion engine, it provides a learning experience that takes users' emotions into consideration.
[0890] Example 2
[0891] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0892] While conventional learning support systems can provide a curriculum based on a user's learning progress and preferred educational institution, they lack the ability to provide a personalized learning experience that takes into account the user's emotional state. Furthermore, they do not provide feedback that appropriately reflects the user's emotional state during the learning process, nor do they provide questions with difficulty levels that are adjusted according to the user's emotions. As a result, improvements in learning efficiency and motivation cannot be expected. Furthermore, knowledge-sharing communities lacked interaction support based on emotional state, which led to a decline in the quality of communication between users.
[0893] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0894] In this invention, the server includes: means for collecting a user's facial expression data and voice data and identifying emotional data; means including a computer device for generating an individual curriculum based on the input and registered user information and emotional data; and means including a computer device for automatically generating questions based on the trends and level of the educational institution the user is aiming for, and adjusting the difficulty level by taking the user's emotional data into consideration. This makes it possible to generate an individual curriculum and provide questions that take the user's emotional state into consideration, and to adjust the tone and content of feedback according to the user's emotional state. Furthermore, by supporting interactions in knowledge sharing communities using an emotional engine, communication between users can be facilitated, which is expected to improve the quality of learning and motivation.
[0895] "User information" refers to data such as the user's personal information, academic level, and preferred educational institution that is entered into the learning system.
[0896] "Emotional data" refers to data that represents a user's psychological or emotional state obtained from facial expressions and voice analysis.
[0897] "Individualized curriculum" refers to a customized learning plan based on the user's academic level, the requirements of the educational institution of their choice, and their emotional state.
[0898] "Computer device" refers to a computer system or hardware that performs various calculation processes based on user information and emotional data.
[0899] "Auto-generation" refers to the process of using AI modules or algorithms to create specific data (here, questions or curriculum) without human intervention.
[0900] "Feedback" refers to the correctness or incorrectness of the answers entered by the user and advice provided in real time.
[0901] "Progress management" is the process of tracking a user's learning progress and grade changes and identifying areas that need improvement.
[0902] A "knowledge sharing community" is an online forum or platform where candidates and learners can come together to exchange information and advice.
[0903] An "emotion engine" is an algorithm or software that analyzes a user's emotional data and appropriately adjusts interactions based on that data.
[0904] The system based on the present invention aims to utilize user emotional data to personalize the entire learning process, from generating an individual curriculum to providing questions, feedback, progress management, and a knowledge sharing community.
[0905] User registration and information entry
[0906] When a user first accesses the platform, they enter their name, email address, preferred educational institution, and current academic level (e.g., math, English) on the account creation page. The device also uses a camera and microphone to collect facial and voice data, which is then saved as emotion data. The device then packages this information and data and sends it to the server. The server then stores the received information in a database and notifies the user that registration is complete.
[0907] Creating an individual curriculum
[0908] The server uses an AI module to analyze the stored user information and emotional data. This AI module takes into account the user's entrance exam trends, academic level, and emotional state to generate an individualized learning plan. The generated curriculum includes optimal learning content and progress pace and is displayed to the user via their device.
[0909] Automatic question generation
[0910] The server uses an AI model to automatically generate past exam questions tailored to the trends and level of the educational institution the user is applying to. It also takes into account the user's emotional data and adjusts the difficulty of the questions as needed. The generated questions are then provided to the user via their device.
[0911] Answer entry and feedback
[0912] When a user enters an answer to a given question and presses the submit button, the answer data is sent to the server via the device. The server compares the received answer with a database of correct answers and generates feedback in real time. The feedback takes into account the user's emotional data and adjusts the tone and content appropriately. This feedback information is displayed to the user via the device.
[0913] Progress management and analysis
[0914] The server stores the user's answer history and emotional data in a database, and manages and analyzes their progress. The AI module analyzes this data, identifies areas where the user needs to improve, and generates advice based on that. The analysis results are displayed to the user via their device.
[0915] Knowledge Sharing Community
[0916] Users can join the knowledge-sharing community on the platform and exchange information and advice with other test-takers. An emotion engine supports smooth interactions with posts and comments within the community. The device displays community posts and comments, encouraging interaction with other users.
[0917] Examples of concrete examples and prompts
[0918] For example, if a user is applying to "Example University" and has set their current academic level as intermediate in English and advanced in mathematics, they would input the following prompt sentence into the generative AI model.
[0919] "Please write AI code that allows a user to select the 'example university' as their preferred university, set their current academic level as intermediate in English and advanced in mathematics, and generate an individualized curriculum based on that."
[0920] In this way, the system based on the present invention realizes advanced personalization that utilizes the user's emotional data, thereby maximizing the learning experience.
[0921] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0922] Step 1:
[0923] User registration and information entry
[0924] When a user first accesses the system, they enter their name, email address, preferred educational institution, and current academic level on the account creation page. The system also uses a camera and microphone to collect facial expression and voice data, and the input information registered as emotion data includes text and multimedia data.
[0925] Terminal: Packages input information and sends it to the server. Specifically, it bundles text and multimedia files entered in web forms or smartphone apps into a single request and sends it using the HTTP protocol.
[0926] Step 2:
[0927] Receiving and storing information
[0928] Server: The received user information and emotion data are stored in a database. Furthermore, the server generates user identification information based on the stored data and sends a confirmation email. The received data includes the user's personal information, academic achievement information, and emotion data. This data is stored in a database management system such as MySQL or PostgreSQL.
[0929] Step 3:
[0930] Creating an individual curriculum
[0931] Server: Analyzes the stored user information and emotional data and generates an individualized curriculum using a specific algorithm. Specifically, a machine learning model (using, for example, TensorFlow or PyTorch) is used to customize a learning plan based on the user's academic level and the trends of the educational institution they wish to attend. Emotional data is also input into the AI model to adjust the difficulty and pace of the lesson. The generated curriculum is sent to the device in JSON format.
[0932] Step 4:
[0933] View Curriculum
[0934] Device: The device displays the received personalized curriculum to the user. The curriculum is rendered as a user interface using HTML and CSS, and interactive elements are added using JavaScript as needed, allowing the user to see the learning plan that best suits them.
[0935] Step 5:
[0936] Automatic question generation
[0937] Server: Using an AI model, past exam questions are generated that are tailored to the trends and level of the educational institution the user is applying to. Emotional data is also taken into account to adjust the difficulty of the questions. The generated questions are then converted back into JSON format and sent to the device. Specifically, the AI model references a database of past entrance exam questions and constructs questions based on specific rules.
[0938] Step 6:
[0939] Displaying past questions
[0940] Terminal: The generated past questions are displayed to the user. The questions are dynamically rendered using JavaScript using HTML templates. Specific instructions for entering answers are also displayed.
[0941] Step 7:
[0942] Enter and submit your answers
[0943] User: Enters the answer to the provided question and presses the submit button. The answer is sent in text format to the server via the terminal. Specifically, when the user enters the answer in the input form and presses the submit button, the data is sent to the server as an HTTP request using JavaScript.
[0944] Step 8:
[0945] Receiving answers and feedback
[0946] Server: Compares the received answers with a database of correct answers and generates real-time feedback using an AI model. It takes into account emotional data and adjusts the tone and content of the feedback. Feedback based on the comparison results is generated in JSON format and sent to the device.
[0947] Step 9:
[0948] View Feedback
[0949] Device: Displays feedback information to the user. The display is done using HTML and CSS, and the content and tone of the feedback are adjusted based on the user's emotional state. Specifically, it parses the feedback data in JSON format, inserts it into an HTML template, and displays it.
[0950] Step 10:
[0951] Progress management and analysis
[0952] Server: Stores the user's answer history and sentiment data in a database, and manages and analyzes their progress. It uses AI models to identify the user's weaknesses and areas for improvement, and adjusts their learning plan accordingly. Specifically, it periodically analyzes the stored data and updates the individual curriculum and learning advice based on the results.
[0953] Step 11:
[0954] View progress results
[0955] Device: Receives the analysis results and displays them to the user. The user can check their progress and understand what they are being evaluated on and what they should study next. The analysis results are displayed visually in an easy-to-understand manner using HTML and CSS.
[0956] Step 12:
[0957] Join our knowledge sharing community
[0958] Users: Join the knowledge-sharing community on the platform and exchange information and advice with other test-takers. An emotion engine supports user-to-user interactions. Posts and comments are in text format, and the interface is rendered using HTML and JavaScript.
[0959] Step 13:
[0960] Community Management
[0961] Server: Moderates posts and comments within the community and provides appropriate information to users when necessary. This includes filtering inappropriate posts. It also uses AI models to support positive interactions based on sentiment data.
[0962] (Application example 2)
[0963] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0964] Conventional learning systems lack the ability to recognize users' emotions in real time and optimize learning content and feedback based on that. Furthermore, virtual shopping environments lack product recommendations and customer service that take user emotions into account, leaving a need for improved user experience. Given this situation, it is necessary to develop a system that recognizes users' emotions in real time and provides personalized learning and shopping experiences accordingly.
[0965] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0966] In this invention, the server includes: means for inputting and registering information such as the user's desired educational institution and current academic level; means including a computer device for generating an individual curriculum based on the inputted and registered user information; means including a computer device for automatically generating questions based on the user's desired educational institution and level; means for the user to input answers to the provided questions; means including a computer device for receiving the user's answers, determining whether they are correct or incorrect, and generating feedback in real time; means including a computer device for analyzing the user's learning progress and identifying areas for improvement; means for the user to share information with other test takers in a knowledge-sharing community; and means for recognizing the user's emotions in real time and providing personalized product suggestions and customer service, thereby enabling a personalized learning and virtual shopping experience based on the user's emotions.
[0967] "User" means an individual who uses the system to learn or shop.
[0968] "Educational institution" refers to a place of learning such as a school, university, or vocational school that the user wishes to attend.
[0969] "Academic level" refers to a number or rating entered by the user that indicates the current level of knowledge and skill in each subject.
[0970] "Individual Curriculum" refers to a customized learning plan generated based on the characteristics of the educational institution the user is interested in, as well as the user's academic level and emotional data.
[0971] "Emotional data" refers to information that indicates the emotional state of the user, obtained from facial expressions, voice, etc.
[0972] "Computer equipment" means a device that includes hardware and software for inputting and registering information, generating individualized curriculum, automatically generating questions, analyzing answers, providing real-time feedback, and analyzing progress.
[0973] "Automatic question generation" refers to the process of using an AI module to generate appropriate study questions based on the trends and academic level of the educational institution the user is applying to.
[0974] "Answer" refers to the answer that a user enters in response to a given question.
[0975] "Feedback" refers to the evaluation and advice provided to users based on real-time judgment of whether their answers are correct or incorrect.
[0976] "Analyzing learning progress" refers to the process of identifying a user's learning progress and areas for improvement based on the user's answer history and sentiment data.
[0977] A "knowledge sharing community" is an online platform where users can exchange study information and advice with other test takers.
[0978] "Means for recognizing emotions in real time" refers to technology that analyzes a user's facial expressions and voice to instantly determine their current emotional state.
[0979] "Personalized product suggestions" refers to the process of recommending products that are suited to individual users based on their emotional data and purchasing history.
[0980] "Customer service" refers to the assistance and support provided to users by avatars and chatbots in virtual stores.
[0981] The embodiment of the system according to the present invention is as follows: In particular, to provide a learning system and a virtual shopping environment combined with an emotion engine, the system includes the following specific steps:
[0982] First, the user accesses the system and registers and enters information. The user enters their name, email address, favorite categories (learning or shopping), past progress and purchase history, and emotional data such as facial expressions and voice data. This information is then sent to the server via the device.
[0983] The server generates personalized curriculum and product recommendations based on the received user information and emotional data. In the case of the learning system, the personalized curriculum is customized based on the user's educational preference, academic level, and current emotional state. In the case of virtual shopping, product recommendations are made in real time based on the emotional data.
[0984] The generated individual curriculum and product suggestions are displayed to the user via their device, allowing them to have a personalized learning plan and shopping experience.
[0985] In the learning system, the server automatically generates questions based on the trends and level of the educational institution the user is applying to. The generated questions are then sent to the server, with the user entering the answers via their device. The server then judges the answers in real time and generates feedback. The content and tone of the feedback are adjusted based on the user's emotional data.
[0986] The server also stores the user's answer history and emotional data in a database. Based on the stored data, the server analyzes the user's learning progress and identifies areas that need improvement. The user is notified of the analysis results via their device.
[0987] In the knowledge sharing community, users can share information and advice with other test-takers and shoppers. The server manages posts and comments within the community and supports smooth interactions with an emotion engine.
[0988] For example, if a user is wearing smart glasses in a virtual shopping environment, the system will highlight related product suggestions if the user's facial expression indicates interest. Conversely, if the user indicates dissatisfaction, the system will suggest products in a different category. Furthermore, if the user gazes at a particular item for a long time, the system will automatically display reviews and detailed information related to that item.
[0989] The prompt sentences include the following:
[0990] "Capture facial expression data in real time while the user is wearing the glasses, perform sentiment analysis, and optimize product suggestions in the virtual store. Specifically, if the user expresses positive sentiment toward a certain product, immediately recommend related products. Also, if the user expresses negative sentiment, build a system that suggests products from a different category."
[0991] The system based on this invention uses cloud services such as TensorFlow, Amazon Web Services (AWS), and Google Cloud to analyze emotional data and provide customized learning plans and product recommendations, thereby enabling personalized learning and virtual shopping experiences based on the user's emotions.
[0992] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0993] Step 1:
[0994] The user accesses the system. They input their name, email address, favorite category (study or shopping), past progress and purchase history, and emotional data such as facial expressions and voice data, and send this data to the server from their device. The input data also includes the user's preferred educational institution and academic level.
[0995] Step 2:
[0996] The server analyzes the received user information and emotional data. Specifically, it uses an AI module to generate an individualized curriculum, taking into account the trends of the user's preferred educational institution and their academic level. The emotional data is also analyzed, and the difficulty and content of the curriculum are adjusted based on the user's current emotional state. The output is a customized learning plan or product recommendations.
[0997] Step 3:
[0998] The generated personalized curriculum and product suggestions are displayed to the user via their device. The user can then review the displayed curriculum and products. The displayed content reflects the user's emotional state in real time and dynamically changes according to the user's interests and dissatisfaction.
[0999] Step 4:
[1000] In the case of the learning system, the server automatically generates questions based on the trends of the educational institution the user is applying to and their academic level. Using past exam questions and mock test data, the AI module generates appropriate questions. Emotional data is also taken into account, and adjustments are made, such as lowering the difficulty of questions if the user is feeling stressed.
[1001] In the case of a shopping system, the server provides detailed information about a particular product and displays related product lists and promotional information.
[1002] Step 5:
[1003] The user enters the answer to the generated question and sends it to the server via their device. The server compares the answer with a database of correct answers and generates real-time feedback. This feedback is also adjusted based on the emotional data, and is presented to the user with an appropriate tone and content.
[1004] Step 6:
[1005] The server stores the user's answer history and emotional data in a database. The stored data is used to analyze the user's learning progress. This analysis includes the accuracy and speed of the user's answers, changes in their emotional state, etc. The progress is analyzed in detail to identify areas that need improvement.
[1006] Step 7:
[1007] In the knowledge sharing community, users can share information and advice with other test takers and shoppers. The terminal uses an emotion engine to support interactions within the community and improve the user experience. The server manages posts and comments within the community and provides users with appropriate information as needed.
[1008] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1009] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1010] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1011] [Third embodiment]
[1012] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1013] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[1014] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1015] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1016] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1017] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1018] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1019] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1020] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1021] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1022] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1023] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1024] The embodiment of the system according to the present invention is as follows: This system is targeted at university entrance exam candidates and provides individually customized study plans and past exam questions using generative AI.
[1025] 1. User registration and information entry
[1026] User: When using this system for the first time, the user accesses the platform and opens the page to create an account. The user enters their name, email address, preferred educational institution, and current academic level (e.g., mathematics, English, etc.), and presses the registration button. This allows the user's basic information to be collected.
[1027] Terminal: The entered information is sent to the server via the terminal.
[1028] 2. Creating an individual curriculum
[1029] Server: Based on the received user information, the server uses an AI module to generate a personalized curriculum for each specific user, customized based on the user's desired educational institution entrance exam trends and current academic level.
[1030] Terminal: The generated individual curriculum is displayed to the user via the terminal, allowing the user to proceed with their studies according to the curriculum.
[1031] 3. Automatic question generation
[1032] Server: The AI module installed on the server automatically generates new questions based on past exam questions and question trends from the educational institution the user is applying to. This problem generation function allows users to tackle the latest questions.
[1033] Terminal: The automatically generated questions are provided to the user via the terminal, where the user can answer them.
[1034] 4. Answer entry and feedback
[1035] User: Enters the answer to the provided question and presses the submit button. The entered answer is sent to the server via the terminal.
[1036] Server: The server checks the answers received and determines whether they are correct. Using an AI module, it generates real-time feedback and provides it to the user. This feedback allows the user to check their understanding and further their learning.
[1037] Terminal: Feedback is displayed to the user via the terminal.
[1038] 5. Progress Management and Analysis
[1039] Server: Stores the user's answer history in a database and analyzes the user's learning progress based on this. It uses an AI module to identify areas that the user needs to improve and generate further learning advice.
[1040] Device: Progress analysis results are displayed to users via their device, allowing them to understand their learning progress in real time and plan their learning accordingly.
[1041] 6. Knowledge Sharing Community
[1042] Users can join the knowledge-sharing community on the platform and exchange information and advice with other test-takers, which not only helps users deepen their own knowledge but also helps them stay motivated by learning together with other test-takers.
[1043] Device: Through the community feature, users can post and receive feedback from other users.
[1044] Server: Manages posts and comments within the community and provides users with appropriate information as needed.
[1045] Specific examples
[1046] For example, if a user selects the University of Tokyo as their preferred university, the following will occur:
[1047] User: Access the platform, select the University of Tokyo as their preferred university, enter their current academic level in English, mathematics (Math III), etc., and register.
[1048] Device: Sends registration information to the server.
[1049] Server: Based on the received information, the AI generates an individual curriculum and provides a learning plan suited to the user. It also automatically generates new questions based on past questions and question trends from the University of Tokyo and provides them to the user via their device.
[1050] User: Enters answers to the questions provided and submits them to the server.
[1051] Server: Checks answers, generates real-time feedback and provides it to users via their devices. It also analyzes users' answer history to identify progress and areas for improvement.
[1052] Users: Study based on the feedback provided and share information with other test takers in the community.
[1053] In this way, the system based on the present invention enables users to efficiently prepare for university entrance exams through individually customized study plans and questions, real-time feedback, progress management, and a knowledge-sharing community.
[1054] The processing flow will be explained below.
[1055] Step 1:
[1056] User: Access the platform and enter your name, email address, desired educational institution, and current academic level (e.g., mathematics, English, etc.) on the account creation page, then press the registration button.
[1057] Step 2:
[1058] Terminal: Sends the entered information to the server. If the transmission to the server is successful, displays a confirmation message to the user.
[1059] Step 3:
[1060] Server: Stores the received user information in a database and sends a confirmation message to the device that the information has been saved.
[1061] Step 4:
[1062] Server: Based on the saved user information, an AI module is used to generate an individual curriculum, which is customized according to the entrance exam trends and academic ability level of the educational institution the user wishes to attend.
[1063] Step 5:
[1064] Device: The generated individual curriculum is displayed to the user, who then proceeds with their studies based on the curriculum.
[1065] Step 6:
[1066] Server: Generates automatically generated past exam questions using an AI module based on the question trends of the educational institution the user is applying to.
[1067] Step 7:
[1068] Terminal: Automatically generated past questions are displayed to the user, who then works on the questions.
[1069] Step 8:
[1070] User: Enters the answer to the provided question and presses the submit button. The answer is sent to the server via the terminal.
[1071] Step 9:
[1072] Server: Compares the received answers with a database of correct answers and generates real-time feedback. Feedback is automatically generated based on the user's input.
[1073] Step 10:
[1074] Terminal: Feedback is displayed to the user, who can review the feedback and deepen their understanding.
[1075] Step 11:
[1076] Server: Stores the user's answer history in a database and manages and analyzes the progress using an AI module, thereby identifying areas where the user needs to improve.
[1077] Step 12:
[1078] Device: Progress management and analysis results are displayed to the user, allowing the user to check their own learning progress and take necessary measures.
[1079] Step 13:
[1080] Users: Access knowledge sharing communities to share study tips and advice with other test takers. Gain more insight through posts and comments.
[1081] Step 14:
[1082] Server: Manage posts and comments within the community, moderate them as needed, and help ensure the right information is shared.
[1083] Step 15:
[1084] On your device: Show users the latest community posts and comments. Users can use the community feature to interact with other test-takers.
[1085] Through the above process, the system based on the present invention enables users to study efficiently through individually customized study plans and automatically generated past questions, and maximizes overall learning effectiveness through real-time feedback, progress management, and community interaction.
[1086] Example 1
[1087] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1088] Conventional learning support systems often lack the ability to customize to meet the individual learning needs of each user, and instead provide a standardized learning method. As a result, users' learning efficiency and motivation decline, and it becomes difficult to manage individual progress and identify areas for improvement. In addition, real-time feedback functions are limited, making it difficult for users to immediately correct their learning direction.
[1089] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1090] In this invention, the server includes: means for inputting and registering information such as the user's desired educational institution and current academic level; means including a generative AI model for generating an individual curriculum based on the input and registered user information; means including a computer device for automatically generating questions based on the user's desired educational institution and level; means for the user to input answers to the questions provided; means including a computer device for receiving the user's answers, determining whether they are correct, and generating feedback in real time; means for analyzing the user's learning progress, identifying areas for improvement, analyzing the answer data based on the user's past answer history, and visualizing the learning progress; and means for the user to share information with other test-takers in a knowledge-sharing community. This enables customized learning according to individual learning needs, and significantly improves user learning efficiency by enhancing real-time feedback and progress management.
[1091] "User" refers to an individual who uses this system to learn.
[1092] "Educational institution" refers to an organization such as a school or university to which the user aspires.
[1093] "Academic ability level" refers to a numerical value or evaluation that indicates the user's current level of understanding and knowledge in each subject (e.g., mathematics, English, etc.).
[1094] "Individual curriculum" refers to a customized study plan based on the entrance exam trends of the educational institution the user wishes to attend and their current academic level.
[1095] "Generative AI models" refer to artificial intelligence technology that generates curriculum and questions based on user information. Specifically, they use algorithms for natural language processing and machine learning.
[1096] "Computer device" refers to a computer system or part thereof that performs various calculations and data processing.
[1097] "Real-time feedback" refers to the immediate evaluation and advice that users receive immediately after answering a question.
[1098] "Learning progress" refers to an indicator that shows how much understanding a user has gained as they progress through their studies and how close they are to achieving their goals.
[1099] "Improvement points" refer to the learning content or skills that users need to focus on improving or strengthening through further study.
[1100] "Answer history" refers to data that records the results and process of all questions that a user has answered within the system.
[1101] A "knowledge sharing community" refers to an online forum for exchanging information and advice with other users of the system.
[1102] An embodiment of a system according to the present invention is described in detail below: The invention provides individually customized study plans and past exam questions for university entrance exam candidates.
[1103] The system begins with users accessing the learning platform, creating an account, and registering their academic ability information. Next, it uses a generative AI model to generate a personalized curriculum optimized for the user, including the automatic generation of questions. It then receives answers from users, provides real-time feedback, analyzes their progress, and identifies areas for improvement. Finally, users can exchange information with other test-takers in a knowledge-sharing community.
[1104] Hardware / Software Configuration
[1105] server:
[1106] 1. Database: A database such as MySQL is used to store user information, answer history, and progress data.
[1107] 2. Generative AI models: Generative AI models such as OpenAI GPT-3 are used to generate individualized curricula and automatically generate questions.
[1108] 3. Feedback module: Uses an AI module to receive the user's answers and generate feedback in real time.
[1109] 4. Progress Analysis Module: Uses data analysis tools to analyze users' learning progress and identify areas for improvement.
[1110] Device:
[1111] 1. User Interface: Provides an interface for users to enter information and answer questions, typically in the form of a web browser or mobile app.
[1112] 2. Display module: displays the curriculum, questions, feedback, and progress data sent from the server.
[1113] user:
[1114] 1. Enter information: The user enters their name, email address, preferred educational institution, and current academic level into the input fields on the device.
[1115] 2. Answering questions: The user enters answers to the provided learning questions and submits them via the terminal.
[1116] 3. Receiving feedback: The feedback sent from the server is checked through the display module on the device, and the learning course is corrected.
[1117] 4. Knowledge sharing: Use the community feature to share information with other users.
[1118] Examples of concrete examples and prompts
[1119] For example, if a user selects "University A" as the university of choice and enters "Mathematics (Math III)" and "English" as their current academic level, the following processing will occur.
[1120] Example prompt sentence:
[1121] 1. When registering as a user: "Please enter the educational institution you wish to apply to and your current academic level."
[1122] 2. When generating a curriculum: "Generate a personalized curriculum based on the academic level and desired educational institution you enter."
[1123] 3. When automatically generating questions: "Please generate new questions based on past questions and question trends from University A."
[1124] 4. When generating feedback: "Check the user's answers and generate feedback in real time."
[1125] The system allows users to work on customized study curriculums and questions based on the entrance exam trends of their desired universities, and improves study efficiency by receiving real-time feedback. It also allows users to study while exchanging information with other test-takers through progress visualization and a knowledge-sharing community.
[1126] As described above, the system of the present invention provides each user with an optimized learning experience, realizing effective learning support that meets individual needs.
[1127] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1128] Step 1: User Access and Account Creation
[1129] User: Visits the system's website or app, opens the account creation page, and enters their name, email address, preferred educational institution, and current academic level.
[1130] Input: Name, email address, desired educational institution, current academic level
[1131] Output: Information entered by the user
[1132] Specific operation: When the user presses the registration button, the input information is sent from the device to the server.
[1133] Step 2: Send and store user information
[1134] Device: Sends user input information to the server via an API request.
[1135] Server: Stores the received user information in a database.
[1136] Input: Information entered by the user
[1137] Output: User information stored in the database
[1138] Specific operation: The server receives the user information and stores it in a database such as MySQL.
[1139] Step 3: Create an individual curriculum
[1140] Server: Retrieves user information from a database and passes it as input to a generative AI model (e.g., OpenAI GPT-3).
[1141] Input: User information retrieved from the database
[1142] Output: Generated individual curriculum
[1143] How it works: The AI model generates a customized curriculum based on the user's academic level and preferred educational institution data, and sends it to the user's device.
[1144] Step 4: Submit and view the curriculum
[1145] Server: Sends the generated individual curriculum to the user's device.
[1146] Terminal: Display the received curriculum on the screen.
[1147] Input: Generated individual curriculum
[1148] Output: Individual curriculum displayed on the device
[1149] Specific behavior: The user progresses through the learning process based on the curriculum.
[1150] Step 5: Automatic question generation
[1151] Server: New questions are generated using a generative AI model based on the user's learning progress and past exam data from the educational institution of their choice.
[1152] Input: User's learning progress data, past exam data from the educational institution of choice
[1153] Output: New automatically generated questions
[1154] Specific operation: The AI model analyzes past exam data, generates new questions, and sends them to the device.
[1155] Step 6: Submit and view the issue
[1156] Server: Sends the generated new questions to the user's device.
[1157] Terminal: Displays received questions on the screen.
[1158] Input: The new question to be generated
[1159] Output: The problem displayed on the terminal
[1160] Specific behavior: The user answers the displayed question.
[1161] Step 7: Enter your answers
[1162] User: Enter the answer to the displayed question and press the submit button.
[1163] Input: Answer to the question
[1164] Output: Submitted answer data
[1165] Specific operation: The user's answer data is sent to the server via the device.
[1166] Step 8: Submitting and judging your answers
[1167] Terminal: Sends the user's answer data to the server.
[1168] Server: The AI module analyzes the received answer data and determines whether it is correct or incorrect.
[1169] Input: Submitted answer data
[1170] Output: Correctness of the answer
[1171] Specific operation: The AI module analyzes the answer and determines whether it is correct or incorrect.
[1172] Step 9: Generate and submit feedback
[1173] Server: Generates real-time feedback based on the correctness of the answers.
[1174] Input: Correct / incorrect answer result
[1175] Output: Generated real-time feedback
[1176] Specific operation: The server generates feedback including the percentage of correct answers, explanations, and further study advice, and sends it to the device.
[1177] Step 10: View feedback
[1178] Terminal: Display received feedback to the user.
[1179] Input: Generated real-time feedback
[1180] Output: Feedback displayed on the terminal
[1181] What happens: Users use the feedback to make course corrections.
[1182] Step 11: Track your progress and focus
[1183] Server: Analyzes progress data based on the user's answer history and identifies areas for improvement.
[1184] Input: Answer history data
[1185] Output: Progress data and identified areas for improvement
[1186] Specific operation: The server sends progress data and enhancement points to the user's device.
[1187] Step 12: Viewing your progress and improvement points
[1188] Terminal: Displays progress data and enhancement points on the screen.
[1189] Input: Progress data and identified areas for improvement
[1190] Output: Progress data and improvement points displayed on the terminal
[1191] Specific action: The user uses this to revise their study plan.
[1192] Step 13: Join a knowledge sharing community
[1193] Users: Use the community feature to exchange information and advice with other test takers.
[1194] Input: Post content, comment
[1195] Output: Share information with other users, feedback
[1196] What it does: Users post questions and experiences and receive comments and advice from other users.
[1197] The above is a detailed flow of program processing in this system.
[1198] (Application example 1)
[1199] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1200] In recent years, the learning needs of university entrance exam candidates have become more diverse, requiring individually customized study plans and questions based on the latest exam trends. However, manually creating individual curricula, providing real-time feedback on question answers, and efficiently managing progress are extremely difficult, making it difficult to provide the efficient learning environment that test takers require. Furthermore, knowledge sharing and information exchange with other test takers are also important elements, but no system exists that can consistently provide these. To solve these problems, a system that provides individually customized study plans using generative AI is needed.
[1201] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1202] In this invention, the server includes: means for inputting and registering information such as the user's desired educational institution and current academic level; means including a computer device for generating an individualized curriculum based on the inputted and registered user information; means including a computer device for automatically generating questions based on the user's desired educational institution and level; means for the user to input answers to the provided questions; means including a computer device for receiving the user's answers, determining whether they are correct, and generating feedback in real time; means including a computer device for analyzing the user's learning progress and identifying areas for improvement; means for the user to share information with other test takers in a knowledge sharing community; communication means for transmitting user information and answer data from the terminal to the server; means for providing the individualized curriculum and automatically generated questions based on the generative AI model to the user terminal; and means for generating prompts to input to the generative AI model. This dramatically improves the efficiency and effectiveness of university entrance exam preparation and enables test takers to easily use a study plan that is tailored to them.
[1203] The "desired educational institution" is an educational institution such as a university or vocational school that the user wishes to enroll in.
[1204] "Current academic level" is an indicator that shows the user's level of understanding and proficiency in each subject.
[1205] "Means for input / registration" refers to an interface that allows users to provide the system with information such as their desired educational institution and academic level.
[1206] An "individualized curriculum" is a customized learning plan based on the user's goals and current academic ability.
[1207] A "computer device" is a device that includes hardware and software for performing data processing and calculations.
[1208] "Automatically generating questions" means that the system automatically creates new questions based on past questions and question trends.
[1209] "Means for inputting answers" refers to an interface that allows a user to input answers to questions into the system.
[1210] "Determine correctness and generate feedback in real time" means instantly determining whether a user's answer is correct or incorrect and providing immediate evaluation and advice.
[1211] "Analyzing learning progress and identifying areas for improvement" means analyzing the user's learning data and identifying areas that need particular focus and weak points.
[1212] A "knowledge sharing community" is an online platform where users can exchange information and advice with each other.
[1213] "Communication means" means the technical means for transmitting and receiving information and data between a user terminal and a server.
[1214] A "generative AI model" is an algorithm that uses artificial intelligence to create individual curricula and automatically generated questions.
[1215] A "means for generating prompt sentences" is a method or device that creates input sentences to instruct a generative AI model.
[1216] A "user terminal" is a device (smartphone, tablet, PC, etc.) that a user uses to access and operate the system.
[1217] This invention is a learning support system using generative AI for university entrance exam candidates. The system allows users to input and register information such as their desired educational institution and current academic level, generates an individual curriculum, and then automatically generates questions and provides feedback.
[1218] 1. Registration and information entry
[1219] User: When using the system for the first time, the user creates an account using the user interface (smartphone app or web browser). The user enters information such as their name, preferred educational institution, and current academic level to register in the system.
[1220] 2. Creating an individual curriculum
[1221] Server: Once the user's registration information is sent to the server, the server uses a generative AI model to generate an individual curriculum based on the user's information. This generative AI model analyzes past test data and question trends to provide an optimal study plan.
[1222] 3. Automatic question generation
[1223] Server: The server automatically generates new questions using a generative AI model, based on past questions and question trends from the educational institution of the student's choice. This problem generation function ensures that questions are always in line with the latest trends.
[1224] 4. Answers and Feedback
[1225] User: The user enters the answer to the provided question and submits it.
[1226] Server: The server receives the user's answer, uses a generative AI model to determine whether it is correct, and generates real-time feedback on the answer that is returned to the user. This feedback may include an explanation for the answer or suggested next steps.
[1227] 5. Progress Management and Analysis
[1228] Server: The user's answer history is stored in a database, and the generative AI model analyzes their learning progress based on this information. It provides advice based on the user's improvement points and level of understanding, and customizes the next learning step.
[1229] 6. Knowledge Sharing Community
[1230] Users: Users can join a knowledge-sharing community where they can exchange information with other test-takers. This community feature allows test-takers to share advice and information with each other.
[1231] Server: The server manages community posts and comments and provides appropriate information when needed.
[1232] Hardware and software used
[1233] Hardware: The servers use Amazon Web Services (AWS) and Google Cloud Platform (GCP) to provide computing resources, while users use devices such as smartphones and tablets.
[1234] Software: The server uses a Python and Flask web framework and OpenAI's generative AI models as an API.
[1235] Examples and prompts
[1236] Examples:
[1237] If a user is applying to a university in Tokyo and enters their current academic level as "Mathematics: Intermediate, English: Advanced," the server will send the following prompt to the generative AI model.
[1238] Example prompt sentence:
[1239] For curriculum generation: "Generate an individual curriculum based on user information: {'University of choice': 'University in Tokyo', 'Academic level': {'Mathematics': 'Intermediate', 'English': 'Advanced'}}."
[1240] For question generation: "Please create new questions based on past questions and question trends. I am applying to a university in Tokyo."
[1241] This system allows users to prepare for university entrance exams efficiently and effectively.
[1242] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1243] Program processing flow
[1244] Step 1: User registration and information entry
[1245] user:
[1246] A user accesses the system and creates an account by entering the following information: name, email address, desired educational institution, and current academic level. The user enters this information and presses the "Register" button.
[1247] Input: Name, email address, preferred educational institution, current academic level
[1248] Output: User information sent to the server
[1249] Step 2: Creating an individual curriculum
[1250] server:
[1251] Based on the received user information, the server sends prompts to the generative AI model to generate an individual curriculum.
[1252] Input: User information
[1253] Prompt: "Generate a personalized curriculum for your desired university based on your user information: {user information}."
[1254] Output: Individual curriculum
[1255] Step 3: Providing an individualized curriculum
[1256] server:
[1257] The generated individual curriculum is sent to the user's terminal.
[1258] Input: Individualized Curriculum
[1259] Output: Individual curriculum displayed on the user's device
[1260] Step 4: Automatic question generation
[1261] server:
[1262] Based on past questions and question trends from the educational institution of interest, prompts are sent to a generative AI model to generate new questions.
[1263] Input: Information about the educational institution you are applying to
[1264] Prompt: "Based on past exam questions and exam trends, please create a new question for your desired university: {your desired educational institution}."
[1265] Output: New problem
[1266] Step 5: Submit the problem
[1267] server:
[1268] The generated questions are sent to the user's device.
[1269] Input: New problem
[1270] Output: The new problem displayed on the user's terminal
[1271] Step 6: Enter your answers
[1272] user:
[1273] The user enters the answer to the provided question and presses the submit button.
[1274] Input: Answer
[1275] Output: Answer data sent to the server
[1276] Step 7: Validate the answer and generate feedback
[1277] server:
[1278] Based on the received answer data, a generative AI model is used to determine whether the answer is correct or incorrect, and feedback is generated in real time.
[1279] Input: Answer data
[1280] Output: Feedback
[1281] Step 8: Provide feedback
[1282] server:
[1283] The generated feedback is sent to the user device.
[1284] Input: Feedback
[1285] Output: Feedback displayed on the user's terminal
[1286] Step 9: Track and analyze progress
[1287] server:
[1288] The user's answer history is stored in a database, and a generative AI model is used to analyze progress and identify areas for improvement.
[1289] Input: Answer history
[1290] Output: Improvement points and next steps
[1291] Step 10: Provide progress updates
[1292] server:
[1293] The analysis results and points for improvement are sent to the user's device.
[1294] Input: Analysis results, improvement points
[1295] Output: Progress information displayed on the user's terminal
[1296] Step 11: Knowledge Sharing Community
[1297] user:
[1298] Exchange information with other test takers registered in the system.
[1299] Input: Community posts and comments
[1300] Output: Knowledge and information shared within the community
[1301] Step 12: Managing Your Community
[1302] server:
[1303] Moderate posts and comments within the community and provide appropriate information.
[1304] Input: Community data
[1305] Output: Providing appropriate information and community management
[1306] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1307] The embodiments for implementing the system according to the present invention are as follows: In particular, by combining an emotion engine that recognizes the user's emotions, a more efficient and effective learning experience is provided.
[1308] 1. User registration and information entry
[1309] User: When accessing the system for the first time, users enter their name, email address, preferred educational institution, and current academic level (e.g., mathematics, English, etc.) on the account creation page and press the registration button. Registration information also includes basic data for identifying emotions, such as the user's facial expressions and voice data.
[1310] Terminal: Sends the entered information to the server.
[1311] 2. Creating an individual curriculum
[1312] Server: Based on the received user information and emotional data, the AI module generates an individualized curriculum for the specific user. The individualized curriculum is customized based on the user's desired educational institution entrance exam trends, academic level, and current emotional state.
[1313] Terminal: Displays the generated personalized curriculum to the user.
[1314] 3. Automatic question generation
[1315] Server: Using an AI module, it automatically generates past exam questions based on the trends and level of the educational institution the user is applying to, taking into account the user's emotional data and adjusting the difficulty of the questions as necessary.
[1316] Terminal: Automatically generated past questions are displayed to the user.
[1317] 4. Answer entry and feedback
[1318] User: Enters the answer to the provided question and presses the submit button. The answer is sent to the server via the terminal.
[1319] Server: Checks answers against a database of correct answers and generates real-time feedback, taking into account the user's emotional data to provide feedback with the appropriate tone and content.
[1320] Terminal: Display feedback to the user.
[1321] 5. Progress Management and Analysis
[1322] Server: Stores the user's answer history in a database, manages progress and analyzes it along with emotional data, and uses an AI module to identify areas where the user needs to improve.
[1323] Terminal: Progress analysis results are displayed to the user via the terminal.
[1324] 6. Knowledge Sharing Community
[1325] Users: Join the knowledge-sharing community on the platform to exchange information and advice with other test-takers, and an emotion engine supports interactions within the community.
[1326] Device: Through the community feature, users can post and receive feedback from other users.
[1327] Server: Manages posts and comments within the community and provides users with appropriate information as needed.
[1328] Specific examples
[1329] For example, if a user selects "Example University" as their preferred university, the results will be as follows:
[1330] 1. User registration and information entry
[1331] User: Access the platform, select the "example university" as the university of choice, and register by entering their current academic level (e.g., intermediate English, advanced mathematics) and emotional data via facial expressions and voice.
[1332] Device: Sends registration information to the server.
[1333] 2. Creating an individual curriculum
[1334] Server: Based on the received information, the AI generates an individual curriculum and provides a learning plan suited to the user. It also takes into account the user's emotional data and adjusts the curriculum to the appropriate level of difficulty and pace.
[1335] Device: Display the learning plan to the user.
[1336] 3. Automatic question generation
[1337] Server: Recognizes the user's emotional state from facial expressions and voice data, and generates past questions with adjusted difficulty to match the user's emotions.
[1338] Terminal: Provides study questions to users.
[1339] 4. Answer entry and feedback
[1340] User: Answers the questions provided and submits them to the server.
[1341] Server: Checks answers and provides real-time feedback. Feedback content and tone are adjusted based on the user's emotional data.
[1342] Terminal: Display feedback to the user.
[1343] 5. Progress Management and Analysis
[1344] Server: Based on the user's answer history and emotional data, the server analyzes the user's progress in detail and identifies areas where the user needs to improve.
[1345] Terminal: Display progress to the user.
[1346] 6. Knowledge Sharing Community
[1347] Users: Exchange information with other test takers and use the emotion engine to facilitate smooth interactions within the community.
[1348] Device: View posts and comments within the community and encourage interaction with other users.
[1349] In this way, the system according to the present invention can provide a more personalized learning experience by recognizing the user's emotions and incorporating them into adjustments to the learning plan and feedback.
[1350] The processing flow will be explained below.
[1351] Step 1:
[1352] User: Access the platform and enter your name, email address, desired educational institution, current academic level (e.g., mathematics, English, etc.), and facial and voice data on the account creation page, then press the registration button.
[1353] Step 2:
[1354] Terminal: Sends the entered information to the server. If the transmission to the server is successful, displays a confirmation message to the user.
[1355] Step 3:
[1356] Server: Stores the received user information and emotion data in a database. Sends a confirmation message to the device that the data has been saved.
[1357] Step 4:
[1358] Server: Based on the stored user information and emotional data, an AI module is used to generate a personalized curriculum, which is customized based on the user's desired educational institution entrance exam trends, academic level, and current emotional state.
[1359] Step 5:
[1360] Device: The generated individual curriculum is displayed to the user, who then proceeds with their studies based on the curriculum.
[1361] Step 6:
[1362] Server: Based on the question trends of the educational institution the user is applying to, the server uses an AI module to automatically generate past exam questions, taking into account the user's emotional data and adjusting the difficulty of the questions as necessary.
[1363] Step 7:
[1364] Terminal: Automatically generated past questions are displayed to the user, who then works on the questions.
[1365] Step 8:
[1366] User: Enters the answer to the provided question and presses the submit button. The answer is sent to the server via the terminal.
[1367] Step 9:
[1368] Server: Compares the received answers with a database of correct answers and generates feedback in real time. The server also takes into account the user's emotional data to provide appropriate feedback in terms of content and tone.
[1369] Step 10:
[1370] Terminal: Feedback is displayed to the user, who can review the feedback and deepen their understanding.
[1371] Step 11:
[1372] Server: Stores the user's answer history and emotional data in a database, and manages and analyzes the progress using an AI module, thereby identifying areas where the user needs to improve.
[1373] Step 12:
[1374] Device: Progress management and analysis results are displayed to the user, allowing the user to check their own learning progress and take necessary measures.
[1375] Step 13:
[1376] Users: Access knowledge sharing communities to share learning information and advice with other test-takers, and use an emotion engine to support interactions within the community.
[1377] Step 14:
[1378] Server: Analyzes posts and comments within the community using an emotion engine and provides appropriate feedback, thereby providing support that takes into account the user's emotions.
[1379] Step 15:
[1380] On your device: Show users the latest community posts and comments. Users can use the community feature to interact with other test-takers.
[1381] Through the above process, the system based on the present invention enables users to study efficiently through individually customized study plans and automatically generated past questions, and maximizes overall learning effectiveness through real-time feedback, progress management, and community interaction. Furthermore, by using an emotion engine, it provides a learning experience that takes users' emotions into consideration.
[1382] Example 2
[1383] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1384] While conventional learning support systems can provide a curriculum based on a user's learning progress and preferred educational institution, they lack the ability to provide a personalized learning experience that takes into account the user's emotional state. Furthermore, they do not provide feedback that appropriately reflects the user's emotional state during the learning process, nor do they provide questions with difficulty levels that are adjusted according to the user's emotions. As a result, improvements in learning efficiency and motivation cannot be expected. Furthermore, knowledge-sharing communities lacked interaction support based on emotional state, which led to a decline in the quality of communication between users.
[1385] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1386] In this invention, the server includes: means for collecting a user's facial expression data and voice data and identifying emotional data; means including a computer device for generating an individual curriculum based on the input and registered user information and emotional data; and means including a computer device for automatically generating questions based on the trends and level of the educational institution the user is aiming for, and adjusting the difficulty level by taking the user's emotional data into consideration. This makes it possible to generate an individual curriculum and provide questions that take the user's emotional state into consideration, and to adjust the tone and content of feedback according to the user's emotional state. Furthermore, by supporting interactions in knowledge sharing communities using an emotional engine, communication between users can be facilitated, which is expected to improve the quality of learning and motivation.
[1387] "User information" refers to data such as the user's personal information, academic level, and preferred educational institution that is entered into the learning system.
[1388] "Emotional data" refers to data that represents a user's psychological or emotional state obtained from facial expressions and voice analysis.
[1389] "Individualized curriculum" refers to a customized learning plan based on the user's academic level, the requirements of the educational institution of their choice, and their emotional state.
[1390] "Computer device" refers to a computer system or hardware that performs various calculation processes based on user information and emotional data.
[1391] "Auto-generation" refers to the process of using AI modules or algorithms to create specific data (here, questions or curriculum) without human intervention.
[1392] "Feedback" refers to the correctness or incorrectness of the answers entered by the user and advice provided in real time.
[1393] "Progress management" is the process of tracking a user's learning progress and grade changes and identifying areas that need improvement.
[1394] A "knowledge sharing community" is an online forum or platform where candidates and learners can come together to exchange information and advice.
[1395] An "emotion engine" is an algorithm or software that analyzes a user's emotional data and appropriately adjusts interactions based on that data.
[1396] The system based on the present invention aims to utilize user emotional data to personalize the entire learning process, from generating an individual curriculum to providing questions, feedback, progress management, and a knowledge sharing community.
[1397] User registration and information entry
[1398] When a user first accesses the platform, they enter their name, email address, preferred educational institution, and current academic level (e.g., math, English) on the account creation page. The device also uses a camera and microphone to collect facial and voice data, which is then saved as emotion data. The device then packages this information and data and sends it to the server. The server then stores the received information in a database and notifies the user that registration is complete.
[1399] Creating an individual curriculum
[1400] The server uses an AI module to analyze the stored user information and emotional data. This AI module takes into account the user's entrance exam trends, academic level, and emotional state to generate an individualized learning plan. The generated curriculum includes optimal learning content and progress pace and is displayed to the user via their device.
[1401] Automatic question generation
[1402] The server uses an AI model to automatically generate past exam questions tailored to the trends and level of the educational institution the user is applying to. It also takes into account the user's emotional data and adjusts the difficulty of the questions as needed. The generated questions are then provided to the user via their device.
[1403] Answer entry and feedback
[1404] When a user enters an answer to a given question and presses the submit button, the answer data is sent to the server via the device. The server compares the received answer with a database of correct answers and generates feedback in real time. The feedback takes into account the user's emotional data and adjusts the tone and content appropriately. This feedback information is displayed to the user via the device.
[1405] Progress management and analysis
[1406] The server stores the user's answer history and emotional data in a database, and manages and analyzes their progress. The AI module analyzes this data, identifies areas where the user needs to improve, and generates advice based on that. The analysis results are displayed to the user via their device.
[1407] Knowledge Sharing Community
[1408] Users can join the knowledge-sharing community on the platform and exchange information and advice with other test-takers. An emotion engine supports smooth interactions with posts and comments within the community. The device displays community posts and comments, encouraging interaction with other users.
[1409] Examples of concrete examples and prompts
[1410] For example, if a user is applying to "Example University" and has set their current academic level as intermediate in English and advanced in mathematics, they would input the following prompt sentence into the generative AI model.
[1411] "Please write AI code that allows a user to select the 'example university' as their preferred university, set their current academic level as intermediate in English and advanced in mathematics, and generate an individualized curriculum based on that."
[1412] In this way, the system based on the present invention realizes advanced personalization that utilizes the user's emotional data, thereby maximizing the learning experience.
[1413] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1414] Step 1:
[1415] User registration and information entry
[1416] When a user first accesses the system, they enter their name, email address, preferred educational institution, and current academic level on the account creation page. The system also uses a camera and microphone to collect facial expression and voice data, and the input information registered as emotion data includes text and multimedia data.
[1417] Terminal: Packages input information and sends it to the server. Specifically, it bundles text and multimedia files entered in web forms or smartphone apps into a single request and sends it using the HTTP protocol.
[1418] Step 2:
[1419] Receiving and storing information
[1420] Server: The received user information and emotion data are stored in a database. Furthermore, the server generates user identification information based on the stored data and sends a confirmation email. The received data includes the user's personal information, academic achievement information, and emotion data. This data is stored in a database management system such as MySQL or PostgreSQL.
[1421] Step 3:
[1422] Creating an individual curriculum
[1423] Server: Analyzes the stored user information and emotional data and generates an individualized curriculum using a specific algorithm. Specifically, a machine learning model (using, for example, TensorFlow or PyTorch) is used to customize a learning plan based on the user's academic level and the trends of the educational institution they wish to attend. Emotional data is also input into the AI model to adjust the difficulty and pace of the lesson. The generated curriculum is sent to the device in JSON format.
[1424] Step 4:
[1425] View Curriculum
[1426] Device: The device displays the received personalized curriculum to the user. The curriculum is rendered as a user interface using HTML and CSS, and interactive elements are added using JavaScript as needed, allowing the user to see the learning plan that best suits them.
[1427] Step 5:
[1428] Automatic question generation
[1429] Server: Using an AI model, past exam questions are generated that are tailored to the trends and level of the educational institution the user is applying to. Emotional data is also taken into account to adjust the difficulty of the questions. The generated questions are then converted back into JSON format and sent to the device. Specifically, the AI model references a database of past entrance exam questions and constructs questions based on specific rules.
[1430] Step 6:
[1431] Displaying past questions
[1432] Terminal: The generated past questions are displayed to the user. The questions are dynamically rendered using JavaScript using HTML templates. Specific instructions for entering answers are also displayed.
[1433] Step 7:
[1434] Enter and submit your answers
[1435] User: Enters the answer to the provided question and presses the submit button. The answer is sent in text format to the server via the terminal. Specifically, when the user enters the answer in the input form and presses the submit button, the data is sent to the server as an HTTP request using JavaScript.
[1436] Step 8:
[1437] Receiving answers and feedback
[1438] Server: Compares the received answers with a database of correct answers and generates real-time feedback using an AI model. It takes into account emotional data and adjusts the tone and content of the feedback. Feedback based on the comparison results is generated in JSON format and sent to the device.
[1439] Step 9:
[1440] View Feedback
[1441] Device: Displays feedback information to the user. The display is done using HTML and CSS, and the content and tone of the feedback are adjusted based on the user's emotional state. Specifically, it parses the feedback data in JSON format, inserts it into an HTML template, and displays it.
[1442] Step 10:
[1443] Progress management and analysis
[1444] Server: Stores the user's answer history and sentiment data in a database, and manages and analyzes their progress. It uses AI models to identify the user's weaknesses and areas for improvement, and adjusts their learning plan accordingly. Specifically, it periodically analyzes the stored data and updates the individual curriculum and learning advice based on the results.
[1445] Step 11:
[1446] View progress results
[1447] Device: Receives the analysis results and displays them to the user. The user can check their progress and understand what they are being evaluated on and what they should study next. The analysis results are displayed visually in an easy-to-understand manner using HTML and CSS.
[1448] Step 12:
[1449] Join our knowledge sharing community
[1450] Users: Join the knowledge-sharing community on the platform and exchange information and advice with other test-takers. An emotion engine supports user-to-user interactions. Posts and comments are in text format, and the interface is rendered using HTML and JavaScript.
[1451] Step 13:
[1452] Community Management
[1453] Server: Moderates posts and comments within the community and provides appropriate information to users when necessary. This includes filtering inappropriate posts. It also uses AI models to support positive interactions based on sentiment data.
[1454] (Application example 2)
[1455] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1456] Conventional learning systems lack the ability to recognize users' emotions in real time and optimize learning content and feedback based on that. Furthermore, virtual shopping environments lack product recommendations and customer service that take user emotions into account, leaving a need for improved user experience. Given this situation, it is necessary to develop a system that recognizes users' emotions in real time and provides personalized learning and shopping experiences accordingly.
[1457] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1458] In this invention, the server includes: means for inputting and registering information such as the user's desired educational institution and current academic level; means including a computer device for generating an individual curriculum based on the inputted and registered user information; means including a computer device for automatically generating questions based on the user's desired educational institution and level; means for the user to input answers to the provided questions; means including a computer device for receiving the user's answers, determining whether they are correct or incorrect, and generating feedback in real time; means including a computer device for analyzing the user's learning progress and identifying areas for improvement; means for the user to share information with other test takers in a knowledge-sharing community; and means for recognizing the user's emotions in real time and providing personalized product suggestions and customer service, thereby enabling a personalized learning and virtual shopping experience based on the user's emotions.
[1459] "User" means an individual who uses the system to learn or shop.
[1460] "Educational institution" refers to a place of learning such as a school, university, or vocational school that the user wishes to attend.
[1461] "Academic level" refers to a number or rating entered by the user that indicates the current level of knowledge and skill in each subject.
[1462] "Individual Curriculum" refers to a customized learning plan generated based on the characteristics of the educational institution the user is interested in, as well as the user's academic level and emotional data.
[1463] "Emotional data" refers to information that indicates the emotional state of the user, obtained from facial expressions, voice, etc.
[1464] "Computer equipment" means a device that includes hardware and software for inputting and registering information, generating individualized curriculum, automatically generating questions, analyzing answers, providing real-time feedback, and analyzing progress.
[1465] "Automatic question generation" refers to the process of using an AI module to generate appropriate study questions based on the trends and academic level of the educational institution the user is applying to.
[1466] "Answer" refers to the answer that a user enters in response to a given question.
[1467] "Feedback" refers to the evaluation and advice provided to users based on real-time judgment of whether their answers are correct or incorrect.
[1468] "Analyzing learning progress" refers to the process of identifying a user's learning progress and areas for improvement based on the user's answer history and sentiment data.
[1469] A "knowledge sharing community" is an online platform where users can exchange study information and advice with other test takers.
[1470] "Means for recognizing emotions in real time" refers to technology that analyzes a user's facial expressions and voice to instantly determine their current emotional state.
[1471] "Personalized product suggestions" refers to the process of recommending products that are suited to individual users based on their emotional data and purchasing history.
[1472] "Customer service" refers to the assistance and support provided to users by avatars and chatbots in virtual stores.
[1473] The embodiment of the system according to the present invention is as follows: In particular, to provide a learning system and a virtual shopping environment combined with an emotion engine, the system includes the following specific steps:
[1474] First, the user accesses the system and registers and enters information. The user enters their name, email address, favorite categories (learning or shopping), past progress and purchase history, and emotional data such as facial expressions and voice data. This information is then sent to the server via the device.
[1475] The server generates personalized curriculum and product recommendations based on the received user information and emotional data. In the case of the learning system, the personalized curriculum is customized based on the user's educational preference, academic level, and current emotional state. In the case of virtual shopping, product recommendations are made in real time based on the emotional data.
[1476] The generated individual curriculum and product suggestions are displayed to the user via their device, allowing them to have a personalized learning plan and shopping experience.
[1477] In the learning system, the server automatically generates questions based on the trends and level of the educational institution the user is applying to. The generated questions are then sent to the server, with the user entering the answers via their device. The server then judges the answers in real time and generates feedback. The content and tone of the feedback are adjusted based on the user's emotional data.
[1478] The server also stores the user's answer history and emotional data in a database. Based on the stored data, the server analyzes the user's learning progress and identifies areas that need improvement. The user is notified of the analysis results via their device.
[1479] In the knowledge sharing community, users can share information and advice with other test-takers and shoppers. The server manages posts and comments within the community and supports smooth interactions with an emotion engine.
[1480] For example, if a user is wearing smart glasses in a virtual shopping environment, the system will highlight related product suggestions if the user's facial expression indicates interest. Conversely, if the user indicates dissatisfaction, the system will suggest products in a different category. Furthermore, if the user gazes at a particular item for a long time, the system will automatically display reviews and detailed information related to that item.
[1481] The prompt sentences include the following:
[1482] "Capture facial expression data in real time while the user is wearing the glasses, perform sentiment analysis, and optimize product suggestions in the virtual store. Specifically, if the user expresses positive sentiment toward a certain product, immediately recommend related products. Also, if the user expresses negative sentiment, build a system that suggests products from a different category."
[1483] The system based on this invention uses cloud services such as TensorFlow, Amazon Web Services (AWS), and Google Cloud to analyze emotional data and provide customized learning plans and product recommendations, thereby enabling personalized learning and virtual shopping experiences based on the user's emotions.
[1484] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1485] Step 1:
[1486] The user accesses the system. They input their name, email address, favorite category (study or shopping), past progress and purchase history, and emotional data such as facial expressions and voice data, and send this data to the server from their device. The input data also includes the user's preferred educational institution and academic level.
[1487] Step 2:
[1488] The server analyzes the received user information and emotional data. Specifically, it uses an AI module to generate an individualized curriculum, taking into account the trends of the user's preferred educational institution and their academic level. The emotional data is also analyzed, and the difficulty and content of the curriculum are adjusted based on the user's current emotional state. The output is a customized learning plan or product recommendations.
[1489] Step 3:
[1490] The generated personalized curriculum and product suggestions are displayed to the user via their device. The user can then review the displayed curriculum and products. The displayed content reflects the user's emotional state in real time and dynamically changes according to the user's interests and dissatisfaction.
[1491] Step 4:
[1492] In the case of the learning system, the server automatically generates questions based on the trends of the educational institution the user is applying to and their academic level. Using past exam questions and mock test data, the AI module generates appropriate questions. Emotional data is also taken into account, and adjustments are made, such as lowering the difficulty of questions if the user is feeling stressed.
[1493] In the case of a shopping system, the server provides detailed information about a particular product and displays related product lists and promotional information.
[1494] Step 5:
[1495] The user enters the answer to the generated question and sends it to the server via their device. The server compares the answer with a database of correct answers and generates real-time feedback. This feedback is also adjusted based on the emotional data, and is presented to the user with an appropriate tone and content.
[1496] Step 6:
[1497] The server stores the user's answer history and emotional data in a database. The stored data is used to analyze the user's learning progress. This analysis includes the accuracy and speed of the user's answers, changes in their emotional state, etc. The progress is analyzed in detail to identify areas that need improvement.
[1498] Step 7:
[1499] In the knowledge sharing community, users can share information and advice with other test takers and shoppers. The terminal uses an emotion engine to support interactions within the community and improve the user experience. The server manages posts and comments within the community and provides users with appropriate information as needed.
[1500] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1501] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1502] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1503] [Fourth embodiment]
[1504] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1505] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1506] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1507] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1508] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1509] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1510] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1511] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1512] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1513] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1514] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1515] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1516] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1517] The embodiment of the system according to the present invention is as follows: This system is targeted at university entrance exam candidates and provides individually customized study plans and past exam questions using generative AI.
[1518] 1. User registration and information entry
[1519] User: When using this system for the first time, the user accesses the platform and opens the page to create an account. The user enters their name, email address, preferred educational institution, and current academic level (e.g., mathematics, English, etc.), and presses the registration button. This allows the user's basic information to be collected.
[1520] Terminal: The entered information is sent to the server via the terminal.
[1521] 2. Creating an individual curriculum
[1522] Server: Based on the received user information, the server uses an AI module to generate a personalized curriculum for each specific user, customized based on the user's desired educational institution entrance exam trends and current academic level.
[1523] Terminal: The generated individual curriculum is displayed to the user via the terminal, allowing the user to proceed with their studies according to the curriculum.
[1524] 3. Automatic question generation
[1525] Server: The AI module installed on the server automatically generates new questions based on past exam questions and question trends from the educational institution the user is applying to. This problem generation function allows users to tackle the latest questions.
[1526] Terminal: The automatically generated questions are provided to the user via the terminal, where the user can answer them.
[1527] 4. Answer entry and feedback
[1528] User: Enters the answer to the provided question and presses the submit button. The entered answer is sent to the server via the terminal.
[1529] Server: The server checks the answers received and determines whether they are correct. Using an AI module, it generates real-time feedback and provides it to the user. This feedback allows the user to check their understanding and further their learning.
[1530] Terminal: Feedback is displayed to the user via the terminal.
[1531] 5. Progress Management and Analysis
[1532] Server: Stores the user's answer history in a database and analyzes the user's learning progress based on this. It uses an AI module to identify areas that the user needs to improve and generate further learning advice.
[1533] Device: Progress analysis results are displayed to users via their device, allowing them to understand their learning progress in real time and plan their learning accordingly.
[1534] 6. Knowledge Sharing Community
[1535] Users can join the knowledge-sharing community on the platform and exchange information and advice with other test-takers, which not only helps users deepen their own knowledge but also helps them stay motivated by learning together with other test-takers.
[1536] Device: Through the community feature, users can post and receive feedback from other users.
[1537] Server: Manages posts and comments within the community and provides users with appropriate information as needed.
[1538] Specific examples
[1539] For example, if a user selects the University of Tokyo as their preferred university, the following will occur:
[1540] User: Access the platform, select the University of Tokyo as their preferred university, enter their current academic level in English, mathematics (Math III), etc., and register.
[1541] Device: Sends registration information to the server.
[1542] Server: Based on the received information, the AI generates an individual curriculum and provides a learning plan suited to the user. It also automatically generates new questions based on past questions and question trends from the University of Tokyo and provides them to the user via their device.
[1543] User: Enters answers to the questions provided and submits them to the server.
[1544] Server: Checks answers, generates real-time feedback and provides it to users via their devices. It also analyzes users' answer history to identify progress and areas for improvement.
[1545] Users: Study based on the feedback provided and share information with other test takers in the community.
[1546] In this way, the system based on the present invention enables users to efficiently prepare for university entrance exams through individually customized study plans and questions, real-time feedback, progress management, and a knowledge-sharing community.
[1547] The processing flow will be explained below.
[1548] Step 1:
[1549] User: Access the platform and enter your name, email address, desired educational institution, and current academic level (e.g., mathematics, English, etc.) on the account creation page, then press the registration button.
[1550] Step 2:
[1551] Terminal: Sends the entered information to the server. If the transmission to the server is successful, displays a confirmation message to the user.
[1552] Step 3:
[1553] Server: Stores the received user information in a database and sends a confirmation message to the device that the information has been saved.
[1554] Step 4:
[1555] Server: Based on the saved user information, an AI module is used to generate an individual curriculum, which is customized according to the entrance exam trends and academic ability level of the educational institution the user wishes to attend.
[1556] Step 5:
[1557] Device: The generated individual curriculum is displayed to the user, who then proceeds with their studies based on the curriculum.
[1558] Step 6:
[1559] Server: Generates automatically generated past exam questions using an AI module based on the question trends of the educational institution the user is applying to.
[1560] Step 7:
[1561] Terminal: Automatically generated past questions are displayed to the user, who then works on the questions.
[1562] Step 8:
[1563] User: Enters the answer to the provided question and presses the submit button. The answer is sent to the server via the terminal.
[1564] Step 9:
[1565] Server: Compares the received answers with a database of correct answers and generates real-time feedback. Feedback is automatically generated based on the user's input.
[1566] Step 10:
[1567] Terminal: Feedback is displayed to the user, who can review the feedback and deepen their understanding.
[1568] Step 11:
[1569] Server: Stores the user's answer history in a database and manages and analyzes the progress using an AI module, thereby identifying areas where the user needs to improve.
[1570] Step 12:
[1571] Device: Progress management and analysis results are displayed to the user, allowing the user to check their own learning progress and take necessary measures.
[1572] Step 13:
[1573] Users: Access knowledge sharing communities to share study tips and advice with other test takers. Gain more insight through posts and comments.
[1574] Step 14:
[1575] Server: Manage posts and comments within the community, moderate them as needed, and help ensure the right information is shared.
[1576] Step 15:
[1577] On your device: Show users the latest community posts and comments. Users can use the community feature to interact with other test-takers.
[1578] Through the above process, the system based on the present invention enables users to study efficiently through individually customized study plans and automatically generated past questions, and maximizes overall learning effectiveness through real-time feedback, progress management, and community interaction.
[1579] Example 1
[1580] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1581] Conventional learning support systems often lack the ability to customize to meet the individual learning needs of each user, and instead provide a standardized learning method. As a result, users' learning efficiency and motivation decline, and it becomes difficult to manage individual progress and identify areas for improvement. In addition, real-time feedback functions are limited, making it difficult for users to immediately correct their learning direction.
[1582] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1583] In this invention, the server includes: means for inputting and registering information such as the user's desired educational institution and current academic level; means including a generative AI model for generating an individual curriculum based on the input and registered user information; means including a computer device for automatically generating questions based on the user's desired educational institution and level; means for the user to input answers to the questions provided; means including a computer device for receiving the user's answers, determining whether they are correct, and generating feedback in real time; means for analyzing the user's learning progress, identifying areas for improvement, analyzing the answer data based on the user's past answer history, and visualizing the learning progress; and means for the user to share information with other test-takers in a knowledge-sharing community. This enables customized learning according to individual learning needs, and significantly improves user learning efficiency by enhancing real-time feedback and progress management.
[1584] "User" refers to an individual who uses this system to learn.
[1585] "Educational institution" refers to an organization such as a school or university to which the user aspires.
[1586] "Academic ability level" refers to a numerical value or evaluation that indicates the user's current level of understanding and knowledge in each subject (e.g., mathematics, English, etc.).
[1587] "Individual curriculum" refers to a customized study plan based on the entrance exam trends of the educational institution the user wishes to attend and their current academic level.
[1588] "Generative AI models" refer to artificial intelligence technology that generates curriculum and questions based on user information. Specifically, they use algorithms for natural language processing and machine learning.
[1589] "Computer device" refers to a computer system or part thereof that performs various calculations and data processing.
[1590] "Real-time feedback" refers to the immediate evaluation and advice that users receive immediately after answering a question.
[1591] "Learning progress" refers to an indicator that shows how much understanding a user has gained as they progress through their studies and how close they are to achieving their goals.
[1592] "Improvement points" refer to the learning content or skills that users need to focus on improving or strengthening through further study.
[1593] "Answer history" refers to data that records the results and process of all questions that a user has answered within the system.
[1594] A "knowledge sharing community" refers to an online forum for exchanging information and advice with other users of the system.
[1595] An embodiment of a system according to the present invention is described in detail below: The invention provides individually customized study plans and past exam questions for university entrance exam candidates.
[1596] The system begins with users accessing the learning platform, creating an account, and registering their academic ability information. Next, it uses a generative AI model to generate a personalized curriculum optimized for the user, including the automatic generation of questions. It then receives answers from users, provides real-time feedback, analyzes their progress, and identifies areas for improvement. Finally, users can exchange information with other test-takers in a knowledge-sharing community.
[1597] Hardware / Software Configuration
[1598] server:
[1599] 1. Database: A database such as MySQL is used to store user information, answer history, and progress data.
[1600] 2. Generative AI models: Generative AI models such as OpenAI GPT-3 are used to generate individualized curricula and automatically generate questions.
[1601] 3. Feedback module: Uses an AI module to receive the user's answers and generate feedback in real time.
[1602] 4. Progress Analysis Module: Uses data analysis tools to analyze users' learning progress and identify areas for improvement.
[1603] Device:
[1604] 1. User Interface: Provides an interface for users to enter information and answer questions, typically in the form of a web browser or mobile app.
[1605] 2. Display module: displays the curriculum, questions, feedback, and progress data sent from the server.
[1606] user:
[1607] 1. Enter information: The user enters their name, email address, preferred educational institution, and current academic level into the input fields on the device.
[1608] 2. Answering questions: The user enters answers to the provided learning questions and submits them via the terminal.
[1609] 3. Receiving feedback: The feedback sent from the server is checked through the display module on the device, and the learning course is corrected.
[1610] 4. Knowledge sharing: Use the community feature to share information with other users.
[1611] Examples of concrete examples and prompts
[1612] For example, if a user selects "University A" as the university of choice and enters "Mathematics (Math III)" and "English" as their current academic level, the following processing will occur.
[1613] Example prompt sentence:
[1614] 1. When registering as a user: "Please enter the educational institution you wish to apply to and your current academic level."
[1615] 2. When generating a curriculum: "Generate a personalized curriculum based on the academic level and desired educational institution you enter."
[1616] 3. When automatically generating questions: "Please generate new questions based on past questions and question trends from University A."
[1617] 4. When generating feedback: "Check the user's answers and generate feedback in real time."
[1618] The system allows users to work on customized study curriculums and questions based on the entrance exam trends of their desired universities, and improves study efficiency by receiving real-time feedback. It also allows users to study while exchanging information with other test-takers through progress visualization and a knowledge-sharing community.
[1619] As described above, the system of the present invention provides each user with an optimized learning experience, realizing effective learning support that meets individual needs.
[1620] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1621] Step 1: User Access and Account Creation
[1622] User: Visits the system's website or app, opens the account creation page, and enters their name, email address, preferred educational institution, and current academic level.
[1623] Input: Name, email address, desired educational institution, current academic level
[1624] Output: Information entered by the user
[1625] Specific operation: When the user presses the registration button, the input information is sent from the device to the server.
[1626] Step 2: Send and store user information
[1627] Device: Sends user input information to the server via an API request.
[1628] Server: Stores the received user information in a database.
[1629] Input: Information entered by the user
[1630] Output: User information stored in the database
[1631] Specific operation: The server receives the user information and stores it in a database such as MySQL.
[1632] Step 3: Create an individual curriculum
[1633] Server: Retrieves user information from a database and passes it as input to a generative AI model (e.g., OpenAI GPT-3).
[1634] Input: User information retrieved from the database
[1635] Output: Generated individual curriculum
[1636] How it works: The AI model generates a customized curriculum based on the user's academic level and preferred educational institution data, and sends it to the user's device.
[1637] Step 4: Submit and view the curriculum
[1638] Server: Sends the generated individual curriculum to the user's device.
[1639] Terminal: Display the received curriculum on the screen.
[1640] Input: Generated individual curriculum
[1641] Output: Individual curriculum displayed on the device
[1642] Specific behavior: The user progresses through the learning process based on the curriculum.
[1643] Step 5: Automatic question generation
[1644] Server: New questions are generated using a generative AI model based on the user's learning progress and past exam data from the educational institution of their choice.
[1645] Input: User's learning progress data, past exam data from the educational institution of choice
[1646] Output: New automatically generated questions
[1647] Specific operation: The AI model analyzes past exam data, generates new questions, and sends them to the device.
[1648] Step 6: Submit and view the issue
[1649] Server: Sends the generated new questions to the user's device.
[1650] Terminal: Displays received questions on the screen.
[1651] Input: The new question to be generated
[1652] Output: The problem displayed on the terminal
[1653] Specific behavior: The user answers the displayed question.
[1654] Step 7: Enter your answers
[1655] User: Enter the answer to the displayed question and press the submit button.
[1656] Input: Answer to the question
[1657] Output: Submitted answer data
[1658] Specific operation: The user's answer data is sent to the server via the device.
[1659] Step 8: Submitting and judging your answers
[1660] Terminal: Sends the user's answer data to the server.
[1661] Server: The AI module analyzes the received answer data and determines whether it is correct or incorrect.
[1662] Input: Submitted answer data
[1663] Output: Correctness of the answer
[1664] Specific operation: The AI module analyzes the answer and determines whether it is correct or incorrect.
[1665] Step 9: Generate and submit feedback
[1666] Server: Generates real-time feedback based on the correctness of the answers.
[1667] Input: Correct / incorrect answer result
[1668] Output: Generated real-time feedback
[1669] Specific operation: The server generates feedback including the percentage of correct answers, explanations, and further study advice, and sends it to the device.
[1670] Step 10: View feedback
[1671] Terminal: Display received feedback to the user.
[1672] Input: Generated real-time feedback
[1673] Output: Feedback displayed on the terminal
[1674] What happens: Users use the feedback to make course corrections.
[1675] Step 11: Track your progress and focus
[1676] Server: Analyzes progress data based on the user's answer history and identifies areas for improvement.
[1677] Input: Answer history data
[1678] Output: Progress data and identified areas for improvement
[1679] Specific operation: The server sends progress data and enhancement points to the user's device.
[1680] Step 12: Viewing your progress and improvement points
[1681] Terminal: Displays progress data and enhancement points on the screen.
[1682] Input: Progress data and identified areas for improvement
[1683] Output: Progress data and improvement points displayed on the terminal
[1684] Specific action: The user uses this to revise their study plan.
[1685] Step 13: Join a knowledge sharing community
[1686] Users: Use the community feature to exchange information and advice with other test takers.
[1687] Input: Post content, comment
[1688] Output: Share information with other users, feedback
[1689] What it does: Users post questions and experiences and receive comments and advice from other users.
[1690] The above is a detailed flow of program processing in this system.
[1691] (Application example 1)
[1692] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1693] In recent years, the learning needs of university entrance exam candidates have become more diverse, requiring individually customized study plans and questions based on the latest exam trends. However, manually creating individual curricula, providing real-time feedback on question answers, and efficiently managing progress are extremely difficult, making it difficult to provide the efficient learning environment that test takers require. Furthermore, knowledge sharing and information exchange with other test takers are also important elements, but no system exists that can consistently provide these. To solve these problems, a system that provides individually customized study plans using generative AI is needed.
[1694] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1695] In this invention, the server includes: means for inputting and registering information such as the user's desired educational institution and current academic level; means including a computer device for generating an individualized curriculum based on the inputted and registered user information; means including a computer device for automatically generating questions based on the user's desired educational institution and level; means for the user to input answers to the provided questions; means including a computer device for receiving the user's answers, determining whether they are correct, and generating feedback in real time; means including a computer device for analyzing the user's learning progress and identifying areas for improvement; means for the user to share information with other test takers in a knowledge sharing community; communication means for transmitting user information and answer data from the terminal to the server; means for providing the individualized curriculum and automatically generated questions based on the generative AI model to the user terminal; and means for generating prompts to input to the generative AI model. This dramatically improves the efficiency and effectiveness of university entrance exam preparation and enables test takers to easily use a study plan that is tailored to them.
[1696] The "desired educational institution" is an educational institution such as a university or vocational school that the user wishes to enroll in.
[1697] "Current academic level" is an indicator that shows the user's level of understanding and proficiency in each subject.
[1698] "Means for input / registration" refers to an interface that allows users to provide the system with information such as their desired educational institution and academic level.
[1699] An "individualized curriculum" is a customized learning plan based on the user's goals and current academic ability.
[1700] A "computer device" is a device that includes hardware and software for performing data processing and calculations.
[1701] "Automatically generating questions" means that the system automatically creates new questions based on past questions and question trends.
[1702] "Means for inputting answers" refers to an interface that allows a user to input answers to questions into the system.
[1703] "Determine correctness and generate feedback in real time" means instantly determining whether a user's answer is correct or incorrect and providing immediate evaluation and advice.
[1704] "Analyzing learning progress and identifying areas for improvement" means analyzing the user's learning data and identifying areas that need particular focus and weak points.
[1705] A "knowledge sharing community" is an online platform where users can exchange information and advice with each other.
[1706] "Communication means" means the technical means for transmitting and receiving information and data between a user terminal and a server.
[1707] A "generative AI model" is an algorithm that uses artificial intelligence to create individual curricula and automatically generated questions.
[1708] A "means for generating prompt sentences" is a method or device that creates input sentences to instruct a generative AI model.
[1709] A "user terminal" is a device (smartphone, tablet, PC, etc.) that a user uses to access and operate the system.
[1710] This invention is a learning support system using generative AI for university entrance exam candidates. The system allows users to input and register information such as their desired educational institution and current academic level, generates an individual curriculum, and then automatically generates questions and provides feedback.
[1711] 1. Registration and information entry
[1712] User: When using the system for the first time, the user creates an account using the user interface (smartphone app or web browser). The user enters information such as their name, preferred educational institution, and current academic level to register in the system.
[1713] 2. Creating an individual curriculum
[1714] Server: Once the user's registration information is sent to the server, the server uses a generative AI model to generate an individual curriculum based on the user's information. This generative AI model analyzes past test data and question trends to provide an optimal study plan.
[1715] 3. Automatic question generation
[1716] Server: The server automatically generates new questions using a generative AI model, based on past questions and question trends from the educational institution of the student's choice. This problem generation function ensures that questions are always in line with the latest trends.
[1717] 4. Answers and Feedback
[1718] User: The user enters the answer to the provided question and submits it.
[1719] Server: The server receives the user's answer, uses a generative AI model to determine whether it is correct, and generates real-time feedback on the answer that is returned to the user. This feedback may include an explanation for the answer or suggested next steps.
[1720] 5. Progress Management and Analysis
[1721] Server: The user's answer history is stored in a database, and the generative AI model analyzes their learning progress based on this information. It provides advice based on the user's improvement points and level of understanding, and customizes the next learning step.
[1722] 6. Knowledge Sharing Community
[1723] Users: Users can join a knowledge-sharing community where they can exchange information with other test-takers. This community feature allows test-takers to share advice and information with each other.
[1724] Server: The server manages community posts and comments and provides appropriate information when needed.
[1725] Hardware and software used
[1726] Hardware: The servers use Amazon Web Services (AWS) and Google Cloud Platform (GCP) to provide computing resources, while users use devices such as smartphones and tablets.
[1727] Software: The server uses a Python and Flask web framework and OpenAI's generative AI models as an API.
[1728] Examples and prompts
[1729] Examples:
[1730] If a user is applying to a university in Tokyo and enters their current academic level as "Mathematics: Intermediate, English: Advanced," the server will send the following prompt to the generative AI model.
[1731] Example prompt sentence:
[1732] For curriculum generation: "Generate an individual curriculum based on user information: {'University of choice': 'University in Tokyo', 'Academic level': {'Mathematics': 'Intermediate', 'English': 'Advanced'}}."
[1733] For question generation: "Please create new questions based on past questions and question trends. I am applying to a university in Tokyo."
[1734] This system allows users to prepare for university entrance exams efficiently and effectively.
[1735] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1736] Program processing flow
[1737] Step 1: User registration and information entry
[1738] user:
[1739] A user accesses the system and creates an account by entering the following information: name, email address, desired educational institution, and current academic level. The user enters this information and presses the "Register" button.
[1740] Input: Name, email address, preferred educational institution, current academic level
[1741] Output: User information sent to the server
[1742] Step 2: Creating an individual curriculum
[1743] server:
[1744] Based on the received user information, the server sends prompts to the generative AI model to generate an individual curriculum.
[1745] Input: User information
[1746] Prompt: "Generate a personalized curriculum for your desired university based on your user information: {user information}."
[1747] Output: Individual curriculum
[1748] Step 3: Providing an individualized curriculum
[1749] server:
[1750] The generated individual curriculum is sent to the user's terminal.
[1751] Input: Individualized Curriculum
[1752] Output: Individual curriculum displayed on the user's device
[1753] Step 4: Automatic question generation
[1754] server:
[1755] Based on past questions and question trends from the educational institution of interest, prompts are sent to a generative AI model to generate new questions.
[1756] Input: Information about the educational institution you are applying to
[1757] Prompt: "Based on past exam questions and exam trends, please create a new question for your desired university: {your desired educational institution}."
[1758] Output: New problem
[1759] Step 5: Submit the problem
[1760] server:
[1761] The generated questions are sent to the user's device.
[1762] Input: New problem
[1763] Output: The new problem displayed on the user's terminal
[1764] Step 6: Enter your answers
[1765] user:
[1766] The user enters the answer to the provided question and presses the submit button.
[1767] Input: Answer
[1768] Output: Answer data sent to the server
[1769] Step 7: Validate the answer and generate feedback
[1770] server:
[1771] Based on the received answer data, a generative AI model is used to determine whether the answer is correct or incorrect, and feedback is generated in real time.
[1772] Input: Answer data
[1773] Output: Feedback
[1774] Step 8: Provide feedback
[1775] server:
[1776] The generated feedback is sent to the user device.
[1777] Input: Feedback
[1778] Output: Feedback displayed on the user's terminal
[1779] Step 9: Track and analyze progress
[1780] server:
[1781] The user's answer history is stored in a database, and a generative AI model is used to analyze progress and identify areas for improvement.
[1782] Input: Answer history
[1783] Output: Improvement points and next steps
[1784] Step 10: Provide progress updates
[1785] server:
[1786] The analysis results and points for improvement are sent to the user's device.
[1787] Input: Analysis results, improvement points
[1788] Output: Progress information displayed on the user's terminal
[1789] Step 11: Knowledge Sharing Community
[1790] user:
[1791] Exchange information with other test takers registered in the system.
[1792] Input: Community posts and comments
[1793] Output: Knowledge and information shared within the community
[1794] Step 12: Managing Your Community
[1795] server:
[1796] Moderate posts and comments within the community and provide appropriate information.
[1797] Input: Community data
[1798] Output: Providing appropriate information and community management
[1799] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1800] The embodiments for implementing the system according to the present invention are as follows: In particular, by combining an emotion engine that recognizes the user's emotions, a more efficient and effective learning experience is provided.
[1801] 1. User registration and information entry
[1802] User: When accessing the system for the first time, users enter their name, email address, preferred educational institution, and current academic level (e.g., mathematics, English, etc.) on the account creation page and press the registration button. Registration information also includes basic data for identifying emotions, such as the user's facial expressions and voice data.
[1803] Terminal: Sends the entered information to the server.
[1804] 2. Creating an individual curriculum
[1805] Server: Based on the received user information and emotional data, the AI module generates an individualized curriculum for the specific user. The individualized curriculum is customized based on the user's desired educational institution entrance exam trends, academic level, and current emotional state.
[1806] Terminal: Displays the generated personalized curriculum to the user.
[1807] 3. Automatic question generation
[1808] Server: Using an AI module, it automatically generates past exam questions based on the trends and level of the educational institution the user is applying to, taking into account the user's emotional data and adjusting the difficulty of the questions as necessary.
[1809] Terminal: Automatically generated past questions are displayed to the user.
[1810] 4. Answer entry and feedback
[1811] User: Enters the answer to the provided question and presses the submit button. The answer is sent to the server via the terminal.
[1812] Server: Checks answers against a database of correct answers and generates real-time feedback, taking into account the user's emotional data to provide feedback with the appropriate tone and content.
[1813] Terminal: Display feedback to the user.
[1814] 5. Progress Management and Analysis
[1815] Server: Stores the user's answer history in a database, manages progress and analyzes it along with emotional data, and uses an AI module to identify areas where the user needs to improve.
[1816] Terminal: Progress analysis results are displayed to the user via the terminal.
[1817] 6. Knowledge Sharing Community
[1818] Users: Join the knowledge-sharing community on the platform to exchange information and advice with other test-takers, and an emotion engine supports interactions within the community.
[1819] Device: Through the community feature, users can post and receive feedback from other users.
[1820] Server: Manages posts and comments within the community and provides users with appropriate information as needed.
[1821] Specific examples
[1822] For example, if a user selects "Example University" as their preferred university, the results will be as follows:
[1823] 1. User registration and information entry
[1824] User: Access the platform, select the "example university" as the university of choice, and register by entering their current academic level (e.g., intermediate English, advanced mathematics) and emotional data via facial expressions and voice.
[1825] Device: Sends registration information to the server.
[1826] 2. Creating an individual curriculum
[1827] Server: Based on the received information, the AI generates an individual curriculum and provides a learning plan suited to the user. It also takes into account the user's emotional data and adjusts the curriculum to the appropriate level of difficulty and pace.
[1828] Device: Display the learning plan to the user.
[1829] 3. Automatic question generation
[1830] Server: Recognizes the user's emotional state from facial expressions and voice data, and generates past questions with adjusted difficulty to match the user's emotions.
[1831] Terminal: Provides study questions to users.
[1832] 4. Answer entry and feedback
[1833] User: Answers the questions provided and submits them to the server.
[1834] Server: Checks answers and provides real-time feedback. Feedback content and tone are adjusted based on the user's emotional data.
[1835] Terminal: Display feedback to the user.
[1836] 5. Progress Management and Analysis
[1837] Server: Based on the user's answer history and emotional data, the server analyzes the user's progress in detail and identifies areas where the user needs to improve.
[1838] Terminal: Display progress to the user.
[1839] 6. Knowledge Sharing Community
[1840] Users: Exchange information with other test takers and use the emotion engine to facilitate smooth interactions within the community.
[1841] Device: View posts and comments within the community and encourage interaction with other users.
[1842] In this way, the system according to the present invention can provide a more personalized learning experience by recognizing the user's emotions and incorporating them into adjustments to the learning plan and feedback.
[1843] The processing flow will be explained below.
[1844] Step 1:
[1845] User: Access the platform and enter your name, email address, desired educational institution, current academic level (e.g., mathematics, English, etc.), and facial and voice data on the account creation page, then press the registration button.
[1846] Step 2:
[1847] Terminal: Sends the entered information to the server. If the transmission to the server is successful, displays a confirmation message to the user.
[1848] Step 3:
[1849] Server: Stores the received user information and emotion data in a database. Sends a confirmation message to the device that the data has been saved.
[1850] Step 4:
[1851] Server: Based on the stored user information and emotional data, an AI module is used to generate a personalized curriculum, which is customized based on the user's desired educational institution entrance exam trends, academic level, and current emotional state.
[1852] Step 5:
[1853] Device: The generated individual curriculum is displayed to the user, who then proceeds with their studies based on the curriculum.
[1854] Step 6:
[1855] Server: Based on the question trends of the educational institution the user is applying to, the server uses an AI module to automatically generate past exam questions, taking into account the user's emotional data and adjusting the difficulty of the questions as necessary.
[1856] Step 7:
[1857] Terminal: Automatically generated past questions are displayed to the user, who then works on the questions.
[1858] Step 8:
[1859] User: Enters the answer to the provided question and presses the submit button. The answer is sent to the server via the terminal.
[1860] Step 9:
[1861] Server: Compares the received answers with a database of correct answers and generates feedback in real time. The server also takes into account the user's emotional data to provide appropriate feedback in terms of content and tone.
[1862] Step 10:
[1863] Terminal: Feedback is displayed to the user, who can review the feedback and deepen their understanding.
[1864] Step 11:
[1865] Server: Stores the user's answer history and emotional data in a database, and manages and analyzes the progress using an AI module, thereby identifying areas where the user needs to improve.
[1866] Step 12:
[1867] Device: Progress management and analysis results are displayed to the user, allowing the user to check their own learning progress and take necessary measures.
[1868] Step 13:
[1869] Users: Access knowledge sharing communities to share learning information and advice with other test-takers, and use an emotion engine to support interactions within the community.
[1870] Step 14:
[1871] Server: Analyzes posts and comments within the community using an emotion engine and provides appropriate feedback, thereby providing support that takes into account the user's emotions.
[1872] Step 15:
[1873] On your device: Show users the latest community posts and comments. Users can use the community feature to interact with other test-takers.
[1874] Through the above process, the system based on the present invention enables users to study efficiently through individually customized study plans and automatically generated past questions, and maximizes overall learning effectiveness through real-time feedback, progress management, and community interaction. Furthermore, by using an emotion engine, it provides a learning experience that takes users' emotions into consideration.
[1875] Example 2
[1876] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1877] While conventional learning support systems can provide a curriculum based on a user's learning progress and preferred educational institution, they lack the ability to provide a personalized learning experience that takes into account the user's emotional state. Furthermore, they do not provide feedback that appropriately reflects the user's emotional state during the learning process, nor do they provide questions with difficulty levels that are adjusted according to the user's emotions. As a result, improvements in learning efficiency and motivation cannot be expected. Furthermore, knowledge-sharing communities lacked interaction support based on emotional state, which led to a decline in the quality of communication between users.
[1878] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1879] In this invention, the server includes: means for collecting a user's facial expression data and voice data and identifying emotional data; means including a computer device for generating an individual curriculum based on the input and registered user information and emotional data; and means including a computer device for automatically generating questions based on the trends and level of the educational institution the user is aiming for, and adjusting the difficulty level by taking the user's emotional data into consideration. This makes it possible to generate an individual curriculum and provide questions that take the user's emotional state into consideration, and to adjust the tone and content of feedback according to the user's emotional state. Furthermore, by supporting interactions in knowledge sharing communities using an emotional engine, communication between users can be facilitated, which is expected to improve the quality of learning and motivation.
[1880] "User information" refers to data such as the user's personal information, academic level, and preferred educational institution that is entered into the learning system.
[1881] "Emotional data" refers to data that represents a user's psychological or emotional state obtained from facial expressions and voice analysis.
[1882] "Individualized curriculum" refers to a customized learning plan based on the user's academic level, the requirements of the educational institution of their choice, and their emotional state.
[1883] "Computer device" refers to a computer system or hardware that performs various calculation processes based on user information and emotional data.
[1884] "Auto-generation" refers to the process of using AI modules or algorithms to create specific data (here, questions or curriculum) without human intervention.
[1885] "Feedback" refers to the correctness or incorrectness of the answers entered by the user and advice provided in real time.
[1886] "Progress management" is the process of tracking a user's learning progress and grade changes and identifying areas that need improvement.
[1887] A "knowledge sharing community" is an online forum or platform where candidates and learners can come together to exchange information and advice.
[1888] An "emotion engine" is an algorithm or software that analyzes a user's emotional data and appropriately adjusts interactions based on that data.
[1889] The system based on the present invention aims to utilize user emotional data to personalize the entire learning process, from generating an individual curriculum to providing questions, feedback, progress management, and a knowledge sharing community.
[1890] User registration and information entry
[1891] When a user first accesses the platform, they enter their name, email address, preferred educational institution, and current academic level (e.g., math, English) on the account creation page. The device also uses a camera and microphone to collect facial and voice data, which is then saved as emotion data. The device then packages this information and data and sends it to the server. The server then stores the received information in a database and notifies the user that registration is complete.
[1892] Creating an individual curriculum
[1893] The server uses an AI module to analyze the stored user information and emotional data. This AI module takes into account the user's entrance exam trends, academic level, and emotional state to generate an individualized learning plan. The generated curriculum includes optimal learning content and progress pace and is displayed to the user via their device.
[1894] Automatic question generation
[1895] The server uses an AI model to automatically generate past exam questions tailored to the trends and level of the educational institution the user is applying to. It also takes into account the user's emotional data and adjusts the difficulty of the questions as needed. The generated questions are then provided to the user via their device.
[1896] Answer entry and feedback
[1897] When a user enters an answer to a given question and presses the submit button, the answer data is sent to the server via the device. The server compares the received answer with a database of correct answers and generates feedback in real time. The feedback takes into account the user's emotional data and adjusts the tone and content appropriately. This feedback information is displayed to the user via the device.
[1898] Progress management and analysis
[1899] The server stores the user's answer history and emotional data in a database, and manages and analyzes their progress. The AI module analyzes this data, identifies areas where the user needs to improve, and generates advice based on that. The analysis results are displayed to the user via their device.
[1900] Knowledge Sharing Community
[1901] Users can join the knowledge-sharing community on the platform and exchange information and advice with other test-takers. An emotion engine supports smooth interactions with posts and comments within the community. The device displays community posts and comments, encouraging interaction with other users.
[1902] Examples of concrete examples and prompts
[1903] For example, if a user is applying to "Example University" and has set their current academic level as intermediate in English and advanced in mathematics, they would input the following prompt sentence into the generative AI model.
[1904] "Please write AI code that allows a user to select the 'example university' as their preferred university, set their current academic level as intermediate in English and advanced in mathematics, and generate an individualized curriculum based on that."
[1905] In this way, the system based on the present invention realizes advanced personalization that utilizes the user's emotional data, thereby maximizing the learning experience.
[1906] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1907] Step 1:
[1908] User registration and information entry
[1909] When a user first accesses the system, they enter their name, email address, preferred educational institution, and current academic level on the account creation page. The system also uses a camera and microphone to collect facial expression and voice data, and the input information registered as emotion data includes text and multimedia data.
[1910] Terminal: Packages input information and sends it to the server. Specifically, it bundles text and multimedia files entered in web forms or smartphone apps into a single request and sends it using the HTTP protocol.
[1911] Step 2:
[1912] Receiving and storing information
[1913] Server: The received user information and emotion data are stored in a database. Furthermore, the server generates user identification information based on the stored data and sends a confirmation email. The received data includes the user's personal information, academic achievement information, and emotion data. This data is stored in a database management system such as MySQL or PostgreSQL.
[1914] Step 3:
[1915] Creating an individual curriculum
[1916] Server: Analyzes the stored user information and emotional data and generates an individualized curriculum using a specific algorithm. Specifically, a machine learning model (using, for example, TensorFlow or PyTorch) is used to customize a learning plan based on the user's academic level and the trends of the educational institution they wish to attend. Emotional data is also input into the AI model to adjust the difficulty and pace of the lesson. The generated curriculum is sent to the device in JSON format.
[1917] Step 4:
[1918] View Curriculum
[1919] Device: The device displays the received personalized curriculum to the user. The curriculum is rendered as a user interface using HTML and CSS, and interactive elements are added using JavaScript as needed, allowing the user to see the learning plan that best suits them.
[1920] Step 5:
[1921] Automatic question generation
[1922] Server: Using an AI model, past exam questions are generated that are tailored to the trends and level of the educational institution the user is applying to. Emotional data is also taken into account to adjust the difficulty of the questions. The generated questions are then converted back into JSON format and sent to the device. Specifically, the AI model references a database of past entrance exam questions and constructs questions based on specific rules.
[1923] Step 6:
[1924] Displaying past questions
[1925] Terminal: The generated past questions are displayed to the user. The questions are dynamically rendered using JavaScript using HTML templates. Specific instructions for entering answers are also displayed.
[1926] Step 7:
[1927] Enter and submit your answers
[1928] User: Enters the answer to the provided question and presses the submit button. The answer is sent in text format to the server via the terminal. Specifically, when the user enters the answer in the input form and presses the submit button, the data is sent to the server as an HTTP request using JavaScript.
[1929] Step 8:
[1930] Receiving answers and feedback
[1931] Server: Compares the received answers with a database of correct answers and generates real-time feedback using an AI model. It takes into account emotional data and adjusts the tone and content of the feedback. Feedback based on the comparison results is generated in JSON format and sent to the device.
[1932] Step 9:
[1933] View Feedback
[1934] Device: Displays feedback information to the user. The display is done using HTML and CSS, and the content and tone of the feedback are adjusted based on the user's emotional state. Specifically, it parses the feedback data in JSON format, inserts it into an HTML template, and displays it.
[1935] Step 10:
[1936] Progress management and analysis
[1937] Server: Stores the user's answer history and sentiment data in a database, and manages and analyzes their progress. It uses AI models to identify the user's weaknesses and areas for improvement, and adjusts their learning plan accordingly. Specifically, it periodically analyzes the stored data and updates the individual curriculum and learning advice based on the results.
[1938] Step 11:
[1939] View progress results
[1940] Device: Receives the analysis results and displays them to the user. The user can check their progress and understand what they are being evaluated on and what they should study next. The analysis results are displayed visually in an easy-to-understand manner using HTML and CSS.
[1941] Step 12:
[1942] Join our knowledge sharing community
[1943] Users: Join the knowledge-sharing community on the platform and exchange information and advice with other test-takers. An emotion engine supports user-to-user interactions. Posts and comments are in text format, and the interface is rendered using HTML and JavaScript.
[1944] Step 13:
[1945] Community Management
[1946] Server: Moderates posts and comments within the community and provides appropriate information to users when necessary. This includes filtering inappropriate posts. It also uses AI models to support positive interactions based on sentiment data.
[1947] (Application example 2)
[1948] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1949] Conventional learning systems lack the ability to recognize users' emotions in real time and optimize learning content and feedback based on that. Furthermore, virtual shopping environments lack product recommendations and customer service that take user emotions into account, leaving a need for improved user experience. Given this situation, it is necessary to develop a system that recognizes users' emotions in real time and provides personalized learning and shopping experiences accordingly.
[1950] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1951] In this invention, the server includes: means for inputting and registering information such as the user's desired educational institution and current academic level; means including a computer device for generating an individual curriculum based on the inputted and registered user information; means including a computer device for automatically generating questions based on the user's desired educational institution and level; means for the user to input answers to the provided questions; means including a computer device for receiving the user's answers, determining whether they are correct or incorrect, and generating feedback in real time; means including a computer device for analyzing the user's learning progress and identifying areas for improvement; means for the user to share information with other test takers in a knowledge-sharing community; and means for recognizing the user's emotions in real time and providing personalized product suggestions and customer service, thereby enabling a personalized learning and virtual shopping experience based on the user's emotions.
[1952] "User" means an individual who uses the system to learn or shop.
[1953] "Educational institution" refers to a place of learning such as a school, university, or vocational school that the user wishes to attend.
[1954] "Academic level" refers to a number or rating entered by the user that indicates the current level of knowledge and skill in each subject.
[1955] "Individual Curriculum" refers to a customized learning plan generated based on the characteristics of the educational institution the user is interested in, as well as the user's academic level and emotional data.
[1956] "Emotional data" refers to information that indicates the emotional state of the user, obtained from facial expressions, voice, etc.
[1957] "Computer equipment" means a device that includes hardware and software for inputting and registering information, generating individualized curriculum, automatically generating questions, analyzing answers, providing real-time feedback, and analyzing progress.
[1958] "Automatic question generation" refers to the process of using an AI module to generate appropriate study questions based on the trends and academic level of the educational institution the user is applying to.
[1959] "Answer" refers to the answer that a user enters in response to a given question.
[1960] "Feedback" refers to the evaluation and advice provided to users based on real-time judgment of whether their answers are correct or incorrect.
[1961] "Analyzing learning progress" refers to the process of identifying a user's learning progress and areas for improvement based on the user's answer history and sentiment data.
[1962] A "knowledge sharing community" is an online platform where users can exchange study information and advice with other test takers.
[1963] "Means for recognizing emotions in real time" refers to technology that analyzes a user's facial expressions and voice to instantly determine their current emotional state.
[1964] "Personalized product suggestions" refers to the process of recommending products that are suited to individual users based on their emotional data and purchasing history.
[1965] "Customer service" refers to the assistance and support provided to users by avatars and chatbots in virtual stores.
[1966] The embodiment of the system according to the present invention is as follows: In particular, to provide a learning system and a virtual shopping environment combined with an emotion engine, the system includes the following specific steps:
[1967] First, the user accesses the system and registers and enters information. The user enters their name, email address, favorite categories (learning or shopping), past progress and purchase history, and emotional data such as facial expressions and voice data. This information is then sent to the server via the device.
[1968] The server generates personalized curriculum and product recommendations based on the received user information and emotional data. In the case of the learning system, the personalized curriculum is customized based on the user's educational preference, academic level, and current emotional state. In the case of virtual shopping, product recommendations are made in real time based on the emotional data.
[1969] The generated individual curriculum and product suggestions are displayed to the user via their device, allowing them to have a personalized learning plan and shopping experience.
[1970] In the learning system, the server automatically generates questions based on the trends and level of the educational institution the user is applying to. The generated questions are then sent to the server, with the user entering the answers via their device. The server then judges the answers in real time and generates feedback. The content and tone of the feedback are adjusted based on the user's emotional data.
[1971] The server also stores the user's answer history and emotional data in a database. Based on the stored data, the server analyzes the user's learning progress and identifies areas that need improvement. The user is notified of the analysis results via their device.
[1972] In the knowledge sharing community, users can share information and advice with other test-takers and shoppers. The server manages posts and comments within the community and supports smooth interactions with an emotion engine.
[1973] For example, if a user is wearing smart glasses in a virtual shopping environment, the system will highlight related product suggestions if the user's facial expression indicates interest. Conversely, if the user indicates dissatisfaction, the system will suggest products in a different category. Furthermore, if the user gazes at a particular item for a long time, the system will automatically display reviews and detailed information related to that item.
[1974] The prompt sentences include the following:
[1975] "Capture facial expression data in real time while the user is wearing the glasses, perform sentiment analysis, and optimize product suggestions in the virtual store. Specifically, if the user expresses positive sentiment toward a certain product, immediately recommend related products. Also, if the user expresses negative sentiment, build a system that suggests products from a different category."
[1976] The system based on this invention uses cloud services such as TensorFlow, Amazon Web Services (AWS), and Google Cloud to analyze emotional data and provide customized learning plans and product recommendations, thereby enabling personalized learning and virtual shopping experiences based on the user's emotions.
[1977] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1978] Step 1:
[1979] The user accesses the system. They input their name, email address, favorite category (study or shopping), past progress and purchase history, and emotional data such as facial expressions and voice data, and send this data to the server from their device. The input data also includes the user's preferred educational institution and academic level.
[1980] Step 2:
[1981] The server analyzes the received user information and emotional data. Specifically, it uses an AI module to generate an individualized curriculum, taking into account the trends of the user's preferred educational institution and their academic level. The emotional data is also analyzed, and the difficulty and content of the curriculum are adjusted based on the user's current emotional state. The output is a customized learning plan or product recommendations.
[1982] Step 3:
[1983] The generated personalized curriculum and product suggestions are displayed to the user via their device. The user can then review the displayed curriculum and products. The displayed content reflects the user's emotional state in real time and dynamically changes according to the user's interests and dissatisfaction.
[1984] Step 4:
[1985] In the case of the learning system, the server automatically generates questions based on the trends of the educational institution the user is applying to and their academic level. Using past exam questions and mock test data, the AI module generates appropriate questions. Emotional data is also taken into account, and adjustments are made, such as lowering the difficulty of questions if the user is feeling stressed.
[1986] In the case of a shopping system, the server provides detailed information about a particular product and displays related product lists and promotional information.
[1987] Step 5:
[1988] The user enters the answer to the generated question and sends it to the server via their device. The server compares the answer with a database of correct answers and generates real-time feedback. This feedback is also adjusted based on the emotional data, and is presented to the user with an appropriate tone and content.
[1989] Step 6:
[1990] The server stores the user's answer history and emotional data in a database. The stored data is used to analyze the user's learning progress. This analysis includes the accuracy and speed of the user's answers, changes in their emotional state, etc. The progress is analyzed in detail to identify areas that need improvement.
[1991] Step 7:
[1992] In the knowledge sharing community, users can share information and advice with other test takers and shoppers. The terminal uses an emotion engine to support interactions within the community and improve the user experience. The server manages posts and comments within the community and provides users with appropriate information as needed.
[1993] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[1994] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural netwo...
Claims
1. A means for users to input and register information such as their desired educational institution and current academic level; means including a computer device for generating an individual curriculum based on input and registered user information; means including a computer device for automatically generating questions based on the trends and level of the educational institution to which the user is applying; means for a user to input answers to the questions provided; means including a computing device for receiving the user's answers, determining whether they are correct or incorrect, and generating feedback in real time; means including a computer device for analyzing the user's learning progress and identifying areas for improvement; A knowledge sharing community allows users to share information with other candidates; A system including:
2. A means for storing answer data of questions answered by users in a database; means for tracking a user's progress based on the saved answer data; The system of claim 1 further comprising:
3. A means including a computer program for automating a series of processes from individual curriculum generation to progress analysis, question provision, feedback, and information sharing based on information entered and registered by a user; The system of claim 1 , comprising:
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A