System
The system addresses inconsistent lesson quality and educational disparities in language learning by tailoring AI instructor models to users' personalities and regions, using advertisement revenue to fund free learning and promote social contribution.
Patent Information
- Application Number
- JP2024125347
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-31
- Publication Date
- 2026-02-13
AI Technical Summary
Conventional language learning services face issues of inconsistent lesson quality, difficulty in booking popular instructors, high tuition fees, and a sense of embarrassment among Japanese language beginners, leading to educational disparities and hindered language acquisition.
A system that allows users to input basic information, take a personality test, and be recommended an AI instructor model tailored to their personality and region, with features for lesson management, interaction logging, and advertisement-based funding to provide free language learning.
This system ensures uniform lesson quality, eliminates educational disparities, and provides accessible language learning by utilizing AI instructors and advertisement revenue to sustain operations, allowing users to contribute study time to others.
Smart Images

Figure 2026023412000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Conventional language learning services have had the problem of inconsistent learning results due to differences in lesson quality between instructors. It is also difficult to reserve with popular instructors, leaving many users unable to take lessons at the time they desire. Furthermore, high tuition fees make it difficult for some users to continue learning due to financial constraints. Another problem, particularly among Japanese people, is that language beginners hesitate to take lessons due to a sense of embarrassment. These issues are contributing to the widening educational gap in language acquisition. The present invention aims to solve these issues and provide an environment in which all users can learn languages equally and effectively. [Means for solving the problem]
[0005] The present invention solves the above problems by the following means.
[0006] By providing a means for users to enter their basic information and take a personality test, the system will provide a learning experience that is tailored to each individual's personality. In addition, by providing a means for users to be recommended the most suitable instructor model based on the results of the personality test, the system will enable users to select the best instructor model from approximately 100 models with variations based on personality and region.
[0007] Furthermore, by providing a means for users to select a teacher model and start a lesson, they can freely proceed with their learning without being restricted by time or place.By providing a means for recording interactions with users during lessons and managing progress, we ensure uniform lesson quality and make it easier for users to understand their progress.
[0008] In addition, we will build a system that allows users to accumulate their study time and offer it to other users as a way to contribute to society. By displaying advertisements and providing a means to manage advertising revenue, we will provide the service completely free of charge, and will also achieve sustainable operation by utilizing donations from companies and recruitment agency fees.
[0009] This will eliminate educational disparities and provide an environment where all users can receive equally effective language learning.
[0010] "User" refers to a user who accesses the system and engages in language learning.
[0011] "Basic information" refers to personal information such as name, age, gender, and email address that a user provides when registering with the system.
[0012] "Personality diagnosis" refers to a diagnosis that evaluates a user's personality traits and recommends the most suitable instructor model based on the results.
[0013] "Instructor model" refers to a virtual language instructor generated by AI, with variations according to personality and region.
[0014] "Selection" refers to the act of the user choosing the most suitable instructor model from those recommended by the server.
[0015] "Lesson" refers to a language learning session between a user and a teacher model, conducted via text and / or audio.
[0016] "Dialogue" refers to the communication between the user and the instructor model.
[0017] "Progress" refers to the user's learning progress and level of achievement.
[0018] "Accumulation" refers to the act of continuously accumulating a user's study time.
[0019] "Provision" refers to the act of distributing accumulated study time to other users free of charge.
[0020] "Advertisements" refers to promotional information for companies or services displayed on the Platform.
[0021] "Advertising revenue" refers to the income earned from clicks and views on displayed advertisements.
[0022] "Corporate donations" refers to financial assistance provided by corporations.
[0023] "Recruitment agency fees" refers to the commission income earned through recruitment agency services with companies. [Brief explanation of the drawings]
[0024] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2]1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0025] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0026] First, the terms used in the following description will be explained.
[0027] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0028] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0029] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0030] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0031] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0032] [First embodiment]
[0033] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0034] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0035] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0036] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0037] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0038] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0039] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0040] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0041] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0042] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0043] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0044] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0045] This invention is a system that allows users to freely study languages for as long as they like, and provides lessons using approximately 100 AI instructor models tailored to their personalities and regions. The system is composed of a server, a terminal, and a user component.
[0046] User registration and personality test
[0047] The user accesses the system and enters their basic information (name, age, gender, email address, etc.) into the registration form. The device sends this information to the server. The server stores the received user information in a database and sends the user a URL for a personality assessment page. Once the user completes the personality assessment, the results are sent to the server for analysis. Based on the results of the personality assessment, the server returns a recommended list of compatible tutor models.
[0048] Select an AI teacher and start lessons
[0049] The user browses the recommendation list sent from the server and selects the AI instructor that best suits them. The selection information is sent from the device to the server. The server activates the selected instructor model and prepares to start the lesson. The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log.
[0050] Lesson progress and log storage
[0051] During the lesson, the AI instructor presents questions and tasks to the user, who then responds and makes comments. The server monitors the dialogue data in real time and stores all interactions as logs. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[0052] Sharing study time
[0053] The server records each user's study time in a database and manages the accumulated study time. When a certain amount of study time has been accumulated, the server will offer that time to other less fortunate users free of charge. For example, if two hours of study time has been accumulated, another user will be offered one hour of study time. This system encourages users to study while being conscious of contributing to society.
[0054] Advertising Revenue and Funding
[0055] The server places advertisements in appropriate locations on the platform and sends that information to the device. When an advertisement is displayed and clicked on while a user is in class or browsing a page, that information is sent to the server. The server reports ad click data to advertisers and manages advertising revenue. The server also collects donations and recruitment agency fees from companies, which are used as operating funds to ensure the sustainable operation of the system.
[0056] Specific examples
[0057] For example, a user accesses the system, enters basic information, and takes a personality test. The user is determined to be "introverted," and the server recommends a teacher model "Teacher A" that matches the introverted personality. The user selects Teacher A and begins the lesson. The lesson proceeds via video call, with the user answering questions and engaging in dialogue. The server records this in a log, and after the lesson is over, generates a progress report and provides it to the user.
[0058] Furthermore, when a user's cumulative study time reaches four hours, two of those hours are donated free of charge to other less fortunate users. Corporate advertisements are displayed on the lesson screen, and when users click on them with interest, the advertising revenue is managed as funds for maintaining the system. In this way, the present invention provides a high-quality language learning environment for all users, while eliminating educational disparities and contributing to society.
[0059] The processing flow will be explained below.
[0060] User registration and personality test
[0061] Step 1:
[0062] The user accesses the system's registration page and enters basic information (name, age, gender, email address, etc.).
[0063] Step 2:
[0064] The device sends the user's basic information to the server.
[0065] Step 3:
[0066] The server stores the user's basic information in a database, generates a URL for the personality test page, and returns it to the device.
[0067] Step 4:
[0068] The user visits the personality test page and answers the questions displayed.
[0069] Step 5:
[0070] The device sends the user's personality test answers to the server.
[0071] Step 6:
[0072] The server analyzes the personality test answers in real time and determines the user's personality.
[0073] Step 7:
[0074] Based on the results of the assessment, the server sends the most suitable AI instructor model to the terminal as a recommendation list.
[0075] Select an AI teacher and start lessons
[0076] Step 8:
[0077] Users can select the tutor that best suits them from the recommended AI tutor models.
[0078] Step 9:
[0079] The terminal transmits the user's selection information to the server.
[0080] Step 10:
[0081] The server activates the selected AI instructor model and prepares for the start of the lesson.
[0082] Step 11:
[0083] The device will notify the user that the lesson has started and launch the learning screen.
[0084] Step 12:
[0085] The user begins a dialogue with the AI instructor on the learning screen.
[0086] Lesson progress and log storage
[0087] Step 13:
[0088] The AI instructor presents the lesson content to the user and gives questions and assignments.
[0089] Step 14:
[0090] Users respond and comment accordingly.
[0091] Step 15:
[0092] The server records the dialogue data between the user and the AI instructor in real time and stores the dialogue logs in a database.
[0093] Step 16:
[0094] After the lesson ends, the server generates a progress report for the user and sends it to the device.
[0095] Step 17:
[0096] The device displays a progress report to the user.
[0097] Sharing study time
[0098] Step 18:
[0099] The server records the user's study time in a database and manages the cumulative study time.
[0100] Step 19:
[0101] When the accumulated learning time reaches a certain value, the server provides that time to other less fortunate users free of charge.
[0102] Step 20:
[0103] Free users will receive a notification and access the class page.
[0104] Advertising Revenue and Funding
[0105] Step 21:
[0106] The server places the advertisement in the appropriate location on the platform and sends the information to the device.
[0107] Step 22:
[0108] The device displays advertisements on the user's learning screen.
[0109] Step 23:
[0110] When a user clicks on an advertisement, the click information is sent to the server.
[0111] Step 24:
[0112] The server reports click data to advertisers and manages advertising revenue.
[0113] Step 25:
[0114] The server collects donations and recruitment agency fees from companies and uses these funds to fund the system's operations.
[0115] Through these specific processing steps, users can receive high-quality language learning for free and also contribute to society.
[0116] Example 1
[0117] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0118] Conventional language learning systems have not provided sufficient means for selecting the optimal teacher model for each individual user, resulting in inefficient learning. Furthermore, there is no mechanism for properly managing learning progress or providing learning time to other users. Furthermore, there are insufficient methods for effectively displaying advertisements and managing revenue. Therefore, there is a need for a system that allows users to contribute to society while efficiently learning a language.
[0119] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0120] In this invention, the server includes a means for a user to input their basic information and conduct a personality assessment, a means for recommending an optimal teacher model based on the results of the personality assessment, and a means for the user to select a teacher model and start a lesson. This allows the optimal teacher model to be selected for each individual user, enabling efficient learning. The server also includes a means for recording interactions with the user during lessons and managing progress, a means for accumulating the user's study time and providing that time to other users, and a means for displaying advertisements and managing advertising revenue. This makes it possible to appropriately manage the user's study progress, provide free study time to underprivileged users, and effectively manage advertising revenue.
[0121] "Basic information" refers to personal data entered by the user, such as name, age, gender, and email address.
[0122] A "personality test" is a test or questionnaire that assesses a user's personality and categorizes them into specific patterns.
[0123] A "teacher model" is an artificial intelligence character model designed to provide lessons to users.
[0124] The "lesson start means" is a function that allows the user to activate the teacher model selected and start learning.
[0125] The "interaction recording means" is a function that records all interactions between the user and the teacher model during a lesson.
[0126] "Progress management means" is a function that monitors the user's learning progress and provides appropriate feedback and reports.
[0127] "Accumulated study time" refers to calculating the total time a user spends studying on the system.
[0128] "Means for providing study time" is a system in which a portion of accumulated study time is provided free of charge to other less fortunate users.
[0129] "Advertisement display means" is a function that displays advertisement content while the user is using the system.
[0130] "Advertising revenue management means" is a function for collecting and managing revenue earned from displayed advertisements.
[0131] This invention is a system that allows users to freely study languages for as long as they like, and provides lessons using AI instructor models tailored to their personalities and regions. The system is composed of components: a server, a terminal, and a user.
[0132] User registration and personality test
[0133] A user accesses the system and uses a terminal to enter basic information such as name, age, gender, and email address into a registration form. The terminal then sends this information to the server. The server stores the received user information in a database and sends the user a URL for a personality assessment page. Once the user completes the personality assessment, the results are sent to the server for analysis. The personality assessment involves the user answering questions to assess their personality and classify it into specific patterns. Based on these results, the server returns a list of recommended teacher models that are compatible with the user.
[0134] For example, when a user first accesses the system, they enter the required information into a web form in their browser. The server then emails the user a URL for a personality test. The user is then prompted, for example, to "take the personality test," and the user completes the test.
[0135] Select an AI teacher and start lessons
[0136] The user browses the recommendation list sent from the server and selects the AI instructor that best suits them. The selection information is sent from the device to the server. The server activates the selected teacher model and prepares to start the lesson. The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log.
[0137] For example, when a user selects "Teacher A" from the recommended list and starts a lesson, the lesson screen will launch and a conversation with the AI instructor will begin in a video call format. For example, a prompt will appear asking, "Do you want to start today's lesson?" and the user will select "Start."
[0138] Lesson progress and log storage
[0139] During the lesson, the AI instructor presents questions and tasks to the user, who then responds and makes comments. The server monitors the dialogue data in real time and stores all interactions as logs. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[0140] As a concrete example, during a lesson, an AI instructor will ask questions such as, "Please explain yesterday's weather in English." The user's answers are sent to the server in real time and recorded in a log. After the lesson ends, a "progress report of today's lesson" is displayed to the user.
[0141] Sharing study time
[0142] The server records each user's study time in a database and manages the accumulated study time. When a certain amount of study time has been accumulated, the server will offer that time to other less fortunate users free of charge. For example, if two hours of study time has been accumulated, another user will be offered one hour of study time. This system encourages users to study while being conscious of contributing to society.
[0143] Advertising Revenue and Funding
[0144] The server places advertisements in appropriate locations on the platform and sends that information to the device. When an advertisement is displayed and clicked on while a user is in class or browsing a page, that information is sent to the server. The server reports ad click data to advertisers and manages advertising revenue. The server also collects donations and recruitment agency fees from companies, which are used as operating funds to ensure the sustainable operation of the system.
[0145] For example, an advertising banner is displayed on the sidebar of a lesson screen, and when a user clicks on the ad, the click information is sent to the server. A prompt is displayed asking, "Are you interested in new language learning materials?" If the user selects "Yes," they are redirected to the advertiser's page.
[0146] In this way, the present invention provides a high-quality language learning environment to all users, while eliminating educational disparities and contributing to society.
[0147] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0148] Step 1:
[0149] The user enters basic information.
[0150] Input: Basic information such as name, age, gender, and email address.
[0151] What happens: A user accesses a web form in a browser and enters the required information.
[0152] Output: The device sends the entered information as an HTTP POST request.
[0153] Step 2:
[0154] The terminal sends the information to the server.
[0155] Input: Basic information entered by the user.
[0156] Specific operation: The device sends data asynchronously using JavaScript or Ajax.
[0157] Output: The server stores the received information in a database.
[0158] Step 3:
[0159] The server stores the information in a database.
[0160] Input: Basic user information data.
[0161] What happens: A server-side script (e.g., PHP or Node.js) executes an INSERT query against the database.
[0162] Output: Basic information stored in the database.
[0163] Step 4:
[0164] The server sends the URL of the personality test page.
[0165] Input: The user's email address.
[0166] Specific operation: The server uses the SMTP server to send an email containing a link to the personality test page.
[0167] Output: The user will receive a link to the personality test page in their mailbox.
[0168] Step 5:
[0169] The user completes a personality test.
[0170] Input: URL of the personality test page.
[0171] Specific behavior: The user visits a personality test page and answers a few questions.
[0172] Output: The results of the personality test are displayed and sent from the device to the server.
[0173] Step 6:
[0174] The terminal transmits the diagnosis results to the server.
[0175] Input: Personality test results.
[0176] Specific operation: The device sends an HTTP POST request containing the diagnostic results to the server.
[0177] Output: The server analyzes the diagnostic results it receives.
[0178] Step 7:
[0179] The server analyzes the diagnostic results and returns a list of recommendations.
[0180] Input: Personality test result data.
[0181] Specific operation: The server uses the generative AI model to analyze the diagnosis results and create a list of recommended teacher models that match the user's personality.
[0182] Output: The user is presented with a list of recommendations.
[0183] Step 8:
[0184] The user browses the recommendations list.
[0185] Input: A list of recommendations sent by the server.
[0186] Specific operation: The user checks the list in a web browser and selects the desired teacher model.
[0187] Output: Information on the selected teacher model is passed to the next process.
[0188] Step 9:
[0189] The terminal transmits the selection information to the server.
[0190] Input: Information about the teacher model selected by the user.
[0191] Specific operation: The terminal sends an HTTP POST request including the selection information to the server.
[0192] Output: The server receives the selection and continues processing.
[0193] Step 10:
[0194] The server activates the teacher model.
[0195] Input: Information about the teacher model selected by the user.
[0196] Specific operation: The server launches an instance of the selected teacher model and makes it active.
[0197] Output: Lesson is ready to begin.
[0198] Step 11:
[0199] The device will display a notification that class is about to begin.
[0200] Input: Notification from the server that the lesson is ready to begin.
[0201] Specific behavior: The device will display a pop-up notification in the browser and redirect you to the learning screen.
[0202] Output: The user is notified that the lesson has started.
[0203] Step 12:
[0204] The user starts a lesson.
[0205] Input: Lesson start screen.
[0206] How it works: The user begins a conversation with the AI instructor on the lesson screen, via text chat or voice interaction.
[0207] Output: Interaction data is sent to the server.
[0208] Step 13:
[0209] The server processes and stores the interaction data.
[0210] Input: User interaction data.
[0211] Specific operation: The server processes the interaction data in real time and stores the interaction log in the database.
[0212] Output: The interaction log is saved to a database.
[0213] Step 14:
[0214] The server generates a progress report.
[0215] Input: Interaction log data.
[0216] Specific operation: The server analyzes the interaction log and creates a progress report for the user.
[0217] Output: A progress report is generated.
[0218] Step 15:
[0219] The device will display a progress report.
[0220] Input: A progress report sent by the server.
[0221] Specific behavior: The device displays a progress report to the user.
[0222] Output: User sees status report.
[0223] Step 16:
[0224] The server records the study time in a database.
[0225] Input: User study time data.
[0226] Specific operation: The server measures the time that the user is logged in and updates the database.
[0227] Output: The cumulative learning time is recorded in a database.
[0228] Step 17:
[0229] The server manages the cumulative learning time and provides a certain amount of time free of charge.
[0230] Input: Accumulated study time data.
[0231] Specific operation: The server executes logic that provides free study time to other users when a certain amount of study time has been accumulated.
[0232] Output: The free learning time is recorded.
[0233] Step 18:
[0234] The server places the advertisement and sends it to the device.
[0235] Input: Ad data.
[0236] Specific operation: The server places the advertisement in the appropriate location on the platform and sends the advertisement data to the terminal.
[0237] Output: Advertising data is sent to the device.
[0238] Step 19:
[0239] The device displays advertisements.
[0240] Input: Advertisement data sent from the server.
[0241] What it does: The device displays advertising banners in the sidebar or at the top of web pages.
[0242] Output: The user is shown the ad.
[0243] Step 20:
[0244] A user clicks on an ad.
[0245] Input: The ad displayed.
[0246] Specific behavior: The event of a user clicking on an ad is tracked.
[0247] Output: Click information is sent to the server.
[0248] Step 21:
[0249] The server reports ad click data and manages revenue.
[0250] Input: Ad click data.
[0251] Specific operation: The server reports click data to advertisers and manages advertising revenue.
[0252] Output: Advertising revenue is managed.
[0253] Step 22:
[0254] The server collects donations and recruitment fees.
[0255] Input: Data on donations and job intermediation.
[0256] Specific operation: The server collects donations and recruitment agency fees from companies and manages them as operating funds.
[0257] Output: The funds collected are used to run the system sustainably.
[0258] (Application example 1)
[0259] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0260] Current online education systems and virtual stores make it difficult for users to receive optimal support and education tailored to their individual needs and personalities. Furthermore, systems for managing learning progress and contributing to society are insufficient, and the lack of multilingual support in virtual stores is becoming apparent. These challenges make it difficult to improve user satisfaction and eliminate educational disparities.
[0261] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0262] In this invention, the server includes: means for a user to input their own basic information and conduct a personality assessment; means for recommending an optimal instructor model based on the results of the personality assessment; means for the user to select an instructor model and start a lesson; means for recording dialogue with the user during the lesson and managing progress; means for accumulating the user's study time and providing that time to other users; means for displaying advertisements and managing advertising revenue; means for providing the user with multilingual guidance and support when searching for, purchasing, or inquiring about products in a virtual store; and means for selecting a recommended virtual guide and exploring the store with that guide. This allows the user to receive education and support optimized to their individual needs, thereby eliminating social educational disparities and achieving high user satisfaction.
[0263] "Basic user information" refers to information such as name, age, gender, and email address that a user enters when registering with the system.
[0264] "Personality diagnosis" is a diagnostic tool that analyzes the user's personality and recommends the most suitable instructor model based on the results.
[0265] The "instructor model" is a lesson delivery model that implements AI tailored to the instructor's personality and region, providing the most appropriate education to the user.
[0266] "Lesson starts" refers to the state in which the user activates the selected instructor model and the lesson actually begins.
[0267] "Dialogue recording" is the process of saving the interaction between the user and the AI instructor during the lesson as a log so that it can be referenced later.
[0268] "Progress management" is the process of tracking a user's learning progress and providing feedback based on that progress.
[0269] "Accumulating learning time" is the process of tallying and recording the time a user spends learning on the system.
[0270] "Providing to other users" means distributing a portion of the accumulated learning time to other less fortunate users free of charge.
[0271] "Displaying Advertisements" means the process of placing Advertisements on the Platform and making them visible to Users.
[0272] "Advertising revenue management" is the process of aggregating click data from displayed ads and managing the resulting revenue as operating funds.
[0273] "Exploring the virtual store" means that a user browses, selects, purchases, and inquires about products within a virtual shopping environment.
[0274] "Multilingual guidance and support" means that the AI guide provides guidance and support in different languages depending on the user's language settings.
[0275] "Selecting a virtual guide" is the process of selecting the most suitable virtual guide based on the results of a personality test and the user's preferences, and then exploring the store together.
[0276] MODE FOR CARRYING OUT THE INVENTION
[0277] The present invention is a system that allows users to freely learn languages and receive multilingual guidance in virtual stores. The system is composed of components: a server, a terminal, and a user. The system is implemented as follows:
[0278] User registration and personality test
[0279] The user accesses the system from their device and enters basic information such as name, age, gender, and email address into the registration form. The device sends this information to the server. The server stores the received user information in a database and sends the user a URL for the personality assessment page. Once the user completes the personality assessment, the results are sent to the server, which analyzes them. Based on the results of the personality assessment, the server returns a list of recommended tutor models who are compatible with the user to the user.
[0280] Select an AI teacher and start lessons
[0281] The user browses the recommendation list sent from the server and selects the AI instructor that best suits them. This selection information is sent from the device to the server. The server activates the selected instructor model and prepares to start the lesson. The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log.
[0282] Lesson progress and log storage
[0283] During the lesson, the AI instructor presents questions and tasks to the user, who then responds and makes comments. The server monitors the dialogue data in real time and saves all interactions as a log. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[0284] Sharing study time
[0285] The server records each user's study time in a database and manages the cumulative study time. When a user achieves a certain amount of study time, a portion of that time is donated free of charge to other less fortunate users. For example, if a user accumulates two hours of study time, they can donate one hour of study time to another user. This system allows users to study while being conscious of contributing to society.
[0286] Advertising Revenue and Funding
[0287] The server places advertisements in appropriate locations on the platform and sends that information to the device. When a user clicks on an advertisement displayed during class or while browsing a page, that information is sent to the server. The server collects ad click data, reports it to advertisers, and manages advertising revenue. It also collects donations and recruitment agency fees from companies, which it uses as operating funds to ensure the sustainable operation of the system.
[0288] Multilingual guidance in the virtual store
[0289] When a user accesses a virtual store, they select the AI guide that best suits them based on their basic information and personality assessment. The selected information is sent from the device to the server. The server then activates the selected virtual guide and guides the user in multiple languages through product exploration, purchases, and inquiries within the virtual store. Interaction data is saved as a log on the server in real time, allowing the server to provide support tailored to the user's progress and interests.
[0290] Hardware and software used
[0291] Server (Amazon Web Services (AWS), Google Cloud Platform (GCP), etc.)
[0292] Client terminal (smartphone: iOS / Android, PC)
[0293] Database (MySQL, PostgreSQL)
[0294] AI teacher model (GPT-3, Google BERT)
[0295] Development language (Python, JavaScript, Swift, Kotlin)
[0296] Specific Examples
[0297] Users visit the virtual store
[0298] When a user visits a virtual store and is guided through the products, the following prompt is used:
[0299] "Hello. What product would you like to know about today? Tell me what you're looking for."
[0300] Interact with a virtual AI guide
[0301] When a user asks about a specific product, the following exchange might occur:
[0302] User: "Tell me about this TV."
[0303] AI Guide: "This TV is equipped with the latest 4K technology, delivering exceptional picture quality. It also has a wealth of smart features. Want to know more?"
[0304] In this way, the AI guide can provide personalized information in response to user questions.
[0305] As described above, the present invention provides optimal education and virtual store support tailored to the needs of each individual user, thereby improving user satisfaction and eliminating social educational disparities.
[0306] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0307] Step 1:
[0308] User registration and basic information entry
[0309] A user accesses the system from a terminal and enters basic information such as name, age, gender, and email address into the registration form. The terminal sends the entered basic information to the server. The server stores the received user information in a database and sends the terminal the URL of the personality test page to proceed to the next step. The input is the user's basic information, and the output is the URL of the personality test page.
[0310] Step 2:
[0311] Personality test
[0312] The user accesses the personality test page and answers the questions. The answers are sent from the device to the server. The server analyzes the received personality test results and uses a prepared generative AI model to select the most suitable tutor model for the user. The analysis results are returned to the user as a list of recommendations. The input is the personality test answer results, and the output is a list of recommended tutor models.
[0313] Step 3:
[0314] Select an AI teacher and start lessons
[0315] The user browses the recommended list and selects a suitable instructor model. This selection information is sent from the terminal to the server. The server activates the selected instructor model and prepares for the start of the lesson. The terminal displays a notification that the lesson has started to the user and launches the learning screen. The input is the instructor model selection information, and the output is a notification that the lesson has started and the learning screen.
[0316] Step 4:
[0317] Recording of lesson progress and dialogue
[0318] During the lesson, the AI instructor presents the user with questions and tasks. The user answers them and engages in a dialogue. The server processes this dialogue data in real time and saves all interactions as a log. The input is the user's answers and dialogue data, and the output is the dialogue log.
[0319] Step 5:
[0320] Generate progress reports
[0321] After the lesson ends, the server analyzes the dialogue log and generates a progress report for the user. The generated report is sent to the terminal and displayed to the user. The input is the log data, and the output is the progress report.
[0322] Step 6:
[0323] Managing and sharing study time
[0324] The server records the user's study time in a database and manages the accumulated study time. When a certain amount of study time is achieved, a portion of that time is offered free of charge to other less fortunate users. The input is the accumulated study time data, and the output is a notification of the free offer.
[0325] Step 7:
[0326] Ad display and revenue management
[0327] The server places ads in the appropriate locations on the platform and sends the information to the device. When a user clicks on an ad, the click data is sent to the server. The server collects this data and reports it to advertisers to manage revenue. The input is ad click data, and the output is revenue management data.
[0328] Step 8:
[0329] Multilingual guidance in the virtual store
[0330] Users access a virtual store and select the most suitable AI guide based on their basic information and personality assessment. The selection information is sent from the device to the server. The server activates the selected virtual guide and guides the user in multiple languages to explore products in the virtual store, make purchases, and make inquiries. Interaction data is saved as a log on the server in real time, providing support based on the user's progress and interests. The input is the AI guide's selection information, and the output is multilingual guidance and log data.
[0331] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0332] This invention is a system that allows users to freely study languages for as long as they like, and provides lessons using an AI instructor model and emotion engine tailored to the personalities and regions of approximately 100 people. The system is composed of server, terminal, and user components.
[0333] User registration and personality test
[0334] The user accesses the system and enters their basic information (name, age, gender, email address, etc.) into the registration form. The device sends this information to the server. The server stores the received user information in a database and sends the user a URL for a personality assessment page. Once the user completes the personality assessment, the results are sent to the server for analysis. Based on the results of the personality assessment, the server returns a recommended list of compatible tutor models.
[0335] Select an AI teacher and start lessons
[0336] The user browses the recommendation list sent from the server and selects the AI instructor that best suits them. The selection information is sent from the device to the server. The server activates the selected instructor model and prepares for the start of the lesson. The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log.
[0337] Lesson progress and log storage
[0338] During the lesson, the AI instructor presents the lesson content to the user and poses questions and assignments. The user responds and makes comments accordingly. The server monitors the dialogue data in real time and saves all interactions as a log. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[0339] Incorporating an emotion engine
[0340] The emotion engine recognizes the user's emotional state in real time and provides feedback according to that state. For example, if a user is feeling frustrated during a lesson, the emotion engine will detect this information and the server will generate an encouraging message and send it to the device. This will help the user maintain their motivation to learn.
[0341] Furthermore, the emotion engine has the function of determining the user's stress level. If the stress level is determined to be high, the server will suggest an appropriate time to take a break and send a message to the device urging it to take a break.
[0342] Sharing study time
[0343] The server records each user's study time in a database and manages the accumulated study time. When a certain amount of study time has been accumulated, the server will offer that time to other less fortunate users free of charge. For example, if two hours of study time has been accumulated, another user will be offered one hour of study time. This system encourages users to study while being conscious of contributing to society.
[0344] Advertising Revenue and Funding
[0345] The server places advertisements in appropriate locations on the platform and sends that information to the device. When an advertisement is displayed and clicked on while a user is in class or browsing a page, that information is sent to the server. The server reports ad click data to advertisers and manages advertising revenue. The server also collects donations and recruitment agency fees from companies, which are used as operating funds to ensure the sustainable operation of the system.
[0346] Specific examples
[0347] For example, a user accesses the system, enters basic information, and takes a personality test. The user is determined to be "introverted," and the server recommends a teacher model "Teacher A" that matches the introverted personality. The user selects Teacher A and begins the lesson. The lesson proceeds via video call, with the user answering questions and engaging in dialogue. The server records this in a log, and after the lesson is over, generates a progress report and provides it to the user.
[0348] Furthermore, if the emotion engine determines that the user is tired during class, the server will send a message suggesting a break. At the same time, if the user's cumulative study time reaches four hours, two of those hours will be donated free of charge to other less fortunate users. Corporate advertisements are displayed on the class screen, and if a user clicks on them with interest, the advertising revenue is managed as funds to maintain the system.
[0349] In this way, the present invention provides a high-quality language learning environment to all users, while eliminating educational disparities and contributing to society.
[0350] The processing flow will be explained below.
[0351] User registration and personality test
[0352] Step 1:
[0353] The user accesses the system's registration page and enters basic information (name, age, gender, email address, etc.).
[0354] Step 2:
[0355] The device sends the user's basic information to the server.
[0356] Step 3:
[0357] The server stores the user's basic information in a database, generates a URL for the personality test page, and returns it to the device.
[0358] Step 4:
[0359] The user visits the personality test page and answers the questions displayed.
[0360] Step 5:
[0361] The device sends the user's personality test answers to the server.
[0362] Step 6:
[0363] The server analyzes the personality test answers in real time and determines the user's personality.
[0364] Step 7:
[0365] Based on the results of the assessment, the server sends the most suitable AI instructor model to the terminal as a recommendation list.
[0366] Select an AI teacher and start lessons
[0367] Step 8:
[0368] Users can select the tutor that best suits them from the recommended AI tutor models.
[0369] Step 9:
[0370] The terminal transmits the user's selection information to the server.
[0371] Step 10:
[0372] The server activates the selected AI instructor model and prepares for the start of the lesson.
[0373] Step 11:
[0374] The device will notify the user that the lesson has started and launch the learning screen.
[0375] Step 12:
[0376] The user begins a dialogue with the AI instructor on the learning screen.
[0377] Lesson progress and log storage
[0378] Step 13:
[0379] The AI instructor presents the lesson content to the user and gives questions and assignments.
[0380] Step 14:
[0381] Users respond and comment accordingly.
[0382] Step 15:
[0383] The server records the dialogue data between the user and the AI instructor in real time and stores the dialogue logs in a database.
[0384] Step 16:
[0385] The server uses an emotion engine to analyze the user's emotional state from the dialogue data and decides on an appropriate response.
[0386] Step 17:
[0387] If the user's emotions indicate fatigue or stress, the emotion engine detects this and notifies the server.
[0388] Step 18:
[0389] The server generates messages encouraging the user or encouraging them to take a break and sends them to the device.
[0390] Step 19:
[0391] The terminal displays the generated message to the user.
[0392] Step 20:
[0393] After the lesson ends, the server generates a progress report for the user and sends it to the device.
[0394] Step 21:
[0395] The device displays a progress report to the user.
[0396] Sharing study time
[0397] Step 22:
[0398] The server records the user's study time in a database and manages the cumulative study time.
[0399] Step 23:
[0400] When the accumulated learning time reaches a certain value, the server provides that time to other less fortunate users free of charge.
[0401] Step 24:
[0402] Free users will receive a notification and access the class page.
[0403] Advertising Revenue and Funding
[0404] Step 25:
[0405] The server places the advertisement in the appropriate location on the platform and sends the information to the device.
[0406] Step 26:
[0407] The device displays advertisements on the user's learning screen.
[0408] Step 27:
[0409] When a user clicks on an advertisement, the click information is sent to the server.
[0410] Step 28:
[0411] The server reports click data to advertisers and manages advertising revenue.
[0412] Step 29:
[0413] The server collects donations and recruitment agency fees from companies and uses these funds to fund the system's operations.
[0414] Through these specific processing steps, users can receive high-quality language learning for free and also contribute to society.
[0415] Example 2
[0416] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0417] Conventional language learning systems have struggled to provide optimal learning tailored to each user's individual personality and regional background, and have often relied on uniform content and pace. It has also been difficult to grasp a user's emotional state in real time during learning and provide effective feedback based on that. Furthermore, maintaining user motivation and fostering a sense of social contribution during long learning periods have also been challenges.
[0418] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0419] In this invention, the server includes means for a user to input their own basic information and conduct a personality diagnosis, means for recommending the most suitable instructor model based on the results of the personality diagnosis, means for the user to select an instructor model and start the lesson, means for recording the dialogue with the user during the lesson and managing the progress, means for recognizing the user's emotional state in real time and providing feedback according to that state, means for accumulating the user's study time and providing that time to other users, and means for displaying advertisements and managing advertising revenue. This provides an optimal learning environment for each user, realizes appropriate feedback according to emotions, and aims to improve awareness of social contribution through the accumulation of study time.
[0420] "Basic information" refers to information related to personal identification, such as name, age, gender, and email address, entered by the user.
[0421] "Personality diagnosis" is a process for evaluating a user's personality and characteristics and selecting a suitable instructor model based on that.
[0422] The "Instructor Model" is an AI-based educational content provider designed to assist users in their learning.
[0423] A "lesson" is an educational session conducted by an AI instructor model for a user, and includes dialogue and assignment presentation.
[0424] "Dialogue Data" refers to the voice, text, and other interaction data exchanged between a user and an AI instructor model during a lesson.
[0425] "Progress management" is the process of recording and analyzing a user's learning content and progress and providing appropriate feedback.
[0426] "Emotional state" refers to the user's psychological and emotional state, including stress, frustration, etc.
[0427] "Feedback" refers to responses such as encouragement or advice provided based on the user's learning progress or emotional state.
[0428] "Cumulative Study Time" refers to the total time a User spends studying using the System.
[0429] "Sharing" refers to a system in which a portion of accumulated study time is provided free of charge to other less fortunate users.
[0430] "Advertisement" refers to promotional information for companies, organizations, etc. that is displayed on the system.
[0431] "Advertising Revenue" refers to revenue earned from users viewing or clicking on advertisements displayed on the System.
[0432] This invention is a system that allows users to freely study languages for as long as they like, and provides lessons using an AI instructor model and emotion engine tailored to the personalities and regions of approximately 100 people. The system is composed of server, terminal, and user components.
[0433] User registration and personality test
[0434] Users access the system using their own devices and enter basic information such as name, age, gender, and email address into the registration form. The device sends this information to the server. The server stores the received user information in a database and sends the user a URL for the personality test page, allowing them to take the test.
[0435] Once the user has completed the personality test, the results are sent from the device to the server, which analyzes the results and generates a list of recommended tutor models based on the user's personality. This list is then presented to the user via the device.
[0436] Select an AI teacher and start lessons
[0437] The user browses a list of recommended instructors on their device and selects an AI instructor that best suits them. The selection information is sent from the device to the server. The server sets the selected instructor model to active status and prepares for the start of the lesson. When preparations are complete, the server sends a notification to the device, which displays that information to the user. The lesson then progresses when the user launches the learning screen and begins interacting with the AI instructor.
[0438] Lesson progress and log storage
[0439] During the lesson, the AI instructor presents the lesson content to the user and poses questions and assignments. The user responds and makes comments accordingly. All of these interactions are sent to the server in real time and saved as logs by the server. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[0440] Incorporating an emotion engine
[0441] The emotion engine recognizes the user's emotional state in real time and provides feedback according to that state. For example, if a user feels frustrated during class, the emotion engine detects this information and the server generates an encouraging message and sends it to the device. This helps the user maintain their motivation to study. The emotion engine also has the function of determining the user's stress level, and if a high stress level is detected, the server will send a message to the device suggesting an appropriate break.
[0442] Sharing study time
[0443] The server records each user's study time in a database and manages the cumulative study time. When the cumulative study time reaches a certain level, the server provides a portion of it to other users. This system is intended to promote a sense of social contribution.
[0444] Ad display and revenue management
[0445] The server places advertisements in appropriate locations on the platform and transmits the information to the device. When a user views or clicks on an advertisement, the information is sent to the server. The server manages advertising revenue based on this information, and also collects donations and recruitment agency fees from companies to fund the system's operations.
[0446] Examples of concrete examples and prompts
[0447] For example, a user accesses the system, enters basic information, and takes a personality test. The user is determined to be introverted, and the server recommends a teacher model named "Teacher A" who matches the introverted personality. The user selects Teacher A and begins the lesson. The lesson proceeds via video call, with the user answering questions and engaging in dialogue. The server records this in a log, and after the lesson is over, generates a progress report and provides it to the user.
[0448] Furthermore, if the emotion engine determines that the user is tired during class, the server will send a message suggesting a break. At the same time, if the user's cumulative study time reaches four hours, two of those hours will be donated free of charge to other less fortunate users. Corporate advertisements are displayed on the class screen, and if a user clicks on them with interest, the advertising revenue is managed as funds to maintain the system.
[0449] Example prompt: "Write a scene in which a user accesses the system, enters basic information, and takes a personality test. Include a scene in which the user is determined to be an introvert and selects an AI tutor who matches their introverted personality to begin the lesson. Also, include a scene in which the emotion engine provides appropriate feedback if the user feels fatigued during the lesson."
[0450] In this way, the present invention provides a high-quality language learning environment to all users, while eliminating educational disparities and contributing to society.
[0451] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0452] Step 1: User Registration
[0453] Input: The user enters their basic information (name, age, gender, email address, etc.) into the registration form.
[0454] Action: The device sends this information to the server.
[0455] Data processing / calculation: The server stores the received information in a database.
[0456] Output: The server sends the user the URL of the personality test page.
[0457] Step 2: Take a personality test
[0458] Input: A user visits the personality assessment page and completes the test.
[0459] Operation: The device sends the results of the personality test to the server.
[0460] Data processing / calculation: The server analyzes the diagnostic results and identifies the user's personality traits.
[0461] Output: The server generates the best tutor model as a recommendation list and sends it to the device.
[0462] Step 3: Select an AI teacher
[0463] Input: User browses the recommendation list on their device and selects the best teacher model.
[0464] Operation: The device sends the selection information to the server.
[0465] Data processing / calculation: The server sets the selected instructor model to the active state and prepares for the start of the lesson.
[0466] Output: The server sends a notification to the terminal that the lesson is ready to start.
[0467] Step 4: Start classes
[0468] Input: The terminal that receives the notification from the server notifies the user that the lesson has started.
[0469] How it works: The user launches the lesson screen and begins a dialogue with the AI instructor.
[0470] Data processing / calculation: The server records the interaction data between the user and the AI teacher model in real time.
[0471] Output: Initial interaction log stored in the database.
[0472] Step 5: Classroom Management
[0473] Input: During class, users respond to instructions and questions from the instructor.
[0474] How it works: The device sends the user's answers and comments to the server.
[0475] Data processing / calculation: The server analyzes interaction data in real time and stores it as a log.
[0476] Output: Progress report data for the lesson content is generated.
[0477] Step 6: Feedback from the Emotion Engine
[0478] Input: The user's facial and voice data is captured in real time.
[0479] Operation: The device sends this data to the server.
[0480] Data processing / calculation: The emotion engine on the server analyzes the data and determines the user's emotional state.
[0481] Output: Generates appropriate feedback messages for the user and sends them to the device.
[0482] Step 7: Share your study time
[0483] Input: User learning time data accumulated on the server.
[0484] How it works: The server periodically checks the accumulated time to see if it has reached a certain threshold.
[0485] Data processing / calculation: When the standard is reached, the excess time is allocated to other users.
[0486] Output: Sends notification of time donation to relevant users.
[0487] Step 8: Display ads and manage revenue
[0488] Input: Advertising data and user activity data while learning and browsing.
[0489] How it works: The server places the ad in the appropriate location and sends the information to the device.
[0490] Data processing / calculation: When an advertisement is clicked, the data is collected and analyzed.
[0491] Output: Reporting ad revenue data to advertisers and managing revenue.
[0492] Through this series of steps, the system provides users with an effective language learning environment, maintaining their motivation to learn while also contributing to society.
[0493] (Application example 2)
[0494] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0495] Conventional language learning systems lack personalization based on the user's personality and learning situation, and lack real-time feedback and emotional state management to maintain motivation to learn. Furthermore, it is difficult for users to share their accumulated learning time with other users, and there is a lack of a mechanism to continue learning while maintaining a sense of social contribution.
[0496] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a user to input their basic information and conduct a personality assessment, a means for recommending an optimal instructor model based on the results of the personality assessment, a means for the user to select an instructor model and start a lesson, a means for recording dialogue with the user during the lesson and managing progress, a means for accumulating the user's study time and providing that time to other users, a means for displaying advertisements and managing advertising revenue, a means for recognizing the user's emotional state in real time and providing feedback, a means for generating a list of recommended video content, and a means for monitoring facial expressions and analyzing the user's emotional state. This provides a personalized learning environment tailored to the user's personality and emotional state, making it possible to continue learning and increase a sense of social contribution.
[0497] "Basic information" refers to personal information such as the user's name, age, gender, and email address.
[0498] A "personality assessment" is a method for analyzing a user's personality and providing an optimal learning experience based on the results.
[0499] The "instructor model" is a virtual instructor created using AI technology, and is a program that provides lessons to users.
[0500] "Starting a lesson" is the process by which a user begins language learning interactively with a selected instructor model.
[0501] "Recording a dialogue" is the process of saving the communication that takes place between the user and the instructor model.
[0502] "Manage Progress" is a way to track and record a user's learning progress and achievements.
[0503] "Accumulating study time" is the process of recording the total amount of study time a user has performed and managing that total.
[0504] The "means of provision" refers to a mechanism that allows users to share their accumulated study time with other users.
[0505] "Advertising Revenue Management" is a means of tracking revenue generated from displayed ads and managing that revenue as operating funds.
[0506] "Real-time emotional state recognition" is the process of analyzing a user's facial expressions and tone of voice to determine their emotions at any given time.
[0507] "Providing feedback" means providing encouragement and advice in real time based on the user's learning progress and emotional state.
[0508] "Generating a video content recommendation list" is the process of creating a list to recommend the most suitable learning videos based on the user's personality assessment and learning history.
[0509] "Monitoring facial expressions to analyze emotional state" refers to the process of using a camera to capture a user's facial expressions and then identifying their emotional state through an emotion identification algorithm.
[0510] The present invention is a system that allows users to freely study a language for as long as they like, and includes a means for providing video learning content optimized for each user. This invention is implemented using the following hardware and software.
[0511] Hardware
[0512] Smartphone: Uses a smartphone with a camera to capture the user's facial expressions.
[0513] Server: A server for database management and real-time processing.
[0514] software
[0515] Python: Used to implement various processing logic.
[0516] TensorFlow: Running machine learning models for sentiment analysis.
[0517] OpenCV: An image processing library for capturing and analyzing the user's facial expressions.
[0518] Firebase: Used for storing user information, real-time processing, and database management.
[0519] Operation explanation
[0520] User registration and personality test
[0521] Users download the smartphone app and enter basic information (such as name, age, gender, and email address). The information is sent from the smartphone to a server, which stores it in a database. When users log in for the first time, they take a personality test, and the server recommends the most suitable instructor model based on the results.
[0522] Content recommendations and viewing
[0523] The server generates a recommendation list containing the most suitable video content for the user based on the results of the personality test. The user then uses their smartphone to select a video from this recommendation list and begin watching.
[0524] Video viewing management and progress reporting
[0525] While watching the video, the user's dialogue and reactions are recorded in real time and sent to the server. The recorded dialogue and reactions are analyzed on the server side, and a report based on the user's learning progress is generated. When the video viewing ends, this report is displayed on the smartphone device.
[0526] Implementing the Emotion Engine
[0527] While watching, the user's facial expressions are monitored through the smartphone camera. The emotion engine analyzes this facial data to determine whether the user is tired or stressed. The emotion engine analyzes the user's emotional state in real time, notifying them of the need to take a break and displaying encouraging messages as needed.
[0528] Sharing study time
[0529] When a user's cumulative viewing time reaches a certain amount, that information is sent to a server and offered as free study time for other users. This system allows study time to be used to contribute to society.
[0530] Advertising and Fundraising
[0531] Advertisements are displayed while the smartphone app is running or during breaks while watching videos. When an ad is clicked, revenue data is sent to a server and managed. This advertising revenue is used to fund the system's operations.
[0532] Specific examples
[0533] For example, a user downloads the app for the first time, enters basic information, and takes a personality test. The user is determined to be "introverted," and the server recommends a teacher model "Teacher A" that matches the introverted personality. The user selects Teacher A and begins video learning. If the emotion engine determines that the user is tired during learning, it automatically displays a message suggesting a break.
[0534] Prompt Sentence Examples
[0535] The personality test determined that the user is an introvert. If the user is tired, generate an encouraging message.
[0536] In this way, the present invention provides a personalized learning environment that is tailored to the user's personality and emotional state, making it possible to encourage continuity in learning and enhance a sense of social contribution.
[0537] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0538] Step 1:
[0539] A user downloads the app on their smartphone and enters basic information (name, age, gender, email address, etc.). This information is sent from the device to the server, which then stores it in a database. Input: Basic user information. Output: User information stored in the database.
[0540] Step 2:
[0541] The server sends the user the URL of the personality test page. When the user clicks on the URL to take the personality test, the results are sent to the server. The server analyzes the received personality test results and saves them in a database. Input: User's basic information and personality test results. Output: Personality test results saved in the database.
[0542] Step 3:
[0543] The server recommends the most suitable tutor model based on the results of the personality test. A list of recommended tutor models is generated and displayed to the user. Input: Personality test results and tutor model data. Output: A list of recommended tutor models to be displayed to the user.
[0544] Step 4:
[0545] The user selects from the recommended instructor models and the selection information is sent to the server. The server activates the selected instructor model and prepares for the start of the lesson. Input: User's instructor model selection. Output: The instructor model that has been activated.
[0546] Step 5:
[0547] The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log. Input: User interaction data. Output: Interaction data processed in real time and its log.
[0548] Step 6:
[0549] During the lesson, the AI instructor presents the lesson content to the user and gives questions and assignments. The user responds and makes comments accordingly. The server monitors the dialogue data in real time and saves all interactions as logs. Input: User's responses and comments. Output: Interaction data saved as a log.
[0550] Step 7:
[0551] The server generates a progress report for the user and sends it to the terminal after the lesson ends. The terminal displays this report to the user. Input: Interaction data and lesson progress information. Output: Progress report.
[0552] Step 8:
[0553] The emotion engine recognizes the user's emotional state in real time and provides feedback according to that state. If the user feels tired, it sends a message to the device encouraging them to take a break. Input: User's facial expression data. Output: Message encouraging them to take a break.
[0554] Step 9:
[0555] The server records each user's study time in a database and manages the accumulated study time. When a certain amount of study time has been accumulated, that time is offered to other users free of charge. Input: User's study time data. Output: Study time offered free of charge.
[0556] Step 10:
[0557] The server places advertisements in appropriate locations on the platform and sends that information to the terminal. When an advertisement is displayed and clicked on while the user is in class or browsing a page, that information is sent to the server. The server reports ad click data to advertisers and manages advertising revenue. Input: Ad click data. Output: Revenue management data.
[0558] As a result, the present invention can provide a personalized learning experience that is optimized for each user, and can also build a system that simultaneously improves motivation to learn and contributes to society.
[0559] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0560] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0561] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0562] [Second embodiment]
[0563] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0564] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0565] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0566] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0567] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0568] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0569] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0570] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0571] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0572] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0573] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0574] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0575] This invention is a system that allows users to freely study languages for as long as they like, and provides lessons using approximately 100 AI instructor models tailored to their personalities and regions. The system is composed of a server, a terminal, and a user component.
[0576] User registration and personality test
[0577] The user accesses the system and enters their basic information (name, age, gender, email address, etc.) into the registration form. The device sends this information to the server. The server stores the received user information in a database and sends the user a URL for a personality assessment page. Once the user completes the personality assessment, the results are sent to the server for analysis. Based on the results of the personality assessment, the server returns a recommended list of compatible tutor models.
[0578] Select an AI teacher and start lessons
[0579] The user browses the recommendation list sent from the server and selects the AI instructor that best suits them. The selection information is sent from the device to the server. The server activates the selected instructor model and prepares to start the lesson. The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log.
[0580] Lesson progress and log storage
[0581] During the lesson, the AI instructor presents questions and tasks to the user, who then responds and makes comments. The server monitors the dialogue data in real time and stores all interactions as logs. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[0582] Sharing study time
[0583] The server records each user's study time in a database and manages the accumulated study time. When a certain amount of study time has been accumulated, the server will offer that time to other less fortunate users free of charge. For example, if two hours of study time has been accumulated, another user will be offered one hour of study time. This system encourages users to study while being conscious of contributing to society.
[0584] Advertising Revenue and Funding
[0585] The server places advertisements in appropriate locations on the platform and sends that information to the device. When an advertisement is displayed and clicked on while a user is in class or browsing a page, that information is sent to the server. The server reports ad click data to advertisers and manages advertising revenue. The server also collects donations and recruitment agency fees from companies, which are used as operating funds to ensure the sustainable operation of the system.
[0586] Specific examples
[0587] For example, a user accesses the system, enters basic information, and takes a personality test. The user is determined to be "introverted," and the server recommends a teacher model "Teacher A" that matches the introverted personality. The user selects Teacher A and begins the lesson. The lesson proceeds via video call, with the user answering questions and engaging in dialogue. The server records this in a log, and after the lesson is over, generates a progress report and provides it to the user.
[0588] Furthermore, when a user's cumulative study time reaches four hours, two of those hours are donated free of charge to other less fortunate users. Corporate advertisements are displayed on the lesson screen, and when users click on them with interest, the advertising revenue is managed as funds for maintaining the system. In this way, the present invention provides a high-quality language learning environment for all users, while eliminating educational disparities and contributing to society.
[0589] The processing flow will be explained below.
[0590] User registration and personality test
[0591] Step 1:
[0592] The user accesses the system's registration page and enters basic information (name, age, gender, email address, etc.).
[0593] Step 2:
[0594] The device sends the user's basic information to the server.
[0595] Step 3:
[0596] The server stores the user's basic information in a database, generates a URL for the personality test page, and returns it to the device.
[0597] Step 4:
[0598] The user visits the personality test page and answers the questions displayed.
[0599] Step 5:
[0600] The device sends the user's personality test answers to the server.
[0601] Step 6:
[0602] The server analyzes the personality test answers in real time and determines the user's personality.
[0603] Step 7:
[0604] Based on the results of the assessment, the server sends the most suitable AI instructor model to the terminal as a recommendation list.
[0605] Select an AI teacher and start lessons
[0606] Step 8:
[0607] Users can select the tutor that best suits them from the recommended AI tutor models.
[0608] Step 9:
[0609] The terminal transmits the user's selection information to the server.
[0610] Step 10:
[0611] The server activates the selected AI instructor model and prepares for the start of the lesson.
[0612] Step 11:
[0613] The device will notify the user that the lesson has started and launch the learning screen.
[0614] Step 12:
[0615] The user begins a dialogue with the AI instructor on the learning screen.
[0616] Lesson progress and log storage
[0617] Step 13:
[0618] The AI instructor presents the lesson content to the user and gives questions and assignments.
[0619] Step 14:
[0620] Users respond and comment accordingly.
[0621] Step 15:
[0622] The server records the dialogue data between the user and the AI instructor in real time and stores the dialogue logs in a database.
[0623] Step 16:
[0624] After the lesson ends, the server generates a progress report for the user and sends it to the device.
[0625] Step 17:
[0626] The device displays a progress report to the user.
[0627] Sharing study time
[0628] Step 18:
[0629] The server records the user's study time in a database and manages the cumulative study time.
[0630] Step 19:
[0631] When the accumulated learning time reaches a certain value, the server provides that time to other less fortunate users free of charge.
[0632] Step 20:
[0633] Free users will receive a notification and access the class page.
[0634] Advertising Revenue and Funding
[0635] Step 21:
[0636] The server places the advertisement in the appropriate location on the platform and sends the information to the device.
[0637] Step 22:
[0638] The device displays advertisements on the user's learning screen.
[0639] Step 23:
[0640] When a user clicks on an advertisement, the click information is sent to the server.
[0641] Step 24:
[0642] The server reports click data to advertisers and manages advertising revenue.
[0643] Step 25:
[0644] The server collects donations and recruitment agency fees from companies and uses these funds to fund the system's operations.
[0645] Through these specific processing steps, users can receive high-quality language learning for free and also contribute to society.
[0646] Example 1
[0647] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0648] Conventional language learning systems have not provided sufficient means for selecting the optimal teacher model for each individual user, resulting in inefficient learning. Furthermore, there is no mechanism for properly managing learning progress or providing learning time to other users. Furthermore, there are insufficient methods for effectively displaying advertisements and managing revenue. Therefore, there is a need for a system that allows users to contribute to society while efficiently learning a language.
[0649] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0650] In this invention, the server includes a means for a user to input their basic information and conduct a personality assessment, a means for recommending an optimal teacher model based on the results of the personality assessment, and a means for the user to select a teacher model and start a lesson. This allows the optimal teacher model to be selected for each individual user, enabling efficient learning. The server also includes a means for recording interactions with the user during lessons and managing progress, a means for accumulating the user's study time and providing that time to other users, and a means for displaying advertisements and managing advertising revenue. This makes it possible to appropriately manage the user's study progress, provide free study time to underprivileged users, and effectively manage advertising revenue.
[0651] "Basic information" refers to personal data entered by the user, such as name, age, gender, and email address.
[0652] A "personality test" is a test or questionnaire that assesses a user's personality and categorizes them into specific patterns.
[0653] A "teacher model" is an artificial intelligence character model designed to provide lessons to users.
[0654] The "lesson start means" is a function that allows the user to activate the teacher model selected and start learning.
[0655] The "interaction recording means" is a function that records all interactions between the user and the teacher model during a lesson.
[0656] "Progress management means" is a function that monitors the user's learning progress and provides appropriate feedback and reports.
[0657] "Accumulated study time" refers to calculating the total time a user spends studying on the system.
[0658] "Means for providing study time" is a system in which a portion of accumulated study time is provided free of charge to other less fortunate users.
[0659] "Advertisement display means" is a function that displays advertisement content while the user is using the system.
[0660] "Advertising revenue management means" is a function for collecting and managing revenue earned from displayed advertisements.
[0661] This invention is a system that allows users to freely study languages for as long as they like, and provides lessons using AI instructor models tailored to their personalities and regions. The system is composed of components: a server, a terminal, and a user.
[0662] User registration and personality test
[0663] A user accesses the system and uses a terminal to enter basic information such as name, age, gender, and email address into a registration form. The terminal then sends this information to the server. The server stores the received user information in a database and sends the user a URL for a personality assessment page. Once the user completes the personality assessment, the results are sent to the server for analysis. The personality assessment involves the user answering questions to assess their personality and classify it into specific patterns. Based on these results, the server returns a list of recommended teacher models that are compatible with the user.
[0664] For example, when a user first accesses the system, they enter the required information into a web form in their browser. The server then emails the user a URL for a personality test. The user is then prompted, for example, to "take the personality test," and the user completes the test.
[0665] Select an AI teacher and start lessons
[0666] The user browses the recommendation list sent from the server and selects the AI instructor that best suits them. The selection information is sent from the device to the server. The server activates the selected teacher model and prepares to start the lesson. The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log.
[0667] For example, when a user selects "Teacher A" from the recommended list and starts a lesson, the lesson screen will launch and a conversation with the AI instructor will begin in a video call format. For example, a prompt will appear asking, "Do you want to start today's lesson?" and the user will select "Start."
[0668] Lesson progress and log storage
[0669] During the lesson, the AI instructor presents questions and tasks to the user, who then responds and makes comments. The server monitors the dialogue data in real time and stores all interactions as logs. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[0670] As a concrete example, during a lesson, an AI instructor will ask questions such as, "Please explain yesterday's weather in English." The user's answers are sent to the server in real time and recorded in a log. After the lesson ends, a "progress report of today's lesson" is displayed to the user.
[0671] Sharing study time
[0672] The server records each user's study time in a database and manages the accumulated study time. When a certain amount of study time has been accumulated, the server will offer that time to other less fortunate users free of charge. For example, if two hours of study time has been accumulated, another user will be offered one hour of study time. This system encourages users to study while being conscious of contributing to society.
[0673] Advertising Revenue and Funding
[0674] The server places advertisements in appropriate locations on the platform and sends that information to the device. When an advertisement is displayed and clicked on while a user is in class or browsing a page, that information is sent to the server. The server reports ad click data to advertisers and manages advertising revenue. The server also collects donations and recruitment agency fees from companies, which are used as operating funds to ensure the sustainable operation of the system.
[0675] For example, an advertising banner is displayed on the sidebar of a lesson screen, and when a user clicks on the ad, the click information is sent to the server. A prompt is displayed asking, "Are you interested in new language learning materials?" If the user selects "Yes," they are redirected to the advertiser's page.
[0676] In this way, the present invention provides a high-quality language learning environment to all users, while eliminating educational disparities and contributing to society.
[0677] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0678] Step 1:
[0679] The user enters basic information.
[0680] Input: Basic information such as name, age, gender, and email address.
[0681] What happens: A user accesses a web form in a browser and enters the required information.
[0682] Output: The device sends the entered information as an HTTP POST request.
[0683] Step 2:
[0684] The terminal sends the information to the server.
[0685] Input: Basic information entered by the user.
[0686] Specific operation: The device sends data asynchronously using JavaScript or Ajax.
[0687] Output: The server stores the received information in a database.
[0688] Step 3:
[0689] The server stores the information in a database.
[0690] Input: Basic user information data.
[0691] What happens: A server-side script (e.g., PHP or Node.js) executes an INSERT query against the database.
[0692] Output: Basic information stored in the database.
[0693] Step 4:
[0694] The server sends the URL of the personality test page.
[0695] Input: The user's email address.
[0696] Specific operation: The server uses the SMTP server to send an email containing a link to the personality test page.
[0697] Output: The user will receive a link to the personality test page in their mailbox.
[0698] Step 5:
[0699] The user completes a personality test.
[0700] Input: URL of the personality test page.
[0701] Specific behavior: The user visits a personality test page and answers a few questions.
[0702] Output: The results of the personality test are displayed and sent from the device to the server.
[0703] Step 6:
[0704] The terminal transmits the diagnosis results to the server.
[0705] Input: Personality test results.
[0706] Specific operation: The device sends an HTTP POST request containing the diagnostic results to the server.
[0707] Output: The server analyzes the diagnostic results it receives.
[0708] Step 7:
[0709] The server analyzes the diagnostic results and returns a list of recommendations.
[0710] Input: Personality test result data.
[0711] Specific operation: The server uses the generative AI model to analyze the diagnosis results and create a list of recommended teacher models that match the user's personality.
[0712] Output: The user is presented with a list of recommendations.
[0713] Step 8:
[0714] The user browses the recommendations list.
[0715] Input: A list of recommendations sent by the server.
[0716] Specific operation: The user checks the list in a web browser and selects the desired teacher model.
[0717] Output: Information on the selected teacher model is passed to the next process.
[0718] Step 9:
[0719] The terminal transmits the selection information to the server.
[0720] Input: Information about the teacher model selected by the user.
[0721] Specific operation: The terminal sends an HTTP POST request including the selection information to the server.
[0722] Output: The server receives the selection and continues processing.
[0723] Step 10:
[0724] The server activates the teacher model.
[0725] Input: Information about the teacher model selected by the user.
[0726] Specific operation: The server launches an instance of the selected teacher model and makes it active.
[0727] Output: Lesson is ready to begin.
[0728] Step 11:
[0729] The device will display a notification that class is about to begin.
[0730] Input: Notification from the server that the lesson is ready to begin.
[0731] Specific behavior: The device will display a pop-up notification in the browser and redirect you to the learning screen.
[0732] Output: The user is notified that the lesson has started.
[0733] Step 12:
[0734] The user starts a lesson.
[0735] Input: Lesson start screen.
[0736] How it works: The user begins a conversation with the AI instructor on the lesson screen, via text chat or voice interaction.
[0737] Output: Interaction data is sent to the server.
[0738] Step 13:
[0739] The server processes and stores the interaction data.
[0740] Input: User interaction data.
[0741] Specific operation: The server processes the interaction data in real time and stores the interaction log in the database.
[0742] Output: The interaction log is saved to a database.
[0743] Step 14:
[0744] The server generates a progress report.
[0745] Input: Interaction log data.
[0746] Specific operation: The server analyzes the interaction log and creates a progress report for the user.
[0747] Output: A progress report is generated.
[0748] Step 15:
[0749] The device will display a progress report.
[0750] Input: A progress report sent by the server.
[0751] Specific behavior: The device displays a progress report to the user.
[0752] Output: User sees status report.
[0753] Step 16:
[0754] The server records the study time in a database.
[0755] Input: User study time data.
[0756] Specific operation: The server measures the time that the user is logged in and updates the database.
[0757] Output: The cumulative learning time is recorded in a database.
[0758] Step 17:
[0759] The server manages the cumulative learning time and provides a certain amount of time free of charge.
[0760] Input: Accumulated study time data.
[0761] Specific operation: The server executes logic that provides free study time to other users when a certain amount of study time has been accumulated.
[0762] Output: The free learning time is recorded.
[0763] Step 18:
[0764] The server places the advertisement and sends it to the device.
[0765] Input: Ad data.
[0766] Specific operation: The server places the advertisement in the appropriate location on the platform and sends the advertisement data to the terminal.
[0767] Output: Advertising data is sent to the device.
[0768] Step 19:
[0769] The device displays advertisements.
[0770] Input: Advertisement data sent from the server.
[0771] What it does: The device displays advertising banners in the sidebar or at the top of web pages.
[0772] Output: The user is shown the ad.
[0773] Step 20:
[0774] A user clicks on an ad.
[0775] Input: The ad displayed.
[0776] Specific behavior: The event of a user clicking on an ad is tracked.
[0777] Output: Click information is sent to the server.
[0778] Step 21:
[0779] The server reports ad click data and manages revenue.
[0780] Input: Ad click data.
[0781] Specific operation: The server reports click data to advertisers and manages advertising revenue.
[0782] Output: Advertising revenue is managed.
[0783] Step 22:
[0784] The server collects donations and recruitment fees.
[0785] Input: Data on donations and job intermediation.
[0786] Specific operation: The server collects donations and recruitment agency fees from companies and manages them as operating funds.
[0787] Output: The funds collected are used to run the system sustainably.
[0788] (Application example 1)
[0789] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0790] Current online education systems and virtual stores make it difficult for users to receive optimal support and education tailored to their individual needs and personalities. Furthermore, systems for managing learning progress and contributing to society are insufficient, and the lack of multilingual support in virtual stores is becoming apparent. These challenges make it difficult to improve user satisfaction and eliminate educational disparities.
[0791] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0792] In this invention, the server includes: means for a user to input their own basic information and conduct a personality assessment; means for recommending an optimal instructor model based on the results of the personality assessment; means for the user to select an instructor model and start a lesson; means for recording dialogue with the user during the lesson and managing progress; means for accumulating the user's study time and providing that time to other users; means for displaying advertisements and managing advertising revenue; means for providing the user with multilingual guidance and support when searching for, purchasing, or inquiring about products in a virtual store; and means for selecting a recommended virtual guide and exploring the store with that guide. This allows the user to receive education and support optimized to their individual needs, thereby eliminating social educational disparities and achieving high user satisfaction.
[0793] "Basic user information" refers to information such as name, age, gender, and email address that a user enters when registering with the system.
[0794] "Personality diagnosis" is a diagnostic tool that analyzes the user's personality and recommends the most suitable instructor model based on the results.
[0795] The "instructor model" is a lesson delivery model that implements AI tailored to the instructor's personality and region, providing the most appropriate education to the user.
[0796] "Lesson starts" refers to the state in which the user activates the selected instructor model and the lesson actually begins.
[0797] "Dialogue recording" is the process of saving the interaction between the user and the AI instructor during the lesson as a log so that it can be referenced later.
[0798] "Progress management" is the process of tracking a user's learning progress and providing feedback based on that progress.
[0799] "Accumulating learning time" is the process of tallying and recording the time a user spends learning on the system.
[0800] "Providing to other users" means distributing a portion of the accumulated learning time to other less fortunate users free of charge.
[0801] "Displaying Advertisements" means the process of placing Advertisements on the Platform and making them visible to Users.
[0802] "Advertising revenue management" is the process of aggregating click data from displayed ads and managing the resulting revenue as operating funds.
[0803] "Exploring the virtual store" means that a user browses, selects, purchases, and inquires about products within a virtual shopping environment.
[0804] "Multilingual guidance and support" means that the AI guide provides guidance and support in different languages depending on the user's language settings.
[0805] "Selecting a virtual guide" is the process of selecting the most suitable virtual guide based on the results of a personality test and the user's preferences, and then exploring the store together.
[0806] MODE FOR CARRYING OUT THE INVENTION
[0807] The present invention is a system that allows users to freely learn languages and receive multilingual guidance in virtual stores. The system is composed of components: a server, a terminal, and a user. The system is implemented as follows:
[0808] User registration and personality test
[0809] The user accesses the system from their device and enters basic information such as name, age, gender, and email address into the registration form. The device sends this information to the server. The server stores the received user information in a database and sends the user a URL for the personality assessment page. Once the user completes the personality assessment, the results are sent to the server, which analyzes them. Based on the results of the personality assessment, the server returns a list of recommended tutor models who are compatible with the user to the user.
[0810] Select an AI teacher and start lessons
[0811] The user browses the recommendation list sent from the server and selects the AI instructor that best suits them. This selection information is sent from the device to the server. The server activates the selected instructor model and prepares to start the lesson. The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log.
[0812] Lesson progress and log storage
[0813] During the lesson, the AI instructor presents questions and tasks to the user, who then responds and makes comments. The server monitors the dialogue data in real time and saves all interactions as a log. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[0814] Sharing study time
[0815] The server records each user's study time in a database and manages the cumulative study time. When a user achieves a certain amount of study time, a portion of that time is donated free of charge to other less fortunate users. For example, if a user accumulates two hours of study time, they can donate one hour of study time to another user. This system allows users to study while being conscious of contributing to society.
[0816] Advertising Revenue and Funding
[0817] The server places advertisements in appropriate locations on the platform and sends that information to the device. When a user clicks on an advertisement displayed during class or while browsing a page, that information is sent to the server. The server collects ad click data, reports it to advertisers, and manages advertising revenue. It also collects donations and recruitment agency fees from companies, which it uses as operating funds to ensure the sustainable operation of the system.
[0818] Multilingual guidance in the virtual store
[0819] When a user accesses a virtual store, they select the AI guide that best suits them based on their basic information and personality assessment. The selected information is sent from the device to the server. The server then activates the selected virtual guide and guides the user in multiple languages through product exploration, purchases, and inquiries within the virtual store. Interaction data is saved as a log on the server in real time, allowing the server to provide support tailored to the user's progress and interests.
[0820] Hardware and software used
[0821] Server (Amazon Web Services (AWS), Google Cloud Platform (GCP), etc.)
[0822] Client terminal (smartphone: iOS / Android, PC)
[0823] Database (MySQL, PostgreSQL)
[0824] AI teacher model (GPT-3, Google BERT)
[0825] Development language (Python, JavaScript, Swift, Kotlin)
[0826] Specific Examples
[0827] Users visit the virtual store
[0828] When a user visits a virtual store and is guided through the products, the following prompt is used:
[0829] "Hello. What product would you like to know about today? Tell me what you're looking for."
[0830] Interact with a virtual AI guide
[0831] When a user asks about a specific product, the following exchange might occur:
[0832] User: "Tell me about this TV."
[0833] AI Guide: "This TV is equipped with the latest 4K technology, delivering exceptional picture quality. It also has a wealth of smart features. Want to know more?"
[0834] In this way, the AI guide can provide personalized information in response to user questions.
[0835] As described above, the present invention provides optimal education and virtual store support tailored to the needs of each individual user, thereby improving user satisfaction and eliminating social educational disparities.
[0836] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0837] Step 1:
[0838] User registration and basic information entry
[0839] A user accesses the system from a terminal and enters basic information such as name, age, gender, and email address into the registration form. The terminal sends the entered basic information to the server. The server stores the received user information in a database and sends the terminal the URL of the personality test page to proceed to the next step. The input is the user's basic information, and the output is the URL of the personality test page.
[0840] Step 2:
[0841] Personality test
[0842] The user accesses the personality test page and answers the questions. The answers are sent from the device to the server. The server analyzes the received personality test results and uses a prepared generative AI model to select the most suitable tutor model for the user. The analysis results are returned to the user as a list of recommendations. The input is the personality test answer results, and the output is a list of recommended tutor models.
[0843] Step 3:
[0844] Select an AI teacher and start lessons
[0845] The user browses the recommended list and selects a suitable instructor model. This selection information is sent from the terminal to the server. The server activates the selected instructor model and prepares for the start of the lesson. The terminal displays a notification that the lesson has started to the user and launches the learning screen. The input is the instructor model selection information, and the output is a notification that the lesson has started and the learning screen.
[0846] Step 4:
[0847] Recording of lesson progress and dialogue
[0848] During the lesson, the AI instructor presents the user with questions and tasks. The user answers them and engages in a dialogue. The server processes this dialogue data in real time and saves all interactions as a log. The input is the user's answers and dialogue data, and the output is the dialogue log.
[0849] Step 5:
[0850] Generate progress reports
[0851] After the lesson ends, the server analyzes the dialogue log and generates a progress report for the user. The generated report is sent to the terminal and displayed to the user. The input is the log data, and the output is the progress report.
[0852] Step 6:
[0853] Managing and sharing study time
[0854] The server records the user's study time in a database and manages the accumulated study time. When a certain amount of study time is achieved, a portion of that time is offered free of charge to other less fortunate users. The input is the accumulated study time data, and the output is a notification of the free offer.
[0855] Step 7:
[0856] Ad display and revenue management
[0857] The server places ads in the appropriate locations on the platform and sends the information to the device. When a user clicks on an ad, the click data is sent to the server. The server collects this data and reports it to advertisers to manage revenue. The input is ad click data, and the output is revenue management data.
[0858] Step 8:
[0859] Multilingual guidance in the virtual store
[0860] Users access a virtual store and select the most suitable AI guide based on their basic information and personality assessment. The selection information is sent from the device to the server. The server activates the selected virtual guide and guides the user in multiple languages to explore products in the virtual store, make purchases, and make inquiries. Interaction data is saved as a log on the server in real time, providing support based on the user's progress and interests. The input is the AI guide's selection information, and the output is multilingual guidance and log data.
[0861] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0862] This invention is a system that allows users to freely study languages for as long as they like, and provides lessons using an AI instructor model and emotion engine tailored to the personalities and regions of approximately 100 people. The system is composed of server, terminal, and user components.
[0863] User registration and personality test
[0864] The user accesses the system and enters their basic information (name, age, gender, email address, etc.) into the registration form. The device sends this information to the server. The server stores the received user information in a database and sends the user a URL for a personality assessment page. Once the user completes the personality assessment, the results are sent to the server for analysis. Based on the results of the personality assessment, the server returns a recommended list of compatible tutor models.
[0865] Select an AI teacher and start lessons
[0866] The user browses the recommendation list sent from the server and selects the AI instructor that best suits them. The selection information is sent from the device to the server. The server activates the selected instructor model and prepares for the start of the lesson. The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log.
[0867] Lesson progress and log storage
[0868] During the lesson, the AI instructor presents the lesson content to the user and poses questions and assignments. The user responds and makes comments accordingly. The server monitors the dialogue data in real time and saves all interactions as a log. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[0869] Incorporating an emotion engine
[0870] The emotion engine recognizes the user's emotional state in real time and provides feedback according to that state. For example, if a user is feeling frustrated during a lesson, the emotion engine will detect this information and the server will generate an encouraging message and send it to the device. This will help the user maintain their motivation to learn.
[0871] Furthermore, the emotion engine has the function of determining the user's stress level. If the stress level is determined to be high, the server will suggest an appropriate time to take a break and send a message to the device urging it to take a break.
[0872] Sharing study time
[0873] The server records each user's study time in a database and manages the accumulated study time. When a certain amount of study time has been accumulated, the server will offer that time to other less fortunate users free of charge. For example, if two hours of study time has been accumulated, another user will be offered one hour of study time. This system encourages users to study while being conscious of contributing to society.
[0874] Advertising Revenue and Funding
[0875] The server places advertisements in appropriate locations on the platform and sends that information to the device. When an advertisement is displayed and clicked on while a user is in class or browsing a page, that information is sent to the server. The server reports ad click data to advertisers and manages advertising revenue. The server also collects donations and recruitment agency fees from companies, which are used as operating funds to ensure the sustainable operation of the system.
[0876] Specific examples
[0877] For example, a user accesses the system, enters basic information, and takes a personality test. The user is determined to be "introverted," and the server recommends a teacher model "Teacher A" that matches the introverted personality. The user selects Teacher A and begins the lesson. The lesson proceeds via video call, with the user answering questions and engaging in dialogue. The server records this in a log, and after the lesson is over, generates a progress report and provides it to the user.
[0878] Furthermore, if the emotion engine determines that the user is tired during class, the server will send a message suggesting a break. At the same time, if the user's cumulative study time reaches four hours, two of those hours will be donated free of charge to other less fortunate users. Corporate advertisements are displayed on the class screen, and if a user clicks on them with interest, the advertising revenue is managed as funds to maintain the system.
[0879] In this way, the present invention provides a high-quality language learning environment to all users, while eliminating educational disparities and contributing to society.
[0880] The processing flow will be explained below.
[0881] User registration and personality test
[0882] Step 1:
[0883] The user accesses the system's registration page and enters basic information (name, age, gender, email address, etc.).
[0884] Step 2:
[0885] The device sends the user's basic information to the server.
[0886] Step 3:
[0887] The server stores the user's basic information in a database, generates a URL for the personality test page, and returns it to the device.
[0888] Step 4:
[0889] The user visits the personality test page and answers the questions displayed.
[0890] Step 5:
[0891] The device sends the user's personality test answers to the server.
[0892] Step 6:
[0893] The server analyzes the personality test answers in real time and determines the user's personality.
[0894] Step 7:
[0895] Based on the results of the assessment, the server sends the most suitable AI instructor model to the terminal as a recommendation list.
[0896] Select an AI teacher and start lessons
[0897] Step 8:
[0898] Users can select the tutor that best suits them from the recommended AI tutor models.
[0899] Step 9:
[0900] The terminal transmits the user's selection information to the server.
[0901] Step 10:
[0902] The server activates the selected AI instructor model and prepares for the start of the lesson.
[0903] Step 11:
[0904] The device will notify the user that the lesson has started and launch the learning screen.
[0905] Step 12:
[0906] The user begins a dialogue with the AI instructor on the learning screen.
[0907] Lesson progress and log storage
[0908] Step 13:
[0909] The AI instructor presents the lesson content to the user and gives questions and assignments.
[0910] Step 14:
[0911] Users respond and comment accordingly.
[0912] Step 15:
[0913] The server records the dialogue data between the user and the AI instructor in real time and stores the dialogue logs in a database.
[0914] Step 16:
[0915] The server uses an emotion engine to analyze the user's emotional state from the dialogue data and decides on an appropriate response.
[0916] Step 17:
[0917] If the user's emotions indicate fatigue or stress, the emotion engine detects this and notifies the server.
[0918] Step 18:
[0919] The server generates messages encouraging the user or encouraging them to take a break and sends them to the device.
[0920] Step 19:
[0921] The terminal displays the generated message to the user.
[0922] Step 20:
[0923] After the lesson ends, the server generates a progress report for the user and sends it to the device.
[0924] Step 21:
[0925] The device displays a progress report to the user.
[0926] Sharing study time
[0927] Step 22:
[0928] The server records the user's study time in a database and manages the cumulative study time.
[0929] Step 23:
[0930] When the accumulated learning time reaches a certain value, the server provides that time to other less fortunate users free of charge.
[0931] Step 24:
[0932] Free users will receive a notification and access the class page.
[0933] Advertising Revenue and Funding
[0934] Step 25:
[0935] The server places the advertisement in the appropriate location on the platform and sends the information to the device.
[0936] Step 26:
[0937] The device displays advertisements on the user's learning screen.
[0938] Step 27:
[0939] When a user clicks on an advertisement, the click information is sent to the server.
[0940] Step 28:
[0941] The server reports click data to advertisers and manages advertising revenue.
[0942] Step 29:
[0943] The server collects donations and recruitment agency fees from companies and uses these funds to fund the system's operations.
[0944] Through these specific processing steps, users can receive high-quality language learning for free and also contribute to society.
[0945] Example 2
[0946] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0947] Conventional language learning systems have struggled to provide optimal learning tailored to each user's individual personality and regional background, and have often relied on uniform content and pace. It has also been difficult to grasp a user's emotional state in real time during learning and provide effective feedback based on that. Furthermore, maintaining user motivation and fostering a sense of social contribution during long learning periods have also been challenges.
[0948] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0949] In this invention, the server includes means for a user to input their own basic information and conduct a personality diagnosis, means for recommending the most suitable instructor model based on the results of the personality diagnosis, means for the user to select an instructor model and start the lesson, means for recording the dialogue with the user during the lesson and managing the progress, means for recognizing the user's emotional state in real time and providing feedback according to that state, means for accumulating the user's study time and providing that time to other users, and means for displaying advertisements and managing advertising revenue. This provides an optimal learning environment for each user, realizes appropriate feedback according to emotions, and aims to improve awareness of social contribution through the accumulation of study time.
[0950] "Basic information" refers to information related to personal identification, such as name, age, gender, and email address, entered by the user.
[0951] "Personality diagnosis" is a process for evaluating a user's personality and characteristics and selecting a suitable instructor model based on that.
[0952] The "Instructor Model" is an AI-based educational content provider designed to assist users in their learning.
[0953] A "lesson" is an educational session conducted by an AI instructor model for a user, and includes dialogue and assignment presentation.
[0954] "Dialogue Data" refers to the voice, text, and other interaction data exchanged between a user and an AI instructor model during a lesson.
[0955] "Progress management" is the process of recording and analyzing a user's learning content and progress and providing appropriate feedback.
[0956] "Emotional state" refers to the user's psychological and emotional state, including stress, frustration, etc.
[0957] "Feedback" refers to responses such as encouragement or advice provided based on the user's learning progress or emotional state.
[0958] "Cumulative Study Time" refers to the total time a User spends studying using the System.
[0959] "Sharing" refers to a system in which a portion of accumulated study time is provided free of charge to other less fortunate users.
[0960] "Advertisement" refers to promotional information for companies, organizations, etc. that is displayed on the system.
[0961] "Advertising Revenue" refers to revenue earned from users viewing or clicking on advertisements displayed on the System.
[0962] This invention is a system that allows users to freely study languages for as long as they like, and provides lessons using an AI instructor model and emotion engine tailored to the personalities and regions of approximately 100 people. The system is composed of server, terminal, and user components.
[0963] User registration and personality test
[0964] Users access the system using their own devices and enter basic information such as name, age, gender, and email address into the registration form. The device sends this information to the server. The server stores the received user information in a database and sends the user a URL for the personality test page, allowing them to take the test.
[0965] Once the user has completed the personality test, the results are sent from the device to the server, which analyzes the results and generates a list of recommended tutor models based on the user's personality. This list is then presented to the user via the device.
[0966] Select an AI teacher and start lessons
[0967] The user browses a list of recommended instructors on their device and selects an AI instructor that best suits them. The selection information is sent from the device to the server. The server sets the selected instructor model to active status and prepares for the start of the lesson. When preparations are complete, the server sends a notification to the device, which displays that information to the user. The lesson then progresses when the user launches the learning screen and begins interacting with the AI instructor.
[0968] Lesson progress and log storage
[0969] During the lesson, the AI instructor presents the lesson content to the user and poses questions and assignments. The user responds and makes comments accordingly. All of these interactions are sent to the server in real time and saved as logs by the server. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[0970] Incorporating an emotion engine
[0971] The emotion engine recognizes the user's emotional state in real time and provides feedback according to that state. For example, if a user feels frustrated during class, the emotion engine detects this information and the server generates an encouraging message and sends it to the device. This helps the user maintain their motivation to study. The emotion engine also has the function of determining the user's stress level, and if a high stress level is detected, the server will send a message to the device suggesting an appropriate break.
[0972] Sharing study time
[0973] The server records each user's study time in a database and manages the cumulative study time. When the cumulative study time reaches a certain level, the server provides a portion of it to other users. This system is intended to promote a sense of social contribution.
[0974] Ad display and revenue management
[0975] The server places advertisements in appropriate locations on the platform and transmits the information to the device. When a user views or clicks on an advertisement, the information is sent to the server. The server manages advertising revenue based on this information, and also collects donations and recruitment agency fees from companies to fund the system's operations.
[0976] Examples of concrete examples and prompts
[0977] For example, a user accesses the system, enters basic information, and takes a personality test. The user is determined to be introverted, and the server recommends a teacher model named "Teacher A" who matches the introverted personality. The user selects Teacher A and begins the lesson. The lesson proceeds via video call, with the user answering questions and engaging in dialogue. The server records this in a log, and after the lesson is over, generates a progress report and provides it to the user.
[0978] Furthermore, if the emotion engine determines that the user is tired during class, the server will send a message suggesting a break. At the same time, if the user's cumulative study time reaches four hours, two of those hours will be donated free of charge to other less fortunate users. Corporate advertisements are displayed on the class screen, and if a user clicks on them with interest, the advertising revenue is managed as funds to maintain the system.
[0979] Example prompt: "Write a scene in which a user accesses the system, enters basic information, and takes a personality test. Include a scene in which the user is determined to be an introvert and selects an AI tutor who matches their introverted personality to begin the lesson. Also, include a scene in which the emotion engine provides appropriate feedback if the user feels fatigued during the lesson."
[0980] In this way, the present invention provides a high-quality language learning environment to all users, while eliminating educational disparities and contributing to society.
[0981] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0982] Step 1: User Registration
[0983] Input: The user enters their basic information (name, age, gender, email address, etc.) into the registration form.
[0984] Action: The device sends this information to the server.
[0985] Data processing / calculation: The server stores the received information in a database.
[0986] Output: The server sends the user the URL of the personality test page.
[0987] Step 2: Take a personality test
[0988] Input: A user visits the personality assessment page and completes the test.
[0989] Operation: The device sends the results of the personality test to the server.
[0990] Data processing / calculation: The server analyzes the diagnostic results and identifies the user's personality traits.
[0991] Output: The server generates the best tutor model as a recommendation list and sends it to the device.
[0992] Step 3: Select an AI teacher
[0993] Input: User browses the recommendation list on their device and selects the best teacher model.
[0994] Operation: The device sends the selection information to the server.
[0995] Data processing / calculation: The server sets the selected instructor model to the active state and prepares for the start of the lesson.
[0996] Output: The server sends a notification to the terminal that the lesson is ready to start.
[0997] Step 4: Start classes
[0998] Input: The terminal that receives the notification from the server notifies the user that the lesson has started.
[0999] How it works: The user launches the lesson screen and begins a dialogue with the AI instructor.
[1000] Data processing / calculation: The server records the interaction data between the user and the AI teacher model in real time.
[1001] Output: Initial interaction log stored in the database.
[1002] Step 5: Classroom Management
[1003] Input: During class, users respond to instructions and questions from the instructor.
[1004] How it works: The device sends the user's answers and comments to the server.
[1005] Data processing / calculation: The server analyzes interaction data in real time and stores it as a log.
[1006] Output: Progress report data for the lesson content is generated.
[1007] Step 6: Feedback from the Emotion Engine
[1008] Input: The user's facial and voice data is captured in real time.
[1009] Operation: The device sends this data to the server.
[1010] Data processing / calculation: The emotion engine on the server analyzes the data and determines the user's emotional state.
[1011] Output: Generates appropriate feedback messages for the user and sends them to the device.
[1012] Step 7: Share your study time
[1013] Input: User learning time data accumulated on the server.
[1014] How it works: The server periodically checks the accumulated time to see if it has reached a certain threshold.
[1015] Data processing / calculation: When the standard is reached, the excess time is allocated to other users.
[1016] Output: Sends notification of time donation to relevant users.
[1017] Step 8: Display ads and manage revenue
[1018] Input: Advertising data and user activity data while learning and browsing.
[1019] How it works: The server places the ad in the appropriate location and sends the information to the device.
[1020] Data processing / calculation: When an advertisement is clicked, the data is collected and analyzed.
[1021] Output: Reporting ad revenue data to advertisers and managing revenue.
[1022] Through this series of steps, the system provides users with an effective language learning environment, maintaining their motivation to learn while also contributing to society.
[1023] (Application example 2)
[1024] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1025] Conventional language learning systems lack personalization based on the user's personality and learning situation, and lack real-time feedback and emotional state management to maintain motivation to learn. Furthermore, it is difficult for users to share their accumulated learning time with other users, and there is a lack of a mechanism to continue learning while maintaining a sense of social contribution.
[1026] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a user to input their basic information and conduct a personality assessment, a means for recommending an optimal instructor model based on the results of the personality assessment, a means for the user to select an instructor model and start a lesson, a means for recording dialogue with the user during the lesson and managing progress, a means for accumulating the user's study time and providing that time to other users, a means for displaying advertisements and managing advertising revenue, a means for recognizing the user's emotional state in real time and providing feedback, a means for generating a list of recommended video content, and a means for monitoring facial expressions and analyzing the user's emotional state. This provides a personalized learning environment tailored to the user's personality and emotional state, making it possible to continue learning and increase a sense of social contribution.
[1027] "Basic information" refers to personal information such as the user's name, age, gender, and email address.
[1028] A "personality assessment" is a method for analyzing a user's personality and providing an optimal learning experience based on the results.
[1029] The "instructor model" is a virtual instructor created using AI technology, and is a program that provides lessons to users.
[1030] "Starting a lesson" is the process by which a user begins language learning interactively with a selected instructor model.
[1031] "Recording a dialogue" is the process of saving the communication that takes place between the user and the instructor model.
[1032] "Manage Progress" is a way to track and record a user's learning progress and achievements.
[1033] "Accumulating study time" is the process of recording the total amount of study time a user has performed and managing that total.
[1034] The "means of provision" refers to a mechanism that allows users to share their accumulated study time with other users.
[1035] "Advertising Revenue Management" is a means of tracking revenue generated from displayed ads and managing that revenue as operating funds.
[1036] "Real-time emotional state recognition" is the process of analyzing a user's facial expressions and tone of voice to determine their emotions at any given time.
[1037] "Providing feedback" means providing encouragement and advice in real time based on the user's learning progress and emotional state.
[1038] "Generating a video content recommendation list" is the process of creating a list to recommend the most suitable learning videos based on the user's personality assessment and learning history.
[1039] "Monitoring facial expressions to analyze emotional state" refers to the process of using a camera to capture a user's facial expressions and then identifying their emotional state through an emotion identification algorithm.
[1040] The present invention is a system that allows users to freely study a language for as long as they like, and includes a means for providing video learning content optimized for each user. This invention is implemented using the following hardware and software.
[1041] Hardware
[1042] Smartphone: Uses a smartphone with a camera to capture the user's facial expressions.
[1043] Server: A server for database management and real-time processing.
[1044] software
[1045] Python: Used to implement various processing logic.
[1046] TensorFlow: Running machine learning models for sentiment analysis.
[1047] OpenCV: An image processing library for capturing and analyzing the user's facial expressions.
[1048] Firebase: Used for storing user information, real-time processing, and database management.
[1049] Operation explanation
[1050] User registration and personality test
[1051] Users download the smartphone app and enter basic information (such as name, age, gender, and email address). The information is sent from the smartphone to a server, which stores it in a database. When users log in for the first time, they take a personality test, and the server recommends the most suitable instructor model based on the results.
[1052] Content recommendations and viewing
[1053] The server generates a recommendation list containing the most suitable video content for the user based on the results of the personality test. The user then uses their smartphone to select a video from this recommendation list and begin watching.
[1054] Video viewing management and progress reporting
[1055] While watching the video, the user's dialogue and reactions are recorded in real time and sent to the server. The recorded dialogue and reactions are analyzed on the server side, and a report based on the user's learning progress is generated. When the video viewing ends, this report is displayed on the smartphone device.
[1056] Implementing the Emotion Engine
[1057] While watching, the user's facial expressions are monitored through the smartphone camera. The emotion engine analyzes this facial data to determine whether the user is tired or stressed. The emotion engine analyzes the user's emotional state in real time, notifying them of the need to take a break and displaying encouraging messages as needed.
[1058] Sharing study time
[1059] When a user's cumulative viewing time reaches a certain amount, that information is sent to a server and offered as free study time for other users. This system allows study time to be used to contribute to society.
[1060] Advertising and Fundraising
[1061] Advertisements are displayed while the smartphone app is running or during breaks while watching videos. When an ad is clicked, revenue data is sent to a server and managed. This advertising revenue is used to fund the system's operations.
[1062] Specific examples
[1063] For example, a user downloads the app for the first time, enters basic information, and takes a personality test. The user is determined to be "introverted," and the server recommends a teacher model "Teacher A" that matches the introverted personality. The user selects Teacher A and begins video learning. If the emotion engine determines that the user is tired during learning, it automatically displays a message suggesting a break.
[1064] Prompt Sentence Examples
[1065] The personality test determined that the user is an introvert. If the user is tired, generate an encouraging message.
[1066] In this way, the present invention provides a personalized learning environment that is tailored to the user's personality and emotional state, making it possible to encourage continuity in learning and enhance a sense of social contribution.
[1067] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1068] Step 1:
[1069] A user downloads the app on their smartphone and enters basic information (name, age, gender, email address, etc.). This information is sent from the device to the server, which then stores it in a database. Input: Basic user information. Output: User information stored in the database.
[1070] Step 2:
[1071] The server sends the user the URL of the personality test page. When the user clicks on the URL to take the personality test, the results are sent to the server. The server analyzes the received personality test results and saves them in a database. Input: User's basic information and personality test results. Output: Personality test results saved in the database.
[1072] Step 3:
[1073] The server recommends the most suitable tutor model based on the results of the personality test. A list of recommended tutor models is generated and displayed to the user. Input: Personality test results and tutor model data. Output: A list of recommended tutor models to be displayed to the user.
[1074] Step 4:
[1075] The user selects from the recommended instructor models and the selection information is sent to the server. The server activates the selected instructor model and prepares for the start of the lesson. Input: User's instructor model selection. Output: The instructor model that has been activated.
[1076] Step 5:
[1077] The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log. Input: User interaction data. Output: Interaction data processed in real time and its log.
[1078] Step 6:
[1079] During the lesson, the AI instructor presents the lesson content to the user and gives questions and assignments. The user responds and makes comments accordingly. The server monitors the dialogue data in real time and saves all interactions as logs. Input: User's responses and comments. Output: Interaction data saved as a log.
[1080] Step 7:
[1081] The server generates a progress report for the user and sends it to the terminal after the lesson ends. The terminal displays this report to the user. Input: Interaction data and lesson progress information. Output: Progress report.
[1082] Step 8:
[1083] The emotion engine recognizes the user's emotional state in real time and provides feedback according to that state. If the user feels tired, it sends a message to the device encouraging them to take a break. Input: User's facial expression data. Output: Message encouraging them to take a break.
[1084] Step 9:
[1085] The server records each user's study time in a database and manages the accumulated study time. When a certain amount of study time has been accumulated, that time is offered to other users free of charge. Input: User's study time data. Output: Study time offered free of charge.
[1086] Step 10:
[1087] The server places advertisements in appropriate locations on the platform and sends that information to the terminal. When an advertisement is displayed and clicked on while the user is in class or browsing a page, that information is sent to the server. The server reports ad click data to advertisers and manages advertising revenue. Input: Ad click data. Output: Revenue management data.
[1088] As a result, the present invention can provide a personalized learning experience that is optimized for each user, and can also build a system that simultaneously improves motivation to learn and contributes to society.
[1089] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1090] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1091] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1092] [Third embodiment]
[1093] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1094] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[1095] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1096] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1097] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1098] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1099] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1100] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1101] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1102] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1103] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1104] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1105] This invention is a system that allows users to freely study languages for as long as they like, and provides lessons using approximately 100 AI instructor models tailored to their personalities and regions. The system is composed of a server, a terminal, and a user component.
[1106] User registration and personality test
[1107] The user accesses the system and enters their basic information (name, age, gender, email address, etc.) into the registration form. The device sends this information to the server. The server stores the received user information in a database and sends the user a URL for a personality assessment page. Once the user completes the personality assessment, the results are sent to the server for analysis. Based on the results of the personality assessment, the server returns a recommended list of compatible tutor models.
[1108] Select an AI teacher and start lessons
[1109] The user browses the recommendation list sent from the server and selects the AI instructor that best suits them. The selection information is sent from the device to the server. The server activates the selected instructor model and prepares to start the lesson. The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log.
[1110] Lesson progress and log storage
[1111] During the lesson, the AI instructor presents questions and tasks to the user, who then responds and makes comments. The server monitors the dialogue data in real time and stores all interactions as logs. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[1112] Sharing study time
[1113] The server records each user's study time in a database and manages the accumulated study time. When a certain amount of study time has been accumulated, the server will offer that time to other less fortunate users free of charge. For example, if two hours of study time has been accumulated, another user will be offered one hour of study time. This system encourages users to study while being conscious of contributing to society.
[1114] Advertising Revenue and Funding
[1115] The server places advertisements in appropriate locations on the platform and sends that information to the device. When an advertisement is displayed and clicked on while a user is in class or browsing a page, that information is sent to the server. The server reports ad click data to advertisers and manages advertising revenue. The server also collects donations and recruitment agency fees from companies, which are used as operating funds to ensure the sustainable operation of the system.
[1116] Specific examples
[1117] For example, a user accesses the system, enters basic information, and takes a personality test. The user is determined to be "introverted," and the server recommends a teacher model "Teacher A" that matches the introverted personality. The user selects Teacher A and begins the lesson. The lesson proceeds via video call, with the user answering questions and engaging in dialogue. The server records this in a log, and after the lesson is over, generates a progress report and provides it to the user.
[1118] Furthermore, when a user's cumulative study time reaches four hours, two of those hours are donated free of charge to other less fortunate users. Corporate advertisements are displayed on the lesson screen, and when users click on them with interest, the advertising revenue is managed as funds for maintaining the system. In this way, the present invention provides a high-quality language learning environment for all users, while eliminating educational disparities and contributing to society.
[1119] The processing flow will be explained below.
[1120] User registration and personality test
[1121] Step 1:
[1122] The user accesses the system's registration page and enters basic information (name, age, gender, email address, etc.).
[1123] Step 2:
[1124] The device sends the user's basic information to the server.
[1125] Step 3:
[1126] The server stores the user's basic information in a database, generates a URL for the personality test page, and returns it to the device.
[1127] Step 4:
[1128] The user visits the personality test page and answers the questions displayed.
[1129] Step 5:
[1130] The device sends the user's personality test answers to the server.
[1131] Step 6:
[1132] The server analyzes the personality test answers in real time and determines the user's personality.
[1133] Step 7:
[1134] Based on the results of the assessment, the server sends the most suitable AI instructor model to the terminal as a recommendation list.
[1135] Select an AI teacher and start lessons
[1136] Step 8:
[1137] Users can select the tutor that best suits them from the recommended AI tutor models.
[1138] Step 9:
[1139] The terminal transmits the user's selection information to the server.
[1140] Step 10:
[1141] The server activates the selected AI instructor model and prepares for the start of the lesson.
[1142] Step 11:
[1143] The device will notify the user that the lesson has started and launch the learning screen.
[1144] Step 12:
[1145] The user begins a dialogue with the AI instructor on the learning screen.
[1146] Lesson progress and log storage
[1147] Step 13:
[1148] The AI instructor presents the lesson content to the user and gives questions and assignments.
[1149] Step 14:
[1150] Users respond and comment accordingly.
[1151] Step 15:
[1152] The server records the dialogue data between the user and the AI instructor in real time and stores the dialogue logs in a database.
[1153] Step 16:
[1154] After the lesson ends, the server generates a progress report for the user and sends it to the device.
[1155] Step 17:
[1156] The device displays a progress report to the user.
[1157] Sharing study time
[1158] Step 18:
[1159] The server records the user's study time in a database and manages the cumulative study time.
[1160] Step 19:
[1161] When the accumulated learning time reaches a certain value, the server provides that time to other less fortunate users free of charge.
[1162] Step 20:
[1163] Free users will receive a notification and access the class page.
[1164] Advertising Revenue and Funding
[1165] Step 21:
[1166] The server places the advertisement in the appropriate location on the platform and sends the information to the device.
[1167] Step 22:
[1168] The device displays advertisements on the user's learning screen.
[1169] Step 23:
[1170] When a user clicks on an advertisement, the click information is sent to the server.
[1171] Step 24:
[1172] The server reports click data to advertisers and manages advertising revenue.
[1173] Step 25:
[1174] The server collects donations and recruitment agency fees from companies and uses these funds to fund the system's operations.
[1175] Through these specific processing steps, users can receive high-quality language learning for free and also contribute to society.
[1176] Example 1
[1177] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1178] Conventional language learning systems have not provided sufficient means for selecting the optimal teacher model for each individual user, resulting in inefficient learning. Furthermore, there is no mechanism for properly managing learning progress or providing learning time to other users. Furthermore, there are insufficient methods for effectively displaying advertisements and managing revenue. Therefore, there is a need for a system that allows users to contribute to society while efficiently learning a language.
[1179] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1180] In this invention, the server includes a means for a user to input their basic information and conduct a personality assessment, a means for recommending an optimal teacher model based on the results of the personality assessment, and a means for the user to select a teacher model and start a lesson. This allows the optimal teacher model to be selected for each individual user, enabling efficient learning. The server also includes a means for recording interactions with the user during lessons and managing progress, a means for accumulating the user's study time and providing that time to other users, and a means for displaying advertisements and managing advertising revenue. This makes it possible to appropriately manage the user's study progress, provide free study time to underprivileged users, and effectively manage advertising revenue.
[1181] "Basic information" refers to personal data entered by the user, such as name, age, gender, and email address.
[1182] A "personality test" is a test or questionnaire that assesses a user's personality and categorizes them into specific patterns.
[1183] A "teacher model" is an artificial intelligence character model designed to provide lessons to users.
[1184] The "lesson start means" is a function that allows the user to activate the teacher model selected and start learning.
[1185] The "interaction recording means" is a function that records all interactions between the user and the teacher model during a lesson.
[1186] "Progress management means" is a function that monitors the user's learning progress and provides appropriate feedback and reports.
[1187] "Accumulated study time" refers to calculating the total time a user spends studying on the system.
[1188] "Means for providing study time" is a system in which a portion of accumulated study time is provided free of charge to other less fortunate users.
[1189] "Advertisement display means" is a function that displays advertisement content while the user is using the system.
[1190] "Advertising revenue management means" is a function for collecting and managing revenue earned from displayed advertisements.
[1191] This invention is a system that allows users to freely study languages for as long as they like, and provides lessons using AI instructor models tailored to their personalities and regions. The system is composed of components: a server, a terminal, and a user.
[1192] User registration and personality test
[1193] A user accesses the system and uses a terminal to enter basic information such as name, age, gender, and email address into a registration form. The terminal then sends this information to the server. The server stores the received user information in a database and sends the user a URL for a personality assessment page. Once the user completes the personality assessment, the results are sent to the server for analysis. The personality assessment involves the user answering questions to assess their personality and classify it into specific patterns. Based on these results, the server returns a list of recommended teacher models that are compatible with the user.
[1194] For example, when a user first accesses the system, they enter the required information into a web form in their browser. The server then emails the user a URL for a personality test. The user is then prompted, for example, to "take the personality test," and the user completes the test.
[1195] Select an AI teacher and start lessons
[1196] The user browses the recommendation list sent from the server and selects the AI instructor that best suits them. The selection information is sent from the device to the server. The server activates the selected teacher model and prepares to start the lesson. The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log.
[1197] For example, when a user selects "Teacher A" from the recommended list and starts a lesson, the lesson screen will launch and a conversation with the AI instructor will begin in a video call format. For example, a prompt will appear asking, "Do you want to start today's lesson?" and the user will select "Start."
[1198] Lesson progress and log storage
[1199] During the lesson, the AI instructor presents questions and tasks to the user, who then responds and makes comments. The server monitors the dialogue data in real time and stores all interactions as logs. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[1200] As a concrete example, during a lesson, an AI instructor will ask questions such as, "Please explain yesterday's weather in English." The user's answers are sent to the server in real time and recorded in a log. After the lesson ends, a "progress report of today's lesson" is displayed to the user.
[1201] Sharing study time
[1202] The server records each user's study time in a database and manages the accumulated study time. When a certain amount of study time has been accumulated, the server will offer that time to other less fortunate users free of charge. For example, if two hours of study time has been accumulated, another user will be offered one hour of study time. This system encourages users to study while being conscious of contributing to society.
[1203] Advertising Revenue and Funding
[1204] The server places advertisements in appropriate locations on the platform and sends that information to the device. When an advertisement is displayed and clicked on while a user is in class or browsing a page, that information is sent to the server. The server reports ad click data to advertisers and manages advertising revenue. The server also collects donations and recruitment agency fees from companies, which are used as operating funds to ensure the sustainable operation of the system.
[1205] For example, an advertising banner is displayed on the sidebar of a lesson screen, and when a user clicks on the ad, the click information is sent to the server. A prompt is displayed asking, "Are you interested in new language learning materials?" If the user selects "Yes," they are redirected to the advertiser's page.
[1206] In this way, the present invention provides a high-quality language learning environment to all users, while eliminating educational disparities and contributing to society.
[1207] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1208] Step 1:
[1209] The user enters basic information.
[1210] Input: Basic information such as name, age, gender, and email address.
[1211] What happens: A user accesses a web form in a browser and enters the required information.
[1212] Output: The device sends the entered information as an HTTP POST request.
[1213] Step 2:
[1214] The terminal sends the information to the server.
[1215] Input: Basic information entered by the user.
[1216] Specific operation: The device sends data asynchronously using JavaScript or Ajax.
[1217] Output: The server stores the received information in a database.
[1218] Step 3:
[1219] The server stores the information in a database.
[1220] Input: Basic user information data.
[1221] What happens: A server-side script (e.g., PHP or Node.js) executes an INSERT query against the database.
[1222] Output: Basic information stored in the database.
[1223] Step 4:
[1224] The server sends the URL of the personality test page.
[1225] Input: The user's email address.
[1226] Specific operation: The server uses the SMTP server to send an email containing a link to the personality test page.
[1227] Output: The user will receive a link to the personality test page in their mailbox.
[1228] Step 5:
[1229] The user completes a personality test.
[1230] Input: URL of the personality test page.
[1231] Specific behavior: The user visits a personality test page and answers a few questions.
[1232] Output: The results of the personality test are displayed and sent from the device to the server.
[1233] Step 6:
[1234] The terminal transmits the diagnosis results to the server.
[1235] Input: Personality test results.
[1236] Specific operation: The device sends an HTTP POST request containing the diagnostic results to the server.
[1237] Output: The server analyzes the diagnostic results it receives.
[1238] Step 7:
[1239] The server analyzes the diagnostic results and returns a list of recommendations.
[1240] Input: Personality test result data.
[1241] Specific operation: The server uses the generative AI model to analyze the diagnosis results and create a list of recommended teacher models that match the user's personality.
[1242] Output: The user is presented with a list of recommendations.
[1243] Step 8:
[1244] The user browses the recommendations list.
[1245] Input: A list of recommendations sent by the server.
[1246] Specific operation: The user checks the list in a web browser and selects the desired teacher model.
[1247] Output: Information on the selected teacher model is passed to the next process.
[1248] Step 9:
[1249] The terminal transmits the selection information to the server.
[1250] Input: Information about the teacher model selected by the user.
[1251] Specific operation: The terminal sends an HTTP POST request including the selection information to the server.
[1252] Output: The server receives the selection and continues processing.
[1253] Step 10:
[1254] The server activates the teacher model.
[1255] Input: Information about the teacher model selected by the user.
[1256] Specific operation: The server launches an instance of the selected teacher model and makes it active.
[1257] Output: Lesson is ready to begin.
[1258] Step 11:
[1259] The device will display a notification that class is about to begin.
[1260] Input: Notification from the server that the lesson is ready to begin.
[1261] Specific behavior: The device will display a pop-up notification in the browser and redirect you to the learning screen.
[1262] Output: The user is notified that the lesson has started.
[1263] Step 12:
[1264] The user starts a lesson.
[1265] Input: Lesson start screen.
[1266] How it works: The user begins a conversation with the AI instructor on the lesson screen, via text chat or voice interaction.
[1267] Output: Interaction data is sent to the server.
[1268] Step 13:
[1269] The server processes and stores the interaction data.
[1270] Input: User interaction data.
[1271] Specific operation: The server processes the interaction data in real time and stores the interaction log in the database.
[1272] Output: The interaction log is saved to a database.
[1273] Step 14:
[1274] The server generates a progress report.
[1275] Input: Interaction log data.
[1276] Specific operation: The server analyzes the interaction log and creates a progress report for the user.
[1277] Output: A progress report is generated.
[1278] Step 15:
[1279] The device will display a progress report.
[1280] Input: A progress report sent by the server.
[1281] Specific behavior: The device displays a progress report to the user.
[1282] Output: User sees status report.
[1283] Step 16:
[1284] The server records the study time in a database.
[1285] Input: User study time data.
[1286] Specific operation: The server measures the time that the user is logged in and updates the database.
[1287] Output: The cumulative learning time is recorded in a database.
[1288] Step 17:
[1289] The server manages the cumulative learning time and provides a certain amount of time free of charge.
[1290] Input: Accumulated study time data.
[1291] Specific operation: The server executes logic that provides free study time to other users when a certain amount of study time has been accumulated.
[1292] Output: The free learning time is recorded.
[1293] Step 18:
[1294] The server places the advertisement and sends it to the device.
[1295] Input: Ad data.
[1296] Specific operation: The server places the advertisement in the appropriate location on the platform and sends the advertisement data to the terminal.
[1297] Output: Advertising data is sent to the device.
[1298] Step 19:
[1299] The device displays advertisements.
[1300] Input: Advertisement data sent from the server.
[1301] What it does: The device displays advertising banners in the sidebar or at the top of web pages.
[1302] Output: The user is shown the ad.
[1303] Step 20:
[1304] A user clicks on an ad.
[1305] Input: The ad displayed.
[1306] Specific behavior: The event of a user clicking on an ad is tracked.
[1307] Output: Click information is sent to the server.
[1308] Step 21:
[1309] The server reports ad click data and manages revenue.
[1310] Input: Ad click data.
[1311] Specific operation: The server reports click data to advertisers and manages advertising revenue.
[1312] Output: Advertising revenue is managed.
[1313] Step 22:
[1314] The server collects donations and recruitment fees.
[1315] Input: Data on donations and job intermediation.
[1316] Specific operation: The server collects donations and recruitment agency fees from companies and manages them as operating funds.
[1317] Output: The funds collected are used to run the system sustainably.
[1318] (Application example 1)
[1319] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1320] Current online education systems and virtual stores make it difficult for users to receive optimal support and education tailored to their individual needs and personalities. Furthermore, systems for managing learning progress and contributing to society are insufficient, and the lack of multilingual support in virtual stores is becoming apparent. These challenges make it difficult to improve user satisfaction and eliminate educational disparities.
[1321] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1322] In this invention, the server includes: means for a user to input their own basic information and conduct a personality assessment; means for recommending an optimal instructor model based on the results of the personality assessment; means for the user to select an instructor model and start a lesson; means for recording dialogue with the user during the lesson and managing progress; means for accumulating the user's study time and providing that time to other users; means for displaying advertisements and managing advertising revenue; means for providing the user with multilingual guidance and support when searching for, purchasing, or inquiring about products in a virtual store; and means for selecting a recommended virtual guide and exploring the store with that guide. This allows the user to receive education and support optimized to their individual needs, thereby eliminating social educational disparities and achieving high user satisfaction.
[1323] "Basic user information" refers to information such as name, age, gender, and email address that a user enters when registering with the system.
[1324] "Personality diagnosis" is a diagnostic tool that analyzes the user's personality and recommends the most suitable instructor model based on the results.
[1325] The "instructor model" is a lesson delivery model that implements AI tailored to the instructor's personality and region, providing the most appropriate education to the user.
[1326] "Lesson starts" refers to the state in which the user activates the selected instructor model and the lesson actually begins.
[1327] "Dialogue recording" is the process of saving the interaction between the user and the AI instructor during the lesson as a log so that it can be referenced later.
[1328] "Progress management" is the process of tracking a user's learning progress and providing feedback based on that progress.
[1329] "Accumulating learning time" is the process of tallying and recording the time a user spends learning on the system.
[1330] "Providing to other users" means distributing a portion of the accumulated learning time to other less fortunate users free of charge.
[1331] "Displaying Advertisements" means the process of placing Advertisements on the Platform and making them visible to Users.
[1332] "Advertising revenue management" is the process of aggregating click data from displayed ads and managing the resulting revenue as operating funds.
[1333] "Exploring the virtual store" means that a user browses, selects, purchases, and inquires about products within a virtual shopping environment.
[1334] "Multilingual guidance and support" means that the AI guide provides guidance and support in different languages depending on the user's language settings.
[1335] "Selecting a virtual guide" is the process of selecting the most suitable virtual guide based on the results of a personality test and the user's preferences, and then exploring the store together.
[1336] MODE FOR CARRYING OUT THE INVENTION
[1337] The present invention is a system that allows users to freely learn languages and receive multilingual guidance in virtual stores. The system is composed of components: a server, a terminal, and a user. The system is implemented as follows:
[1338] User registration and personality test
[1339] The user accesses the system from their device and enters basic information such as name, age, gender, and email address into the registration form. The device sends this information to the server. The server stores the received user information in a database and sends the user a URL for the personality assessment page. Once the user completes the personality assessment, the results are sent to the server, which analyzes them. Based on the results of the personality assessment, the server returns a list of recommended tutor models who are compatible with the user to the user.
[1340] Select an AI teacher and start lessons
[1341] The user browses the recommendation list sent from the server and selects the AI instructor that best suits them. This selection information is sent from the device to the server. The server activates the selected instructor model and prepares to start the lesson. The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log.
[1342] Lesson progress and log storage
[1343] During the lesson, the AI instructor presents questions and tasks to the user, who then responds and makes comments. The server monitors the dialogue data in real time and saves all interactions as a log. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[1344] Sharing study time
[1345] The server records each user's study time in a database and manages the cumulative study time. When a user achieves a certain amount of study time, a portion of that time is donated free of charge to other less fortunate users. For example, if a user accumulates two hours of study time, they can donate one hour of study time to another user. This system allows users to study while being conscious of contributing to society.
[1346] Advertising Revenue and Funding
[1347] The server places advertisements in appropriate locations on the platform and sends that information to the device. When a user clicks on an advertisement displayed during class or while browsing a page, that information is sent to the server. The server collects ad click data, reports it to advertisers, and manages advertising revenue. It also collects donations and recruitment agency fees from companies, which it uses as operating funds to ensure the sustainable operation of the system.
[1348] Multilingual guidance in the virtual store
[1349] When a user accesses a virtual store, they select the AI guide that best suits them based on their basic information and personality assessment. The selected information is sent from the device to the server. The server then activates the selected virtual guide and guides the user in multiple languages through product exploration, purchases, and inquiries within the virtual store. Interaction data is saved as a log on the server in real time, allowing the server to provide support tailored to the user's progress and interests.
[1350] Hardware and software used
[1351] Server (Amazon Web Services (AWS), Google Cloud Platform (GCP), etc.)
[1352] Client terminal (smartphone: iOS / Android, PC)
[1353] Database (MySQL, PostgreSQL)
[1354] AI teacher model (GPT-3, Google BERT)
[1355] Development language (Python, JavaScript, Swift, Kotlin)
[1356] Specific Examples
[1357] Users visit the virtual store
[1358] When a user visits a virtual store and is guided through the products, the following prompt is used:
[1359] "Hello. What product would you like to know about today? Tell me what you're looking for."
[1360] Interact with a virtual AI guide
[1361] When a user asks about a specific product, the following exchange might occur:
[1362] User: "Tell me about this TV."
[1363] AI Guide: "This TV is equipped with the latest 4K technology, delivering exceptional picture quality. It also has a wealth of smart features. Want to know more?"
[1364] In this way, the AI guide can provide personalized information in response to user questions.
[1365] As described above, the present invention provides optimal education and virtual store support tailored to the needs of each individual user, thereby improving user satisfaction and eliminating social educational disparities.
[1366] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1367] Step 1:
[1368] User registration and basic information entry
[1369] A user accesses the system from a terminal and enters basic information such as name, age, gender, and email address into the registration form. The terminal sends the entered basic information to the server. The server stores the received user information in a database and sends the terminal the URL of the personality test page to proceed to the next step. The input is the user's basic information, and the output is the URL of the personality test page.
[1370] Step 2:
[1371] Personality test
[1372] The user accesses the personality test page and answers the questions. The answers are sent from the device to the server. The server analyzes the received personality test results and uses a prepared generative AI model to select the most suitable tutor model for the user. The analysis results are returned to the user as a list of recommendations. The input is the personality test answer results, and the output is a list of recommended tutor models.
[1373] Step 3:
[1374] Select an AI teacher and start lessons
[1375] The user browses the recommended list and selects a suitable instructor model. This selection information is sent from the terminal to the server. The server activates the selected instructor model and prepares for the start of the lesson. The terminal displays a notification that the lesson has started to the user and launches the learning screen. The input is the instructor model selection information, and the output is a notification that the lesson has started and the learning screen.
[1376] Step 4:
[1377] Recording of lesson progress and dialogue
[1378] During the lesson, the AI instructor presents the user with questions and tasks. The user answers them and engages in a dialogue. The server processes this dialogue data in real time and saves all interactions as a log. The input is the user's answers and dialogue data, and the output is the dialogue log.
[1379] Step 5:
[1380] Generate progress reports
[1381] After the lesson ends, the server analyzes the dialogue log and generates a progress report for the user. The generated report is sent to the terminal and displayed to the user. The input is the log data, and the output is the progress report.
[1382] Step 6:
[1383] Managing and sharing study time
[1384] The server records the user's study time in a database and manages the accumulated study time. When a certain amount of study time is achieved, a portion of that time is offered free of charge to other less fortunate users. The input is the accumulated study time data, and the output is a notification of the free offer.
[1385] Step 7:
[1386] Ad display and revenue management
[1387] The server places ads in the appropriate locations on the platform and sends the information to the device. When a user clicks on an ad, the click data is sent to the server. The server collects this data and reports it to advertisers to manage revenue. The input is ad click data, and the output is revenue management data.
[1388] Step 8:
[1389] Multilingual guidance in the virtual store
[1390] Users access a virtual store and select the most suitable AI guide based on their basic information and personality assessment. The selection information is sent from the device to the server. The server activates the selected virtual guide and guides the user in multiple languages to explore products in the virtual store, make purchases, and make inquiries. Interaction data is saved as a log on the server in real time, providing support based on the user's progress and interests. The input is the AI guide's selection information, and the output is multilingual guidance and log data.
[1391] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1392] This invention is a system that allows users to freely study languages for as long as they like, and provides lessons using an AI instructor model and emotion engine tailored to the personalities and regions of approximately 100 people. The system is composed of server, terminal, and user components.
[1393] User registration and personality test
[1394] The user accesses the system and enters their basic information (name, age, gender, email address, etc.) into the registration form. The device sends this information to the server. The server stores the received user information in a database and sends the user a URL for a personality assessment page. Once the user completes the personality assessment, the results are sent to the server for analysis. Based on the results of the personality assessment, the server returns a recommended list of compatible tutor models.
[1395] Select an AI teacher and start lessons
[1396] The user browses the recommendation list sent from the server and selects the AI instructor that best suits them. The selection information is sent from the device to the server. The server activates the selected instructor model and prepares for the start of the lesson. The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log.
[1397] Lesson progress and log storage
[1398] During the lesson, the AI instructor presents the lesson content to the user and poses questions and assignments. The user responds and makes comments accordingly. The server monitors the dialogue data in real time and saves all interactions as a log. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[1399] Incorporating an emotion engine
[1400] The emotion engine recognizes the user's emotional state in real time and provides feedback according to that state. For example, if a user is feeling frustrated during a lesson, the emotion engine will detect this information and the server will generate an encouraging message and send it to the device. This will help the user maintain their motivation to learn.
[1401] Furthermore, the emotion engine has the function of determining the user's stress level. If the stress level is determined to be high, the server will suggest an appropriate time to take a break and send a message to the device urging it to take a break.
[1402] Sharing study time
[1403] The server records each user's study time in a database and manages the accumulated study time. When a certain amount of study time has been accumulated, the server will offer that time to other less fortunate users free of charge. For example, if two hours of study time has been accumulated, another user will be offered one hour of study time. This system encourages users to study while being conscious of contributing to society.
[1404] Advertising Revenue and Funding
[1405] The server places advertisements in appropriate locations on the platform and sends that information to the device. When an advertisement is displayed and clicked on while a user is in class or browsing a page, that information is sent to the server. The server reports ad click data to advertisers and manages advertising revenue. The server also collects donations and recruitment agency fees from companies, which are used as operating funds to ensure the sustainable operation of the system.
[1406] Specific examples
[1407] For example, a user accesses the system, enters basic information, and takes a personality test. The user is determined to be "introverted," and the server recommends a teacher model "Teacher A" that matches the introverted personality. The user selects Teacher A and begins the lesson. The lesson proceeds via video call, with the user answering questions and engaging in dialogue. The server records this in a log, and after the lesson is over, generates a progress report and provides it to the user.
[1408] Furthermore, if the emotion engine determines that the user is tired during class, the server will send a message suggesting a break. At the same time, if the user's cumulative study time reaches four hours, two of those hours will be donated free of charge to other less fortunate users. Corporate advertisements are displayed on the class screen, and if a user clicks on them with interest, the advertising revenue is managed as funds to maintain the system.
[1409] In this way, the present invention provides a high-quality language learning environment to all users, while eliminating educational disparities and contributing to society.
[1410] The processing flow will be explained below.
[1411] User registration and personality test
[1412] Step 1:
[1413] The user accesses the system's registration page and enters basic information (name, age, gender, email address, etc.).
[1414] Step 2:
[1415] The device sends the user's basic information to the server.
[1416] Step 3:
[1417] The server stores the user's basic information in a database, generates a URL for the personality test page, and returns it to the device.
[1418] Step 4:
[1419] The user visits the personality test page and answers the questions displayed.
[1420] Step 5:
[1421] The device sends the user's personality test answers to the server.
[1422] Step 6:
[1423] The server analyzes the personality test answers in real time and determines the user's personality.
[1424] Step 7:
[1425] Based on the results of the assessment, the server sends the most suitable AI instructor model to the terminal as a recommendation list.
[1426] Select an AI teacher and start lessons
[1427] Step 8:
[1428] Users can select the tutor that best suits them from the recommended AI tutor models.
[1429] Step 9:
[1430] The terminal transmits the user's selection information to the server.
[1431] Step 10:
[1432] The server activates the selected AI instructor model and prepares for the start of the lesson.
[1433] Step 11:
[1434] The device will notify the user that the lesson has started and launch the learning screen.
[1435] Step 12:
[1436] The user begins a dialogue with the AI instructor on the learning screen.
[1437] Lesson progress and log storage
[1438] Step 13:
[1439] The AI instructor presents the lesson content to the user and gives questions and assignments.
[1440] Step 14:
[1441] Users respond and comment accordingly.
[1442] Step 15:
[1443] The server records the dialogue data between the user and the AI instructor in real time and stores the dialogue logs in a database.
[1444] Step 16:
[1445] The server uses an emotion engine to analyze the user's emotional state from the dialogue data and decides on an appropriate response.
[1446] Step 17:
[1447] If the user's emotions indicate fatigue or stress, the emotion engine detects this and notifies the server.
[1448] Step 18:
[1449] The server generates messages encouraging the user or encouraging them to take a break and sends them to the device.
[1450] Step 19:
[1451] The terminal displays the generated message to the user.
[1452] Step 20:
[1453] After the lesson ends, the server generates a progress report for the user and sends it to the device.
[1454] Step 21:
[1455] The device displays a progress report to the user.
[1456] Sharing study time
[1457] Step 22:
[1458] The server records the user's study time in a database and manages the cumulative study time.
[1459] Step 23:
[1460] When the accumulated learning time reaches a certain value, the server provides that time to other less fortunate users free of charge.
[1461] Step 24:
[1462] Free users will receive a notification and access the class page.
[1463] Advertising Revenue and Funding
[1464] Step 25:
[1465] The server places the advertisement in the appropriate location on the platform and sends the information to the device.
[1466] Step 26:
[1467] The device displays advertisements on the user's learning screen.
[1468] Step 27:
[1469] When a user clicks on an advertisement, the click information is sent to the server.
[1470] Step 28:
[1471] The server reports click data to advertisers and manages advertising revenue.
[1472] Step 29:
[1473] The server collects donations and recruitment agency fees from companies and uses these funds to fund the system's operations.
[1474] Through these specific processing steps, users can receive high-quality language learning for free and also contribute to society.
[1475] Example 2
[1476] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1477] Conventional language learning systems have struggled to provide optimal learning tailored to each user's individual personality and regional background, and have often relied on uniform content and pace. It has also been difficult to grasp a user's emotional state in real time during learning and provide effective feedback based on that. Furthermore, maintaining user motivation and fostering a sense of social contribution during long learning periods have also been challenges.
[1478] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1479] In this invention, the server includes means for a user to input their own basic information and conduct a personality diagnosis, means for recommending the most suitable instructor model based on the results of the personality diagnosis, means for the user to select an instructor model and start the lesson, means for recording the dialogue with the user during the lesson and managing the progress, means for recognizing the user's emotional state in real time and providing feedback according to that state, means for accumulating the user's study time and providing that time to other users, and means for displaying advertisements and managing advertising revenue. This provides an optimal learning environment for each user, realizes appropriate feedback according to emotions, and aims to improve awareness of social contribution through the accumulation of study time.
[1480] "Basic information" refers to information related to personal identification, such as name, age, gender, and email address, entered by the user.
[1481] "Personality diagnosis" is a process for evaluating a user's personality and characteristics and selecting a suitable instructor model based on that.
[1482] The "Instructor Model" is an AI-based educational content provider designed to assist users in their learning.
[1483] A "lesson" is an educational session conducted by an AI instructor model for a user, and includes dialogue and assignment presentation.
[1484] "Dialogue Data" refers to the voice, text, and other interaction data exchanged between a user and an AI instructor model during a lesson.
[1485] "Progress management" is the process of recording and analyzing a user's learning content and progress and providing appropriate feedback.
[1486] "Emotional state" refers to the user's psychological and emotional state, including stress, frustration, etc.
[1487] "Feedback" refers to responses such as encouragement or advice provided based on the user's learning progress or emotional state.
[1488] "Cumulative Study Time" refers to the total time a User spends studying using the System.
[1489] "Sharing" refers to a system in which a portion of accumulated study time is provided free of charge to other less fortunate users.
[1490] "Advertisement" refers to promotional information for companies, organizations, etc. that is displayed on the system.
[1491] "Advertising Revenue" refers to revenue earned from users viewing or clicking on advertisements displayed on the System.
[1492] This invention is a system that allows users to freely study languages for as long as they like, and provides lessons using an AI instructor model and emotion engine tailored to the personalities and regions of approximately 100 people. The system is composed of server, terminal, and user components.
[1493] User registration and personality test
[1494] Users access the system using their own devices and enter basic information such as name, age, gender, and email address into the registration form. The device sends this information to the server. The server stores the received user information in a database and sends the user a URL for the personality test page, allowing them to take the test.
[1495] Once the user has completed the personality test, the results are sent from the device to the server, which analyzes the results and generates a list of recommended tutor models based on the user's personality. This list is then presented to the user via the device.
[1496] Select an AI teacher and start lessons
[1497] The user browses a list of recommended instructors on their device and selects an AI instructor that best suits them. The selection information is sent from the device to the server. The server sets the selected instructor model to active status and prepares for the start of the lesson. When preparations are complete, the server sends a notification to the device, which displays that information to the user. The lesson then progresses when the user launches the learning screen and begins interacting with the AI instructor.
[1498] Lesson progress and log storage
[1499] During the lesson, the AI instructor presents the lesson content to the user and poses questions and assignments. The user responds and makes comments accordingly. All of these interactions are sent to the server in real time and saved as logs by the server. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[1500] Incorporating an emotion engine
[1501] The emotion engine recognizes the user's emotional state in real time and provides feedback according to that state. For example, if a user feels frustrated during class, the emotion engine detects this information and the server generates an encouraging message and sends it to the device. This helps the user maintain their motivation to study. The emotion engine also has the function of determining the user's stress level, and if a high stress level is detected, the server will send a message to the device suggesting an appropriate break.
[1502] Sharing study time
[1503] The server records each user's study time in a database and manages the cumulative study time. When the cumulative study time reaches a certain level, the server provides a portion of it to other users. This system is intended to promote a sense of social contribution.
[1504] Ad display and revenue management
[1505] The server places advertisements in appropriate locations on the platform and transmits the information to the device. When a user views or clicks on an advertisement, the information is sent to the server. The server manages advertising revenue based on this information, and also collects donations and recruitment agency fees from companies to fund the system's operations.
[1506] Examples of concrete examples and prompts
[1507] For example, a user accesses the system, enters basic information, and takes a personality test. The user is determined to be introverted, and the server recommends a teacher model named "Teacher A" who matches the introverted personality. The user selects Teacher A and begins the lesson. The lesson proceeds via video call, with the user answering questions and engaging in dialogue. The server records this in a log, and after the lesson is over, generates a progress report and provides it to the user.
[1508] Furthermore, if the emotion engine determines that the user is tired during class, the server will send a message suggesting a break. At the same time, if the user's cumulative study time reaches four hours, two of those hours will be donated free of charge to other less fortunate users. Corporate advertisements are displayed on the class screen, and if a user clicks on them with interest, the advertising revenue is managed as funds to maintain the system.
[1509] Example prompt: "Write a scene in which a user accesses the system, enters basic information, and takes a personality test. Include a scene in which the user is determined to be an introvert and selects an AI tutor who matches their introverted personality to begin the lesson. Also, include a scene in which the emotion engine provides appropriate feedback if the user feels fatigued during the lesson."
[1510] In this way, the present invention provides a high-quality language learning environment to all users, while eliminating educational disparities and contributing to society.
[1511] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1512] Step 1: User Registration
[1513] Input: The user enters their basic information (name, age, gender, email address, etc.) into the registration form.
[1514] Action: The device sends this information to the server.
[1515] Data processing / calculation: The server stores the received information in a database.
[1516] Output: The server sends the user the URL of the personality test page.
[1517] Step 2: Take a personality test
[1518] Input: A user visits the personality assessment page and completes the test.
[1519] Operation: The device sends the results of the personality test to the server.
[1520] Data processing / calculation: The server analyzes the diagnostic results and identifies the user's personality traits.
[1521] Output: The server generates the best tutor model as a recommendation list and sends it to the device.
[1522] Step 3: Select an AI teacher
[1523] Input: User browses the recommendation list on their device and selects the best teacher model.
[1524] Operation: The device sends the selection information to the server.
[1525] Data processing / calculation: The server sets the selected instructor model to the active state and prepares for the start of the lesson.
[1526] Output: The server sends a notification to the terminal that the lesson is ready to start.
[1527] Step 4: Start classes
[1528] Input: The terminal that receives the notification from the server notifies the user that the lesson has started.
[1529] How it works: The user launches the lesson screen and begins a dialogue with the AI instructor.
[1530] Data processing / calculation: The server records the interaction data between the user and the AI teacher model in real time.
[1531] Output: Initial interaction log stored in the database.
[1532] Step 5: Classroom Management
[1533] Input: During class, users respond to instructions and questions from the instructor.
[1534] How it works: The device sends the user's answers and comments to the server.
[1535] Data processing / calculation: The server analyzes interaction data in real time and stores it as a log.
[1536] Output: Progress report data for the lesson content is generated.
[1537] Step 6: Feedback from the Emotion Engine
[1538] Input: The user's facial and voice data is captured in real time.
[1539] Operation: The device sends this data to the server.
[1540] Data processing / calculation: The emotion engine on the server analyzes the data and determines the user's emotional state.
[1541] Output: Generates appropriate feedback messages for the user and sends them to the device.
[1542] Step 7: Share your study time
[1543] Input: User learning time data accumulated on the server.
[1544] How it works: The server periodically checks the accumulated time to see if it has reached a certain threshold.
[1545] Data processing / calculation: When the standard is reached, the excess time is allocated to other users.
[1546] Output: Sends notification of time donation to relevant users.
[1547] Step 8: Display ads and manage revenue
[1548] Input: Advertising data and user activity data while learning and browsing.
[1549] How it works: The server places the ad in the appropriate location and sends the information to the device.
[1550] Data processing / calculation: When an advertisement is clicked, the data is collected and analyzed.
[1551] Output: Reporting ad revenue data to advertisers and managing revenue.
[1552] Through this series of steps, the system provides users with an effective language learning environment, maintaining their motivation to learn while also contributing to society.
[1553] (Application example 2)
[1554] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1555] Conventional language learning systems lack personalization based on the user's personality and learning situation, and lack real-time feedback and emotional state management to maintain motivation to learn. Furthermore, it is difficult for users to share their accumulated learning time with other users, and there is a lack of a mechanism to continue learning while maintaining a sense of social contribution.
[1556] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a user to input their basic information and conduct a personality assessment, a means for recommending an optimal instructor model based on the results of the personality assessment, a means for the user to select an instructor model and start a lesson, a means for recording dialogue with the user during the lesson and managing progress, a means for accumulating the user's study time and providing that time to other users, a means for displaying advertisements and managing advertising revenue, a means for recognizing the user's emotional state in real time and providing feedback, a means for generating a list of recommended video content, and a means for monitoring facial expressions and analyzing the user's emotional state. This provides a personalized learning environment tailored to the user's personality and emotional state, making it possible to continue learning and increase a sense of social contribution.
[1557] "Basic information" refers to personal information such as the user's name, age, gender, and email address.
[1558] A "personality assessment" is a method for analyzing a user's personality and providing an optimal learning experience based on the results.
[1559] The "instructor model" is a virtual instructor created using AI technology, and is a program that provides lessons to users.
[1560] "Starting a lesson" is the process by which a user begins language learning interactively with a selected instructor model.
[1561] "Recording a dialogue" is the process of saving the communication that takes place between the user and the instructor model.
[1562] "Manage Progress" is a way to track and record a user's learning progress and achievements.
[1563] "Accumulating study time" is the process of recording the total amount of study time a user has performed and managing that total.
[1564] The "means of provision" refers to a mechanism that allows users to share their accumulated study time with other users.
[1565] "Advertising Revenue Management" is a means of tracking revenue generated from displayed ads and managing that revenue as operating funds.
[1566] "Real-time emotional state recognition" is the process of analyzing a user's facial expressions and tone of voice to determine their emotions at any given time.
[1567] "Providing feedback" means providing encouragement and advice in real time based on the user's learning progress and emotional state.
[1568] "Generating a video content recommendation list" is the process of creating a list to recommend the most suitable learning videos based on the user's personality assessment and learning history.
[1569] "Monitoring facial expressions to analyze emotional state" refers to the process of using a camera to capture a user's facial expressions and then identifying their emotional state through an emotion identification algorithm.
[1570] The present invention is a system that allows users to freely study a language for as long as they like, and includes a means for providing video learning content optimized for each user. This invention is implemented using the following hardware and software.
[1571] Hardware
[1572] Smartphone: Uses a smartphone with a camera to capture the user's facial expressions.
[1573] Server: A server for database management and real-time processing.
[1574] software
[1575] Python: Used to implement various processing logic.
[1576] TensorFlow: Running machine learning models for sentiment analysis.
[1577] OpenCV: An image processing library for capturing and analyzing the user's facial expressions.
[1578] Firebase: Used for storing user information, real-time processing, and database management.
[1579] Operation explanation
[1580] User registration and personality test
[1581] Users download the smartphone app and enter basic information (such as name, age, gender, and email address). The information is sent from the smartphone to a server, which stores it in a database. When users log in for the first time, they take a personality test, and the server recommends the most suitable instructor model based on the results.
[1582] Content recommendations and viewing
[1583] The server generates a recommendation list containing the most suitable video content for the user based on the results of the personality test. The user then uses their smartphone to select a video from this recommendation list and begin watching.
[1584] Video viewing management and progress reporting
[1585] While watching the video, the user's dialogue and reactions are recorded in real time and sent to the server. The recorded dialogue and reactions are analyzed on the server side, and a report based on the user's learning progress is generated. When the video viewing ends, this report is displayed on the smartphone device.
[1586] Implementing the Emotion Engine
[1587] While watching, the user's facial expressions are monitored through the smartphone camera. The emotion engine analyzes this facial data to determine whether the user is tired or stressed. The emotion engine analyzes the user's emotional state in real time, notifying them of the need to take a break and displaying encouraging messages as needed.
[1588] Sharing study time
[1589] When a user's cumulative viewing time reaches a certain amount, that information is sent to a server and offered as free study time for other users. This system allows study time to be used to contribute to society.
[1590] Advertising and Fundraising
[1591] Advertisements are displayed while the smartphone app is running or during breaks while watching videos. When an ad is clicked, revenue data is sent to a server and managed. This advertising revenue is used to fund the system's operations.
[1592] Specific examples
[1593] For example, a user downloads the app for the first time, enters basic information, and takes a personality test. The user is determined to be "introverted," and the server recommends a teacher model "Teacher A" that matches the introverted personality. The user selects Teacher A and begins video learning. If the emotion engine determines that the user is tired during learning, it automatically displays a message suggesting a break.
[1594] Prompt Sentence Examples
[1595] The personality test determined that the user is an introvert. If the user is tired, generate an encouraging message.
[1596] In this way, the present invention provides a personalized learning environment that is tailored to the user's personality and emotional state, making it possible to encourage continuity in learning and enhance a sense of social contribution.
[1597] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1598] Step 1:
[1599] A user downloads the app on their smartphone and enters basic information (name, age, gender, email address, etc.). This information is sent from the device to the server, which then stores it in a database. Input: Basic user information. Output: User information stored in the database.
[1600] Step 2:
[1601] The server sends the user the URL of the personality test page. When the user clicks on the URL to take the personality test, the results are sent to the server. The server analyzes the received personality test results and saves them in a database. Input: User's basic information and personality test results. Output: Personality test results saved in the database.
[1602] Step 3:
[1603] The server recommends the most suitable tutor model based on the results of the personality test. A list of recommended tutor models is generated and displayed to the user. Input: Personality test results and tutor model data. Output: A list of recommended tutor models to be displayed to the user.
[1604] Step 4:
[1605] The user selects from the recommended instructor models and the selection information is sent to the server. The server activates the selected instructor model and prepares for the start of the lesson. Input: User's instructor model selection. Output: The instructor model that has been activated.
[1606] Step 5:
[1607] The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log. Input: User interaction data. Output: Interaction data processed in real time and its log.
[1608] Step 6:
[1609] During the lesson, the AI instructor presents the lesson content to the user and gives questions and assignments. The user responds and makes comments accordingly. The server monitors the dialogue data in real time and saves all interactions as logs. Input: User's responses and comments. Output: Interaction data saved as a log.
[1610] Step 7:
[1611] The server generates a progress report for the user and sends it to the terminal after the lesson ends. The terminal displays this report to the user. Input: Interaction data and lesson progress information. Output: Progress report.
[1612] Step 8:
[1613] The emotion engine recognizes the user's emotional state in real time and provides feedback according to that state. If the user feels tired, it sends a message to the device encouraging them to take a break. Input: User's facial expression data. Output: Message encouraging them to take a break.
[1614] Step 9:
[1615] The server records each user's study time in a database and manages the accumulated study time. When a certain amount of study time has been accumulated, that time is offered to other users free of charge. Input: User's study time data. Output: Study time offered free of charge.
[1616] Step 10:
[1617] The server places advertisements in appropriate locations on the platform and sends that information to the terminal. When an advertisement is displayed and clicked on while the user is in class or browsing a page, that information is sent to the server. The server reports ad click data to advertisers and manages advertising revenue. Input: Ad click data. Output: Revenue management data.
[1618] As a result, the present invention can provide a personalized learning experience that is optimized for each user, and can also build a system that simultaneously improves motivation to learn and contributes to society.
[1619] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1620] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1621] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1622] [Fourth embodiment]
[1623] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1624] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1625] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1626] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1627] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1628] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1629] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1630] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1631] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1632] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1633] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1634] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1635] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1636] This invention is a system that allows users to freely study languages for as long as they like, and provides lessons using approximately 100 AI instructor models tailored to their personalities and regions. The system is composed of a server, a terminal, and a user component.
[1637] User registration and personality test
[1638] The user accesses the system and enters their basic information (name, age, gender, email address, etc.) into the registration form. The device sends this information to the server. The server stores the received user information in a database and sends the user a URL for a personality assessment page. Once the user completes the personality assessment, the results are sent to the server for analysis. Based on the results of the personality assessment, the server returns a recommended list of compatible tutor models.
[1639] Select an AI teacher and start lessons
[1640] The user browses the recommendation list sent from the server and selects the AI instructor that best suits them. The selection information is sent from the device to the server. The server activates the selected instructor model and prepares to start the lesson. The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log.
[1641] Lesson progress and log storage
[1642] During the lesson, the AI instructor presents questions and tasks to the user, who then responds and makes comments. The server monitors the dialogue data in real time and stores all interactions as logs. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[1643] Sharing study time
[1644] The server records each user's study time in a database and manages the accumulated study time. When a certain amount of study time has been accumulated, the server will offer that time to other less fortunate users free of charge. For example, if two hours of study time has been accumulated, another user will be offered one hour of study time. This system encourages users to study while being conscious of contributing to society.
[1645] Advertising Revenue and Funding
[1646] The server places advertisements in appropriate locations on the platform and sends that information to the device. When an advertisement is displayed and clicked on while a user is in class or browsing a page, that information is sent to the server. The server reports ad click data to advertisers and manages advertising revenue. The server also collects donations and recruitment agency fees from companies, which are used as operating funds to ensure the sustainable operation of the system.
[1647] Specific examples
[1648] For example, a user accesses the system, enters basic information, and takes a personality test. The user is determined to be "introverted," and the server recommends a teacher model "Teacher A" that matches the introverted personality. The user selects Teacher A and begins the lesson. The lesson proceeds via video call, with the user answering questions and engaging in dialogue. The server records this in a log, and after the lesson is over, generates a progress report and provides it to the user.
[1649] Furthermore, when a user's cumulative study time reaches four hours, two of those hours are donated free of charge to other less fortunate users. Corporate advertisements are displayed on the lesson screen, and when users click on them with interest, the advertising revenue is managed as funds for maintaining the system. In this way, the present invention provides a high-quality language learning environment for all users, while eliminating educational disparities and contributing to society.
[1650] The processing flow will be explained below.
[1651] User registration and personality test
[1652] Step 1:
[1653] The user accesses the system's registration page and enters basic information (name, age, gender, email address, etc.).
[1654] Step 2:
[1655] The device sends the user's basic information to the server.
[1656] Step 3:
[1657] The server stores the user's basic information in a database, generates a URL for the personality test page, and returns it to the device.
[1658] Step 4:
[1659] The user visits the personality test page and answers the questions displayed.
[1660] Step 5:
[1661] The device sends the user's personality test answers to the server.
[1662] Step 6:
[1663] The server analyzes the personality test answers in real time and determines the user's personality.
[1664] Step 7:
[1665] Based on the results of the assessment, the server sends the most suitable AI instructor model to the terminal as a recommendation list.
[1666] Select an AI teacher and start lessons
[1667] Step 8:
[1668] Users can select the tutor that best suits them from the recommended AI tutor models.
[1669] Step 9:
[1670] The terminal transmits the user's selection information to the server.
[1671] Step 10:
[1672] The server activates the selected AI instructor model and prepares for the start of the lesson.
[1673] Step 11:
[1674] The device will notify the user that the lesson has started and launch the learning screen.
[1675] Step 12:
[1676] The user begins a dialogue with the AI instructor on the learning screen.
[1677] Lesson progress and log storage
[1678] Step 13:
[1679] The AI instructor presents the lesson content to the user and gives questions and assignments.
[1680] Step 14:
[1681] Users respond and comment accordingly.
[1682] Step 15:
[1683] The server records the dialogue data between the user and the AI instructor in real time and stores the dialogue logs in a database.
[1684] Step 16:
[1685] After the lesson ends, the server generates a progress report for the user and sends it to the device.
[1686] Step 17:
[1687] The device displays a progress report to the user.
[1688] Sharing study time
[1689] Step 18:
[1690] The server records the user's study time in a database and manages the cumulative study time.
[1691] Step 19:
[1692] When the accumulated learning time reaches a certain value, the server provides that time to other less fortunate users free of charge.
[1693] Step 20:
[1694] Free users will receive a notification and access the class page.
[1695] Advertising Revenue and Funding
[1696] Step 21:
[1697] The server places the advertisement in the appropriate location on the platform and sends the information to the device.
[1698] Step 22:
[1699] The device displays advertisements on the user's learning screen.
[1700] Step 23:
[1701] When a user clicks on an advertisement, the click information is sent to the server.
[1702] Step 24:
[1703] The server reports click data to advertisers and manages advertising revenue.
[1704] Step 25:
[1705] The server collects donations and recruitment agency fees from companies and uses these funds to fund the system's operations.
[1706] Through these specific processing steps, users can receive high-quality language learning for free and also contribute to society.
[1707] Example 1
[1708] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1709] Conventional language learning systems have not provided sufficient means for selecting the optimal teacher model for each individual user, resulting in inefficient learning. Furthermore, there is no mechanism for properly managing learning progress or providing learning time to other users. Furthermore, there are insufficient methods for effectively displaying advertisements and managing revenue. Therefore, there is a need for a system that allows users to contribute to society while efficiently learning a language.
[1710] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1711] In this invention, the server includes a means for a user to input their basic information and conduct a personality assessment, a means for recommending an optimal teacher model based on the results of the personality assessment, and a means for the user to select a teacher model and start a lesson. This allows the optimal teacher model to be selected for each individual user, enabling efficient learning. The server also includes a means for recording interactions with the user during lessons and managing progress, a means for accumulating the user's study time and providing that time to other users, and a means for displaying advertisements and managing advertising revenue. This makes it possible to appropriately manage the user's study progress, provide free study time to underprivileged users, and effectively manage advertising revenue.
[1712] "Basic information" refers to personal data entered by the user, such as name, age, gender, and email address.
[1713] A "personality test" is a test or questionnaire that assesses a user's personality and categorizes them into specific patterns.
[1714] A "teacher model" is an artificial intelligence character model designed to provide lessons to users.
[1715] The "lesson start means" is a function that allows the user to activate the teacher model selected and start learning.
[1716] The "interaction recording means" is a function that records all interactions between the user and the teacher model during a lesson.
[1717] "Progress management means" is a function that monitors the user's learning progress and provides appropriate feedback and reports.
[1718] "Accumulated study time" refers to calculating the total time a user spends studying on the system.
[1719] "Means for providing study time" is a system in which a portion of accumulated study time is provided free of charge to other less fortunate users.
[1720] "Advertisement display means" is a function that displays advertisement content while the user is using the system.
[1721] "Advertising revenue management means" is a function for collecting and managing revenue earned from displayed advertisements.
[1722] This invention is a system that allows users to freely study languages for as long as they like, and provides lessons using AI instructor models tailored to their personalities and regions. The system is composed of components: a server, a terminal, and a user.
[1723] User registration and personality test
[1724] A user accesses the system and uses a terminal to enter basic information such as name, age, gender, and email address into a registration form. The terminal then sends this information to the server. The server stores the received user information in a database and sends the user a URL for a personality assessment page. Once the user completes the personality assessment, the results are sent to the server for analysis. The personality assessment involves the user answering questions to assess their personality and classify it into specific patterns. Based on these results, the server returns a list of recommended teacher models that are compatible with the user.
[1725] For example, when a user first accesses the system, they enter the required information into a web form in their browser. The server then emails the user a URL for a personality test. The user is then prompted, for example, to "take the personality test," and the user completes the test.
[1726] Select an AI teacher and start lessons
[1727] The user browses the recommendation list sent from the server and selects the AI instructor that best suits them. The selection information is sent from the device to the server. The server activates the selected teacher model and prepares to start the lesson. The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log.
[1728] For example, when a user selects "Teacher A" from the recommended list and starts a lesson, the lesson screen will launch and a conversation with the AI instructor will begin in a video call format. For example, a prompt will appear asking, "Do you want to start today's lesson?" and the user will select "Start."
[1729] Lesson progress and log storage
[1730] During the lesson, the AI instructor presents questions and tasks to the user, who then responds and makes comments. The server monitors the dialogue data in real time and stores all interactions as logs. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[1731] As a concrete example, during a lesson, an AI instructor will ask questions such as, "Please explain yesterday's weather in English." The user's answers are sent to the server in real time and recorded in a log. After the lesson ends, a "progress report of today's lesson" is displayed to the user.
[1732] Sharing study time
[1733] The server records each user's study time in a database and manages the accumulated study time. When a certain amount of study time has been accumulated, the server will offer that time to other less fortunate users free of charge. For example, if two hours of study time has been accumulated, another user will be offered one hour of study time. This system encourages users to study while being conscious of contributing to society.
[1734] Advertising Revenue and Funding
[1735] The server places advertisements in appropriate locations on the platform and sends that information to the device. When an advertisement is displayed and clicked on while a user is in class or browsing a page, that information is sent to the server. The server reports ad click data to advertisers and manages advertising revenue. The server also collects donations and recruitment agency fees from companies, which are used as operating funds to ensure the sustainable operation of the system.
[1736] For example, an advertising banner is displayed on the sidebar of a lesson screen, and when a user clicks on the ad, the click information is sent to the server. A prompt is displayed asking, "Are you interested in new language learning materials?" If the user selects "Yes," they are redirected to the advertiser's page.
[1737] In this way, the present invention provides a high-quality language learning environment to all users, while eliminating educational disparities and contributing to society.
[1738] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1739] Step 1:
[1740] The user enters basic information.
[1741] Input: Basic information such as name, age, gender, and email address.
[1742] What happens: A user accesses a web form in a browser and enters the required information.
[1743] Output: The device sends the entered information as an HTTP POST request.
[1744] Step 2:
[1745] The terminal sends the information to the server.
[1746] Input: Basic information entered by the user.
[1747] Specific operation: The device sends data asynchronously using JavaScript or Ajax.
[1748] Output: The server stores the received information in a database.
[1749] Step 3:
[1750] The server stores the information in a database.
[1751] Input: Basic user information data.
[1752] What happens: A server-side script (e.g., PHP or Node.js) executes an INSERT query against the database.
[1753] Output: Basic information stored in the database.
[1754] Step 4:
[1755] The server sends the URL of the personality test page.
[1756] Input: The user's email address.
[1757] Specific operation: The server uses the SMTP server to send an email containing a link to the personality test page.
[1758] Output: The user will receive a link to the personality test page in their mailbox.
[1759] Step 5:
[1760] The user completes a personality test.
[1761] Input: URL of the personality test page.
[1762] Specific behavior: The user visits a personality test page and answers a few questions.
[1763] Output: The results of the personality test are displayed and sent from the device to the server.
[1764] Step 6:
[1765] The terminal transmits the diagnosis results to the server.
[1766] Input: Personality test results.
[1767] Specific operation: The device sends an HTTP POST request containing the diagnostic results to the server.
[1768] Output: The server analyzes the diagnostic results it receives.
[1769] Step 7:
[1770] The server analyzes the diagnostic results and returns a list of recommendations.
[1771] Input: Personality test result data.
[1772] Specific operation: The server uses the generative AI model to analyze the diagnosis results and create a list of recommended teacher models that match the user's personality.
[1773] Output: The user is presented with a list of recommendations.
[1774] Step 8:
[1775] The user browses the recommendations list.
[1776] Input: A list of recommendations sent by the server.
[1777] Specific operation: The user checks the list in a web browser and selects the desired teacher model.
[1778] Output: Information on the selected teacher model is passed to the next process.
[1779] Step 9:
[1780] The terminal transmits the selection information to the server.
[1781] Input: Information about the teacher model selected by the user.
[1782] Specific operation: The terminal sends an HTTP POST request including the selection information to the server.
[1783] Output: The server receives the selection and continues processing.
[1784] Step 10:
[1785] The server activates the teacher model.
[1786] Input: Information about the teacher model selected by the user.
[1787] Specific operation: The server launches an instance of the selected teacher model and makes it active.
[1788] Output: Lesson is ready to begin.
[1789] Step 11:
[1790] The device will display a notification that class is about to begin.
[1791] Input: Notification from the server that the lesson is ready to begin.
[1792] Specific behavior: The device will display a pop-up notification in the browser and redirect you to the learning screen.
[1793] Output: The user is notified that the lesson has started.
[1794] Step 12:
[1795] The user starts a lesson.
[1796] Input: Lesson start screen.
[1797] How it works: The user begins a conversation with the AI instructor on the lesson screen, via text chat or voice interaction.
[1798] Output: Interaction data is sent to the server.
[1799] Step 13:
[1800] The server processes and stores the interaction data.
[1801] Input: User interaction data.
[1802] Specific operation: The server processes the interaction data in real time and stores the interaction log in the database.
[1803] Output: The interaction log is saved to a database.
[1804] Step 14:
[1805] The server generates a progress report.
[1806] Input: Interaction log data.
[1807] Specific operation: The server analyzes the interaction log and creates a progress report for the user.
[1808] Output: A progress report is generated.
[1809] Step 15:
[1810] The device will display a progress report.
[1811] Input: A progress report sent by the server.
[1812] Specific behavior: The device displays a progress report to the user.
[1813] Output: User sees status report.
[1814] Step 16:
[1815] The server records the study time in a database.
[1816] Input: User study time data.
[1817] Specific operation: The server measures the time that the user is logged in and updates the database.
[1818] Output: The cumulative learning time is recorded in a database.
[1819] Step 17:
[1820] The server manages the cumulative learning time and provides a certain amount of time free of charge.
[1821] Input: Accumulated study time data.
[1822] Specific operation: The server executes logic that provides free study time to other users when a certain amount of study time has been accumulated.
[1823] Output: The free learning time is recorded.
[1824] Step 18:
[1825] The server places the advertisement and sends it to the device.
[1826] Input: Ad data.
[1827] Specific operation: The server places the advertisement in the appropriate location on the platform and sends the advertisement data to the terminal.
[1828] Output: Advertising data is sent to the device.
[1829] Step 19:
[1830] The device displays advertisements.
[1831] Input: Advertisement data sent from the server.
[1832] What it does: The device displays advertising banners in the sidebar or at the top of web pages.
[1833] Output: The user is shown the ad.
[1834] Step 20:
[1835] A user clicks on an ad.
[1836] Input: The ad displayed.
[1837] Specific behavior: The event of a user clicking on an ad is tracked.
[1838] Output: Click information is sent to the server.
[1839] Step 21:
[1840] The server reports ad click data and manages revenue.
[1841] Input: Ad click data.
[1842] Specific operation: The server reports click data to advertisers and manages advertising revenue.
[1843] Output: Advertising revenue is managed.
[1844] Step 22:
[1845] The server collects donations and recruitment fees.
[1846] Input: Data on donations and job intermediation.
[1847] Specific operation: The server collects donations and recruitment agency fees from companies and manages them as operating funds.
[1848] Output: The funds collected are used to run the system sustainably.
[1849] (Application example 1)
[1850] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1851] Current online education systems and virtual stores make it difficult for users to receive optimal support and education tailored to their individual needs and personalities. Furthermore, systems for managing learning progress and contributing to society are insufficient, and the lack of multilingual support in virtual stores is becoming apparent. These challenges make it difficult to improve user satisfaction and eliminate educational disparities.
[1852] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1853] In this invention, the server includes: means for a user to input their own basic information and conduct a personality assessment; means for recommending an optimal instructor model based on the results of the personality assessment; means for the user to select an instructor model and start a lesson; means for recording dialogue with the user during the lesson and managing progress; means for accumulating the user's study time and providing that time to other users; means for displaying advertisements and managing advertising revenue; means for providing the user with multilingual guidance and support when searching for, purchasing, or inquiring about products in a virtual store; and means for selecting a recommended virtual guide and exploring the store with that guide. This allows the user to receive education and support optimized to their individual needs, thereby eliminating social educational disparities and achieving high user satisfaction.
[1854] "Basic user information" refers to information such as name, age, gender, and email address that a user enters when registering with the system.
[1855] "Personality diagnosis" is a diagnostic tool that analyzes the user's personality and recommends the most suitable instructor model based on the results.
[1856] The "instructor model" is a lesson delivery model that implements AI tailored to the instructor's personality and region, providing the most appropriate education to the user.
[1857] "Lesson starts" refers to the state in which the user activates the selected instructor model and the lesson actually begins.
[1858] "Dialogue recording" is the process of saving the interaction between the user and the AI instructor during the lesson as a log so that it can be referenced later.
[1859] "Progress management" is the process of tracking a user's learning progress and providing feedback based on that progress.
[1860] "Accumulating learning time" is the process of tallying and recording the time a user spends learning on the system.
[1861] "Providing to other users" means distributing a portion of the accumulated learning time to other less fortunate users free of charge.
[1862] "Displaying Advertisements" means the process of placing Advertisements on the Platform and making them visible to Users.
[1863] "Advertising revenue management" is the process of aggregating click data from displayed ads and managing the resulting revenue as operating funds.
[1864] "Exploring the virtual store" means that a user browses, selects, purchases, and inquires about products within a virtual shopping environment.
[1865] "Multilingual guidance and support" means that the AI guide provides guidance and support in different languages depending on the user's language settings.
[1866] "Selecting a virtual guide" is the process of selecting the most suitable virtual guide based on the results of a personality test and the user's preferences, and then exploring the store together.
[1867] MODE FOR CARRYING OUT THE INVENTION
[1868] The present invention is a system that allows users to freely learn languages and receive multilingual guidance in virtual stores. The system is composed of components: a server, a terminal, and a user. The system is implemented as follows:
[1869] User registration and personality test
[1870] The user accesses the system from their device and enters basic information such as name, age, gender, and email address into the registration form. The device sends this information to the server. The server stores the received user information in a database and sends the user a URL for the personality assessment page. Once the user completes the personality assessment, the results are sent to the server, which analyzes them. Based on the results of the personality assessment, the server returns a list of recommended tutor models who are compatible with the user to the user.
[1871] Select an AI teacher and start lessons
[1872] The user browses the recommendation list sent from the server and selects the AI instructor that best suits them. This selection information is sent from the device to the server. The server activates the selected instructor model and prepares to start the lesson. The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log.
[1873] Lesson progress and log storage
[1874] During the lesson, the AI instructor presents questions and tasks to the user, who then responds and makes comments. The server monitors the dialogue data in real time and saves all interactions as a log. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[1875] Sharing study time
[1876] The server records each user's study time in a database and manages the cumulative study time. When a user achieves a certain amount of study time, a portion of that time is donated free of charge to other less fortunate users. For example, if a user accumulates two hours of study time, they can donate one hour of study time to another user. This system allows users to study while being conscious of contributing to society.
[1877] Advertising Revenue and Funding
[1878] The server places advertisements in appropriate locations on the platform and sends that information to the device. When a user clicks on an advertisement displayed during class or while browsing a page, that information is sent to the server. The server collects ad click data, reports it to advertisers, and manages advertising revenue. It also collects donations and recruitment agency fees from companies, which it uses as operating funds to ensure the sustainable operation of the system.
[1879] Multilingual guidance in the virtual store
[1880] When a user accesses a virtual store, they select the AI guide that best suits them based on their basic information and personality assessment. The selected information is sent from the device to the server. The server then activates the selected virtual guide and guides the user in multiple languages through product exploration, purchases, and inquiries within the virtual store. Interaction data is saved as a log on the server in real time, allowing the server to provide support tailored to the user's progress and interests.
[1881] Hardware and software used
[1882] Server (Amazon Web Services (AWS), Google Cloud Platform (GCP), etc.)
[1883] Client terminal (smartphone: iOS / Android, PC)
[1884] Database (MySQL, PostgreSQL)
[1885] AI teacher model (GPT-3, Google BERT)
[1886] Development language (Python, JavaScript, Swift, Kotlin)
[1887] Specific Examples
[1888] Users visit the virtual store
[1889] When a user visits a virtual store and is guided through the products, the following prompt is used:
[1890] "Hello. What product would you like to know about today? Tell me what you're looking for."
[1891] Interact with a virtual AI guide
[1892] When a user asks about a specific product, the following exchange might occur:
[1893] User: "Tell me about this TV."
[1894] AI Guide: "This TV is equipped with the latest 4K technology, delivering exceptional picture quality. It also has a wealth of smart features. Want to know more?"
[1895] In this way, the AI guide can provide personalized information in response to user questions.
[1896] As described above, the present invention provides optimal education and virtual store support tailored to the needs of each individual user, thereby improving user satisfaction and eliminating social educational disparities.
[1897] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1898] Step 1:
[1899] User registration and basic information entry
[1900] A user accesses the system from a terminal and enters basic information such as name, age, gender, and email address into the registration form. The terminal sends the entered basic information to the server. The server stores the received user information in a database and sends the terminal the URL of the personality test page to proceed to the next step. The input is the user's basic information, and the output is the URL of the personality test page.
[1901] Step 2:
[1902] Personality test
[1903] The user accesses the personality test page and answers the questions. The answers are sent from the device to the server. The server analyzes the received personality test results and uses a prepared generative AI model to select the most suitable tutor model for the user. The analysis results are returned to the user as a list of recommendations. The input is the personality test answer results, and the output is a list of recommended tutor models.
[1904] Step 3:
[1905] Select an AI teacher and start lessons
[1906] The user browses the recommended list and selects a suitable instructor model. This selection information is sent from the terminal to the server. The server activates the selected instructor model and prepares for the start of the lesson. The terminal displays a notification that the lesson has started to the user and launches the learning screen. The input is the instructor model selection information, and the output is a notification that the lesson has started and the learning screen.
[1907] Step 4:
[1908] Recording of lesson progress and dialogue
[1909] During the lesson, the AI instructor presents the user with questions and tasks. The user answers them and engages in a dialogue. The server processes this dialogue data in real time and saves all interactions as a log. The input is the user's answers and dialogue data, and the output is the dialogue log.
[1910] Step 5:
[1911] Generate progress reports
[1912] After the lesson ends, the server analyzes the dialogue log and generates a progress report for the user. The generated report is sent to the terminal and displayed to the user. The input is the log data, and the output is the progress report.
[1913] Step 6:
[1914] Managing and sharing study time
[1915] The server records the user's study time in a database and manages the accumulated study time. When a certain amount of study time is achieved, a portion of that time is offered free of charge to other less fortunate users. The input is the accumulated study time data, and the output is a notification of the free offer.
[1916] Step 7:
[1917] Ad display and revenue management
[1918] The server places ads in the appropriate locations on the platform and sends the information to the device. When a user clicks on an ad, the click data is sent to the server. The server collects this data and reports it to advertisers to manage revenue. The input is ad click data, and the output is revenue management data.
[1919] Step 8:
[1920] Multilingual guidance in the virtual store
[1921] Users access a virtual store and select the most suitable AI guide based on their basic information and personality assessment. The selection information is sent from the device to the server. The server activates the selected virtual guide and guides the user in multiple languages to explore products in the virtual store, make purchases, and make inquiries. Interaction data is saved as a log on the server in real time, providing support based on the user's progress and interests. The input is the AI guide's selection information, and the output is multilingual guidance and log data.
[1922] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1923] This invention is a system that allows users to freely study languages for as long as they like, and provides lessons using an AI instructor model and emotion engine tailored to the personalities and regions of approximately 100 people. The system is composed of server, terminal, and user components.
[1924] User registration and personality test
[1925] The user accesses the system and enters their basic information (name, age, gender, email address, etc.) into the registration form. The device sends this information to the server. The server stores the received user information in a database and sends the user a URL for a personality assessment page. Once the user completes the personality assessment, the results are sent to the server for analysis. Based on the results of the personality assessment, the server returns a recommended list of compatible tutor models.
[1926] Select an AI teacher and start lessons
[1927] The user browses the recommendation list sent from the server and selects the AI instructor that best suits them. The selection information is sent from the device to the server. The server activates the selected instructor model and prepares for the start of the lesson. The device notifies the user that the lesson has started and launches the learning screen. When the user begins interacting with the AI instructor on the lesson screen, the server processes the interaction data in real time and saves the log.
[1928] Lesson progress and log storage
[1929] During the lesson, the AI instructor presents the lesson content to the user and poses questions and assignments. The user responds and makes comments accordingly. The server monitors the dialogue data in real time and saves all interactions as a log. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[1930] Incorporating an emotion engine
[1931] The emotion engine recognizes the user's emotional state in real time and provides feedback according to that state. For example, if a user is feeling frustrated during a lesson, the emotion engine will detect this information and the server will generate an encouraging message and send it to the device. This will help the user maintain their motivation to learn.
[1932] Furthermore, the emotion engine has the function of determining the user's stress level. If the stress level is determined to be high, the server will suggest an appropriate time to take a break and send a message to the device urging it to take a break.
[1933] Sharing study time
[1934] The server records each user's study time in a database and manages the accumulated study time. When a certain amount of study time has been accumulated, the server will offer that time to other less fortunate users free of charge. For example, if two hours of study time has been accumulated, another user will be offered one hour of study time. This system encourages users to study while being conscious of contributing to society.
[1935] Advertising Revenue and Funding
[1936] The server places advertisements in appropriate locations on the platform and sends that information to the device. When an advertisement is displayed and clicked on while a user is in class or browsing a page, that information is sent to the server. The server reports ad click data to advertisers and manages advertising revenue. The server also collects donations and recruitment agency fees from companies, which are used as operating funds to ensure the sustainable operation of the system.
[1937] Specific examples
[1938] For example, a user accesses the system, enters basic information, and takes a personality test. The user is determined to be "introverted," and the server recommends a teacher model "Teacher A" that matches the introverted personality. The user selects Teacher A and begins the lesson. The lesson proceeds via video call, with the user answering questions and engaging in dialogue. The server records this in a log, and after the lesson is over, generates a progress report and provides it to the user.
[1939] Furthermore, if the emotion engine determines that the user is tired during class, the server will send a message suggesting a break. At the same time, if the user's cumulative study time reaches four hours, two of those hours will be donated free of charge to other less fortunate users. Corporate advertisements are displayed on the class screen, and if a user clicks on them with interest, the advertising revenue is managed as funds to maintain the system.
[1940] In this way, the present invention provides a high-quality language learning environment to all users, while eliminating educational disparities and contributing to society.
[1941] The processing flow will be explained below.
[1942] User registration and personality test
[1943] Step 1:
[1944] The user accesses the system's registration page and enters basic information (name, age, gender, email address, etc.).
[1945] Step 2:
[1946] The device sends the user's basic information to the server.
[1947] Step 3:
[1948] The server stores the user's basic information in a database, generates a URL for the personality test page, and returns it to the device.
[1949] Step 4:
[1950] The user visits the personality test page and answers the questions displayed.
[1951] Step 5:
[1952] The device sends the user's personality test answers to the server.
[1953] Step 6:
[1954] The server analyzes the personality test answers in real time and determines the user's personality.
[1955] Step 7:
[1956] Based on the results of the assessment, the server sends the most suitable AI instructor model to the terminal as a recommendation list.
[1957] Select an AI teacher and start lessons
[1958] Step 8:
[1959] Users can select the tutor that best suits them from the recommended AI tutor models.
[1960] Step 9:
[1961] The terminal transmits the user's selection information to the server.
[1962] Step 10:
[1963] The server activates the selected AI instructor model and prepares for the start of the lesson.
[1964] Step 11:
[1965] The device will notify the user that the lesson has started and launch the learning screen.
[1966] Step 12:
[1967] The user begins a dialogue with the AI instructor on the learning screen.
[1968] Lesson progress and log storage
[1969] Step 13:
[1970] The AI instructor presents the lesson content to the user and gives questions and assignments.
[1971] Step 14:
[1972] Users respond and comment accordingly.
[1973] Step 15:
[1974] The server records the dialogue data between the user and the AI instructor in real time and stores the dialogue logs in a database.
[1975] Step 16:
[1976] The server uses an emotion engine to analyze the user's emotional state from the dialogue data and decides on an appropriate response.
[1977] Step 17:
[1978] If the user's emotions indicate fatigue or stress, the emotion engine detects this and notifies the server.
[1979] Step 18:
[1980] The server generates messages encouraging the user or encouraging them to take a break and sends them to the device.
[1981] Step 19:
[1982] The terminal displays the generated message to the user.
[1983] Step 20:
[1984] After the lesson ends, the server generates a progress report for the user and sends it to the device.
[1985] Step 21:
[1986] The device displays a progress report to the user.
[1987] Sharing study time
[1988] Step 22:
[1989] The server records the user's study time in a database and manages the cumulative study time.
[1990] Step 23:
[1991] When the accumulated learning time reaches a certain value, the server provides that time to other less fortunate users free of charge.
[1992] Step 24:
[1993] Free users will receive a notification and access the class page.
[1994] Advertising Revenue and Funding
[1995] Step 25:
[1996] The server places the advertisement in the appropriate location on the platform and sends the information to the device.
[1997] Step 26:
[1998] The device displays advertisements on the user's learning screen.
[1999] Step 27:
[2000] When a user clicks on an advertisement, the click information is sent to the server.
[2001] Step 28:
[2002] The server reports click data to advertisers and manages advertising revenue.
[2003] Step 29:
[2004] The server collects donations and recruitment agency fees from companies and uses these funds to fund the system's operations.
[2005] Through these specific processing steps, users can receive high-quality language learning for free and also contribute to society.
[2006] Example 2
[2007] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2008] Conventional language learning systems have struggled to provide optimal learning tailored to each user's individual personality and regional background, and have often relied on uniform content and pace. It has also been difficult to grasp a user's emotional state in real time during learning and provide effective feedback based on that. Furthermore, maintaining user motivation and fostering a sense of social contribution during long learning periods have also been challenges.
[2009] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[2010] In this invention, the server includes means for a user to input their own basic information and conduct a personality diagnosis, means for recommending the most suitable instructor model based on the results of the personality diagnosis, means for the user to select an instructor model and start the lesson, means for recording the dialogue with the user during the lesson and managing the progress, means for recognizing the user's emotional state in real time and providing feedback according to that state, means for accumulating the user's study time and providing that time to other users, and means for displaying advertisements and managing advertising revenue. This provides an optimal learning environment for each user, realizes appropriate feedback according to emotions, and aims to improve awareness of social contribution through the accumulation of study time.
[2011] "Basic information" refers to information related to personal identification, such as name, age, gender, and email address, entered by the user.
[2012] "Personality diagnosis" is a process for evaluating a user's personality and characteristics and selecting a suitable instructor model based on that.
[2013] The "Instructor Model" is an AI-based educational content provider designed to assist users in their learning.
[2014] A "lesson" is an educational session conducted by an AI instructor model for a user, and includes dialogue and assignment presentation.
[2015] "Dialogue Data" refers to the voice, text, and other interaction data exchanged between a user and an AI instructor model during a lesson.
[2016] "Progress management" is the process of recording and analyzing a user's learning content and progress and providing appropriate feedback.
[2017] "Emotional state" refers to the user's psychological and emotional state, including stress, frustration, etc.
[2018] "Feedback" refers to responses such as encouragement or advice provided based on the user's learning progress or emotional state.
[2019] "Cumulative Study Time" refers to the total time a User spends studying using the System.
[2020] "Sharing" refers to a system in which a portion of accumulated study time is provided free of charge to other less fortunate users.
[2021] "Advertisement" refers to promotional information for companies, organizations, etc. that is displayed on the system.
[2022] "Advertising Revenue" refers to revenue earned from users viewing or clicking on advertisements displayed on the System.
[2023] This invention is a system that allows users to freely study languages for as long as they like, and provides lessons using an AI instructor model and emotion engine tailored to the personalities and regions of approximately 100 people. The system is composed of server, terminal, and user components.
[2024] User registration and personality test
[2025] Users access the system using their own devices and enter basic information such as name, age, gender, and email address into the registration form. The device sends this information to the server. The server stores the received user information in a database and sends the user a URL for the personality test page, allowing them to take the test.
[2026] Once the user has completed the personality test, the results are sent from the device to the server, which analyzes the results and generates a list of recommended tutor models based on the user's personality. This list is then presented to the user via the device.
[2027] Select an AI teacher and start lessons
[2028] The user browses a list of recommended instructors on their device and selects an AI instructor that best suits them. The selection information is sent from the device to the server. The server sets the selected instructor model to active status and prepares for the start of the lesson. When preparations are complete, the server sends a notification to the device, which displays that information to the user. The lesson then progresses when the user launches the learning screen and begins interacting with the AI instructor.
[2029] Lesson progress and log storage
[2030] During the lesson, the AI instructor presents the lesson content to the user and poses questions and assignments. The user responds and makes comments accordingly. All of these interactions are sent to the server in real time and saved as logs by the server. After the lesson ends, the server generates a progress report for the user and sends it to the device. The device then displays this report to the user.
[2031] Incorporating an emotion engine
[2032] The emotion engine recognizes the user's emotional state in real time and provides feedback according to that state. For example, if a user feels frustrated during class, the emotion engine detects this information and the server generates an encouraging message and sends it to the device. This helps the user maintain their motivation to study. The emotion engine also has the function of determining the user's stress level, and if a high stress level is detected, the server will send a message to the device suggesting an appropriate break.
[2033] Sharing study time
[2034] The server records each user's study time in a database and manages the cumulative study time. When the cumulative study time reaches a certain level, the server provides a portion of it to other users. This system is intended to promote a sense of social contribution.
[2035] Ad display and revenue management
[2036] The server places advertisements in appropriate locations on the platform and transmits the information to the device. When a user views or clicks on an advertisement, the information is sent to the server. The server manages advertising revenue based on this information, and also collects donations and recruitment agency fees from companies to fund the system's operations.
[2037] Examples of concrete examples and prompts
[2038] For example, a user accesses the system, enters basic information, and takes a personality test. The user is determined to be introverted, and the server recommends a teacher model named "Teacher A" who matches the introverted personality. The user selects Teacher A and begins the lesson. The lesson proceeds via video call, with the user answering questions and engaging in dialogue. The server records this in a log, and after the lesson is over, generates a progress report and provides it to the user.
[2039] Furthermore, if the emotion engine determines that the user is tired during class, the server will send a message suggesting a break. At the same time, if the user's cumulative study time reaches four hours, two of those hours will be donated free of charge to other less fortunate users. Corporate advertisements are displayed on the class screen, and if a user clicks on them with interest, the advertising revenue is managed as funds to maintain the system.
[2040] Example prompt: "Write a scene in which a user accesses the system, enters basic information, and takes a personality test. Include a scene in which the user is determined to be an introvert and selects an AI tutor who matches their introverted personality to begin the lesson. Also, include a scene in which the emotion engine provides appropriate feedback if the user feels fatigued during the lesson."
[2041] In this way, the present invention provides a high-quality language learning environment to all users, while eliminating educational disparities and contributing to society.
[2042] The flow of the identification process in the second embodiment will be described with reference to FIG.
[2043] Step 1: User Registration
[2044] Input: The user enters their basic information (name, age, gender, email address, etc.) into the registration form.
[2045] Action: The device sends this information to the server.
[2046] Data processing / calculation: The server stores the received information in a database.
[2047] Output: The server sends the user the URL of the personality test page.
[2048] Step 2: Take a personality test
[2049] Input: A user visits the personality assessment page and completes the test.
[2050] Operation: The device sends the results of the personality test to the server.
[2051] Data processing / calculation: The server analyzes the diagnostic results and identifies the user's personality traits.
[2052] Output: The server generates the best tutor model as a recommendation list and sends it to the device.
[2053] Step 3: Select an AI teacher
[2054] Input: User browses the recommendation list on their device and selects the best teacher model.
[2055] Operation: The device sends the selection information to the server.
[2056] Data processing / calculation: The server sets the selected instructor model to the active state and prepares for the start of the lesson.
[2057] Output: The server sends a notification to the terminal that the lesson is ready to start.
[2058] Step 4: Start classes
[2059] Input: The terminal that receives the notification from the server notifies the user that the lesson has started.
[2060] How it works: The user launches the lesson screen and begins a dialogue with the AI instructor.
[2061] Data processing / calculation: The server records the interaction data between the user and the AI teacher model in real time.
[2062] Output: Initial interaction log stored in the database.
[2063] Step 5: Classroom Management
[2064] Input: During class, users respond to instructions and questions from the instructor.
[2065] How it works: The device sends the user's answers and comments to the server.
[2066] Data processing / calculation: The server analyzes interaction data in real time and stores it as a log.
[2067] Output: Progress report data for the lesson content is generated.
[2068] Step 6: Feedback from the Emotion Engine
[2069] Input: The user's facial and voice data is captured in real time.
[2070] Operation: The device sends this data to the server.
[2071] Data processing / calculation: The emotion engine on the server analyzes the data and determines the user's emotional state.
[2072] Output: Generates appropriate feedback messages for the user and sends them to the device.
[2073] Step 7: Share your study time
[2074] Input: User learning time data accumulated on the server.
[2075] How it works: The server periodically checks the accumulated time to see if it has reached a certain threshold.
[2076] Data processing / calculation: When the standard is reached, the excess time is allocated to other users.
[2077] Output: Sends notification of time donation to relevant users.
[2078] Step 8: Display ads and manage revenue
[2079] Input: Advertising data and user activity data while learning and browsing.
[2080] How it works: The server places the ad in the appropriate location and sends the information to the device.
[2081] Data processing / calculation: When an advertisement is clicked, the data is collected and analyzed.
[2082] Output: Reporting ad revenue data to advertisers and managing revenue.
[2083] Through this series of steps, the system provides users with an effective language learning environment, maintaining their motivation to learn while also contributing to society.
[2084] (Application example 2)
[2085] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2086] Conventional language learning systems lack personalization based on the user's personality and learning situation, and lack real-time feedback and emotional state management to maintain motivation to learn. Furthermore, it is difficult for users to share their accumulated learning time with other users, and there is a lack of a mechanism to continue learning while maintaining a sense of social contribution.
[2087] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a user to input their basic information and conduct a personality assessment, a means for recommending an optimal instructor model based on the results of the personality assessment, a means for the user to select an instructor model and start a lesson, a means for recording dialogue with the user during the lesson and managing progress, a means for accumulating the user's study time and providing that time to other...
Claims
1. A means for users to enter their basic information and take a personality test; A means for recommending the most suitable instructor model based on the results of the personality test; A means for users to select a teacher model and start a lesson; A means to record interactions with users during lessons and manage progress, A means for accumulating users' learning time and offering that time to other users; a means for displaying advertisements and managing advertising revenue; A system including:
2. The system according to claim 1 , further comprising means for recommending an optimal tutor model from a plurality of tutor models having different personalities and regional variations based on the results of the personality assessment.
3. The system of claim 1 , further comprising means for providing real-time feedback to the user as the user progresses.
4. The system of claim 1 further comprising means for providing the service free of charge to users by utilizing advertising revenue or corporate donations.
5. 2. The system according to claim 1, further comprising means for establishing a mechanism for allowing a user to share his / her study time with other users, and automatically providing free study time when the accumulated study time reaches a certain value.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A