System
A system using generative AI and virtual reality provides personalized career guidance and practical experiences, addressing the limitations of traditional education by analyzing students' interests and strengths to suggest tailored career paths.
Patent Information
- Application Number
- JP2024137132
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-16
- Publication Date
- 2026-02-27
AI Technical Summary
The modern education system fails to provide personalized career guidance that considers individual students' interests and strengths, limiting their ability to find suitable career paths and gain practical work experience.
A system utilizing generative artificial intelligence to analyze students' interests and strengths, combined with virtual reality technology to provide customized career suggestions and immersive work experiences.
Enables students to understand their interests and strengths, explore career paths, and reduce anxiety about future choices by receiving personalized career suggestions and experiencing jobs through virtual reality.
Smart Images

Figure 2026034011000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] The modern education system makes it difficult for students to have a concrete vision for their future careers. Furthermore, traditional career education is one-size-fits-all and fails to fully consider each student's interests and strengths. As a result, students have difficulty finding the right career path for themselves and lack information on career choices. Furthermore, they have limited opportunities to experience actual jobs, preventing them from gaining a practical understanding. [Means for solving the problem]
[0005] The present invention relates to a system that uses generative artificial intelligence to analyze the interests and strengths of individual students and provides customized career suggestions to each student based on that information. Specifically, the system includes the following means:
[0006] 1. A means of using generative artificial intelligence to analyze individual student interests and strengths.
[0007] 2. A means of using virtual reality technology to allow students to virtually experience the proposed career.
[0008] 3. A means for dynamically updating a student's profile based on responses provided via said generative artificial intelligence.
[0009] 4. Means for generating customized career suggestions based on said profile.
[0010] This allows students to understand their own interests and strengths and explore career paths based on these, while work experiences using virtual reality technology deepen their understanding of real-life jobs.
[0011] "Generative AI" is an artificial intelligence technique that analyzes data, recognizes patterns, and generates appropriate responses and suggestions.
[0012] "Interest" refers to the degree of curiosity or interest that an individual student feels in a particular field or activity.
[0013] "Strengths" are the characteristics or abilities that make an individual student superior to others in a particular area or skill.
[0014] "Analyzing" is the process of examining data or information in detail to find patterns and meaning.
[0015] "Virtual reality technology" is a technology that allows users to experience a virtual environment generated by a computer.
[0016] "Experiencing" refers to having the user actually perform a particular activity or scenario and experience it.
[0017] A "response" is a response or reaction from the system to an input or question from the user.
[0018] "Updating" refers to replacing existing information or data with new information.
[0019] A "profile" is a data set that records the interests, strengths, and other characteristics of an individual student.
[0020] A "proposal" is a recommendation or advice based on a specific purpose or condition.
[0021] "Customized" means specifically tailored or modified for a particular user or situation.
[0022] A "career path" is a list of occupations or roles and the associated set of experiences and skills. [Brief explanation of the drawings]
[0023] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8]FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0024] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0025] First, the terms used in the following description will be explained.
[0026] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0027] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0028] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0029] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0030] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0031] [First embodiment]
[0032] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0033] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0034] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0035] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0036] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0037] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0038] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0039] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0040] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0041] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0042] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0043] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0044] The present invention relates to a system that combines generative artificial intelligence and virtual reality technologies to analyze individual student interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences.
[0045] System configuration
[0046] The system includes the following major components:
[0047] 1. Generative artificial intelligence (server) for analyzing students' interests and strengths.
[0048] 2. A means (terminal) for providing work experience using virtual reality technology.
[0049] 3. Interface (terminal) for interactive interaction with students.
[0050] 4. A means (server) for dynamically updating student profiles and generating customized career suggestions.
[0051] Explanation of program processing
[0052] 1. Student registration and initial settings
[0053] When a student first uses the system, the server provides an interface for them to enter basic information about themselves (such as their name, grade, and areas of interest). Once the student enters and submits the information, the server receives the information and stores it in a database, creating a student profile.
[0054] Examples:
[0055] User (student): Enter your name, grade, and area of interest and submit.
[0056] Server: Receives input information, stores it in a database, and creates a profile.
[0057] 2. Interacting with AI assistants
[0058] The device displays a chat box that allows for interactive dialogue with the student. The server uses generative artificial intelligence to generate questions to explore the student's interests and strengths and sends them to the device. The student answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the student's profile.
[0059] Examples:
[0060] Server: Generates a question (e.g., "Do you like science?") and sends it to the device.
[0061] Device: Shows a question and students respond (e.g., "Yes, I like it").
[0062] User (student): Answers questions.
[0063] Terminal: Sends the answer to the server.
[0064] Server: Receives the response, stores it in the database, and updates the profile.
[0065] 3. Customized career suggestions
[0066] The server generates customized career suggestions based on the student's profile. This involves creating a list of occupations that best fit the student's interests and strengths through generative artificial intelligence. The created occupation list is sent to the device and displayed to the student. The student then selects the occupations that interest them, and their selection is sent from the device to the server.
[0067] Examples:
[0068] Server: Generates a customized occupation list (e.g., "scientist," "engineer," "doctor") and sends it to the device.
[0069] Terminal: Display occupation list.
[0070] User (student): Select a profession of interest (e.g., "scientist").
[0071] Device: Sends selection to server.
[0072] 4. Providing VR experiences
[0073] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the student with a virtual occupation experience. The student experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the terminal to the server, and the profile is updated again.
[0074] Examples:
[0075] Server: Prepares VR content and sends it to the device.
[0076] Device: Wear a VR headset to experience virtual jobs.
[0077] User (student): Put on the VR headset and experience it.
[0078] User (student): Enter feedback after the experience.
[0079] Device: Send feedback to the server.
[0080] Server: Receives feedback and updates profile.
[0081] In this way, the system will provide students with personalized career suggestions based on their interests and strengths, and offer hands-on work experiences through virtual reality, helping them find the career path that's right for them.
[0082] The processing flow will be explained below.
[0083] Step 1:
[0084] The server receives the data from the new user registration form, stores the student's basic information (name, year, interests, etc.) in a database, generates a unique student ID, and initializes the student profile.
[0085] Step 2:
[0086] The terminal provides an interface for students to enter information into a registration form and transmits the entered data to a server.
[0087] Step 3:
[0088] The user (student) enters their name, grade, areas of interest, etc. into the registration form and clicks the "Submit" button.
[0089] Step 4:
[0090] The server analyzes the student's input and generates an initial question using generative artificial intelligence, which is then sent to the device.
[0091] Step 5:
[0092] The terminal provides an interface that displays questions received from the server to the student and transmits the student's answers to the server.
[0093] Step 6:
[0094] The user (student) answers questions displayed on the terminal (e.g., "Do you like science?" to which the student answers "Yes, I do").
[0095] Step 7:
[0096] The server receives the student's answers, stores them in a database, and uses generative artificial intelligence to generate the next question, updating the student's profile.
[0097] Step 8:
[0098] The process from step 5 to step 7 is repeated until enough data is collected and the server generates customized career suggestions based on the student's profile.
[0099] Step 9:
[0100] The server generates career suggestions and sends a list of relevant occupations (e.g., "scientist," "engineer," "doctor") to the terminal.
[0101] Step 10:
[0102] The terminal provides an interface that displays the received career suggestions to the student and transmits the student's selection to the server.
[0103] Step 11:
[0104] The user (student) reviews the list of suggested occupations and selects the occupation that interests them (e.g., "scientist").
[0105] Step 12:
[0106] The server prepares virtual reality content related to the career selected by the student and transmits it to the terminal.
[0107] Step 13:
[0108] The device guides students through the setup and plays VR content for work experience using a VR headset.
[0109] Step 14:
[0110] The user (student) follows the instructions on the device to put on the VR headset and virtually experience a specific occupation (e.g., conducting experiments in a lab as a scientist).
[0111] Step 15:
[0112] After the VR experience is over, the device displays a feedback form to the student and sends the feedback entered by the student to the server.
[0113] Step 16:
[0114] Users (students) enter their impressions of the VR experience and what they would like to learn next into a feedback form and submit it.
[0115] Step 17:
[0116] The server receives student feedback, stores it in a database, and also updates student profiles and generates upcoming learning resources and career suggestions.
[0117] Above is a detailed description of the processing steps of the present invention, which allows students to receive customized career suggestions based on their interests and strengths and experience specific careers through virtual reality.
[0118] Example 1
[0119] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0120] Conventional career guidance systems have difficulty in providing customized suggestions based on individual students' interests and strengths, and there are limited ways for students to experience actual occupations. As a result, students often find it difficult to find the career path that best suits them, and they often feel anxious about their future career choices. In response to this, there is a growing need for a system that allows students to receive specific and practical career suggestions based on their interests and strengths, and that also allows them to virtually experience those occupations using virtual reality technology.
[0121] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0122] In this invention, the server includes means for providing an interface for users to input basic information, means for analyzing the interests and strengths of individual students using generative artificial intelligence, means for generating questions through interactive dialogue and receiving user responses, means for allowing students to virtually experience suggested careers using virtual reality technology, means for providing the generated career suggestions to students and receiving their selections, means for dynamically updating student profiles based on responses provided via the generative artificial intelligence, and means for generating customized career suggestions based on the profiles.
[0123] This allows students to receive personalized career suggestions based on their interests and strengths, and even experience those jobs through virtual reality technology, helping students to reduce their lack of information and anxiety about future career choices and discover the career path that best suits them.
[0124] "Generative AI" is an AI technology that analyzes individual students' interests and strengths and uses them to generate questions and create career suggestions.
[0125] "Virtual reality technology" is a technology that allows students to virtually experience proposed careers, using devices such as virtual reality headsets.
[0126] "Interface" refers to a user interface that allows a user to input basic information and interact with the generating AI.
[0127] A "profile" is a database record for dynamically updating and storing individual information about a student, including their name, grade level, areas of interest, and past interactions.
[0128] "Career suggestions" refers to a list of occupations and specific career path suggestions generated by artificial intelligence based on students' interests and strengths.
[0129] "Career Simulation" is a simulation that uses virtual reality technology to allow students to virtually experience careers that interest them.
[0130] "Interactive dialogue" refers to the process in which generative artificial intelligence interacts with students in real time, generating questions and collecting answers.
[0131] "Dynamic updating" refers to the process of updating existing student profiles in real time based on new information collected via generative artificial intelligence.
[0132] The present invention relates to a system that combines generative artificial intelligence and virtual reality technologies to analyze individual student interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences.
[0133] System configuration
[0134] The system includes the following major components:
[0135] 1. Generative AI (Server): A means to analyze student interests and strengths. Using AI models, it updates student profiles based on input information and dialogue.
[0136] 2. Virtual reality technology (devices): This is a means of providing students with work experience using devices such as virtual reality headsets, allowing them to virtually experience a career that interests them.
[0137] 3. Interface (terminal): A user interface where students can input basic information and interact with the AI assistant.
[0138] 4. Database (server): A means of storing basic information about students, records of interactions, and profile information.
[0139] Explanation of program processing
[0140] Hardware and Software
[0141] The server manages the AI assistant and database, specifically the server on which the generative AI model is installed.
[0142] The terminal is an interactive device such as a tablet or PC, through which students input data and experience VR.
[0143] A VR headset is a device that provides a virtual reality experience. Specifically, commercially available VR devices are available.
[0144] Specific processing flow and operations
[0145] 1. Student registration and initial settings
[0146] The terminal provides an interface for first-time students to enter information such as their name, grade, and areas of interest.
[0147] The user (student) enters this information and presses the send button.
[0148] The terminal transmits the input information to the server.
[0149] The server stores the received information in a database and creates an initial profile.
[0150] 2. Interacting with AI assistants
[0151] The server uses generative artificial intelligence to generate questions to explore students' interests and strengths.
[0152] The server transmits the generated question to the terminal.
[0153] The terminal displays the question in a chat box and students enter their answers.
[0154] The user (student) enters an answer to the question and presses the send button.
[0155] The terminal sends the response to the server.
[0156] The server stores the received answers in a database and updates the student's profile.
[0157] 3. Customized career suggestions
[0158] The server generates customized carrier offers based on the updated profile.
[0159] The server transmits the generated occupation list to the terminal.
[0160] The terminal displays a list of occupations to the student.
[0161] The user (student) selects the occupation of interest and presses the send button.
[0162] The terminal transmits the selected occupation information to the server.
[0163] The server stores the received selection information in a database.
[0164] 4. Providing VR experiences
[0165] The server prepares virtual reality content related to the selected occupation.
[0166] The server transmits the prepared VR content to the terminal.
[0167] The device uses a VR headset to provide students with a virtual work experience.
[0168] Users (students) wear a VR headset and enjoy a virtual reality work experience.
[0169] The user (student) enters their feedback after the experience into the terminal and presses the send button.
[0170] The terminal sends the feedback to the server.
[0171] The server stores the received feedback in a database and updates the profile again.
[0172] Specific examples
[0173] User: Enter the name "Taro Tanaka", grade "2nd year of junior high school", and area of interest "Science" and submit.
[0174] Server: Generates the question "Do you like science?" and sends it to the device.
[0175] Device: Display the question and have the student answer "Yes, I like it."
[0176] User: Answers "Yes, I like it" and submits.
[0177] Server: Stores the received answers in a database and updates the profile.
[0178] Server: Generates a list of occupations (e.g., "scientist," "engineer," "doctor") as career suggestions and sends them to the terminal.
[0179] Terminal: Display a list of occupations and have the student select "scientist."
[0180] User: Select the occupation "Scientist" and submit.
[0181] Server: Prepares VR content and sends it to the device.
[0182] Device: VR headsets are used to provide students with virtual work experience.
[0183] User: Wears a VR headset and experiences the work of a scientist.
[0184] User: Enters and submits feedback after the experience, saying "It was very interesting."
[0185] Server: Receives feedback, stores it in a database and updates the profile.
[0186] Prompt Sentence Examples
[0187] "Design a system that provides students with customized career suggestions based on their interests and strengths, and then offers them a virtual reality experience. First, students enter their basic information, and then interact with an AI to update their profile and display career suggestions. Finally, they are provided with a VR experience, and their profile is updated again based on their feedback."
[0188] In this way, the system will provide students with personalized career suggestions based on their interests and strengths, and offer hands-on work experiences through virtual reality, helping them find the career path that's right for them.
[0189] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0190] System program processing flow
[0191] Step 1:
[0192] The user enters basic information such as name, grade, and areas of interest through the terminal interface and begins pressing the send button.
[0193] Input: Basic information such as name, grade, and areas of interest.
[0194] Data Processing: The server receives the basic information sent and formats it into a database format.
[0195] Output: Formatted student information.
[0196] The server stores the received basic information in a database and creates an initial profile.
[0197] Specific behavior:
[0198] User: Enter "Name", "Grade", and "Area of Interest" and submit.
[0199] Terminal: Sends input information to the server.
[0200] Server: Receives information, stores it in a database, and creates a profile.
[0201] Step 2:
[0202] The server uses generative artificial intelligence to generate questions to explore students' interests and strengths.
[0203] Input: User basic information and profile.
[0204] Data Calculation: Generative AI analyzes the user's interests and strengths based on input information and creates appropriate questions.
[0205] Output: The generated question.
[0206] The server transmits the generated question to the terminal.
[0207] Specific behavior:
[0208] Server: Generates the question "Do you like science?" and sends it to the device.
[0209] Terminal: Display the question to the user.
[0210] Step 3:
[0211] The terminal displays the question in a chat box and the user enters the answer.
[0212] Input: The generated question and the user's answer.
[0213] Data processing: The terminal formats the user's responses and converts them into a format that can be sent to the server.
[0214] Output: The formatted user answers.
[0215] The terminal sends the formatted response to the server.
[0216] Specific behavior:
[0217] User: Answers "Yes, I like it" and submits.
[0218] Terminal: Sends the answer to the server.
[0219] Step 4:
[0220] The server stores the received answers in a database and updates the profile.
[0221] Input: The formatted user answer.
[0222] Data calculation: The server updates the user's profile based on the received response.
[0223] Output: The updated profile.
[0224] The server updates and saves the profile.
[0225] Specific behavior:
[0226] Server: Receives the response, stores it in the database, and updates the profile.
[0227] Step 5:
[0228] The server generates customized carrier offers based on the updated profile.
[0229] Input: The updated profile.
[0230] Data Computation: Generative artificial intelligence is used to generate optimal career suggestions from profile information.
[0231] Output: Generated career suggestions (occupation list).
[0232] The server transmits the generated carrier proposal to the terminal.
[0233] Specific behavior:
[0234] Server: Generates a customized occupation list (e.g., "scientist," "engineer," "doctor") and sends it to the device.
[0235] Terminal: Display a list of occupations to the user.
[0236] Step 6:
[0237] The user selects the occupation of interest and presses the send button.
[0238] Input: Occupation list and selected occupation.
[0239] Data processing: The terminal formats the selected occupation information and sends it to the server.
[0240] Output: Formatted selected occupation information.
[0241] The terminal transmits the selected occupation information to the server.
[0242] Specific behavior:
[0243] User: Selects occupation "Scientist" and submits.
[0244] Terminal: Sends the selected information to the server.
[0245] Step 7:
[0246] The server prepares virtual reality content related to the selected occupation.
[0247] Input: Selected occupational information.
[0248] Data processing: The server prepares appropriate VR content based on the selected information.
[0249] Output: Prepared VR content.
[0250] The server transmits the prepared VR content to the terminal.
[0251] Specific behavior:
[0252] Server: Prepares VR content and sends it to the device.
[0253] Step 8:
[0254] The device uses a VR headset to provide students with a virtual work experience.
[0255] Input: Prepared VR content.
[0256] Output: The VR experience provided to students.
[0257] Users (students) wear a VR headset and enjoy a virtual reality work experience.
[0258] Specific behavior:
[0259] Device: Using a VR headset, it provides a scientist work experience.
[0260] User: Experience VR.
[0261] Step 9:
[0262] The user inputs their feedback after the experience into the terminal and presses the send button.
[0263] Input: Feedback content.
[0264] Data processing: The device formats the feedback and sends it to the server.
[0265] Output: Formatted feedback content.
[0266] The terminal sends the feedback to the server.
[0267] Specific behavior:
[0268] User: Enters feedback saying "Very interesting" and submits.
[0269] Device: Send feedback to the server.
[0270] Step 10:
[0271] The server stores the received feedback in a database and updates the student's profile again.
[0272] Input: Formatted feedback content.
[0273] Data calculation: The server updates the profile based on the feedback.
[0274] Output: The updated profile.
[0275] The server stores the profiles in a database.
[0276] Specific behavior:
[0277] Server: Receives feedback, stores it in a database, and updates the profile.
[0278] In this way, the system works in cooperation with the user, server, and device at each step to provide personalized career suggestions based on students' interests and strengths, and provide practical work experiences through virtual reality, helping students find the career path that best suits them.
[0279] (Application example 1)
[0280] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0281] Traditional career support systems often only offer standard career suggestions without fully understanding the interests and strengths of individual students. Furthermore, they face the challenge of providing students with insufficient information to help them find the career path that best suits them, due to the difficulty of providing actual work experience. Furthermore, they are unable to dynamically update profiles through interactive dialogue, which reduces the accuracy of their suggestions.
[0282] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0283] In this invention, the server includes means for analyzing interests and strengths using generative artificial intelligence, means for providing a virtual experience using virtual reality technology, means for dynamically updating a profile based on responses, means for generating customized career suggestions, and means for providing career suggestions and virtual work experiences using a smartphone. This enables highly accurate career suggestions based on individual students' interests and strengths, and allows students to gain concrete work experience through virtual reality. Furthermore, because profiles are dynamically updated through interactive dialogue, more appropriate career suggestions can be realized.
[0284] Key Word Definitions
[0285] "Generative AI" is an artificial intelligence technology that analyzes individual students' interests and strengths and generates customized career suggestions.
[0286] "Virtual reality technology" is a technology that allows students to virtually experience the proposed careers.
[0287] A "profile" is a database of information about an individual student, including their interests, strengths, grades, and future career aspirations.
[0288] "Dynamic update means" refers to the ability to update student profile information in real time based on the responses and feedback generated.
[0289] "Customized career suggestions" are job listings and career paths that are individually tailored to students based on their interests and strengths.
[0290] A "smartphone" is a mobile communication device used to provide career suggestions and virtual work experiences.
[0291] MODE FOR CARRYING OUT THE INVENTION
[0292] The present invention relates to a system that combines generative artificial intelligence and virtual reality technologies to analyze individual student interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences.
[0293] System configuration
[0294] It includes the following main components:
[0295] 1. Means for analyzing interests and strengths using generative artificial intelligence (server):
[0296] The server utilizes generative artificial intelligence to analyze student input data (e.g., areas of interest, grade level, etc.) to identify the student's interests and strengths.
[0297] 2. Means (devices) for virtually experiencing occupations using virtual reality technology:
[0298] The device uses virtual reality technology to give students a virtual experience of the proposed career, allowing them to wear a VR headset and experience specific job duties.
[0299] 3. Dynamic profile update mechanism (server):
[0300] The server updates the student's profile in real time based on the responses and feedback generated.
[0301] 4. Means for generating customized career proposals (server):
[0302] The server generates customized career suggestions (occupation lists) that best fit the student's interests and strengths based on the dynamically updated profile.
[0303] 5. Means (devices) for providing career suggestions and virtual work experiences using smartphones:
[0304] Students use their smartphones to access and experience the generated career suggestions and VR content.
[0305] Explanation of program processing
[0306] 1. Student registration and initial settings
[0307] When a student first uses the system, the server provides an interface for them to enter basic information about themselves (such as their name, grade, and areas of interest). Once the student enters and submits the information, the server receives the information and stores it in a database, creating a student profile.
[0308] 2. Interacting with AI assistants
[0309] The device displays a chat box that allows for interactive dialogue with the student. The server uses generative artificial intelligence to generate questions to explore the student's interests and strengths and sends them to the device. The student answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the student's profile.
[0310] Examples:
[0311] The server generates the following question and sends it to the device: "Do you like science?"
[0312] The device displays this question to the student, who responds, "Yes, I like it."
[0313] The device sends a response to the server, which stores this information in a database and updates the profile.
[0314] 3. Customized career suggestions
[0315] The server generates customized career suggestions based on the updated profile, which involves creating a list of occupations that best fit the student's interests and strengths through generative artificial intelligence. The created occupation list is then sent to the terminal and presented to the student.
[0316] Examples:
[0317] The server generates a customized list of occupations, such as "scientist," "engineer," or "doctor," and sends it to the device.
[0318] Students check the list of occupations on their terminals and, if they are interested in "scientist," select it.
[0319] 4. Providing VR experiences
[0320] The server prepares virtual reality content related to the selected job and sends it to the device. The student uses a VR headset to experience the virtual job. After the experience, the student enters feedback into the device and it is sent to the server. The server updates the profile again based on this feedback.
[0321] Examples:
[0322] The server prepares the "scientist" job experience content and sends it to the terminal.
[0323] Students wear VR headsets and experience the job duties of a scientist.
[0324] After the experience, students enter their feedback, and the device sends this information to the server.
[0325] The server receives the feedback and updates the student's profile.
[0326] Prompt Sentence Examples
[0327] "Generate career suggestions for students if they are interested in science."
[0328] "This student is interested in science. What career suggestions would be best for him / her?"
[0329] "Create a career proposal for students interested in engineering."
[0330] In this way, the system can provide students with accurate career suggestions based on their interests and strengths, and offer practical work experiences through virtual reality.
[0331] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0332] Program processing steps
[0333] Step 1:
[0334] When a student uses the system for the first time, the server provides an interface for entering basic student information. The user enters information such as name, grade, and areas of interest. The server receives this information and stores it in a database. A student profile is created based on this information.
[0335] Input: Basic information such as name, grade, and interests entered by the user.
[0336] Output: The initial profile data generated by the server.
[0337] How it works: The server stores the information you enter in a database and creates an initial profile.
[0338] Step 2:
[0339] The device displays a chat box for interactive dialogue with the student. The server uses generative artificial intelligence to generate questions to explore the student's interests and strengths and sends them to the device. The user answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the student's profile.
[0340] Input: Questions generated by the generative AI to explore interests and strengths, and the user's answers.
[0341] Output: Updated student profile.
[0342] How it works: The device displays questions, the user answers, and sends the answers to the server, which analyzes them and updates the profile.
[0343] Examples:
[0344] The server generates a question and sends it to the device: "Do you like science?"
[0345] The terminal displays this question and the user responds with "Yes, I like it."
[0346] The device sends the answer to the server, which stores this information in a database, analyzes it, and updates the profile.
[0347] Step 3:
[0348] The server generates customized career suggestions based on the updated profile. Using a generative AI model, it creates a list of occupations that best fit the student's interests and strengths. The created occupation list is sent to the device and presented to the user.
[0349] Input: Updated profile data.
[0350] Output: A customized list of occupations.
[0351] How it works: The server uses a generative AI model based on the profile data to generate a list of occupations and sends it to the device.
[0352] Examples:
[0353] The server generates a list of occupations such as "scientist," "engineer," and "doctor" and sends it to the device.
[0354] The terminal displays a list of occupations and prompts the user to make a selection.
[0355] Step 4:
[0356] The user selects the occupation of interest from a customized occupation list displayed on the terminal, and the selected information is transmitted from the terminal to the server.
[0357] Input: customized occupation list, user selection.
[0358] Output: Selection information sent to the server.
[0359] Operation: The user selects an occupation of interest from the occupation list, and the terminal transmits the selection information to the server.
[0360] Step 5:
[0361] The server prepares virtual reality content related to the selected occupation and sends it to the device. The device uses a VR headset to provide the user with a virtual occupation experience. The user experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the device to the server, and the profile is updated again.
[0362] Input: User's career choice information, virtual reality content.
[0363] Output: Feedback after the experience, updated profile again.
[0364] How it works: The server prepares VR content and sends it to the device. The user experiences the job using a VR headset and enters feedback. The device sends the feedback to the server, which updates the profile.
[0365] Examples:
[0366] The server prepares the "scientist" job experience content and sends it to the terminal.
[0367] The device allows users to wear a VR headset and experience the job duties of a scientist.
[0368] After the experience, the user inputs feedback, which the terminal then sends to the server.
[0369] The server receives the feedback and updates the profile again.
[0370] Through these processing steps, the system can provide individual career suggestions based on students' interests and strengths, and offer concrete work experiences through virtual reality.
[0371] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0372] The present invention relates to a system that combines generative artificial intelligence, virtual reality technology, and an emotion engine to analyze individual students' interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences. The emotion engine also recognizes the student's emotional state and adjusts interactive dialogue and recommendations based on that state.
[0373] System configuration
[0374] The system includes the following major components:
[0375] 1. Generative artificial intelligence (server) for analyzing students' interests and strengths.
[0376] 2. A means (terminal) for providing work experience using virtual reality technology.
[0377] 3. Interface (terminal) for interactive interaction with students.
[0378] 4. A means (server) for dynamically updating student profiles and generating customized career suggestions.
[0379] 5. An emotion engine (server / terminal) that recognizes the student's emotional state and adjusts the dialogue and suggestions based on that state.
[0380] Explanation of program processing
[0381] 1. Student registration and initial settings
[0382] When a student first uses the system, the server provides an interface for them to enter basic information about themselves (such as their name, grade, and areas of interest). Once the student enters and submits the information, the server receives the information and stores it in a database, creating a student profile.
[0383] Examples:
[0384] User (student): Enter your name, grade, and area of interest and submit.
[0385] Server: Receives input information, stores it in a database, and creates a profile.
[0386] 2. Interacting with AI assistants
[0387] The device displays a chat box that allows for interactive dialogue with the student. The server uses generative artificial intelligence to generate questions to explore the student's interests and strengths and sends them to the device. The student answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the student's profile.
[0388] Examples:
[0389] Server: Generates a question (e.g., "Do you like science?") and sends it to the device.
[0390] Device: Shows a question and students respond (e.g., "Yes, I like it").
[0391] User (student): Answers questions.
[0392] Terminal: Sends the answer to the server.
[0393] Server: Receives the response, stores it in the database, and updates the profile.
[0394] 3. Emotion Recognition by Emotion Engine
[0395] The emotion engine recognizes the student's emotional state from facial expressions, vocal tone, and body language. This allows the server to understand the student's emotional state in response to a question and adjust the dialogue and suggestions accordingly. The emotional state data is also reflected in the profile.
[0396] Examples:
[0397] Device: Captures students' facial expressions and voice using a camera and microphone.
[0398] Emotion Engine: Analyzes captured data and recognizes emotional states.
[0399] Server: Adjusts questions and tone of conversation based on emotional state, and reflects emotional data in the profile.
[0400] 4. Customized career suggestions
[0401] The server generates customized career suggestions based on the student's profile. This involves creating a list of occupations that best fit the student's interests and strengths through generative artificial intelligence. The created occupation list is sent to the device and displayed to the student. The student then selects the occupations that interest them, and their selection is sent from the device to the server.
[0402] Examples:
[0403] Server: Generates a customized occupation list (e.g., "scientist," "engineer," "doctor") and sends it to the device.
[0404] Terminal: Display occupation list.
[0405] User (student): Select a profession of interest (e.g., "scientist").
[0406] Device: Sends selection to server.
[0407] 5. Providing VR experiences
[0408] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the student with a virtual occupation experience. The student experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the terminal to the server, and the profile is updated again.
[0409] Examples:
[0410] Server: Prepares VR content and sends it to the device.
[0411] Device: Wear a VR headset to experience virtual jobs.
[0412] User (student): Put on the VR headset and experience it.
[0413] User (student): Enter feedback after the experience.
[0414] Device: Send feedback to the server.
[0415] Server: Receives feedback and updates profile.
[0416] In this way, the system makes personalized career suggestions based on students' interests and strengths, and provides practical work experiences through virtual reality. In addition, the system uses an emotion engine to tailor dialogue and suggestions to students' emotional state, resulting in more effective career education.
[0417] The processing flow will be explained below.
[0418] Step 1:
[0419] The server receives the data from the new user registration form, stores the student's basic information (name, year, interests, etc.) in a database, generates a unique student ID, and initializes the student profile.
[0420] Step 2:
[0421] The terminal provides an interface for students to enter information into a registration form and transmits the entered data to a server.
[0422] Step 3:
[0423] The user (student) enters their name, grade, areas of interest, etc. into the registration form and clicks the "Submit" button.
[0424] Step 4:
[0425] The server analyzes the student's input and generates an initial question using generative artificial intelligence, which is then sent to the device.
[0426] Step 5:
[0427] The terminal provides an interface that displays questions received from the server to the student and transmits the student's answers to the server.
[0428] Step 6:
[0429] The user (student) answers questions displayed on the terminal (e.g., "Do you like science?" to which the student answers "Yes, I do").
[0430] Step 7:
[0431] The server receives the student's answers, stores them in a database, generates the next question, and also updates the student's profile.
[0432] Step 8:
[0433] The device uses a camera and microphone to capture the student's facial expressions and voice and transmits them to the emotion engine.
[0434] Step 9:
[0435] The emotion engine analyzes the captured data and recognizes the student's emotional state, and sends the results to the server.
[0436] Step 10:
[0437] The server adjusts the content of questions and dialogue based on the emotional state data received from the emotion engine, and reflects the emotional state data in the profile.
[0438] Step 11:
[0439] Steps 5 through 10 are repeated until enough data is collected, at which point the server generates customized career suggestions based on the student's profile.
[0440] Step 12:
[0441] The server generates career suggestions and sends a list of relevant occupations (e.g., "scientist," "engineer," "doctor") to the terminal.
[0442] Step 13:
[0443] The terminal provides an interface that displays the received career suggestions to the student and transmits the student's selection to the server.
[0444] Step 14:
[0445] The user (student) reviews the list of suggested occupations and selects the occupation that interests them (e.g., "scientist").
[0446] Step 15:
[0447] The server prepares virtual reality content related to the career selected by the student and transmits it to the terminal.
[0448] Step 16:
[0449] The device guides students through the setup and plays VR content for work experience using a VR headset.
[0450] Step 17:
[0451] The user (student) follows the instructions on the device to put on the VR headset and virtually experience a specific occupation (e.g., conducting experiments in a lab as a scientist).
[0452] Step 18:
[0453] After the VR experience is over, the device displays a feedback form to the student and sends the feedback entered by the student to the server.
[0454] Step 19:
[0455] Users (students) enter their impressions of the VR experience and what they would like to learn next into a feedback form and submit it.
[0456] Step 20:
[0457] The server receives student feedback, stores it in a database, updates student profiles, and analyzes the feedback data to generate next learning resources and career suggestions.
[0458] This concludes the detailed description of the processing steps of the present invention. Through this process, students receive customized career suggestions based on their interests and strengths, and the emotion engine adjusts the dialogue and suggestions according to their emotional state. Additionally, students can experience specific careers using virtual reality.
[0459] Example 2
[0460] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0461] The current career education system has difficulty providing customized career suggestions based on students' individual interests and strengths. Students also have limited opportunities to gain real-world work experience in a virtual environment. Furthermore, the lack of dialogue and adjustment of suggestions that take into account students' emotional state prevents effective career education.
[0462] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for analyzing the interests and strengths of individual students using generative artificial intelligence, means for allowing students to virtually experience suggested careers using virtual reality technology, means for dynamically updating the student's profile based on responses provided via the generative artificial intelligence, means for recognizing the student's emotional state in real time and adjusting the content of dialogue and suggestions based on the emotional state, and means for generating customized career suggestions based on the profile. This makes it possible to provide career suggestions based on the student's individual interests and strengths. It also makes it possible to provide practical career experiences through virtual reality and adjust dialogue and suggestions according to the student's emotional state.
[0463] "Generative AI" refers to advanced AI technology that responds and generates natural language responses based on given data and input.
[0464] "Individual students" refers to specific students who are targeted at each other and whose responses are tailored to their individual profiles and characteristics.
[0465] "Means for analyzing interests and strengths" refers to a function that identifies a student's academic and activity interests and areas of expertise based on data entered by the student and information obtained through dialogue.
[0466] "Virtual reality technology" refers to technology that allows users to experience a virtual environment that is different from the real world using dedicated devices and software.
[0467] "Means for dynamic updates" refers to the function of automatically changing and correcting the profile contents to reflect new information in real time and keep the data up to date.
[0468] "Means for recognizing emotional state in real time" refers to a function that uses sensors such as cameras and microphones to analyze the user's facial expressions and vocal tone, and automatically determine their emotions at that moment.
[0469] "Means for adjusting dialogue content and suggestions" refers to the function of the system appropriately changing the questions and suggestions made to the user based on the recognized emotions and situation.
[0470] "Means for generating customized career suggestions" refers to the functionality that automatically creates optimal occupational and career path suggestions based on individual student profile information, interests, and strengths.
[0471] "Means for virtually experiencing occupations" refers to a function that uses virtual reality technology to allow students to experience occupations that interest them in a simulated format.
[0472] The present invention relates to a system that combines generative artificial intelligence, virtual reality technology, and an emotion engine to analyze individual students' interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences. The emotion engine also recognizes the student's emotional state and adjusts interactive dialogue and recommendations based on that state.
[0473] System configuration
[0474] The system includes the following major components:
[0475] 1. Generative artificial intelligence (server) for analyzing students' interests and strengths.
[0476] 2. A means (terminal) for providing work experience using virtual reality technology.
[0477] 3. Interface (terminal) for interactive interaction with students.
[0478] 4. A means (server) for dynamically updating student profiles and generating customized career suggestions.
[0479] 5. An emotion engine (server / terminal) that recognizes the student's emotional state and adjusts the dialogue and suggestions based on that state.
[0480] Explanation of program processing
[0481] 1. Student registration and initial settings
[0482] When a student uses the system for the first time, the server provides an interface for them to enter basic information (such as name, grade, and areas of interest). The user (student) enters and submits the information according to the instructions. The terminal receives the information and sends it to the server. The server receives the information entered and stores it in a database to create a student profile.
[0483] Examples:
[0484] User (student): Enter your name, grade, and area of interest and submit.
[0485] Server: Receives input information, stores it in a database, and creates a profile.
[0486] 2. Interacting with AI assistants
[0487] The server uses generative artificial intelligence (e.g., GPT-4 (registered trademark)) to create prompts that generate questions. The generated questions (e.g., "Do you like science?") are sent from the server to the device and displayed to the user. The user enters an answer in the chat box and presses the send button. The device sends the user's answer to the server, which receives the answer and stores it in a database to update the user's profile.
[0488] Examples:
[0489] Server: Generates a question (e.g., "Do you like science?") and sends it to the device.
[0490] Device: Shows a question and students respond (e.g., "Yes, I like it").
[0491] User (student): Answers the question and sends it to the device.
[0492] Server: Receives the answer, stores it in a database, and updates the profile.
[0493] 3. Emotion Recognition by Emotion Engine
[0494] The device uses a camera and microphone to capture the user's (student's) facial expressions and tone of voice. The emotion engine analyzes the captured data in real time and recognizes the user's emotional state. The server adjusts the content of the dialogue and suggestions based on this emotional state, and also reflects the emotional data in the profile.
[0495] Examples:
[0496] Device: Captures the user's facial expressions and voice using a camera and microphone.
[0497] Emotion Engine: Analyzes captured data and recognizes emotional states.
[0498] Server: Adjusts questions and tone of conversation based on emotional state, and reflects emotional data in the profile.
[0499] 4. Customized career suggestions
[0500] The server uses generative artificial intelligence to create a customized career list based on the student's profile. The generated career list is sent to the device and displayed to the user. The user selects the career they are interested in, and the selection is sent from the device to the server. The server prepares to provide further information and experiences based on the selected career.
[0501] Examples:
[0502] Server: Generates a customized occupation list (e.g., "scientist," "engineer," "doctor") and sends it to the device.
[0503] Terminal: Display occupation list.
[0504] User (student): Select the occupation of interest (e.g., "scientist") and send it to the terminal.
[0505] Server: Receives the selected information and prepares the next processing step.
[0506] 5. Providing VR experiences
[0507] The server prepares virtual reality content related to the selected occupation and sends it to the device. The device uses a VR headset to provide the user with a virtual occupation experience. The user experiences the occupation through the experience and inputs their feedback. The feedback is sent from the device to the server, and the server receives the feedback and updates the profile again.
[0508] Examples:
[0509] Server: Prepares VR content and sends it to the device.
[0510] Device: Wearing a VR headset, users are provided with a virtual job experience.
[0511] User (student): Put on the VR headset and experience it.
[0512] User (student): Enters feedback after the experience, and the device sends it to the server.
[0513] Server: Receives feedback and updates profile.
[0514] In this way, the system makes personalized career suggestions based on students' interests and strengths, and provides practical work experiences through virtual reality. Furthermore, by using an emotion engine, the system can tailor dialogue and suggestions to suit the student's emotional state, resulting in more effective career education.
[0515] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0516] Step 1:
[0517] When a student uses the system for the first time, the server provides an interface for entering basic information (such as name, grade, and areas of interest). The terminal displays this interface to the user, who then enters the information as instructed and presses the submit button. The terminal then sends the entered information to the server. The server stores the received information in a database and generates a student profile. The specific input is the student's basic information, and the output is the profile data stored in the database.
[0518] Specific behavior:
[0519] The user enters information into the basic information input form on the device.
[0520] The terminal sends the input information to the server.
[0521] The server receives the input information and stores it in a MySQL (registered trademark) database.
[0522] Step 2:
[0523] The server uses generative AI (e.g., GPT-4) to create prompts that generate questions to explore students' interests and strengths. The generated questions are in the form of prompt sentences, which the server sends to the device. The device displays the generated questions to the user. The user enters an answer in the chat box and presses the send button. The device sends the user's answer to the server. The server stores the received answers in a database and updates the profile. The inputs are the prompt sentences for the generative AI and the student's answers, and the outputs are the generated questions and updated profile data.
[0524] Specific behavior:
[0525] The server sends the AI a prompt, "Do you like science?", which generates a question.
[0526] The terminal displays the generated question and the user enters the answer.
[0527] The device sends the user's answers to the server, which stores them in a database and updates the profile.
[0528] Step 3:
[0529] The device uses a camera and microphone to capture the user's facial expressions and voice tone. The emotion engine analyzes the captured data in real time to recognize the user's emotional state. The server then adjusts new questions and dialogue content based on the recognized emotional state. The emotional state data is also reflected in the profile. The input is the video and audio data captured by the camera and microphone, and the output is the recognized emotional state data, corresponding dialogue content, and new profile data.
[0530] Specific behavior:
[0531] The device captures the user's facial expressions and voice using a camera and microphone.
[0532] The emotion engine analyzes the captured data and recognizes the emotional state.
[0533] The server adjusts the questions asked based on the perceived emotional state and updates the profile.
[0534] Step 4:
[0535] The server generates customized career suggestions based on the student's profile. This involves using generative artificial intelligence to create a list of occupations tailored to the student's interests and strengths. The generated occupation list is sent to the terminal and displayed to the user. The user selects occupations of interest, and the selection is sent from the terminal to the server. The input is the updated profile data and the student's occupation selection, and the output is the generated occupation list and the selected occupation data.
[0536] Specific behavior:
[0537] The server sends prompts to the AI based on the student's profile data to generate a list of occupations.
[0538] The terminal displays the generated occupation list, and the user selects an occupation.
[0539] The terminal transmits the selected occupation information to the server, and the server receives it.
[0540] Step 5:
[0541] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the user with a virtual occupation experience. The user experiences the occupation through the experience and inputs their feedback. The terminal sends the feedback to the server, which receives the feedback and updates the profile again. The input is the student's feedback, and the output is the updated profile data.
[0542] Specific behavior:
[0543] The server prepares the VR content and sends it to the device.
[0544] The device streams the content to the VR headset for the user to experience.
[0545] The user inputs feedback after the experience into the terminal, which then transmits it to the server.
[0546] The server receives the feedback and updates the profile.
[0547] (Application example 2)
[0548] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0549] Conventional career suggestion systems do not adequately provide individual career advice tailored to learners' interests and strengths, and it is difficult to provide optimal dialogue and suggestions that take into account the learner's emotional state. Furthermore, because work experience cannot be conducted in virtual reality, the realism and interactivity of actual work experience are lacking. As a result, it is difficult for learners to make appropriate decisions about their career choices.
[0550] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for analyzing the interests and strengths of individual learners using a generative artificial intelligence, means for allowing the learner to virtually experience suggested occupations using virtual reality technology, means for dynamically updating the learner's profile based on responses provided via the generative artificial intelligence, means for generating and displaying customized career suggestions based on the profile, and means for recognizing the learner's emotional state using an emotion engine and adjusting the dialogue and suggestion content based on that state. This makes it possible to provide appropriate career suggestions based on the learner's interests and strengths, and to adjust the dialogue and suggestion content optimally according to the learner's emotional state.
[0551] "Generative AI" is an artificial intelligence technology used to analyze learners' interests and strengths and generate customized career suggestions.
[0552] "Virtual reality technology" is a technology that provides learners with a virtual work experience, and uses devices such as head-mounted displays.
[0553] A "profile" is an individual electronic record that contains data such as a learner's basic information, interests, strengths, and emotional state.
[0554] An "emotion engine" is software that recognizes a learner's emotional state from facial expressions, tone of voice, body language, etc., and adjusts interactive dialogue and suggestions based on that information.
[0555] "Interactive dialogue" refers to real-time, two-way communication between the learner and the system, in which the system responds appropriately based on the learner's answers and actions.
[0556] "Customized career suggestions" are suggestions for occupations and career paths that are best suited to a learner, created individually based on the learner's profile.
[0557] "Work experience" refers to learners virtually experiencing the actual work content and environment of a proposed occupation through virtual reality technology.
[0558] "Server" means a computer system on a network that runs the generative artificial intelligence and emotion engine and manages and updates learner profiles.
[0559] The present invention relates to a system that combines generative artificial intelligence, virtual reality technology, and an emotion engine. The system analyzes learners' interests and strengths, generates customized career suggestions, and provides learners with work experiences using virtual reality. The emotion engine can also recognize the learner's emotional state and adjust interactive dialogues and suggestions based on that state.
[0560] System configuration
[0561] The system includes the following main components:
[0562] 1. Generative AI (server): Analyzes learner interests and strengths.
[0563] 2. Virtual reality technology (terminals): Allows learners to virtually experience the proposed careers.
[0564] 3. Interactive interface (terminal): Interacts with learners in real time.
[0565] 4. Profile update means (server): Dynamically updates the learner's profile.
[0566] 5. Emotion engine (server / terminal): Recognizes the learner's emotional state and adjusts dialogue and suggestions based on that state.
[0567] Program processing
[0568] 1. Learner registration and initial settings
[0569] When a learner uses the system for the first time, the server provides an interface for them to enter basic information about the learner (such as name, grade, and areas of interest). Once the learner enters and submits the information, the server receives this information and stores it in a database. This creates a learner profile.
[0570] 2. Interacting with AI assistants
[0571] The device displays a chat box that allows for interactive dialogue with the learner. The server uses generative artificial intelligence to generate questions to explore the learner's interests and strengths and sends them to the device. The learner answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the learner's profile.
[0572] 3. Emotion Recognition by Emotion Engine
[0573] The emotion engine recognizes the learner's emotional state from facial expressions, vocal tone, and body language. This allows the server to understand the learner's emotional state in response to a question and adjust the dialogue and suggestions accordingly. The emotional state data is also reflected in the profile.
[0574] 4. Customized career suggestions
[0575] The server generates customized career suggestions based on the learner's profile. This involves creating a list of occupations that best fit the learner's interests and strengths through generative artificial intelligence. The created occupation list is sent to the device and displayed to the learner. The learner selects the occupations that interest them, and their selection is sent from the device to the server.
[0576] 5. Providing VR experiences
[0577] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the learner with a virtual occupational experience. The learner experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the terminal to the server, and the profile is updated again.
[0578] Hardware and software used
[0579] Hardware: VR headset, camera, microphone
[0580] Software: Python, OpenCV, Emotion Engine Library, AI Assistant API, VREngine Library
[0581] Examples and prompts
[0582] Specific examples
[0583] Learner registration: A form to enter name, grade, and areas of interest
[0584] Interactive dialogue:
[0585] Question: "Do you like science?"
[0586] Answer: "Yes, I like it."
[0587] Emotion recognition: If you answer "I'm a little anxious," the next question will be presented in a softer tone.
[0588] Career suggestions: Choose the career that interests you from a list of suggested careers (scientist, engineer, doctor)
[0589] VR experience: After experiencing the career of a scientist, the participant wrote in their feedback that they were "very interested in the job."
[0590] Example prompts for generative AI models
[0591] Prompt sentence to input to the generative AI model:
[0592] prompt:
[0593] Enter the learner profile information.
[0594] Name: {name}
[0595] Grade: {grade}
[0596] Interests: {interests}
[0597] Next, imagine how the learner might respond to the AI assistant and what career suggestions might be made based on their responses.
[0598] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0599] Processing Steps
[0600] Step 1:
[0601] When a learner uses the system for the first time, the server provides an interface for them to enter basic information about the learner (such as name, grade, and areas of interest). Once the learner enters and submits the information, the server receives this information and stores it in a database. This creates a learner profile.
[0602] Input: Learner's basic information
[0603] Output: Learner profile stored in a database
[0604] What happens: When a learner enters basic information into a web form and presses the submit button, the server receives the information, creates a profile, and stores it in a database.
[0605] Step 2:
[0606] The device displays a chat box that allows for interactive dialogue with the learner. The server uses generative artificial intelligence to generate questions to explore the learner's interests and strengths and sends them to the device. The learner answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the learner's profile.
[0607] Input: Learner's basic information and answers during the dialogue
[0608] Output: Updated learner profile
[0609] How it works: A question from the AI assistant is displayed in the chat box, and when the learner answers the question, the answer is sent to the server and their profile is updated.
[0610] Step 3:
[0611] The emotion engine recognizes the learner's emotional state from facial expressions, vocal tone, and body language. This allows the server to understand the learner's emotional state in response to a question and adjust the dialogue and suggestions accordingly. The emotional state data is also reflected in the profile.
[0612] Input: Learner's facial expressions, vocal tone, and body language
[0613] Output: Learner's emotional state data
[0614] How it works: The device's camera and microphone capture the learner's facial expressions and voice, and the emotion engine analyzes the data to identify their emotional state and sends it to the server.
[0615] Step 4:
[0616] The server generates customized career suggestions based on the learner's profile. This involves creating a list of occupations that best fit the learner's interests and strengths through generative artificial intelligence. The created occupation list is sent to the device and displayed to the learner. The learner selects the occupations that interest them, and their selection is sent from the device to the server.
[0617] Input: Updated learner profile
[0618] Output: Customized career proposals
[0619] Specific operation: The server analyzes the profile, generates a list of relevant occupations and sends it to the device, the learner selects an occupation, and the selection is sent to the server.
[0620] Step 5:
[0621] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the learner with a virtual occupational experience. The learner experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the terminal to the server, and the profile is updated again.
[0622] Input: The learner's chosen occupation
[0623] Output: Learner feedback
[0624] Specific operation: The server prepares the VR content and sends it to the terminal, and the learner puts on the VR headset to experience the virtual job, and then inputs and sends feedback after completion.
[0625] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0626] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0627] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0628] [Second embodiment]
[0629] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0630] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0631] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0632] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0633] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0634] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0635] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0636] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0637] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0638] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0639] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0640] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0641] The present invention relates to a system that combines generative artificial intelligence and virtual reality technologies to analyze individual student interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences.
[0642] System configuration
[0643] The system includes the following major components:
[0644] 1. Generative artificial intelligence (server) for analyzing students' interests and strengths.
[0645] 2. A means (terminal) for providing work experience using virtual reality technology.
[0646] 3. Interface (terminal) for interactive interaction with students.
[0647] 4. A means (server) for dynamically updating student profiles and generating customized career suggestions.
[0648] Explanation of program processing
[0649] 1. Student registration and initial settings
[0650] When a student first uses the system, the server provides an interface for them to enter basic information about themselves (such as their name, grade, and areas of interest). Once the student enters and submits the information, the server receives the information and stores it in a database, creating a student profile.
[0651] Examples:
[0652] User (student): Enter your name, grade, and area of interest and submit.
[0653] Server: Receives input information, stores it in a database, and creates a profile.
[0654] 2. Interacting with AI assistants
[0655] The device displays a chat box that allows for interactive dialogue with the student. The server uses generative artificial intelligence to generate questions to explore the student's interests and strengths and sends them to the device. The student answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the student's profile.
[0656] Examples:
[0657] Server: Generates a question (e.g., "Do you like science?") and sends it to the device.
[0658] Device: Shows a question and students respond (e.g., "Yes, I like it").
[0659] User (student): Answers questions.
[0660] Terminal: Sends the answer to the server.
[0661] Server: Receives the response, stores it in the database, and updates the profile.
[0662] 3. Customized career suggestions
[0663] The server generates customized career suggestions based on the student's profile. This involves creating a list of occupations that best fit the student's interests and strengths through generative artificial intelligence. The created occupation list is sent to the device and displayed to the student. The student then selects the occupations that interest them, and their selection is sent from the device to the server.
[0664] Examples:
[0665] Server: Generates a customized occupation list (e.g., "scientist," "engineer," "doctor") and sends it to the device.
[0666] Terminal: Display occupation list.
[0667] User (student): Select a profession of interest (e.g., "scientist").
[0668] Device: Sends selection to server.
[0669] 4. Providing VR experiences
[0670] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the student with a virtual occupation experience. The student experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the terminal to the server, and the profile is updated again.
[0671] Examples:
[0672] Server: Prepares VR content and sends it to the device.
[0673] Device: Wear a VR headset to experience virtual jobs.
[0674] User (student): Put on the VR headset and experience it.
[0675] User (student): Enter feedback after the experience.
[0676] Device: Send feedback to the server.
[0677] Server: Receives feedback and updates profile.
[0678] In this way, the system will provide students with personalized career suggestions based on their interests and strengths, and offer hands-on work experiences through virtual reality, helping them find the career path that's right for them.
[0679] The processing flow will be explained below.
[0680] Step 1:
[0681] The server receives the data from the new user registration form, stores the student's basic information (name, year, interests, etc.) in a database, generates a unique student ID, and initializes the student profile.
[0682] Step 2:
[0683] The terminal provides an interface for students to enter information into a registration form and transmits the entered data to a server.
[0684] Step 3:
[0685] The user (student) enters their name, grade, areas of interest, etc. into the registration form and clicks the "Submit" button.
[0686] Step 4:
[0687] The server analyzes the student's input and generates an initial question using generative artificial intelligence, which is then sent to the device.
[0688] Step 5:
[0689] The terminal provides an interface that displays questions received from the server to the student and transmits the student's answers to the server.
[0690] Step 6:
[0691] The user (student) answers questions displayed on the terminal (e.g., "Do you like science?" to which the student answers "Yes, I do").
[0692] Step 7:
[0693] The server receives the student's answers, stores them in a database, and uses generative artificial intelligence to generate the next question, updating the student's profile.
[0694] Step 8:
[0695] The process from step 5 to step 7 is repeated until enough data is collected and the server generates customized career suggestions based on the student's profile.
[0696] Step 9:
[0697] The server generates career suggestions and sends a list of relevant occupations (e.g., "scientist," "engineer," "doctor") to the terminal.
[0698] Step 10:
[0699] The terminal provides an interface that displays the received career suggestions to the student and transmits the student's selection to the server.
[0700] Step 11:
[0701] The user (student) reviews the list of suggested occupations and selects the occupation that interests them (e.g., "scientist").
[0702] Step 12:
[0703] The server prepares virtual reality content related to the career selected by the student and transmits it to the terminal.
[0704] Step 13:
[0705] The device guides students through the setup and plays VR content for work experience using a VR headset.
[0706] Step 14:
[0707] The user (student) follows the instructions on the device to put on the VR headset and virtually experience a specific occupation (e.g., conducting experiments in a lab as a scientist).
[0708] Step 15:
[0709] After the VR experience is over, the device displays a feedback form to the student and sends the feedback entered by the student to the server.
[0710] Step 16:
[0711] Users (students) enter their impressions of the VR experience and what they would like to learn next into a feedback form and submit it.
[0712] Step 17:
[0713] The server receives student feedback, stores it in a database, and also updates student profiles and generates upcoming learning resources and career suggestions.
[0714] Above is a detailed description of the processing steps of the present invention, which allows students to receive customized career suggestions based on their interests and strengths and experience specific careers through virtual reality.
[0715] Example 1
[0716] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0717] Conventional career guidance systems have difficulty in providing customized suggestions based on individual students' interests and strengths, and there are limited ways for students to experience actual occupations. As a result, students often find it difficult to find the career path that best suits them, and they often feel anxious about their future career choices. In response to this, there is a growing need for a system that allows students to receive specific and practical career suggestions based on their interests and strengths, and that also allows them to virtually experience those occupations using virtual reality technology.
[0718] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0719] In this invention, the server includes means for providing an interface for users to input basic information, means for analyzing the interests and strengths of individual students using generative artificial intelligence, means for generating questions through interactive dialogue and receiving user responses, means for allowing students to virtually experience suggested careers using virtual reality technology, means for providing the generated career suggestions to students and receiving their selections, means for dynamically updating student profiles based on responses provided via the generative artificial intelligence, and means for generating customized career suggestions based on the profiles.
[0720] This allows students to receive personalized career suggestions based on their interests and strengths, and even experience those jobs through virtual reality technology, helping students to reduce their lack of information and anxiety about future career choices and discover the career path that best suits them.
[0721] "Generative AI" is an AI technology that analyzes individual students' interests and strengths and uses them to generate questions and create career suggestions.
[0722] "Virtual reality technology" is a technology that allows students to virtually experience proposed careers, using devices such as virtual reality headsets.
[0723] "Interface" refers to a user interface that allows a user to input basic information and interact with the generating AI.
[0724] A "profile" is a database record for dynamically updating and storing individual information about a student, including their name, grade level, areas of interest, and past interactions.
[0725] "Career suggestions" refers to a list of occupations and specific career path suggestions generated by artificial intelligence based on students' interests and strengths.
[0726] "Career Simulation" is a simulation that uses virtual reality technology to allow students to virtually experience careers that interest them.
[0727] "Interactive dialogue" refers to the process in which generative artificial intelligence interacts with students in real time, generating questions and collecting answers.
[0728] "Dynamic updating" refers to the process of updating existing student profiles in real time based on new information collected via generative artificial intelligence.
[0729] The present invention relates to a system that combines generative artificial intelligence and virtual reality technologies to analyze individual student interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences.
[0730] System configuration
[0731] The system includes the following major components:
[0732] 1. Generative AI (Server): A means to analyze student interests and strengths. Using AI models, it updates student profiles based on input information and dialogue.
[0733] 2. Virtual reality technology (devices): This is a means of providing students with work experience using devices such as virtual reality headsets, allowing them to virtually experience a career that interests them.
[0734] 3. Interface (terminal): A user interface where students can input basic information and interact with the AI assistant.
[0735] 4. Database (server): A means of storing basic information about students, records of interactions, and profile information.
[0736] Explanation of program processing
[0737] Hardware and Software
[0738] The server manages the AI assistant and database, specifically the server on which the generative AI model is installed.
[0739] The terminal is an interactive device such as a tablet or PC, through which students input data and experience VR.
[0740] A VR headset is a device that provides a virtual reality experience. Specifically, commercially available VR devices are available.
[0741] Specific processing flow and operations
[0742] 1. Student registration and initial settings
[0743] The terminal provides an interface for first-time students to enter information such as their name, grade, and areas of interest.
[0744] The user (student) enters this information and presses the send button.
[0745] The terminal transmits the input information to the server.
[0746] The server stores the received information in a database and creates an initial profile.
[0747] 2. Interacting with AI assistants
[0748] The server uses generative artificial intelligence to generate questions to explore students' interests and strengths.
[0749] The server transmits the generated question to the terminal.
[0750] The terminal displays the question in a chat box and students enter their answers.
[0751] The user (student) enters an answer to the question and presses the send button.
[0752] The terminal sends the response to the server.
[0753] The server stores the received answers in a database and updates the student's profile.
[0754] 3. Customized career suggestions
[0755] The server generates customized carrier offers based on the updated profile.
[0756] The server transmits the generated occupation list to the terminal.
[0757] The terminal displays a list of occupations to the student.
[0758] The user (student) selects the occupation of interest and presses the send button.
[0759] The terminal transmits the selected occupation information to the server.
[0760] The server stores the received selection information in a database.
[0761] 4. Providing VR experiences
[0762] The server prepares virtual reality content related to the selected occupation.
[0763] The server transmits the prepared VR content to the terminal.
[0764] The device uses a VR headset to provide students with a virtual work experience.
[0765] Users (students) wear a VR headset and enjoy a virtual reality work experience.
[0766] The user (student) enters their feedback after the experience into the terminal and presses the send button.
[0767] The terminal sends the feedback to the server.
[0768] The server stores the received feedback in a database and updates the profile again.
[0769] Specific examples
[0770] User: Enter the name "Taro Tanaka", grade "2nd year of junior high school", and area of interest "Science" and submit.
[0771] Server: Generates the question "Do you like science?" and sends it to the device.
[0772] Device: Display the question and have the student answer "Yes, I like it."
[0773] User: Answers "Yes, I like it" and submits.
[0774] Server: Stores the received answers in a database and updates the profile.
[0775] Server: Generates a list of occupations (e.g., "scientist," "engineer," "doctor") as career suggestions and sends them to the terminal.
[0776] Terminal: Display a list of occupations and have the student select "scientist."
[0777] User: Select the occupation "Scientist" and submit.
[0778] Server: Prepares VR content and sends it to the device.
[0779] Device: VR headsets are used to provide students with virtual work experience.
[0780] User: Wears a VR headset and experiences the work of a scientist.
[0781] User: Enters and submits feedback after the experience, saying "It was very interesting."
[0782] Server: Receives feedback, stores it in a database and updates the profile.
[0783] Prompt Sentence Examples
[0784] "Design a system that provides students with customized career suggestions based on their interests and strengths, and then offers them a virtual reality experience. First, students enter their basic information, and then interact with an AI to update their profile and display career suggestions. Finally, they are provided with a VR experience, and their profile is updated again based on their feedback."
[0785] In this way, the system will provide students with personalized career suggestions based on their interests and strengths, and offer hands-on work experiences through virtual reality, helping them find the career path that's right for them.
[0786] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0787] System program processing flow
[0788] Step 1:
[0789] The user enters basic information such as name, grade, and areas of interest through the terminal interface and begins pressing the send button.
[0790] Input: Basic information such as name, grade, and areas of interest.
[0791] Data Processing: The server receives the basic information sent and formats it into a database format.
[0792] Output: Formatted student information.
[0793] The server stores the received basic information in a database and creates an initial profile.
[0794] Specific behavior:
[0795] User: Enter "Name", "Grade", and "Area of Interest" and submit.
[0796] Terminal: Sends input information to the server.
[0797] Server: Receives information, stores it in a database, and creates a profile.
[0798] Step 2:
[0799] The server uses generative artificial intelligence to generate questions to explore students' interests and strengths.
[0800] Input: User basic information and profile.
[0801] Data Calculation: Generative AI analyzes the user's interests and strengths based on input information and creates appropriate questions.
[0802] Output: The generated question.
[0803] The server transmits the generated question to the terminal.
[0804] Specific behavior:
[0805] Server: Generates the question "Do you like science?" and sends it to the device.
[0806] Terminal: Display the question to the user.
[0807] Step 3:
[0808] The terminal displays the question in a chat box and the user enters the answer.
[0809] Input: The generated question and the user's answer.
[0810] Data processing: The terminal formats the user's responses and converts them into a format that can be sent to the server.
[0811] Output: The formatted user answers.
[0812] The terminal sends the formatted response to the server.
[0813] Specific behavior:
[0814] User: Answers "Yes, I like it" and submits.
[0815] Terminal: Sends the answer to the server.
[0816] Step 4:
[0817] The server stores the received answers in a database and updates the profile.
[0818] Input: The formatted user answer.
[0819] Data calculation: The server updates the user's profile based on the received response.
[0820] Output: The updated profile.
[0821] The server updates and saves the profile.
[0822] Specific behavior:
[0823] Server: Receives the response, stores it in the database, and updates the profile.
[0824] Step 5:
[0825] The server generates customized carrier offers based on the updated profile.
[0826] Input: The updated profile.
[0827] Data Computation: Generative artificial intelligence is used to generate optimal career suggestions from profile information.
[0828] Output: Generated career suggestions (occupation list).
[0829] The server transmits the generated carrier proposal to the terminal.
[0830] Specific behavior:
[0831] Server: Generates a customized occupation list (e.g., "scientist," "engineer," "doctor") and sends it to the device.
[0832] Terminal: Display a list of occupations to the user.
[0833] Step 6:
[0834] The user selects the occupation of interest and presses the send button.
[0835] Input: Occupation list and selected occupation.
[0836] Data processing: The terminal formats the selected occupation information and sends it to the server.
[0837] Output: Formatted selected occupation information.
[0838] The terminal transmits the selected occupation information to the server.
[0839] Specific behavior:
[0840] User: Selects occupation "Scientist" and submits.
[0841] Terminal: Sends the selected information to the server.
[0842] Step 7:
[0843] The server prepares virtual reality content related to the selected occupation.
[0844] Input: Selected occupational information.
[0845] Data processing: The server prepares appropriate VR content based on the selected information.
[0846] Output: Prepared VR content.
[0847] The server transmits the prepared VR content to the terminal.
[0848] Specific behavior:
[0849] Server: Prepares VR content and sends it to the device.
[0850] Step 8:
[0851] The device uses a VR headset to provide students with a virtual work experience.
[0852] Input: Prepared VR content.
[0853] Output: The VR experience provided to students.
[0854] Users (students) wear a VR headset and enjoy a virtual reality work experience.
[0855] Specific behavior:
[0856] Device: Using a VR headset, it provides a scientist work experience.
[0857] User: Experience VR.
[0858] Step 9:
[0859] The user inputs their feedback after the experience into the terminal and presses the send button.
[0860] Input: Feedback content.
[0861] Data processing: The device formats the feedback and sends it to the server.
[0862] Output: Formatted feedback content.
[0863] The terminal sends the feedback to the server.
[0864] Specific behavior:
[0865] User: Enters feedback saying "Very interesting" and submits.
[0866] Device: Send feedback to the server.
[0867] Step 10:
[0868] The server stores the received feedback in a database and updates the student's profile again.
[0869] Input: Formatted feedback content.
[0870] Data calculation: The server updates the profile based on the feedback.
[0871] Output: The updated profile.
[0872] The server stores the profiles in a database.
[0873] Specific behavior:
[0874] Server: Receives feedback, stores it in a database, and updates the profile.
[0875] In this way, the system works in cooperation with the user, server, and device at each step to provide personalized career suggestions based on students' interests and strengths, and provide practical work experiences through virtual reality, helping students find the career path that best suits them.
[0876] (Application example 1)
[0877] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0878] Traditional career support systems often only offer standard career suggestions without fully understanding the interests and strengths of individual students. Furthermore, they face the challenge of providing students with insufficient information to help them find the career path that best suits them, due to the difficulty of providing actual work experience. Furthermore, they are unable to dynamically update profiles through interactive dialogue, which reduces the accuracy of their suggestions.
[0879] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0880] In this invention, the server includes means for analyzing interests and strengths using generative artificial intelligence, means for providing a virtual experience using virtual reality technology, means for dynamically updating a profile based on responses, means for generating customized career suggestions, and means for providing career suggestions and virtual work experiences using a smartphone. This enables highly accurate career suggestions based on individual students' interests and strengths, and allows students to gain concrete work experience through virtual reality. Furthermore, because profiles are dynamically updated through interactive dialogue, more appropriate career suggestions can be realized.
[0881] Key Word Definitions
[0882] "Generative AI" is an artificial intelligence technology that analyzes individual students' interests and strengths and generates customized career suggestions.
[0883] "Virtual reality technology" is a technology that allows students to virtually experience the proposed careers.
[0884] A "profile" is a database of information about an individual student, including their interests, strengths, grades, and future career aspirations.
[0885] "Dynamic update means" refers to the ability to update student profile information in real time based on the responses and feedback generated.
[0886] "Customized career suggestions" are job listings and career paths that are individually tailored to students based on their interests and strengths.
[0887] A "smartphone" is a mobile communication device used to provide career suggestions and virtual work experiences.
[0888] MODE FOR CARRYING OUT THE INVENTION
[0889] The present invention relates to a system that combines generative artificial intelligence and virtual reality technologies to analyze individual student interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences.
[0890] System configuration
[0891] It includes the following main components:
[0892] 1. Means for analyzing interests and strengths using generative artificial intelligence (server):
[0893] The server utilizes generative artificial intelligence to analyze student input data (e.g., areas of interest, grade level, etc.) to identify the student's interests and strengths.
[0894] 2. Means (devices) for virtually experiencing occupations using virtual reality technology:
[0895] The device uses virtual reality technology to give students a virtual experience of the proposed career, allowing them to wear a VR headset and experience specific job duties.
[0896] 3. Dynamic profile update mechanism (server):
[0897] The server updates the student's profile in real time based on the responses and feedback generated.
[0898] 4. Means for generating customized career proposals (server):
[0899] The server generates customized career suggestions (occupation lists) that best fit the student's interests and strengths based on the dynamically updated profile.
[0900] 5. Means (devices) for providing career suggestions and virtual work experiences using smartphones:
[0901] Students use their smartphones to access and experience the generated career suggestions and VR content.
[0902] Explanation of program processing
[0903] 1. Student registration and initial settings
[0904] When a student first uses the system, the server provides an interface for them to enter basic information about themselves (such as their name, grade, and areas of interest). Once the student enters and submits the information, the server receives the information and stores it in a database, creating a student profile.
[0905] 2. Interacting with AI assistants
[0906] The device displays a chat box that allows for interactive dialogue with the student. The server uses generative artificial intelligence to generate questions to explore the student's interests and strengths and sends them to the device. The student answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the student's profile.
[0907] Examples:
[0908] The server generates the following question and sends it to the device: "Do you like science?"
[0909] The device displays this question to the student, who responds, "Yes, I like it."
[0910] The device sends a response to the server, which stores this information in a database and updates the profile.
[0911] 3. Customized career suggestions
[0912] The server generates customized career suggestions based on the updated profile, which involves creating a list of occupations that best fit the student's interests and strengths through generative artificial intelligence. The created occupation list is then sent to the terminal and presented to the student.
[0913] Examples:
[0914] The server generates a customized list of occupations, such as "scientist," "engineer," or "doctor," and sends it to the device.
[0915] Students check the list of occupations on their terminals and, if they are interested in "scientist," select it.
[0916] 4. Providing VR experiences
[0917] The server prepares virtual reality content related to the selected job and sends it to the device. The student uses a VR headset to experience the virtual job. After the experience, the student enters feedback into the device and it is sent to the server. The server updates the profile again based on this feedback.
[0918] Examples:
[0919] The server prepares the "scientist" job experience content and sends it to the terminal.
[0920] Students wear VR headsets and experience the job duties of a scientist.
[0921] After the experience, students enter their feedback, and the device sends this information to the server.
[0922] The server receives the feedback and updates the student's profile.
[0923] Prompt Sentence Examples
[0924] "Generate career suggestions for students if they are interested in science."
[0925] "This student is interested in science. What career suggestions would be best for him / her?"
[0926] "Create a career proposal for students interested in engineering."
[0927] In this way, the system can provide students with accurate career suggestions based on their interests and strengths, and offer practical work experiences through virtual reality.
[0928] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0929] Program processing steps
[0930] Step 1:
[0931] When a student uses the system for the first time, the server provides an interface for entering basic student information. The user enters information such as name, grade, and areas of interest. The server receives this information and stores it in a database. A student profile is created based on this information.
[0932] Input: Basic information such as name, grade, and interests entered by the user.
[0933] Output: The initial profile data generated by the server.
[0934] How it works: The server stores the information you enter in a database and creates an initial profile.
[0935] Step 2:
[0936] The device displays a chat box for interactive dialogue with the student. The server uses generative artificial intelligence to generate questions to explore the student's interests and strengths and sends them to the device. The user answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the student's profile.
[0937] Input: Questions generated by the generative AI to explore interests and strengths, and the user's answers.
[0938] Output: Updated student profile.
[0939] How it works: The device displays questions, the user answers, and sends the answers to the server, which analyzes them and updates the profile.
[0940] Examples:
[0941] The server generates a question and sends it to the device: "Do you like science?"
[0942] The terminal displays this question and the user responds with "Yes, I like it."
[0943] The device sends the answer to the server, which stores this information in a database, analyzes it, and updates the profile.
[0944] Step 3:
[0945] The server generates customized career suggestions based on the updated profile. Using a generative AI model, it creates a list of occupations that best fit the student's interests and strengths. The created occupation list is sent to the device and presented to the user.
[0946] Input: Updated profile data.
[0947] Output: A customized list of occupations.
[0948] How it works: The server uses a generative AI model based on the profile data to generate a list of occupations and sends it to the device.
[0949] Examples:
[0950] The server generates a list of occupations such as "scientist," "engineer," and "doctor" and sends it to the device.
[0951] The terminal displays a list of occupations and prompts the user to make a selection.
[0952] Step 4:
[0953] The user selects the occupation of interest from a customized occupation list displayed on the terminal, and the selected information is transmitted from the terminal to the server.
[0954] Input: customized occupation list, user selection.
[0955] Output: Selection information sent to the server.
[0956] Operation: The user selects an occupation of interest from the occupation list, and the terminal transmits the selection information to the server.
[0957] Step 5:
[0958] The server prepares virtual reality content related to the selected occupation and sends it to the device. The device uses a VR headset to provide the user with a virtual occupation experience. The user experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the device to the server, and the profile is updated again.
[0959] Input: User's career choice information, virtual reality content.
[0960] Output: Feedback after the experience, updated profile again.
[0961] How it works: The server prepares VR content and sends it to the device. The user experiences the job using a VR headset and enters feedback. The device sends the feedback to the server, which updates the profile.
[0962] Examples:
[0963] The server prepares the "scientist" job experience content and sends it to the terminal.
[0964] The device allows users to wear a VR headset and experience the job duties of a scientist.
[0965] After the experience, the user inputs feedback, which the terminal then sends to the server.
[0966] The server receives the feedback and updates the profile again.
[0967] Through these processing steps, the system can provide individual career suggestions based on students' interests and strengths, and offer concrete work experiences through virtual reality.
[0968] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0969] The present invention relates to a system that combines generative artificial intelligence, virtual reality technology, and an emotion engine to analyze individual students' interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences. The emotion engine also recognizes the student's emotional state and adjusts interactive dialogue and recommendations based on that state.
[0970] System configuration
[0971] The system includes the following major components:
[0972] 1. Generative artificial intelligence (server) for analyzing students' interests and strengths.
[0973] 2. A means (terminal) for providing work experience using virtual reality technology.
[0974] 3. Interface (terminal) for interactive interaction with students.
[0975] 4. A means (server) for dynamically updating student profiles and generating customized career suggestions.
[0976] 5. An emotion engine (server / terminal) that recognizes the student's emotional state and adjusts the dialogue and suggestions based on that state.
[0977] Explanation of program processing
[0978] 1. Student registration and initial settings
[0979] When a student first uses the system, the server provides an interface for them to enter basic information about themselves (such as their name, grade, and areas of interest). Once the student enters and submits the information, the server receives the information and stores it in a database, creating a student profile.
[0980] Examples:
[0981] User (student): Enter your name, grade, and area of interest and submit.
[0982] Server: Receives input information, stores it in a database, and creates a profile.
[0983] 2. Interacting with AI assistants
[0984] The device displays a chat box that allows for interactive dialogue with the student. The server uses generative artificial intelligence to generate questions to explore the student's interests and strengths and sends them to the device. The student answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the student's profile.
[0985] Examples:
[0986] Server: Generates a question (e.g., "Do you like science?") and sends it to the device.
[0987] Device: Shows a question and students respond (e.g., "Yes, I like it").
[0988] User (student): Answers questions.
[0989] Terminal: Sends the answer to the server.
[0990] Server: Receives the response, stores it in the database, and updates the profile.
[0991] 3. Emotion Recognition by Emotion Engine
[0992] The emotion engine recognizes the student's emotional state from facial expressions, vocal tone, and body language. This allows the server to understand the student's emotional state in response to a question and adjust the dialogue and suggestions accordingly. The emotional state data is also reflected in the profile.
[0993] Examples:
[0994] Device: Captures students' facial expressions and voice using a camera and microphone.
[0995] Emotion Engine: Analyzes captured data and recognizes emotional states.
[0996] Server: Adjusts questions and tone of conversation based on emotional state, and reflects emotional data in the profile.
[0997] 4. Customized career suggestions
[0998] The server generates customized career suggestions based on the student's profile. This involves creating a list of occupations that best fit the student's interests and strengths through generative artificial intelligence. The created occupation list is sent to the device and displayed to the student. The student then selects the occupations that interest them, and their selection is sent from the device to the server.
[0999] Examples:
[1000] Server: Generates a customized occupation list (e.g., "scientist," "engineer," "doctor") and sends it to the device.
[1001] Terminal: Display occupation list.
[1002] User (student): Select a profession of interest (e.g., "scientist").
[1003] Device: Sends selection to server.
[1004] 5. Providing VR experiences
[1005] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the student with a virtual occupation experience. The student experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the terminal to the server, and the profile is updated again.
[1006] Examples:
[1007] Server: Prepares VR content and sends it to the device.
[1008] Device: Wear a VR headset to experience virtual jobs.
[1009] User (student): Put on the VR headset and experience it.
[1010] User (student): Enter feedback after the experience.
[1011] Device: Send feedback to the server.
[1012] Server: Receives feedback and updates profile.
[1013] In this way, the system makes personalized career suggestions based on students' interests and strengths, and provides practical work experiences through virtual reality. In addition, the system uses an emotion engine to tailor dialogue and suggestions to students' emotional state, resulting in more effective career education.
[1014] The processing flow will be explained below.
[1015] Step 1:
[1016] The server receives the data from the new user registration form, stores the student's basic information (name, year, interests, etc.) in a database, generates a unique student ID, and initializes the student profile.
[1017] Step 2:
[1018] The terminal provides an interface for students to enter information into a registration form and transmits the entered data to a server.
[1019] Step 3:
[1020] The user (student) enters their name, grade, areas of interest, etc. into the registration form and clicks the "Submit" button.
[1021] Step 4:
[1022] The server analyzes the student's input and generates an initial question using generative artificial intelligence, which is then sent to the device.
[1023] Step 5:
[1024] The terminal provides an interface that displays questions received from the server to the student and transmits the student's answers to the server.
[1025] Step 6:
[1026] The user (student) answers questions displayed on the terminal (e.g., "Do you like science?" to which the student answers "Yes, I do").
[1027] Step 7:
[1028] The server receives the student's answers, stores them in a database, generates the next question, and also updates the student's profile.
[1029] Step 8:
[1030] The device uses a camera and microphone to capture the student's facial expressions and voice and transmits them to the emotion engine.
[1031] Step 9:
[1032] The emotion engine analyzes the captured data and recognizes the student's emotional state, and sends the results to the server.
[1033] Step 10:
[1034] The server adjusts the content of questions and dialogue based on the emotional state data received from the emotion engine, and reflects the emotional state data in the profile.
[1035] Step 11:
[1036] Steps 5 through 10 are repeated until enough data is collected, at which point the server generates customized career suggestions based on the student's profile.
[1037] Step 12:
[1038] The server generates career suggestions and sends a list of relevant occupations (e.g., "scientist," "engineer," "doctor") to the terminal.
[1039] Step 13:
[1040] The terminal provides an interface that displays the received career suggestions to the student and transmits the student's selection to the server.
[1041] Step 14:
[1042] The user (student) reviews the list of suggested occupations and selects the occupation that interests them (e.g., "scientist").
[1043] Step 15:
[1044] The server prepares virtual reality content related to the career selected by the student and transmits it to the terminal.
[1045] Step 16:
[1046] The device guides students through the setup and plays VR content for work experience using a VR headset.
[1047] Step 17:
[1048] The user (student) follows the instructions on the device to put on the VR headset and virtually experience a specific occupation (e.g., conducting experiments in a lab as a scientist).
[1049] Step 18:
[1050] After the VR experience is over, the device displays a feedback form to the student and sends the feedback entered by the student to the server.
[1051] Step 19:
[1052] Users (students) enter their impressions of the VR experience and what they would like to learn next into a feedback form and submit it.
[1053] Step 20:
[1054] The server receives student feedback, stores it in a database, updates student profiles, and analyzes the feedback data to generate next learning resources and career suggestions.
[1055] This concludes the detailed description of the processing steps of the present invention. Through this process, students receive customized career suggestions based on their interests and strengths, and the emotion engine adjusts the dialogue and suggestions according to their emotional state. Additionally, students can experience specific careers using virtual reality.
[1056] Example 2
[1057] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1058] The current career education system has difficulty providing customized career suggestions based on students' individual interests and strengths. Students also have limited opportunities to gain real-world work experience in a virtual environment. Furthermore, the lack of dialogue and adjustment of suggestions that take into account students' emotional state prevents effective career education.
[1059] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for analyzing the interests and strengths of individual students using generative artificial intelligence, means for allowing students to virtually experience suggested careers using virtual reality technology, means for dynamically updating the student's profile based on responses provided via the generative artificial intelligence, means for recognizing the student's emotional state in real time and adjusting the content of dialogue and suggestions based on the emotional state, and means for generating customized career suggestions based on the profile. This makes it possible to provide career suggestions based on the student's individual interests and strengths. It also makes it possible to provide practical career experiences through virtual reality and adjust dialogue and suggestions according to the student's emotional state.
[1060] "Generative AI" refers to advanced AI technology that responds and generates natural language responses based on given data and input.
[1061] "Individual students" refers to specific students who are targeted at each other and whose responses are tailored to their individual profiles and characteristics.
[1062] "Means for analyzing interests and strengths" refers to a function that identifies a student's academic and activity interests and areas of expertise based on data entered by the student and information obtained through dialogue.
[1063] "Virtual reality technology" refers to technology that allows users to experience a virtual environment that is different from the real world using dedicated devices and software.
[1064] "Means for dynamic updates" refers to the function of automatically changing and correcting the profile contents to reflect new information in real time and keep the data up to date.
[1065] "Means for recognizing emotional state in real time" refers to a function that uses sensors such as cameras and microphones to analyze the user's facial expressions and vocal tone, and automatically determine their emotions at that moment.
[1066] "Means for adjusting dialogue content and suggestions" refers to the function of the system appropriately changing the questions and suggestions made to the user based on the recognized emotions and situation.
[1067] "Means for generating customized career suggestions" refers to the functionality that automatically creates optimal occupational and career path suggestions based on individual student profile information, interests, and strengths.
[1068] "Means for virtually experiencing occupations" refers to a function that uses virtual reality technology to allow students to experience occupations that interest them in a simulated format.
[1069] The present invention relates to a system that combines generative artificial intelligence, virtual reality technology, and an emotion engine to analyze individual students' interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences. The emotion engine also recognizes the student's emotional state and adjusts interactive dialogue and recommendations based on that state.
[1070] System configuration
[1071] The system includes the following major components:
[1072] 1. Generative artificial intelligence (server) for analyzing students' interests and strengths.
[1073] 2. A means (terminal) for providing work experience using virtual reality technology.
[1074] 3. Interface (terminal) for interactive interaction with students.
[1075] 4. A means (server) for dynamically updating student profiles and generating customized career suggestions.
[1076] 5. An emotion engine (server / terminal) that recognizes the student's emotional state and adjusts the dialogue and suggestions based on that state.
[1077] Explanation of program processing
[1078] 1. Student registration and initial settings
[1079] When a student uses the system for the first time, the server provides an interface for them to enter basic information (such as name, grade, and areas of interest). The user (student) enters and submits the information according to the instructions. The terminal receives the information and sends it to the server. The server receives the information entered and stores it in a database to create a student profile.
[1080] Examples:
[1081] User (student): Enter your name, grade, and area of interest and submit.
[1082] Server: Receives input information, stores it in a database, and creates a profile.
[1083] 2. Interacting with AI assistants
[1084] The server uses generative artificial intelligence (e.g., GPT-4) to create prompts that generate questions. The generated questions (e.g., "Do you like science?") are sent from the server to the device and displayed to the user. The user enters an answer in the chat box and presses the send button. The device sends the user's answer to the server, which receives the answer and stores it in a database to update the user's profile.
[1085] Examples:
[1086] Server: Generates a question (e.g., "Do you like science?") and sends it to the device.
[1087] Device: Shows a question and students respond (e.g., "Yes, I like it").
[1088] User (student): Answers the question and sends it to the device.
[1089] Server: Receives the answer, stores it in a database, and updates the profile.
[1090] 3. Emotion Recognition by Emotion Engine
[1091] The device uses a camera and microphone to capture the user's (student's) facial expressions and tone of voice. The emotion engine analyzes the captured data in real time and recognizes the user's emotional state. The server adjusts the content of the dialogue and suggestions based on this emotional state, and also reflects the emotional data in the profile.
[1092] Examples:
[1093] Device: Captures the user's facial expressions and voice using a camera and microphone.
[1094] Emotion Engine: Analyzes captured data and recognizes emotional states.
[1095] Server: Adjusts questions and tone of conversation based on emotional state, and reflects emotional data in the profile.
[1096] 4. Customized career suggestions
[1097] The server uses generative artificial intelligence to create a customized career list based on the student's profile. The generated career list is sent to the device and displayed to the user. The user selects the career they are interested in, and the selection is sent from the device to the server. The server prepares to provide further information and experiences based on the selected career.
[1098] Examples:
[1099] Server: Generates a customized occupation list (e.g., "scientist," "engineer," "doctor") and sends it to the device.
[1100] Terminal: Display occupation list.
[1101] User (student): Select the occupation of interest (e.g., "scientist") and send it to the terminal.
[1102] Server: Receives the selected information and prepares the next processing step.
[1103] 5. Providing VR experiences
[1104] The server prepares virtual reality content related to the selected occupation and sends it to the device. The device uses a VR headset to provide the user with a virtual occupation experience. The user experiences the occupation through the experience and inputs their feedback. The feedback is sent from the device to the server, and the server receives the feedback and updates the profile again.
[1105] Examples:
[1106] Server: Prepares VR content and sends it to the device.
[1107] Device: Wearing a VR headset, users are provided with a virtual job experience.
[1108] User (student): Put on the VR headset and experience it.
[1109] User (student): Enters feedback after the experience, and the device sends it to the server.
[1110] Server: Receives feedback and updates profile.
[1111] In this way, the system makes personalized career suggestions based on students' interests and strengths, and provides practical work experiences through virtual reality. Furthermore, by using an emotion engine, the system can tailor dialogue and suggestions to suit the student's emotional state, resulting in more effective career education.
[1112] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1113] Step 1:
[1114] When a student uses the system for the first time, the server provides an interface for entering basic information (such as name, grade, and areas of interest). The terminal displays this interface to the user, who then enters the information as instructed and presses the submit button. The terminal then sends the entered information to the server. The server stores the received information in a database and generates a student profile. The specific input is the student's basic information, and the output is the profile data stored in the database.
[1115] Specific behavior:
[1116] The user enters information into the basic information input form on the device.
[1117] The terminal sends the input information to the server.
[1118] The server receives the input information and stores it in a MySQL database.
[1119] Step 2:
[1120] The server uses generative AI (e.g., GPT-4) to create prompts that generate questions to explore students' interests and strengths. The generated questions are in the form of prompt sentences, which the server sends to the device. The device displays the generated questions to the user. The user enters an answer in the chat box and presses the send button. The device sends the user's answer to the server. The server stores the received answers in a database and updates the profile. The inputs are the prompt sentences for the generative AI and the student's answers, and the outputs are the generated questions and updated profile data.
[1121] Specific behavior:
[1122] The server sends the AI a prompt, "Do you like science?", which generates a question.
[1123] The terminal displays the generated question and the user enters the answer.
[1124] The device sends the user's answers to the server, which stores them in a database and updates the profile.
[1125] Step 3:
[1126] The device uses a camera and microphone to capture the user's facial expressions and voice tone. The emotion engine analyzes the captured data in real time to recognize the user's emotional state. The server then adjusts new questions and dialogue content based on the recognized emotional state. The emotional state data is also reflected in the profile. The input is the video and audio data captured by the camera and microphone, and the output is the recognized emotional state data, corresponding dialogue content, and new profile data.
[1127] Specific behavior:
[1128] The device captures the user's facial expressions and voice using a camera and microphone.
[1129] The emotion engine analyzes the captured data and recognizes the emotional state.
[1130] The server adjusts the questions asked based on the perceived emotional state and updates the profile.
[1131] Step 4:
[1132] The server generates customized career suggestions based on the student's profile. This involves using generative artificial intelligence to create a list of occupations tailored to the student's interests and strengths. The generated occupation list is sent to the terminal and displayed to the user. The user selects occupations of interest, and the selection is sent from the terminal to the server. The input is the updated profile data and the student's occupation selection, and the output is the generated occupation list and the selected occupation data.
[1133] Specific behavior:
[1134] The server sends prompts to the AI based on the student's profile data to generate a list of occupations.
[1135] The terminal displays the generated occupation list, and the user selects an occupation.
[1136] The terminal transmits the selected occupation information to the server, and the server receives it.
[1137] Step 5:
[1138] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the user with a virtual occupation experience. The user experiences the occupation through the experience and inputs their feedback. The terminal sends the feedback to the server, which receives the feedback and updates the profile again. The input is the student's feedback, and the output is the updated profile data.
[1139] Specific behavior:
[1140] The server prepares the VR content and sends it to the device.
[1141] The device streams the content to the VR headset for the user to experience.
[1142] The user inputs feedback after the experience into the terminal, which then transmits it to the server.
[1143] The server receives the feedback and updates the profile.
[1144] (Application example 2)
[1145] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1146] Conventional career suggestion systems do not adequately provide individual career advice tailored to learners' interests and strengths, and it is difficult to provide optimal dialogue and suggestions that take into account the learner's emotional state. Furthermore, because work experience cannot be conducted in virtual reality, the realism and interactivity of actual work experience are lacking. As a result, it is difficult for learners to make appropriate decisions about their career choices.
[1147] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for analyzing the interests and strengths of individual learners using a generative artificial intelligence, means for allowing the learner to virtually experience suggested occupations using virtual reality technology, means for dynamically updating the learner's profile based on responses provided via the generative artificial intelligence, means for generating and displaying customized career suggestions based on the profile, and means for recognizing the learner's emotional state using an emotion engine and adjusting the dialogue and suggestion content based on that state. This makes it possible to provide appropriate career suggestions based on the learner's interests and strengths, and to adjust the dialogue and suggestion content optimally according to the learner's emotional state.
[1148] "Generative AI" is an artificial intelligence technology used to analyze learners' interests and strengths and generate customized career suggestions.
[1149] "Virtual reality technology" is a technology that provides learners with a virtual work experience, and uses devices such as head-mounted displays.
[1150] A "profile" is an individual electronic record that contains data such as a learner's basic information, interests, strengths, and emotional state.
[1151] An "emotion engine" is software that recognizes a learner's emotional state from facial expressions, tone of voice, body language, etc., and adjusts interactive dialogue and suggestions based on that information.
[1152] "Interactive dialogue" refers to real-time, two-way communication between the learner and the system, in which the system responds appropriately based on the learner's answers and actions.
[1153] "Customized career suggestions" are suggestions for occupations and career paths that are best suited to a learner, created individually based on the learner's profile.
[1154] "Work experience" refers to learners virtually experiencing the actual work content and environment of a proposed occupation through virtual reality technology.
[1155] "Server" means a computer system on a network that runs the generative artificial intelligence and emotion engine and manages and updates learner profiles.
[1156] The present invention relates to a system that combines generative artificial intelligence, virtual reality technology, and an emotion engine. The system analyzes learners' interests and strengths, generates customized career suggestions, and provides learners with work experiences using virtual reality. The emotion engine can also recognize the learner's emotional state and adjust interactive dialogues and suggestions based on that state.
[1157] System configuration
[1158] The system includes the following main components:
[1159] 1. Generative AI (server): Analyzes learner interests and strengths.
[1160] 2. Virtual reality technology (terminals): Allows learners to virtually experience the proposed careers.
[1161] 3. Interactive interface (terminal): Interacts with learners in real time.
[1162] 4. Profile update means (server): Dynamically updates the learner's profile.
[1163] 5. Emotion engine (server / terminal): Recognizes the learner's emotional state and adjusts dialogue and suggestions based on that state.
[1164] Program processing
[1165] 1. Learner registration and initial settings
[1166] When a learner uses the system for the first time, the server provides an interface for them to enter basic information about the learner (such as name, grade, and areas of interest). Once the learner enters and submits the information, the server receives this information and stores it in a database. This creates a learner profile.
[1167] 2. Interacting with AI assistants
[1168] The device displays a chat box that allows for interactive dialogue with the learner. The server uses generative artificial intelligence to generate questions to explore the learner's interests and strengths and sends them to the device. The learner answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the learner's profile.
[1169] 3. Emotion Recognition by Emotion Engine
[1170] The emotion engine recognizes the learner's emotional state from facial expressions, vocal tone, and body language. This allows the server to understand the learner's emotional state in response to a question and adjust the dialogue and suggestions accordingly. The emotional state data is also reflected in the profile.
[1171] 4. Customized career suggestions
[1172] The server generates customized career suggestions based on the learner's profile. This involves creating a list of occupations that best fit the learner's interests and strengths through generative artificial intelligence. The created occupation list is sent to the device and displayed to the learner. The learner selects the occupations that interest them, and their selection is sent from the device to the server.
[1173] 5. Providing VR experiences
[1174] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the learner with a virtual occupational experience. The learner experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the terminal to the server, and the profile is updated again.
[1175] Hardware and software used
[1176] Hardware: VR headset, camera, microphone
[1177] Software: Python, OpenCV, Emotion Engine Library, AI Assistant API, VREngine Library
[1178] Examples and prompts
[1179] Specific examples
[1180] Learner registration: A form to enter name, grade, and areas of interest
[1181] Interactive dialogue:
[1182] Question: "Do you like science?"
[1183] Answer: "Yes, I like it."
[1184] Emotion recognition: If you answer "I'm a little anxious," the next question will be presented in a softer tone.
[1185] Career suggestions: Choose the career that interests you from a list of suggested careers (scientist, engineer, doctor)
[1186] VR experience: After experiencing the career of a scientist, the participant wrote in their feedback that they were "very interested in the job."
[1187] Example prompts for generative AI models
[1188] Prompt sentence to input to the generative AI model:
[1189] prompt:
[1190] Enter the learner profile information.
[1191] Name: {name}
[1192] Grade: {grade}
[1193] Interests: {interests}
[1194] Next, imagine how the learner might respond to the AI assistant and what career suggestions might be made based on their responses.
[1195] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1196] Processing Steps
[1197] Step 1:
[1198] When a learner uses the system for the first time, the server provides an interface for them to enter basic information about the learner (such as name, grade, and areas of interest). Once the learner enters and submits the information, the server receives this information and stores it in a database. This creates a learner profile.
[1199] Input: Learner's basic information
[1200] Output: Learner profile stored in a database
[1201] What happens: When a learner enters basic information into a web form and presses the submit button, the server receives the information, creates a profile, and stores it in a database.
[1202] Step 2:
[1203] The device displays a chat box that allows for interactive dialogue with the learner. The server uses generative artificial intelligence to generate questions to explore the learner's interests and strengths and sends them to the device. The learner answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the learner's profile.
[1204] Input: Learner's basic information and answers during the dialogue
[1205] Output: Updated learner profile
[1206] How it works: A question from the AI assistant is displayed in the chat box, and when the learner answers the question, the answer is sent to the server and their profile is updated.
[1207] Step 3:
[1208] The emotion engine recognizes the learner's emotional state from facial expressions, vocal tone, and body language. This allows the server to understand the learner's emotional state in response to a question and adjust the dialogue and suggestions accordingly. The emotional state data is also reflected in the profile.
[1209] Input: Learner's facial expressions, vocal tone, and body language
[1210] Output: Learner's emotional state data
[1211] How it works: The device's camera and microphone capture the learner's facial expressions and voice, and the emotion engine analyzes the data to identify their emotional state and sends it to the server.
[1212] Step 4:
[1213] The server generates customized career suggestions based on the learner's profile. This involves creating a list of occupations that best fit the learner's interests and strengths through generative artificial intelligence. The created occupation list is sent to the device and displayed to the learner. The learner selects the occupations that interest them, and their selection is sent from the device to the server.
[1214] Input: Updated learner profile
[1215] Output: Customized career proposals
[1216] Specific operation: The server analyzes the profile, generates a list of relevant occupations and sends it to the device, the learner selects an occupation, and the selection is sent to the server.
[1217] Step 5:
[1218] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the learner with a virtual occupational experience. The learner experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the terminal to the server, and the profile is updated again.
[1219] Input: The learner's chosen occupation
[1220] Output: Learner feedback
[1221] Specific operation: The server prepares the VR content and sends it to the terminal, and the learner puts on the VR headset to experience the virtual job, and then inputs and sends feedback after completion.
[1222] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1223] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1224] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1225] [Third embodiment]
[1226] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1227] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[1228] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1229] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1230] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1231] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1232] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1233] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1234] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1235] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1236] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1237] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1238] The present invention relates to a system that combines generative artificial intelligence and virtual reality technologies to analyze individual student interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences.
[1239] System configuration
[1240] The system includes the following major components:
[1241] 1. Generative artificial intelligence (server) for analyzing students' interests and strengths.
[1242] 2. A means (terminal) for providing work experience using virtual reality technology.
[1243] 3. Interface (terminal) for interactive interaction with students.
[1244] 4. A means (server) for dynamically updating student profiles and generating customized career suggestions.
[1245] Explanation of program processing
[1246] 1. Student registration and initial settings
[1247] When a student first uses the system, the server provides an interface for them to enter basic information about themselves (such as their name, grade, and areas of interest). Once the student enters and submits the information, the server receives the information and stores it in a database, creating a student profile.
[1248] Examples:
[1249] User (student): Enter your name, grade, and area of interest and submit.
[1250] Server: Receives input information, stores it in a database, and creates a profile.
[1251] 2. Interacting with AI assistants
[1252] The device displays a chat box that allows for interactive dialogue with the student. The server uses generative artificial intelligence to generate questions to explore the student's interests and strengths and sends them to the device. The student answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the student's profile.
[1253] Examples:
[1254] Server: Generates a question (e.g., "Do you like science?") and sends it to the device.
[1255] Device: Shows a question and students respond (e.g., "Yes, I like it").
[1256] User (student): Answers questions.
[1257] Terminal: Sends the answer to the server.
[1258] Server: Receives the response, stores it in the database, and updates the profile.
[1259] 3. Customized career suggestions
[1260] The server generates customized career suggestions based on the student's profile. This involves creating a list of occupations that best fit the student's interests and strengths through generative artificial intelligence. The created occupation list is sent to the device and displayed to the student. The student then selects the occupations that interest them, and their selection is sent from the device to the server.
[1261] Examples:
[1262] Server: Generates a customized occupation list (e.g., "scientist," "engineer," "doctor") and sends it to the device.
[1263] Terminal: Display occupation list.
[1264] User (student): Select a profession of interest (e.g., "scientist").
[1265] Device: Sends selection to server.
[1266] 4. Providing VR experiences
[1267] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the student with a virtual occupation experience. The student experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the terminal to the server, and the profile is updated again.
[1268] Examples:
[1269] Server: Prepares VR content and sends it to the device.
[1270] Device: Wear a VR headset to experience virtual jobs.
[1271] User (student): Put on the VR headset and experience it.
[1272] User (student): Enter feedback after the experience.
[1273] Device: Send feedback to the server.
[1274] Server: Receives feedback and updates profile.
[1275] In this way, the system will provide students with personalized career suggestions based on their interests and strengths, and offer hands-on work experiences through virtual reality, helping them find the career path that's right for them.
[1276] The processing flow will be explained below.
[1277] Step 1:
[1278] The server receives the data from the new user registration form, stores the student's basic information (name, year, interests, etc.) in a database, generates a unique student ID, and initializes the student profile.
[1279] Step 2:
[1280] The terminal provides an interface for students to enter information into a registration form and transmits the entered data to a server.
[1281] Step 3:
[1282] The user (student) enters their name, grade, areas of interest, etc. into the registration form and clicks the "Submit" button.
[1283] Step 4:
[1284] The server analyzes the student's input and generates an initial question using generative artificial intelligence, which is then sent to the device.
[1285] Step 5:
[1286] The terminal provides an interface that displays questions received from the server to the student and transmits the student's answers to the server.
[1287] Step 6:
[1288] The user (student) answers questions displayed on the terminal (e.g., "Do you like science?" to which the student answers "Yes, I do").
[1289] Step 7:
[1290] The server receives the student's answers, stores them in a database, and uses generative artificial intelligence to generate the next question, updating the student's profile.
[1291] Step 8:
[1292] The process from step 5 to step 7 is repeated until enough data is collected and the server generates customized career suggestions based on the student's profile.
[1293] Step 9:
[1294] The server generates career suggestions and sends a list of relevant occupations (e.g., "scientist," "engineer," "doctor") to the terminal.
[1295] Step 10:
[1296] The terminal provides an interface that displays the received career suggestions to the student and transmits the student's selection to the server.
[1297] Step 11:
[1298] The user (student) reviews the list of suggested occupations and selects the occupation that interests them (e.g., "scientist").
[1299] Step 12:
[1300] The server prepares virtual reality content related to the career selected by the student and transmits it to the terminal.
[1301] Step 13:
[1302] The device guides students through the setup and plays VR content for work experience using a VR headset.
[1303] Step 14:
[1304] The user (student) follows the instructions on the device to put on the VR headset and virtually experience a specific occupation (e.g., conducting experiments in a lab as a scientist).
[1305] Step 15:
[1306] After the VR experience is over, the device displays a feedback form to the student and sends the feedback entered by the student to the server.
[1307] Step 16:
[1308] Users (students) enter their impressions of the VR experience and what they would like to learn next into a feedback form and submit it.
[1309] Step 17:
[1310] The server receives student feedback, stores it in a database, and also updates student profiles and generates upcoming learning resources and career suggestions.
[1311] Above is a detailed description of the processing steps of the present invention, which allows students to receive customized career suggestions based on their interests and strengths and experience specific careers through virtual reality.
[1312] Example 1
[1313] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1314] Conventional career guidance systems have difficulty in providing customized suggestions based on individual students' interests and strengths, and there are limited ways for students to experience actual occupations. As a result, students often find it difficult to find the career path that best suits them, and they often feel anxious about their future career choices. In response to this, there is a growing need for a system that allows students to receive specific and practical career suggestions based on their interests and strengths, and that also allows them to virtually experience those occupations using virtual reality technology.
[1315] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1316] In this invention, the server includes means for providing an interface for users to input basic information, means for analyzing the interests and strengths of individual students using generative artificial intelligence, means for generating questions through interactive dialogue and receiving user responses, means for allowing students to virtually experience suggested careers using virtual reality technology, means for providing the generated career suggestions to students and receiving their selections, means for dynamically updating student profiles based on responses provided via the generative artificial intelligence, and means for generating customized career suggestions based on the profiles.
[1317] This allows students to receive personalized career suggestions based on their interests and strengths, and even experience those jobs through virtual reality technology, helping students to reduce their lack of information and anxiety about future career choices and discover the career path that best suits them.
[1318] "Generative AI" is an AI technology that analyzes individual students' interests and strengths and uses them to generate questions and create career suggestions.
[1319] "Virtual reality technology" is a technology that allows students to virtually experience proposed careers, using devices such as virtual reality headsets.
[1320] "Interface" refers to a user interface that allows a user to input basic information and interact with the generating AI.
[1321] A "profile" is a database record for dynamically updating and storing individual information about a student, including their name, grade level, areas of interest, and past interactions.
[1322] "Career suggestions" refers to a list of occupations and specific career path suggestions generated by artificial intelligence based on students' interests and strengths.
[1323] "Career Simulation" is a simulation that uses virtual reality technology to allow students to virtually experience careers that interest them.
[1324] "Interactive dialogue" refers to the process in which generative artificial intelligence interacts with students in real time, generating questions and collecting answers.
[1325] "Dynamic updating" refers to the process of updating existing student profiles in real time based on new information collected via generative artificial intelligence.
[1326] The present invention relates to a system that combines generative artificial intelligence and virtual reality technologies to analyze individual student interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences.
[1327] System configuration
[1328] The system includes the following major components:
[1329] 1. Generative AI (Server): A means to analyze student interests and strengths. Using AI models, it updates student profiles based on input information and dialogue.
[1330] 2. Virtual reality technology (devices): This is a means of providing students with work experience using devices such as virtual reality headsets, allowing them to virtually experience a career that interests them.
[1331] 3. Interface (terminal): A user interface where students can input basic information and interact with the AI assistant.
[1332] 4. Database (server): A means of storing basic information about students, records of interactions, and profile information.
[1333] Explanation of program processing
[1334] Hardware and Software
[1335] The server manages the AI assistant and database, specifically the server on which the generative AI model is installed.
[1336] The terminal is an interactive device such as a tablet or PC, through which students input data and experience VR.
[1337] A VR headset is a device that provides a virtual reality experience. Specifically, commercially available VR devices are available.
[1338] Specific processing flow and operations
[1339] 1. Student registration and initial settings
[1340] The terminal provides an interface for first-time students to enter information such as their name, grade, and areas of interest.
[1341] The user (student) enters this information and presses the send button.
[1342] The terminal transmits the input information to the server.
[1343] The server stores the received information in a database and creates an initial profile.
[1344] 2. Interacting with AI assistants
[1345] The server uses generative artificial intelligence to generate questions to explore students' interests and strengths.
[1346] The server transmits the generated question to the terminal.
[1347] The terminal displays the question in a chat box and students enter their answers.
[1348] The user (student) enters an answer to the question and presses the send button.
[1349] The terminal sends the response to the server.
[1350] The server stores the received answers in a database and updates the student's profile.
[1351] 3. Customized career suggestions
[1352] The server generates customized carrier offers based on the updated profile.
[1353] The server transmits the generated occupation list to the terminal.
[1354] The terminal displays a list of occupations to the student.
[1355] The user (student) selects the occupation of interest and presses the send button.
[1356] The terminal transmits the selected occupation information to the server.
[1357] The server stores the received selection information in a database.
[1358] 4. Providing VR experiences
[1359] The server prepares virtual reality content related to the selected occupation.
[1360] The server transmits the prepared VR content to the terminal.
[1361] The device uses a VR headset to provide students with a virtual work experience.
[1362] Users (students) wear a VR headset and enjoy a virtual reality work experience.
[1363] The user (student) enters their feedback after the experience into the terminal and presses the send button.
[1364] The terminal sends the feedback to the server.
[1365] The server stores the received feedback in a database and updates the profile again.
[1366] Specific examples
[1367] User: Enter the name "Taro Tanaka", grade "2nd year of junior high school", and area of interest "Science" and submit.
[1368] Server: Generates the question "Do you like science?" and sends it to the device.
[1369] Device: Display the question and have the student answer "Yes, I like it."
[1370] User: Answers "Yes, I like it" and submits.
[1371] Server: Stores the received answers in a database and updates the profile.
[1372] Server: Generates a list of occupations (e.g., "scientist," "engineer," "doctor") as career suggestions and sends them to the terminal.
[1373] Terminal: Display a list of occupations and have the student select "scientist."
[1374] User: Select the occupation "Scientist" and submit.
[1375] Server: Prepares VR content and sends it to the device.
[1376] Device: VR headsets are used to provide students with virtual work experience.
[1377] User: Wears a VR headset and experiences the work of a scientist.
[1378] User: Enters and submits feedback after the experience, saying "It was very interesting."
[1379] Server: Receives feedback, stores it in a database and updates the profile.
[1380] Prompt Sentence Examples
[1381] "Design a system that provides students with customized career suggestions based on their interests and strengths, and then offers them a virtual reality experience. First, students enter their basic information, and then interact with an AI to update their profile and display career suggestions. Finally, they are provided with a VR experience, and their profile is updated again based on their feedback."
[1382] In this way, the system will provide students with personalized career suggestions based on their interests and strengths, and offer hands-on work experiences through virtual reality, helping them find the career path that's right for them.
[1383] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1384] System program processing flow
[1385] Step 1:
[1386] The user enters basic information such as name, grade, and areas of interest through the terminal interface and begins pressing the send button.
[1387] Input: Basic information such as name, grade, and areas of interest.
[1388] Data Processing: The server receives the basic information sent and formats it into a database format.
[1389] Output: Formatted student information.
[1390] The server stores the received basic information in a database and creates an initial profile.
[1391] Specific behavior:
[1392] User: Enter "Name", "Grade", and "Area of Interest" and submit.
[1393] Terminal: Sends input information to the server.
[1394] Server: Receives information, stores it in a database, and creates a profile.
[1395] Step 2:
[1396] The server uses generative artificial intelligence to generate questions to explore students' interests and strengths.
[1397] Input: User basic information and profile.
[1398] Data Calculation: Generative AI analyzes the user's interests and strengths based on input information and creates appropriate questions.
[1399] Output: The generated question.
[1400] The server transmits the generated question to the terminal.
[1401] Specific behavior:
[1402] Server: Generates the question "Do you like science?" and sends it to the device.
[1403] Terminal: Display the question to the user.
[1404] Step 3:
[1405] The terminal displays the question in a chat box and the user enters the answer.
[1406] Input: The generated question and the user's answer.
[1407] Data processing: The terminal formats the user's responses and converts them into a format that can be sent to the server.
[1408] Output: The formatted user answers.
[1409] The terminal sends the formatted response to the server.
[1410] Specific behavior:
[1411] User: Answers "Yes, I like it" and submits.
[1412] Terminal: Sends the answer to the server.
[1413] Step 4:
[1414] The server stores the received answers in a database and updates the profile.
[1415] Input: The formatted user answer.
[1416] Data calculation: The server updates the user's profile based on the received response.
[1417] Output: The updated profile.
[1418] The server updates and saves the profile.
[1419] Specific behavior:
[1420] Server: Receives the response, stores it in the database, and updates the profile.
[1421] Step 5:
[1422] The server generates customized carrier offers based on the updated profile.
[1423] Input: The updated profile.
[1424] Data Computation: Generative artificial intelligence is used to generate optimal career suggestions from profile information.
[1425] Output: Generated career suggestions (occupation list).
[1426] The server transmits the generated carrier proposal to the terminal.
[1427] Specific behavior:
[1428] Server: Generates a customized occupation list (e.g., "scientist," "engineer," "doctor") and sends it to the device.
[1429] Terminal: Display a list of occupations to the user.
[1430] Step 6:
[1431] The user selects the occupation of interest and presses the send button.
[1432] Input: Occupation list and selected occupation.
[1433] Data processing: The terminal formats the selected occupation information and sends it to the server.
[1434] Output: Formatted selected occupation information.
[1435] The terminal transmits the selected occupation information to the server.
[1436] Specific behavior:
[1437] User: Selects occupation "Scientist" and submits.
[1438] Terminal: Sends the selected information to the server.
[1439] Step 7:
[1440] The server prepares virtual reality content related to the selected occupation.
[1441] Input: Selected occupational information.
[1442] Data processing: The server prepares appropriate VR content based on the selected information.
[1443] Output: Prepared VR content.
[1444] The server transmits the prepared VR content to the terminal.
[1445] Specific behavior:
[1446] Server: Prepares VR content and sends it to the device.
[1447] Step 8:
[1448] The device uses a VR headset to provide students with a virtual work experience.
[1449] Input: Prepared VR content.
[1450] Output: The VR experience provided to students.
[1451] Users (students) wear a VR headset and enjoy a virtual reality work experience.
[1452] Specific behavior:
[1453] Device: Using a VR headset, it provides a scientist work experience.
[1454] User: Experience VR.
[1455] Step 9:
[1456] The user inputs their feedback after the experience into the terminal and presses the send button.
[1457] Input: Feedback content.
[1458] Data processing: The device formats the feedback and sends it to the server.
[1459] Output: Formatted feedback content.
[1460] The terminal sends the feedback to the server.
[1461] Specific behavior:
[1462] User: Enters feedback saying "Very interesting" and submits.
[1463] Device: Send feedback to the server.
[1464] Step 10:
[1465] The server stores the received feedback in a database and updates the student's profile again.
[1466] Input: Formatted feedback content.
[1467] Data calculation: The server updates the profile based on the feedback.
[1468] Output: The updated profile.
[1469] The server stores the profiles in a database.
[1470] Specific behavior:
[1471] Server: Receives feedback, stores it in a database, and updates the profile.
[1472] In this way, the system works in cooperation with the user, server, and device at each step to provide personalized career suggestions based on students' interests and strengths, and provide practical work experiences through virtual reality, helping students find the career path that best suits them.
[1473] (Application example 1)
[1474] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1475] Traditional career support systems often only offer standard career suggestions without fully understanding the interests and strengths of individual students. Furthermore, they face the challenge of providing students with insufficient information to help them find the career path that best suits them, due to the difficulty of providing actual work experience. Furthermore, they are unable to dynamically update profiles through interactive dialogue, which reduces the accuracy of their suggestions.
[1476] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1477] In this invention, the server includes means for analyzing interests and strengths using generative artificial intelligence, means for providing a virtual experience using virtual reality technology, means for dynamically updating a profile based on responses, means for generating customized career suggestions, and means for providing career suggestions and virtual work experiences using a smartphone. This enables highly accurate career suggestions based on individual students' interests and strengths, and allows students to gain concrete work experience through virtual reality. Furthermore, because profiles are dynamically updated through interactive dialogue, more appropriate career suggestions can be realized.
[1478] Key Word Definitions
[1479] "Generative AI" is an artificial intelligence technology that analyzes individual students' interests and strengths and generates customized career suggestions.
[1480] "Virtual reality technology" is a technology that allows students to virtually experience the proposed careers.
[1481] A "profile" is a database of information about an individual student, including their interests, strengths, grades, and future career aspirations.
[1482] "Dynamic update means" refers to the ability to update student profile information in real time based on the responses and feedback generated.
[1483] "Customized career suggestions" are job listings and career paths that are individually tailored to students based on their interests and strengths.
[1484] A "smartphone" is a mobile communication device used to provide career suggestions and virtual work experiences.
[1485] MODE FOR CARRYING OUT THE INVENTION
[1486] The present invention relates to a system that combines generative artificial intelligence and virtual reality technologies to analyze individual student interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences.
[1487] System configuration
[1488] It includes the following main components:
[1489] 1. Means for analyzing interests and strengths using generative artificial intelligence (server):
[1490] The server utilizes generative artificial intelligence to analyze student input data (e.g., areas of interest, grade level, etc.) to identify the student's interests and strengths.
[1491] 2. Means (devices) for virtually experiencing occupations using virtual reality technology:
[1492] The device uses virtual reality technology to give students a virtual experience of the proposed career, allowing them to wear a VR headset and experience specific job duties.
[1493] 3. Dynamic profile update mechanism (server):
[1494] The server updates the student's profile in real time based on the responses and feedback generated.
[1495] 4. Means for generating customized career proposals (server):
[1496] The server generates customized career suggestions (occupation lists) that best fit the student's interests and strengths based on the dynamically updated profile.
[1497] 5. Means (devices) for providing career suggestions and virtual work experiences using smartphones:
[1498] Students use their smartphones to access and experience the generated career suggestions and VR content.
[1499] Explanation of program processing
[1500] 1. Student registration and initial settings
[1501] When a student first uses the system, the server provides an interface for them to enter basic information about themselves (such as their name, grade, and areas of interest). Once the student enters and submits the information, the server receives the information and stores it in a database, creating a student profile.
[1502] 2. Interacting with AI assistants
[1503] The device displays a chat box that allows for interactive dialogue with the student. The server uses generative artificial intelligence to generate questions to explore the student's interests and strengths and sends them to the device. The student answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the student's profile.
[1504] Examples:
[1505] The server generates the following question and sends it to the device: "Do you like science?"
[1506] The device displays this question to the student, who responds, "Yes, I like it."
[1507] The device sends a response to the server, which stores this information in a database and updates the profile.
[1508] 3. Customized career suggestions
[1509] The server generates customized career suggestions based on the updated profile, which involves creating a list of occupations that best fit the student's interests and strengths through generative artificial intelligence. The created occupation list is then sent to the terminal and presented to the student.
[1510] Examples:
[1511] The server generates a customized list of occupations, such as "scientist," "engineer," or "doctor," and sends it to the device.
[1512] Students check the list of occupations on their terminals and, if they are interested in "scientist," select it.
[1513] 4. Providing VR experiences
[1514] The server prepares virtual reality content related to the selected job and sends it to the device. The student uses a VR headset to experience the virtual job. After the experience, the student enters feedback into the device and it is sent to the server. The server updates the profile again based on this feedback.
[1515] Examples:
[1516] The server prepares the "scientist" job experience content and sends it to the terminal.
[1517] Students wear VR headsets and experience the job duties of a scientist.
[1518] After the experience, students enter their feedback, and the device sends this information to the server.
[1519] The server receives the feedback and updates the student's profile.
[1520] Prompt Sentence Examples
[1521] "Generate career suggestions for students if they are interested in science."
[1522] "This student is interested in science. What career suggestions would be best for him / her?"
[1523] "Create a career proposal for students interested in engineering."
[1524] In this way, the system can provide students with accurate career suggestions based on their interests and strengths, and offer practical work experiences through virtual reality.
[1525] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1526] Program processing steps
[1527] Step 1:
[1528] When a student uses the system for the first time, the server provides an interface for entering basic student information. The user enters information such as name, grade, and areas of interest. The server receives this information and stores it in a database. A student profile is created based on this information.
[1529] Input: Basic information such as name, grade, and interests entered by the user.
[1530] Output: The initial profile data generated by the server.
[1531] How it works: The server stores the information you enter in a database and creates an initial profile.
[1532] Step 2:
[1533] The device displays a chat box for interactive dialogue with the student. The server uses generative artificial intelligence to generate questions to explore the student's interests and strengths and sends them to the device. The user answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the student's profile.
[1534] Input: Questions generated by the generative AI to explore interests and strengths, and the user's answers.
[1535] Output: Updated student profile.
[1536] How it works: The device displays questions, the user answers, and sends the answers to the server, which analyzes them and updates the profile.
[1537] Examples:
[1538] The server generates a question and sends it to the device: "Do you like science?"
[1539] The terminal displays this question and the user responds with "Yes, I like it."
[1540] The device sends the answer to the server, which stores this information in a database, analyzes it, and updates the profile.
[1541] Step 3:
[1542] The server generates customized career suggestions based on the updated profile. Using a generative AI model, it creates a list of occupations that best fit the student's interests and strengths. The created occupation list is sent to the device and presented to the user.
[1543] Input: Updated profile data.
[1544] Output: A customized list of occupations.
[1545] How it works: The server uses a generative AI model based on the profile data to generate a list of occupations and sends it to the device.
[1546] Examples:
[1547] The server generates a list of occupations such as "scientist," "engineer," and "doctor" and sends it to the device.
[1548] The terminal displays a list of occupations and prompts the user to make a selection.
[1549] Step 4:
[1550] The user selects the occupation of interest from a customized occupation list displayed on the terminal, and the selected information is transmitted from the terminal to the server.
[1551] Input: customized occupation list, user selection.
[1552] Output: Selection information sent to the server.
[1553] Operation: The user selects an occupation of interest from the occupation list, and the terminal transmits the selection information to the server.
[1554] Step 5:
[1555] The server prepares virtual reality content related to the selected occupation and sends it to the device. The device uses a VR headset to provide the user with a virtual occupation experience. The user experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the device to the server, and the profile is updated again.
[1556] Input: User's career choice information, virtual reality content.
[1557] Output: Feedback after the experience, updated profile again.
[1558] How it works: The server prepares VR content and sends it to the device. The user experiences the job using a VR headset and enters feedback. The device sends the feedback to the server, which updates the profile.
[1559] Examples:
[1560] The server prepares the "scientist" job experience content and sends it to the terminal.
[1561] The device allows users to wear a VR headset and experience the job duties of a scientist.
[1562] After the experience, the user inputs feedback, which the terminal then sends to the server.
[1563] The server receives the feedback and updates the profile again.
[1564] Through these processing steps, the system can provide individual career suggestions based on students' interests and strengths, and offer concrete work experiences through virtual reality.
[1565] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1566] The present invention relates to a system that combines generative artificial intelligence, virtual reality technology, and an emotion engine to analyze individual students' interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences. The emotion engine also recognizes the student's emotional state and adjusts interactive dialogue and recommendations based on that state.
[1567] System configuration
[1568] The system includes the following major components:
[1569] 1. Generative artificial intelligence (server) for analyzing students' interests and strengths.
[1570] 2. A means (terminal) for providing work experience using virtual reality technology.
[1571] 3. Interface (terminal) for interactive interaction with students.
[1572] 4. A means (server) for dynamically updating student profiles and generating customized career suggestions.
[1573] 5. An emotion engine (server / terminal) that recognizes the student's emotional state and adjusts the dialogue and suggestions based on that state.
[1574] Explanation of program processing
[1575] 1. Student registration and initial settings
[1576] When a student first uses the system, the server provides an interface for them to enter basic information about themselves (such as their name, grade, and areas of interest). Once the student enters and submits the information, the server receives the information and stores it in a database, creating a student profile.
[1577] Examples:
[1578] User (student): Enter your name, grade, and area of interest and submit.
[1579] Server: Receives input information, stores it in a database, and creates a profile.
[1580] 2. Interacting with AI assistants
[1581] The device displays a chat box that allows for interactive dialogue with the student. The server uses generative artificial intelligence to generate questions to explore the student's interests and strengths and sends them to the device. The student answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the student's profile.
[1582] Examples:
[1583] Server: Generates a question (e.g., "Do you like science?") and sends it to the device.
[1584] Device: Shows a question and students respond (e.g., "Yes, I like it").
[1585] User (student): Answers questions.
[1586] Terminal: Sends the answer to the server.
[1587] Server: Receives the response, stores it in the database, and updates the profile.
[1588] 3. Emotion Recognition by Emotion Engine
[1589] The emotion engine recognizes the student's emotional state from facial expressions, vocal tone, and body language. This allows the server to understand the student's emotional state in response to a question and adjust the dialogue and suggestions accordingly. The emotional state data is also reflected in the profile.
[1590] Examples:
[1591] Device: Captures students' facial expressions and voice using a camera and microphone.
[1592] Emotion Engine: Analyzes captured data and recognizes emotional states.
[1593] Server: Adjusts questions and tone of conversation based on emotional state, and reflects emotional data in the profile.
[1594] 4. Customized career suggestions
[1595] The server generates customized career suggestions based on the student's profile. This involves creating a list of occupations that best fit the student's interests and strengths through generative artificial intelligence. The created occupation list is sent to the device and displayed to the student. The student then selects the occupations that interest them, and their selection is sent from the device to the server.
[1596] Examples:
[1597] Server: Generates a customized occupation list (e.g., "scientist," "engineer," "doctor") and sends it to the device.
[1598] Terminal: Display occupation list.
[1599] User (student): Select a profession of interest (e.g., "scientist").
[1600] Device: Sends selection to server.
[1601] 5. Providing VR experiences
[1602] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the student with a virtual occupation experience. The student experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the terminal to the server, and the profile is updated again.
[1603] Examples:
[1604] Server: Prepares VR content and sends it to the device.
[1605] Device: Wear a VR headset to experience virtual jobs.
[1606] User (student): Put on the VR headset and experience it.
[1607] User (student): Enter feedback after the experience.
[1608] Device: Send feedback to the server.
[1609] Server: Receives feedback and updates profile.
[1610] In this way, the system makes personalized career suggestions based on students' interests and strengths, and provides practical work experiences through virtual reality. In addition, the system uses an emotion engine to tailor dialogue and suggestions to students' emotional state, resulting in more effective career education.
[1611] The processing flow will be explained below.
[1612] Step 1:
[1613] The server receives the data from the new user registration form, stores the student's basic information (name, year, interests, etc.) in a database, generates a unique student ID, and initializes the student profile.
[1614] Step 2:
[1615] The terminal provides an interface for students to enter information into a registration form and transmits the entered data to a server.
[1616] Step 3:
[1617] The user (student) enters their name, grade, areas of interest, etc. into the registration form and clicks the "Submit" button.
[1618] Step 4:
[1619] The server analyzes the student's input and generates an initial question using generative artificial intelligence, which is then sent to the device.
[1620] Step 5:
[1621] The terminal provides an interface that displays questions received from the server to the student and transmits the student's answers to the server.
[1622] Step 6:
[1623] The user (student) answers questions displayed on the terminal (e.g., "Do you like science?" to which the student answers "Yes, I do").
[1624] Step 7:
[1625] The server receives the student's answers, stores them in a database, generates the next question, and also updates the student's profile.
[1626] Step 8:
[1627] The device uses a camera and microphone to capture the student's facial expressions and voice and transmits them to the emotion engine.
[1628] Step 9:
[1629] The emotion engine analyzes the captured data and recognizes the student's emotional state, and sends the results to the server.
[1630] Step 10:
[1631] The server adjusts the content of questions and dialogue based on the emotional state data received from the emotion engine, and reflects the emotional state data in the profile.
[1632] Step 11:
[1633] Steps 5 through 10 are repeated until enough data is collected, at which point the server generates customized career suggestions based on the student's profile.
[1634] Step 12:
[1635] The server generates career suggestions and sends a list of relevant occupations (e.g., "scientist," "engineer," "doctor") to the terminal.
[1636] Step 13:
[1637] The terminal provides an interface that displays the received career suggestions to the student and transmits the student's selection to the server.
[1638] Step 14:
[1639] The user (student) reviews the list of suggested occupations and selects the occupation that interests them (e.g., "scientist").
[1640] Step 15:
[1641] The server prepares virtual reality content related to the career selected by the student and transmits it to the terminal.
[1642] Step 16:
[1643] The device guides students through the setup and plays VR content for work experience using a VR headset.
[1644] Step 17:
[1645] The user (student) follows the instructions on the device to put on the VR headset and virtually experience a specific occupation (e.g., conducting experiments in a lab as a scientist).
[1646] Step 18:
[1647] After the VR experience is over, the device displays a feedback form to the student and sends the feedback entered by the student to the server.
[1648] Step 19:
[1649] Users (students) enter their impressions of the VR experience and what they would like to learn next into a feedback form and submit it.
[1650] Step 20:
[1651] The server receives student feedback, stores it in a database, updates student profiles, and analyzes the feedback data to generate next learning resources and career suggestions.
[1652] This concludes the detailed description of the processing steps of the present invention. Through this process, students receive customized career suggestions based on their interests and strengths, and the emotion engine adjusts the dialogue and suggestions according to their emotional state. Additionally, students can experience specific careers using virtual reality.
[1653] Example 2
[1654] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1655] The current career education system has difficulty providing customized career suggestions based on students' individual interests and strengths. Students also have limited opportunities to gain real-world work experience in a virtual environment. Furthermore, the lack of dialogue and adjustment of suggestions that take into account students' emotional state prevents effective career education.
[1656] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for analyzing the interests and strengths of individual students using generative artificial intelligence, means for allowing students to virtually experience suggested careers using virtual reality technology, means for dynamically updating the student's profile based on responses provided via the generative artificial intelligence, means for recognizing the student's emotional state in real time and adjusting the content of dialogue and suggestions based on the emotional state, and means for generating customized career suggestions based on the profile. This makes it possible to provide career suggestions based on the student's individual interests and strengths. It also makes it possible to provide practical career experiences through virtual reality and adjust dialogue and suggestions according to the student's emotional state.
[1657] "Generative AI" refers to advanced AI technology that responds and generates natural language responses based on given data and input.
[1658] "Individual students" refers to specific students who are targeted at each other and whose responses are tailored to their individual profiles and characteristics.
[1659] "Means for analyzing interests and strengths" refers to a function that identifies a student's academic and activity interests and areas of expertise based on data entered by the student and information obtained through dialogue.
[1660] "Virtual reality technology" refers to technology that allows users to experience a virtual environment that is different from the real world using dedicated devices and software.
[1661] "Means for dynamic updates" refers to the function of automatically changing and correcting the profile contents to reflect new information in real time and keep the data up to date.
[1662] "Means for recognizing emotional state in real time" refers to a function that uses sensors such as cameras and microphones to analyze the user's facial expressions and vocal tone, and automatically determine their emotions at that moment.
[1663] "Means for adjusting dialogue content and suggestions" refers to the function of the system appropriately changing the questions and suggestions made to the user based on the recognized emotions and situation.
[1664] "Means for generating customized career suggestions" refers to the functionality that automatically creates optimal occupational and career path suggestions based on individual student profile information, interests, and strengths.
[1665] "Means for virtually experiencing occupations" refers to a function that uses virtual reality technology to allow students to experience occupations that interest them in a simulated format.
[1666] The present invention relates to a system that combines generative artificial intelligence, virtual reality technology, and an emotion engine to analyze individual students' interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences. The emotion engine also recognizes the student's emotional state and adjusts interactive dialogue and recommendations based on that state.
[1667] System configuration
[1668] The system includes the following major components:
[1669] 1. Generative artificial intelligence (server) for analyzing students' interests and strengths.
[1670] 2. A means (terminal) for providing work experience using virtual reality technology.
[1671] 3. Interface (terminal) for interactive interaction with students.
[1672] 4. A means (server) for dynamically updating student profiles and generating customized career suggestions.
[1673] 5. An emotion engine (server / terminal) that recognizes the student's emotional state and adjusts the dialogue and suggestions based on that state.
[1674] Explanation of program processing
[1675] 1. Student registration and initial settings
[1676] When a student uses the system for the first time, the server provides an interface for them to enter basic information (such as name, grade, and areas of interest). The user (student) enters and submits the information according to the instructions. The terminal receives the information and sends it to the server. The server receives the information entered and stores it in a database to create a student profile.
[1677] Examples:
[1678] User (student): Enter your name, grade, and area of interest and submit.
[1679] Server: Receives input information, stores it in a database, and creates a profile.
[1680] 2. Interacting with AI assistants
[1681] The server uses generative artificial intelligence (e.g., GPT-4) to create prompts that generate questions. The generated questions (e.g., "Do you like science?") are sent from the server to the device and displayed to the user. The user enters an answer in the chat box and presses the send button. The device sends the user's answer to the server, which receives the answer and stores it in a database to update the user's profile.
[1682] Examples:
[1683] Server: Generates a question (e.g., "Do you like science?") and sends it to the device.
[1684] Device: Shows a question and students respond (e.g., "Yes, I like it").
[1685] User (student): Answers the question and sends it to the device.
[1686] Server: Receives the answer, stores it in a database, and updates the profile.
[1687] 3. Emotion Recognition by Emotion Engine
[1688] The device uses a camera and microphone to capture the user's (student's) facial expressions and tone of voice. The emotion engine analyzes the captured data in real time and recognizes the user's emotional state. The server adjusts the content of the dialogue and suggestions based on this emotional state, and also reflects the emotional data in the profile.
[1689] Examples:
[1690] Device: Captures the user's facial expressions and voice using a camera and microphone.
[1691] Emotion Engine: Analyzes captured data and recognizes emotional states.
[1692] Server: Adjusts questions and tone of conversation based on emotional state, and reflects emotional data in the profile.
[1693] 4. Customized career suggestions
[1694] The server uses generative artificial intelligence to create a customized career list based on the student's profile. The generated career list is sent to the device and displayed to the user. The user selects the career they are interested in, and the selection is sent from the device to the server. The server prepares to provide further information and experiences based on the selected career.
[1695] Examples:
[1696] Server: Generates a customized occupation list (e.g., "scientist," "engineer," "doctor") and sends it to the device.
[1697] Terminal: Display occupation list.
[1698] User (student): Select the occupation of interest (e.g., "scientist") and send it to the terminal.
[1699] Server: Receives the selected information and prepares the next processing step.
[1700] 5. Providing VR experiences
[1701] The server prepares virtual reality content related to the selected occupation and sends it to the device. The device uses a VR headset to provide the user with a virtual occupation experience. The user experiences the occupation through the experience and inputs their feedback. The feedback is sent from the device to the server, and the server receives the feedback and updates the profile again.
[1702] Examples:
[1703] Server: Prepares VR content and sends it to the device.
[1704] Device: Wearing a VR headset, users are provided with a virtual job experience.
[1705] User (student): Put on the VR headset and experience it.
[1706] User (student): Enters feedback after the experience, and the device sends it to the server.
[1707] Server: Receives feedback and updates profile.
[1708] In this way, the system makes personalized career suggestions based on students' interests and strengths, and provides practical work experiences through virtual reality. Furthermore, by using an emotion engine, the system can tailor dialogue and suggestions to suit the student's emotional state, resulting in more effective career education.
[1709] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1710] Step 1:
[1711] When a student uses the system for the first time, the server provides an interface for entering basic information (such as name, grade, and areas of interest). The terminal displays this interface to the user, who then enters the information as instructed and presses the submit button. The terminal then sends the entered information to the server. The server stores the received information in a database and generates a student profile. The specific input is the student's basic information, and the output is the profile data stored in the database.
[1712] Specific behavior:
[1713] The user enters information into the basic information input form on the device.
[1714] The terminal sends the input information to the server.
[1715] The server receives the input information and stores it in a MySQL database.
[1716] Step 2:
[1717] The server uses generative AI (e.g., GPT-4) to create prompts that generate questions to explore students' interests and strengths. The generated questions are in the form of prompt sentences, which the server sends to the device. The device displays the generated questions to the user. The user enters an answer in the chat box and presses the send button. The device sends the user's answer to the server. The server stores the received answers in a database and updates the profile. The inputs are the prompt sentences for the generative AI and the student's answers, and the outputs are the generated questions and updated profile data.
[1718] Specific behavior:
[1719] The server sends the AI a prompt, "Do you like science?", which generates a question.
[1720] The terminal displays the generated question and the user enters the answer.
[1721] The device sends the user's answers to the server, which stores them in a database and updates the profile.
[1722] Step 3:
[1723] The device uses a camera and microphone to capture the user's facial expressions and voice tone. The emotion engine analyzes the captured data in real time to recognize the user's emotional state. The server then adjusts new questions and dialogue content based on the recognized emotional state. The emotional state data is also reflected in the profile. The input is the video and audio data captured by the camera and microphone, and the output is the recognized emotional state data, corresponding dialogue content, and new profile data.
[1724] Specific behavior:
[1725] The device captures the user's facial expressions and voice using a camera and microphone.
[1726] The emotion engine analyzes the captured data and recognizes the emotional state.
[1727] The server adjusts the questions asked based on the perceived emotional state and updates the profile.
[1728] Step 4:
[1729] The server generates customized career suggestions based on the student's profile. This involves using generative artificial intelligence to create a list of occupations tailored to the student's interests and strengths. The generated occupation list is sent to the terminal and displayed to the user. The user selects occupations of interest, and the selection is sent from the terminal to the server. The input is the updated profile data and the student's occupation selection, and the output is the generated occupation list and the selected occupation data.
[1730] Specific behavior:
[1731] The server sends prompts to the AI based on the student's profile data to generate a list of occupations.
[1732] The terminal displays the generated occupation list, and the user selects an occupation.
[1733] The terminal transmits the selected occupation information to the server, and the server receives it.
[1734] Step 5:
[1735] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the user with a virtual occupation experience. The user experiences the occupation through the experience and inputs their feedback. The terminal sends the feedback to the server, which receives the feedback and updates the profile again. The input is the student's feedback, and the output is the updated profile data.
[1736] Specific behavior:
[1737] The server prepares the VR content and sends it to the device.
[1738] The device streams the content to the VR headset for the user to experience.
[1739] The user inputs feedback after the experience into the terminal, which then transmits it to the server.
[1740] The server receives the feedback and updates the profile.
[1741] (Application example 2)
[1742] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1743] Conventional career suggestion systems do not adequately provide individual career advice tailored to learners' interests and strengths, and it is difficult to provide optimal dialogue and suggestions that take into account the learner's emotional state. Furthermore, because work experience cannot be conducted in virtual reality, the realism and interactivity of actual work experience are lacking. As a result, it is difficult for learners to make appropriate decisions about their career choices.
[1744] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for analyzing the interests and strengths of individual learners using a generative artificial intelligence, means for allowing the learner to virtually experience suggested occupations using virtual reality technology, means for dynamically updating the learner's profile based on responses provided via the generative artificial intelligence, means for generating and displaying customized career suggestions based on the profile, and means for recognizing the learner's emotional state using an emotion engine and adjusting the dialogue and suggestion content based on that state. This makes it possible to provide appropriate career suggestions based on the learner's interests and strengths, and to adjust the dialogue and suggestion content optimally according to the learner's emotional state.
[1745] "Generative AI" is an artificial intelligence technology used to analyze learners' interests and strengths and generate customized career suggestions.
[1746] "Virtual reality technology" is a technology that provides learners with a virtual work experience, and uses devices such as head-mounted displays.
[1747] A "profile" is an individual electronic record that contains data such as a learner's basic information, interests, strengths, and emotional state.
[1748] An "emotion engine" is software that recognizes a learner's emotional state from facial expressions, tone of voice, body language, etc., and adjusts interactive dialogue and suggestions based on that information.
[1749] "Interactive dialogue" refers to real-time, two-way communication between the learner and the system, in which the system responds appropriately based on the learner's answers and actions.
[1750] "Customized career suggestions" are suggestions for occupations and career paths that are best suited to a learner, created individually based on the learner's profile.
[1751] "Work experience" refers to learners virtually experiencing the actual work content and environment of a proposed occupation through virtual reality technology.
[1752] "Server" means a computer system on a network that runs the generative artificial intelligence and emotion engine and manages and updates learner profiles.
[1753] The present invention relates to a system that combines generative artificial intelligence, virtual reality technology, and an emotion engine. The system analyzes learners' interests and strengths, generates customized career suggestions, and provides learners with work experiences using virtual reality. The emotion engine can also recognize the learner's emotional state and adjust interactive dialogues and suggestions based on that state.
[1754] System configuration
[1755] The system includes the following main components:
[1756] 1. Generative AI (server): Analyzes learner interests and strengths.
[1757] 2. Virtual reality technology (terminals): Allows learners to virtually experience the proposed careers.
[1758] 3. Interactive interface (terminal): Interacts with learners in real time.
[1759] 4. Profile update means (server): Dynamically updates the learner's profile.
[1760] 5. Emotion engine (server / terminal): Recognizes the learner's emotional state and adjusts dialogue and suggestions based on that state.
[1761] Program processing
[1762] 1. Learner registration and initial settings
[1763] When a learner uses the system for the first time, the server provides an interface for them to enter basic information about the learner (such as name, grade, and areas of interest). Once the learner enters and submits the information, the server receives this information and stores it in a database. This creates a learner profile.
[1764] 2. Interacting with AI assistants
[1765] The device displays a chat box that allows for interactive dialogue with the learner. The server uses generative artificial intelligence to generate questions to explore the learner's interests and strengths and sends them to the device. The learner answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the learner's profile.
[1766] 3. Emotion Recognition by Emotion Engine
[1767] The emotion engine recognizes the learner's emotional state from facial expressions, vocal tone, and body language. This allows the server to understand the learner's emotional state in response to a question and adjust the dialogue and suggestions accordingly. The emotional state data is also reflected in the profile.
[1768] 4. Customized career suggestions
[1769] The server generates customized career suggestions based on the learner's profile. This involves creating a list of occupations that best fit the learner's interests and strengths through generative artificial intelligence. The created occupation list is sent to the device and displayed to the learner. The learner selects the occupations that interest them, and their selection is sent from the device to the server.
[1770] 5. Providing VR experiences
[1771] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the learner with a virtual occupational experience. The learner experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the terminal to the server, and the profile is updated again.
[1772] Hardware and software used
[1773] Hardware: VR headset, camera, microphone
[1774] Software: Python, OpenCV, Emotion Engine Library, AI Assistant API, VREngine Library
[1775] Examples and prompts
[1776] Specific examples
[1777] Learner registration: A form to enter name, grade, and areas of interest
[1778] Interactive dialogue:
[1779] Question: "Do you like science?"
[1780] Answer: "Yes, I like it."
[1781] Emotion recognition: If you answer "I'm a little anxious," the next question will be presented in a softer tone.
[1782] Career suggestions: Choose the career that interests you from a list of suggested careers (scientist, engineer, doctor)
[1783] VR experience: After experiencing the career of a scientist, the participant wrote in their feedback that they were "very interested in the job."
[1784] Example prompts for generative AI models
[1785] Prompt sentence to input to the generative AI model:
[1786] prompt:
[1787] Enter the learner profile information.
[1788] Name: {name}
[1789] Grade: {grade}
[1790] Interests: {interests}
[1791] Next, imagine how the learner might respond to the AI assistant and what career suggestions might be made based on their responses.
[1792] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1793] Processing Steps
[1794] Step 1:
[1795] When a learner uses the system for the first time, the server provides an interface for them to enter basic information about the learner (such as name, grade, and areas of interest). Once the learner enters and submits the information, the server receives this information and stores it in a database. This creates a learner profile.
[1796] Input: Learner's basic information
[1797] Output: Learner profile stored in a database
[1798] What happens: When a learner enters basic information into a web form and presses the submit button, the server receives the information, creates a profile, and stores it in a database.
[1799] Step 2:
[1800] The device displays a chat box that allows for interactive dialogue with the learner. The server uses generative artificial intelligence to generate questions to explore the learner's interests and strengths and sends them to the device. The learner answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the learner's profile.
[1801] Input: Learner's basic information and answers during the dialogue
[1802] Output: Updated learner profile
[1803] How it works: A question from the AI assistant is displayed in the chat box, and when the learner answers the question, the answer is sent to the server and their profile is updated.
[1804] Step 3:
[1805] The emotion engine recognizes the learner's emotional state from facial expressions, vocal tone, and body language. This allows the server to understand the learner's emotional state in response to a question and adjust the dialogue and suggestions accordingly. The emotional state data is also reflected in the profile.
[1806] Input: Learner's facial expressions, vocal tone, and body language
[1807] Output: Learner's emotional state data
[1808] How it works: The device's camera and microphone capture the learner's facial expressions and voice, and the emotion engine analyzes the data to identify their emotional state and sends it to the server.
[1809] Step 4:
[1810] The server generates customized career suggestions based on the learner's profile. This involves creating a list of occupations that best fit the learner's interests and strengths through generative artificial intelligence. The created occupation list is sent to the device and displayed to the learner. The learner selects the occupations that interest them, and their selection is sent from the device to the server.
[1811] Input: Updated learner profile
[1812] Output: Customized career proposals
[1813] Specific operation: The server analyzes the profile, generates a list of relevant occupations and sends it to the device, the learner selects an occupation, and the selection is sent to the server.
[1814] Step 5:
[1815] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the learner with a virtual occupational experience. The learner experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the terminal to the server, and the profile is updated again.
[1816] Input: The learner's chosen occupation
[1817] Output: Learner feedback
[1818] Specific operation: The server prepares the VR content and sends it to the terminal, and the learner puts on the VR headset to experience the virtual job, and then inputs and sends feedback after completion.
[1819] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1820] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1821] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1822] [Fourth embodiment]
[1823] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1824] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1825] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1826] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1827] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1828] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1829] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1830] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1831] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1832] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1833] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1834] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1835] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1836] The present invention relates to a system that combines generative artificial intelligence and virtual reality technologies to analyze individual student interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences.
[1837] System configuration
[1838] The system includes the following major components:
[1839] 1. Generative artificial intelligence (server) for analyzing students' interests and strengths.
[1840] 2. A means (terminal) for providing work experience using virtual reality technology.
[1841] 3. Interface (terminal) for interactive interaction with students.
[1842] 4. A means (server) for dynamically updating student profiles and generating customized career suggestions.
[1843] Explanation of program processing
[1844] 1. Student registration and initial settings
[1845] When a student first uses the system, the server provides an interface for them to enter basic information about themselves (such as their name, grade, and areas of interest). Once the student enters and submits the information, the server receives the information and stores it in a database, creating a student profile.
[1846] Examples:
[1847] User (student): Enter your name, grade, and area of interest and submit.
[1848] Server: Receives input information, stores it in a database, and creates a profile.
[1849] 2. Interacting with AI assistants
[1850] The device displays a chat box that allows for interactive dialogue with the student. The server uses generative artificial intelligence to generate questions to explore the student's interests and strengths and sends them to the device. The student answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the student's profile.
[1851] Examples:
[1852] Server: Generates a question (e.g., "Do you like science?") and sends it to the device.
[1853] Device: Shows a question and students respond (e.g., "Yes, I like it").
[1854] User (student): Answers questions.
[1855] Terminal: Sends the answer to the server.
[1856] Server: Receives the response, stores it in the database, and updates the profile.
[1857] 3. Customized career suggestions
[1858] The server generates customized career suggestions based on the student's profile. This involves creating a list of occupations that best fit the student's interests and strengths through generative artificial intelligence. The created occupation list is sent to the device and displayed to the student. The student then selects the occupations that interest them, and their selection is sent from the device to the server.
[1859] Examples:
[1860] Server: Generates a customized occupation list (e.g., "scientist," "engineer," "doctor") and sends it to the device.
[1861] Terminal: Display occupation list.
[1862] User (student): Select a profession of interest (e.g., "scientist").
[1863] Device: Sends selection to server.
[1864] 4. Providing VR experiences
[1865] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the student with a virtual occupation experience. The student experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the terminal to the server, and the profile is updated again.
[1866] Examples:
[1867] Server: Prepares VR content and sends it to the device.
[1868] Device: Wear a VR headset to experience virtual jobs.
[1869] User (student): Put on the VR headset and experience it.
[1870] User (student): Enter feedback after the experience.
[1871] Device: Send feedback to the server.
[1872] Server: Receives feedback and updates profile.
[1873] In this way, the system will provide students with personalized career suggestions based on their interests and strengths, and offer hands-on work experiences through virtual reality, helping them find the career path that's right for them.
[1874] The processing flow will be explained below.
[1875] Step 1:
[1876] The server receives the data from the new user registration form, stores the student's basic information (name, year, interests, etc.) in a database, generates a unique student ID, and initializes the student profile.
[1877] Step 2:
[1878] The terminal provides an interface for students to enter information into a registration form and transmits the entered data to a server.
[1879] Step 3:
[1880] The user (student) enters their name, grade, areas of interest, etc. into the registration form and clicks the "Submit" button.
[1881] Step 4:
[1882] The server analyzes the student's input and generates an initial question using generative artificial intelligence, which is then sent to the device.
[1883] Step 5:
[1884] The terminal provides an interface that displays questions received from the server to the student and transmits the student's answers to the server.
[1885] Step 6:
[1886] The user (student) answers questions displayed on the terminal (e.g., "Do you like science?" to which the student answers "Yes, I do").
[1887] Step 7:
[1888] The server receives the student's answers, stores them in a database, and uses generative artificial intelligence to generate the next question, updating the student's profile.
[1889] Step 8:
[1890] The process from step 5 to step 7 is repeated until enough data is collected and the server generates customized career suggestions based on the student's profile.
[1891] Step 9:
[1892] The server generates career suggestions and sends a list of relevant occupations (e.g., "scientist," "engineer," "doctor") to the terminal.
[1893] Step 10:
[1894] The terminal provides an interface that displays the received career suggestions to the student and transmits the student's selection to the server.
[1895] Step 11:
[1896] The user (student) reviews the list of suggested occupations and selects the occupation that interests them (e.g., "scientist").
[1897] Step 12:
[1898] The server prepares virtual reality content related to the career selected by the student and transmits it to the terminal.
[1899] Step 13:
[1900] The device guides students through the setup and plays VR content for work experience using a VR headset.
[1901] Step 14:
[1902] The user (student) follows the instructions on the device to put on the VR headset and virtually experience a specific occupation (e.g., conducting experiments in a lab as a scientist).
[1903] Step 15:
[1904] After the VR experience is over, the device displays a feedback form to the student and sends the feedback entered by the student to the server.
[1905] Step 16:
[1906] Users (students) enter their impressions of the VR experience and what they would like to learn next into a feedback form and submit it.
[1907] Step 17:
[1908] The server receives student feedback, stores it in a database, and also updates student profiles and generates upcoming learning resources and career suggestions.
[1909] Above is a detailed description of the processing steps of the present invention, which allows students to receive customized career suggestions based on their interests and strengths and experience specific careers through virtual reality.
[1910] Example 1
[1911] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1912] Conventional career guidance systems have difficulty in providing customized suggestions based on individual students' interests and strengths, and there are limited ways for students to experience actual occupations. As a result, students often find it difficult to find the career path that best suits them, and they often feel anxious about their future career choices. In response to this, there is a growing need for a system that allows students to receive specific and practical career suggestions based on their interests and strengths, and that also allows them to virtually experience those occupations using virtual reality technology.
[1913] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1914] In this invention, the server includes means for providing an interface for users to input basic information, means for analyzing the interests and strengths of individual students using generative artificial intelligence, means for generating questions through interactive dialogue and receiving user responses, means for allowing students to virtually experience suggested careers using virtual reality technology, means for providing the generated career suggestions to students and receiving their selections, means for dynamically updating student profiles based on responses provided via the generative artificial intelligence, and means for generating customized career suggestions based on the profiles.
[1915] This allows students to receive personalized career suggestions based on their interests and strengths, and even experience those jobs through virtual reality technology, helping students to reduce their lack of information and anxiety about future career choices and discover the career path that best suits them.
[1916] "Generative AI" is an AI technology that analyzes individual students' interests and strengths and uses them to generate questions and create career suggestions.
[1917] "Virtual reality technology" is a technology that allows students to virtually experience proposed careers, using devices such as virtual reality headsets.
[1918] "Interface" refers to a user interface that allows a user to input basic information and interact with the generating AI.
[1919] A "profile" is a database record for dynamically updating and storing individual information about a student, including their name, grade level, areas of interest, and past interactions.
[1920] "Career suggestions" refers to a list of occupations and specific career path suggestions generated by artificial intelligence based on students' interests and strengths.
[1921] "Career Simulation" is a simulation that uses virtual reality technology to allow students to virtually experience careers that interest them.
[1922] "Interactive dialogue" refers to the process in which generative artificial intelligence interacts with students in real time, generating questions and collecting answers.
[1923] "Dynamic updating" refers to the process of updating existing student profiles in real time based on new information collected via generative artificial intelligence.
[1924] The present invention relates to a system that combines generative artificial intelligence and virtual reality technologies to analyze individual student interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences.
[1925] System configuration
[1926] The system includes the following major components:
[1927] 1. Generative AI (Server): A means to analyze student interests and strengths. Using AI models, it updates student profiles based on input information and dialogue.
[1928] 2. Virtual reality technology (devices): This is a means of providing students with work experience using devices such as virtual reality headsets, allowing them to virtually experience a career that interests them.
[1929] 3. Interface (terminal): A user interface where students can input basic information and interact with the AI assistant.
[1930] 4. Database (server): A means of storing basic information about students, records of interactions, and profile information.
[1931] Explanation of program processing
[1932] Hardware and Software
[1933] The server manages the AI assistant and database, specifically the server on which the generative AI model is installed.
[1934] The terminal is an interactive device such as a tablet or PC, through which students input data and experience VR.
[1935] A VR headset is a device that provides a virtual reality experience. Specifically, commercially available VR devices are available.
[1936] Specific processing flow and operations
[1937] 1. Student registration and initial settings
[1938] The terminal provides an interface for first-time students to enter information such as their name, grade, and areas of interest.
[1939] The user (student) enters this information and presses the send button.
[1940] The terminal transmits the input information to the server.
[1941] The server stores the received information in a database and creates an initial profile.
[1942] 2. Interacting with AI assistants
[1943] The server uses generative artificial intelligence to generate questions to explore students' interests and strengths.
[1944] The server transmits the generated question to the terminal.
[1945] The terminal displays the question in a chat box and students enter their answers.
[1946] The user (student) enters an answer to the question and presses the send button.
[1947] The terminal sends the response to the server.
[1948] The server stores the received answers in a database and updates the student's profile.
[1949] 3. Customized career suggestions
[1950] The server generates customized carrier offers based on the updated profile.
[1951] The server transmits the generated occupation list to the terminal.
[1952] The terminal displays a list of occupations to the student.
[1953] The user (student) selects the occupation of interest and presses the send button.
[1954] The terminal transmits the selected occupation information to the server.
[1955] The server stores the received selection information in a database.
[1956] 4. Providing VR experiences
[1957] The server prepares virtual reality content related to the selected occupation.
[1958] The server transmits the prepared VR content to the terminal.
[1959] The device uses a VR headset to provide students with a virtual work experience.
[1960] Users (students) wear a VR headset and enjoy a virtual reality work experience.
[1961] The user (student) enters their feedback after the experience into the terminal and presses the send button.
[1962] The terminal sends the feedback to the server.
[1963] The server stores the received feedback in a database and updates the profile again.
[1964] Specific examples
[1965] User: Enter the name "Taro Tanaka", grade "2nd year of junior high school", and area of interest "Science" and submit.
[1966] Server: Generates the question "Do you like science?" and sends it to the device.
[1967] Device: Display the question and have the student answer "Yes, I like it."
[1968] User: Answers "Yes, I like it" and submits.
[1969] Server: Stores the received answers in a database and updates the profile.
[1970] Server: Generates a list of occupations (e.g., "scientist," "engineer," "doctor") as career suggestions and sends them to the terminal.
[1971] Terminal: Display a list of occupations and have the student select "scientist."
[1972] User: Select the occupation "Scientist" and submit.
[1973] Server: Prepares VR content and sends it to the device.
[1974] Device: VR headsets are used to provide students with virtual work experience.
[1975] User: Wears a VR headset and experiences the work of a scientist.
[1976] User: Enters and submits feedback after the experience, saying "It was very interesting."
[1977] Server: Receives feedback, stores it in a database and updates the profile.
[1978] Prompt Sentence Examples
[1979] "Design a system that provides students with customized career suggestions based on their interests and strengths, and then offers them a virtual reality experience. First, students enter their basic information, and then interact with an AI to update their profile and display career suggestions. Finally, they are provided with a VR experience, and their profile is updated again based on their feedback."
[1980] In this way, the system will provide students with personalized career suggestions based on their interests and strengths, and offer hands-on work experiences through virtual reality, helping them find the career path that's right for them.
[1981] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1982] System program processing flow
[1983] Step 1:
[1984] The user enters basic information such as name, grade, and areas of interest through the terminal interface and begins pressing the send button.
[1985] Input: Basic information such as name, grade, and areas of interest.
[1986] Data Processing: The server receives the basic information sent and formats it into a database format.
[1987] Output: Formatted student information.
[1988] The server stores the received basic information in a database and creates an initial profile.
[1989] Specific behavior:
[1990] User: Enter "Name", "Grade", and "Area of Interest" and submit.
[1991] Terminal: Sends input information to the server.
[1992] Server: Receives information, stores it in a database, and creates a profile.
[1993] Step 2:
[1994] The server uses generative artificial intelligence to generate questions to explore students' interests and strengths.
[1995] Input: User basic information and profile.
[1996] Data Calculation: Generative AI analyzes the user's interests and strengths based on input information and creates appropriate questions.
[1997] Output: The generated question.
[1998] The server transmits the generated question to the terminal.
[1999] Specific behavior:
[2000] Server: Generates the question "Do you like science?" and sends it to the device.
[2001] Terminal: Display the question to the user.
[2002] Step 3:
[2003] The terminal displays the question in a chat box and the user enters the answer.
[2004] Input: The generated question and the user's answer.
[2005] Data processing: The terminal formats the user's responses and converts them into a format that can be sent to the server.
[2006] Output: The formatted user answers.
[2007] The terminal sends the formatted response to the server.
[2008] Specific behavior:
[2009] User: Answers "Yes, I like it" and submits.
[2010] Terminal: Sends the answer to the server.
[2011] Step 4:
[2012] The server stores the received answers in a database and updates the profile.
[2013] Input: The formatted user answer.
[2014] Data calculation: The server updates the user's profile based on the received response.
[2015] Output: The updated profile.
[2016] The server updates and saves the profile.
[2017] Specific behavior:
[2018] Server: Receives the response, stores it in the database, and updates the profile.
[2019] Step 5:
[2020] The server generates customized carrier offers based on the updated profile.
[2021] Input: The updated profile.
[2022] Data Computation: Generative artificial intelligence is used to generate optimal career suggestions from profile information.
[2023] Output: Generated career suggestions (occupation list).
[2024] The server transmits the generated carrier proposal to the terminal.
[2025] Specific behavior:
[2026] Server: Generates a customized occupation list (e.g., "scientist," "engineer," "doctor") and sends it to the device.
[2027] Terminal: Display a list of occupations to the user.
[2028] Step 6:
[2029] The user selects the occupation of interest and presses the send button.
[2030] Input: Occupation list and selected occupation.
[2031] Data processing: The terminal formats the selected occupation information and sends it to the server.
[2032] Output: Formatted selected occupation information.
[2033] The terminal transmits the selected occupation information to the server.
[2034] Specific behavior:
[2035] User: Selects occupation "Scientist" and submits.
[2036] Terminal: Sends the selected information to the server.
[2037] Step 7:
[2038] The server prepares virtual reality content related to the selected occupation.
[2039] Input: Selected occupational information.
[2040] Data processing: The server prepares appropriate VR content based on the selected information.
[2041] Output: Prepared VR content.
[2042] The server transmits the prepared VR content to the terminal.
[2043] Specific behavior:
[2044] Server: Prepares VR content and sends it to the device.
[2045] Step 8:
[2046] The device uses a VR headset to provide students with a virtual work experience.
[2047] Input: Prepared VR content.
[2048] Output: The VR experience provided to students.
[2049] Users (students) wear a VR headset and enjoy a virtual reality work experience.
[2050] Specific behavior:
[2051] Device: Using a VR headset, it provides a scientist work experience.
[2052] User: Experience VR.
[2053] Step 9:
[2054] The user inputs their feedback after the experience into the terminal and presses the send button.
[2055] Input: Feedback content.
[2056] Data processing: The device formats the feedback and sends it to the server.
[2057] Output: Formatted feedback content.
[2058] The terminal sends the feedback to the server.
[2059] Specific behavior:
[2060] User: Enters feedback saying "Very interesting" and submits.
[2061] Device: Send feedback to the server.
[2062] Step 10:
[2063] The server stores the received feedback in a database and updates the student's profile again.
[2064] Input: Formatted feedback content.
[2065] Data calculation: The server updates the profile based on the feedback.
[2066] Output: The updated profile.
[2067] The server stores the profiles in a database.
[2068] Specific behavior:
[2069] Server: Receives feedback, stores it in a database, and updates the profile.
[2070] In this way, the system works in cooperation with the user, server, and device at each step to provide personalized career suggestions based on students' interests and strengths, and provide practical work experiences through virtual reality, helping students find the career path that best suits them.
[2071] (Application example 1)
[2072] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2073] Traditional career support systems often only offer standard career suggestions without fully understanding the interests and strengths of individual students. Furthermore, they face the challenge of providing students with insufficient information to help them find the career path that best suits them, due to the difficulty of providing actual work experience. Furthermore, they are unable to dynamically update profiles through interactive dialogue, which reduces the accuracy of their suggestions.
[2074] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[2075] In this invention, the server includes means for analyzing interests and strengths using generative artificial intelligence, means for providing a virtual experience using virtual reality technology, means for dynamically updating a profile based on responses, means for generating customized career suggestions, and means for providing career suggestions and virtual work experiences using a smartphone. This enables highly accurate career suggestions based on individual students' interests and strengths, and allows students to gain concrete work experience through virtual reality. Furthermore, because profiles are dynamically updated through interactive dialogue, more appropriate career suggestions can be realized.
[2076] Key Word Definitions
[2077] "Generative AI" is an artificial intelligence technology that analyzes individual students' interests and strengths and generates customized career suggestions.
[2078] "Virtual reality technology" is a technology that allows students to virtually experience the proposed careers.
[2079] A "profile" is a database of information about an individual student, including their interests, strengths, grades, and future career aspirations.
[2080] "Dynamic update means" refers to the ability to update student profile information in real time based on the responses and feedback generated.
[2081] "Customized career suggestions" are job listings and career paths that are individually tailored to students based on their interests and strengths.
[2082] A "smartphone" is a mobile communication device used to provide career suggestions and virtual work experiences.
[2083] MODE FOR CARRYING OUT THE INVENTION
[2084] The present invention relates to a system that combines generative artificial intelligence and virtual reality technologies to analyze individual student interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences.
[2085] System configuration
[2086] It includes the following main components:
[2087] 1. Means for analyzing interests and strengths using generative artificial intelligence (server):
[2088] The server utilizes generative artificial intelligence to analyze student input data (e.g., areas of interest, grade level, etc.) to identify the student's interests and strengths.
[2089] 2. Means (devices) for virtually experiencing occupations using virtual reality technology:
[2090] The device uses virtual reality technology to give students a virtual experience of the proposed career, allowing them to wear a VR headset and experience specific job duties.
[2091] 3. Dynamic profile update mechanism (server):
[2092] The server updates the student's profile in real time based on the responses and feedback generated.
[2093] 4. Means for generating customized career proposals (server):
[2094] The server generates customized career suggestions (occupation lists) that best fit the student's interests and strengths based on the dynamically updated profile.
[2095] 5. Means (devices) for providing career suggestions and virtual work experiences using smartphones:
[2096] Students use their smartphones to access and experience the generated career suggestions and VR content.
[2097] Explanation of program processing
[2098] 1. Student registration and initial settings
[2099] When a student first uses the system, the server provides an interface for them to enter basic information about themselves (such as their name, grade, and areas of interest). Once the student enters and submits the information, the server receives the information and stores it in a database, creating a student profile.
[2100] 2. Interacting with AI assistants
[2101] The device displays a chat box that allows for interactive dialogue with the student. The server uses generative artificial intelligence to generate questions to explore the student's interests and strengths and sends them to the device. The student answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the student's profile.
[2102] Examples:
[2103] The server generates the following question and sends it to the device: "Do you like science?"
[2104] The device displays this question to the student, who responds, "Yes, I like it."
[2105] The device sends a response to the server, which stores this information in a database and updates the profile.
[2106] 3. Customized career suggestions
[2107] The server generates customized career suggestions based on the updated profile, which involves creating a list of occupations that best fit the student's interests and strengths through generative artificial intelligence. The created occupation list is then sent to the terminal and presented to the student.
[2108] Examples:
[2109] The server generates a customized list of occupations, such as "scientist," "engineer," or "doctor," and sends it to the device.
[2110] Students check the list of occupations on their terminals and, if they are interested in "scientist," select it.
[2111] 4. Providing VR experiences
[2112] The server prepares virtual reality content related to the selected job and sends it to the device. The student uses a VR headset to experience the virtual job. After the experience, the student enters feedback into the device and it is sent to the server. The server updates the profile again based on this feedback.
[2113] Examples:
[2114] The server prepares the "scientist" job experience content and sends it to the terminal.
[2115] Students wear VR headsets and experience the job duties of a scientist.
[2116] After the experience, students enter their feedback, and the device sends this information to the server.
[2117] The server receives the feedback and updates the student's profile.
[2118] Prompt Sentence Examples
[2119] "Generate career suggestions for students if they are interested in science."
[2120] "This student is interested in science. What career suggestions would be best for him / her?"
[2121] "Create a career proposal for students interested in engineering."
[2122] In this way, the system can provide students with accurate career suggestions based on their interests and strengths, and offer practical work experiences through virtual reality.
[2123] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[2124] Program processing steps
[2125] Step 1:
[2126] When a student uses the system for the first time, the server provides an interface for entering basic student information. The user enters information such as name, grade, and areas of interest. The server receives this information and stores it in a database. A student profile is created based on this information.
[2127] Input: Basic information such as name, grade, and interests entered by the user.
[2128] Output: The initial profile data generated by the server.
[2129] How it works: The server stores the information you enter in a database and creates an initial profile.
[2130] Step 2:
[2131] The device displays a chat box for interactive dialogue with the student. The server uses generative artificial intelligence to generate questions to explore the student's interests and strengths and sends them to the device. The user answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the student's profile.
[2132] Input: Questions generated by the generative AI to explore interests and strengths, and the user's answers.
[2133] Output: Updated student profile.
[2134] How it works: The device displays questions, the user answers, and sends the answers to the server, which analyzes them and updates the profile.
[2135] Examples:
[2136] The server generates a question and sends it to the device: "Do you like science?"
[2137] The terminal displays this question and the user responds with "Yes, I like it."
[2138] The device sends the answer to the server, which stores this information in a database, analyzes it, and updates the profile.
[2139] Step 3:
[2140] The server generates customized career suggestions based on the updated profile. Using a generative AI model, it creates a list of occupations that best fit the student's interests and strengths. The created occupation list is sent to the device and presented to the user.
[2141] Input: Updated profile data.
[2142] Output: A customized list of occupations.
[2143] How it works: The server uses a generative AI model based on the profile data to generate a list of occupations and sends it to the device.
[2144] Examples:
[2145] The server generates a list of occupations such as "scientist," "engineer," and "doctor" and sends it to the device.
[2146] The terminal displays a list of occupations and prompts the user to make a selection.
[2147] Step 4:
[2148] The user selects the occupation of interest from a customized occupation list displayed on the terminal, and the selected information is transmitted from the terminal to the server.
[2149] Input: customized occupation list, user selection.
[2150] Output: Selection information sent to the server.
[2151] Operation: The user selects an occupation of interest from the occupation list, and the terminal transmits the selection information to the server.
[2152] Step 5:
[2153] The server prepares virtual reality content related to the selected occupation and sends it to the device. The device uses a VR headset to provide the user with a virtual occupation experience. The user experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the device to the server, and the profile is updated again.
[2154] Input: User's career choice information, virtual reality content.
[2155] Output: Feedback after the experience, updated profile again.
[2156] How it works: The server prepares VR content and sends it to the device. The user experiences the job using a VR headset and enters feedback. The device sends the feedback to the server, which updates the profile.
[2157] Examples:
[2158] The server prepares the "scientist" job experience content and sends it to the terminal.
[2159] The device allows users to wear a VR headset and experience the job duties of a scientist.
[2160] After the experience, the user inputs feedback, which the terminal then sends to the server.
[2161] The server receives the feedback and updates the profile again.
[2162] Through these processing steps, the system can provide individual career suggestions based on students' interests and strengths, and offer concrete work experiences through virtual reality.
[2163] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[2164] The present invention relates to a system that combines generative artificial intelligence, virtual reality technology, and an emotion engine to analyze individual students' interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences. The emotion engine also recognizes the student's emotional state and adjusts interactive dialogue and recommendations based on that state.
[2165] System configuration
[2166] The system includes the following major components:
[2167] 1. Generative artificial intelligence (server) for analyzing students' interests and strengths.
[2168] 2. A means (terminal) for providing work experience using virtual reality technology.
[2169] 3. Interface (terminal) for interactive interaction with students.
[2170] 4. A means (server) for dynamically updating student profiles and generating customized career suggestions.
[2171] 5. An emotion engine (server / terminal) that recognizes the student's emotional state and adjusts the dialogue and suggestions based on that state.
[2172] Explanation of program processing
[2173] 1. Student registration and initial settings
[2174] When a student first uses the system, the server provides an interface for them to enter basic information about themselves (such as their name, grade, and areas of interest). Once the student enters and submits the information, the server receives the information and stores it in a database, creating a student profile.
[2175] Examples:
[2176] User (student): Enter your name, grade, and area of interest and submit.
[2177] Server: Receives input information, stores it in a database, and creates a profile.
[2178] 2. Interacting with AI assistants
[2179] The device displays a chat box that allows for interactive dialogue with the student. The server uses generative artificial intelligence to generate questions to explore the student's interests and strengths and sends them to the device. The student answers the questions, and the answers are sent from the device to the server and stored in a database. The server analyzes this information and updates the student's profile.
[2180] Examples:
[2181] Server: Generates a question (e.g., "Do you like science?") and sends it to the device.
[2182] Device: Shows a question and students respond (e.g., "Yes, I like it").
[2183] User (student): Answers questions.
[2184] Terminal: Sends the answer to the server.
[2185] Server: Receives the response, stores it in the database, and updates the profile.
[2186] 3. Emotion Recognition by Emotion Engine
[2187] The emotion engine recognizes the student's emotional state from facial expressions, vocal tone, and body language. This allows the server to understand the student's emotional state in response to a question and adjust the dialogue and suggestions accordingly. The emotional state data is also reflected in the profile.
[2188] Examples:
[2189] Device: Captures students' facial expressions and voice using a camera and microphone.
[2190] Emotion Engine: Analyzes captured data and recognizes emotional states.
[2191] Server: Adjusts questions and tone of conversation based on emotional state, and reflects emotional data in the profile.
[2192] 4. Customized career suggestions
[2193] The server generates customized career suggestions based on the student's profile. This involves creating a list of occupations that best fit the student's interests and strengths through generative artificial intelligence. The created occupation list is sent to the device and displayed to the student. The student then selects the occupations that interest them, and their selection is sent from the device to the server.
[2194] Examples:
[2195] Server: Generates a customized occupation list (e.g., "scientist," "engineer," "doctor") and sends it to the device.
[2196] Terminal: Display occupation list.
[2197] User (student): Select a profession of interest (e.g., "scientist").
[2198] Device: Sends selection to server.
[2199] 5. Providing VR experiences
[2200] The server prepares virtual reality content related to the selected occupation and sends it to the terminal. The terminal uses a VR headset to provide the student with a virtual occupation experience. The student experiences the proposed occupation through virtual reality and inputs the results as feedback. The feedback is sent from the terminal to the server, and the profile is updated again.
[2201] Examples:
[2202] Server: Prepares VR content and sends it to the device.
[2203] Device: Wear a VR headset to experience virtual jobs.
[2204] User (student): Put on the VR headset and experience it.
[2205] User (student): Enter feedback after the experience.
[2206] Device: Send feedback to the server.
[2207] Server: Receives feedback and updates profile.
[2208] In this way, the system makes personalized career suggestions based on students' interests and strengths, and provides practical work experiences through virtual reality. In addition, the system uses an emotion engine to tailor dialogue and suggestions to students' emotional state, resulting in more effective career education.
[2209] The processing flow will be explained below.
[2210] Step 1:
[2211] The server receives the data from the new user registration form, stores the student's basic information (name, year, interests, etc.) in a database, generates a unique student ID, and initializes the student profile.
[2212] Step 2:
[2213] The terminal provides an interface for students to enter information into a registration form and transmits the entered data to a server.
[2214] Step 3:
[2215] The user (student) enters their name, grade, areas of interest, etc. into the registration form and clicks the "Submit" button.
[2216] Step 4:
[2217] The server analyzes the student's input and generates an initial question using generative artificial intelligence, which is then sent to the device.
[2218] Step 5:
[2219] The terminal provides an interface that displays questions received from the server to the student and transmits the student's answers to the server.
[2220] Step 6:
[2221] The user (student) answers questions displayed on the terminal (e.g., "Do you like science?" to which the student answers "Yes, I do").
[2222] Step 7:
[2223] The server receives the student's answers, stores them in a database, generates the next question, and also updates the student's profile.
[2224] Step 8:
[2225] The device uses a camera and microphone to capture the student's facial expressions and voice and transmits them to the emotion engine.
[2226] Step 9:
[2227] The emotion engine analyzes the captured data and recognizes the student's emotional state, and sends the results to the server.
[2228] Step 10:
[2229] The server adjusts the content of questions and dialogue based on the emotional state data received from the emotion engine, and reflects the emotional state data in the profile.
[2230] Step 11:
[2231] Steps 5 through 10 are repeated until enough data is collected, at which point the server generates customized career suggestions based on the student's profile.
[2232] Step 12:
[2233] The server generates career suggestions and sends a list of relevant occupations (e.g., "scientist," "engineer," "doctor") to the terminal.
[2234] Step 13:
[2235] The terminal provides an interface that displays the received career suggestions to the student and transmits the student's selection to the server.
[2236] Step 14:
[2237] The user (student) reviews the list of suggested occupations and selects the occupation that interests them (e.g., "scientist").
[2238] Step 15:
[2239] The server prepares virtual reality content related to the career selected by the student and transmits it to the terminal.
[2240] Step 16:
[2241] The device guides students through the setup and plays VR content for work experience using a VR headset.
[2242] Step 17:
[2243] The user (student) follows the instructions on the device to put on the VR headset and virtually experience a specific occupation (e.g., conducting experiments in a lab as a scientist).
[2244] Step 18:
[2245] After the VR experience is over, the device displays a feedback form to the student and sends the feedback entered by the student to the server.
[2246] Step 19:
[2247] Users (students) enter their impressions of the VR experience and what they would like to learn next into a feedback form and submit it.
[2248] Step 20:
[2249] The server receives student feedback, stores it in a database, updates student profiles, and analyzes the feedback data to generate next learning resources and career suggestions.
[2250] This concludes the detailed description of the processing steps of the present invention. Through this process, students receive customized career suggestions based on their interests and strengths, and the emotion engine adjusts the dialogue and suggestions according to their emotional state. Additionally, students can experience specific careers using virtual reality.
[2251] Example 2
[2252] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2253] The current career education system has difficulty providing customized career suggestions based on students' individual interests and strengths. Students also have limited opportunities to gain real-world work experience in a virtual environment. Furthermore, the lack of dialogue and adjustment of suggestions that take into account students' emotional state prevents effective career education.
[2254] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for analyzing the interests and strengths of individual students using generative artificial intelligence, means for allowing students to virtually experience suggested careers using virtual reality technology, means for dynamically updating the student's profile based on responses provided via the generative artificial intelligence, means for recognizing the student's emotional state in real time and adjusting the content of dialogue and suggestions based on the emotional state, and means for generating customized career suggestions based on the profile. This makes it possible to provide career suggestions based on the student's individual interests and strengths. It also makes it possible to provide practical career experiences through virtual reality and adjust dialogue and suggestions according to the student's emotional state.
[2255] "Generative AI" refers to advanced AI technology that responds and generates natural language responses based on given data and input.
[2256] "Individual students" refers to specific students who are targeted at each other and whose responses are tailored to their individual profiles and characteristics.
[2257] "Means for analyzing interests and strengths" refers to a function that identifies a student's academic and activity interests and areas of expertise based on data entered by the student and information obtained through dialogue.
[2258] "Virtual reality technology" refers to technology that allows users to experience a virtual environment that is different from the real world using dedicated devices and software.
[2259] "Means for dynamic updates" refers to the function of automatically changing and correcting the profile contents to reflect new information in real time and keep the data up to date.
[2260] "Means for recognizing emotional state in real time" refers to a function that uses sensors such as cameras and microphones to analyze the user's facial expressions and vocal tone, and automatically determine their emotions at that moment.
[2261] "Means for adjusting dialogue content and suggestions" refers to the function of the system appropriately changing the questions and suggestions made to the user based on the recognized emotions and situation.
[2262] "Means for generating customized career suggestions" refers to the functionality that automatically creates optimal occupational and career path suggestions based on individual student profile information, interests, and strengths.
[2263] "Means for virtually experiencing occupations" refers to a function that uses virtual reality technology to allow students to experience occupations that interest them in a simulated format.
[2264] The present invention relates to a system that combines generative artificial intelligence, virtual reality technology, and an emotion engine to analyze individual students' interests and strengths and provide customized career recommendations. The system dynamically updates student profiles, generates career recommendations based on that information, and uses virtual reality to provide students with work experiences. The emotion engine also recognizes the student's emotional state and adjusts interactive dialogue and recommendations based on that state.
[2265] System configuration
[2266] The system includes the following major components:
[2267] 1. Generative artificial intelligence (server) for analyzing students' interests and strengths.
[2268] 2. A means (terminal) for providing work experience using virtual reality technology.
[2269] 3. Interface (terminal) for interactive interaction with students.
[2270] 4. A means (server) for dynamically updating student profiles and generating customized career suggestions.
[2271] 5. An emotion engine (server / terminal) that recognizes the student's emotional state and adjusts the dialogue and suggestions based on that state.
[2272] Explanation of program processing
[2273] 1. Student registration and initial settings
[2274] When a student uses the system for the first time, the server provides an interface for them to enter basic information (such as name, grade, and areas of interest). The user (student) enters and submits the information according to the instructions. The terminal receives the information and sends it to the server. The server receives the information entered and stores it in a database to create a student profile.
[2275] Examples:
[2276] User (student): Enter your name, grade, and area of interest and submit.
[2277] Server: Receives input information, stores it in a database, and creates a profile.
[2278] 2. Interacting with AI assistants
[2279] The server uses generative artificial intelligence (e.g., GPT-4) to create prompts that generate questions. The generated questions (e.g., "Do you like science?") are sent from the server to the device and displayed...
Claims
1. a means of analyzing individual student interests and strengths using generative artificial intelligence; a means of using virtual reality technology to allow students to virtually experience the proposed career; means for dynamically updating a student profile based on responses provided via said generative artificial intelligence; means for generating customized career offers based on said profile; A system including:
2. 10. The system of claim 1, wherein the generative artificial intelligence gathers information through interactive dialogue with the student and updates the student's profile.
3. The system of claim 1 , wherein the virtual reality technology provides a simulation for virtually experiencing a plurality of different occupations.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A