system

Abstract

Provide a system. A means for receiving and authenticating input information from a user; a means for delivering a training program through a virtual reality device; A means of tracking and evaluating user behavior in real time, a means for generating nutritional management and meal plans for users; a means for collecting and analyzing user progress data; A way to provide users with feedback to keep them motivated; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional training programs and diet guidance systems have difficulty responding flexibly to individual needs and progress, and are often short-lived. Furthermore, users' behavior and diet management often relies on self-reporting, making it difficult to provide effective feedback. This can lead to users losing motivation, and as a result, they are unable to achieve results from their training or diet. [Means for solving the problem]

[0005] The present invention provides a system that includes a means for receiving and authenticating input information from a user, a means for providing a training program through a virtual reality device, a means for tracking and evaluating the user's movements in real time, a means for generating a nutritional management and meal plan for the user, a means for collecting and analyzing the user's progress data, and a means for providing the user with feedback to maintain motivation. This system enables optimal training and dietary advice tailored to the user's individual needs, and by continuously managing and evaluating the user's progress, effective feedback and maintenance of motivation are achieved.

[0006] "User" refers to an individual who receives training and dietary guidance services using a virtual reality device.

[0007] "Input information" refers to the authentication information and profile information that a user provides to the system.

[0008] "Means of authentication" refers to a function for verifying the legitimacy of a user based on input information received from the user.

[0009] A "virtual reality device" refers to a device that can provide a virtual reality space that a user can wear and experience.

[0010] "Training Program" means the plan and instructions for exercise or physical activity that a User performs through a virtual reality device.

[0011] "Tracking means" refers to functions that detect and record user movements and actions in real time.

[0012] "Means for evaluation" refers to the function for analyzing data obtained by the tracking means and providing appropriate feedback.

[0013] "Nutrition management" refers to managing the nutritional balance based on the user's diet and providing optimal dietary advice.

[0014] "Meal Plan" means a meal plan suggested based on a User's health status and goals.

[0015] "Progress Data" refers to various data that shows the progress of a user's training and nutrition management.

[0016] "Means of collection" refers to the functionality for collecting user progress data.

[0017] "Means for analysis" refers to the functionality for analyzing collected progress data and assessing the user's situation.

[0018] "Feedback" refers to providing users with evaluations and advice regarding their training and diet.

[0019] "System" refers to the integrated hardware and software designed to consistently support a User's training and nutritional management. [Brief explanation of the drawings]

[0020] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6]FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0021] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0022] First, the terms used in the following description will be explained.

[0023] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0024] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0025] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0026] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0027] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0028] [First embodiment]

[0029] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0030] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0031] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0032] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0033] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0034] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0035] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0036] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0037] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0038] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0039] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0040] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0041] The present invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide personalized training and dietary advice. The system includes user authentication, training session execution, dietary advice and planning, progress tracking and analysis, motivation and notifications, subscription management and purchasing support.

[0042] User authentication and profile management

[0043] The user puts on the VR headset and accesses the login screen. The user enters their username and password. The device sends this authentication information to the server. The server checks the user's authentication information in the database and generates an authentication token if successful. If authentication is successful, the server returns a welcome message along with the authentication token to the device, which is then displayed.

[0044] As a specific example, when a user opens an application, enters their login information and presses the submit button, authentication takes place within a few seconds and a message appears informing them that they can proceed to the next screen.

[0045] Running a training session

[0046] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by generative AI based on the user's profile and goals. The device then displays the session content based on this. The user's movements are captured by a camera and sent to the server in real time. The AI ​​on the server analyzes this, evaluates their form and progress, and sends and displays instructions and corrections to the device in real time.

[0047] For example, if a user's posture is poor while doing squats, the AI ​​will immediately detect this and provide audio and visual instructions such as "Bend your knees a little more."

[0048] Providing dietary advice and planning

[0049] When users submit dietary questions via their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device. Related recipes and links to purchase ingredients are also displayed. This allows users to continue eating healthy without having to worry about choosing ingredients or cooking methods.

[0050] For example, if a user asks, "What would be good for dinner tonight?" the server will suggest "grilled salmon and vegetables" based on the user's profile and display the necessary ingredients and recipe.

[0051] Progress Tracking and Analysis

[0052] Users enter their daily weight and dietary information on their device. The server collects this data and analyzes their progress. Weekly and monthly reports are generated and displayed on the device in the form of visual graphs and charts. This allows users to understand their progress and stay motivated to reach their next goal.

[0053] For example, a user can enter their weight, the server will record it, and at the end of the week a graphical progress report will be displayed on the device.

[0054] Motivation and notifications

[0055] The server generates appropriate motivational messages and reminders based on the user's progress data and sends them to the device, helping the user to stay motivated.

[0056] For example, if a user reaches 50% of their goal, a message such as "You're halfway there, keep trying!" will appear on the device.

[0057] Subscription management and purchasing support

[0058] Users can check their subscription information or send requests to change their plan from their device. The server processes the requests and returns the updated information to the device. It also generates promotional information for special diet foods and training equipment and sends it to the device. Users can then review the information and complete the purchase process.

[0059] For example, if a user wants to upgrade to a premium plan, they send a request from their device, the server processes it, and notifies them of the change in subscription fee.

[0060] Through these features, the present invention provides users with comprehensive, personalized training and nutritional advice to help maintain and improve their long-term health.

[0061] The processing flow will be explained below.

[0062] User authentication and profile management

[0063] Step 1:

[0064] The user puts on the VR headset and the login screen appears.

[0065] Step 2:

[0066] The user enters a username and password.

[0067] Step 3:

[0068] The terminal transmits the entered authentication information to the server.

[0069] Step 4:

[0070] The server checks the user's credentials against a database and generates an authentication token on success.

[0071] Step 5:

[0072] The server returns an authentication token to the device.

[0073] Step 6:

[0074] The device receives the authentication token and displays a message indicating successful login.

[0075] Running a training session

[0076] Step 1:

[0077] The user launches a dedicated application to begin a training session.

[0078] Step 2:

[0079] The device retrieves the latest training menu from the server.

[0080] Step 3:

[0081] The device displays the training menu to the user and starts the session.

[0082] Step 4:

[0083] The device captures the user's movements with a camera and transmits the data to a server in real time.

[0084] Step 5:

[0085] AI on the server analyzes the captured data and evaluates the form and progress of the movements.

[0086] Step 6:

[0087] The server sends the evaluation results and feedback to the device.

[0088] Step 7:

[0089] The device displays feedback to the user in real time.

[0090] Providing dietary advice and planning

[0091] Step 1:

[0092] The user inputs and submits questions about meals via the terminal.

[0093] Step 2:

[0094] The server generates an appropriate meal plan based on the user's profile and current goals.

[0095] Step 3:

[0096] The server sends the generated meal plan to the device.

[0097] Step 4:

[0098] The device will display the meal plan to the user and provide links to recipes and ingredients.

[0099] Progress Tracking and Analysis

[0100] Step 1:

[0101] Users enter their daily weight and dietary information on the device.

[0102] Step 2:

[0103] The terminal transmits the input data to the server.

[0104] Step 3:

[0105] The progress is analyzed based on the data collected by the server.

[0106] Step 4:

[0107] The server generates weekly and monthly reports.

[0108] Step 5:

[0109] The device displays the generated reports to the user in the form of visual graphs and charts.

[0110] Motivation and notifications

[0111] Step 1:

[0112] The server generates appropriate motivational messages based on the user's progress data.

[0113] Step 2:

[0114] The server generates a message and sends it to the terminal.

[0115] Step 3:

[0116] The device displays messages to the user to encourage them to maintain their motivation.

[0117] Subscription management and purchasing support

[0118] Step 1:

[0119] The user interacts with their device to check their subscription status.

[0120] Step 2:

[0121] The device requests subscription information from the server.

[0122] Step 3:

[0123] The server checks the user's subscription status and sends that information back to the device.

[0124] Step 4:

[0125] The device displays the subscription status to the user.

[0126] Step 5:

[0127] The server generates promotional information for special diet foods and training equipment and transmits it to the terminal.

[0128] Step 6:

[0129] The device displays promotional information to the user and assists them in the purchase process.

[0130] In this way, through each step of the process, users can efficiently receive authentication, training, dietary guidance, progress management, motivation maintenance, as well as subscription management and purchasing support.

[0131] Example 1

[0132] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0133] There is a lack of a means for virtual reality training systems to allow users to receive individually supervised training and nutritional guidance at home. There is also a need for a function that evaluates users' movements in real time and provides appropriate feedback. Furthermore, there is a need to collect and analyze progress data and provide visual feedback that allows users to effectively self-manage. There is a need to provide a system that solves these issues and helps users maintain motivation and improve their long-term health.

[0134] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0135] In this invention, the server includes means for receiving and authenticating input information from a user, means for providing a training program through a virtual reality device, means for tracking the user's movements and evaluating them in real time, means for generating a nutritional management and meal plan for the user, means for collecting and analyzing the user's progress data, means for providing the user with feedback to maintain motivation, means for receiving dietary questions from the user and generating and presenting a meal plan using a generation AI, and means for capturing the user's training movements in real time and having the generation AI evaluate and provide feedback. This allows the user to receive individually managed training and dietary advice at home, train while receiving feedback in real time, and improve their long-term health while visually understanding their progress.

[0136] (1) "Information entered by the user" refers to all information provided by the user to the system, such as login information, questions, training data, and dietary data.

[0137] (2) "Authentication" refers to the process of verifying a user's identity based on the login information provided by the user.

[0138] (3) "Virtual reality device" means a device worn by a user that allows the user to access a virtual space and receive training or other instruction.

[0139] (4) "Training Program" means a plan for teaching a user a series of movements or exercises that are customized based on the user's needs and goals.

[0140] (5) “Tracking” refers to recording a user’s performance, such as their physical movements and posture.

[0141] (6) "Real-time evaluation" refers to the process of instantly analyzing user behavior data and generating evaluation results.

[0142] (7) “Nutrition management” refers to managing the user’s dietary content and nutritional intake status.

[0143] (8) "Meal Plan" means a plan that indicates the recommended meal content and timing based on a user's health status and goals.

[0144] (9) “Progress Data” refers to data such as the user’s training history, weight fluctuations, and dietary information.

[0145] (10) "Motivational feedback" refers to encouraging messages or notifications provided to encourage users to continue making efforts.

[0146] (11) "Dietary Questions" refers to questions that users ask the system about proper diet and nutrition.

[0147] (12) “Generative AI” refers to an artificial intelligence model that generates appropriate training programs and meal plans based on user input.

[0148] (13) “Capture” refers to recording a user’s movements and postures using a camera or sensor.

[0149] (14) "Feedback" means that the system provides specific improvements or instructions to the user regarding their performance.

[0150] The present invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide individual training and dietary advice. This system has the following main functions:

[0151] User authentication and profile management

[0152] The user puts on the virtual reality device and accesses the login screen. The user enters their username and password, and the device sends the authentication information to the server. The server checks the authentication information in a database, and if authentication is successful, it generates an authentication token and sends it back to the device along with a welcome message. The device displays this. Specifically, when the user opens the application, enters their login information, and presses the submit button, a message appears stating that authentication has been completed in a few seconds and that they will proceed to the next screen.

[0153] Running a training session

[0154] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by the generation AI based on the user's profile and goals. The device displays this session content. The user's movements are captured by a camera and sent to the server in real time. The generation AI on the server analyzes this, evaluates form and progress, and sends and displays any necessary instructions and corrections to the device in real time. For example, if a user's posture is poor while doing squats, the AI ​​will immediately provide audio and visual instructions such as, "Bend your knees a little more."

[0155] Providing dietary advice and planning

[0156] When a user sends a question about their diet through their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and displays it on the device. Related recipes and links to purchase ingredients are also displayed. This allows users to continue eating healthy meals without having to worry about choosing ingredients or cooking methods. For example, if a user asks, "What would be good for dinner tonight?" the server will suggest "grilled salmon and vegetables" and display the necessary ingredients and recipe.

[0157] Progress Tracking and Analysis

[0158] Users enter their daily weight and dietary information on their device. The server collects and analyzes this data and compiles weekly and monthly progress reports. The reports are displayed on the device in the form of visual graphs and charts, making it easier for users to understand their progress. For example, when a user enters their weight, the server records it and displays a graphical progress report on the device at the end of the week.

[0159] Motivation and notifications

[0160] The server generates appropriate motivational messages and reminders based on the user's progress and sends them to the device, helping the user to stay motivated. For example, when a user reaches 50% of their goal, a message such as "You're halfway there, keep trying!" will appear on the device.

[0161] Subscription management and purchasing support

[0162] Users can check their subscription information on their device and send a plan change request. The server processes this and returns the updated information to the device. It also generates promotional information for specific nutritional products or training equipment and sends it to the device. The user can review this information and complete the purchase process. For example, if a user wants to upgrade to a premium plan, they can send a request from their device, and the server processes it and notifies them of the change in subscription fee.

[0163] Hardware and software used

[0164] Virtual reality devices (e.g., VR headsets)

[0165] Device (e.g. smartphone or tablet)

[0166] Server (cloud-based database system, e.g., cloud database)

[0167] Generative AI (e.g., generative AI models)

[0168] Examples of prompt statements

[0169] "Please log in to your account via user authentication to view the training menu."

[0170] "Provide real-time postural instructions as the user performs the squat."

[0171] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0172] System program processing flow and specific operations

[0173] User authentication and profile management

[0174] Step 1:

[0175] The user puts on the VR headset and accesses the login screen.

[0176] Input: The user puts on a VR headset and opens the system's login screen.

[0177] Output: The login screen appears in the user's field of view.

[0178] Step 2:

[0179] The user enters their username and password and clicks the submit button.

[0180] Input: Username and password input information.

[0181] Output: The device sends this information to the server.

[0182] Step 3:

[0183] The server checks the authentication information against a database and generates an authentication token.

[0184] Input: The username and password sent from the device.

[0185] Data processing / calculation: The server checks the authentication information stored in the database. If authentication is successful, it generates an authentication token. If it fails, it generates an error message.

[0186] Output: An authentication token or an error message is generated.

[0187] Step 4:

[0188] The server returns a welcome message to the terminal along with an authentication token.

[0189] Input: Authentication token.

[0190] Output: An authentication token and a welcome message are sent to the terminal.

[0191] Step 5:

[0192] The device displays a welcome message.

[0193] Input: Authentication token and welcome message.

[0194] Output: A welcome message is displayed on the user's screen.

[0195] What happens: Once the user enters their login details and is authenticated, the message "Welcome, [username]" is displayed.

[0196] Running a training session

[0197] Step 6:

[0198] A user requests to start a training session.

[0199] Input: Press the Start Training button.

[0200] Output: A training session start request is sent from the device to the server.

[0201] Step 7:

[0202] The terminal obtains the latest training menu from the server.

[0203] Input: Training session start request.

[0204] Data processing / calculation: The server uses generative AI to generate a customized training menu based on the user's profile and goals.

[0205] Output: Send the latest training menu to the device.

[0206] Step 8:

[0207] The training menu acquired by the device is displayed.

[0208] Enter: your latest training menu.

[0209] Output: The training menu is displayed to the user.

[0210] What happens: The user's training screen displays the latest training program.

[0211] Step 9:

[0212] The user's training movements are captured by a camera and sent to a server.

[0213] Input: Footage of user in action.

[0214] Data processing / calculation: The device captures the motion video in real time and sends it to the server.

[0215] Output: The moving image is sent to the server.

[0216] Step 10:

[0217] A generation AI on the server analyzes the motion footage and generates feedback.

[0218] Input: Motion footage.

[0219] Data processing / calculation: The server's generated AI analyzes the video data, evaluates form and progress, and generates appropriate feedback.

[0220] Output: Feedback data.

[0221] Step 11:

[0222] The server generates feedback and sends it to the terminal, which displays it.

[0223] Input: Feedback data.

[0224] Output: Sends feedback to the device and is displayed to the user.

[0225] Specific action: If the user has poor posture while performing a squat, real-time instructions will be displayed, such as "Bend your knees a bit more."

[0226] Providing dietary advice and planning

[0227] Step 12:

[0228] Users send questions about meals via their device.

[0229] Input: Food questions.

[0230] Output: The question is sent from the terminal to the server.

[0231] Step 13:

[0232] The server receives the questions and the generative AI generates the optimal meal plan.

[0233] Input: Food questions.

[0234] Data processing / calculation: The server's generation AI generates a meal plan based on the user's goals and current nutritional status.

[0235] Output: The generated meal plan.

[0236] Step 14:

[0237] The server sends the meal plan to the device, which displays it.

[0238] Input: The generated meal plan.

[0239] Output: The meal plan is sent to the device.

[0240] What it does: When a user asks, "What's good for dinner tonight?" it suggests "grilled salmon and vegetables" and displays the ingredients and recipe.

[0241] (Application example 1)

[0242] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0243] While training and dietary guidance systems using virtual reality devices allow users to receive personalized training and meal plans, they lack face-to-face support when purchasing physical products. Furthermore, new methods are needed to more effectively maintain motivation and comprehensive health management through interactive activities in virtual spaces.

[0244] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0245] In this invention, the server includes means for receiving and authenticating input information from a user, means for providing a training program through a virtual reality device, means for tracking and evaluating the user's movements in real time, means for generating nutritional management and meal plans for the user, means for collecting and analyzing the user's progress data, means for providing feedback to the user to maintain motivation, and means for enabling the purchase of fitness equipment and health foods in a virtual store, thereby enabling the user to seamlessly purchase physical products as well as receive comprehensive training support within the virtual reality space.

[0246] "Means for receiving and authenticating input information from users" refers to the function of collecting personal authentication information (e.g., user name and password) provided by users through virtual reality devices and verifying and authenticating it on the server.

[0247] "Means for providing a training program through a virtual reality device" refers to a function that allows a user to display and execute individual training content through a virtual reality device.

[0248] "Means for tracking user movements and evaluating them in real time" refers to a function that uses cameras and sensors to monitor the user's physical movements in real time, analyzes them, and evaluates their movements.

[0249] "Means for generating a user's nutritional management and meal plan" refers to a function that generates an optimal meal plan based on the user's health goals and current nutritional status and provides related information.

[0250] "Means for collecting and analyzing user progress data" refers to a function that collects data such as weight, dietary content, and exercise information provided by users on a daily basis, and analyzes this data to understand their progress.

[0251] "Means of providing users with feedback to maintain their motivation" refers to a function that provides messages and reminders to maintain ongoing motivation based on the user's progress data.

[0252] "Means for enabling the purchase of fitness equipment and health foods as a virtual store" refers to a function that allows users to purchase fitness equipment and health foods within a virtual reality space.

[0253] This invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide individual training and dietary advice. The main components of the system are as follows:

[0254] Hardware and Software Configuration

[0255] This system consists of the following hardware and software:

[0256] Hardware:

[0257] Virtual reality headsets (e.g., Oculus Rift, HTC Vive)

[0258] Tracking Camera

[0259] Sensors that detect user movement

[0260] software:

[0261] vr_sdk: A library for managing the display and interaction of VR content.

[0262] health_ai_sdk: An AI library that generates training and meal plans

[0263] e_commerce_sdk: A library for subscription management and purchasing support

[0264] User authentication and profile management

[0265] The user puts on the virtual reality headset and accesses the login screen. The user enters their username and password, and the device sends these credentials to the server. The server checks the user's credentials in a database and generates an authentication token if successful. If authentication is successful, the server returns a welcome message along with the authentication token to the device, which is then displayed.

[0266] Running a training session

[0267] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by generative AI based on the user's profile and goals. The device then displays the session content based on this. The user's movements are captured by a camera and sent to the server in real time. The AI ​​on the server analyzes this, evaluates their form and progress, and sends and displays instructions and corrections to the device in real time.

[0268] Providing dietary advice and planning

[0269] When users submit dietary questions via their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device. Related recipes and links to purchase ingredients are also displayed. This allows users to continue eating healthy without having to worry about choosing ingredients or cooking methods.

[0270] Progress Tracking and Analysis

[0271] Users enter their daily weight and dietary information on their device. The server collects this data and analyzes their progress. Weekly and monthly reports are generated and displayed on the device in the form of visual graphs and charts. This allows users to understand their progress and stay motivated to reach their next goal.

[0272] Motivation and notifications

[0273] The server generates appropriate motivational messages and reminders based on the user's progress data and sends them to the device, helping the user to stay motivated.

[0274] Virtual store features

[0275] It provides a virtual store where users can purchase fitness equipment and health foods in a virtual reality space. Users can access the virtual store through a VR headset and purchase the products they need. At that time, generative AI provides advice on product selection and assists with the purchase process.

[0276] As a specific example, a user uses the system as follows.

[0277] If you ask, "Please suggest a meal plan for today," the AI ​​will suggest "grilled salmon and vegetables" and display the necessary ingredients and recipe.

[0278] When you request to "start a training session," a customized training plan will be presented and your form will be corrected in real time.

[0279] As described above, this system provides users with comprehensive training and health management, realizing services that make the most of virtual reality space.

[0280] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0281] Step 1:

[0282] User authentication

[0283] Input: Username and Password

[0284] Process: The user puts on the virtual reality headset and enters their login information (username and password) on the device. The device sends this authentication information to the server. The server checks the user's authentication information against its database, and if authentication is successful, generates an authentication token and returns it to the device.

[0285] Output: Authentication token and welcome message

[0286] Step 2:

[0287] Providing training programs

[0288] Input: User profile and goals

[0289] Processing: The user gives instructions to the device to start a training session. The device retrieves the latest training menu from the server. The server uses generative AI to generate a customized training plan based on the user's profile and goals and sends it to the device. The device displays the training content.

[0290] Output: Customized training plan

[0291] Step 3:

[0292] User behavior tracking and evaluation

[0293] Input: User behavior data

[0294] Processing: The user's movements are captured by a tracking camera and sensors. The device sends this data to a server in real time. AI on the server analyzes the movement data and evaluates form and progress. If necessary, corrections and feedback are generated and sent to the device. The device then provides audio and visual instructions to the user.

[0295] Output: Real-time evaluation feedback

[0296] Step 4:

[0297] Providing dietary advice and planning

[0298] Input: Food Question

[0299] Processing: The user submits a dietary question via the device. The server uses generative AI to generate an optimal meal plan based on the user's goals and current nutritional status. Related recipes and links to purchase ingredients are also generated and sent to the device. The device displays this information along with the meal plan.

[0300] Output: Optimal meal plan and related information

[0301] Step 5:

[0302] Progress Tracking and Analysis

[0303] Input: Daily weight, dietary information

[0304] Processing: The user enters their daily weight and dietary information into the device. The device sends this data to the server. The server collects the data and analyzes their progress. It generates weekly and monthly progress reports and sends them to the device in the form of visual graphs and charts. The device displays these reports.

[0305] Output: Visual progress report

[0306] Step 6:

[0307] Motivation and notifications

[0308] Input: Progress data

[0309] Processing: The server generates motivational messages and reminders based on the user's progress data. These messages are sent to the user and displayed on the device as appropriate.

[0310] Output: Motivational messages and reminders

[0311] Step 7:

[0312] Use of virtual stores

[0313] Input: Product purchase request

[0314] Processing: The user inputs a request to purchase fitness equipment or health foods into the device in the virtual reality space. The device sends the request to the server, which generates corresponding product information and sends it to the device. The device displays the product information, and the user completes the purchase process. The generation AI provides advice on product selection.

[0315] Output: Purchase confirmation and product information

[0316] Through these steps, the system provides users with comprehensive training and health management, realizing services that make the most of virtual reality space.

[0317] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0318] The present invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide individual training and dietary advice, and further combines it with an emotion engine to recognize the user's emotions. The system includes user authentication, training session execution, dietary advice and planning, progress tracking and analysis, motivation maintenance and notifications, subscription management and purchasing support, and the emotion engine.

[0319] User authentication and profile management

[0320] The user puts on the VR headset and accesses the login screen. The user enters their username and password. The device sends this authentication information to the server. The server checks the user's authentication information in the database and generates an authentication token if successful. If authentication is successful, the server returns a welcome message along with the authentication token to the device, which is then displayed.

[0321] Running a training session

[0322] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by generative AI based on the user's profile and goals. The device then displays the session content based on this. The user's movements are captured by a camera and sent to the server in real time. The AI ​​on the server analyzes this, evaluates their form and progress, and sends and displays instructions and corrections to the device in real time.

[0323] Introducing the Emotion Engine

[0324] The system incorporates an emotion engine that allows the device to recognize emotions from the user's facial expressions and tone of voice. This emotion data is sent to the server and dynamically reflected in feedback and training content. For example, if the user expresses fatigue, the intensity of training can be automatically adjusted.

[0325] For example, when a user is doing squats, a camera captures the user's facial expressions, and if the emotion engine analyzes this and determines that the user is "tired," it will suggest reducing the intensity of the next exercise.

[0326] Providing dietary advice and planning

[0327] When users submit dietary questions via their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device. Related recipes and links to purchase ingredients are also displayed. If the user is not motivated to eat, the emotional engine suggests easy, effortless meal plans.

[0328] Progress Tracking and Analysis

[0329] Users enter their daily weight and dietary habits on their device. The server collects this data and analyzes their progress. Weekly and monthly reports are generated and displayed on the device in the form of visual graphs and charts. Data recognized by the emotion engine is also reflected in the progress report, allowing users to check their psychological state.

[0330] For example, a user can enter their weight, the server records it, and at the end of the week, a graphical progress report is displayed on the device. The emotion engine also adds the user's emotional trends to the report.

[0331] Motivation and notifications

[0332] The server generates appropriate motivational messages and reminders based on the user's progress data and sends them to the device. Based on the recognition results of the emotion engine, the feedback messages are updated accordingly to provide optimal support for the user's current situation.

[0333] For example, if a user expresses a lack of motivation, an encouraging message such as "Take a break and try again!" will be displayed on the device.

[0334] Subscription management and purchasing support

[0335] Users can check their subscription information or send requests to change their plan from their device. The server processes the requests and returns the updated information to the device. It also generates promotional information for special diet foods and training equipment and sends it to the device. Users can then review the information and complete the purchase process.

[0336] For example, if a user wants to upgrade to a premium plan, they send a request from their device, the server processes it, and notifies them of the change in subscription fee.

[0337] Through these features, the present invention provides users with comprehensive, personalized training and nutritional guidance, helping them maintain and improve their long-term health while also taking into account their emotional state.

[0338] The processing flow will be explained below.

[0339] User authentication and profile management

[0340] Step 1:

[0341] The user puts on the VR headset and the login screen appears.

[0342] Step 2:

[0343] The user enters a username and password.

[0344] Step 3:

[0345] The terminal transmits the entered authentication information to the server.

[0346] Step 4:

[0347] The server checks the user's credentials against a database and generates an authentication token on success.

[0348] Step 5:

[0349] The server returns an authentication token to the device.

[0350] Step 6:

[0351] The device receives the authentication token and displays a message indicating successful login.

[0352] Running a training session

[0353] Step 1:

[0354] The user launches a dedicated application to begin a training session.

[0355] Step 2:

[0356] The device retrieves the latest training menu from the server.

[0357] Step 3:

[0358] The device displays the training menu to the user and starts the session.

[0359] Step 4:

[0360] The device captures the user's movements with a camera and transmits the data to a server in real time.

[0361] Step 5:

[0362] AI on the server analyzes the captured data and evaluates the form and progress of the movements.

[0363] Step 6:

[0364] The server sends the evaluation results and feedback to the device.

[0365] Step 7:

[0366] The device displays feedback to the user in real time.

[0367] Introducing the Emotion Engine

[0368] Step 1:

[0369] The device captures the user's facial expressions and tone of voice.

[0370] Step 2:

[0371] The device sends the captured data to the server.

[0372] Step 3:

[0373] The server's emotion engine analyzes the data and recognizes the user's emotional state.

[0374] Step 4:

[0375] The server adjusts the training content and feedback based on the recognized emotional state.

[0376] Step 5:

[0377] The server sends appropriate feedback and training content to the device.

[0378] Step 6:

[0379] The device displays feedback and training adjustments to the user.

[0380] Providing dietary advice and planning

[0381] Step 1:

[0382] The user inputs and submits questions about meals via the terminal.

[0383] Step 2:

[0384] The server generates an appropriate meal plan based on the user's profile and current goals.

[0385] Step 3:

[0386] The server sends the generated meal plan to the device.

[0387] Step 4:

[0388] The device will display the meal plan to the user and provide links to recipes and ingredients.

[0389] Step 5:

[0390] The server adjusts the meal plan based on the emotional state recognized by the emotion engine.

[0391] Progress Tracking and Analysis

[0392] Step 1:

[0393] Users enter their daily weight and dietary information on the device.

[0394] Step 2:

[0395] The terminal transmits the input data to the server.

[0396] Step 3:

[0397] The progress is analyzed based on the data collected by the server.

[0398] Step 4:

[0399] The server generates weekly and monthly reports.

[0400] Step 5:

[0401] The device displays the generated reports to the user in the form of visual graphs and charts.

[0402] Step 6:

[0403] The server also reflects data recognized by the emotion engine in the progress report.

[0404] Motivation and notifications

[0405] Step 1:

[0406] The server generates appropriate motivational messages based on the user's progress data.

[0407] Step 2:

[0408] The server generates a message and sends it to the terminal.

[0409] Step 3:

[0410] The terminal displays the message to the user.

[0411] Step 4:

[0412] The server changes the feedback message in a timely manner according to the emotional state of the user recognized by the emotion engine.

[0413] Subscription management and purchasing support

[0414] Step 1:

[0415] The user interacts with their device to check their subscription status.

[0416] Step 2:

[0417] The device requests subscription information from the server.

[0418] Step 3:

[0419] The server checks the user's subscription status and sends that information back to the device.

[0420] Step 4:

[0421] The device displays the subscription status to the user.

[0422] Step 5:

[0423] The server generates promotional information for special diet foods and training equipment and transmits it to the terminal.

[0424] Step 6:

[0425] The device displays promotional information to the user and assists them in the purchase process.

[0426] Through these specific processing steps, users can efficiently receive authentication, training, dietary advice, progress management, motivation maintenance, subscription management and purchasing support. By combining this with the emotion engine, optimal support tailored to individual needs can be provided.

[0427] Example 2

[0428] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0429] Traditional training systems lack the ability to generate personalized training programs and meal plans, and are unable to reflect the user's emotional state and progress data in real time. They also lack effective motivation and feedback, resulting in little improvement in the user experience. Furthermore, subscription management requires manual, time-consuming tasks.

[0430] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0431] In this invention, the server includes means for receiving and authenticating input information from a user, means for providing a training program through a virtual reality device, means for tracking and evaluating the user's movements in real time, means for recognizing the user's emotional state and dynamically adjusting the training content based thereon, means for generating nutritional management and meal plans for the user, means for collecting and analyzing the user's progress data, means for providing feedback to the user to maintain motivation, and means for managing and changing subscription information. This allows for individualized responses to each user's needs, enabling effective training and diet management while maintaining motivation. Furthermore, the system automatically manages subscriptions, reducing the burden on the user.

[0432] "User authentication" is the process of receiving input from a user and verifying their access rights to a system.

[0433] A "virtual reality device" is a hardware device that allows a user to immerse themselves in a three-dimensional virtual space.

[0434] "Training Program" means a series of exercises designed to improve a User's fitness and health.

[0435] "Tracking" is the process of recording and analyzing user actions and behavior in real time.

[0436] "Real-time evaluation" is the process of instantly analyzing a user's behavioral data and providing appropriate feedback.

[0437] "Emotional state" refers to a user's current mental and emotional state.

[0438] "Dynamic adjustment" refers to the system automatically changing training content and conditions based on the user's real-time data.

[0439] "Nutrition management" is the process of monitoring a user's diet and nutritional intake and providing an optimal nutrition plan.

[0440] A "meal plan" is a meal schedule and content designed based on a user's health goals.

[0441] "Progress Data" is data that shows the user's training and health management history and results.

[0442] "Maintaining motivation" refers to support activities to increase users' motivation to continue training and health management over the long term.

[0443] "Feedback" refers to advice or information provided based on a user's behavior or situation.

[0444] "Subscription Information" refers to the contract information and plan for the service that the User is using.

[0445] "Management and Change" is the process by which the system maintains subscription information and updates it as needed.

[0446] The present invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide personalized training and dietary advice. The system includes user authentication, training session execution, dietary advice and planning, progress tracking and analysis, motivation and notifications, subscription management and purchasing support, and an emotion engine.

[0447] User authentication and profile management

[0448] The user puts on the VR headset and accesses the login screen. The user enters a username and password. The device sends this authentication information to the server. The server checks the user's authentication information in a database and generates an authentication token if successful. If authentication is successful, the server returns a welcome message to the device along with the authentication token, which is then displayed. The software used includes a database management system and an authentication system.

[0449] Running a training session

[0450] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by generative AI based on the user's profile and goals. The device then displays the session content based on this. The user's movements are captured by a camera and sent to the server in real time. The AI ​​on the server analyzes the captured images, evaluates their form and progress, and sends and displays instructions and corrections to the device in real time. The hardware used includes a VR headset, camera, and internet-connected device. The software includes a movement analysis algorithm and a real-time data processing system.

[0451] Introducing the Emotion Engine

[0452] The device recognizes emotions through the user's facial expressions and tone of voice. This emotional data is sent to a server and dynamically reflected in feedback and training content. For example, if the user expresses fatigue, the intensity of the training can be automatically adjusted. For example, while the user is doing squats, the camera captures the user's facial expressions. If the emotion engine analyzes this and determines that the user is "fatigued," the device will suggest lowering the intensity of the next exercise. The software used includes an emotion recognition algorithm.

[0453] Providing dietary advice and planning

[0454] When users submit dietary questions via their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device. Related recipes and links to purchase ingredients are also displayed. If the user is not motivated to eat, the emotional engine suggests easy, effortless meal plans.

[0455] Progress Tracking and Analysis

[0456] Users input their daily weight and dietary habits on their device. The server collects this data and analyzes their progress. Weekly and monthly reports are generated and displayed on the device in the form of visual graphs and charts. Data recognized by the emotion engine is also reflected in the progress report, allowing users to check their psychological state. For example, when a user inputs their weight, the server records it and displays a graphed progress report on the device at the end of the week.

[0457] Motivation and notifications

[0458] The server generates appropriate motivational messages and reminders based on the user's progress data and sends them to the device. Based on the recognition results of the emotion engine, the feedback message is updated accordingly to provide optimal support for the user's current situation. For example, if the user expresses a lack of motivation, an encouraging message such as "Take a short break and try again!" will be displayed on the device.

[0459] Subscription management and purchasing support

[0460] Users can check subscription information from their device or send a request to change their plan. The server processes this and returns the updated information to the device. It also generates promotional information for special diet foods or training equipment and sends it to the device. The user can review this information and then complete the purchase process. For example, if a user wants to upgrade to a premium plan, they send a request from their device, and the server processes it and notifies them of the change in subscription fee.

[0461] Example prompts to input to the generative AI model

[0462] "The user has just recovered from an illness and wants to start exercising again. Please create an initial training menu that is not too strenuous."

[0463] "Propose meal plans that help users maintain positive emotions."

[0464] Through these functions, the present invention provides users with comprehensive, personalized training and dietary advice, helping them maintain and improve their long-term health while also taking into account their emotional state.

[0465] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0466] Specific explanation of program processing

[0467] User authentication and profile management

[0468] Step 1:

[0469] The user puts on the VR headset and accesses the login screen.

[0470] How it works: The user powers on the VR headset and launches the dedicated application.

[0471] Input: User login request.

[0472] Output: Login screen displayed.

[0473] Step 2:

[0474] The user enters a username and password.

[0475] How it works: The user enters their credentials using the keyboard in VR.

[0476] Input: Username and Password.

[0477] Output: Sending authentication information.

[0478] Step 3:

[0479] The device sends the authentication information to the server.

[0480] How it works: Your device encrypts and sends your authentication information to a server over the internet.

[0481] Input: Encrypted credentials.

[0482] Output: Sending authentication information to the server.

[0483] Step 4:

[0484] The server checks the authentication information against its database and generates an authentication token on success.

[0485] What it does: The server queries its database to see if the authentication information matches, and if successful, generates an authentication token.

[0486] Input: Your credentials.

[0487] Output: Generates an authentication token.

[0488] Step 5:

[0489] The server returns a welcome message along with the authentication token to the terminal and displays it.

[0490] Action: The device displays a welcome message in the VR environment.

[0491] Input: Authentication token.

[0492] Output: Display a welcome message.

[0493] Running a training session

[0494] Step 1:

[0495] The user attempts to start a training session.

[0496] How it works: The user selects the Start Training Session button from a menu within the VR environment.

[0497] Enter: Click to start a training session.

[0498] Output: Start preparing for training session.

[0499] Step 2:

[0500] The device retrieves the latest training menu from the server.

[0501] Operation: The device sends an API request to the server to retrieve the training menu.

[0502] Input: Training menu request.

[0503] Output: Get training menu.

[0504] Step 3:

[0505] The device displays the training session.

[0506] Operation: The device displays training content in the VR environment based on the acquired menu information.

[0507] Enter: Training Menu.

[0508] Output: Display of training content.

[0509] Step 4:

[0510] The camera captures the user's movements and transmits them to a server in real time.

[0511] Actions: The device camera captures the user's actions and sends the data to the server.

[0512] Input: User behavior data.

[0513] Output: Sending operational data.

[0514] Step 5:

[0515] The AI ​​on the server analyzes the movements, evaluates the form and progress, and sends instructions and corrections to the device in real time.

[0516] How it works: The server's AI performs image recognition and motion analysis, and sends the evaluation results back to the device.

[0517] Input: Operational data.

[0518] Output: Evaluation results and feedback.

[0519] Introducing the Emotion Engine

[0520] Step 1:

[0521] The device recognizes the user's facial expressions and tone of voice.

[0522] How it works: The microphone and camera capture your audio and video data and analyze it.

[0523] Input: User's facial expression and voice data.

[0524] Output: Emotion data.

[0525] Step 2:

[0526] The emotion data is sent to the server.

[0527] How it works: The device encrypts and transmits emotion data to the server.

[0528] Input: Emotion data.

[0529] Output: Send emotion data to the server.

[0530] Step 3:

[0531] An emotion engine on the server analyzes the data and dynamically reflects feedback and training content.

[0532] How it works: The emotion engine processes the data and generates feedback to adjust the intensity and content of your training.

[0533] Input: Emotion data.

[0534] Output: Adjusted training content and feedback.

[0535] For example, if the emotion engine determines that a user is "tired" while doing squats, it will suggest reducing the intensity of the next exercise.

[0536] Providing dietary advice and planning

[0537] Step 1:

[0538] Users send questions about meals via their device.

[0539] How it works: The user speaks or texts a dietary question and hits submit.

[0540] Input: Food questions.

[0541] Output: Sends the question to the server.

[0542] Step 2:

[0543] AI generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device.

[0544] How it works: A server-generated AI analyzes the questions and the user's profile data to generate a meal plan.

[0545] Input: User question and profile data.

[0546] Output: Meal plan.

[0547] Step 3:

[0548] Show related recipes and links to buy ingredients.

[0549] What it does: Based on the generated meal plan, it displays related recipes and links to buy ingredients on your device.

[0550] Enter: meal plan.

[0551] Output: Recipe and purchase link.

[0552] Progress Tracking and Analysis

[0553] Step 1:

[0554] Users enter their daily weight and dietary information on the device.

[0555] How it works: The user fills out the form with their weight and dietary information and presses the submit button.

[0556] Input: Weight and diet.

[0557] Output: Sending data to the server.

[0558] Step 2:

[0559] The server collects the data and analyzes the progress.

[0560] How it works: The server saves the input data to a database and analyzes the progress.

[0561] Input: User weight and dietary data.

[0562] Output: Analysis results.

[0563] Step 3:

[0564] Weekly and monthly reports are generated and displayed on the device.

[0565] How it works: The server generates reports based on the progress data and displays them on the device in the form of charts and graphs.

[0566] Input: Progress data.

[0567] Output: A visual report.

[0568] For example, users can enter their weight and a graphed progress report will be displayed on the device over the weekend.

[0569] Motivation and notifications

[0570] Step 1:

[0571] The server generates motivational messages and reminders based on the progress data and sends them to the device.

[0572] Operation: The server uses the appropriate reminder function to create a notification message and send it to the device.

[0573] Input: Progress data.

[0574] Output: Motivational messages and reminders.

[0575] Step 2:

[0576] The feedback message is changed appropriately based on the recognition results of the emotion engine.

[0577] How it works: Based on the results recognized by the emotion engine, the server dynamically generates message content and sends it to the device.

[0578] Input: Emotion data.

[0579] Output: A properly adjusted feedback message.

[0580] For example, if a user expresses feelings of lack of motivation, an encouraging message such as "Take a short break and try again!" will be displayed on the device.

[0581] Subscription management and purchasing support

[0582] Step 1:

[0583] The user checks their subscription information on their device and submits a plan change request.

[0584] How it works: A user opens the subscription information page, selects the plan they want to change to, and submits it.

[0585] Input: View and change subscription information requests.

[0586] Output: Sending the request to the server.

[0587] Step 2:

[0588] The server processes the request and returns the updated results to the device.

[0589] Operation: The server processes the request, generates an update result, and notifies the device.

[0590] Input: Subscription change request.

[0591] Output: The update result.

[0592] Step 3:

[0593] Special promotional information is generated and sent to the terminal.

[0594] How it works: The server generates promotional information for special diet foods and training equipment and sends it to the device.

[0595] Input: Request to generate promotion information.

[0596] Output: Sending promotional information to device.

[0597] For example, if a user wants to upgrade to a premium plan, they send a request from their device, the server processes it, and notifies them of the change in subscription fee.

[0598] (Application example 2)

[0599] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0600] While existing training support systems are effective in tracking users' movements and progress and providing personalized training programs and meal plans, they struggle to properly recognize users' emotional state and dynamically adjust feedback and support accordingly. Furthermore, they lack the systems to further improve the user experience when receiving real-time training and meal guidance in physical stores. This makes it difficult for users to maintain motivation and follow meal plans, reducing the effectiveness of long-term health management.

[0601] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0602] In this invention, the server includes means for receiving and authenticating input information from a user, means for providing a training program through a virtual reality device, means for tracking and evaluating the user's movements in real time, means for analyzing the user's emotional data through the virtual reality device, means for dynamically adjusting training intensity based on the emotional data, means for generating a nutritional management and meal plan for the user, means for displaying a visual progress report based on the user's progress data, means for providing feedback to the user to maintain motivation, and means for using the virtual reality device and the emotional analysis means in a physical store, thereby enabling dynamic training adjustments and individually customized fitness and dietary advice based on the user's emotional state.

[0603] "User Input" refers to all data that a user enters into the system, such as login information, training instructions, or meal plan questions.

[0604] "Virtual reality device" refers to equipment that allows users to experience a virtual space, including VR headsets and corresponding controllers.

[0605] A "training program" refers to a customized exercise menu based on the user's health condition and goals.

[0606] "Means for tracking user behavior and evaluating it in real time" refers to the ability to capture user behavior using cameras or sensors and analyze the data in real time.

[0607] "Emotional data" refers to data that indicates the psychological state of a user, derived from facial expressions, tone of voice, etc.

[0608] "Means for dynamically adjusting training intensity based on emotional data" refers to a function that changes the content and intensity of training in real time according to the user's emotional state.

[0609] "Means for generating nutritional management and meal plans" refers to the functionality that generates optimal meal plans based on the user's health status and goals.

[0610] "Progress data" refers to data entered by the user, such as weight, dietary habits, and training history.

[0611] "Means for displaying visual progress reports" refers to the ability to provide progress data to users visually in the form of graphs or charts.

[0612] "Means of providing motivational feedback" refers to features that provide messages such as encouragement or reminders based on the user's progress or emotional state.

[0613] "Means for using virtual reality devices and emotion analysis means within a physical store" refers to the function in which users use a VR headset within a physical store and receive training and dietary advice while undergoing emotion analysis.

[0614] The present invention is a system that allows users to use virtual reality devices in a physical store and receive training and dietary advice based on a generative AI model. The system also includes a function that analyzes users' emotional data in real time and provides optimal feedback to the user.

[0615] Hardware and software used

[0616] VR headset: A device that allows users to experience virtual reality. Examples include Oculus Rift and HTC Vive.

[0617] Tracking camera: A camera for capturing the user's movements and facial expressions.

[0618] User authentication server: A server for managing user login information. Specifically, a cloud service such as AWS (registered trademark) is appropriate.

[0619] Generative AI model: An AI that generates training programs and meal plans based on a user's profile and goals. OpenAI® GPT is preferred.

[0620] Emotion engine: An engine for analyzing the user's facial expressions and tone of voice. Microsoft® Azure® Face API and other APIs can be used.

[0621] System processing flow

[0622] 1. User authentication and profile management

[0623] Users put on a VR headset in a physical store and a login screen appears.

[0624] When a user enters a user name and password, the terminal sends this authentication information to a user authentication server.

[0625] The server checks the authentication information in the database, and if successful, generates an authentication token and returns it to the terminal.

[0626] 2. Running a training session

[0627] When a user starts a training session, the device retrieves the latest training menu from the generative AI model.

[0628] This menu is customized based on the user's profile and goals.

[0629] The device transmits camera data that tracks the user's movements to a server in real time.

[0630] The server analyzes this, evaluates the form and progress, and sends any necessary instructions or corrections to the terminal.

[0631] 3. Emotional Data Analysis and Feedback

[0632] The device's built-in camera captures the user's facial expressions, which are then analyzed by the emotion engine.

[0633] The server adjusts training intensity in real time and provides feedback based on emotional data.

[0634] For example, if the user indicates fatigue, the intensity of the next exercise will be automatically adjusted and an encouraging message will be displayed on the device.

[0635] 4. Nutritional management and meal plan provision

[0636] When a user selects specific ingredients in the health food section, the device uses a generative AI model to generate an optimal meal plan.

[0637] The plan includes related recipes and links to purchase ingredients, which are displayed on the device.

[0638] The emotion engine analyzes the user's motivation and provides appropriate feedback.

[0639] 5. Progress tracking and visual reporting

[0640] Users enter their daily weight and dietary information into the device.

[0641] The server collects this data and generates weekly or monthly progress reports.

[0642] The device will display this visually and emotional data will also be reflected.

[0643] Prompt Sentence Examples

[0644] For example, if a user types, "I'm tired from yesterday's workout. What should I do today?", the generative AI model will provide feedback such as, "You worked hard yesterday! Today, let's focus on some relaxed stretching. Give it a try!"

[0645] This allows for dynamic training adjustments based on the user's emotional state, as well as personalized fitness and nutrition advice.

[0646] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0647] Program processing flow

[0648] Step 1:

[0649] User authentication

[0650] Users put on a VR headset in a physical store and a login screen appears.

[0651] The user enters a username and password, and that information is sent via the terminal to the user authentication server.

[0652] The server checks the entered information against its database and generates an authentication token if authentication is successful.

[0653] The authentication token is returned from the server to the terminal, which retains the token and displays a welcome message.

[0654] Input: Username, Password

[0655] Data processing: Checking authentication information, generating authentication tokens

[0656] Output: Authentication token, welcome message

[0657] Step 2:

[0658] Starting a training session

[0659] The user selects a training session and the device retrieves the latest training menu from the generative AI model.

[0660] The generated menu is displayed on the terminal and the user begins training.

[0661] Input: Training menu request

[0662] Data processing: Generating training menus by applying generative AI models

[0663] Output: Training menu

[0664] Step 3:

[0665] Movement tracking and real-time evaluation

[0666] The device uses a camera to capture the user's movements and transmits the data to a server in real time.

[0667] The server analyzes the captured motion data and evaluates form and progress.

[0668] The evaluation results are sent from the server to the device, and feedback is displayed to the user in real time.

[0669] Input: User behavior data

[0670] Data processing: Analysis of movement data, evaluation of form and progress

[0671] Output: Evaluation results, feedback

[0672] Step 4:

[0673] Analyzing emotion data and adjusting training

[0674] The device's built-in camera captures the user's facial expressions and collects emotional data.

[0675] The device sends this emotion data to the server, where it is analyzed by the emotion engine.

[0676] Based on the analysis results, the server dynamically adjusts the intensity of the training and generates feedback.

[0677] Feedback is displayed on the device and the user continues with the adjusted training.

[0678] Input: facial expression data, tone of voice data

[0679] Data processing: Emotion data analysis and training adjustment

[0680] Output: Adjusted training menu, feedback messages

[0681] Step 5:

[0682] Meal management and planning

[0683] When users scan specific ingredients in the health food aisle, the device uses a generative AI model to generate an optimal meal plan.

[0684] The device will display the generated meal plan along with related recipes and links to purchase ingredients.

[0685] The emotion engine analyzes the user's motivation and provides appropriate feedback.

[0686] Input: Ingredient information, user profile

[0687] Data processing: Meal plan generation

[0688] Output: Meal plans, recipes, purchase links, feedback messages

[0689] Step 6:

[0690] Progress tracking and visual reporting

[0691] Users enter their daily weight and dietary information into the device.

[0692] The terminal sends this data to a server and progress reports are generated periodically.

[0693] The server generates monthly and weekly reports and sends the data back to the device for visual display.

[0694] The device displays progress reports to the user in the form of graphs and charts.

[0695] Input: weight data, dietary data

[0696] Data processing: Collecting and analyzing progress data and generating reports

[0697] Output: Visual progress report

[0698] These steps enable dynamic training adjustments based on the user's emotional state, as well as personalized fitness and nutrition advice.

[0699] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0700] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0701] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0702] [Second embodiment]

[0703] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0704] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0705] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0706] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0707] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0708] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0709] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0710] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0711] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0712] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0713] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0714] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0715] The present invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide personalized training and dietary advice. The system includes user authentication, training session execution, dietary advice and planning, progress tracking and analysis, motivation and notifications, subscription management and purchasing support.

[0716] User authentication and profile management

[0717] The user puts on the VR headset and accesses the login screen. The user enters their username and password. The device sends this authentication information to the server. The server checks the user's authentication information in the database and generates an authentication token if successful. If authentication is successful, the server returns a welcome message along with the authentication token to the device, which is then displayed.

[0718] As a specific example, when a user opens an application, enters their login information and presses the submit button, authentication takes place within a few seconds and a message appears informing them that they can proceed to the next screen.

[0719] Running a training session

[0720] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by generative AI based on the user's profile and goals. The device then displays the session content based on this. The user's movements are captured by a camera and sent to the server in real time. The AI ​​on the server analyzes this, evaluates their form and progress, and sends and displays instructions and corrections to the device in real time.

[0721] For example, if a user's posture is poor while doing squats, the AI ​​will immediately detect this and provide audio and visual instructions such as "Bend your knees a little more."

[0722] Providing dietary advice and planning

[0723] When users submit dietary questions via their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device. Related recipes and links to purchase ingredients are also displayed. This allows users to continue eating healthy without having to worry about choosing ingredients or cooking methods.

[0724] For example, if a user asks, "What would be good for dinner tonight?" the server will suggest "grilled salmon and vegetables" based on the user's profile and display the necessary ingredients and recipe.

[0725] Progress Tracking and Analysis

[0726] Users enter their daily weight and dietary information on their device. The server collects this data and analyzes their progress. Weekly and monthly reports are generated and displayed on the device in the form of visual graphs and charts. This allows users to understand their progress and stay motivated to reach their next goal.

[0727] For example, a user can enter their weight, the server will record it, and at the end of the week a graphical progress report will be displayed on the device.

[0728] Motivation and notifications

[0729] The server generates appropriate motivational messages and reminders based on the user's progress data and sends them to the device, helping the user to stay motivated.

[0730] For example, if a user reaches 50% of their goal, a message such as "You're halfway there, keep trying!" will appear on the device.

[0731] Subscription management and purchasing support

[0732] Users can check their subscription information or send requests to change their plan from their device. The server processes the requests and returns the updated information to the device. It also generates promotional information for special diet foods and training equipment and sends it to the device. Users can then review the information and complete the purchase process.

[0733] For example, if a user wants to upgrade to a premium plan, they send a request from their device, the server processes it, and notifies them of the change in subscription fee.

[0734] Through these features, the present invention provides users with comprehensive, personalized training and nutritional advice to help maintain and improve their long-term health.

[0735] The processing flow will be explained below.

[0736] User authentication and profile management

[0737] Step 1:

[0738] The user puts on the VR headset and the login screen appears.

[0739] Step 2:

[0740] The user enters a username and password.

[0741] Step 3:

[0742] The terminal transmits the entered authentication information to the server.

[0743] Step 4:

[0744] The server checks the user's credentials against a database and generates an authentication token on success.

[0745] Step 5:

[0746] The server returns an authentication token to the device.

[0747] Step 6:

[0748] The device receives the authentication token and displays a message indicating successful login.

[0749] Running a training session

[0750] Step 1:

[0751] The user launches a dedicated application to begin a training session.

[0752] Step 2:

[0753] The device retrieves the latest training menu from the server.

[0754] Step 3:

[0755] The device displays the training menu to the user and starts the session.

[0756] Step 4:

[0757] The device captures the user's movements with a camera and transmits the data to a server in real time.

[0758] Step 5:

[0759] AI on the server analyzes the captured data and evaluates the form and progress of the movements.

[0760] Step 6:

[0761] The server sends the evaluation results and feedback to the device.

[0762] Step 7:

[0763] The device displays feedback to the user in real time.

[0764] Providing dietary advice and planning

[0765] Step 1:

[0766] The user inputs and submits questions about meals via the terminal.

[0767] Step 2:

[0768] The server generates an appropriate meal plan based on the user's profile and current goals.

[0769] Step 3:

[0770] The server sends the generated meal plan to the device.

[0771] Step 4:

[0772] The device will display the meal plan to the user and provide links to recipes and ingredients.

[0773] Progress Tracking and Analysis

[0774] Step 1:

[0775] Users enter their daily weight and dietary information on the device.

[0776] Step 2:

[0777] The terminal transmits the input data to the server.

[0778] Step 3:

[0779] The progress is analyzed based on the data collected by the server.

[0780] Step 4:

[0781] The server generates weekly and monthly reports.

[0782] Step 5:

[0783] The device displays the generated reports to the user in the form of visual graphs and charts.

[0784] Motivation and notifications

[0785] Step 1:

[0786] The server generates appropriate motivational messages based on the user's progress data.

[0787] Step 2:

[0788] The server generates a message and sends it to the terminal.

[0789] Step 3:

[0790] The device displays messages to the user to encourage them to maintain their motivation.

[0791] Subscription management and purchasing support

[0792] Step 1:

[0793] The user interacts with their device to check their subscription status.

[0794] Step 2:

[0795] The device requests subscription information from the server.

[0796] Step 3:

[0797] The server checks the user's subscription status and sends that information back to the device.

[0798] Step 4:

[0799] The device displays the subscription status to the user.

[0800] Step 5:

[0801] The server generates promotional information for special diet foods and training equipment and transmits it to the terminal.

[0802] Step 6:

[0803] The device displays promotional information to the user and assists them in the purchase process.

[0804] In this way, through each step of the process, users can efficiently receive authentication, training, dietary guidance, progress management, motivation maintenance, as well as subscription management and purchasing support.

[0805] Example 1

[0806] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0807] There is a lack of a means for virtual reality training systems to allow users to receive individually supervised training and nutritional guidance at home. There is also a need for a function that evaluates users' movements in real time and provides appropriate feedback. Furthermore, there is a need to collect and analyze progress data and provide visual feedback that allows users to effectively self-manage. There is a need to provide a system that solves these issues and helps users maintain motivation and improve their long-term health.

[0808] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0809] In this invention, the server includes means for receiving and authenticating input information from a user, means for providing a training program through a virtual reality device, means for tracking the user's movements and evaluating them in real time, means for generating a nutritional management and meal plan for the user, means for collecting and analyzing the user's progress data, means for providing the user with feedback to maintain motivation, means for receiving dietary questions from the user and generating and presenting a meal plan using a generation AI, and means for capturing the user's training movements in real time and having the generation AI evaluate and provide feedback. This allows the user to receive individually managed training and dietary advice at home, train while receiving feedback in real time, and improve their long-term health while visually understanding their progress.

[0810] (1) "Information entered by the user" refers to all information provided by the user to the system, such as login information, questions, training data, and dietary data.

[0811] (2) "Authentication" refers to the process of verifying a user's identity based on the login information provided by the user.

[0812] (3) "Virtual reality device" means a device worn by a user that allows the user to access a virtual space and receive training or other instruction.

[0813] (4) "Training Program" means a plan for teaching a user a series of movements or exercises that are customized based on the user's needs and goals.

[0814] (5) “Tracking” refers to recording a user’s performance, such as their physical movements and posture.

[0815] (6) "Real-time evaluation" refers to the process of instantly analyzing user behavior data and generating evaluation results.

[0816] (7) “Nutrition management” refers to managing the user’s dietary content and nutritional intake status.

[0817] (8) "Meal Plan" means a plan that indicates the recommended meal content and timing based on a user's health status and goals.

[0818] (9) “Progress Data” refers to data such as the user’s training history, weight fluctuations, and dietary information.

[0819] (10) "Motivational feedback" refers to encouraging messages or notifications provided to encourage users to continue making efforts.

[0820] (11) "Dietary Questions" refers to questions that users ask the system about proper diet and nutrition.

[0821] (12) “Generative AI” refers to an artificial intelligence model that generates appropriate training programs and meal plans based on user input.

[0822] (13) “Capture” refers to recording a user’s movements and postures using a camera or sensor.

[0823] (14) "Feedback" means that the system provides specific improvements or instructions to the user regarding their performance.

[0824] The present invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide individual training and dietary advice. This system has the following main functions:

[0825] User authentication and profile management

[0826] The user puts on the virtual reality device and accesses the login screen. The user enters their username and password, and the device sends the authentication information to the server. The server checks the authentication information in a database, and if authentication is successful, it generates an authentication token and sends it back to the device along with a welcome message. The device displays this. Specifically, when the user opens the application, enters their login information, and presses the submit button, a message appears stating that authentication has been completed in a few seconds and that they will proceed to the next screen.

[0827] Running a training session

[0828] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by the generation AI based on the user's profile and goals. The device displays this session content. The user's movements are captured by a camera and sent to the server in real time. The generation AI on the server analyzes this, evaluates form and progress, and sends and displays any necessary instructions and corrections to the device in real time. For example, if a user's posture is poor while doing squats, the AI ​​will immediately provide audio and visual instructions such as, "Bend your knees a little more."

[0829] Providing dietary advice and planning

[0830] When a user sends a question about their diet through their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and displays it on the device. Related recipes and links to purchase ingredients are also displayed. This allows users to continue eating healthy meals without having to worry about choosing ingredients or cooking methods. For example, if a user asks, "What would be good for dinner tonight?" the server will suggest "grilled salmon and vegetables" and display the necessary ingredients and recipe.

[0831] Progress Tracking and Analysis

[0832] Users enter their daily weight and dietary information on their device. The server collects and analyzes this data and compiles weekly and monthly progress reports. The reports are displayed on the device in the form of visual graphs and charts, making it easier for users to understand their progress. For example, when a user enters their weight, the server records it and displays a graphical progress report on the device at the end of the week.

[0833] Motivation and notifications

[0834] The server generates appropriate motivational messages and reminders based on the user's progress and sends them to the device, helping the user to stay motivated. For example, when a user reaches 50% of their goal, a message such as "You're halfway there, keep trying!" will appear on the device.

[0835] Subscription management and purchasing support

[0836] Users can check their subscription information on their device and send a plan change request. The server processes this and returns the updated information to the device. It also generates promotional information for specific nutritional products or training equipment and sends it to the device. The user can review this information and complete the purchase process. For example, if a user wants to upgrade to a premium plan, they can send a request from their device, and the server processes it and notifies them of the change in subscription fee.

[0837] Hardware and software used

[0838] Virtual reality devices (e.g., VR headsets)

[0839] Device (e.g. smartphone or tablet)

[0840] Server (cloud-based database system, e.g., cloud database)

[0841] Generative AI (e.g., generative AI models)

[0842] Examples of prompt statements

[0843] "Please log in to your account via user authentication to view the training menu."

[0844] "Provide real-time postural instructions as the user performs the squat."

[0845] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0846] System program processing flow and specific operations

[0847] User authentication and profile management

[0848] Step 1:

[0849] The user puts on the VR headset and accesses the login screen.

[0850] Input: The user puts on a VR headset and opens the system's login screen.

[0851] Output: The login screen appears in the user's field of view.

[0852] Step 2:

[0853] The user enters their username and password and clicks the submit button.

[0854] Input: Username and password input information.

[0855] Output: The device sends this information to the server.

[0856] Step 3:

[0857] The server checks the authentication information against a database and generates an authentication token.

[0858] Input: The username and password sent from the device.

[0859] Data processing / calculation: The server checks the authentication information stored in the database. If authentication is successful, it generates an authentication token. If it fails, it generates an error message.

[0860] Output: An authentication token or an error message is generated.

[0861] Step 4:

[0862] The server returns a welcome message to the terminal along with an authentication token.

[0863] Input: Authentication token.

[0864] Output: An authentication token and a welcome message are sent to the terminal.

[0865] Step 5:

[0866] The device displays a welcome message.

[0867] Input: Authentication token and welcome message.

[0868] Output: A welcome message is displayed on the user's screen.

[0869] What happens: Once the user enters their login details and is authenticated, the message "Welcome, [username]" is displayed.

[0870] Running a training session

[0871] Step 6:

[0872] A user requests to start a training session.

[0873] Input: Press the Start Training button.

[0874] Output: A training session start request is sent from the device to the server.

[0875] Step 7:

[0876] The terminal obtains the latest training menu from the server.

[0877] Input: Training session start request.

[0878] Data processing / calculation: The server uses generative AI to generate a customized training menu based on the user's profile and goals.

[0879] Output: Send the latest training menu to the device.

[0880] Step 8:

[0881] The training menu acquired by the device is displayed.

[0882] Enter: your latest training menu.

[0883] Output: The training menu is displayed to the user.

[0884] What happens: The user's training screen displays the latest training program.

[0885] Step 9:

[0886] The user's training movements are captured by a camera and sent to a server.

[0887] Input: Footage of user in action.

[0888] Data processing / calculation: The device captures the motion video in real time and sends it to the server.

[0889] Output: The moving image is sent to the server.

[0890] Step 10:

[0891] A generation AI on the server analyzes the motion footage and generates feedback.

[0892] Input: Motion footage.

[0893] Data processing / calculation: The server's generated AI analyzes the video data, evaluates form and progress, and generates appropriate feedback.

[0894] Output: Feedback data.

[0895] Step 11:

[0896] The server generates feedback and sends it to the terminal, which displays it.

[0897] Input: Feedback data.

[0898] Output: Sends feedback to the device and is displayed to the user.

[0899] Specific action: If the user has poor posture while performing a squat, real-time instructions will be displayed, such as "Bend your knees a bit more."

[0900] Providing dietary advice and planning

[0901] Step 12:

[0902] Users send questions about meals via their device.

[0903] Input: Food questions.

[0904] Output: The question is sent from the terminal to the server.

[0905] Step 13:

[0906] The server receives the questions and the generative AI generates the optimal meal plan.

[0907] Input: Food questions.

[0908] Data processing / calculation: The server's generation AI generates a meal plan based on the user's goals and current nutritional status.

[0909] Output: The generated meal plan.

[0910] Step 14:

[0911] The server sends the meal plan to the device, which displays it.

[0912] Input: The generated meal plan.

[0913] Output: The meal plan is sent to the device.

[0914] What it does: When a user asks, "What's good for dinner tonight?" it suggests "grilled salmon and vegetables" and displays the ingredients and recipe.

[0915] (Application example 1)

[0916] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0917] While training and dietary guidance systems using virtual reality devices allow users to receive personalized training and meal plans, they lack face-to-face support when purchasing physical products. Furthermore, new methods are needed to more effectively maintain motivation and comprehensive health management through interactive activities in virtual spaces.

[0918] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0919] In this invention, the server includes means for receiving and authenticating input information from a user, means for providing a training program through a virtual reality device, means for tracking and evaluating the user's movements in real time, means for generating nutritional management and meal plans for the user, means for collecting and analyzing the user's progress data, means for providing feedback to the user to maintain motivation, and means for enabling the purchase of fitness equipment and health foods in a virtual store, thereby enabling the user to seamlessly purchase physical products as well as receive comprehensive training support within the virtual reality space.

[0920] "Means for receiving and authenticating input information from users" refers to the function of collecting personal authentication information (e.g., user name, password) provided by users through virtual reality devices and verifying and authenticating it on the server.

[0921] "Means for providing a training program through a virtual reality device" refers to a function that allows a user to display and execute individual training content through a virtual reality device.

[0922] "Means for tracking user movements and evaluating them in real time" refers to a function that uses cameras and sensors to monitor the user's physical movements in real time, analyzes them, and evaluates their movements.

[0923] "Means for generating a user's nutritional management and meal plan" refers to a function that generates an optimal meal plan based on the user's health goals and current nutritional status and provides related information.

[0924] "Means for collecting and analyzing user progress data" refers to a function that collects data such as weight, dietary content, and exercise information provided by users on a daily basis, and analyzes this data to understand their progress.

[0925] "Means of providing users with feedback to maintain their motivation" refers to a function that provides messages and reminders to maintain ongoing motivation based on the user's progress data.

[0926] "Means for enabling the purchase of fitness equipment and health foods as a virtual store" refers to a function that allows users to purchase fitness equipment and health foods within a virtual reality space.

[0927] This invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide individual training and dietary advice. The main components of the system are as follows:

[0928] Hardware and Software Configuration

[0929] This system consists of the following hardware and software:

[0930] Hardware:

[0931] Virtual reality headsets (e.g., Oculus Rift, HTC Vive)

[0932] Tracking Camera

[0933] Sensors that detect user movement

[0934] software:

[0935] vr_sdk: A library for managing the display and interaction of VR content.

[0936] health_ai_sdk: An AI library that generates training and meal plans

[0937] e_commerce_sdk: A library for subscription management and purchasing support

[0938] User authentication and profile management

[0939] The user puts on the virtual reality headset and accesses the login screen. The user enters their username and password, and the device sends these credentials to the server. The server checks the user's credentials in a database and generates an authentication token if successful. If authentication is successful, the server returns a welcome message along with the authentication token to the device, which is then displayed.

[0940] Running a training session

[0941] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by generative AI based on the user's profile and goals. The device then displays the session content based on this. The user's movements are captured by a camera and sent to the server in real time. The AI ​​on the server analyzes this, evaluates their form and progress, and sends and displays instructions and corrections to the device in real time.

[0942] Providing dietary advice and planning

[0943] When users submit dietary questions via their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device. Related recipes and links to purchase ingredients are also displayed. This allows users to continue eating healthy without having to worry about choosing ingredients or cooking methods.

[0944] Progress Tracking and Analysis

[0945] Users enter their daily weight and dietary information on their device. The server collects this data and analyzes their progress. Weekly and monthly reports are generated and displayed on the device in the form of visual graphs and charts. This allows users to understand their progress and stay motivated to reach their next goal.

[0946] Motivation and notifications

[0947] The server generates appropriate motivational messages and reminders based on the user's progress data and sends them to the device, helping the user to stay motivated.

[0948] Virtual store features

[0949] It provides a virtual store where users can purchase fitness equipment and health foods in a virtual reality space. Users can access the virtual store through a VR headset and purchase the products they need. At that time, generative AI provides advice on product selection and assists with the purchase process.

[0950] As a specific example, a user uses the system as follows.

[0951] If you ask, "Please suggest a meal plan for today," the AI ​​will suggest "grilled salmon and vegetables" and display the necessary ingredients and recipe.

[0952] When you request to "start a training session," a customized training plan will be presented and your form will be corrected in real time.

[0953] As described above, this system provides users with comprehensive training and health management, realizing services that make the most of virtual reality space.

[0954] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0955] Step 1:

[0956] User authentication

[0957] Input: Username and Password

[0958] Process: The user puts on the virtual reality headset and enters their login information (username and password) on the device. The device sends this authentication information to the server. The server checks the user's authentication information against its database, and if authentication is successful, generates an authentication token and returns it to the device.

[0959] Output: Authentication token and welcome message

[0960] Step 2:

[0961] Providing training programs

[0962] Input: User profile and goals

[0963] Processing: The user gives instructions to the device to start a training session. The device retrieves the latest training menu from the server. The server uses generative AI to generate a customized training plan based on the user's profile and goals and sends it to the device. The device displays the training content.

[0964] Output: Customized training plan

[0965] Step 3:

[0966] User behavior tracking and evaluation

[0967] Input: User behavior data

[0968] Processing: The user's movements are captured by a tracking camera and sensors. The device sends this data to a server in real time. AI on the server analyzes the movement data and evaluates form and progress. If necessary, corrections and feedback are generated and sent to the device. The device then provides audio and visual instructions to the user.

[0969] Output: Real-time evaluation feedback

[0970] Step 4:

[0971] Providing dietary advice and planning

[0972] Input: Food Question

[0973] Processing: The user submits a dietary question via the device. The server uses generative AI to generate an optimal meal plan based on the user's goals and current nutritional status. Related recipes and links to purchase ingredients are also generated and sent to the device. The device displays this information along with the meal plan.

[0974] Output: Optimal meal plan and related information

[0975] Step 5:

[0976] Progress Tracking and Analysis

[0977] Input: Daily weight, dietary information

[0978] Processing: The user enters their daily weight and dietary information into the device. The device sends this data to the server. The server collects the data and analyzes their progress. It generates weekly and monthly progress reports and sends them to the device in the form of visual graphs and charts. The device displays these reports.

[0979] Output: Visual progress report

[0980] Step 6:

[0981] Motivation and notifications

[0982] Input: Progress data

[0983] Processing: The server generates motivational messages and reminders based on the user's progress data. These messages are sent to the user and displayed on the device as appropriate.

[0984] Output: Motivational messages and reminders

[0985] Step 7:

[0986] Use of virtual stores

[0987] Input: Product purchase request

[0988] Processing: The user inputs a request to purchase fitness equipment or health foods into the device in the virtual reality space. The device sends the request to the server, which generates corresponding product information and sends it to the device. The device displays the product information, and the user completes the purchase process. The generation AI provides advice on product selection.

[0989] Output: Purchase confirmation and product information

[0990] Through these steps, the system provides users with comprehensive training and health management, realizing services that make the most of virtual reality space.

[0991] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0992] The present invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide individual training and dietary advice, and further combines it with an emotion engine to recognize the user's emotions. The system includes user authentication, training session execution, dietary advice and planning, progress tracking and analysis, motivation maintenance and notifications, subscription management and purchasing support, and the emotion engine.

[0993] User authentication and profile management

[0994] The user puts on the VR headset and accesses the login screen. The user enters their username and password. The device sends this authentication information to the server. The server checks the user's authentication information in the database and generates an authentication token if successful. If authentication is successful, the server returns a welcome message along with the authentication token to the device, which is then displayed.

[0995] Running a training session

[0996] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by generative AI based on the user's profile and goals. The device then displays the session content based on this. The user's movements are captured by a camera and sent to the server in real time. The AI ​​on the server analyzes this, evaluates their form and progress, and sends and displays instructions and corrections to the device in real time.

[0997] Introducing the Emotion Engine

[0998] The system incorporates an emotion engine that allows the device to recognize emotions from the user's facial expressions and tone of voice. This emotion data is sent to the server and dynamically reflected in feedback and training content. For example, if the user expresses fatigue, the intensity of training can be automatically adjusted.

[0999] For example, when a user is doing squats, a camera captures the user's facial expressions, and if the emotion engine analyzes this and determines that the user is "tired," it will suggest reducing the intensity of the next exercise.

[1000] Providing dietary advice and planning

[1001] When users submit dietary questions via their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device. Related recipes and links to purchase ingredients are also displayed. If the user is not motivated to eat, the emotional engine suggests easy, effortless meal plans.

[1002] Progress Tracking and Analysis

[1003] Users enter their daily weight and dietary habits on their device. The server collects this data and analyzes their progress. Weekly and monthly reports are generated and displayed on the device in the form of visual graphs and charts. Data recognized by the emotion engine is also reflected in the progress report, allowing users to check their psychological state.

[1004] For example, a user can enter their weight, the server records it, and at the end of the week, a graphical progress report is displayed on the device. The emotion engine also adds the user's emotional trends to the report.

[1005] Motivation and notifications

[1006] The server generates appropriate motivational messages and reminders based on the user's progress data and sends them to the device. Based on the recognition results of the emotion engine, the feedback messages are updated accordingly to provide optimal support for the user's current situation.

[1007] For example, if a user expresses a lack of motivation, an encouraging message such as "Take a break and try again!" will be displayed on the device.

[1008] Subscription management and purchasing support

[1009] Users can check their subscription information or send requests to change their plan from their device. The server processes the requests and returns the updated information to the device. It also generates promotional information for special diet foods and training equipment and sends it to the device. Users can then review the information and complete the purchase process.

[1010] For example, if a user wants to upgrade to a premium plan, they send a request from their device, the server processes it, and notifies them of the change in subscription fee.

[1011] Through these features, the present invention provides users with comprehensive, personalized training and nutritional guidance, helping them maintain and improve their long-term health while also taking into account their emotional state.

[1012] The processing flow will be explained below.

[1013] User authentication and profile management

[1014] Step 1:

[1015] The user puts on the VR headset and the login screen appears.

[1016] Step 2:

[1017] The user enters a username and password.

[1018] Step 3:

[1019] The terminal transmits the entered authentication information to the server.

[1020] Step 4:

[1021] The server checks the user's credentials against a database and generates an authentication token on success.

[1022] Step 5:

[1023] The server returns an authentication token to the device.

[1024] Step 6:

[1025] The device receives the authentication token and displays a message indicating successful login.

[1026] Running a training session

[1027] Step 1:

[1028] The user launches a dedicated application to begin a training session.

[1029] Step 2:

[1030] The device retrieves the latest training menu from the server.

[1031] Step 3:

[1032] The device displays the training menu to the user and starts the session.

[1033] Step 4:

[1034] The device captures the user's movements with a camera and transmits the data to a server in real time.

[1035] Step 5:

[1036] AI on the server analyzes the captured data and evaluates the form and progress of the movements.

[1037] Step 6:

[1038] The server sends the evaluation results and feedback to the device.

[1039] Step 7:

[1040] The device displays feedback to the user in real time.

[1041] Introducing the Emotion Engine

[1042] Step 1:

[1043] The device captures the user's facial expressions and tone of voice.

[1044] Step 2:

[1045] The device sends the captured data to the server.

[1046] Step 3:

[1047] The server's emotion engine analyzes the data and recognizes the user's emotional state.

[1048] Step 4:

[1049] The server adjusts the training content and feedback based on the recognized emotional state.

[1050] Step 5:

[1051] The server sends appropriate feedback and training content to the device.

[1052] Step 6:

[1053] The device displays feedback and training adjustments to the user.

[1054] Providing dietary advice and planning

[1055] Step 1:

[1056] The user inputs and submits questions about meals via the terminal.

[1057] Step 2:

[1058] The server generates an appropriate meal plan based on the user's profile and current goals.

[1059] Step 3:

[1060] The server sends the generated meal plan to the device.

[1061] Step 4:

[1062] The device will display the meal plan to the user and provide links to recipes and ingredients.

[1063] Step 5:

[1064] The server adjusts the meal plan based on the emotional state recognized by the emotion engine.

[1065] Progress Tracking and Analysis

[1066] Step 1:

[1067] Users enter their daily weight and dietary information on the device.

[1068] Step 2:

[1069] The terminal transmits the input data to the server.

[1070] Step 3:

[1071] The progress is analyzed based on the data collected by the server.

[1072] Step 4:

[1073] The server generates weekly and monthly reports.

[1074] Step 5:

[1075] The device displays the generated reports to the user in the form of visual graphs and charts.

[1076] Step 6:

[1077] The server also reflects data recognized by the emotion engine in the progress report.

[1078] Motivation and notifications

[1079] Step 1:

[1080] The server generates appropriate motivational messages based on the user's progress data.

[1081] Step 2:

[1082] The server generates a message and sends it to the terminal.

[1083] Step 3:

[1084] The terminal displays the message to the user.

[1085] Step 4:

[1086] The server changes the feedback message in a timely manner according to the emotional state of the user recognized by the emotion engine.

[1087] Subscription management and purchasing support

[1088] Step 1:

[1089] The user interacts with their device to check their subscription status.

[1090] Step 2:

[1091] The device requests subscription information from the server.

[1092] Step 3:

[1093] The server checks the user's subscription status and sends that information back to the device.

[1094] Step 4:

[1095] The device displays the subscription status to the user.

[1096] Step 5:

[1097] The server generates promotional information for special diet foods and training equipment and transmits it to the terminal.

[1098] Step 6:

[1099] The device displays promotional information to the user and assists them in the purchase process.

[1100] Through these specific processing steps, users can efficiently receive authentication, training, dietary advice, progress management, motivation maintenance, subscription management and purchasing support. By combining this with the emotion engine, optimal support tailored to individual needs can be provided.

[1101] Example 2

[1102] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1103] Traditional training systems lack the ability to generate personalized training programs and meal plans, and are unable to reflect the user's emotional state and progress data in real time. They also lack effective motivation and feedback, resulting in little improvement in the user experience. Furthermore, subscription management requires manual, time-consuming tasks.

[1104] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1105] In this invention, the server includes means for receiving and authenticating input information from a user, means for providing a training program through a virtual reality device, means for tracking and evaluating the user's movements in real time, means for recognizing the user's emotional state and dynamically adjusting the training content based thereon, means for generating nutritional management and meal plans for the user, means for collecting and analyzing the user's progress data, means for providing feedback to the user to maintain motivation, and means for managing and changing subscription information. This allows for individualized responses to each user's needs, enabling effective training and diet management while maintaining motivation. Furthermore, the system automatically manages subscriptions, reducing the burden on the user.

[1106] "User authentication" is the process of receiving input from a user and verifying their access rights to a system.

[1107] A "virtual reality device" is a hardware device that allows a user to immerse themselves in a three-dimensional virtual space.

[1108] "Training Program" means a series of exercises designed to improve a User's fitness and health.

[1109] "Tracking" is the process of recording and analyzing user actions and behavior in real time.

[1110] "Real-time evaluation" is the process of instantly analyzing a user's behavioral data and providing appropriate feedback.

[1111] "Emotional state" refers to a user's current mental and emotional state.

[1112] "Dynamic adjustment" refers to the system automatically changing training content and conditions based on the user's real-time data.

[1113] "Nutrition management" is the process of monitoring a user's diet and nutritional intake and providing an optimal nutrition plan.

[1114] A "meal plan" is a meal schedule and content designed based on a user's health goals.

[1115] "Progress Data" is data that shows the user's training and health management history and results.

[1116] "Maintaining motivation" refers to support activities to increase users' motivation to continue training and health management over the long term.

[1117] "Feedback" refers to advice or information provided based on a user's behavior or situation.

[1118] "Subscription Information" refers to the contract information and plan for the service that the User is using.

[1119] "Management and Change" is the process by which the system maintains subscription information and updates it as needed.

[1120] The present invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide personalized training and dietary advice. The system includes user authentication, training session execution, dietary advice and planning, progress tracking and analysis, motivation and notifications, subscription management and purchasing support, and an emotion engine.

[1121] User authentication and profile management

[1122] The user puts on the VR headset and accesses the login screen. The user enters a username and password. The device sends this authentication information to the server. The server checks the user's authentication information in a database and generates an authentication token if successful. If authentication is successful, the server returns a welcome message to the device along with the authentication token, which is then displayed. The software used includes a database management system and an authentication system.

[1123] Running a training session

[1124] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by generative AI based on the user's profile and goals. The device then displays the session content based on this. The user's movements are captured by a camera and sent to the server in real time. The AI ​​on the server analyzes the captured images, evaluates their form and progress, and sends and displays instructions and corrections to the device in real time. The hardware used includes a VR headset, camera, and internet-connected device. The software includes a movement analysis algorithm and a real-time data processing system.

[1125] Introducing the Emotion Engine

[1126] The device recognizes emotions through the user's facial expressions and tone of voice. This emotional data is sent to a server and dynamically reflected in feedback and training content. For example, if the user expresses fatigue, the intensity of the training can be automatically adjusted. For example, while the user is doing squats, the camera captures the user's facial expressions. If the emotion engine analyzes this and determines that the user is "fatigued," the device will suggest lowering the intensity of the next exercise. The software used includes an emotion recognition algorithm.

[1127] Providing dietary advice and planning

[1128] When users submit dietary questions via their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device. Related recipes and links to purchase ingredients are also displayed. If the user is not motivated to eat, the emotional engine suggests easy, effortless meal plans.

[1129] Progress Tracking and Analysis

[1130] Users input their daily weight and dietary habits on their device. The server collects this data and analyzes their progress. Weekly and monthly reports are generated and displayed on the device in the form of visual graphs and charts. Data recognized by the emotion engine is also reflected in the progress report, allowing users to check their psychological state. For example, when a user inputs their weight, the server records it and displays a graphed progress report on the device at the end of the week.

[1131] Motivation and notifications

[1132] The server generates appropriate motivational messages and reminders based on the user's progress data and sends them to the device. Based on the recognition results of the emotion engine, the feedback message is updated accordingly to provide optimal support for the user's current situation. For example, if the user expresses a lack of motivation, an encouraging message such as "Take a short break and try again!" will be displayed on the device.

[1133] Subscription management and purchasing support

[1134] Users can check subscription information from their device or send a request to change their plan. The server processes this and returns the updated information to the device. It also generates promotional information for special diet foods or training equipment and sends it to the device. The user can review this information and then complete the purchase process. For example, if a user wants to upgrade to a premium plan, they send a request from their device, and the server processes it and notifies them of the change in subscription fee.

[1135] Example prompts to input to the generative AI model

[1136] "The user has just recovered from an illness and wants to start exercising again. Please create an initial training menu that is not too strenuous."

[1137] "Propose meal plans that help users maintain positive emotions."

[1138] Through these functions, the present invention provides users with comprehensive, personalized training and dietary advice, helping them maintain and improve their long-term health while also taking into account their emotional state.

[1139] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1140] Specific explanation of program processing

[1141] User authentication and profile management

[1142] Step 1:

[1143] The user puts on the VR headset and accesses the login screen.

[1144] How it works: The user powers on the VR headset and launches the dedicated application.

[1145] Input: User login request.

[1146] Output: Login screen displayed.

[1147] Step 2:

[1148] The user enters a username and password.

[1149] How it works: The user enters their credentials using the keyboard in VR.

[1150] Input: Username and Password.

[1151] Output: Sending authentication information.

[1152] Step 3:

[1153] The device sends the authentication information to the server.

[1154] How it works: Your device encrypts and sends your authentication information to a server over the internet.

[1155] Input: Encrypted credentials.

[1156] Output: Sending authentication information to the server.

[1157] Step 4:

[1158] The server checks the authentication information against its database and generates an authentication token on success.

[1159] What it does: The server queries its database to see if the authentication information matches, and if successful, generates an authentication token.

[1160] Input: Your credentials.

[1161] Output: Generates an authentication token.

[1162] Step 5:

[1163] The server returns a welcome message along with the authentication token to the terminal and displays it.

[1164] Action: The device displays a welcome message in the VR environment.

[1165] Input: Authentication token.

[1166] Output: Display a welcome message.

[1167] Running a training session

[1168] Step 1:

[1169] The user attempts to start a training session.

[1170] How it works: The user selects the Start Training Session button from a menu within the VR environment.

[1171] Enter: Click to start a training session.

[1172] Output: Start preparing for training session.

[1173] Step 2:

[1174] The device retrieves the latest training menu from the server.

[1175] Operation: The device sends an API request to the server to retrieve the training menu.

[1176] Input: Training menu request.

[1177] Output: Get training menu.

[1178] Step 3:

[1179] The device displays the training session.

[1180] Operation: The device displays training content in the VR environment based on the acquired menu information.

[1181] Enter: Training Menu.

[1182] Output: Display of training content.

[1183] Step 4:

[1184] The camera captures the user's movements and transmits them to a server in real time.

[1185] Actions: The device camera captures the user's actions and sends the data to the server.

[1186] Input: User behavior data.

[1187] Output: Sending operational data.

[1188] Step 5:

[1189] The AI ​​on the server analyzes the movements, evaluates the form and progress, and sends instructions and corrections to the device in real time.

[1190] How it works: The server's AI performs image recognition and motion analysis, and sends the evaluation results back to the device.

[1191] Input: Operational data.

[1192] Output: Evaluation results and feedback.

[1193] Introducing the Emotion Engine

[1194] Step 1:

[1195] The device recognizes the user's facial expressions and tone of voice.

[1196] How it works: The microphone and camera capture your audio and video data and analyze it.

[1197] Input: User's facial expression and voice data.

[1198] Output: Emotion data.

[1199] Step 2:

[1200] The emotion data is sent to the server.

[1201] How it works: The device encrypts and transmits emotion data to the server.

[1202] Input: Emotion data.

[1203] Output: Send emotion data to the server.

[1204] Step 3:

[1205] An emotion engine on the server analyzes the data and dynamically reflects feedback and training content.

[1206] How it works: The emotion engine processes the data and generates feedback to adjust the intensity and content of your training.

[1207] Input: Emotion data.

[1208] Output: Adjusted training content and feedback.

[1209] For example, if the emotion engine determines that a user is "tired" while doing squats, it will suggest reducing the intensity of the next exercise.

[1210] Providing dietary advice and planning

[1211] Step 1:

[1212] Users send questions about meals via their device.

[1213] How it works: The user speaks or texts a dietary question and hits submit.

[1214] Input: Food questions.

[1215] Output: Sends the question to the server.

[1216] Step 2:

[1217] AI generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device.

[1218] How it works: A server-generated AI analyzes the questions and the user's profile data to generate a meal plan.

[1219] Input: User question and profile data.

[1220] Output: Meal plan.

[1221] Step 3:

[1222] Show related recipes and links to buy ingredients.

[1223] What it does: Based on the generated meal plan, it displays related recipes and links to buy ingredients on your device.

[1224] Enter: meal plan.

[1225] Output: Recipe and purchase link.

[1226] Progress Tracking and Analysis

[1227] Step 1:

[1228] Users enter their daily weight and dietary information on the device.

[1229] How it works: The user fills out the form with their weight and dietary information and presses the submit button.

[1230] Input: Weight and diet.

[1231] Output: Sending data to the server.

[1232] Step 2:

[1233] The server collects the data and analyzes the progress.

[1234] How it works: The server saves the input data to a database and analyzes the progress.

[1235] Input: User weight and dietary data.

[1236] Output: Analysis results.

[1237] Step 3:

[1238] Weekly and monthly reports are generated and displayed on the device.

[1239] How it works: The server generates reports based on the progress data and displays them on the device in the form of charts and graphs.

[1240] Input: Progress data.

[1241] Output: A visual report.

[1242] For example, users can enter their weight and a graphed progress report will be displayed on the device over the weekend.

[1243] Motivation and notifications

[1244] Step 1:

[1245] The server generates motivational messages and reminders based on the progress data and sends them to the device.

[1246] Operation: The server uses the appropriate reminder function to create a notification message and send it to the device.

[1247] Input: Progress data.

[1248] Output: Motivational messages and reminders.

[1249] Step 2:

[1250] The feedback message is changed appropriately based on the recognition results of the emotion engine.

[1251] How it works: Based on the results recognized by the emotion engine, the server dynamically generates message content and sends it to the device.

[1252] Input: Emotion data.

[1253] Output: A properly adjusted feedback message.

[1254] For example, if a user expresses feelings of lack of motivation, an encouraging message such as "Take a short break and try again!" will be displayed on the device.

[1255] Subscription management and purchasing support

[1256] Step 1:

[1257] The user checks their subscription information on their device and submits a plan change request.

[1258] How it works: A user opens the subscription information page, selects the plan they want to change to, and submits it.

[1259] Input: View and change subscription information requests.

[1260] Output: Sending the request to the server.

[1261] Step 2:

[1262] The server processes the request and returns the updated results to the device.

[1263] Operation: The server processes the request, generates an update result, and notifies the device.

[1264] Input: Subscription change request.

[1265] Output: The update result.

[1266] Step 3:

[1267] Special promotional information is generated and sent to the terminal.

[1268] How it works: The server generates promotional information for special diet foods and training equipment and sends it to the device.

[1269] Input: Request to generate promotion information.

[1270] Output: Sending promotional information to device.

[1271] For example, if a user wants to upgrade to a premium plan, they send a request from their device, the server processes it, and notifies them of the change in subscription fee.

[1272] (Application example 2)

[1273] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1274] While existing training support systems are effective in tracking users' movements and progress and providing personalized training programs and meal plans, they struggle to properly recognize users' emotional state and dynamically adjust feedback and support accordingly. Furthermore, they lack the systems to further improve the user experience when receiving real-time training and meal guidance in physical stores. This makes it difficult for users to maintain motivation and follow meal plans, reducing the effectiveness of long-term health management.

[1275] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1276] In this invention, the server includes means for receiving and authenticating input information from a user, means for providing a training program through a virtual reality device, means for tracking and evaluating the user's movements in real time, means for analyzing the user's emotional data through the virtual reality device, means for dynamically adjusting training intensity based on the emotional data, means for generating a nutritional management and meal plan for the user, means for displaying a visual progress report based on the user's progress data, means for providing feedback to the user to maintain motivation, and means for using the virtual reality device and the emotional analysis means in a physical store, thereby enabling dynamic training adjustments and individually customized fitness and dietary advice based on the user's emotional state.

[1277] "User Input" refers to all data that a user enters into the system, such as login information, training instructions, or meal plan questions.

[1278] "Virtual reality device" refers to equipment that allows users to experience a virtual space, including VR headsets and corresponding controllers.

[1279] A "training program" refers to a customized exercise menu based on the user's health condition and goals.

[1280] "Means for tracking user behavior and evaluating it in real time" refers to the ability to capture user behavior using cameras or sensors and analyze the data in real time.

[1281] "Emotional data" refers to data that indicates the psychological state of a user, derived from facial expressions, tone of voice, etc.

[1282] "Means for dynamically adjusting training intensity based on emotional data" refers to a function that changes the content and intensity of training in real time according to the user's emotional state.

[1283] "Means for generating nutritional management and meal plans" refers to the functionality that generates optimal meal plans based on the user's health status and goals.

[1284] "Progress data" refers to data entered by the user, such as weight, dietary habits, and training history.

[1285] "Means for displaying visual progress reports" refers to the ability to provide progress data to users visually in the form of graphs or charts.

[1286] "Means of providing motivational feedback" refers to features that provide messages such as encouragement or reminders based on the user's progress or emotional state.

[1287] "Means for using virtual reality devices and emotion analysis means within a physical store" refers to the function in which users use a VR headset within a physical store and receive training and dietary advice while undergoing emotion analysis.

[1288] The present invention is a system that allows users to use virtual reality devices in a physical store and receive training and dietary advice based on a generative AI model. The system also includes a function that analyzes users' emotional data in real time and provides optimal feedback to the user.

[1289] Hardware and software used

[1290] VR headset: A device that allows users to experience virtual reality. Examples include Oculus Rift and HTC Vive.

[1291] Tracking camera: A camera for capturing the user's movements and facial expressions.

[1292] User authentication server: A server for managing user login information. Specifically, a cloud service such as AWS is suitable.

[1293] Generative AI model: An AI that generates training programs and meal plans based on a user's profile and goals. OpenAI GPT is preferred.

[1294] Emotion engine: An engine for analyzing the user's facial expressions and tone of voice. Microsoft Azure Face API can be used.

[1295] System processing flow

[1296] 1. User authentication and profile management

[1297] Users put on a VR headset in a physical store and a login screen appears.

[1298] When a user enters a user name and password, the terminal sends this authentication information to a user authentication server.

[1299] The server checks the authentication information in the database, and if successful, generates an authentication token and returns it to the terminal.

[1300] 2. Running a training session

[1301] When a user starts a training session, the device retrieves the latest training menu from the generative AI model.

[1302] This menu is customized based on the user's profile and goals.

[1303] The device transmits camera data that tracks the user's movements to a server in real time.

[1304] The server analyzes this, evaluates the form and progress, and sends any necessary instructions or corrections to the terminal.

[1305] 3. Emotional Data Analysis and Feedback

[1306] The device's built-in camera captures the user's facial expressions, which are then analyzed by the emotion engine.

[1307] The server adjusts training intensity in real time and provides feedback based on emotional data.

[1308] For example, if the user indicates fatigue, the intensity of the next exercise will be automatically adjusted and an encouraging message will be displayed on the device.

[1309] 4. Nutritional management and meal plan provision

[1310] When a user selects specific ingredients in the health food section, the device uses a generative AI model to generate an optimal meal plan.

[1311] The plan includes related recipes and links to purchase ingredients, which are displayed on the device.

[1312] The emotion engine analyzes the user's motivation and provides appropriate feedback.

[1313] 5. Progress tracking and visual reporting

[1314] Users enter their daily weight and dietary information into the device.

[1315] The server collects this data and generates weekly or monthly progress reports.

[1316] The device will display this visually and emotional data will also be reflected.

[1317] Prompt Sentence Examples

[1318] For example, if a user types, "I'm tired from yesterday's workout. What should I do today?", the generative AI model will provide feedback such as, "You worked hard yesterday! Today, let's focus on some relaxed stretching. Give it a try!"

[1319] This allows for dynamic training adjustments based on the user's emotional state, as well as personalized fitness and nutrition advice.

[1320] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1321] Program processing flow

[1322] Step 1:

[1323] User authentication

[1324] Users put on a VR headset in a physical store and a login screen appears.

[1325] The user enters a username and password, and that information is sent via the terminal to the user authentication server.

[1326] The server checks the entered information against its database and generates an authentication token if authentication is successful.

[1327] The authentication token is returned from the server to the terminal, which retains the token and displays a welcome message.

[1328] Input: Username, Password

[1329] Data processing: Checking authentication information, generating authentication tokens

[1330] Output: Authentication token, welcome message

[1331] Step 2:

[1332] Starting a training session

[1333] The user selects a training session and the device retrieves the latest training menu from the generative AI model.

[1334] The generated menu is displayed on the terminal and the user begins training.

[1335] Input: Training menu request

[1336] Data processing: Generating training menus by applying generative AI models

[1337] Output: Training menu

[1338] Step 3:

[1339] Movement tracking and real-time evaluation

[1340] The device uses a camera to capture the user's movements and transmits the data to a server in real time.

[1341] The server analyzes the captured motion data and evaluates form and progress.

[1342] The evaluation results are sent from the server to the device, and feedback is displayed to the user in real time.

[1343] Input: User behavior data

[1344] Data processing: Analysis of movement data, evaluation of form and progress

[1345] Output: Evaluation results, feedback

[1346] Step 4:

[1347] Analyzing emotion data and adjusting training

[1348] The device's built-in camera captures the user's facial expressions and collects emotional data.

[1349] The device sends this emotion data to the server, where it is analyzed by the emotion engine.

[1350] Based on the analysis results, the server dynamically adjusts the intensity of the training and generates feedback.

[1351] Feedback is displayed on the device and the user continues with the adjusted training.

[1352] Input: facial expression data, tone of voice data

[1353] Data processing: Emotion data analysis and training adjustment

[1354] Output: Adjusted training menu, feedback messages

[1355] Step 5:

[1356] Meal management and planning

[1357] When users scan specific ingredients in the health food aisle, the device uses a generative AI model to generate an optimal meal plan.

[1358] The device will display the generated meal plan along with related recipes and links to purchase ingredients.

[1359] The emotion engine analyzes the user's motivation and provides appropriate feedback.

[1360] Input: Ingredient information, user profile

[1361] Data processing: Meal plan generation

[1362] Output: Meal plans, recipes, purchase links, feedback messages

[1363] Step 6:

[1364] Progress tracking and visual reporting

[1365] Users enter their daily weight and dietary information into the device.

[1366] The terminal sends this data to a server and progress reports are generated periodically.

[1367] The server generates monthly and weekly reports and sends the data back to the device for visual display.

[1368] The device displays progress reports to the user in the form of graphs and charts.

[1369] Input: weight data, dietary data

[1370] Data processing: Collecting and analyzing progress data and generating reports

[1371] Output: Visual progress report

[1372] These steps enable dynamic training adjustments based on the user's emotional state, as well as personalized fitness and nutrition advice.

[1373] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1374] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1375] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1376] [Third embodiment]

[1377] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1378] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1379] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1380] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1381] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1382] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1383] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1384] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1385] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1386] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1387] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1388] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1389] The present invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide personalized training and dietary advice. The system includes user authentication, training session execution, dietary advice and planning, progress tracking and analysis, motivation and notifications, subscription management and purchasing support.

[1390] User authentication and profile management

[1391] The user puts on the VR headset and accesses the login screen. The user enters their username and password. The device sends this authentication information to the server. The server checks the user's authentication information in the database and generates an authentication token if successful. If authentication is successful, the server returns a welcome message along with the authentication token to the device, which is then displayed.

[1392] As a specific example, when a user opens an application, enters their login information and presses the submit button, authentication takes place within a few seconds and a message appears informing them that they can proceed to the next screen.

[1393] Running a training session

[1394] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by generative AI based on the user's profile and goals. The device then displays the session content based on this. The user's movements are captured by a camera and sent to the server in real time. The AI ​​on the server analyzes this, evaluates their form and progress, and sends and displays instructions and corrections to the device in real time.

[1395] For example, if a user's posture is poor while doing squats, the AI ​​will immediately detect this and provide audio and visual instructions such as "Bend your knees a little more."

[1396] Providing dietary advice and planning

[1397] When users submit dietary questions via their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device. Related recipes and links to purchase ingredients are also displayed. This allows users to continue eating healthy without having to worry about choosing ingredients or cooking methods.

[1398] For example, if a user asks, "What would be good for dinner tonight?" the server will suggest "grilled salmon and vegetables" based on the user's profile and display the necessary ingredients and recipe.

[1399] Progress Tracking and Analysis

[1400] Users enter their daily weight and dietary information on their device. The server collects this data and analyzes their progress. Weekly and monthly reports are generated and displayed on the device in the form of visual graphs and charts. This allows users to understand their progress and stay motivated to reach their next goal.

[1401] For example, a user can enter their weight, the server will record it, and at the end of the week a graphical progress report will be displayed on the device.

[1402] Motivation and notifications

[1403] The server generates appropriate motivational messages and reminders based on the user's progress data and sends them to the device, helping the user to stay motivated.

[1404] For example, if a user reaches 50% of their goal, a message such as "You're halfway there, keep trying!" will appear on the device.

[1405] Subscription management and purchasing support

[1406] Users can check their subscription information or send requests to change their plan from their device. The server processes the requests and returns the updated information to the device. It also generates promotional information for special diet foods and training equipment and sends it to the device. Users can then review the information and complete the purchase process.

[1407] For example, if a user wants to upgrade to a premium plan, they send a request from their device, the server processes it, and notifies them of the change in subscription fee.

[1408] Through these features, the present invention provides users with comprehensive, personalized training and nutritional advice to help maintain and improve their long-term health.

[1409] The processing flow will be explained below.

[1410] User authentication and profile management

[1411] Step 1:

[1412] The user puts on the VR headset and the login screen appears.

[1413] Step 2:

[1414] The user enters a username and password.

[1415] Step 3:

[1416] The terminal transmits the entered authentication information to the server.

[1417] Step 4:

[1418] The server checks the user's credentials against a database and generates an authentication token on success.

[1419] Step 5:

[1420] The server returns an authentication token to the device.

[1421] Step 6:

[1422] The device receives the authentication token and displays a message indicating successful login.

[1423] Running a training session

[1424] Step 1:

[1425] The user launches a dedicated application to begin a training session.

[1426] Step 2:

[1427] The device retrieves the latest training menu from the server.

[1428] Step 3:

[1429] The device displays the training menu to the user and starts the session.

[1430] Step 4:

[1431] The device captures the user's movements with a camera and transmits the data to a server in real time.

[1432] Step 5:

[1433] AI on the server analyzes the captured data and evaluates the form and progress of the movements.

[1434] Step 6:

[1435] The server sends the evaluation results and feedback to the device.

[1436] Step 7:

[1437] The device displays feedback to the user in real time.

[1438] Providing dietary advice and planning

[1439] Step 1:

[1440] The user inputs and submits questions about meals via the terminal.

[1441] Step 2:

[1442] The server generates an appropriate meal plan based on the user's profile and current goals.

[1443] Step 3:

[1444] The server sends the generated meal plan to the device.

[1445] Step 4:

[1446] The device will display the meal plan to the user and provide links to recipes and ingredients.

[1447] Progress Tracking and Analysis

[1448] Step 1:

[1449] Users enter their daily weight and dietary information on the device.

[1450] Step 2:

[1451] The terminal transmits the input data to the server.

[1452] Step 3:

[1453] The progress is analyzed based on the data collected by the server.

[1454] Step 4:

[1455] The server generates weekly and monthly reports.

[1456] Step 5:

[1457] The device displays the generated reports to the user in the form of visual graphs and charts.

[1458] Motivation and notifications

[1459] Step 1:

[1460] The server generates appropriate motivational messages based on the user's progress data.

[1461] Step 2:

[1462] The server generates a message and sends it to the terminal.

[1463] Step 3:

[1464] The device displays messages to the user to encourage them to maintain their motivation.

[1465] Subscription management and purchasing support

[1466] Step 1:

[1467] The user interacts with their device to check their subscription status.

[1468] Step 2:

[1469] The device requests subscription information from the server.

[1470] Step 3:

[1471] The server checks the user's subscription status and sends that information back to the device.

[1472] Step 4:

[1473] The device displays the subscription status to the user.

[1474] Step 5:

[1475] The server generates promotional information for special diet foods and training equipment and transmits it to the terminal.

[1476] Step 6:

[1477] The device displays promotional information to the user and assists them in the purchase process.

[1478] In this way, through each step of the process, users can efficiently receive authentication, training, dietary guidance, progress management, motivation maintenance, as well as subscription management and purchasing support.

[1479] Example 1

[1480] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1481] There is a lack of a means for virtual reality training systems to allow users to receive individually supervised training and nutritional guidance at home. There is also a need for a function that evaluates users' movements in real time and provides appropriate feedback. Furthermore, there is a need to collect and analyze progress data and provide visual feedback that allows users to effectively self-manage. There is a need to provide a system that solves these issues and helps users maintain motivation and improve their long-term health.

[1482] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1483] In this invention, the server includes means for receiving and authenticating input information from a user, means for providing a training program through a virtual reality device, means for tracking the user's movements and evaluating them in real time, means for generating a nutritional management and meal plan for the user, means for collecting and analyzing the user's progress data, means for providing the user with feedback to maintain motivation, means for receiving dietary questions from the user and generating and presenting a meal plan using a generation AI, and means for capturing the user's training movements in real time and having the generation AI evaluate and provide feedback. This allows the user to receive individually managed training and dietary advice at home, train while receiving feedback in real time, and improve their long-term health while visually understanding their progress.

[1484] (1) "Information entered by the user" refers to all information provided by the user to the system, such as login information, questions, training data, and dietary data.

[1485] (2) "Authentication" refers to the process of verifying a user's identity based on the login information provided by the user.

[1486] (3) "Virtual reality device" means a device worn by a user that allows the user to access a virtual space and receive training or other instruction.

[1487] (4) "Training Program" means a plan for teaching a user a series of movements or exercises that are customized based on the user's needs and goals.

[1488] (5) “Tracking” refers to recording a user’s performance, such as their physical movements and posture.

[1489] (6) "Real-time evaluation" refers to the process of instantly analyzing user behavior data and generating evaluation results.

[1490] (7) “Nutrition management” refers to managing the user’s dietary content and nutritional intake status.

[1491] (8) "Meal Plan" means a plan that indicates the recommended meal content and timing based on a user's health status and goals.

[1492] (9) “Progress Data” refers to data such as the user’s training history, weight fluctuations, and dietary information.

[1493] (10) "Motivational feedback" refers to encouraging messages or notifications provided to encourage users to continue making efforts.

[1494] (11) "Dietary Questions" refers to questions that users ask the system about proper diet and nutrition.

[1495] (12) “Generative AI” refers to an artificial intelligence model that generates appropriate training programs and meal plans based on user input.

[1496] (13) “Capture” refers to recording a user’s movements and postures using a camera or sensor.

[1497] (14) "Feedback" means that the system provides specific improvements or instructions to the user regarding their performance.

[1498] The present invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide individual training and dietary advice. This system has the following main functions:

[1499] User authentication and profile management

[1500] The user puts on the virtual reality device and accesses the login screen. The user enters their username and password, and the device sends the authentication information to the server. The server checks the authentication information in a database, and if authentication is successful, it generates an authentication token and sends it back to the device along with a welcome message. The device displays this. Specifically, when the user opens the application, enters their login information, and presses the submit button, a message appears stating that authentication has been completed in a few seconds and that they will proceed to the next screen.

[1501] Running a training session

[1502] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by the generation AI based on the user's profile and goals. The device displays this session content. The user's movements are captured by a camera and sent to the server in real time. The generation AI on the server analyzes this, evaluates form and progress, and sends and displays any necessary instructions and corrections to the device in real time. For example, if a user's posture is poor while doing squats, the AI ​​will immediately provide audio and visual instructions such as, "Bend your knees a little more."

[1503] Providing dietary advice and planning

[1504] When a user sends a question about their diet through their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and displays it on the device. Related recipes and links to purchase ingredients are also displayed. This allows users to continue eating healthy meals without having to worry about choosing ingredients or cooking methods. For example, if a user asks, "What would be good for dinner tonight?" the server will suggest "grilled salmon and vegetables" and display the necessary ingredients and recipe.

[1505] Progress Tracking and Analysis

[1506] Users enter their daily weight and dietary information on their device. The server collects and analyzes this data and compiles weekly and monthly progress reports. The reports are displayed on the device in the form of visual graphs and charts, making it easier for users to understand their progress. For example, when a user enters their weight, the server records it and displays a graphical progress report on the device at the end of the week.

[1507] Motivation and notifications

[1508] The server generates appropriate motivational messages and reminders based on the user's progress and sends them to the device, helping the user to stay motivated. For example, when a user reaches 50% of their goal, a message such as "You're halfway there, keep trying!" will appear on the device.

[1509] Subscription management and purchasing support

[1510] Users can check their subscription information on their device and send a plan change request. The server processes this and returns the updated information to the device. It also generates promotional information for specific nutritional products or training equipment and sends it to the device. The user can review this information and complete the purchase process. For example, if a user wants to upgrade to a premium plan, they can send a request from their device, and the server processes it and notifies them of the change in subscription fee.

[1511] Hardware and software used

[1512] Virtual reality devices (e.g., VR headsets)

[1513] Device (e.g. smartphone or tablet)

[1514] Server (cloud-based database system, e.g., cloud database)

[1515] Generative AI (e.g., generative AI models)

[1516] Examples of prompt statements

[1517] "Please log in to your account via user authentication to view the training menu."

[1518] "Provide real-time postural instructions as the user performs the squat."

[1519] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1520] System program processing flow and specific operations

[1521] User authentication and profile management

[1522] Step 1:

[1523] The user puts on the VR headset and accesses the login screen.

[1524] Input: The user puts on a VR headset and opens the system's login screen.

[1525] Output: The login screen appears in the user's field of view.

[1526] Step 2:

[1527] The user enters their username and password and clicks the submit button.

[1528] Input: Username and password input information.

[1529] Output: The device sends this information to the server.

[1530] Step 3:

[1531] The server checks the authentication information against a database and generates an authentication token.

[1532] Input: The username and password sent from the device.

[1533] Data processing / calculation: The server checks the authentication information stored in the database. If authentication is successful, it generates an authentication token. If it fails, it generates an error message.

[1534] Output: An authentication token or an error message is generated.

[1535] Step 4:

[1536] The server returns a welcome message to the terminal along with an authentication token.

[1537] Input: Authentication token.

[1538] Output: An authentication token and a welcome message are sent to the terminal.

[1539] Step 5:

[1540] The device displays a welcome message.

[1541] Input: Authentication token and welcome message.

[1542] Output: A welcome message is displayed on the user's screen.

[1543] What happens: Once the user enters their login details and is authenticated, the message "Welcome, [username]" is displayed.

[1544] Running a training session

[1545] Step 6:

[1546] A user requests to start a training session.

[1547] Input: Press the Start Training button.

[1548] Output: A training session start request is sent from the device to the server.

[1549] Step 7:

[1550] The terminal obtains the latest training menu from the server.

[1551] Input: Training session start request.

[1552] Data processing / calculation: The server uses generative AI to generate a customized training menu based on the user's profile and goals.

[1553] Output: Send the latest training menu to the device.

[1554] Step 8:

[1555] The training menu acquired by the device is displayed.

[1556] Enter: your latest training menu.

[1557] Output: The training menu is displayed to the user.

[1558] What happens: The user's training screen displays the latest training program.

[1559] Step 9:

[1560] The user's training movements are captured by a camera and sent to a server.

[1561] Input: Footage of user in action.

[1562] Data processing / calculation: The device captures the motion video in real time and sends it to the server.

[1563] Output: The moving image is sent to the server.

[1564] Step 10:

[1565] A generation AI on the server analyzes the motion footage and generates feedback.

[1566] Input: Motion footage.

[1567] Data processing / calculation: The server's generated AI analyzes the video data, evaluates form and progress, and generates appropriate feedback.

[1568] Output: Feedback data.

[1569] Step 11:

[1570] The server generates feedback and sends it to the terminal, which displays it.

[1571] Input: Feedback data.

[1572] Output: Sends feedback to the device and is displayed to the user.

[1573] Specific action: If the user has poor posture while performing a squat, real-time instructions will be displayed, such as "Bend your knees a bit more."

[1574] Providing dietary advice and planning

[1575] Step 12:

[1576] Users send questions about meals via their device.

[1577] Input: Food questions.

[1578] Output: The question is sent from the terminal to the server.

[1579] Step 13:

[1580] The server receives the questions and the generative AI generates the optimal meal plan.

[1581] Input: Food questions.

[1582] Data processing / calculation: The server's generation AI generates a meal plan based on the user's goals and current nutritional status.

[1583] Output: The generated meal plan.

[1584] Step 14:

[1585] The server sends the meal plan to the device, which displays it.

[1586] Input: The generated meal plan.

[1587] Output: The meal plan is sent to the device.

[1588] What it does: When a user asks, "What's good for dinner tonight?" it suggests "grilled salmon and vegetables" and displays the ingredients and recipe.

[1589] (Application example 1)

[1590] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1591] While training and dietary guidance systems using virtual reality devices allow users to receive personalized training and meal plans, they lack face-to-face support when purchasing physical products. Furthermore, new methods are needed to more effectively maintain motivation and comprehensive health management through interactive activities in virtual spaces.

[1592] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1593] In this invention, the server includes means for receiving and authenticating input information from a user, means for providing a training program through a virtual reality device, means for tracking and evaluating the user's movements in real time, means for generating nutritional management and meal plans for the user, means for collecting and analyzing the user's progress data, means for providing feedback to the user to maintain motivation, and means for enabling the purchase of fitness equipment and health foods in a virtual store, thereby enabling the user to seamlessly purchase physical products as well as receive comprehensive training support within the virtual reality space.

[1594] "Means for receiving and authenticating input information from users" refers to the function of collecting personal authentication information (e.g., user name and password) provided by users through virtual reality devices and verifying and authenticating it on the server.

[1595] "Means for providing a training program through a virtual reality device" refers to a function that allows a user to display and execute individual training content through a virtual reality device.

[1596] "Means for tracking user movements and evaluating them in real time" refers to a function that uses cameras and sensors to monitor the user's physical movements in real time, analyzes them, and evaluates their movements.

[1597] "Means for generating a user's nutritional management and meal plan" refers to a function that generates an optimal meal plan based on the user's health goals and current nutritional status and provides related information.

[1598] "Means for collecting and analyzing user progress data" refers to a function that collects data such as weight, dietary content, and exercise information provided by users on a daily basis, and analyzes this data to understand their progress.

[1599] "Means of providing users with feedback to maintain their motivation" refers to a function that provides messages and reminders to maintain ongoing motivation based on the user's progress data.

[1600] "Means for enabling the purchase of fitness equipment and health foods as a virtual store" refers to a function that allows users to purchase fitness equipment and health foods within a virtual reality space.

[1601] This invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide individual training and dietary advice. The main components of the system are as follows:

[1602] Hardware and Software Configuration

[1603] This system consists of the following hardware and software:

[1604] Hardware:

[1605] Virtual reality headsets (e.g., Oculus Rift, HTC Vive)

[1606] Tracking Camera

[1607] Sensors that detect user movement

[1608] software:

[1609] vr_sdk: A library for managing the display and interaction of VR content.

[1610] health_ai_sdk: An AI library that generates training and meal plans

[1611] e_commerce_sdk: A library for subscription management and purchasing support

[1612] User authentication and profile management

[1613] The user puts on the virtual reality headset and accesses the login screen. The user enters their username and password, and the device sends these credentials to the server. The server checks the user's credentials in a database and generates an authentication token if successful. If authentication is successful, the server returns a welcome message along with the authentication token to the device, which is then displayed.

[1614] Running a training session

[1615] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by generative AI based on the user's profile and goals. The device then displays the session content based on this. The user's movements are captured by a camera and sent to the server in real time. The AI ​​on the server analyzes this, evaluates their form and progress, and sends and displays instructions and corrections to the device in real time.

[1616] Providing dietary advice and planning

[1617] When users submit dietary questions via their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device. Related recipes and links to purchase ingredients are also displayed. This allows users to continue eating healthy without having to worry about choosing ingredients or cooking methods.

[1618] Progress Tracking and Analysis

[1619] Users enter their daily weight and dietary information on their device. The server collects this data and analyzes their progress. Weekly and monthly reports are generated and displayed on the device in the form of visual graphs and charts. This allows users to understand their progress and stay motivated to reach their next goal.

[1620] Motivation and notifications

[1621] The server generates appropriate motivational messages and reminders based on the user's progress data and sends them to the device, helping the user to stay motivated.

[1622] Virtual store features

[1623] It provides a virtual store where users can purchase fitness equipment and health foods in a virtual reality space. Users can access the virtual store through a VR headset and purchase the products they need. At that time, generative AI provides advice on product selection and assists with the purchase process.

[1624] As a specific example, a user uses the system as follows.

[1625] If you ask, "Please suggest a meal plan for today," the AI ​​will suggest "grilled salmon and vegetables" and display the necessary ingredients and recipe.

[1626] When you request to "start a training session," a customized training plan will be presented and your form will be corrected in real time.

[1627] As described above, this system provides users with comprehensive training and health management, realizing services that make the most of virtual reality space.

[1628] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1629] Step 1:

[1630] User authentication

[1631] Input: Username and Password

[1632] Process: The user puts on the virtual reality headset and enters their login information (username and password) on the device. The device sends this authentication information to the server. The server checks the user's authentication information against its database, and if authentication is successful, generates an authentication token and returns it to the device.

[1633] Output: Authentication token and welcome message

[1634] Step 2:

[1635] Providing training programs

[1636] Input: User profile and goals

[1637] Processing: The user gives instructions to the device to start a training session. The device retrieves the latest training menu from the server. The server uses generative AI to generate a customized training plan based on the user's profile and goals and sends it to the device. The device displays the training content.

[1638] Output: Customized training plan

[1639] Step 3:

[1640] User behavior tracking and evaluation

[1641] Input: User behavior data

[1642] Processing: The user's movements are captured by a tracking camera and sensors. The device sends this data to a server in real time. AI on the server analyzes the movement data and evaluates form and progress. If necessary, corrections and feedback are generated and sent to the device. The device then provides audio and visual instructions to the user.

[1643] Output: Real-time evaluation feedback

[1644] Step 4:

[1645] Providing dietary advice and planning

[1646] Input: Food Question

[1647] Processing: The user submits a dietary question via the device. The server uses generative AI to generate an optimal meal plan based on the user's goals and current nutritional status. Related recipes and links to purchase ingredients are also generated and sent to the device. The device displays this information along with the meal plan.

[1648] Output: Optimal meal plan and related information

[1649] Step 5:

[1650] Progress Tracking and Analysis

[1651] Input: Daily weight, dietary information

[1652] Processing: The user enters their daily weight and dietary information into the device. The device sends this data to the server. The server collects the data and analyzes their progress. It generates weekly and monthly progress reports and sends them to the device in the form of visual graphs and charts. The device displays these reports.

[1653] Output: Visual progress report

[1654] Step 6:

[1655] Motivation and notifications

[1656] Input: Progress data

[1657] Processing: The server generates motivational messages and reminders based on the user's progress data. These messages are sent to the user and displayed on the device as appropriate.

[1658] Output: Motivational messages and reminders

[1659] Step 7:

[1660] Use of virtual stores

[1661] Input: Product purchase request

[1662] Processing: The user inputs a request to purchase fitness equipment or health foods into the device in the virtual reality space. The device sends the request to the server, which generates corresponding product information and sends it to the device. The device displays the product information, and the user completes the purchase process. The generation AI provides advice on product selection.

[1663] Output: Purchase confirmation and product information

[1664] Through these steps, the system provides users with comprehensive training and health management, realizing services that make the most of virtual reality space.

[1665] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1666] The present invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide individual training and dietary advice, and further combines it with an emotion engine to recognize the user's emotions. The system includes user authentication, training session execution, dietary advice and planning, progress tracking and analysis, motivation maintenance and notifications, subscription management and purchasing support, and the emotion engine.

[1667] User authentication and profile management

[1668] The user puts on the VR headset and accesses the login screen. The user enters their username and password. The device sends this authentication information to the server. The server checks the user's authentication information in the database and generates an authentication token if successful. If authentication is successful, the server returns a welcome message along with the authentication token to the device, which is then displayed.

[1669] Running a training session

[1670] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by generative AI based on the user's profile and goals. The device then displays the session content based on this. The user's movements are captured by a camera and sent to the server in real time. The AI ​​on the server analyzes this, evaluates their form and progress, and sends and displays instructions and corrections to the device in real time.

[1671] Introducing the Emotion Engine

[1672] The system incorporates an emotion engine that allows the device to recognize emotions from the user's facial expressions and tone of voice. This emotion data is sent to the server and dynamically reflected in feedback and training content. For example, if the user expresses fatigue, the intensity of training can be automatically adjusted.

[1673] For example, when a user is doing squats, a camera captures the user's facial expressions, and if the emotion engine analyzes this and determines that the user is "tired," it will suggest reducing the intensity of the next exercise.

[1674] Providing dietary advice and planning

[1675] When users submit dietary questions via their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device. Related recipes and links to purchase ingredients are also displayed. If the user is not motivated to eat, the emotional engine suggests easy, effortless meal plans.

[1676] Progress Tracking and Analysis

[1677] Users enter their daily weight and dietary habits on their device. The server collects this data and analyzes their progress. Weekly and monthly reports are generated and displayed on the device in the form of visual graphs and charts. Data recognized by the emotion engine is also reflected in the progress report, allowing users to check their psychological state.

[1678] For example, a user can enter their weight, the server records it, and at the end of the week, a graphical progress report is displayed on the device. The emotion engine also adds the user's emotional trends to the report.

[1679] Motivation and notifications

[1680] The server generates appropriate motivational messages and reminders based on the user's progress data and sends them to the device. Based on the recognition results of the emotion engine, the feedback messages are updated accordingly to provide optimal support for the user's current situation.

[1681] For example, if a user expresses a lack of motivation, an encouraging message such as "Take a break and try again!" will be displayed on the device.

[1682] Subscription management and purchasing support

[1683] Users can check their subscription information or send requests to change their plan from their device. The server processes the requests and returns the updated information to the device. It also generates promotional information for special diet foods and training equipment and sends it to the device. Users can then review the information and complete the purchase process.

[1684] For example, if a user wants to upgrade to a premium plan, they send a request from their device, the server processes it, and notifies them of the change in subscription fee.

[1685] Through these features, the present invention provides users with comprehensive, personalized training and nutritional guidance, helping them maintain and improve their long-term health while also taking into account their emotional state.

[1686] The processing flow will be explained below.

[1687] User authentication and profile management

[1688] Step 1:

[1689] The user puts on the VR headset and the login screen appears.

[1690] Step 2:

[1691] The user enters a username and password.

[1692] Step 3:

[1693] The terminal transmits the entered authentication information to the server.

[1694] Step 4:

[1695] The server checks the user's credentials against a database and generates an authentication token on success.

[1696] Step 5:

[1697] The server returns an authentication token to the device.

[1698] Step 6:

[1699] The device receives the authentication token and displays a message indicating successful login.

[1700] Running a training session

[1701] Step 1:

[1702] The user launches a dedicated application to begin a training session.

[1703] Step 2:

[1704] The device retrieves the latest training menu from the server.

[1705] Step 3:

[1706] The device displays the training menu to the user and starts the session.

[1707] Step 4:

[1708] The device captures the user's movements with a camera and transmits the data to a server in real time.

[1709] Step 5:

[1710] AI on the server analyzes the captured data and evaluates the form and progress of the movements.

[1711] Step 6:

[1712] The server sends the evaluation results and feedback to the device.

[1713] Step 7:

[1714] The device displays feedback to the user in real time.

[1715] Introducing the Emotion Engine

[1716] Step 1:

[1717] The device captures the user's facial expressions and tone of voice.

[1718] Step 2:

[1719] The device sends the captured data to the server.

[1720] Step 3:

[1721] The server's emotion engine analyzes the data and recognizes the user's emotional state.

[1722] Step 4:

[1723] The server adjusts the training content and feedback based on the recognized emotional state.

[1724] Step 5:

[1725] The server sends appropriate feedback and training content to the device.

[1726] Step 6:

[1727] The device displays feedback and training adjustments to the user.

[1728] Providing dietary advice and planning

[1729] Step 1:

[1730] The user inputs and submits questions about meals via the terminal.

[1731] Step 2:

[1732] The server generates an appropriate meal plan based on the user's profile and current goals.

[1733] Step 3:

[1734] The server sends the generated meal plan to the device.

[1735] Step 4:

[1736] The device will display the meal plan to the user and provide links to recipes and ingredients.

[1737] Step 5:

[1738] The server adjusts the meal plan based on the emotional state recognized by the emotion engine.

[1739] Progress Tracking and Analysis

[1740] Step 1:

[1741] Users enter their daily weight and dietary information on the device.

[1742] Step 2:

[1743] The terminal transmits the input data to the server.

[1744] Step 3:

[1745] The progress is analyzed based on the data collected by the server.

[1746] Step 4:

[1747] The server generates weekly and monthly reports.

[1748] Step 5:

[1749] The device displays the generated reports to the user in the form of visual graphs and charts.

[1750] Step 6:

[1751] The server also reflects data recognized by the emotion engine in the progress report.

[1752] Motivation and notifications

[1753] Step 1:

[1754] The server generates appropriate motivational messages based on the user's progress data.

[1755] Step 2:

[1756] The server generates a message and sends it to the terminal.

[1757] Step 3:

[1758] The terminal displays the message to the user.

[1759] Step 4:

[1760] The server changes the feedback message in a timely manner according to the emotional state of the user recognized by the emotion engine.

[1761] Subscription management and purchasing support

[1762] Step 1:

[1763] The user interacts with their device to check their subscription status.

[1764] Step 2:

[1765] The device requests subscription information from the server.

[1766] Step 3:

[1767] The server checks the user's subscription status and sends that information back to the device.

[1768] Step 4:

[1769] The device displays the subscription status to the user.

[1770] Step 5:

[1771] The server generates promotional information for special diet foods and training equipment and transmits it to the terminal.

[1772] Step 6:

[1773] The device displays promotional information to the user and assists them in the purchase process.

[1774] Through these specific processing steps, users can efficiently receive authentication, training, dietary advice, progress management, motivation maintenance, subscription management and purchasing support. By combining this with the emotion engine, optimal support tailored to individual needs can be provided.

[1775] Example 2

[1776] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1777] Traditional training systems lack the ability to generate personalized training programs and meal plans, and are unable to reflect the user's emotional state and progress data in real time. They also lack effective motivation and feedback, resulting in little improvement in the user experience. Furthermore, subscription management requires manual, time-consuming tasks.

[1778] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1779] In this invention, the server includes means for receiving and authenticating input information from a user, means for providing a training program through a virtual reality device, means for tracking and evaluating the user's movements in real time, means for recognizing the user's emotional state and dynamically adjusting the training content based thereon, means for generating nutritional management and meal plans for the user, means for collecting and analyzing the user's progress data, means for providing feedback to the user to maintain motivation, and means for managing and changing subscription information. This allows for individualized responses to each user's needs, enabling effective training and diet management while maintaining motivation. Furthermore, the system automatically manages subscriptions, reducing the burden on the user.

[1780] "User authentication" is the process of receiving input from a user and verifying their access rights to a system.

[1781] A "virtual reality device" is a hardware device that allows a user to immerse themselves in a three-dimensional virtual space.

[1782] "Training Program" means a series of exercises designed to improve a User's fitness and health.

[1783] "Tracking" is the process of recording and analyzing user actions and behavior in real time.

[1784] "Real-time evaluation" is the process of instantly analyzing a user's behavioral data and providing appropriate feedback.

[1785] "Emotional state" refers to a user's current mental and emotional state.

[1786] "Dynamic adjustment" refers to the system automatically changing training content and conditions based on the user's real-time data.

[1787] "Nutrition management" is the process of monitoring a user's diet and nutritional intake and providing an optimal nutrition plan.

[1788] A "meal plan" is a meal schedule and content designed based on a user's health goals.

[1789] "Progress Data" is data that shows the user's training and health management history and results.

[1790] "Maintaining motivation" refers to support activities to increase users' motivation to continue training and health management over the long term.

[1791] "Feedback" refers to advice or information provided based on a user's behavior or situation.

[1792] "Subscription Information" refers to the contract information and plan for the service that the User is using.

[1793] "Management and Change" is the process by which the system maintains subscription information and updates it as needed.

[1794] The present invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide personalized training and dietary advice. The system includes user authentication, training session execution, dietary advice and planning, progress tracking and analysis, motivation and notifications, subscription management and purchasing support, and an emotion engine.

[1795] User authentication and profile management

[1796] The user puts on the VR headset and accesses the login screen. The user enters a username and password. The device sends this authentication information to the server. The server checks the user's authentication information in a database and generates an authentication token if successful. If authentication is successful, the server returns a welcome message to the device along with the authentication token, which is then displayed. The software used includes a database management system and an authentication system.

[1797] Running a training session

[1798] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by generative AI based on the user's profile and goals. The device then displays the session content based on this. The user's movements are captured by a camera and sent to the server in real time. The AI ​​on the server analyzes the captured images, evaluates their form and progress, and sends and displays instructions and corrections to the device in real time. The hardware used includes a VR headset, camera, and internet-connected device. The software includes a movement analysis algorithm and a real-time data processing system.

[1799] Introducing the Emotion Engine

[1800] The device recognizes emotions through the user's facial expressions and tone of voice. This emotional data is sent to a server and dynamically reflected in feedback and training content. For example, if the user expresses fatigue, the intensity of the training can be automatically adjusted. For example, while the user is doing squats, the camera captures the user's facial expressions. If the emotion engine analyzes this and determines that the user is "fatigued," the device will suggest lowering the intensity of the next exercise. The software used includes an emotion recognition algorithm.

[1801] Providing dietary advice and planning

[1802] When users submit dietary questions via their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device. Related recipes and links to purchase ingredients are also displayed. If the user is not motivated to eat, the emotional engine suggests easy, effortless meal plans.

[1803] Progress Tracking and Analysis

[1804] Users input their daily weight and dietary habits on their device. The server collects this data and analyzes their progress. Weekly and monthly reports are generated and displayed on the device in the form of visual graphs and charts. Data recognized by the emotion engine is also reflected in the progress report, allowing users to check their psychological state. For example, when a user inputs their weight, the server records it and displays a graphed progress report on the device at the end of the week.

[1805] Motivation and notifications

[1806] The server generates appropriate motivational messages and reminders based on the user's progress data and sends them to the device. Based on the recognition results of the emotion engine, the feedback message is updated accordingly to provide optimal support for the user's current situation. For example, if the user expresses a lack of motivation, an encouraging message such as "Take a short break and try again!" will be displayed on the device.

[1807] Subscription management and purchasing support

[1808] Users can check subscription information from their device or send a request to change their plan. The server processes this and returns the updated information to the device. It also generates promotional information for special diet foods or training equipment and sends it to the device. The user can review this information and then complete the purchase process. For example, if a user wants to upgrade to a premium plan, they send a request from their device, and the server processes it and notifies them of the change in subscription fee.

[1809] Example prompts to input to the generative AI model

[1810] "The user has just recovered from an illness and wants to start exercising again. Please create an initial training menu that is not too strenuous."

[1811] "Propose meal plans that help users maintain positive emotions."

[1812] Through these functions, the present invention provides users with comprehensive, personalized training and dietary advice, helping them maintain and improve their long-term health while also taking into account their emotional state.

[1813] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1814] Specific explanation of program processing

[1815] User authentication and profile management

[1816] Step 1:

[1817] The user puts on the VR headset and accesses the login screen.

[1818] How it works: The user powers on the VR headset and launches the dedicated application.

[1819] Input: User login request.

[1820] Output: Login screen displayed.

[1821] Step 2:

[1822] The user enters a username and password.

[1823] How it works: The user enters their credentials using the keyboard in VR.

[1824] Input: Username and Password.

[1825] Output: Sending authentication information.

[1826] Step 3:

[1827] The device sends the authentication information to the server.

[1828] How it works: Your device encrypts and sends your authentication information to a server over the internet.

[1829] Input: Encrypted credentials.

[1830] Output: Sending authentication information to the server.

[1831] Step 4:

[1832] The server checks the authentication information against its database and generates an authentication token on success.

[1833] What it does: The server queries its database to see if the authentication information matches, and if successful, generates an authentication token.

[1834] Input: Your credentials.

[1835] Output: Generates an authentication token.

[1836] Step 5:

[1837] The server returns a welcome message along with the authentication token to the terminal and displays it.

[1838] Action: The device displays a welcome message in the VR environment.

[1839] Input: Authentication token.

[1840] Output: Display a welcome message.

[1841] Running a training session

[1842] Step 1:

[1843] The user attempts to start a training session.

[1844] How it works: The user selects the Start Training Session button from a menu within the VR environment.

[1845] Enter: Click to start a training session.

[1846] Output: Start preparing for training session.

[1847] Step 2:

[1848] The device retrieves the latest training menu from the server.

[1849] Operation: The device sends an API request to the server to retrieve the training menu.

[1850] Input: Training menu request.

[1851] Output: Get training menu.

[1852] Step 3:

[1853] The device displays the training session.

[1854] Operation: The device displays training content in the VR environment based on the acquired menu information.

[1855] Enter: Training Menu.

[1856] Output: Display of training content.

[1857] Step 4:

[1858] The camera captures the user's movements and transmits them to a server in real time.

[1859] Actions: The device camera captures the user's actions and sends the data to the server.

[1860] Input: User behavior data.

[1861] Output: Sending operational data.

[1862] Step 5:

[1863] The AI ​​on the server analyzes the movements, evaluates the form and progress, and sends instructions and corrections to the device in real time.

[1864] How it works: The server's AI performs image recognition and motion analysis, and sends the evaluation results back to the device.

[1865] Input: Operational data.

[1866] Output: Evaluation results and feedback.

[1867] Introducing the Emotion Engine

[1868] Step 1:

[1869] The device recognizes the user's facial expressions and tone of voice.

[1870] How it works: The microphone and camera capture your audio and video data and analyze it.

[1871] Input: User's facial expression and voice data.

[1872] Output: Emotion data.

[1873] Step 2:

[1874] The emotion data is sent to the server.

[1875] How it works: The device encrypts and transmits emotion data to the server.

[1876] Input: Emotion data.

[1877] Output: Send emotion data to the server.

[1878] Step 3:

[1879] An emotion engine on the server analyzes the data and dynamically reflects feedback and training content.

[1880] How it works: The emotion engine processes the data and generates feedback to adjust the intensity and content of your training.

[1881] Input: Emotion data.

[1882] Output: Adjusted training content and feedback.

[1883] For example, if the emotion engine determines that a user is "tired" while doing squats, it will suggest reducing the intensity of the next exercise.

[1884] Providing dietary advice and planning

[1885] Step 1:

[1886] Users send questions about meals via their device.

[1887] How it works: The user speaks or texts a dietary question and hits submit.

[1888] Input: Food questions.

[1889] Output: Sends the question to the server.

[1890] Step 2:

[1891] AI generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device.

[1892] How it works: A server-generated AI analyzes the questions and the user's profile data to generate a meal plan.

[1893] Input: User question and profile data.

[1894] Output: Meal plan.

[1895] Step 3:

[1896] Show related recipes and links to buy ingredients.

[1897] What it does: Based on the generated meal plan, it displays related recipes and links to buy ingredients on your device.

[1898] Enter: meal plan.

[1899] Output: Recipe and purchase link.

[1900] Progress Tracking and Analysis

[1901] Step 1:

[1902] Users enter their daily weight and dietary information on the device.

[1903] How it works: The user fills out the form with their weight and dietary information and presses the submit button.

[1904] Input: Weight and diet.

[1905] Output: Sending data to the server.

[1906] Step 2:

[1907] The server collects the data and analyzes the progress.

[1908] How it works: The server saves the input data to a database and analyzes the progress.

[1909] Input: User weight and dietary data.

[1910] Output: Analysis results.

[1911] Step 3:

[1912] Weekly and monthly reports are generated and displayed on the device.

[1913] How it works: The server generates reports based on the progress data and displays them on the device in the form of charts and graphs.

[1914] Input: Progress data.

[1915] Output: A visual report.

[1916] For example, users can enter their weight and a graphed progress report will be displayed on the device over the weekend.

[1917] Motivation and notifications

[1918] Step 1:

[1919] The server generates motivational messages and reminders based on the progress data and sends them to the device.

[1920] Operation: The server uses the appropriate reminder function to create a notification message and send it to the device.

[1921] Input: Progress data.

[1922] Output: Motivational messages and reminders.

[1923] Step 2:

[1924] The feedback message is changed appropriately based on the recognition results of the emotion engine.

[1925] How it works: Based on the results recognized by the emotion engine, the server dynamically generates message content and sends it to the device.

[1926] Input: Emotion data.

[1927] Output: A properly adjusted feedback message.

[1928] For example, if a user expresses feelings of lack of motivation, an encouraging message such as "Take a short break and try again!" will be displayed on the device.

[1929] Subscription management and purchasing support

[1930] Step 1:

[1931] The user checks their subscription information on their device and submits a plan change request.

[1932] How it works: A user opens the subscription information page, selects the plan they want to change to, and submits it.

[1933] Input: View and change subscription information requests.

[1934] Output: Sending the request to the server.

[1935] Step 2:

[1936] The server processes the request and returns the updated results to the device.

[1937] Operation: The server processes the request, generates an update result, and notifies the device.

[1938] Input: Subscription change request.

[1939] Output: The update result.

[1940] Step 3:

[1941] Special promotional information is generated and sent to the terminal.

[1942] How it works: The server generates promotional information for special diet foods and training equipment and sends it to the device.

[1943] Input: Request to generate promotion information.

[1944] Output: Sending promotional information to device.

[1945] For example, if a user wants to upgrade to a premium plan, they send a request from their device, the server processes it, and notifies them of the change in subscription fee.

[1946] (Application example 2)

[1947] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1948] While existing training support systems are effective in tracking users' movements and progress and providing personalized training programs and meal plans, they struggle to properly recognize users' emotional state and dynamically adjust feedback and support accordingly. Furthermore, they lack the systems to further improve the user experience when receiving real-time training and meal guidance in physical stores. This makes it difficult for users to maintain motivation and follow meal plans, reducing the effectiveness of long-term health management.

[1949] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1950] In this invention, the server includes means for receiving and authenticating input information from a user, means for providing a training program through a virtual reality device, means for tracking and evaluating the user's movements in real time, means for analyzing the user's emotional data through the virtual reality device, means for dynamically adjusting training intensity based on the emotional data, means for generating a nutritional management and meal plan for the user, means for displaying a visual progress report based on the user's progress data, means for providing feedback to the user to maintain motivation, and means for using the virtual reality device and the emotional analysis means in a physical store, thereby enabling dynamic training adjustments and individually customized fitness and dietary advice based on the user's emotional state.

[1951] "User Input" refers to all data that a user enters into the system, such as login information, training instructions, or meal plan questions.

[1952] "Virtual reality device" refers to equipment that allows users to experience a virtual space, including VR headsets and corresponding controllers.

[1953] A "training program" refers to a customized exercise menu based on the user's health condition and goals.

[1954] "Means for tracking user behavior and evaluating it in real time" refers to the ability to capture user behavior using cameras or sensors and analyze the data in real time.

[1955] "Emotional data" refers to data that indicates the psychological state of a user, derived from facial expressions, tone of voice, etc.

[1956] "Means for dynamically adjusting training intensity based on emotional data" refers to a function that changes the content and intensity of training in real time according to the user's emotional state.

[1957] "Means for generating nutritional management and meal plans" refers to the functionality that generates optimal meal plans based on the user's health status and goals.

[1958] "Progress data" refers to data entered by the user, such as weight, dietary habits, and training history.

[1959] "Means for displaying visual progress reports" refers to the ability to provide progress data to users visually in the form of graphs or charts.

[1960] "Means of providing motivational feedback" refers to features that provide messages such as encouragement or reminders based on the user's progress or emotional state.

[1961] "Means for using virtual reality devices and emotion analysis means within a physical store" refers to the function in which users use a VR headset within a physical store and receive training and dietary advice while undergoing emotion analysis.

[1962] The present invention is a system that allows users to use virtual reality devices in a physical store and receive training and dietary advice based on a generative AI model. The system also includes a function that analyzes users' emotional data in real time and provides optimal feedback to the user.

[1963] Hardware and software used

[1964] VR headset: A device that allows users to experience virtual reality. Examples include Oculus Rift and HTC Vive.

[1965] Tracking camera: A camera for capturing the user's movements and facial expressions.

[1966] User authentication server: A server for managing user login information. Specifically, a cloud service such as AWS is suitable.

[1967] Generative AI model: An AI that generates training programs and meal plans based on a user's profile and goals. OpenAI GPT is preferred.

[1968] Emotion engine: An engine for analyzing the user's facial expressions and tone of voice. Microsoft Azure Face API can be used.

[1969] System processing flow

[1970] 1. User authentication and profile management

[1971] Users put on a VR headset in a physical store and a login screen appears.

[1972] When a user enters a user name and password, the terminal sends this authentication information to a user authentication server.

[1973] The server checks the authentication information in the database, and if successful, generates an authentication token and returns it to the terminal.

[1974] 2. Running a training session

[1975] When a user starts a training session, the device retrieves the latest training menu from the generative AI model.

[1976] This menu is customized based on the user's profile and goals.

[1977] The device transmits camera data that tracks the user's movements to a server in real time.

[1978] The server analyzes this, evaluates the form and progress, and sends any necessary instructions or corrections to the terminal.

[1979] 3. Emotional Data Analysis and Feedback

[1980] The device's built-in camera captures the user's facial expressions, which are then analyzed by the emotion engine.

[1981] The server adjusts training intensity in real time and provides feedback based on emotional data.

[1982] For example, if the user indicates fatigue, the intensity of the next exercise will be automatically adjusted and an encouraging message will be displayed on the device.

[1983] 4. Nutritional management and meal plan provision

[1984] When a user selects specific ingredients in the health food section, the device uses a generative AI model to generate an optimal meal plan.

[1985] The plan includes related recipes and links to purchase ingredients, which are displayed on the device.

[1986] The emotion engine analyzes the user's motivation and provides appropriate feedback.

[1987] 5. Progress tracking and visual reporting

[1988] Users enter their daily weight and dietary information into the device.

[1989] The server collects this data and generates weekly or monthly progress reports.

[1990] The device will display this visually and emotional data will also be reflected.

[1991] Prompt Sentence Examples

[1992] For example, if a user types, "I'm tired from yesterday's workout. What should I do today?", the generative AI model will provide feedback such as, "You worked hard yesterday! Today, let's focus on some relaxed stretching. Give it a try!"

[1993] This allows for dynamic training adjustments based on the user's emotional state, as well as personalized fitness and nutrition advice.

[1994] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1995] Program processing flow

[1996] Step 1:

[1997] User authentication

[1998] Users put on a VR headset in a physical store and a login screen appears.

[1999] The user enters a username and password, and that information is sent via the terminal to the user authentication server.

[2000] The server checks the entered information against its database and generates an authentication token if authentication is successful.

[2001] The authentication token is returned from the server to the terminal, which retains the token and displays a welcome message.

[2002] Input: Username, Password

[2003] Data processing: Checking authentication information, generating authentication tokens

[2004] Output: Authentication token, welcome message

[2005] Step 2:

[2006] Starting a training session

[2007] The user selects a training session and the device retrieves the latest training menu from the generative AI model.

[2008] The generated menu is displayed on the terminal and the user begins training.

[2009] Input: Training menu request

[2010] Data processing: Generating training menus by applying generative AI models

[2011] Output: Training menu

[2012] Step 3:

[2013] Movement tracking and real-time evaluation

[2014] The device uses a camera to capture the user's movements and transmits the data to a server in real time.

[2015] The server analyzes the captured motion data and evaluates form and progress.

[2016] The evaluation results are sent from the server to the device, and feedback is displayed to the user in real time.

[2017] Input: User behavior data

[2018] Data processing: Analysis of movement data, evaluation of form and progress

[2019] Output: Evaluation results, feedback

[2020] Step 4:

[2021] Analyzing emotion data and adjusting training

[2022] The device's built-in camera captures the user's facial expressions and collects emotional data.

[2023] The device sends this emotion data to the server, where it is analyzed by the emotion engine.

[2024] Based on the analysis results, the server dynamically adjusts the intensity of the training and generates feedback.

[2025] Feedback is displayed on the device and the user continues with the adjusted training.

[2026] Input: facial expression data, tone of voice data

[2027] Data processing: Emotion data analysis and training adjustment

[2028] Output: Adjusted training menu, feedback messages

[2029] Step 5:

[2030] Meal management and planning

[2031] When users scan specific ingredients in the health food aisle, the device uses a generative AI model to generate an optimal meal plan.

[2032] The device will display the generated meal plan along with related recipes and links to purchase ingredients.

[2033] The emotion engine analyzes the user's motivation and provides appropriate feedback.

[2034] Input: Ingredient information, user profile

[2035] Data processing: Meal plan generation

[2036] Output: Meal plans, recipes, purchase links, feedback messages

[2037] Step 6:

[2038] Progress tracking and visual reporting

[2039] Users enter their daily weight and dietary information into the device.

[2040] The terminal sends this data to a server and progress reports are generated periodically.

[2041] The server generates monthly and weekly reports and sends the data back to the device for visual display.

[2042] The device displays progress reports to the user in the form of graphs and charts.

[2043] Input: weight data, dietary data

[2044] Data processing: Collecting and analyzing progress data and generating reports

[2045] Output: Visual progress report

[2046] These steps enable dynamic training adjustments based on the user's emotional state, as well as personalized fitness and nutrition advice.

[2047] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2048] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2049] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2050] [Fourth embodiment]

[2051] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2052] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2053] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2054] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2055] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2056] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2057] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2058] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2059] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2060] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2061] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2062] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2063] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2064] The present invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide personalized training and dietary advice. The system includes user authentication, training session execution, dietary advice and planning, progress tracking and analysis, motivation and notifications, subscription management and purchasing support.

[2065] User authentication and profile management

[2066] The user puts on the VR headset and accesses the login screen. The user enters their username and password. The device sends this authentication information to the server. The server checks the user's authentication information in the database and generates an authentication token if successful. If authentication is successful, the server returns a welcome message along with the authentication token to the device, which is then displayed.

[2067] As a specific example, when a user opens an application, enters their login information and presses the submit button, authentication takes place within a few seconds and a message appears informing them that they can proceed to the next screen.

[2068] Running a training session

[2069] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by generative AI based on the user's profile and goals. The device then displays the session content based on this. The user's movements are captured by a camera and sent to the server in real time. The AI ​​on the server analyzes this, evaluates their form and progress, and sends and displays instructions and corrections to the device in real time.

[2070] For example, if a user's posture is poor while doing squats, the AI ​​will immediately detect this and provide audio and visual instructions such as "Bend your knees a little more."

[2071] Providing dietary advice and planning

[2072] When users submit dietary questions via their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device. Related recipes and links to purchase ingredients are also displayed. This allows users to continue eating healthy without having to worry about choosing ingredients or cooking methods.

[2073] For example, if a user asks, "What would be good for dinner tonight?" the server will suggest "grilled salmon and vegetables" based on the user's profile and display the necessary ingredients and recipe.

[2074] Progress Tracking and Analysis

[2075] Users enter their daily weight and dietary information on their device. The server collects this data and analyzes their progress. Weekly and monthly reports are generated and displayed on the device in the form of visual graphs and charts. This allows users to understand their progress and stay motivated to reach their next goal.

[2076] For example, a user can enter their weight, the server will record it, and at the end of the week a graphical progress report will be displayed on the device.

[2077] Motivation and notifications

[2078] The server generates appropriate motivational messages and reminders based on the user's progress data and sends them to the device, helping the user to stay motivated.

[2079] For example, if a user reaches 50% of their goal, a message such as "You're halfway there, keep trying!" will appear on the device.

[2080] Subscription management and purchasing support

[2081] Users can check their subscription information or send requests to change their plan from their device. The server processes the requests and returns the updated information to the device. It also generates promotional information for special diet foods and training equipment and sends it to the device. Users can then review the information and complete the purchase process.

[2082] For example, if a user wants to upgrade to a premium plan, they send a request from their device, the server processes it, and notifies them of the change in subscription fee.

[2083] Through these features, the present invention provides users with comprehensive, personalized training and nutritional advice to help maintain and improve their long-term health.

[2084] The processing flow will be explained below.

[2085] User authentication and profile management

[2086] Step 1:

[2087] The user puts on the VR headset and the login screen appears.

[2088] Step 2:

[2089] The user enters a username and password.

[2090] Step 3:

[2091] The terminal transmits the entered authentication information to the server.

[2092] Step 4:

[2093] The server checks the user's credentials against a database and generates an authentication token on success.

[2094] Step 5:

[2095] The server returns an authentication token to the device.

[2096] Step 6:

[2097] The device receives the authentication token and displays a message indicating successful login.

[2098] Running a training session

[2099] Step 1:

[2100] The user launches a dedicated application to begin a training session.

[2101] Step 2:

[2102] The device retrieves the latest training menu from the server.

[2103] Step 3:

[2104] The device displays the training menu to the user and starts the session.

[2105] Step 4:

[2106] The device captures the user's movements with a camera and transmits the data to a server in real time.

[2107] Step 5:

[2108] AI on the server analyzes the captured data and evaluates the form and progress of the movements.

[2109] Step 6:

[2110] The server sends the evaluation results and feedback to the device.

[2111] Step 7:

[2112] The device displays feedback to the user in real time.

[2113] Providing dietary advice and planning

[2114] Step 1:

[2115] The user inputs and submits questions about meals via the terminal.

[2116] Step 2:

[2117] The server generates an appropriate meal plan based on the user's profile and current goals.

[2118] Step 3:

[2119] The server sends the generated meal plan to the device.

[2120] Step 4:

[2121] The device will display the meal plan to the user and provide links to recipes and ingredients.

[2122] Progress Tracking and Analysis

[2123] Step 1:

[2124] Users enter their daily weight and dietary information on the device.

[2125] Step 2:

[2126] The terminal transmits the input data to the server.

[2127] Step 3:

[2128] The progress is analyzed based on the data collected by the server.

[2129] Step 4:

[2130] The server generates weekly and monthly reports.

[2131] Step 5:

[2132] The device displays the generated reports to the user in the form of visual graphs and charts.

[2133] Motivation and notifications

[2134] Step 1:

[2135] The server generates appropriate motivational messages based on the user's progress data.

[2136] Step 2:

[2137] The server generates a message and sends it to the terminal.

[2138] Step 3:

[2139] The device displays messages to the user to encourage them to maintain their motivation.

[2140] Subscription management and purchasing support

[2141] Step 1:

[2142] The user interacts with their device to check their subscription status.

[2143] Step 2:

[2144] The device requests subscription information from the server.

[2145] Step 3:

[2146] The server checks the user's subscription status and sends that information back to the device.

[2147] Step 4:

[2148] The device displays the subscription status to the user.

[2149] Step 5:

[2150] The server generates promotional information for special diet foods and training equipment and transmits it to the terminal.

[2151] Step 6:

[2152] The device displays promotional information to the user and assists them in the purchase process.

[2153] In this way, through each step of the process, users can efficiently receive authentication, training, dietary guidance, progress management, motivation maintenance, as well as subscription management and purchasing support.

[2154] Example 1

[2155] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2156] There is a lack of a means for virtual reality training systems to allow users to receive individually supervised training and nutritional guidance at home. There is also a need for a function that evaluates users' movements in real time and provides appropriate feedback. Furthermore, there is a need to collect and analyze progress data and provide visual feedback that allows users to effectively self-manage. There is a need to provide a system that solves these issues and helps users maintain motivation and improve their long-term health.

[2157] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2158] In this invention, the server includes means for receiving and authenticating input information from a user, means for providing a training program through a virtual reality device, means for tracking the user's movements and evaluating them in real time, means for generating a nutritional management and meal plan for the user, means for collecting and analyzing the user's progress data, means for providing the user with feedback to maintain motivation, means for receiving dietary questions from the user and generating and presenting a meal plan using a generation AI, and means for capturing the user's training movements in real time and having the generation AI evaluate and provide feedback. This allows the user to receive individually managed training and dietary advice at home, train while receiving feedback in real time, and improve their long-term health while visually understanding their progress.

[2159] (1) "Information entered by the user" refers to all information provided by the user to the system, such as login information, questions, training data, and dietary data.

[2160] (2) "Authentication" refers to the process of verifying a user's identity based on the login information provided by the user.

[2161] (3) "Virtual reality device" means a device worn by a user that allows the user to access a virtual space and receive training or other instruction.

[2162] (4) "Training Program" means a plan for teaching a user a series of movements or exercises that are customized based on the user's needs and goals.

[2163] (5) “Tracking” refers to recording a user’s performance, such as their physical movements and posture.

[2164] (6) "Real-time evaluation" refers to the process of instantly analyzing user behavior data and generating evaluation results.

[2165] (7) “Nutrition management” refers to managing the user’s dietary content and nutritional intake status.

[2166] (8) "Meal Plan" means a plan that indicates the recommended meal content and timing based on a user's health status and goals.

[2167] (9) “Progress Data” refers to data such as the user’s training history, weight fluctuations, and dietary information.

[2168] (10) "Motivational feedback" refers to encouraging messages or notifications provided to encourage users to continue making efforts.

[2169] (11) "Dietary Questions" refers to questions that users ask the system about proper diet and nutrition.

[2170] (12) “Generative AI” refers to an artificial intelligence model that generates appropriate training programs and meal plans based on user input.

[2171] (13) “Capture” refers to recording a user’s movements and postures using a camera or sensor.

[2172] (14) "Feedback" means that the system provides specific improvements or instructions to the user regarding their performance.

[2173] The present invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide individual training and dietary advice. This system has the following main functions:

[2174] User authentication and profile management

[2175] The user puts on the virtual reality device and accesses the login screen. The user enters their username and password, and the device sends the authentication information to the server. The server checks the authentication information in a database, and if authentication is successful, it generates an authentication token and sends it back to the device along with a welcome message. The device displays this. Specifically, when the user opens the application, enters their login information, and presses the submit button, a message appears stating that authentication has been completed in a few seconds and that they will proceed to the next screen.

[2176] Running a training session

[2177] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by the generation AI based on the user's profile and goals. The device displays this session content. The user's movements are captured by a camera and sent to the server in real time. The generation AI on the server analyzes this, evaluates form and progress, and sends and displays any necessary instructions and corrections to the device in real time. For example, if a user's posture is poor while doing squats, the AI ​​will immediately provide audio and visual instructions such as, "Bend your knees a little more."

[2178] Providing dietary advice and planning

[2179] When a user sends a question about their diet through their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and displays it on the device. Related recipes and links to purchase ingredients are also displayed. This allows users to continue eating healthy meals without having to worry about choosing ingredients or cooking methods. For example, if a user asks, "What would be good for dinner tonight?" the server will suggest "grilled salmon and vegetables" and display the necessary ingredients and recipe.

[2180] Progress Tracking and Analysis

[2181] Users enter their daily weight and dietary information on their device. The server collects and analyzes this data and compiles weekly and monthly progress reports. The reports are displayed on the device in the form of visual graphs and charts, making it easier for users to understand their progress. For example, when a user enters their weight, the server records it and displays a graphical progress report on the device at the end of the week.

[2182] Motivation and notifications

[2183] The server generates appropriate motivational messages and reminders based on the user's progress and sends them to the device, helping the user to stay motivated. For example, when a user reaches 50% of their goal, a message such as "You're halfway there, keep trying!" will appear on the device.

[2184] Subscription management and purchasing support

[2185] Users can check their subscription information on their device and send a plan change request. The server processes this and returns the updated information to the device. It also generates promotional information for specific nutritional products or training equipment and sends it to the device. The user can review this information and complete the purchase process. For example, if a user wants to upgrade to a premium plan, they can send a request from their device, and the server processes it and notifies them of the change in subscription fee.

[2186] Hardware and software used

[2187] Virtual reality devices (e.g., VR headsets)

[2188] Device (e.g. smartphone or tablet)

[2189] Server (cloud-based database system, e.g., cloud database)

[2190] Generative AI (e.g., generative AI models)

[2191] Examples of prompt statements

[2192] "Please log in to your account via user authentication to view the training menu."

[2193] "Provide real-time postural instructions as the user performs the squat."

[2194] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2195] System program processing flow and specific operations

[2196] User authentication and profile management

[2197] Step 1:

[2198] The user puts on the VR headset and accesses the login screen.

[2199] Input: The user puts on a VR headset and opens the system's login screen.

[2200] Output: The login screen appears in the user's field of view.

[2201] Step 2:

[2202] The user enters their username and password and clicks the submit button.

[2203] Input: Username and password input information.

[2204] Output: The device sends this information to the server.

[2205] Step 3:

[2206] The server checks the authentication information against a database and generates an authentication token.

[2207] Input: The username and password sent from the device.

[2208] Data processing / calculation: The server checks the authentication information stored in the database. If authentication is successful, it generates an authentication token. If it fails, it generates an error message.

[2209] Output: An authentication token or an error message is generated.

[2210] Step 4:

[2211] The server returns a welcome message to the terminal along with an authentication token.

[2212] Input: Authentication token.

[2213] Output: An authentication token and a welcome message are sent to the terminal.

[2214] Step 5:

[2215] The device displays a welcome message.

[2216] Input: Authentication token and welcome message.

[2217] Output: A welcome message is displayed on the user's screen.

[2218] What happens: Once the user enters their login details and is authenticated, the message "Welcome, [username]" is displayed.

[2219] Running a training session

[2220] Step 6:

[2221] A user requests to start a training session.

[2222] Input: Press the Start Training button.

[2223] Output: A training session start request is sent from the device to the server.

[2224] Step 7:

[2225] The terminal obtains the latest training menu from the server.

[2226] Input: Training session start request.

[2227] Data processing / calculation: The server uses generative AI to generate a customized training menu based on the user's profile and goals.

[2228] Output: Send the latest training menu to the device.

[2229] Step 8:

[2230] The training menu acquired by the device is displayed.

[2231] Enter: your latest training menu.

[2232] Output: The training menu is displayed to the user.

[2233] What happens: The user's training screen displays the latest training program.

[2234] Step 9:

[2235] The user's training movements are captured by a camera and sent to a server.

[2236] Input: Footage of user in action.

[2237] Data processing / calculation: The device captures the motion video in real time and sends it to the server.

[2238] Output: The moving image is sent to the server.

[2239] Step 10:

[2240] A generation AI on the server analyzes the motion footage and generates feedback.

[2241] Input: Motion footage.

[2242] Data processing / calculation: The server's generated AI analyzes the video data, evaluates form and progress, and generates appropriate feedback.

[2243] Output: Feedback data.

[2244] Step 11:

[2245] The server generates feedback and sends it to the terminal, which displays it.

[2246] Input: Feedback data.

[2247] Output: Sends feedback to the device and is displayed to the user.

[2248] Specific action: If the user has poor posture while performing a squat, real-time instructions will be displayed, such as "Bend your knees a bit more."

[2249] Providing dietary advice and planning

[2250] Step 12:

[2251] Users send questions about meals via their device.

[2252] Input: Food questions.

[2253] Output: The question is sent from the terminal to the server.

[2254] Step 13:

[2255] The server receives the questions and the generative AI generates the optimal meal plan.

[2256] Input: Food questions.

[2257] Data processing / calculation: The server's generation AI generates a meal plan based on the user's goals and current nutritional status.

[2258] Output: The generated meal plan.

[2259] Step 14:

[2260] The server sends the meal plan to the device, which displays it.

[2261] Input: The generated meal plan.

[2262] Output: The meal plan is sent to the device.

[2263] What it does: When a user asks, "What's good for dinner tonight?" it suggests "grilled salmon and vegetables" and displays the ingredients and recipe.

[2264] (Application example 1)

[2265] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2266] While training and dietary guidance systems using virtual reality devices allow users to receive personalized training and meal plans, they lack face-to-face support when purchasing physical products. Furthermore, new methods are needed to more effectively maintain motivation and comprehensive health management through interactive activities in virtual spaces.

[2267] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2268] In this invention, the server includes means for receiving and authenticating input information from a user, means for providing a training program through a virtual reality device, means for tracking and evaluating the user's movements in real time, means for generating nutritional management and meal plans for the user, means for collecting and analyzing the user's progress data, means for providing feedback to the user to maintain motivation, and means for enabling the purchase of fitness equipment and health foods in a virtual store, thereby enabling the user to seamlessly purchase physical products as well as receive comprehensive training support within the virtual reality space.

[2269] "Means for receiving and authenticating input information from users" refers to the function of collecting personal authentication information (e.g., user name and password) provided by users through virtual reality devices and verifying and authenticating it on the server.

[2270] "Means for providing a training program through a virtual reality device" refers to a function that allows a user to display and execute individual training content through a virtual reality device.

[2271] "Means for tracking user movements and evaluating them in real time" refers to a function that uses cameras and sensors to monitor the user's physical movements in real time, analyzes them, and evaluates their movements.

[2272] "Means for generating a user's nutritional management and meal plan" refers to a function that generates an optimal meal plan based on the user's health goals and current nutritional status and provides related information.

[2273] "Means for collecting and analyzing user progress data" refers to a function that collects data such as weight, dietary content, and exercise information provided by users on a daily basis, and analyzes this data to understand their progress.

[2274] "Means of providing users with feedback to maintain their motivation" refers to a function that provides messages and reminders to maintain ongoing motivation based on the user's progress data.

[2275] "Means for enabling the purchase of fitness equipment and health foods as a virtual store" refers to a function that allows users to purchase fitness equipment and health foods within a virtual reality space.

[2276] This invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide individual training and dietary advice. The main components of the system are as follows:

[2277] Hardware and Software Configuration

[2278] This system consists of the following hardware and software:

[2279] Hardware:

[2280] Virtual reality headsets (e.g., Oculus Rift, HTC Vive)

[2281] Tracking Camera

[2282] Sensors that detect user movement

[2283] software:

[2284] vr_sdk: A library for managing the display and interaction of VR content.

[2285] health_ai_sdk: An AI library that generates training and meal plans

[2286] e_commerce_sdk: A library for subscription management and purchasing support

[2287] User authentication and profile management

[2288] The user puts on the virtual reality headset and accesses the login screen. The user enters their username and password, and the device sends these credentials to the server. The server checks the user's credentials in a database and generates an authentication token if successful. If authentication is successful, the server returns a welcome message along with the authentication token to the device, which is then displayed.

[2289] Running a training session

[2290] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by generative AI based on the user's profile and goals. The device then displays the session content based on this. The user's movements are captured by a camera and sent to the server in real time. The AI ​​on the server analyzes this, evaluates their form and progress, and sends and displays instructions and corrections to the device in real time.

[2291] Providing dietary advice and planning

[2292] When users submit dietary questions via their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device. Related recipes and links to purchase ingredients are also displayed. This allows users to continue eating healthy without having to worry about choosing ingredients or cooking methods.

[2293] Progress Tracking and Analysis

[2294] Users enter their daily weight and dietary information on their device. The server collects this data and analyzes their progress. Weekly and monthly reports are generated and displayed on the device in the form of visual graphs and charts. This allows users to understand their progress and stay motivated to reach their next goal.

[2295] Motivation and notifications

[2296] The server generates appropriate motivational messages and reminders based on the user's progress data and sends them to the device, helping the user to stay motivated.

[2297] Virtual store features

[2298] It provides a virtual store where users can purchase fitness equipment and health foods in a virtual reality space. Users can access the virtual store through a VR headset and purchase the products they need. At that time, generative AI provides advice on product selection and assists with the purchase process.

[2299] As a specific example, a user uses the system as follows.

[2300] If you ask, "Please suggest a meal plan for today," the AI ​​will suggest "grilled salmon and vegetables" and display the necessary ingredients and recipe.

[2301] When you request to "start a training session," a customized training plan will be presented and your form will be corrected in real time.

[2302] As described above, this system provides users with comprehensive training and health management, realizing services that make the most of virtual reality space.

[2303] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2304] Step 1:

[2305] User authentication

[2306] Input: Username and Password

[2307] Process: The user puts on the virtual reality headset and enters their login information (username and password) on the device. The device sends this authentication information to the server. The server checks the user's authentication information against its database, and if authentication is successful, generates an authentication token and returns it to the device.

[2308] Output: Authentication token and welcome message

[2309] Step 2:

[2310] Providing training programs

[2311] Input: User profile and goals

[2312] Processing: The user gives instructions to the device to start a training session. The device retrieves the latest training menu from the server. The server uses generative AI to generate a customized training plan based on the user's profile and goals and sends it to the device. The device displays the training content.

[2313] Output: Customized training plan

[2314] Step 3:

[2315] User behavior tracking and evaluation

[2316] Input: User behavior data

[2317] Processing: The user's movements are captured by a tracking camera and sensors. The device sends this data to a server in real time. AI on the server analyzes the movement data and evaluates form and progress. If necessary, corrections and feedback are generated and sent to the device. The device then provides audio and visual instructions to the user.

[2318] Output: Real-time evaluation feedback

[2319] Step 4:

[2320] Providing dietary advice and planning

[2321] Input: Food Question

[2322] Processing: The user submits a dietary question via the device. The server uses generative AI to generate an optimal meal plan based on the user's goals and current nutritional status. Related recipes and links to purchase ingredients are also generated and sent to the device. The device displays this information along with the meal plan.

[2323] Output: Optimal meal plan and related information

[2324] Step 5:

[2325] Progress Tracking and Analysis

[2326] Input: Daily weight, dietary information

[2327] Processing: The user enters their daily weight and dietary information into the device. The device sends this data to the server. The server collects the data and analyzes their progress. It generates weekly and monthly progress reports and sends them to the device in the form of visual graphs and charts. The device displays these reports.

[2328] Output: Visual progress report

[2329] Step 6:

[2330] Motivation and notifications

[2331] Input: Progress data

[2332] Processing: The server generates motivational messages and reminders based on the user's progress data. These messages are sent to the user and displayed on the device as appropriate.

[2333] Output: Motivational messages and reminders

[2334] Step 7:

[2335] Use of virtual stores

[2336] Input: Product purchase request

[2337] Processing: The user inputs a request to purchase fitness equipment or health foods into the device in the virtual reality space. The device sends the request to the server, which generates corresponding product information and sends it to the device. The device displays the product information, and the user completes the purchase process. The generation AI provides advice on product selection.

[2338] Output: Purchase confirmation and product information

[2339] Through these steps, the system provides users with comprehensive training and health management, realizing services that make the most of virtual reality space.

[2340] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2341] The present invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide individual training and dietary advice, and further combines it with an emotion engine to recognize the user's emotions. The system includes user authentication, training session execution, dietary advice and planning, progress tracking and analysis, motivation maintenance and notifications, subscription management and purchasing support, and the emotion engine.

[2342] User authentication and profile management

[2343] The user puts on the VR headset and accesses the login screen. The user enters their username and password. The device sends this authentication information to the server. The server checks the user's authentication information in the database and generates an authentication token if successful. If authentication is successful, the server returns a welcome message along with the authentication token to the device, which is then displayed.

[2344] Running a training session

[2345] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by generative AI based on the user's profile and goals. The device then displays the session content based on this. The user's movements are captured by a camera and sent to the server in real time. The AI ​​on the server analyzes this, evaluates their form and progress, and sends and displays instructions and corrections to the device in real time.

[2346] Introducing the Emotion Engine

[2347] The system incorporates an emotion engine that allows the device to recognize emotions from the user's facial expressions and tone of voice. This emotion data is sent to the server and dynamically reflected in feedback and training content. For example, if the user expresses fatigue, the intensity of training can be automatically adjusted.

[2348] For example, when a user is doing squats, a camera captures the user's facial expressions, and if the emotion engine analyzes this and determines that the user is "tired," it will suggest reducing the intensity of the next exercise.

[2349] Providing dietary advice and planning

[2350] When users submit dietary questions via their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device. Related recipes and links to purchase ingredients are also displayed. If the user is not motivated to eat, the emotional engine suggests easy, effortless meal plans.

[2351] Progress Tracking and Analysis

[2352] Users enter their daily weight and dietary habits on their device. The server collects this data and analyzes their progress. Weekly and monthly reports are generated and displayed on the device in the form of visual graphs and charts. Data recognized by the emotion engine is also reflected in the progress report, allowing users to check their psychological state.

[2353] For example, a user can enter their weight, the server records it, and at the end of the week, a graphical progress report is displayed on the device. The emotion engine also adds the user's emotional trends to the report.

[2354] Motivation and notifications

[2355] The server generates appropriate motivational messages and reminders based on the user's progress data and sends them to the device. Based on the recognition results of the emotion engine, the feedback messages are updated accordingly to provide optimal support for the user's current situation.

[2356] For example, if a user expresses a lack of motivation, an encouraging message such as "Take a break and try again!" will be displayed on the device.

[2357] Subscription management and purchasing support

[2358] Users can check their subscription information or send requests to change their plan from their device. The server processes the requests and returns the updated information to the device. It also generates promotional information for special diet foods and training equipment and sends it to the device. Users can then review the information and complete the purchase process.

[2359] For example, if a user wants to upgrade to a premium plan, they send a request from their device, the server processes it, and notifies them of the change in subscription fee.

[2360] Through these features, the present invention provides users with comprehensive, personalized training and nutritional guidance, helping them maintain and improve their long-term health while also taking into account their emotional state.

[2361] The processing flow will be explained below.

[2362] User authentication and profile management

[2363] Step 1:

[2364] The user puts on the VR headset and the login screen appears.

[2365] Step 2:

[2366] The user enters a username and password.

[2367] Step 3:

[2368] The terminal transmits the entered authentication information to the server.

[2369] Step 4:

[2370] The server checks the user's credentials against a database and generates an authentication token on success.

[2371] Step 5:

[2372] The server returns an authentication token to the device.

[2373] Step 6:

[2374] The device receives the authentication token and displays a message indicating successful login.

[2375] Running a training session

[2376] Step 1:

[2377] The user launches a dedicated application to begin a training session.

[2378] Step 2:

[2379] The device retrieves the latest training menu from the server.

[2380] Step 3:

[2381] The device displays the training menu to the user and starts the session.

[2382] Step 4:

[2383] The device captures the user's movements with a camera and transmits the data to a server in real time.

[2384] Step 5:

[2385] AI on the server analyzes the captured data and evaluates the form and progress of the movements.

[2386] Step 6:

[2387] The server sends the evaluation results and feedback to the device.

[2388] Step 7:

[2389] The device displays feedback to the user in real time.

[2390] Introducing the Emotion Engine

[2391] Step 1:

[2392] The device captures the user's facial expressions and tone of voice.

[2393] Step 2:

[2394] The device sends the captured data to the server.

[2395] Step 3:

[2396] The server's emotion engine analyzes the data and recognizes the user's emotional state.

[2397] Step 4:

[2398] The server adjusts the training content and feedback based on the recognized emotional state.

[2399] Step 5:

[2400] The server sends appropriate feedback and training content to the device.

[2401] Step 6:

[2402] The device displays feedback and training adjustments to the user.

[2403] Providing dietary advice and planning

[2404] Step 1:

[2405] The user inputs and submits questions about meals via the terminal.

[2406] Step 2:

[2407] The server generates an appropriate meal plan based on the user's profile and current goals.

[2408] Step 3:

[2409] The server sends the generated meal plan to the device.

[2410] Step 4:

[2411] The device will display the meal plan to the user and provide links to recipes and ingredients.

[2412] Step 5:

[2413] The server adjusts the meal plan based on the emotional state recognized by the emotion engine.

[2414] Progress Tracking and Analysis

[2415] Step 1:

[2416] Users enter their daily weight and dietary information on the device.

[2417] Step 2:

[2418] The terminal transmits the input data to the server.

[2419] Step 3:

[2420] The progress is analyzed based on the data collected by the server.

[2421] Step 4:

[2422] The server generates weekly and monthly reports.

[2423] Step 5:

[2424] The device displays the generated reports to the user in the form of visual graphs and charts.

[2425] Step 6:

[2426] The server also reflects data recognized by the emotion engine in the progress report.

[2427] Motivation and notifications

[2428] Step 1:

[2429] The server generates appropriate motivational messages based on the user's progress data.

[2430] Step 2:

[2431] The server generates a message and sends it to the terminal.

[2432] Step 3:

[2433] The terminal displays the message to the user.

[2434] Step 4:

[2435] The server changes the feedback message in a timely manner according to the emotional state of the user recognized by the emotion engine.

[2436] Subscription management and purchasing support

[2437] Step 1:

[2438] The user interacts with their device to check their subscription status.

[2439] Step 2:

[2440] The device requests subscription information from the server.

[2441] Step 3:

[2442] The server checks the user's subscription status and sends that information back to the device.

[2443] Step 4:

[2444] The device displays the subscription status to the user.

[2445] Step 5:

[2446] The server generates promotional information for special diet foods and training equipment and transmits it to the terminal.

[2447] Step 6:

[2448] The device displays promotional information to the user and assists them in the purchase process.

[2449] Through these specific processing steps, users can efficiently receive authentication, training, dietary advice, progress management, motivation maintenance, subscription management and purchasing support. By combining this with the emotion engine, optimal support tailored to individual needs can be provided.

[2450] Example 2

[2451] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2452] Traditional training systems lack the ability to generate personalized training programs and meal plans, and are unable to reflect the user's emotional state and progress data in real time. They also lack effective motivation and feedback, resulting in little improvement in the user experience. Furthermore, subscription management requires manual, time-consuming tasks.

[2453] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2454] In this invention, the server includes means for receiving and authenticating input information from a user, means for providing a training program through a virtual reality device, means for tracking and evaluating the user's movements in real time, means for recognizing the user's emotional state and dynamically adjusting the training content based thereon, means for generating nutritional management and meal plans for the user, means for collecting and analyzing the user's progress data, means for providing feedback to the user to maintain motivation, and means for managing and changing subscription information. This allows for individualized responses to each user's needs, enabling effective training and diet management while maintaining motivation. Furthermore, the system automatically manages subscriptions, reducing the burden on the user.

[2455] "User authentication" is the process of receiving input from a user and verifying their access rights to a system.

[2456] A "virtual reality device" is a hardware device that allows a user to immerse themselves in a three-dimensional virtual space.

[2457] "Training Program" means a series of exercises designed to improve a User's fitness and health.

[2458] "Tracking" is the process of recording and analyzing user actions and behavior in real time.

[2459] "Real-time evaluation" is the process of instantly analyzing a user's behavioral data and providing appropriate feedback.

[2460] "Emotional state" refers to a user's current mental and emotional state.

[2461] "Dynamic adjustment" refers to the system automatically changing training content and conditions based on the user's real-time data.

[2462] "Nutrition management" is the process of monitoring a user's diet and nutritional intake and providing an optimal nutrition plan.

[2463] A "meal plan" is a meal schedule and content designed based on a user's health goals.

[2464] "Progress Data" is data that shows the user's training and health management history and results.

[2465] "Maintaining motivation" refers to support activities to increase users' motivation to continue training and health management over the long term.

[2466] "Feedback" refers to advice or information provided based on a user's behavior or situation.

[2467] "Subscription Information" refers to the contract information and plan for the service that the User is using.

[2468] "Management and Change" is the process by which the system maintains subscription information and updates it as needed.

[2469] The present invention is a system in which a user uses a virtual reality device at home and a generative AI acts as a personal trainer to provide personalized training and dietary advice. The system includes user authentication, training session execution, dietary advice and planning, progress tracking and analysis, motivation and notifications, subscription management and purchasing support, and an emotion engine.

[2470] User authentication and profile management

[2471] The user puts on the VR headset and accesses the login screen. The user enters a username and password. The device sends this authentication information to the server. The server checks the user's authentication information in a database and generates an authentication token if successful. If authentication is successful, the server returns a welcome message to the device along with the authentication token, which is then displayed. The software used includes a database management system and an authentication system.

[2472] Running a training session

[2473] When a user attempts to start a training session, the device retrieves the latest training menu from the server. This menu is customized by generative AI based on the user's profile and goals. The device then displays the session content based on this. The user's movements are captured by a camera and sent to the server in real time. The AI ​​on the server analyzes the captured images, evaluates their form and progress, and sends and displays instructions and corrections to the device in real time. The hardware used includes a VR headset, camera, and internet-connected device. The software includes a movement analysis algorithm and a real-time data processing system.

[2474] Introducing the Emotion Engine

[2475] The device recognizes emotions through the user's facial expressions and tone of voice. This emotional data is sent to a server and dynamically reflected in feedback and training content. For example, if the user expresses fatigue, the intensity of the training can be automatically adjusted. For example, while the user is doing squats, the camera captures the user's facial expressions. If the emotion engine analyzes this and determines that the user is "fatigued," the device will suggest lowering the intensity of the next exercise. The software used includes an emotion recognition algorithm.

[2476] Providing dietary advice and planning

[2477] When users submit dietary questions via their device, the AI ​​generates an optimal meal plan based on the user's goals and current nutritional status and presents it on the device. Related recipes and links to purchase ingredients are also displayed. If the user is not motivated to eat, the emotional engine suggests easy, effortless meal plans.

[2478] Progress Tracking and Analysis

[2479] Users input their daily weight and dietary habits on their device. The server collects this data and analyzes their progress. Weekly and monthly reports are generated and displayed on the device in the form of visual graphs and charts. Data recognized by the emotion engine is also reflected in the progress report, allowing users to check their psychological state. For example, when a user inputs their weight, the server records it and displays a graphed progress report on the device at the end of the week.

[2480] Motivation and notifications

[2481] The server generates appropriate motivational messages and reminders based on the user's progress data and sends them to the device. Based on the recognition results of the emotion engine, the feedback message is updated accordingly to provide optimal support for the user's current situation. For example, if the user expresses a lack of motivation, an encouraging message such as "Take a short break and try again!" will be displayed on the device.

[2482] Subscription management and purchasing support

[2483] Users can check subscription information from their device or send a request to change their plan. The server processes this and returns the updated information to the device. It also generates promotional information for special diet foods or training equipment and sends it to the device. The user can review this information and then complete the purchase process. For example, if a user wants to upgrade to a premium plan, they send a request from their device, and the server processes it and notifies them of the change in subscription fee.

[2484] Example prompts to input to the generative AI model

[2485] "The user has just recovered from an illness and wants to start exercising again. Please create an initial training menu that is not too strenuous."

[2486] "Propose meal plans that help users maintain positive emotions."

[2487] Through these functions, the present invention provides users with comprehensive, personalized training and dietary advice, helping them maintain and improve their long-term health while also taking into account their emotional state.

[2488] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2489] Specific explanation of program processing

[2490] User authentication and profile management

[2491] Step 1:

[2492] The user puts on the VR headset and accesses the login screen.

[2493] How it works: The user powers on the VR headset and launches the dedicated application.

[2494] Input: User login request.

[2495] Output: Login screen displayed.

[2496] Step 2:

[2497] The user enters a username and password.

[2498] How it works: The user enters their credentials using the keyboard in VR.

[2499] Input: Username and Password.

[2500] Output: Sending authentication information.

[2501] Step 3:

[2502] The device sends the authentication information to the server.

[2503] How it works: Your device encrypts and sends your authentication information to a server over the internet.

[2504] Input: Encrypted credentials.

[2505] Output: Sending authentication information to the server.

[2506] Step 4:

[2507] The server checks the authentication information against its database and generates an authentication token on succe...

Claims

1. a means for receiving and authenticating user input; a means for delivering a training program through a virtual reality device; A means of tracking and evaluating user behavior in real time, a means for generating nutritional management and meal plans for users; a means for collecting and analyzing user progress data; A way to provide users with feedback to keep them motivated; A system including:

2. The system of claim 1 further comprising means for generating a personalized training program and meal plan based on input information from the user.

3. The system of claim 1 , further comprising means for periodically displaying a visual progress report to the user based on the user's progress data.

Images