system

Abstract

We provide the system. [Solution] Means for receiving the user's personal information and training goals, A means for generating a customized training program based on received personal information and training objectives, A means of displaying the generated training program to the user, A means of providing real-time video chat training sessions between users and trainers, A means of providing users with a training experience in a virtual reality environment, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance that responds to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In modern society, due to busy lives and mobility restrictions, there are problems such as difficulty in individualized fitness and nutrition management. In addition, fitness and nutrition programs are often provided uniformly, and there is a problem that customization based on individual physical conditions and goals is not sufficiently carried out. Furthermore, there are also problems such as difficulty in maintaining correct form during training and providing real-time guidance for effective training, and a lack of means for maintaining training motivation. There is a need for a system that comprehensively solves these problems.

Means for Solving the Problems

[0005] This invention provides a system that receives a user's personal information and training goals, generates a customized training program based on this information, and displays it to the user. Specifically, it includes means for generating a training program using an algorithm based on user information and training goals, and means for displaying and managing the generated program to the user. It also includes means for providing real-time video chat training sessions between the user and the trainer. Furthermore, this invention includes means for receiving the user's dietary preferences and allergy information, and generating and providing customized nutritional advice based on this information. It also includes means for providing the user with an immersive training experience in a virtual reality environment, and for monitoring the user's training performance in real time and providing feedback. This enables personalized, intuitive, and effective training and nutrition management for the user.

[0006] A "user" refers to an individual who uses the system to receive customized training and nutritional advice.

[0007] "Training goals" refer to specific fitness and health-related objectives that the user aims to achieve.

[0008] A "server" refers to a computer system that receives and analyzes user data and generates and provides training programs and nutritional advice.

[0009] "Personal information" refers to physical or identifiable data such as a user's name, age, gender, height, weight, and exercise history.

[0010] A "customized training program" refers to an exercise plan that is individually optimized based on the user's personal information and training goals.

[0011] A "video chat training session" refers to a session in which the user and trainer provide real-time training guidance and feedback via video communication.

[0012] A "virtual reality environment" refers to a virtual environment in which users can train in an immersive virtual space using VR headsets or similar devices.

[0013] "Nutritional advice" refers to a personalized meal and nutrition plan tailored to the user's dietary preferences and allergy information.

[0014] "Feedback" refers to real-time instructions, corrections, and evaluations provided to the user during training.

[0015] An "algorithm" refers to the processing steps used to analyze a user's personal information and goals, and to generate a customized training program and nutritional advice. [Brief explanation of the drawing]

[0016] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7]It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Mode for Carrying Out the Invention

[0017] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, the signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU (Central Processing Unit), GPU (Graphics Processing Unit), GPGPU (General-Purpose computing on Graphics Processing Units), and APU (Accelerated Processing Unit).

[0020] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0021] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0022] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0024] [First Embodiment]

[0025] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0026] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0029] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0032] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0036] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0037] This invention relates to a system that provides customized training programs and nutritional advice to support users in effectively achieving their fitness goals. The specific operation of each component is described below.

[0038] 1. User registration and login

[0039] When a user uses the system for the first time, they access a new registration form on their device. The user enters personal information such as their name, email address, and password, and submits it. The server receives the entered information and stores it in the database. It also generates an authentication token to activate the user account. This allows the user to log in using the login form and access their personal dashboard.

[0040] 2. Creating a customized training program

[0041] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history, etc.) and training goals (e.g., weight loss, muscle gain). The server receives this data and performs analysis. Based on the analysis results, the server uses an algorithm to generate a training program optimized for the user and displays it on their personal dashboard. The user then proceeds with their training according to this program.

[0042] 3. Providing nutritional advice

[0043] When a user enters their dietary preferences and allergy information, the server generates customized nutritional advice based on this information. The server refers to a database of nutritionist advice and creates a meal plan for the user. The generated meal plan is displayed on the user's dashboard.

[0044] 4. Virtual trainer service via video chat

[0045] When a user books a training session, the server receives the booking data and notifies the appropriate virtual trainer. As the session time approaches, the device notifies the user and starts a video chat. The trainer monitors the user's training in real time and provides guidance on form correction and motivation.

[0046] 5. Training utilizing virtual reality

[0047] The user puts on a VR headset and launches a specific training application. The server generates an appropriate virtual reality environment based on the user's training program. The user trains within this virtual environment and receives real-time feedback from the server, thereby enhancing the effectiveness of the training.

[0048] Specific example

[0049] User A uses the system with the goal of losing weight. First, they register with the system, log in, and enter their physical information (height 170cm, weight 75kg, age 30, no prior exercise experience). The server receives this information and generates a program that includes three cardio exercises per week and strength training. Next, because User A has a dairy allergy, this is reflected in the meal plan, and a calorie-balanced meal plan that avoids dairy products is provided. In addition, they regularly schedule video chat sessions with a virtual trainer to receive form checks and support to maintain motivation. Furthermore, they use a virtual reality environment to experience a realistic gym-like training environment from the comfort of their home.

[0050] In this way, this system provides users with comprehensive training and nutritional management, and delivers customized support tailored to their individual goals.

[0051] The following describes the processing flow.

[0052] Step 1:

[0053] The user accesses the new registration form on their device and enters personal information such as their name, email address, and password.

[0054] Step 2:

[0055] The terminal sends the entered information to the server.

[0056] Step 3:

[0057] The server processes the received information and saves the user's data to the database.

[0058] Step 4:

[0059] The server generates an authentication token and activates the user account.

[0060] Step 5:

[0061] The user logs in using the login form.

[0062] Step 6:

[0063] The server verifies the user's authentication information and allows them to access their personal dashboard.

[0064] Step 7:

[0065] The user enters their physical information and training goals.

[0066] Step 8:

[0067] The device sends the entered physical information and training goals to the server.

[0068] Step 9:

[0069] The server analyzes the information it receives and generates a customized training program.

[0070] Step 10:

[0071] The server displays the generated training program on the user's dashboard.

[0072] Step 11:

[0073] Users enter their dietary preferences and allergy information.

[0074] Step 12:

[0075] The terminal sends the entered meal information to the server.

[0076] Step 13:

[0077] The server analyzes the received meal information and generates customized nutritional advice.

[0078] Step 14:

[0079] The server displays the generated nutritional advice on the user's dashboard.

[0080] Step 15:

[0081] The user books a training session.

[0082] Step 16:

[0083] The device sends the reservation data to the server.

[0084] Step 17:

[0085] The server receives the reservation information and notifies the appropriate virtual trainer.

[0086] Step 18:

[0087] As the session time approaches, the device will notify the user.

[0088] Step 19:

[0089] The user launches the video chat interface and starts a session.

[0090] Step 20:

[0091] A virtual trainer monitors the user's training in real time and provides feedback.

[0092] Step 21:

[0093] The user puts on a VR headset and launches a specific training application.

[0094] Step 22:

[0095] The server generates an appropriate virtual reality environment based on the user's training program.

[0096] Step 23:

[0097] The server sends the generated virtual reality environment to the user's VR headset.

[0098] Step 24:

[0099] Users train in a virtual reality environment and receive real-time feedback from the server.

[0100] (Example 1)

[0101] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0102] Conventional fitness systems have struggled to provide customized training programs and nutritional advice for each user, resulting in a lack of effective support tailored to individual user needs. Furthermore, they lacked features to provide realistic training experiences and real-time feedback, preventing users from receiving sufficient support to achieve their goals. To address these challenges, the present invention aims to provide a system that offers comprehensive training and nutritional management to users, supporting them in achieving their individual goals.

[0103] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0104] In this invention, the server includes means for receiving the user's personal information and training goals, means for generating a customized training program based on the received personal information and training goals, means for displaying the generated training program to the user, means for receiving the user's dietary preferences and allergy information, means for generating customized nutritional advice based on the received dietary preferences and allergy information, means for providing the generated nutritional advice to the user, means for providing real-time video chat training sessions between the user and the instructor, and means for providing the user with a training experience in a virtual reality environment. As a result, the user can receive individually customized training programs and nutritional advice, and more effectively achieve their fitness goals through real-time support and a realistic training experience.

[0105] "Personal information" refers to data used to identify or distinguish a user, such as the user's name, email address, password, height, weight, age, and exercise history.

[0106] "Training goals" refer to fitness goals set by the user, such as weight loss or muscle strength improvement.

[0107] A "training program" is an exercise schedule or plan created based on the user's personal information and training goals, and includes details regarding the type, frequency, and intensity of exercise.

[0108] "Dietary preferences" refer to the ingredients and types of food that users like, and are information about the user's eating preferences.

[0109] "Allergy information" refers to information about the foods and ingredients that a user is allergic to.

[0110] "Nutritional advice" refers to a balanced meal plan and dietary recommendations tailored to the user's dietary preferences and allergy information.

[0111] A "trainer" refers to a professional who supports users' training and provides guidance and advice in real time.

[0112] A "real-time video chat training session" is a type of session in which users and instructors conduct training simultaneously online via video chat.

[0113] A "virtual reality environment" is a virtual training space created using virtual reality technology, allowing users to enjoy a training experience that closely resembles reality.

[0114] "Customization" refers to optimizing specific content or functions based on each user's individual needs and information.

[0115] A "generative AI model" is an artificial intelligence algorithm or system that automatically creates training programs and nutritional advice based on user information.

[0116] "Feedback" refers to evaluations and advice given regarding a user's training performance, providing information that users can use to improve or adjust their training.

[0117] "Reservation" refers to the act of a user setting and securing a training session or video chat in advance.

[0118] This invention relates to a system that provides customized training programs and nutritional advice to support users in effectively achieving their fitness goals. This system provides optimized training and nutritional management based on the user's personal information, training goals, dietary preferences, and allergy information. The specific operation of each component of this system is described below.

[0119] Hardware and software usage

[0120] This system uses the following hardware and software:

[0121] Devices (PCs, smartphones, tablets, etc.)

[0122] Server (including database and analysis engine)

[0123] VR headset for virtual reality

[0124] Camera and microphone for video chat

[0125] User registration and login

[0126] When a user uses the system for the first time, they access a new registration form on their device. The user enters personal information such as their name, email address, and password, and submits it. The server receives the entered information and securely stores it in the database. Furthermore, it generates an authentication token to activate the user account. This allows the user to log in using the login form and access their personal dashboard.

[0127] Creating a customized training program

[0128] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history, etc.) and training goals (e.g., weight loss, muscle strength improvement). The server receives this data and performs analysis. A generative AI model is used for the analysis to generate an optimized training program based on the user's information. The generated training program is displayed on the user's personal dashboard. The user then proceeds with their training according to this program.

[0129] Nutritional advice

[0130] When a user enters their dietary preferences and allergy information, the server generates personalized nutritional advice based on that information. The server consults a database of nutritionist advice and creates a meal plan for the user. The generated meal plan is displayed on the user's dashboard. The user can use this information to incorporate appropriate meals into their diet.

[0131] Virtual trainer service via video chat

[0132] When a user books a training session, the server receives the booking data and notifies the appropriate virtual trainer. As the session time approaches, the device notifies the user and initiates a video chat. The trainer monitors the user's training in real time and provides guidance on form correction and motivation improvement.

[0133] Training utilizing virtual reality

[0134] The user puts on a VR headset and launches a specific training application on their device. The server generates an appropriate virtual reality environment based on the user's training program. The user trains within this virtual environment and receives real-time feedback from the server to enhance the effectiveness of their training.

[0135] Specific example

[0136] If User A uses the system with the goal of losing weight, they first register and log in. Next, they enter their physical information (height 170cm, weight 75kg, age 30, no prior exercise experience). The server receives this information and generates a program that includes cardio exercises and strength training three times a week. Since User A has a dairy allergy, a meal plan is also generated based on that. User A regularly schedules video chat sessions with a virtual trainer to receive training guidance. Furthermore, they experience training in a virtual reality environment using a VR headset.

[0137] Example of a prompt

[0138] "Please explain the user registration procedure in detail."

[0139] "Please explain how to generate a customized training program."

[0140] Please describe in detail how you provide nutritional advice.

[0141] "Please explain the support process via video chat."

[0142] "What are the advantages of training programs that utilize virtual reality?"

[0143] As described above, this system provides users with comprehensive training and nutritional management, and delivers customized support tailored to individual goals.

[0144] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0145] Step 1:

[0146] User Registration

[0147] Input: The user enters personal information such as their name, email address, and password into a new registration form on their device.

[0148] Processing: The terminal sends the entered information to the server.

[0149] Data processing: The server analyzes the received information and securely stores it in the database. Next, it generates an authentication token.

[0150] Output: The user account is activated, and the user can log in.

[0151] Step 2:

[0152] User Login

[0153] Input: The user enters their email address and password into the login form on their device.

[0154] Processing: The terminal sends the input information to the server.

[0155] Data processing: The server compares the input information with the information in the database and performs authentication.

[0156] Output: If authentication is successful, the user will be able to access their personal dashboard.

[0157] Step 3:

[0158] Entering physical information and training goals

[0159] Input: The user enters physical information (height, weight, age, exercise history, etc.) and training goals (weight loss, muscle strength improvement, etc.) on their device.

[0160] Processing: The terminal sends that data to the server.

[0161] Data processing: The server analyzes the received data and generates a training program optimized for the user.

[0162] Output: The generated training program is displayed on the user's dashboard.

[0163] Step 4:

[0164] Enter your dietary preferences and allergy information.

[0165] Input: The user enters their dietary preferences and allergy information on their device.

[0166] Processing: The terminal sends the input data to the server.

[0167] Data processing: The server references a nutritionist advice database and generates nutritional advice tailored to the user.

[0168] Output: Customized nutritional advice is displayed on the user's dashboard.

[0169] Step 5:

[0170] Booking a training session

[0171] Input: The user books a training session on their device.

[0172] Processing: The terminal sends the reservation data to the server.

[0173] Data processing: The server notifies the appropriate virtual trainer of the reservation data.

[0174] Output: The device notifies the user as the session time approaches.

[0175] Step 6:

[0176] video chat session

[0177] Input: The user and instructor log into the system during the session time.

[0178] Processing: The device starts a video chat.

[0179] Data processing: Instructors monitor user training in real time and provide feedback.

[0180] Output: Users receive guidance, and the effectiveness of their training improves.

[0181] Step 7:

[0182] Virtual reality training

[0183] Input: The user puts on a VR headset and launches the training application.

[0184] Processing: The device sends the user's training status to the server.

[0185] Data processing: The server generates an appropriate virtual reality environment based on the training program.

[0186] Output: Users perform training in a virtual environment and receive real-time feedback from the server.

[0187] The above outlines the specific processing steps of this system. Based on the information entered at each step, the data is appropriately processed and analyzed, enabling the system to provide users with optimal training and nutritional management.

[0188] (Application Example 1)

[0189] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0190] Traditional factory machinery and equipment faced challenges in maintaining optimal operating conditions due to uniform and inefficient maintenance and operational training. In particular, varying performance requirements for each piece of equipment and the experience levels of technicians often resulted in insufficient maintenance frequency and content. This increased the risk of equipment failures and operational errors.

[0191] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0192] In this invention, the server includes means for receiving the user's personal information and operational objectives; means for generating a customized training program based on the received personal information and operational objectives; means for displaying the generated training program to the user; means for providing a real-time video chat training session between the user and the technician; means for providing the user with an operational experience in a virtual environment; and means for customizing and providing maintenance schedules and training plans for work equipment in a factory setting. This enables customized maintenance and training optimized for the performance of each piece of equipment.

[0193] "Users" refer to engineers and workers who use the system.

[0194] "Personal information" includes information such as the user's name, email address, and password.

[0195] "Operational objectives" refer to the user's goals or tasks related to operating the equipment.

[0196] A "training program" refers to a practice plan customized to achieve specific operational goals.

[0197] A "virtual environment" refers to a simulated operating space created using virtual reality technology.

[0198] A "technician" refers to a professional who provides training sessions to users in real time via video chat.

[0199] "Factory setting" refers to the industrial environment in which equipment is installed and operating.

[0200] "Work equipment" refers to machinery and robots used in factories.

[0201] A "maintenance schedule" refers to a plan for the regular inspection and adjustment of work equipment.

[0202] A "training plan" refers to a customized training plan designed to help users effectively utilize the operating equipment.

[0203] "Operating equipment" refers to all types of equipment used within a factory.

[0204] "Maintenance information" refers to information regarding the maintenance history and current status of the user's operating equipment.

[0205] "Maintenance advice" refers to customized instructions on the optimal maintenance methods for operating equipment.

[0206] "Operational performance" refers to the efficiency and effectiveness of tasks performed by a user using an operating device.

[0207] As an embodiment of this invention, a system for providing customized maintenance schedules and training plans for factory equipment is described.

[0208] First, the server receives personal information and operational goals from the user. Personal information includes name, email address, and password, while operational goals include specific tasks and objectives for operating the equipment. Based on this received information, the server generates a customized training program. This training program is designed to help the user efficiently improve their operational skills, and the generated program is displayed on the user's terminal.

[0209] Furthermore, the system utilizes a means to provide real-time video chat training sessions between users and technicians. The server manages these sessions, allowing users to receive direct advice and corrections from technicians in real time.

[0210] The system also provides an interactive experience in a virtual environment. Users train in a simulated operating space using virtual reality equipment, such as a VR headset. The server dynamically generates this virtual environment and provides real-time feedback to the user.

[0211] In the factory setup, maintenance schedules and training plans for work equipment are also provided on a customized basis. The server receives capability and maintenance information for the operating equipment and generates an optimized maintenance schedule based on this information. This maintenance schedule includes periodic inspection and adjustment tasks, which are also displayed on the user's terminal.

[0212] Furthermore, it includes a means to monitor operational performance in real time and provide feedback. The server stores operational performance data, making it available for later reference. For example, the efficiency and effectiveness of a user's equipment operation can be recorded numerically and used to inform future training plans.

[0213] This system makes it possible to provide users with training tailored to their individual operational goals while maintaining the optimal operation of factory equipment.

[0214] (Specific example)

[0215] For example, consider the factory robot "R12345". The server receives operational goals and maintenance information for this robot from the user and generates a personalized maintenance schedule and an intermediate-level training plan. The maintenance schedule may include details such as "Check Task 1 on Monday." Furthermore, training sessions are conducted via real-time video chat between the user and the technician, where points for operational improvements are pointed out.

[0216] (Example of a prompt message)

[0217] "Please generate a weekly maintenance schedule and an intermediate-level training plan for the robot 'R12345' used in a factory. The robot model is 'X200', and the year of manufacture is 2022."

[0218] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0219] Step 1:

[0220] The server receives personal information and operational goals from the user. The user accesses the system using a terminal and enters and submits information such as their name, email address, password, and operational goals. The server receives this information and stores it in the database. The input is the user's personal information and operational goals, and the output is this information stored in the database.

[0221] Step 2:

[0222] The server generates a customized training program based on the received personal information and operational goals. The server uses a generating AI model to calculate the optimal training steps for the user's operational goals. The input is personal information and operational goals, and the output is the customized training program. Specifically, it includes an algorithm that determines the training content based on the user's experience and goals.

[0223] Step 3:

[0224] The server displays the generated training program on the user's device. The server then reflects the generated training program on the user's dashboard. The input is the generated training program, and the output is the training program displayed on the screen. Specific actions include web page updates and app notifications.

[0225] Step 4:

[0226] A server provides real-time video chat training sessions between users and technicians. Users book training sessions, and the server notifies the technicians of the booking information. Once a session begins, the server coordinates the video chat, enabling real-time communication between the user and the technician. The input is the training session booking information, and the output is the start of the video chat session. Specific operations include the use of video streaming services and notification functions.

[0227] Step 5:

[0228] The server generates a virtual environment and provides an interactive experience to the user's device. The user puts on a VR headset and launches a specific program. Based on the user's training program, the server constructs an appropriate virtual environment. The input is the user's training program, and the output is the virtual environment displayed on the VR headset. Specific operations include environment generation using virtual reality technology and the provision of real-time feedback.

[0229] Step 6:

[0230] The server provides customized maintenance schedules and training plans for work equipment in the factory configuration. The server receives capability and maintenance information for the operating equipment and generates maintenance schedules. The input is the capability and maintenance information of the operating equipment, and the output is the maintenance schedule. Specifically, its operation includes scheduling optimal maintenance tasks for each piece of equipment.

[0231] Step 7:

[0232] The server has the means to monitor operational performance in real time and provide feedback. When a user performs an operation, the server monitors performance using sensors and log data and provides real-time feedback as needed. The input is real-time information from sensors and log data, and the output is feedback to the user. Specific actions include alert and notification functions, or the generation of performance reports.

[0233] Step 8:

[0234] The server saves the aforementioned operational performance data and makes it available for later reference. It stores user operational performance data in a database so that it can be used later when reviewing training content and maintenance schedules. The input is operational performance data, and the output is storage in the database and its availability for later reference. Specific operations include database updates and report generation functions.

[0235] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0236] This invention relates to a system that, in addition to customized training programs and nutritional advice, has the function of recognizing the user's emotional state and providing adjustments and feedback accordingly. This enables comprehensive fitness support that also takes the user's psychological state into consideration. The specific operation of each component is described below.

[0237] 1. User registration and login

[0238] When a user uses the system for the first time, they access a new registration form on their device and enter personal information such as their name, email address, and password. The device sends the entered information to the server. The server processes the received information and stores the user's data in a database. It also generates an authentication token to activate the user account. This allows the user to log in using the login form and access their personal dashboard.

[0239] 2. Creating a customized training program

[0240] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history, etc.) and training goals (e.g., weight loss, muscle gain). The device sends this data to the server. The server analyzes this data and generates a customized training program. The generated program is displayed on the user's personal dashboard.

[0241] 3. Providing nutritional advice

[0242] When a user enters their dietary preferences and allergy information, the device sends this information to the server. The server then generates customized nutritional advice based on this information. It consults a database of nutritionist advice and creates a meal plan for the user. The generated meal plan is displayed on the user's dashboard.

[0243] 4. Virtual trainer service via video chat

[0244] When a user books a training session, the device sends the booking data to the server. The server receives the booking information and notifies the appropriate virtual trainer. As the session time approaches, the device notifies the user and starts a video chat. The trainer monitors the user's training in real time and provides guidance on form correction and motivation improvement.

[0245] 5. Training utilizing virtual reality

[0246] The user puts on a VR headset and launches a specific training application. The server generates an appropriate virtual reality environment based on the user's training program. The generated virtual reality environment is sent to the user's VR headset. The user trains within this virtual environment and receives real-time feedback from the server.

[0247] 6. Recognition and adaptation to emotional states

[0248] This system includes an emotion engine to recognize the user's emotional state. Using the camera and microphone on the user's device (e.g., a smartphone or VR headset), the emotion engine analyzes facial expressions, voice tone, body movements, and other information. The server receives this data and evaluates the user's emotional state.

[0249] Specific example

[0250] User B uses the system to improve their muscle strength. First, they register with the system, log in, and enter their physical information (height 180cm, weight 85kg, age 25, gym experience 3 years). The server uses this information to generate a training program that includes dumbbell exercises and cardio exercises. Next, because User B has a dairy allergy, this is reflected in the meal plan, and a high-protein menu that avoids dairy products is provided.

[0251] If the emotion engine detects that user B's emotions are negative during a session with a virtual trainer, the server transmits this information to the trainer. Based on this, the trainer adds more encouraging words to increase the user's motivation. Conversely, if the server detects that user B's emotions are positive during VR training, it instructs the trainer to moderately increase the training load.

[0252] In this way, the system takes user emotions into consideration and provides appropriate real-time feedback and adjustments, thereby achieving more effective and personalized fitness and nutrition guidance.

[0253] The following describes the processing flow.

[0254] Step 1:

[0255] The user accesses the new registration form on their device and enters personal information such as their name, email address, and password.

[0256] Step 2:

[0257] The terminal sends the entered information to the server.

[0258] Step 3:

[0259] The server processes the received information and saves the user's data to the database.

[0260] Step 4:

[0261] The server generates an authentication token and activates the user account.

[0262] Step 5:

[0263] The user logs in using the login form.

[0264] Step 6:

[0265] The server verifies the user's authentication information and allows them to access their personal dashboard.

[0266] Step 7:

[0267] The user enters their physical information and training goals.

[0268] Step 8:

[0269] The device sends the entered physical information and training goals to the server.

[0270] Step 9:

[0271] The server analyzes the information it receives and generates a customized training program.

[0272] Step 10:

[0273] The server displays the training program it has generated on the user's dashboard.

[0274] Step 11:

[0275] The user enters their dietary preferences and allergy information.

[0276] Step 12:

[0277] The terminal sends the entered dietary information to the server.

[0278] Step 13:

[0279] The server analyzes the received dietary information and generates customized nutritional advice.

[0280] Step 14:

[0281] The server displays the generated nutritional advice on the user's dashboard.

[0282] Step 15:

[0283] The user reserves a training session.

[0284] Step 16:

[0285] The terminal sends the reservation data to the server.

[0286] Step 17:

[0287] The server receives the reservation information and notifies the appropriate virtual trainer.

[0288] Step 18:

[0289] When the session time approaches, the terminal notifies the user.

[0290] Step 19:

[0291] The user launches the video chat interface and starts a session.

[0292] Step 20:

[0293] A virtual trainer monitors the user's training in real time and provides feedback.

[0294] Step 21:

[0295] The user puts on a VR headset and launches a specific training application.

[0296] Step 22:

[0297] The server generates an appropriate virtual reality environment based on the user's training program.

[0298] Step 23:

[0299] The server sends the generated virtual reality environment to the user's VR headset.

[0300] Step 24:

[0301] Users train in a virtual reality environment and receive real-time feedback from the server.

[0302] Step 25:

[0303] Users provide the emotion engine with their facial expressions and voice tone during training via their device's camera and microphone.

[0304] Step 26:

[0305] The emotion engine analyzes the received data and evaluates the user's emotional state.

[0306] Step 27:

[0307] The server receives the emotional state data from the emotion engine and adjusts the training program or feedback.

[0308] Step 28:

[0309] When the user is in a negative emotional state, the server adjusts the virtual trainer and training scenario and provides the user with appropriate ways to improve motivation.

[0310] Step 29:

[0311] When the user is in a positive emotional state, the server makes adaptations such as increasing the training load.

[0312] Step 30:

[0313] After the user finishes the training, the server saves the training data and emotional state data and uses them for optimizing the next training program.

[0314] (Example 2)

[0315] Next, Example 2 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart device 14 is referred to as the "terminal".

[0316] Conventional fitness systems lack sufficient customization based on users' personal information and training goals, and lack the function of providing feedback considering users' emotional states. For this reason, it is difficult to enhance users' motivation or provide appropriate advice in real time, and there is a problem that it is difficult to achieve effective fitness guidance and nutrition management.

[0317] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server

[0318] Means for receiving users' personal information and training goals,

[0319] A means for generating a customized training program based on received personal information and training objectives,

[0320] A means of displaying the generated training program to the user,

[0321] A means of providing real-time video chat training sessions between users and trainers,

[0322] A means of providing users with a training experience in a virtual reality environment,

[0323] A means of recognizing the user's emotional state and providing appropriate feedback,

[0324] This includes [specific features / features]. This enables comprehensive fitness support that takes into account the user's psychological state.

[0325] "Personal information" refers to information used to identify a specific user, such as the user's name, email address, password, age, height, weight, and exercise history.

[0326] "Training goals" refer to specific fitness objectives that a user aims to achieve, such as weight loss, muscle strength improvement, or endurance enhancement.

[0327] A "customized training program" is an individually optimized exercise plan generated based on the user's personal information and training goals.

[0328] A "video chat training session" is a training session conducted through real-time video calls between the user and the trainer over the internet.

[0329] A "virtual reality environment" is a system that provides users with a virtual training environment using devices such as VR headsets, allowing users to experience exercise in a virtual reality setting.

[0330] "Emotional state" refers to the user's psychological state, which is specifically judged through facial expressions, tone of voice, body movements, and other factors.

[0331] "Feedback" refers to responses such as instructions, advice, and encouragement provided based on the user's actions and status.

[0332] "Nutritional advice" refers to personalized guidance and recommendations regarding diet based on the user's dietary preferences and allergy information.

[0333] This invention relates to a system that receives a user's personal information and training goals, and provides a customized training program and nutritional advice. It also includes a function to recognize the user's emotional state and provide feedback accordingly. The specific operation of each component is described below.

[0334] 1. User registration and login

[0335] When a user uses the system for the first time, they access a new registration form on their device and enter personal information such as their name, email address, and password. The device sends this information to the server via an HTTP POST request. The server checks the received information and stores it in its database. If the storage is successful, the server generates an authentication token, such as a JWT (JSON Web Token), and sends it to the device. This allows the user to log in using the login form and access their personal dashboard.

[0336] 2. Creating a customized training program

[0337] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history) and training goals (e.g., weight loss, muscle gain). The device sends this data to the server via an HTTP POST request. The server analyzes the received data and generates a customized training program using a generative AI model. This program is stored in a database and sent to the device. This program is then displayed on the user's personal dashboard.

[0338] 3. Providing nutritional advice

[0339] When a user enters their dietary preferences and allergy information, the device sends this information to the server via an HTTP POST request. Based on the received data, the server consults a nutritionist advice database and generates customized nutritional advice. This generated meal plan is saved to the database and sent back to the device. The device then displays this plan on the user's dashboard.

[0340] 4. Virtual trainer service via video chat

[0341] When a user books a training session, the device sends the booking data to the server via an HTTP POST request. The server receives the booking information and notifies the appropriate virtual trainer. As the session time approaches, the device notifies the user and starts a video chat. The virtual trainer monitors the user's training in real time and provides guidance on correcting form and improving motivation.

[0342] 5. Training utilizing virtual reality

[0343] The user puts on a VR headset and launches a dedicated training application. The server generates an appropriate virtual reality environment based on the user's training program. This environment is stored in a database and sent to the user's VR headset. The user trains in this virtual environment and receives real-time feedback from the server.

[0344] 6. Recognition and adaptation to emotional states

[0345] The camera and microphone on the user's device capture their facial expressions, voice tone, and body movements. This data is transmitted to a server in real time. The server uses an emotion engine to analyze the data and evaluate the user's emotional state. Based on this evaluation, training and nutritional advice are tailored to the user. For example, if the user is in a negative emotional state, the server notifies the trainer and instructs them to add words of encouragement, etc.

[0346] Specific example

[0347] User B uses the system with the goal of improving their muscle strength. User B registers with the system and, after logging in, enters their physical information (height 180cm, weight 85kg, age 25, gym experience 3 years). Based on this data, the server generates a training program that includes dumbbell exercises and cardio exercises. Subsequently, User B enters their dairy allergy, and based on this, a high-protein diet menu that avoids dairy products is provided. If the emotion engine detects negative emotions from User B during a session with the virtual trainer, the server notifies the trainer, who then offers words of encouragement. Conversely, if positive emotions are detected during VR training, instructions are given to moderately increase the training load.

[0348] Examples of prompt statements are as follows:

[0349] "Please enter the user's height, weight, age, and exercise history."

[0350] "Next, please select your training goal."

[0351] Please enter your dietary preferences and allergy information.

[0352] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0353] 1. User registration and login

[0354] Step 1:

[0355] The user accesses the new registration form. The user enters their name, email address, and password. The user is given the name, email address, and password as input.

[0356] Step 2:

[0357] The terminal sends the entered information to the server via an HTTP POST request. The server receives the information and saves it to the database. A message indicating successful saving is output.

[0358] Step 3:

[0359] The server generates an authentication token (e.g., a JWT) and sends it to the terminal. The token is issued as output.

[0360] Step 4:

[0361] The device saves the received token. The user uses the token to log in through the login form and access their personal dashboard. A login success message is output.

[0362] 2. Creating a customized training program

[0363] Step 1:

[0364] After logging in, the user enters physical information (e.g., height, weight, age, exercise history) and training goals (e.g., weight loss, muscle strength improvement). Physical information and training goals are provided as input fields.

[0365] Step 2:

[0366] The device sends this data to the server via an HTTP POST request. The server analyzes the received data and uses it to generate a customized training program using a generated AI model. The training program is obtained as output.

[0367] Step 3:

[0368] The generated training program is sent from the server to the terminal. The terminal displays the program on the user's personal dashboard. The displayed training program is obtained as output.

[0369] 3. Providing nutritional advice

[0370] Step 1:

[0371] The user enters their dietary preferences and allergy information. The input provided includes dietary preferences and allergy information.

[0372] Step 2:

[0373] The device sends this information to the server via an HTTP POST request. The server analyzes the received data, consults a nutritionist advice database, and generates customized nutrition advice. The output is the nutrition advice.

[0374] Step 3:

[0375] The generated nutritional advice is sent from the server to the terminal and displayed on the user's personal dashboard. The output is the displayed nutritional advice.

[0376] 4. Virtual trainer service via video chat

[0377] Step 1:

[0378] A user books a training session. The booking information is provided as input.

[0379] Step 2:

[0380] The terminal sends reservation data to the server via an HTTP POST request. The server receives the reservation information and notifies the appropriate virtual trainer. The output is the notification to the trainer.

[0381] Step 3:

[0382] As the session time approaches, the device notifies the user and initiates the video chat. A real-time video chat takes place between the user and the trainer. The output is a video session start notification.

[0383] Step 4:

[0384] During video chat, the trainer monitors the user's training, providing guidance on form correction and motivation improvement. The output is real-time training instruction.

[0385] 5. Training utilizing virtual reality

[0386] Step 1:

[0387] The user puts on a VR headset and launches a dedicated training application. The inputs provided are the wearing of the VR headset and the launch of the application.

[0388] Step 2:

[0389] The server generates an appropriate virtual reality environment based on the user's training program. The output is a VR environment.

[0390] Step 3:

[0391] The VR environment is sent from the server to the user's VR headset. The user performs training within the virtual environment. The output is the sent VR environment.

[0392] Step 4:

[0393] Users train in a virtual reality environment and receive real-time feedback from the server. The output is real-time feedback.

[0394] 6. Recognition and adaptation to emotional states

[0395] Step 1:

[0396] The camera and microphone on the user's device capture facial expressions, voice tone, and body movements. Facial expressions, voice tone, and body movements are provided as input.

[0397] Step 2:

[0398] The device sends the collected data to the server in real time. The server uses an emotion engine to analyze the data and evaluate the user's emotional state. The output is the evaluation result of the emotional state.

[0399] Step 3:

[0400] Based on the user's emotional state, training programs and nutritional advice are tailored to their needs. If the user is in a negative emotional state, the server notifies the trainer and instructs them to add encouraging words, etc. The output is the tailored training and nutritional advice.

[0401] (Application Example 2)

[0402] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0403] While conventional fitness support systems provide customized programs based on the user's physical information and training goals, they lack real-time feedback and adjustments that take into account the user's emotional state. As a result, maintaining user motivation and optimizing performance is difficult, leading to challenges in fully realizing the effects of training. Furthermore, even in training sessions utilizing virtual reality environments and real-time video chat, individualized support that takes into account the user's psychological state is required, but this is difficult to achieve with current systems.

[0404] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for receiving the user's personal information and training goals, means for generating a customized training program based on the received personal information and training goals, means for displaying the generated training program to the user, means for providing a real-time video chat training session between the user and the instructor, means for providing the user with a training experience in a virtual reality environment, means for recognizing the user's emotional state and providing adjustments and feedback accordingly, and means for collecting data from a camera and microphone for analyzing the emotional state. This enables comprehensive fitness support that takes the user's emotional state into consideration.

[0405] A "user" is an individual who uses the system to receive training programs and nutritional advice.

[0406] "Personal information" refers to data that includes physical information about the user, such as height, weight, and age, as well as contact information.

[0407] "Training goals" refer to specific fitness objectives that users want to achieve, such as weight loss or muscle gain.

[0408] A "customized training program" refers to an exercise plan generated individually based on the user's personal information and training goals.

[0409] "Means of display" refers to methods and devices for outputting the generated training program to the user's device or a display in the gym.

[0410] A "trainer" is a professional who provides exercise guidance and advice to users through training sessions.

[0411] A "real-time video chat training session" is a session in which instructors and users conduct training in real time via video and audio over a network.

[0412] A "virtual reality environment" refers to a technology and system that allows users to exercise in a virtual training space.

[0413] "Emotional state" refers to the user's psychological state or emotions, such as joy, sadness, or anger.

[0414] "Means of providing adjustments and feedback" refers to methods and systems that appropriately modify training programs and instruction content based on the user's emotional state and provide appropriate advice.

[0415] "Means of collecting data from cameras and microphones" refers to devices for recording a user's facial expressions and voice tone, and methods for transmitting that data to a system.

[0416] This invention relates to a system that provides comprehensive fitness support by offering customized training programs and nutritional advice based on the user's personal information and training goals, and by providing adjustments and feedback according to the user's emotional state. Specific embodiments are described below.

[0417] System Overview

[0418] This system mainly consists of the following components:

[0419] 1. Ability to receive users' personal information and training goals.

[0420] 2. Ability to generate customized training programs

[0421] 3. Function to display the training program to the user.

[0422] 4. A feature that provides real-time video chat training sessions between users and instructors.

[0423] 5. Features that provide a training experience in a virtual reality environment.

[0424] 6. A function that recognizes the user's emotional state and provides adjustments and feedback accordingly.

[0425] 7. Function to collect data from cameras and microphones to analyze emotional states.

[0426] System Implementation Procedures

[0427] Regarding program generation and processing

[0428] Hardware and software to be used

[0429] Hardware: Smartphones, cameras in the gym, fitness machines with sensors

[0430] Software: Python, OpenCV (face recognition), Azure® Emotion API (emotion analysis), frontend is React Native or Flutter®.

[0431] 1. User registration and login

[0432] When a user uses the system for the first time, they access a new registration form on their smartphone or a terminal in the gym and enter their personal information (e.g., name, email address, password). The terminal sends the entered information to the server, which stores the received information in a database. At the same time, an authentication token is generated to activate the user account, and the user can log in using the login form and access their personal dashboard.

[0433] 2. Creating a customized training program

[0434] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history) and training goals. The device sends this data to the server, which analyzes it and generates a personalized training program for the user. The generated program is then displayed on the user's personal dashboard.

[0435] 3. Providing nutritional advice

[0436] When a user enters their dietary preferences and allergy information, the device sends this information to a server. The server then consults a database of nutritionist advice and generates personalized nutritional advice. This advice is then displayed on the user's dashboard.

[0437] 4. Coaching services via video chat

[0438] When a user books a training session, the device sends the booking data to the server. The server receives the booking information and notifies the appropriate instructor. As the session time approaches, the device notifies the user and starts a video chat. The instructor monitors the user's training in real time and provides guidance on form correction and motivation improvement.

[0439] 5. Training utilizing virtual reality

[0440] The user puts on a VR headset and launches a specific training application. The server generates an appropriate virtual reality environment based on the user's training program. The generated virtual reality environment is sent to the user's VR headset. The user trains within this virtual environment and receives real-time feedback from the server.

[0441] 6. Recognition and adaptation to emotional states

[0442] This system includes an emotion engine to recognize the user's emotional state. Using the camera and microphone on the user's device (e.g., smartphone or VR headset), the emotion engine analyzes facial expressions, voice tone, body movements, etc. The server receives this data and evaluates the user's emotional state. Based on the emotional state, it adjusts the training load and provides feedback in real time.

[0443] Specific example

[0444] For example, if the emotion engine detects that the user is fatigued during training, the server will instruct it to reduce the training load. Also, if the user is excited about achieving their goal, the server will suggest a more challenging training session. Examples of prompts for the generative AI model include, "Analyze my emotional state and give me appropriate training feedback," and "Adjust my future training plan based on my emotional data."

[0445] In this way, comprehensive fitness support that takes into account the user's emotional state can be realized.

[0446] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0447] Step 1: User registration and login

[0448] Users access a new registration form on their smartphone or a terminal within the gym and enter personal information such as their name, email address, and password. The terminal sends the entered information to the server. The server stores the received information in a database, generates an authentication token, and activates the user account. This allows the user to log in using the login form and access their personal dashboard. The input is the user's personal information, and the output is the user information and authentication token stored in the database.

[0449] Step 2: Create a customized training program

[0450] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history, etc.) and training goals. The device sends this data to the server. The server analyzes this data and generates a customized training program. The generated program is displayed on the user's personal dashboard. The input is the user's physical information and training goals, and the output is the customized training program.

[0451] Step 3: Provide nutritional advice

[0452] The user enters their dietary preferences and allergy information. The terminal sends this information to the server. The server consults a nutritionist advice database and generates customized nutritional advice. The generated nutritional advice is displayed on the user's dashboard. The input is the user's dietary and allergy information, and the output is customized nutritional advice.

[0453] Step 4: Coaching services via video chat

[0454] The user books a fitness session. The device sends the booking data to the server. The server receives the booking information and notifies the appropriate instructor. As the session time approaches, the device notifies the user and starts a video chat. The instructor monitors the user's training in real time and provides appropriate corrections and motivational guidance. The input is the user's session booking information, and the output is the video chat connection for the training session.

[0455] Step 5: Training using virtual reality

[0456] The user puts on a VR headset and launches a virtual training application. The server generates a suitable virtual reality environment based on the user's training program. The generated virtual reality environment is sent to the VR headset, and the user trains in this virtual environment. The server provides real-time feedback. The input is the user's training program, and the output is the virtual reality environment and real-time feedback.

[0457] Step 6: Recognition and feedback on emotional state

[0458] Users utilize cameras and microphones built into their smartphones or VR headsets. Data such as facial expressions, voice tone, and body movements are collected from these devices. The devices transmit this data to a server, which uses an emotion engine to analyze the user's emotional state. Based on the analysis results, the server adjusts the training load and feedback as needed and provides it to the user. The input is the user's emotional data, and the output is the adjusted training load and feedback.

[0459] Specific example:

[0460] For example, if a user shows signs of fatigue during training, the emotion engine analyzes this information and notifies the server. The server then instructs the system to reduce the training load and notifies the user via a pop-up message. Examples of prompts for the generative AI model include, "Analyze my emotional state and provide appropriate training feedback," and "Adjust future training plans based on the user's emotional data."

[0461] In this way, the system is designed to provide users with optimal training and advice by performing appropriate data processing and calculations based on the user's input data at each step and providing feedback on the results.

[0462] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0463] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0464] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0465] [Second Embodiment]

[0466] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0467] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0468] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0469] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0470] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0471] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0472] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0473] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0474] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0475] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0476] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0477] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0478] This invention relates to a system that provides customized training programs and nutritional advice to support users in effectively achieving their fitness goals. The specific operation of each component is described below.

[0479] 1. User registration and login

[0480] When a user uses the system for the first time, they access a new registration form on their device. The user enters personal information such as their name, email address, and password, and submits it. The server receives the entered information and stores it in the database. It also generates an authentication token to activate the user account. This allows the user to log in using the login form and access their personal dashboard.

[0481] 2. Creating a customized training program

[0482] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history, etc.) and training goals (e.g., weight loss, muscle gain). The server receives this data and performs analysis. Based on the analysis results, the server uses an algorithm to generate a training program optimized for the user and displays it on their personal dashboard. The user then proceeds with their training according to this program.

[0483] 3. Providing nutritional advice

[0484] When a user enters their dietary preferences and allergy information, the server generates customized nutritional advice based on this information. The server refers to a database of nutritionist advice and creates a meal plan for the user. The generated meal plan is displayed on the user's dashboard.

[0485] 4. Virtual trainer service via video chat

[0486] When a user books a training session, the server receives the booking data and notifies the appropriate virtual trainer. As the session time approaches, the device notifies the user and starts a video chat. The trainer monitors the user's training in real time and provides guidance on form correction and motivation.

[0487] 5. Training utilizing virtual reality

[0488] The user puts on a VR headset and launches a specific training application. The server generates an appropriate virtual reality environment based on the user's training program. The user trains within this virtual environment and receives real-time feedback from the server, thereby enhancing the effectiveness of the training.

[0489] Specific example

[0490] User A uses the system with the goal of losing weight. First, they register with the system, log in, and enter their physical information (height 170cm, weight 75kg, age 30, no prior exercise experience). The server receives this information and generates a program that includes three cardio exercises per week and strength training. Next, because User A has a dairy allergy, this is reflected in the meal plan, and a calorie-balanced meal plan that avoids dairy products is provided. In addition, they regularly schedule video chat sessions with a virtual trainer to receive form checks and support to maintain motivation. Furthermore, they use a virtual reality environment to experience a realistic gym-like training environment from the comfort of their home.

[0491] In this way, this system provides users with comprehensive training and nutritional management, and delivers customized support tailored to their individual goals.

[0492] The following describes the processing flow.

[0493] Step 1:

[0494] The user accesses the new registration form on their device and enters personal information such as their name, email address, and password.

[0495] Step 2:

[0496] The terminal sends the entered information to the server.

[0497] Step 3:

[0498] The server processes the received information and saves the user's data to the database.

[0499] Step 4:

[0500] The server generates an authentication token and activates the user account.

[0501] Step 5:

[0502] The user logs in using the login form.

[0503] Step 6:

[0504] The server verifies the user's authentication information and allows them to access their personal dashboard.

[0505] Step 7:

[0506] The user enters their physical information and training goals.

[0507] Step 8:

[0508] The device sends the entered physical information and training goals to the server.

[0509] Step 9:

[0510] The server analyzes the information it receives and generates a customized training program.

[0511] Step 10:

[0512] The server displays the generated training program on the user's dashboard.

[0513] Step 11:

[0514] Users enter their dietary preferences and allergy information.

[0515] Step 12:

[0516] The terminal sends the entered meal information to the server.

[0517] Step 13:

[0518] The server analyzes the received meal information and generates customized nutritional advice.

[0519] Step 14:

[0520] The server displays the generated nutritional advice on the user's dashboard.

[0521] Step 15:

[0522] The user books a training session.

[0523] Step 16:

[0524] The device sends the reservation data to the server.

[0525] Step 17:

[0526] The server receives the reservation information and notifies the appropriate virtual trainer.

[0527] Step 18:

[0528] As the session time approaches, the device will notify the user.

[0529] Step 19:

[0530] The user launches the video chat interface and starts a session.

[0531] Step 20:

[0532] A virtual trainer monitors the user's training in real time and provides feedback.

[0533] Step 21:

[0534] The user puts on a VR headset and launches a specific training application.

[0535] Step 22:

[0536] The server generates an appropriate virtual reality environment based on the user's training program.

[0537] Step 23:

[0538] The server sends the generated virtual reality environment to the user's VR headset.

[0539] Step 24:

[0540] Users train in a virtual reality environment and receive real-time feedback from the server.

[0541] (Example 1)

[0542] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0543] Conventional fitness systems have struggled to provide customized training programs and nutritional advice for each user, resulting in a lack of effective support tailored to individual user needs. Furthermore, they lacked features to provide realistic training experiences and real-time feedback, preventing users from receiving sufficient support to achieve their goals. To address these challenges, the present invention aims to provide a system that offers comprehensive training and nutritional management to users, supporting them in achieving their individual goals.

[0544] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0545] In this invention, the server includes means for receiving the user's personal information and training goals, means for generating a customized training program based on the received personal information and training goals, means for displaying the generated training program to the user, means for receiving the user's dietary preferences and allergy information, means for generating customized nutritional advice based on the received dietary preferences and allergy information, means for providing the generated nutritional advice to the user, means for providing real-time video chat training sessions between the user and the instructor, and means for providing the user with a training experience in a virtual reality environment. As a result, the user can receive individually customized training programs and nutritional advice, and more effectively achieve their fitness goals through real-time support and a realistic training experience.

[0546] "Personal information" refers to data used to identify or distinguish a user, such as the user's name, email address, password, height, weight, age, and exercise history.

[0547] "Training goals" refer to fitness goals set by the user, such as weight loss or muscle strength improvement.

[0548] A "training program" is an exercise schedule or plan created based on the user's personal information and training goals, and includes details regarding the type, frequency, and intensity of exercise.

[0549] "Dietary preferences" refer to the ingredients and types of food that users like, and are information about the user's eating preferences.

[0550] "Allergy information" refers to information about the foods and ingredients that a user is allergic to.

[0551] "Nutritional advice" refers to a balanced meal plan and dietary recommendations tailored to the user's dietary preferences and allergy information.

[0552] A "trainer" refers to a professional who supports users' training and provides guidance and advice in real time.

[0553] A "real-time video chat training session" is a type of session in which users and instructors conduct training simultaneously online via video chat.

[0554] A "virtual reality environment" is a virtual training space created using virtual reality technology, allowing users to enjoy a training experience that closely resembles reality.

[0555] "Customization" refers to optimizing specific content or functions based on each user's individual needs and information.

[0556] A "generative AI model" is an artificial intelligence algorithm or system that automatically creates training programs and nutritional advice based on user information.

[0557] "Feedback" refers to evaluations and advice given regarding a user's training performance, providing information that users can use to improve or adjust their training.

[0558] "Reservation" refers to the act of a user setting and securing a training session or video chat in advance.

[0559] This invention relates to a system that provides customized training programs and nutritional advice to support users in effectively achieving their fitness goals. This system provides optimized training and nutritional management based on the user's personal information, training goals, dietary preferences, and allergy information. The specific operation of each component of this system is described below.

[0560] Hardware and software usage

[0561] This system uses the following hardware and software:

[0562] Devices (PCs, smartphones, tablets, etc.)

[0563] Server (including database and analysis engine)

[0564] VR headset for virtual reality

[0565] Camera and microphone for video chat

[0566] User registration and login

[0567] When a user uses the system for the first time, they access a new registration form on their device. The user enters personal information such as their name, email address, and password, and submits it. The server receives the entered information and securely stores it in the database. Furthermore, it generates an authentication token to activate the user account. This allows the user to log in using the login form and access their personal dashboard.

[0568] Creating a customized training program

[0569] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history, etc.) and training goals (e.g., weight loss, muscle strength improvement). The server receives this data and performs analysis. A generative AI model is used for the analysis to generate an optimized training program based on the user's information. The generated training program is displayed on the user's personal dashboard. The user then proceeds with their training according to this program.

[0570] Providing nutritional advice

[0571] When a user enters their dietary preferences and allergy information, the server generates personalized nutritional advice based on that information. The server consults a database of nutritionist advice and creates a meal plan for the user. The generated meal plan is displayed on the user's dashboard. The user can use this information to incorporate appropriate meals into their diet.

[0572] Virtual trainer service via video chat

[0573] When a user books a training session, the server receives the booking data and notifies the appropriate virtual trainer. As the session time approaches, the device notifies the user and initiates a video chat. The trainer monitors the user's training in real time and provides guidance on form correction and motivation improvement.

[0574] Training utilizing virtual reality

[0575] The user puts on a VR headset and launches a specific training application on their device. The server generates an appropriate virtual reality environment based on the user's training program. The user trains within this virtual environment and receives real-time feedback from the server to enhance the effectiveness of their training.

[0576] Specific example

[0577] If User A uses the system with the goal of losing weight, they first register and log in. Next, they enter their physical information (height 170cm, weight 75kg, age 30, no prior exercise experience). The server receives this information and generates a program that includes cardio exercises and strength training three times a week. Since User A has a dairy allergy, a meal plan is also generated based on that. User A regularly schedules video chat sessions with a virtual trainer to receive training guidance. Furthermore, they experience training in a virtual reality environment using a VR headset.

[0578] Example of a prompt

[0579] "Please explain the user registration procedure in detail."

[0580] "Please explain how to generate a customized training program."

[0581] Please describe in detail how you provide nutritional advice.

[0582] "Please explain the support process via video chat."

[0583] "What are the advantages of training programs that utilize virtual reality?"

[0584] As described above, this system provides users with comprehensive training and nutritional management, and delivers customized support tailored to individual goals.

[0585] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0586] Step 1:

[0587] User Registration

[0588] Input: The user enters personal information such as their name, email address, and password into a new registration form on their device.

[0589] Processing: The terminal sends the entered information to the server.

[0590] Data processing: The server analyzes the received information and securely stores it in the database. Next, it generates an authentication token.

[0591] Output: The user account is activated, and the user can log in.

[0592] Step 2:

[0593] User Login

[0594] Input: The user enters their email address and password into the login form on their device.

[0595] Processing: The terminal sends the input information to the server.

[0596] Data processing: The server compares the input information with the information in the database and performs authentication.

[0597] Output: If authentication is successful, the user will be able to access their personal dashboard.

[0598] Step 3:

[0599] Entering physical information and training goals

[0600] Input: The user enters physical information (height, weight, age, exercise history, etc.) and training goals (weight loss, muscle strength improvement, etc.) on their device.

[0601] Processing: The terminal sends that data to the server.

[0602] Data processing: The server analyzes the received data and generates a training program optimized for the user.

[0603] Output: The generated training program is displayed on the user's dashboard.

[0604] Step 4:

[0605] Enter your dietary preferences and allergy information.

[0606] Input: The user enters their dietary preferences and allergy information on their device.

[0607] Processing: The terminal sends the input data to the server.

[0608] Data processing: The server references a nutritionist advice database and generates nutritional advice tailored to the user.

[0609] Output: Customized nutritional advice is displayed on the user's dashboard.

[0610] Step 5:

[0611] Booking a training session

[0612] Input: The user books a training session on their device.

[0613] Processing: The terminal sends the reservation data to the server.

[0614] Data processing: The server notifies the appropriate virtual trainer of the reservation data.

[0615] Output: The device notifies the user as the session time approaches.

[0616] Step 6:

[0617] video chat session

[0618] Input: The user and instructor log into the system during the session time.

[0619] Processing: The device starts a video chat.

[0620] Data processing: Instructors monitor user training in real time and provide feedback.

[0621] Output: Users receive guidance, and the effectiveness of their training improves.

[0622] Step 7:

[0623] Virtual reality training

[0624] Input: The user puts on a VR headset and launches the training application.

[0625] Processing: The device sends the user's training status to the server.

[0626] Data processing: The server generates an appropriate virtual reality environment based on the training program.

[0627] Output: Users perform training in a virtual environment and receive real-time feedback from the server.

[0628] The above outlines the specific processing steps of this system. Based on the information entered at each step, the data is appropriately processed and analyzed, enabling the system to provide users with optimal training and nutritional management.

[0629] (Application Example 1)

[0630] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0631] Traditional factory machinery and equipment faced challenges in maintaining optimal operating conditions due to uniform and inefficient maintenance and operational training. In particular, varying performance requirements for each piece of equipment and the experience levels of technicians often resulted in insufficient maintenance frequency and content. This increased the risk of equipment failures and operational errors.

[0632] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0633] In this invention, the server includes means for receiving the user's personal information and operational objectives; means for generating a customized training program based on the received personal information and operational objectives; means for displaying the generated training program to the user; means for providing a real-time video chat training session between the user and the technician; means for providing the user with an operational experience in a virtual environment; and means for customizing and providing maintenance schedules and training plans for work equipment in a factory setting. This enables customized maintenance and training optimized for the performance of each piece of equipment.

[0634] "Users" refer to engineers and workers who use the system.

[0635] "Personal information" includes information such as the user's name, email address, and password.

[0636] "Operational objectives" refer to the user's goals or tasks related to operating the equipment.

[0637] A "training program" refers to a practice plan customized to achieve specific operational goals.

[0638] A "virtual environment" refers to a simulated operating space created using virtual reality technology.

[0639] A "technician" refers to a professional who provides training sessions to users in real time via video chat.

[0640] "Factory setting" refers to the industrial environment in which equipment is installed and operating.

[0641] "Work equipment" refers to machinery and robots used in factories.

[0642] A "maintenance schedule" refers to a plan for the regular inspection and adjustment of work equipment.

[0643] A "training plan" refers to a customized training plan designed to help users effectively utilize the operating equipment.

[0644] "Operating equipment" refers to all types of equipment used within a factory.

[0645] "Maintenance information" refers to information regarding the maintenance history and current status of the user's operating equipment.

[0646] "Maintenance advice" refers to customized instructions on the optimal maintenance methods for operating equipment.

[0647] "Operational performance" refers to the efficiency and effectiveness of tasks performed by a user using an operating device.

[0648] As an embodiment of this invention, a system for providing customized maintenance schedules and training plans for factory equipment is described.

[0649] First, the server receives personal information and operational goals from the user. Personal information includes name, email address, and password, while operational goals include specific tasks and objectives for operating the equipment. Based on this received information, the server generates a customized training program. This training program is designed to help the user efficiently improve their operational skills, and the generated program is displayed on the user's terminal.

[0650] Furthermore, the system utilizes a means to provide real-time video chat training sessions between users and technicians. The server manages these sessions, allowing users to receive direct advice and corrections from technicians in real time.

[0651] The system also provides an interactive experience in a virtual environment. Users train in a simulated operating space using virtual reality equipment, such as a VR headset. The server dynamically generates this virtual environment and provides real-time feedback to the user.

[0652] In the factory setup, maintenance schedules and training plans for work equipment are also provided on a customized basis. The server receives capability and maintenance information for the operating equipment and generates an optimized maintenance schedule based on this information. This maintenance schedule includes periodic inspection and adjustment tasks, which are also displayed on the user's terminal.

[0653] Furthermore, it includes a means to monitor operational performance in real time and provide feedback. The server stores operational performance data, making it available for later reference. For example, the efficiency and effectiveness of a user's equipment operation can be recorded numerically and used to inform future training plans.

[0654] This system makes it possible to provide users with training tailored to their individual operational goals while maintaining the optimal operation of factory equipment.

[0655] (Specific example)

[0656] For example, consider the factory robot "R12345". The server receives operational goals and maintenance information for this robot from the user and generates a personalized maintenance schedule and an intermediate-level training plan. The maintenance schedule may include details such as "Check Task 1 on Monday." Furthermore, training sessions are conducted via real-time video chat between the user and the technician, where points for operational improvements are pointed out.

[0657] (Example of a prompt message)

[0658] "Please generate a weekly maintenance schedule and an intermediate-level training plan for the robot 'R12345' used in a factory. The robot model is 'X200', and the year of manufacture is 2022."

[0659] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0660] Step 1:

[0661] The server receives personal information and operational goals from the user. The user accesses the system using a terminal and enters and submits information such as their name, email address, password, and operational goals. The server receives this information and stores it in the database. The input is the user's personal information and operational goals, and the output is this information stored in the database.

[0662] Step 2:

[0663] The server generates a customized training program based on the received personal information and operational goals. The server uses a generating AI model to calculate the optimal training steps for the user's operational goals. The input is personal information and operational goals, and the output is the customized training program. Specifically, it includes an algorithm that determines the training content based on the user's experience and goals.

[0664] Step 3:

[0665] The server displays the generated training program on the user's device. The server then reflects the generated training program on the user's dashboard. The input is the generated training program, and the output is the training program displayed on the screen. Specific actions include web page updates and app notifications.

[0666] Step 4:

[0667] A server provides real-time video chat training sessions between users and technicians. Users book training sessions, and the server notifies the technicians of the booking information. Once a session begins, the server coordinates the video chat, enabling real-time communication between the user and the technician. The input is the training session booking information, and the output is the start of the video chat session. Specific operations include the use of video streaming services and notification functions.

[0668] Step 5:

[0669] The server generates a virtual environment and provides an interactive experience to the user's device. The user puts on a VR headset and launches a specific program. Based on the user's training program, the server constructs an appropriate virtual environment. The input is the user's training program, and the output is the virtual environment displayed on the VR headset. Specific operations include environment generation using virtual reality technology and the provision of real-time feedback.

[0670] Step 6:

[0671] The server provides customized maintenance schedules and training plans for work equipment in the factory configuration. The server receives capability and maintenance information for the operating equipment and generates maintenance schedules. The input is the capability and maintenance information of the operating equipment, and the output is the maintenance schedule. Specifically, its operation includes scheduling optimal maintenance tasks for each piece of equipment.

[0672] Step 7:

[0673] The server has the means to monitor operational performance in real time and provide feedback. When a user performs an operation, the server monitors performance using sensors and log data and provides real-time feedback as needed. The input is real-time information from sensors and log data, and the output is feedback to the user. Specific actions include alert and notification functions, or the generation of performance reports.

[0674] Step 8:

[0675] The server saves the aforementioned operational performance data and makes it available for later reference. It stores user operational performance data in a database so that it can be used later when reviewing training content and maintenance schedules. The input is operational performance data, and the output is storage in the database and its availability for later reference. Specific operations include database updates and report generation functions.

[0676] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0677] This invention relates to a system that, in addition to customized training programs and nutritional advice, has the function of recognizing the user's emotional state and providing adjustments and feedback accordingly. This enables comprehensive fitness support that also takes the user's psychological state into consideration. The specific operation of each component is described below.

[0678] 1. User registration and login

[0679] When a user uses the system for the first time, they access a new registration form on their device and enter personal information such as their name, email address, and password. The device sends the entered information to the server. The server processes the received information and stores the user's data in a database. It also generates an authentication token to activate the user account. This allows the user to log in using the login form and access their personal dashboard.

[0680] 2. Creating a customized training program

[0681] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history, etc.) and training goals (e.g., weight loss, muscle gain). The device sends this data to the server. The server analyzes this data and generates a customized training program. The generated program is displayed on the user's personal dashboard.

[0682] 3. Providing nutritional advice

[0683] When a user enters their dietary preferences and allergy information, the device sends this information to the server. The server then generates customized nutritional advice based on this information. It consults a database of nutritionist advice and creates a meal plan for the user. The generated meal plan is displayed on the user's dashboard.

[0684] 4. Virtual trainer service via video chat

[0685] When a user books a training session, the device sends the booking data to the server. The server receives the booking information and notifies the appropriate virtual trainer. As the session time approaches, the device notifies the user and starts a video chat. The trainer monitors the user's training in real time and provides guidance on form correction and motivation improvement.

[0686] 5. Training utilizing virtual reality

[0687] The user puts on a VR headset and launches a specific training application. The server generates an appropriate virtual reality environment based on the user's training program. The generated virtual reality environment is sent to the user's VR headset. The user trains within this virtual environment and receives real-time feedback from the server.

[0688] 6. Recognition and adaptation to emotional states

[0689] This system includes an emotion engine to recognize the user's emotional state. Using the camera and microphone on the user's device (e.g., a smartphone or VR headset), the emotion engine analyzes facial expressions, voice tone, body movements, and other information. The server receives this data and evaluates the user's emotional state.

[0690] Specific example

[0691] User B uses the system to improve their muscle strength. First, they register with the system, log in, and enter their physical information (height 180cm, weight 85kg, age 25, gym experience 3 years). The server uses this information to generate a training program that includes dumbbell exercises and cardio exercises. Next, because User B has a dairy allergy, this is reflected in the meal plan, and a high-protein menu that avoids dairy products is provided.

[0692] If the emotion engine detects that user B's emotions are negative during a session with a virtual trainer, the server transmits this information to the trainer. Based on this, the trainer adds more encouraging words to increase the user's motivation. Conversely, if the server detects that user B's emotions are positive during VR training, it instructs the trainer to moderately increase the training load.

[0693] In this way, the system takes user emotions into consideration and provides appropriate real-time feedback and adjustments, thereby achieving more effective and personalized fitness and nutrition guidance.

[0694] The following describes the processing flow.

[0695] Step 1:

[0696] The user accesses the new registration form on their device and enters personal information such as their name, email address, and password.

[0697] Step 2:

[0698] The terminal sends the entered information to the server.

[0699] Step 3:

[0700] The server processes the received information and saves the user's data to the database.

[0701] Step 4:

[0702] The server generates an authentication token and activates the user account.

[0703] Step 5:

[0704] The user logs in using the login form.

[0705] Step 6:

[0706] The server verifies the user's authentication information and allows them to access their personal dashboard.

[0707] Step 7:

[0708] The user enters their physical information and training goals.

[0709] Step 8:

[0710] The device sends the entered physical information and training goals to the server.

[0711] Step 9:

[0712] The server analyzes the information it receives and generates a customized training program.

[0713] Step 10:

[0714] The server displays the generated training program on the user's dashboard.

[0715] Step 11:

[0716] Users enter their dietary preferences and allergy information.

[0717] Step 12:

[0718] The terminal sends the entered meal information to the server.

[0719] Step 13:

[0720] The server analyzes the received meal information and generates customized nutritional advice.

[0721] Step 14:

[0722] The server displays the generated nutritional advice on the user's dashboard.

[0723] Step 15:

[0724] The user books a training session.

[0725] Step 16:

[0726] The device sends the reservation data to the server.

[0727] Step 17:

[0728] The server receives the reservation information and notifies the appropriate virtual trainer.

[0729] Step 18:

[0730] As the session time approaches, the device will notify the user.

[0731] Step 19:

[0732] The user launches the video chat interface and starts a session.

[0733] Step 20:

[0734] A virtual trainer monitors the user's training in real time and provides feedback.

[0735] Step 21:

[0736] The user puts on a VR headset and launches a specific training application.

[0737] Step 22:

[0738] The server generates an appropriate virtual reality environment based on the user's training program.

[0739] Step 23:

[0740] The server sends the generated virtual reality environment to the user's VR headset.

[0741] Step 24:

[0742] Users train in a virtual reality environment and receive real-time feedback from the server.

[0743] Step 25:

[0744] Users provide the emotion engine with their facial expressions and voice tone during training via their device's camera and microphone.

[0745] Step 26:

[0746] The emotion engine analyzes the received data and evaluates the user's emotional state.

[0747] Step 27:

[0748] The server receives emotional state data from the emotion engine and adjusts the training program or feedback accordingly.

[0749] Step 28:

[0750] If a user is in a negative emotional state, the server adjusts the virtual trainer and training scenario to provide the user with appropriate ways to improve their motivation.

[0751] Step 29:

[0752] When the user is in a positive emotional state, the server makes adjustments such as increasing the training load.

[0753] Step 30:

[0754] After the user finishes training, the server saves the training data and emotional state data, which are then used to optimize the next training program.

[0755] (Example 2)

[0756] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0757] Traditional fitness systems lack sufficient customization based on users' personal information and training goals, and they also lack the ability to provide feedback that takes into account the user's emotional state. This makes it difficult to motivate users, provide appropriate advice in real time, and achieve effective fitness guidance and nutritional management.

[0758] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server is

[0759] Means for receiving users' personal information and training goals,

[0760] A means for generating a customized training program based on received personal information and training objectives,

[0761] A means of displaying the generated training program to the user,

[0762] A means of providing real-time video chat training sessions between users and trainers,

[0763] A means of providing users with a training experience in a virtual reality environment,

[0764] A means of recognizing the user's emotional state and providing appropriate feedback,

[0765] This includes [specific features / features]. This enables comprehensive fitness support that takes into account the user's psychological state.

[0766] "Personal information" refers to information used to identify a specific user, such as the user's name, email address, password, age, height, weight, and exercise history.

[0767] "Training goals" refer to specific fitness objectives that a user aims to achieve, such as weight loss, muscle strength improvement, or endurance enhancement.

[0768] A "customized training program" is an individually optimized exercise plan generated based on the user's personal information and training goals.

[0769] A "video chat training session" is a training session conducted through real-time video calls between the user and the trainer over the internet.

[0770] A "virtual reality environment" is a system that provides users with a virtual training environment using devices such as VR headsets, allowing users to experience exercise in a virtual reality setting.

[0771] "Emotional state" refers to the user's psychological state, which is specifically judged through facial expressions, tone of voice, body movements, and other factors.

[0772] "Feedback" refers to responses such as instructions, advice, and encouragement provided based on the user's actions and status.

[0773] "Nutritional advice" refers to personalized guidance and recommendations regarding diet based on the user's dietary preferences and allergy information.

[0774] This invention relates to a system that receives a user's personal information and training goals, and provides a customized training program and nutritional advice. It also includes a function to recognize the user's emotional state and provide feedback accordingly. The specific operation of each component is described below.

[0775] 1. User registration and login

[0776] When a user uses the system for the first time, they access a new registration form on their device and enter personal information such as their name, email address, and password. The device sends this information to the server via an HTTP POST request. The server checks the received information and stores it in its database. If the storage is successful, the server generates an authentication token, such as a JWT (JSON Web Token), and sends it to the device. This allows the user to log in using the login form and access their personal dashboard.

[0777] 2. Creating a customized training program

[0778] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history) and training goals (e.g., weight loss, muscle gain). The device sends this data to the server via an HTTP POST request. The server analyzes the received data and generates a customized training program using a generative AI model. This program is stored in a database and sent to the device. This program is then displayed on the user's personal dashboard.

[0779] 3. Providing nutritional advice

[0780] When a user enters their dietary preferences and allergy information, the device sends this information to the server via an HTTP POST request. Based on the received data, the server consults a nutritionist advice database and generates customized nutritional advice. This generated meal plan is saved to the database and sent back to the device. The device then displays this plan on the user's dashboard.

[0781] 4. Virtual trainer service via video chat

[0782] When a user books a training session, the device sends the booking data to the server via an HTTP POST request. The server receives the booking information and notifies the appropriate virtual trainer. As the session time approaches, the device notifies the user and starts a video chat. The virtual trainer monitors the user's training in real time and provides guidance on correcting form and improving motivation.

[0783] 5. Training utilizing virtual reality

[0784] The user puts on a VR headset and launches a dedicated training application. The server generates an appropriate virtual reality environment based on the user's training program. This environment is stored in a database and sent to the user's VR headset. The user trains in this virtual environment and receives real-time feedback from the server.

[0785] 6. Recognition and adaptation to emotional states

[0786] The camera and microphone on the user's device capture their facial expressions, voice tone, and body movements. This data is transmitted to a server in real time. The server uses an emotion engine to analyze the data and evaluate the user's emotional state. Based on this evaluation, training and nutritional advice are tailored to the user. For example, if the user is in a negative emotional state, the server notifies the trainer and instructs them to add words of encouragement, etc.

[0787] Specific example

[0788] User B uses the system with the goal of improving their muscle strength. User B registers with the system and, after logging in, enters their physical information (height 180cm, weight 85kg, age 25, gym experience 3 years). Based on this data, the server generates a training program that includes dumbbell exercises and cardio exercises. Subsequently, User B enters their dairy allergy, and based on this, a high-protein diet menu that avoids dairy products is provided. If the emotion engine detects negative emotions from User B during a session with the virtual trainer, the server notifies the trainer, who then offers words of encouragement. Conversely, if positive emotions are detected during VR training, instructions are given to moderately increase the training load.

[0789] Examples of prompt statements are as follows:

[0790] "Please enter the user's height, weight, age, and exercise history."

[0791] "Next, please select your training goal."

[0792] Please enter your dietary preferences and allergy information.

[0793] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0794] 1. User registration and login

[0795] Step 1:

[0796] The user accesses the new registration form. The user enters their name, email address, and password. The user is given the name, email address, and password as input.

[0797] Step 2:

[0798] The terminal sends the entered information to the server via an HTTP POST request. The server receives the information and saves it to the database. A message indicating successful saving is output.

[0799] Step 3:

[0800] The server generates an authentication token (e.g., a JWT) and sends it to the terminal. The token is issued as output.

[0801] Step 4:

[0802] The device saves the received token. The user uses the token to log in through the login form and access their personal dashboard. A login success message is output.

[0803] 2. Creating a customized training program

[0804] Step 1:

[0805] After logging in, the user enters physical information (e.g., height, weight, age, exercise history) and training goals (e.g., weight loss, muscle strength improvement). Physical information and training goals are provided as input fields.

[0806] Step 2:

[0807] The device sends this data to the server via an HTTP POST request. The server analyzes the received data and uses it to generate a customized training program using a generated AI model. The training program is obtained as output.

[0808] Step 3:

[0809] The generated training program is sent from the server to the terminal. The terminal displays the program on the user's personal dashboard. The displayed training program is obtained as output.

[0810] 3. Providing nutritional advice

[0811] Step 1:

[0812] The user enters their dietary preferences and allergy information. The input provided includes dietary preferences and allergy information.

[0813] Step 2:

[0814] The device sends this information to the server via an HTTP POST request. The server analyzes the received data, consults a nutritionist advice database, and generates customized nutrition advice. The output is the nutrition advice.

[0815] Step 3:

[0816] The generated nutritional advice is sent from the server to the terminal and displayed on the user's personal dashboard. The output is the displayed nutritional advice.

[0817] 4. Virtual trainer service via video chat

[0818] Step 1:

[0819] The user books a training session. The booking information is provided as input.

[0820] Step 2:

[0821] The terminal sends reservation data to the server via an HTTP POST request. The server receives the reservation information and notifies the appropriate virtual trainer. The output is the notification to the trainer.

[0822] Step 3:

[0823] As the session time approaches, the device notifies the user and initiates the video chat. A real-time video chat takes place between the user and the trainer. The output is a video session start notification.

[0824] Step 4:

[0825] During video chat, the trainer monitors the user's training, providing guidance on form correction and motivation improvement. The output is real-time training instruction.

[0826] 5. Training utilizing virtual reality

[0827] Step 1:

[0828] The user puts on a VR headset and launches a dedicated training application. The inputs provided are the wearing of the VR headset and the launch of the application.

[0829] Step 2:

[0830] The server generates an appropriate virtual reality environment based on the user's training program. The output is a VR environment.

[0831] Step 3:

[0832] The VR environment is transmitted from the server to the user's VR headset. The user performs training within the virtual environment. The output is the transmitted VR environment.

[0833] Step 4:

[0834] Users train in a virtual reality environment and receive real-time feedback from the server. The output is real-time feedback.

[0835] 6. Recognition and adaptation to emotional states

[0836] Step 1:

[0837] The camera and microphone on the user's device capture facial expressions, voice tone, and body movements. Facial expressions, voice tone, and body movements are provided as input.

[0838] Step 2:

[0839] The device sends the collected data to the server in real time. The server uses an emotion engine to analyze the data and evaluate the user's emotional state. The output is the evaluation result of the emotional state.

[0840] Step 3:

[0841] Based on the user's emotional state, training programs and nutritional advice are tailored to their needs. If the user is in a negative emotional state, the server notifies the trainer and instructs them to add encouraging words, etc. The output is the tailored training and nutritional advice.

[0842] (Application Example 2)

[0843] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0844] While conventional fitness support systems provide customized programs based on the user's physical information and training goals, they lack real-time feedback and adjustments that take into account the user's emotional state. As a result, maintaining user motivation and optimizing performance is difficult, leading to challenges in fully realizing the effects of training. Furthermore, even in training sessions utilizing virtual reality environments and real-time video chat, individualized support that takes into account the user's psychological state is required, but this is difficult to achieve with current systems.

[0845] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for receiving the user's personal information and training goals, means for generating a customized training program based on the received personal information and training goals, means for displaying the generated training program to the user, means for providing a real-time video chat training session between the user and the instructor, means for providing the user with a training experience in a virtual reality environment, means for recognizing the user's emotional state and providing adjustments and feedback accordingly, and means for collecting data from a camera and microphone for analyzing the emotional state. This enables comprehensive fitness support that takes the user's emotional state into consideration.

[0846] A "user" is an individual who uses the system to receive training programs and nutritional advice.

[0847] "Personal information" refers to data that includes physical information about the user, such as height, weight, and age, as well as contact information.

[0848] "Training goals" refer to specific fitness objectives that users want to achieve, such as weight loss or muscle gain.

[0849] A "customized training program" refers to an exercise plan generated individually based on the user's personal information and training goals.

[0850] "Means of display" refers to methods and devices for outputting the generated training program to the user's device or a display in the gym.

[0851] A "trainer" is a professional who provides exercise guidance and advice to users through training sessions.

[0852] A "real-time video chat training session" is a session in which instructors and users conduct training in real time via video and audio over a network.

[0853] A "virtual reality environment" refers to a technology and system that allows users to exercise in a virtual training space.

[0854] "Emotional state" refers to the user's psychological state or emotions, such as joy, sadness, or anger.

[0855] "Means of providing adjustments and feedback" refers to methods and systems that appropriately modify training programs and instruction content based on the user's emotional state and provide appropriate advice.

[0856] "Means of collecting data from cameras and microphones" refers to devices for recording a user's facial expressions and voice tone, and methods for transmitting that data to a system.

[0857] This invention relates to a system that provides comprehensive fitness support by offering customized training programs and nutritional advice based on the user's personal information and training goals, and by providing adjustments and feedback according to the user's emotional state. Specific embodiments are described below.

[0858] System Overview

[0859] This system mainly consists of the following components:

[0860] 1. Ability to receive users' personal information and training goals.

[0861] 2. Ability to generate customized training programs

[0862] 3. Function to display the training program to the user.

[0863] 4. A feature that provides real-time video chat training sessions between users and instructors.

[0864] 5. Features that provide a training experience in a virtual reality environment.

[0865] 6. A function that recognizes the user's emotional state and provides adjustments and feedback accordingly.

[0866] 7. Function to collect data from cameras and microphones to analyze emotional states.

[0867] System Implementation Procedures

[0868] Regarding program generation and processing

[0869] Hardware and software to be used

[0870] Hardware: Smartphones, cameras in the gym, fitness machines with sensors

[0871] Software: Python, OpenCV (face recognition), Azure Emotion API (sentiment analysis), frontend is React Native or Flutter

[0872] 1. User registration and login

[0873] When a user uses the system for the first time, they access a new registration form on their smartphone or a terminal in the gym and enter their personal information (e.g., name, email address, password). The terminal sends the entered information to the server, which stores the received information in a database. At the same time, an authentication token is generated to activate the user account, and the user can log in using the login form and access their personal dashboard.

[0874] 2. Creating a customized training program

[0875] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history) and training goals. The device sends this data to the server, which analyzes it and generates a personalized training program for the user. The generated program is then displayed on the user's personal dashboard.

[0876] 3. Providing nutritional advice

[0877] When a user enters their dietary preferences and allergy information, the device sends this information to a server. The server then consults a database of nutritionist advice and generates personalized nutritional advice. This advice is then displayed on the user's dashboard.

[0878] 4. Coaching services via video chat

[0879] When a user books a training session, the device sends the booking data to the server. The server receives the booking information and notifies the appropriate instructor. As the session time approaches, the device notifies the user and starts a video chat. The instructor monitors the user's training in real time and provides guidance on form correction and motivation improvement.

[0880] 5. Training utilizing virtual reality

[0881] The user puts on a VR headset and launches a specific training application. The server generates an appropriate virtual reality environment based on the user's training program. The generated virtual reality environment is sent to the user's VR headset. The user trains within this virtual environment and receives real-time feedback from the server.

[0882] 6. Recognition and adaptation to emotional states

[0883] This system includes an emotion engine to recognize the user's emotional state. Using the camera and microphone on the user's device (e.g., smartphone or VR headset), the emotion engine analyzes facial expressions, voice tone, body movements, etc. The server receives this data and evaluates the user's emotional state. Based on the emotional state, it adjusts the training load and provides feedback in real time.

[0884] Specific example

[0885] For example, if the emotion engine detects that the user is fatigued during training, the server will instruct it to reduce the training load. Also, if the user is excited about achieving their goal, the server will suggest a more challenging training session. Examples of prompts for the generative AI model include, "Analyze my emotional state and give me appropriate training feedback," and "Adjust my future training plan based on my emotional data."

[0886] In this way, comprehensive fitness support that takes into account the user's emotional state can be realized.

[0887] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0888] Step 1: User registration and login

[0889] Users access a new registration form on their smartphone or a terminal within the gym and enter personal information such as their name, email address, and password. The terminal sends the entered information to the server. The server stores the received information in a database, generates an authentication token, and activates the user account. This allows the user to log in using the login form and access their personal dashboard. The input is the user's personal information, and the output is the user information and authentication token stored in the database.

[0890] Step 2: Create a customized training program

[0891] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history, etc.) and training goals. The device sends this data to the server. The server analyzes this data and generates a customized training program. The generated program is displayed on the user's personal dashboard. The input is the user's physical information and training goals, and the output is the customized training program.

[0892] Step 3: Provide nutritional advice

[0893] The user enters their dietary preferences and allergy information. The terminal sends this information to the server. The server consults a nutritionist advice database and generates customized nutritional advice. The generated nutritional advice is displayed on the user's dashboard. The input is the user's dietary and allergy information, and the output is customized nutritional advice.

[0894] Step 4: Coaching services via video chat

[0895] The user books a fitness session. The device sends the booking data to the server. The server receives the booking information and notifies the appropriate instructor. As the session time approaches, the device notifies the user and starts a video chat. The instructor monitors the user's training in real time and provides appropriate corrections and motivational guidance. The input is the user's session booking information, and the output is the video chat connection for the training session.

[0896] Step 5: Training using virtual reality

[0897] The user puts on a VR headset and launches a virtual training application. The server generates a suitable virtual reality environment based on the user's training program. The generated virtual reality environment is sent to the VR headset, and the user trains in this virtual environment. The server provides real-time feedback. The input is the user's training program, and the output is the virtual reality environment and real-time feedback.

[0898] Step 6: Recognition and feedback on emotional state

[0899] Users utilize cameras and microphones built into their smartphones or VR headsets. Data such as facial expressions, voice tone, and body movements are collected from these devices. The devices transmit this data to a server, which uses an emotion engine to analyze the user's emotional state. Based on the analysis results, the server adjusts the training load and feedback as needed and provides it to the user. The input is the user's emotional data, and the output is the adjusted training load and feedback.

[0900] Specific example:

[0901] For example, if a user shows signs of fatigue during training, the emotion engine analyzes this information and notifies the server. The server then instructs the system to reduce the training load and notifies the user via a pop-up message. Examples of prompts for the generative AI model include, "Analyze my emotional state and provide appropriate training feedback," and "Adjust future training plans based on the user's emotional data."

[0902] In this way, the system is designed to provide users with optimal training and advice by performing appropriate data processing and calculations based on the user's input data at each step and providing feedback on the results.

[0903] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0904] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0905] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0906] [Third Embodiment]

[0907] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0908] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0909] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0910] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0911] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0912] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0913] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0914] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0915] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0916] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0917] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0918] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0919] This invention relates to a system that provides customized training programs and nutritional advice to support users in effectively achieving their fitness goals. The specific operation of each component is described below.

[0920] 1. User registration and login

[0921] When a user uses the system for the first time, they access a new registration form on their device. The user enters personal information such as their name, email address, and password, and submits it. The server receives the entered information and stores it in the database. It also generates an authentication token to activate the user account. This allows the user to log in using the login form and access their personal dashboard.

[0922] 2. Creating a customized training program

[0923] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history, etc.) and training goals (e.g., weight loss, muscle gain). The server receives this data and performs analysis. Based on the analysis results, the server uses an algorithm to generate a training program optimized for the user and displays it on their personal dashboard. The user then proceeds with their training according to this program.

[0924] 3. Providing nutritional advice

[0925] When a user enters their dietary preferences and allergy information, the server generates customized nutritional advice based on this information. The server refers to a database of nutritionist advice and creates a meal plan for the user. The generated meal plan is displayed on the user's dashboard.

[0926] 4. Virtual trainer service via video chat

[0927] When a user books a training session, the server receives the booking data and notifies the appropriate virtual trainer. As the session time approaches, the device notifies the user and starts a video chat. The trainer monitors the user's training in real time and provides guidance on form correction and motivation.

[0928] 5. Training utilizing virtual reality

[0929] The user puts on a VR headset and launches a specific training application. The server generates an appropriate virtual reality environment based on the user's training program. The user trains within this virtual environment and receives real-time feedback from the server, thereby enhancing the effectiveness of the training.

[0930] Specific example

[0931] User A uses the system with the goal of losing weight. First, they register with the system, log in, and enter their physical information (height 170cm, weight 75kg, age 30, no prior exercise experience). The server receives this information and generates a program that includes three cardio exercises per week and strength training. Next, because User A has a dairy allergy, this is reflected in the meal plan, and a calorie-balanced meal plan that avoids dairy products is provided. In addition, they regularly schedule video chat sessions with a virtual trainer to receive form checks and support to maintain motivation. Furthermore, they use a virtual reality environment to experience a realistic gym-like training environment from the comfort of their home.

[0932] In this way, this system provides users with comprehensive training and nutritional management, and delivers customized support tailored to their individual goals.

[0933] The following describes the processing flow.

[0934] Step 1:

[0935] The user accesses the new registration form on their device and enters personal information such as their name, email address, and password.

[0936] Step 2:

[0937] The terminal sends the entered information to the server.

[0938] Step 3:

[0939] The server processes the received information and saves the user's data to the database.

[0940] Step 4:

[0941] The server generates an authentication token and activates the user account.

[0942] Step 5:

[0943] The user logs in using the login form.

[0944] Step 6:

[0945] The server verifies the user's authentication information and allows them to access their personal dashboard.

[0946] Step 7:

[0947] The user enters their physical information and training goals.

[0948] Step 8:

[0949] The device sends the entered physical information and training goals to the server.

[0950] Step 9:

[0951] The server analyzes the information it receives and generates a customized training program.

[0952] Step 10:

[0953] The server displays the generated training program on the user's dashboard.

[0954] Step 11:

[0955] Users enter their dietary preferences and allergy information.

[0956] Step 12:

[0957] The terminal sends the entered meal information to the server.

[0958] Step 13:

[0959] The server analyzes the received meal information and generates customized nutritional advice.

[0960] Step 14:

[0961] The server displays the generated nutritional advice on the user's dashboard.

[0962] Step 15:

[0963] The user books a training session.

[0964] Step 16:

[0965] The device sends the reservation data to the server.

[0966] Step 17:

[0967] The server receives the reservation information and notifies the appropriate virtual trainer.

[0968] Step 18:

[0969] As the session time approaches, the device will notify the user.

[0970] Step 19:

[0971] The user launches the video chat interface and starts a session.

[0972] Step 20:

[0973] A virtual trainer monitors the user's training in real time and provides feedback.

[0974] Step 21:

[0975] The user puts on a VR headset and launches a specific training application.

[0976] Step 22:

[0977] The server generates an appropriate virtual reality environment based on the user's training program.

[0978] Step 23:

[0979] The server sends the generated virtual reality environment to the user's VR headset.

[0980] Step 24:

[0981] Users train in a virtual reality environment and receive real-time feedback from the server.

[0982] (Example 1)

[0983] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0984] Conventional fitness systems have struggled to provide customized training programs and nutritional advice for each user, resulting in a lack of effective support tailored to individual user needs. Furthermore, they lacked features to provide realistic training experiences and real-time feedback, preventing users from receiving sufficient support to achieve their goals. To address these challenges, the present invention aims to provide a system that offers comprehensive training and nutritional management to users, supporting them in achieving their individual goals.

[0985] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0986] In this invention, the server includes means for receiving the user's personal information and training goals, means for generating a customized training program based on the received personal information and training goals, means for displaying the generated training program to the user, means for receiving the user's dietary preferences and allergy information, means for generating customized nutritional advice based on the received dietary preferences and allergy information, means for providing the generated nutritional advice to the user, means for providing real-time video chat training sessions between the user and the instructor, and means for providing the user with a training experience in a virtual reality environment. As a result, the user can receive individually customized training programs and nutritional advice, and more effectively achieve their fitness goals through real-time support and a realistic training experience.

[0987] "Personal information" refers to data used to identify or distinguish a user, such as the user's name, email address, password, height, weight, age, and exercise history.

[0988] "Training goals" refer to fitness goals set by the user, such as weight loss or muscle strength improvement.

[0989] A "training program" is an exercise schedule or plan created based on the user's personal information and training goals, and includes details regarding the type, frequency, and intensity of exercise.

[0990] "Dietary preferences" refer to the ingredients and types of food that users like, and are information about the user's eating preferences.

[0991] "Allergy information" refers to information about the foods and ingredients that a user is allergic to.

[0992] "Nutritional advice" refers to a balanced meal plan and dietary recommendations tailored to the user's dietary preferences and allergy information.

[0993] A "trainer" refers to a professional who supports users' training and provides guidance and advice in real time.

[0994] A "real-time video chat training session" is a type of session in which users and instructors conduct training simultaneously online via video chat.

[0995] A "virtual reality environment" is a virtual training space created using virtual reality technology, allowing users to enjoy a training experience that closely resembles reality.

[0996] "Customization" refers to optimizing specific content or functions based on each user's individual needs and information.

[0997] A "generative AI model" is an artificial intelligence algorithm or system that automatically creates training programs and nutritional advice based on user information.

[0998] "Feedback" refers to evaluations and advice given regarding a user's training performance, providing information that users can use to improve or adjust their training.

[0999] "Reservation" refers to the act of a user setting and securing a training session or video chat in advance.

[1000] This invention relates to a system that provides customized training programs and nutritional advice to support users in effectively achieving their fitness goals. This system provides optimized training and nutritional management based on the user's personal information, training goals, dietary preferences, and allergy information. The specific operation of each component of this system is described below.

[1001] Hardware and software usage

[1002] This system uses the following hardware and software:

[1003] Devices (PCs, smartphones, tablets, etc.)

[1004] Server (including database and analysis engine)

[1005] VR headset for virtual reality

[1006] Camera and microphone for video chat

[1007] User registration and login

[1008] When a user uses the system for the first time, they access a new registration form on their device. The user enters personal information such as their name, email address, and password, and submits it. The server receives the entered information and securely stores it in the database. Furthermore, it generates an authentication token to activate the user account. This allows the user to log in using the login form and access their personal dashboard.

[1009] Creating a customized training program

[1010] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history, etc.) and training goals (e.g., weight loss, muscle strength improvement). The server receives this data and performs analysis. A generative AI model is used for the analysis to generate an optimized training program based on the user's information. The generated training program is displayed on the user's personal dashboard. The user then proceeds with their training according to this program.

[1011] Providing nutritional advice

[1012] When a user enters their dietary preferences and allergy information, the server generates personalized nutritional advice based on that information. The server consults a database of nutritionist advice and creates a meal plan for the user. The generated meal plan is displayed on the user's dashboard. The user can use this information to incorporate appropriate meals into their diet.

[1013] Virtual trainer service via video chat

[1014] When a user books a training session, the server receives the booking data and notifies the appropriate virtual trainer. As the session time approaches, the device notifies the user and initiates a video chat. The trainer monitors the user's training in real time and provides guidance on form correction and motivation improvement.

[1015] Training utilizing virtual reality

[1016] The user puts on a VR headset and launches a specific training application on their device. The server generates an appropriate virtual reality environment based on the user's training program. The user trains within this virtual environment and receives real-time feedback from the server to enhance the effectiveness of their training.

[1017] Specific example

[1018] If User A uses the system with the goal of losing weight, they first register and log in. Next, they enter their physical information (height 170cm, weight 75kg, age 30, no prior exercise experience). The server receives this information and generates a program that includes cardio exercises and strength training three times a week. Since User A has a dairy allergy, a meal plan is also generated based on that. User A regularly schedules video chat sessions with a virtual trainer to receive training guidance. Furthermore, they experience training in a virtual reality environment using a VR headset.

[1019] Example of a prompt

[1020] "Please explain the user registration procedure in detail."

[1021] "Please explain how to generate a customized training program."

[1022] Please describe in detail how you provide nutritional advice.

[1023] "Please explain the support process via video chat."

[1024] "What are the advantages of training programs that utilize virtual reality?"

[1025] As described above, this system provides users with comprehensive training and nutritional management, and delivers customized support tailored to individual goals.

[1026] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1027] Step 1:

[1028] User Registration

[1029] Input: The user enters personal information such as their name, email address, and password into a new registration form on their device.

[1030] Processing: The terminal sends the entered information to the server.

[1031] Data processing: The server analyzes the received information and securely stores it in the database. Next, it generates an authentication token.

[1032] Output: The user account is activated, and the user can log in.

[1033] Step 2:

[1034] User Login

[1035] Input: The user enters their email address and password into the login form on their device.

[1036] Processing: The terminal sends the input information to the server.

[1037] Data processing: The server compares the input information with the information in the database and performs authentication.

[1038] Output: If authentication is successful, the user will be able to access their personal dashboard.

[1039] Step 3:

[1040] Entering physical information and training goals

[1041] Input: The user enters physical information (height, weight, age, exercise history, etc.) and training goals (weight loss, muscle strength improvement, etc.) on their device.

[1042] Processing: The terminal sends that data to the server.

[1043] Data processing: The server analyzes the received data and generates a training program optimized for the user.

[1044] Output: The generated training program is displayed on the user's dashboard.

[1045] Step 4:

[1046] Enter your dietary preferences and allergy information.

[1047] Input: The user enters their dietary preferences and allergy information on their device.

[1048] Processing: The terminal sends the input data to the server.

[1049] Data processing: The server references a nutritionist advice database and generates nutritional advice tailored to the user.

[1050] Output: Customized nutritional advice is displayed on the user's dashboard.

[1051] Step 5:

[1052] Booking a training session

[1053] Input: The user books a training session on their device.

[1054] Processing: The terminal sends the reservation data to the server.

[1055] Data processing: The server notifies the appropriate virtual trainer of the reservation data.

[1056] Output: The device notifies the user as the session time approaches.

[1057] Step 6:

[1058] video chat session

[1059] Input: The user and instructor log into the system during the session time.

[1060] Processing: The device starts a video chat.

[1061] Data processing: Instructors monitor user training in real time and provide feedback.

[1062] Output: Users receive guidance, and the effectiveness of their training improves.

[1063] Step 7:

[1064] Virtual reality training

[1065] Input: The user puts on a VR headset and launches the training application.

[1066] Processing: The device sends the user's training status to the server.

[1067] Data processing: The server generates an appropriate virtual reality environment based on the training program.

[1068] Output: Users perform training in a virtual environment and receive real-time feedback from the server.

[1069] The above outlines the specific processing steps of this system. Based on the information entered at each step, the data is appropriately processed and analyzed, enabling the system to provide users with optimal training and nutritional management.

[1070] (Application Example 1)

[1071] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1072] Traditional factory machinery and equipment faced challenges in maintaining optimal operating conditions due to uniform and inefficient maintenance and operational training. In particular, varying performance requirements for each piece of equipment and the experience levels of technicians often resulted in insufficient maintenance frequency and content. This increased the risk of equipment failures and operational errors.

[1073] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1074] In this invention, the server includes means for receiving the user's personal information and operational objectives; means for generating a customized training program based on the received personal information and operational objectives; means for displaying the generated training program to the user; means for providing a real-time video chat training session between the user and the technician; means for providing the user with an operational experience in a virtual environment; and means for customizing and providing maintenance schedules and training plans for work equipment in a factory setting. This enables customized maintenance and training optimized for the performance of each piece of equipment.

[1075] "Users" refer to engineers and workers who use the system.

[1076] "Personal information" includes information such as the user's name, email address, and password.

[1077] "Operational objectives" refer to the user's goals or tasks related to operating the equipment.

[1078] A "training program" refers to a practice plan customized to achieve specific operational goals.

[1079] A "virtual environment" refers to a simulated operating space created using virtual reality technology.

[1080] A "technician" refers to a professional who provides training sessions to users in real time via video chat.

[1081] "Factory setting" refers to the industrial environment in which equipment is installed and operating.

[1082] "Work equipment" refers to machinery and robots used in factories.

[1083] A "maintenance schedule" refers to a plan for the regular inspection and adjustment of work equipment.

[1084] A "training plan" refers to a customized training plan designed to help users effectively utilize the operating equipment.

[1085] "Operating equipment" refers to all types of equipment used within a factory.

[1086] "Maintenance information" refers to information regarding the maintenance history and current status of the user's operating equipment.

[1087] "Maintenance advice" refers to customized instructions on the optimal maintenance methods for operating equipment.

[1088] "Operational performance" refers to the efficiency and effectiveness of tasks performed by a user using an operating device.

[1089] As an embodiment of this invention, a system for providing customized maintenance schedules and training plans for factory equipment is described.

[1090] First, the server receives personal information and operational goals from the user. Personal information includes name, email address, and password, while operational goals include specific tasks and objectives for operating the equipment. Based on this received information, the server generates a customized training program. This training program is designed to help the user efficiently improve their operational skills, and the generated program is displayed on the user's terminal.

[1091] Furthermore, the system utilizes a means to provide real-time video chat training sessions between users and technicians. The server manages these sessions, allowing users to receive direct advice and corrections from technicians in real time.

[1092] The system also provides an interactive experience in a virtual environment. Users train in a simulated operating space using virtual reality equipment, such as a VR headset. The server dynamically generates this virtual environment and provides real-time feedback to the user.

[1093] In the factory setup, maintenance schedules and training plans for work equipment are also provided on a customized basis. The server receives capability and maintenance information for the operating equipment and generates an optimized maintenance schedule based on this information. This maintenance schedule includes periodic inspection and adjustment tasks, which are also displayed on the user's terminal.

[1094] Furthermore, it includes a means to monitor operational performance in real time and provide feedback. The server stores operational performance data, making it available for later reference. For example, the efficiency and effectiveness of a user's equipment operation can be recorded numerically and used to inform future training plans.

[1095] This system makes it possible to provide users with training tailored to their individual operational goals while maintaining the optimal operation of factory equipment.

[1096] (Specific example)

[1097] For example, consider the factory robot "R12345". The server receives operational goals and maintenance information for this robot from the user and generates a personalized maintenance schedule and an intermediate-level training plan. The maintenance schedule may include details such as "Check Task 1 on Monday." Furthermore, training sessions are conducted via real-time video chat between the user and the technician, where points for operational improvements are pointed out.

[1098] (Example of a prompt message)

[1099] "Please generate a weekly maintenance schedule and an intermediate-level training plan for the robot 'R12345' used in a factory. The robot model is 'X200', and the year of manufacture is 2022."

[1100] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1101] Step 1:

[1102] The server receives personal information and operational goals from the user. The user accesses the system using a terminal and enters and submits information such as their name, email address, password, and operational goals. The server receives this information and stores it in the database. The input is the user's personal information and operational goals, and the output is this information stored in the database.

[1103] Step 2:

[1104] The server generates a customized training program based on the received personal information and operational goals. The server uses a generating AI model to calculate the optimal training steps for the user's operational goals. The input is personal information and operational goals, and the output is the customized training program. Specifically, it includes an algorithm that determines the training content based on the user's experience and goals.

[1105] Step 3:

[1106] The server displays the generated training program on the user's device. The server then reflects the generated training program on the user's dashboard. The input is the generated training program, and the output is the training program displayed on the screen. Specific actions include web page updates and app notifications.

[1107] Step 4:

[1108] A server provides real-time video chat training sessions between users and technicians. Users book training sessions, and the server notifies the technicians of the booking information. Once a session begins, the server coordinates the video chat, enabling real-time communication between the user and the technician. The input is the training session booking information, and the output is the start of the video chat session. Specific operations include the use of video streaming services and notification functions.

[1109] Step 5:

[1110] The server generates a virtual environment and provides an interactive experience to the user's device. The user puts on a VR headset and launches a specific program. Based on the user's training program, the server constructs an appropriate virtual environment. The input is the user's training program, and the output is the virtual environment displayed on the VR headset. Specific operations include environment generation using virtual reality technology and the provision of real-time feedback.

[1111] Step 6:

[1112] The server provides customized maintenance schedules and training plans for work equipment in the factory configuration. The server receives capability and maintenance information for the operating equipment and generates maintenance schedules. The input is the capability and maintenance information of the operating equipment, and the output is the maintenance schedule. Specifically, its operation includes scheduling optimal maintenance tasks for each piece of equipment.

[1113] Step 7:

[1114] The server has the means to monitor operational performance in real time and provide feedback. When a user performs an operation, the server monitors performance using sensors and log data and provides real-time feedback as needed. The input is real-time information from sensors and log data, and the output is feedback to the user. Specific actions include alert and notification functions, or the generation of performance reports.

[1115] Step 8:

[1116] The server saves the aforementioned operational performance data and makes it available for later reference. It stores user operational performance data in a database so that it can be used later when reviewing training content and maintenance schedules. The input is operational performance data, and the output is storage in the database and its availability for later reference. Specific operations include database updates and report generation functions.

[1117] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1118] This invention relates to a system that, in addition to customized training programs and nutritional advice, has the function of recognizing the user's emotional state and providing adjustments and feedback accordingly. This enables comprehensive fitness support that also takes the user's psychological state into consideration. The specific operation of each component is described below.

[1119] 1. User registration and login

[1120] When a user uses the system for the first time, they access a new registration form on their device and enter personal information such as their name, email address, and password. The device sends the entered information to the server. The server processes the received information and stores the user's data in a database. It also generates an authentication token to activate the user account. This allows the user to log in using the login form and access their personal dashboard.

[1121] 2. Creating a customized training program

[1122] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history, etc.) and training goals (e.g., weight loss, muscle gain). The device sends this data to the server. The server analyzes this data and generates a customized training program. The generated program is displayed on the user's personal dashboard.

[1123] 3. Providing nutritional advice

[1124] When a user enters their dietary preferences and allergy information, the device sends this information to the server. The server then generates customized nutritional advice based on this information. It consults a database of nutritionist advice and creates a meal plan for the user. The generated meal plan is displayed on the user's dashboard.

[1125] 4. Virtual trainer service via video chat

[1126] When a user books a training session, the device sends the booking data to the server. The server receives the booking information and notifies the appropriate virtual trainer. As the session time approaches, the device notifies the user and starts a video chat. The trainer monitors the user's training in real time and provides guidance on form correction and motivation improvement.

[1127] 5. Training utilizing virtual reality

[1128] The user puts on a VR headset and launches a specific training application. The server generates an appropriate virtual reality environment based on the user's training program. The generated virtual reality environment is sent to the user's VR headset. The user trains within this virtual environment and receives real-time feedback from the server.

[1129] 6. Recognition and adaptation to emotional states

[1130] This system includes an emotion engine to recognize the user's emotional state. Using the camera and microphone on the user's device (e.g., a smartphone or VR headset), the emotion engine analyzes facial expressions, voice tone, body movements, and other information. The server receives this data and evaluates the user's emotional state.

[1131] Specific example

[1132] User B uses the system to improve their muscle strength. First, they register with the system, log in, and enter their physical information (height 180cm, weight 85kg, age 25, gym experience 3 years). The server uses this information to generate a training program that includes dumbbell exercises and cardio exercises. Next, because User B has a dairy allergy, this is reflected in the meal plan, and a high-protein menu that avoids dairy products is provided.

[1133] If the emotion engine detects that user B's emotions are negative during a session with a virtual trainer, the server transmits this information to the trainer. Based on this, the trainer adds more encouraging words to increase the user's motivation. Conversely, if the server detects that user B's emotions are positive during VR training, it instructs the trainer to moderately increase the training load.

[1134] In this way, the system takes user emotions into consideration and provides appropriate real-time feedback and adjustments, thereby achieving more effective and personalized fitness and nutrition guidance.

[1135] The following describes the processing flow.

[1136] Step 1:

[1137] The user accesses the new registration form on their device and enters personal information such as their name, email address, and password.

[1138] Step 2:

[1139] The terminal sends the entered information to the server.

[1140] Step 3:

[1141] The server processes the received information and saves the user's data to the database.

[1142] Step 4:

[1143] The server generates an authentication token and activates the user account.

[1144] Step 5:

[1145] The user logs in using the login form.

[1146] Step 6:

[1147] The server verifies the user's authentication information and allows them to access their personal dashboard.

[1148] Step 7:

[1149] The user enters their physical information and training goals.

[1150] Step 8:

[1151] The device sends the entered physical information and training goals to the server.

[1152] Step 9:

[1153] The server analyzes the information it receives and generates a customized training program.

[1154] Step 10:

[1155] The server displays the generated training program on the user's dashboard.

[1156] Step 11:

[1157] Users enter their dietary preferences and allergy information.

[1158] Step 12:

[1159] The terminal sends the entered meal information to the server.

[1160] Step 13:

[1161] The server analyzes the received meal information and generates customized nutritional advice.

[1162] Step 14:

[1163] The server displays the generated nutritional advice on the user's dashboard.

[1164] Step 15:

[1165] The user books a training session.

[1166] Step 16:

[1167] The device sends the reservation data to the server.

[1168] Step 17:

[1169] The server receives the reservation information and notifies the appropriate virtual trainer.

[1170] Step 18:

[1171] As the session time approaches, the device will notify the user.

[1172] Step 19:

[1173] The user launches the video chat interface and starts a session.

[1174] Step 20:

[1175] A virtual trainer monitors the user's training in real time and provides feedback.

[1176] Step 21:

[1177] The user puts on a VR headset and launches a specific training application.

[1178] Step 22:

[1179] The server generates an appropriate virtual reality environment based on the user's training program.

[1180] Step 23:

[1181] The server sends the generated virtual reality environment to the user's VR headset.

[1182] Step 24:

[1183] Users train in a virtual reality environment and receive real-time feedback from the server.

[1184] Step 25:

[1185] Users provide the emotion engine with their facial expressions and voice tone during training via their device's camera and microphone.

[1186] Step 26:

[1187] The emotion engine analyzes the received data and evaluates the user's emotional state.

[1188] Step 27:

[1189] The server receives emotional state data from the emotion engine and adjusts the training program or feedback accordingly.

[1190] Step 28:

[1191] If a user is in a negative emotional state, the server adjusts the virtual trainer and training scenario to provide the user with appropriate ways to improve their motivation.

[1192] Step 29:

[1193] When the user is in a positive emotional state, the server makes adjustments such as increasing the training load.

[1194] Step 30:

[1195] After the user finishes training, the server saves the training data and emotional state data, which are then used to optimize the next training program.

[1196] (Example 2)

[1197] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1198] Traditional fitness systems lack sufficient customization based on users' personal information and training goals, and they also lack the ability to provide feedback that takes into account the user's emotional state. This makes it difficult to motivate users, provide appropriate advice in real time, and achieve effective fitness guidance and nutritional management.

[1199] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server is

[1200] Means for receiving users' personal information and training goals,

[1201] A means for generating a customized training program based on received personal information and training objectives,

[1202] A means of displaying the generated training program to the user,

[1203] A means of providing real-time video chat training sessions between users and trainers,

[1204] A means of providing users with a training experience in a virtual reality environment,

[1205] A means of recognizing the user's emotional state and providing appropriate feedback,

[1206] This includes [specific features / features]. This enables comprehensive fitness support that takes into account the user's psychological state.

[1207] "Personal information" refers to information used to identify a specific user, such as the user's name, email address, password, age, height, weight, and exercise history.

[1208] "Training goals" refer to specific fitness objectives that a user aims to achieve, such as weight loss, muscle strength improvement, or endurance enhancement.

[1209] A "customized training program" is an individually optimized exercise plan generated based on the user's personal information and training goals.

[1210] A "video chat training session" is a training session conducted through real-time video calls between the user and the trainer over the internet.

[1211] A "virtual reality environment" is a system that provides users with a virtual training environment using devices such as VR headsets, allowing users to experience exercise in a virtual reality setting.

[1212] "Emotional state" refers to the user's psychological state, which is specifically judged through facial expressions, tone of voice, body movements, and other factors.

[1213] "Feedback" refers to responses such as instructions, advice, and encouragement provided based on the user's actions and status.

[1214] "Nutritional advice" refers to personalized guidance and recommendations regarding diet based on the user's dietary preferences and allergy information.

[1215] This invention relates to a system that receives a user's personal information and training goals, and provides a customized training program and nutritional advice. It also includes a function to recognize the user's emotional state and provide feedback accordingly. The specific operation of each component is described below.

[1216] 1. User registration and login

[1217] When a user uses the system for the first time, they access a new registration form on their device and enter personal information such as their name, email address, and password. The device sends this information to the server via an HTTP POST request. The server checks the received information and stores it in its database. If the storage is successful, the server generates an authentication token, such as a JWT (JSON Web Token), and sends it to the device. This allows the user to log in using the login form and access their personal dashboard.

[1218] 2. Creating a customized training program

[1219] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history) and training goals (e.g., weight loss, muscle gain). The device sends this data to the server via an HTTP POST request. The server analyzes the received data and generates a customized training program using a generative AI model. This program is stored in a database and sent to the device. This program is then displayed on the user's personal dashboard.

[1220] 3. Providing nutritional advice

[1221] When a user enters their dietary preferences and allergy information, the device sends this information to the server via an HTTP POST request. Based on the received data, the server consults a nutritionist advice database and generates customized nutritional advice. This generated meal plan is saved to the database and sent back to the device. The device then displays this plan on the user's dashboard.

[1222] 4. Virtual trainer service via video chat

[1223] When a user books a training session, the device sends the booking data to the server via an HTTP POST request. The server receives the booking information and notifies the appropriate virtual trainer. As the session time approaches, the device notifies the user and starts a video chat. The virtual trainer monitors the user's training in real time and provides guidance on correcting form and improving motivation.

[1224] 5. Training utilizing virtual reality

[1225] The user puts on a VR headset and launches a dedicated training application. The server generates an appropriate virtual reality environment based on the user's training program. This environment is stored in a database and sent to the user's VR headset. The user trains in this virtual environment and receives real-time feedback from the server.

[1226] 6. Recognition and adaptation to emotional states

[1227] The camera and microphone on the user's device capture their facial expressions, voice tone, and body movements. This data is transmitted to a server in real time. The server uses an emotion engine to analyze the data and evaluate the user's emotional state. Based on this evaluation, training and nutritional advice are tailored to the user. For example, if the user is in a negative emotional state, the server notifies the trainer and instructs them to add words of encouragement, etc.

[1228] Specific example

[1229] User B uses the system with the goal of improving their muscle strength. User B registers with the system and, after logging in, enters their physical information (height 180cm, weight 85kg, age 25, gym experience 3 years). Based on this data, the server generates a training program that includes dumbbell exercises and cardio exercises. Subsequently, User B enters their dairy allergy, and based on this, a high-protein diet menu that avoids dairy products is provided. If the emotion engine detects negative emotions from User B during a session with the virtual trainer, the server notifies the trainer, who then offers words of encouragement. Conversely, if positive emotions are detected during VR training, instructions are given to moderately increase the training load.

[1230] Examples of prompt statements are as follows:

[1231] "Please enter the user's height, weight, age, and exercise history."

[1232] "Next, please select your training goal."

[1233] Please enter your dietary preferences and allergy information.

[1234] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1235] 1. User registration and login

[1236] Step 1:

[1237] The user accesses the new registration form. The user enters their name, email address, and password. The user is given the name, email address, and password as input.

[1238] Step 2:

[1239] The terminal sends the entered information to the server via an HTTP POST request. The server receives the information and saves it to the database. A message indicating successful saving is output.

[1240] Step 3:

[1241] The server generates an authentication token (e.g., a JWT) and sends it to the terminal. The token is issued as output.

[1242] Step 4:

[1243] The device saves the received token. The user uses the token to log in through the login form and access their personal dashboard. A login success message is output.

[1244] 2. Creating a customized training program

[1245] Step 1:

[1246] After logging in, the user enters physical information (e.g., height, weight, age, exercise history) and training goals (e.g., weight loss, muscle strength improvement). Physical information and training goals are provided as input fields.

[1247] Step 2:

[1248] The device sends this data to the server via an HTTP POST request. The server analyzes the received data and uses it to generate a customized training program using a generated AI model. The training program is obtained as output.

[1249] Step 3:

[1250] The generated training program is sent from the server to the terminal. The terminal displays the program on the user's personal dashboard. The displayed training program is obtained as output.

[1251] 3. Providing nutritional advice

[1252] Step 1:

[1253] The user enters their dietary preferences and allergy information. The input provided includes dietary preferences and allergy information.

[1254] Step 2:

[1255] The device sends this information to the server via an HTTP POST request. The server analyzes the received data, consults a nutritionist advice database, and generates customized nutrition advice. The output is the nutrition advice.

[1256] Step 3:

[1257] The generated nutritional advice is sent from the server to the terminal and displayed on the user's personal dashboard. The output is the displayed nutritional advice.

[1258] 4. Virtual trainer service via video chat

[1259] Step 1:

[1260] The user books a training session. The booking information is provided as input.

[1261] Step 2:

[1262] The terminal sends reservation data to the server via an HTTP POST request. The server receives the reservation information and notifies the appropriate virtual trainer. The output is the notification to the trainer.

[1263] Step 3:

[1264] As the session time approaches, the device notifies the user and initiates the video chat. A real-time video chat takes place between the user and the trainer. The output is a video session start notification.

[1265] Step 4:

[1266] During video chat, the trainer monitors the user's training, providing guidance on form correction and motivation improvement. The output is real-time training instruction.

[1267] 5. Training utilizing virtual reality

[1268] Step 1:

[1269] The user puts on a VR headset and launches a dedicated training application. The inputs provided are the wearing of the VR headset and the launch of the application.

[1270] Step 2:

[1271] The server generates an appropriate virtual reality environment based on the user's training program. The output is a VR environment.

[1272] Step 3:

[1273] The VR environment is transmitted from the server to the user's VR headset. The user performs training within the virtual environment. The output is the transmitted VR environment.

[1274] Step 4:

[1275] Users train in a virtual reality environment and receive real-time feedback from the server. The output is real-time feedback.

[1276] 6. Recognition and adaptation to emotional states

[1277] Step 1:

[1278] The camera and microphone on the user's device capture facial expressions, voice tone, and body movements. Facial expressions, voice tone, and body movements are provided as input.

[1279] Step 2:

[1280] The device sends the collected data to the server in real time. The server uses an emotion engine to analyze the data and evaluate the user's emotional state. The output is the evaluation result of the emotional state.

[1281] Step 3:

[1282] Based on the user's emotional state, training programs and nutritional advice are tailored to their needs. If the user is in a negative emotional state, the server notifies the trainer and instructs them to add encouraging words, etc. The output is the tailored training and nutritional advice.

[1283] (Application Example 2)

[1284] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1285] While conventional fitness support systems provide customized programs based on the user's physical information and training goals, they lack real-time feedback and adjustments that take into account the user's emotional state. As a result, maintaining user motivation and optimizing performance is difficult, leading to challenges in fully realizing the effects of training. Furthermore, even in training sessions utilizing virtual reality environments and real-time video chat, individualized support that takes into account the user's psychological state is required, but this is difficult to achieve with current systems.

[1286] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for receiving the user's personal information and training goals, means for generating a customized training program based on the received personal information and training goals, means for displaying the generated training program to the user, means for providing a real-time video chat training session between the user and the instructor, means for providing the user with a training experience in a virtual reality environment, means for recognizing the user's emotional state and providing adjustments and feedback accordingly, and means for collecting data from a camera and microphone for analyzing the emotional state. This enables comprehensive fitness support that takes the user's emotional state into consideration.

[1287] A "user" is an individual who uses the system to receive training programs and nutritional advice.

[1288] "Personal information" refers to data that includes physical information about the user, such as height, weight, and age, as well as contact information.

[1289] "Training goals" refer to specific fitness objectives that users want to achieve, such as weight loss or muscle gain.

[1290] A "customized training program" refers to an exercise plan generated individually based on the user's personal information and training goals.

[1291] "Means of display" refers to methods and devices for outputting the generated training program to the user's device or a display in the gym.

[1292] A "trainer" is a professional who provides exercise guidance and advice to users through training sessions.

[1293] A "real-time video chat training session" is a session in which instructors and users conduct training in real time via video and audio over a network.

[1294] A "virtual reality environment" refers to a technology and system that allows users to exercise in a virtual training space.

[1295] "Emotional state" refers to the user's psychological state or emotions, such as joy, sadness, or anger.

[1296] "Means of providing adjustments and feedback" refers to methods and systems that appropriately modify training programs and instruction content based on the user's emotional state and provide appropriate advice.

[1297] "Means of collecting data from cameras and microphones" refers to devices for recording a user's facial expressions and voice tone, and methods for transmitting that data to a system.

[1298] This invention relates to a system that provides comprehensive fitness support by offering customized training programs and nutritional advice based on the user's personal information and training goals, and by providing adjustments and feedback according to the user's emotional state. Specific embodiments are described below.

[1299] System Overview

[1300] This system mainly consists of the following components:

[1301] 1. Ability to receive users' personal information and training goals.

[1302] 2. Ability to generate customized training programs

[1303] 3. Function to display the training program to the user.

[1304] 4. A feature that provides real-time video chat training sessions between users and instructors.

[1305] 5. Features that provide a training experience in a virtual reality environment.

[1306] 6. A function that recognizes the user's emotional state and provides adjustments and feedback accordingly.

[1307] 7. Function to collect data from cameras and microphones to analyze emotional states.

[1308] System Implementation Procedures

[1309] Regarding program generation and processing

[1310] Hardware and software to be used

[1311] Hardware: Smartphones, cameras in the gym, fitness machines with sensors

[1312] Software: Python, OpenCV (face recognition), Azure Emotion API (sentiment analysis), frontend is React Native or Flutter

[1313] 1. User registration and login

[1314] When a user uses the system for the first time, they access a new registration form on their smartphone or a terminal in the gym and enter their personal information (e.g., name, email address, password). The terminal sends the entered information to the server, which stores the received information in a database. At the same time, an authentication token is generated to activate the user account, and the user can log in using the login form and access their personal dashboard.

[1315] 2. Creating a customized training program

[1316] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history) and training goals. The device sends this data to the server, which analyzes it and generates a personalized training program for the user. The generated program is then displayed on the user's personal dashboard.

[1317] 3. Providing nutritional advice

[1318] When a user enters their dietary preferences and allergy information, the device sends this information to a server. The server then consults a database of nutritionist advice and generates personalized nutritional advice. This advice is then displayed on the user's dashboard.

[1319] 4. Coaching services via video chat

[1320] When a user books a training session, the device sends the booking data to the server. The server receives the booking information and notifies the appropriate instructor. As the session time approaches, the device notifies the user and starts a video chat. The instructor monitors the user's training in real time and provides guidance on form correction and motivation improvement.

[1321] 5. Training utilizing virtual reality

[1322] The user puts on a VR headset and launches a specific training application. The server generates an appropriate virtual reality environment based on the user's training program. The generated virtual reality environment is sent to the user's VR headset. The user trains within this virtual environment and receives real-time feedback from the server.

[1323] 6. Recognition and adaptation to emotional states

[1324] This system includes an emotion engine to recognize the user's emotional state. Using the camera and microphone on the user's device (e.g., smartphone or VR headset), the emotion engine analyzes facial expressions, voice tone, body movements, etc. The server receives this data and evaluates the user's emotional state. Based on the emotional state, it adjusts the training load and provides feedback in real time.

[1325] Specific example

[1326] For example, if the emotion engine detects that the user is fatigued during training, the server will instruct it to reduce the training load. Also, if the user is excited about achieving their goal, the server will suggest a more challenging training session. Examples of prompts for the generative AI model include, "Analyze my emotional state and give me appropriate training feedback," and "Adjust my future training plan based on my emotional data."

[1327] In this way, comprehensive fitness support that takes into account the user's emotional state can be realized.

[1328] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1329] Step 1: User registration and login

[1330] Users access a new registration form on their smartphone or a terminal within the gym and enter personal information such as their name, email address, and password. The terminal sends the entered information to the server. The server stores the received information in a database, generates an authentication token, and activates the user account. This allows the user to log in using the login form and access their personal dashboard. The input is the user's personal information, and the output is the user information and authentication token stored in the database.

[1331] Step 2: Create a customized training program

[1332] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history, etc.) and training goals. The device sends this data to the server. The server analyzes this data and generates a customized training program. The generated program is displayed on the user's personal dashboard. The input is the user's physical information and training goals, and the output is the customized training program.

[1333] Step 3: Provide nutritional advice

[1334] The user enters their dietary preferences and allergy information. The terminal sends this information to the server. The server consults a nutritionist advice database and generates customized nutritional advice. The generated nutritional advice is displayed on the user's dashboard. The input is the user's dietary and allergy information, and the output is customized nutritional advice.

[1335] Step 4: Coaching services via video chat

[1336] The user books a fitness session. The device sends the booking data to the server. The server receives the booking information and notifies the appropriate instructor. As the session time approaches, the device notifies the user and starts a video chat. The instructor monitors the user's training in real time and provides appropriate corrections and motivational guidance. The input is the user's session booking information, and the output is the video chat connection for the training session.

[1337] Step 5: Training using virtual reality

[1338] The user puts on a VR headset and launches a virtual training application. The server generates a suitable virtual reality environment based on the user's training program. The generated virtual reality environment is sent to the VR headset, and the user trains in this virtual environment. The server provides real-time feedback. The input is the user's training program, and the output is the virtual reality environment and real-time feedback.

[1339] Step 6: Recognition and feedback on emotional state

[1340] Users utilize cameras and microphones built into their smartphones or VR headsets. Data such as facial expressions, voice tone, and body movements are collected from these devices. The devices transmit this data to a server, which uses an emotion engine to analyze the user's emotional state. Based on the analysis results, the server adjusts the training load and feedback as needed and provides it to the user. The input is the user's emotional data, and the output is the adjusted training load and feedback.

[1341] Specific example:

[1342] For example, if a user shows signs of fatigue during training, the emotion engine analyzes this information and notifies the server. The server then instructs the system to reduce the training load and notifies the user via a pop-up message. Examples of prompts for the generative AI model include, "Analyze my emotional state and provide appropriate training feedback," and "Adjust future training plans based on the user's emotional data."

[1343] In this way, the system is designed to provide users with optimal training and advice by performing appropriate data processing and calculations based on the user's input data at each step and providing feedback on the results.

[1344] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1345] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1346] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1347] [Fourth Embodiment]

[1348] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1349] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1350] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1351] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1352] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1353] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1354] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1355] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1356] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1357] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1358] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1359] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1360] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1361] This invention relates to a system that provides customized training programs and nutritional advice to support users in effectively achieving their fitness goals. The specific operation of each component is described below.

[1362] 1. User registration and login

[1363] When a user uses the system for the first time, they access a new registration form on their device. The user enters personal information such as their name, email address, and password, and submits it. The server receives the entered information and stores it in the database. It also generates an authentication token to activate the user account. This allows the user to log in using the login form and access their personal dashboard.

[1364] 2. Creating a customized training program

[1365] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history, etc.) and training goals (e.g., weight loss, muscle gain). The server receives this data and performs analysis. Based on the analysis results, the server uses an algorithm to generate a training program optimized for the user and displays it on their personal dashboard. The user then proceeds with their training according to this program.

[1366] 3. Providing nutritional advice

[1367] When a user enters their dietary preferences and allergy information, the server generates customized nutritional advice based on this information. The server refers to a database of nutritionist advice and creates a meal plan for the user. The generated meal plan is displayed on the user's dashboard.

[1368] 4. Virtual trainer service via video chat

[1369] When a user books a training session, the server receives the booking data and notifies the appropriate virtual trainer. As the session time approaches, the device notifies the user and starts a video chat. The trainer monitors the user's training in real time and provides guidance on form correction and motivation.

[1370] 5. Training utilizing virtual reality

[1371] The user puts on a VR headset and launches a specific training application. The server generates an appropriate virtual reality environment based on the user's training program. The user trains within this virtual environment and receives real-time feedback from the server, thereby enhancing the effectiveness of the training.

[1372] Specific example

[1373] User A uses the system with the goal of losing weight. First, they register with the system, log in, and enter their physical information (height 170cm, weight 75kg, age 30, no prior exercise experience). The server receives this information and generates a program that includes three cardio exercises per week and strength training. Next, because User A has a dairy allergy, this is reflected in the meal plan, and a calorie-balanced meal plan that avoids dairy products is provided. In addition, they regularly schedule video chat sessions with a virtual trainer to receive form checks and support to maintain motivation. Furthermore, they use a virtual reality environment to experience a realistic gym-like training environment from the comfort of their home.

[1374] In this way, this system provides users with comprehensive training and nutritional management, and delivers customized support tailored to their individual goals.

[1375] The following describes the processing flow.

[1376] Step 1:

[1377] The user accesses the new registration form on their device and enters personal information such as their name, email address, and password.

[1378] Step 2:

[1379] The terminal sends the entered information to the server.

[1380] Step 3:

[1381] The server processes the received information and saves the user's data to the database.

[1382] Step 4:

[1383] The server generates an authentication token and activates the user account.

[1384] Step 5:

[1385] The user logs in using the login form.

[1386] Step 6:

[1387] The server verifies the user's authentication information and allows them to access their personal dashboard.

[1388] Step 7:

[1389] The user enters their physical information and training goals.

[1390] Step 8:

[1391] The device sends the entered physical information and training goals to the server.

[1392] Step 9:

[1393] The server analyzes the information it receives and generates a customized training program.

[1394] Step 10:

[1395] The server displays the generated training program on the user's dashboard.

[1396] Step 11:

[1397] Users enter their dietary preferences and allergy information.

[1398] Step 12:

[1399] The terminal sends the entered meal information to the server.

[1400] Step 13:

[1401] The server analyzes the received meal information and generates customized nutritional advice.

[1402] Step 14:

[1403] The server displays the generated nutritional advice on the user's dashboard.

[1404] Step 15:

[1405] The user books a training session.

[1406] Step 16:

[1407] The device sends the reservation data to the server.

[1408] Step 17:

[1409] The server receives the reservation information and notifies the appropriate virtual trainer.

[1410] Step 18:

[1411] As the session time approaches, the device will notify the user.

[1412] Step 19:

[1413] The user launches the video chat interface and starts a session.

[1414] Step 20:

[1415] A virtual trainer monitors the user's training in real time and provides feedback.

[1416] Step 21:

[1417] The user puts on a VR headset and launches a specific training application.

[1418] Step 22:

[1419] The server generates an appropriate virtual reality environment based on the user's training program.

[1420] Step 23:

[1421] The server sends the generated virtual reality environment to the user's VR headset.

[1422] Step 24:

[1423] Users train in a virtual reality environment and receive real-time feedback from the server.

[1424] (Example 1)

[1425] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1426] Conventional fitness systems have struggled to provide customized training programs and nutritional advice for each user, resulting in a lack of effective support tailored to individual user needs. Furthermore, they lacked features to provide realistic training experiences and real-time feedback, preventing users from receiving sufficient support to achieve their goals. To address these challenges, the present invention aims to provide a system that offers comprehensive training and nutritional management to users, supporting them in achieving their individual goals.

[1427] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1428] In this invention, the server includes means for receiving the user's personal information and training goals, means for generating a customized training program based on the received personal information and training goals, means for displaying the generated training program to the user, means for receiving the user's dietary preferences and allergy information, means for generating customized nutritional advice based on the received dietary preferences and allergy information, means for providing the generated nutritional advice to the user, means for providing real-time video chat training sessions between the user and the instructor, and means for providing the user with a training experience in a virtual reality environment. As a result, the user can receive individually customized training programs and nutritional advice, and more effectively achieve their fitness goals through real-time support and a realistic training experience.

[1429] "Personal information" refers to data used to identify or distinguish a user, such as the user's name, email address, password, height, weight, age, and exercise history.

[1430] "Training goals" refer to fitness goals set by the user, such as weight loss or muscle strength improvement.

[1431] A "training program" is an exercise schedule or plan created based on the user's personal information and training goals, and includes details regarding the type, frequency, and intensity of exercise.

[1432] "Dietary preferences" refer to the ingredients and types of food that users like, and are information about the user's eating preferences.

[1433] "Allergy information" refers to information about the foods and ingredients that a user is allergic to.

[1434] "Nutritional advice" refers to a balanced meal plan and dietary recommendations tailored to the user's dietary preferences and allergy information.

[1435] A "trainer" refers to a professional who supports users' training and provides guidance and advice in real time.

[1436] A "real-time video chat training session" is a type of session in which users and instructors conduct training simultaneously online via video chat.

[1437] A "virtual reality environment" is a virtual training space created using virtual reality technology, allowing users to enjoy a training experience that closely resembles reality.

[1438] "Customization" refers to optimizing specific content or functions based on each user's individual needs and information.

[1439] A "generative AI model" is an artificial intelligence algorithm or system that automatically creates training programs and nutritional advice based on user information.

[1440] "Feedback" refers to evaluations and advice given regarding a user's training performance, providing information that users can use to improve or adjust their training.

[1441] "Reservation" refers to the act of a user setting and securing a training session or video chat in advance.

[1442] This invention relates to a system that provides customized training programs and nutritional advice to support users in effectively achieving their fitness goals. This system provides optimized training and nutritional management based on the user's personal information, training goals, dietary preferences, and allergy information. The specific operation of each component of this system is described below.

[1443] Hardware and software usage

[1444] This system uses the following hardware and software:

[1445] Devices (PCs, smartphones, tablets, etc.)

[1446] Server (including database and analysis engine)

[1447] VR headset for virtual reality

[1448] Camera and microphone for video chat

[1449] User registration and login

[1450] When a user uses the system for the first time, they access a new registration form on their device. The user enters personal information such as their name, email address, and password, and submits it. The server receives the entered information and securely stores it in the database. Furthermore, it generates an authentication token to activate the user account. This allows the user to log in using the login form and access their personal dashboard.

[1451] Creating a customized training program

[1452] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history, etc.) and training goals (e.g., weight loss, muscle strength improvement). The server receives this data and performs analysis. A generative AI model is used for the analysis to generate an optimized training program based on the user's information. The generated training program is displayed on the user's personal dashboard. The user then proceeds with their training according to this program.

[1453] Providing nutritional advice

[1454] When a user enters their dietary preferences and allergy information, the server generates personalized nutritional advice based on that information. The server consults a database of nutritionist advice and creates a meal plan for the user. The generated meal plan is displayed on the user's dashboard. The user can use this information to incorporate appropriate meals into their diet.

[1455] Virtual trainer service via video chat

[1456] When a user books a training session, the server receives the booking data and notifies the appropriate virtual trainer. As the session time approaches, the device notifies the user and initiates a video chat. The trainer monitors the user's training in real time and provides guidance on form correction and motivation improvement.

[1457] Training utilizing virtual reality

[1458] The user puts on a VR headset and launches a specific training application on their device. The server generates an appropriate virtual reality environment based on the user's training program. The user trains within this virtual environment and receives real-time feedback from the server to enhance the effectiveness of their training.

[1459] Specific example

[1460] If User A uses the system with the goal of losing weight, they first register and log in. Next, they enter their physical information (height 170cm, weight 75kg, age 30, no prior exercise experience). The server receives this information and generates a program that includes cardio exercises and strength training three times a week. Since User A has a dairy allergy, a meal plan is also generated based on that. User A regularly schedules video chat sessions with a virtual trainer to receive training guidance. Furthermore, they experience training in a virtual reality environment using a VR headset.

[1461] Example of a prompt

[1462] "Please explain the user registration procedure in detail."

[1463] "Please explain how to generate a customized training program."

[1464] Please describe in detail how you provide nutritional advice.

[1465] "Please explain the support process via video chat."

[1466] "What are the advantages of training programs that utilize virtual reality?"

[1467] As described above, this system provides users with comprehensive training and nutritional management, and delivers customized support tailored to individual goals.

[1468] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1469] Step 1:

[1470] User Registration

[1471] Input: The user enters personal information such as their name, email address, and password into a new registration form on their device.

[1472] Processing: The terminal sends the entered information to the server.

[1473] Data processing: The server analyzes the received information and securely stores it in the database. Next, it generates an authentication token.

[1474] Output: The user account is activated, and the user can log in.

[1475] Step 2:

[1476] User Login

[1477] Input: The user enters their email address and password into the login form on their device.

[1478] Processing: The terminal sends the input information to the server.

[1479] Data processing: The server compares the input information with the information in the database and performs authentication.

[1480] Output: If authentication is successful, the user will be able to access their personal dashboard.

[1481] Step 3:

[1482] Entering physical information and training goals

[1483] Input: The user enters physical information (height, weight, age, exercise history, etc.) and training goals (weight loss, muscle strength improvement, etc.) on their device.

[1484] Processing: The terminal sends that data to the server.

[1485] Data processing: The server analyzes the received data and generates a training program optimized for the user.

[1486] Output: The generated training program is displayed on the user's dashboard.

[1487] Step 4:

[1488] Enter your dietary preferences and allergy information.

[1489] Input: The user enters their dietary preferences and allergy information on their device.

[1490] Processing: The terminal sends the input data to the server.

[1491] Data processing: The server references a nutritionist advice database and generates nutritional advice tailored to the user.

[1492] Output: Customized nutritional advice is displayed on the user's dashboard.

[1493] Step 5:

[1494] Booking a training session

[1495] Input: The user books a training session on their device.

[1496] Processing: The terminal sends the reservation data to the server.

[1497] Data processing: The server notifies the appropriate virtual trainer of the reservation data.

[1498] Output: The device notifies the user as the session time approaches.

[1499] Step 6:

[1500] video chat session

[1501] Input: The user and instructor log into the system during the session time.

[1502] Processing: The device starts a video chat.

[1503] Data processing: Instructors monitor user training in real time and provide feedback.

[1504] Output: Users receive guidance, and the effectiveness of their training improves.

[1505] Step 7:

[1506] Virtual reality training

[1507] Input: The user puts on a VR headset and launches the training application.

[1508] Processing: The device sends the user's training status to the server.

[1509] Data processing: The server generates an appropriate virtual reality environment based on the training program.

[1510] Output: Users perform training in a virtual environment and receive real-time feedback from the server.

[1511] The above outlines the specific processing steps of this system. Based on the information entered at each step, the data is appropriately processed and analyzed, enabling the system to provide users with optimal training and nutritional management.

[1512] (Application Example 1)

[1513] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1514] Traditional factory machinery and equipment faced challenges in maintaining optimal operating conditions due to uniform and inefficient maintenance and operational training. In particular, varying performance requirements for each piece of equipment and the experience levels of technicians often resulted in insufficient maintenance frequency and content. This increased the risk of equipment failures and operational errors.

[1515] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1516] In this invention, the server includes means for receiving the user's personal information and operational objectives; means for generating a customized training program based on the received personal information and operational objectives; means for displaying the generated training program to the user; means for providing a real-time video chat training session between the user and the technician; means for providing the user with an operational experience in a virtual environment; and means for customizing and providing maintenance schedules and training plans for work equipment in a factory setting. This enables customized maintenance and training optimized for the performance of each piece of equipment.

[1517] "Users" refer to engineers and workers who use the system.

[1518] "Personal information" includes information such as the user's name, email address, and password.

[1519] "Operational objectives" refer to the user's goals or tasks related to operating the equipment.

[1520] A "training program" refers to a practice plan customized to achieve specific operational goals.

[1521] A "virtual environment" refers to a simulated operating space created using virtual reality technology.

[1522] A "technician" refers to a professional who provides training sessions to users in real time via video chat.

[1523] "Factory setting" refers to the industrial environment in which equipment is installed and operating.

[1524] "Work equipment" refers to machinery and robots used in factories.

[1525] A "maintenance schedule" refers to a plan for the regular inspection and adjustment of work equipment.

[1526] A "training plan" refers to a customized training plan designed to help users effectively utilize the operating equipment.

[1527] "Operating equipment" refers to all types of equipment used within a factory.

[1528] "Maintenance information" refers to information regarding the maintenance history and current status of the user's operating equipment.

[1529] "Maintenance advice" refers to customized instructions on the optimal maintenance methods for operating equipment.

[1530] "Operational performance" refers to the efficiency and effectiveness of tasks performed by a user using an operating device.

[1531] As an embodiment of this invention, a system for providing customized maintenance schedules and training plans for factory equipment is described.

[1532] First, the server receives personal information and operational goals from the user. Personal information includes name, email address, and password, while operational goals include specific tasks and objectives for operating the equipment. Based on this received information, the server generates a customized training program. This training program is designed to help the user efficiently improve their operational skills, and the generated program is displayed on the user's terminal.

[1533] Furthermore, the system utilizes a means to provide real-time video chat training sessions between users and technicians. The server manages these sessions, allowing users to receive direct advice and corrections from technicians in real time.

[1534] The system also provides an interactive experience in a virtual environment. Users train in a simulated operating space using virtual reality equipment, such as a VR headset. The server dynamically generates this virtual environment and provides real-time feedback to the user.

[1535] In the factory setup, maintenance schedules and training plans for work equipment are also provided on a customized basis. The server receives capability and maintenance information for the operating equipment and generates an optimized maintenance schedule based on this information. This maintenance schedule includes periodic inspection and adjustment tasks, which are also displayed on the user's terminal.

[1536] Furthermore, it includes a means to monitor operational performance in real time and provide feedback. The server stores operational performance data, making it available for later reference. For example, the efficiency and effectiveness of a user's equipment operation can be recorded numerically and used to inform future training plans.

[1537] This system makes it possible to provide users with training tailored to their individual operational goals while maintaining the optimal operation of factory equipment.

[1538] (Specific example)

[1539] For example, consider the factory robot "R12345". The server receives operational goals and maintenance information for this robot from the user and generates a personalized maintenance schedule and an intermediate-level training plan. The maintenance schedule may include details such as "Check Task 1 on Monday." Furthermore, training sessions are conducted via real-time video chat between the user and the technician, where points for operational improvements are pointed out.

[1540] (Example of a prompt message)

[1541] "Please generate a weekly maintenance schedule and an intermediate-level training plan for the robot 'R12345' used in a factory. The robot model is 'X200', and the year of manufacture is 2022."

[1542] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1543] Step 1:

[1544] The server receives personal information and operational goals from the user. The user accesses the system using a terminal and enters and submits information such as their name, email address, password, and operational goals. The server receives this information and stores it in the database. The input is the user's personal information and operational goals, and the output is this information stored in the database.

[1545] Step 2:

[1546] The server generates a customized training program based on the received personal information and operational goals. The server uses a generating AI model to calculate the optimal training steps for the user's operational goals. The input is personal information and operational goals, and the output is the customized training program. Specifically, it includes an algorithm that determines the training content based on the user's experience and goals.

[1547] Step 3:

[1548] The server displays the generated training program on the user's device. The server then reflects the generated training program on the user's dashboard. The input is the generated training program, and the output is the training program displayed on the screen. Specific actions include web page updates and app notifications.

[1549] Step 4:

[1550] A server provides real-time video chat training sessions between users and technicians. Users book training sessions, and the server notifies the technicians of the booking information. Once a session begins, the server coordinates the video chat, enabling real-time communication between the user and the technician. The input is the training session booking information, and the output is the start of the video chat session. Specific operations include the use of video streaming services and notification functions.

[1551] Step 5:

[1552] The server generates a virtual environment and provides an interactive experience to the user's device. The user puts on a VR headset and launches a specific program. Based on the user's training program, the server constructs an appropriate virtual environment. The input is the user's training program, and the output is the virtual environment displayed on the VR headset. Specific operations include environment generation using virtual reality technology and the provision of real-time feedback.

[1553] Step 6:

[1554] The server provides customized maintenance schedules and training plans for work equipment in the factory configuration. The server receives capability and maintenance information for the operating equipment and generates maintenance schedules. The input is the capability and maintenance information of the operating equipment, and the output is the maintenance schedule. Specifically, its operation includes scheduling optimal maintenance tasks for each piece of equipment.

[1555] Step 7:

[1556] The server has the means to monitor operational performance in real time and provide feedback. When a user performs an operation, the server monitors performance using sensors and log data and provides real-time feedback as needed. The input is real-time information from sensors and log data, and the output is feedback to the user. Specific actions include alert and notification functions, or the generation of performance reports.

[1557] Step 8:

[1558] The server saves the aforementioned operational performance data and makes it available for later reference. It stores user operational performance data in a database so that it can be used later when reviewing training content and maintenance schedules. The input is operational performance data, and the output is storage in the database and its availability for later reference. Specific operations include database updates and report generation functions.

[1559] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1560] This invention relates to a system that, in addition to customized training programs and nutritional advice, has the function of recognizing the user's emotional state and providing adjustments and feedback accordingly. This enables comprehensive fitness support that also takes the user's psychological state into consideration. The specific operation of each component is described below.

[1561] 1. User registration and login

[1562] When a user uses the system for the first time, they access a new registration form on their device and enter personal information such as their name, email address, and password. The device sends the entered information to the server. The server processes the received information and stores the user's data in a database. It also generates an authentication token to activate the user account. This allows the user to log in using the login form and access their personal dashboard.

[1563] 2. Creating a customized training program

[1564] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history, etc.) and training goals (e.g., weight loss, muscle gain). The device sends this data to the server. The server analyzes this data and generates a customized training program. The generated program is displayed on the user's personal dashboard.

[1565] 3. Providing nutritional advice

[1566] When a user enters their dietary preferences and allergy information, the device sends this information to the server. The server then generates customized nutritional advice based on this information. It consults a database of nutritionist advice and creates a meal plan for the user. The generated meal plan is displayed on the user's dashboard.

[1567] 4. Virtual trainer service via video chat

[1568] When a user books a training session, the device sends the booking data to the server. The server receives the booking information and notifies the appropriate virtual trainer. As the session time approaches, the device notifies the user and starts a video chat. The trainer monitors the user's training in real time and provides guidance on form correction and motivation improvement.

[1569] 5. Training utilizing virtual reality

[1570] The user puts on a VR headset and launches a specific training application. The server generates an appropriate virtual reality environment based on the user's training program. The generated virtual reality environment is sent to the user's VR headset. The user trains within this virtual environment and receives real-time feedback from the server.

[1571] 6. Recognition and adaptation to emotional states

[1572] This system includes an emotion engine to recognize the user's emotional state. Using the camera and microphone on the user's device (e.g., a smartphone or VR headset), the emotion engine analyzes facial expressions, voice tone, body movements, and other information. The server receives this data and evaluates the user's emotional state.

[1573] Specific example

[1574] User B uses the system to improve their muscle strength. First, they register with the system, log in, and enter their physical information (height 180cm, weight 85kg, age 25, gym experience 3 years). The server uses this information to generate a training program that includes dumbbell exercises and cardio exercises. Next, because User B has a dairy allergy, this is reflected in the meal plan, and a high-protein menu that avoids dairy products is provided.

[1575] If the emotion engine detects that user B's emotions are negative during a session with a virtual trainer, the server transmits this information to the trainer. Based on this, the trainer adds more encouraging words to increase the user's motivation. Conversely, if the server detects that user B's emotions are positive during VR training, it instructs the trainer to moderately increase the training load.

[1576] In this way, the system takes user emotions into consideration and provides appropriate real-time feedback and adjustments, thereby achieving more effective and personalized fitness and nutrition guidance.

[1577] The following describes the processing flow.

[1578] Step 1:

[1579] The user accesses the new registration form on their device and enters personal information such as their name, email address, and password.

[1580] Step 2:

[1581] The terminal sends the entered information to the server.

[1582] Step 3:

[1583] The server processes the received information and saves the user's data to the database.

[1584] Step 4:

[1585] The server generates an authentication token and activates the user account.

[1586] Step 5:

[1587] The user logs in using the login form.

[1588] Step 6:

[1589] The server verifies the user's authentication information and allows them to access their personal dashboard.

[1590] Step 7:

[1591] The user enters their physical information and training goals.

[1592] Step 8:

[1593] The device sends the entered physical information and training goals to the server.

[1594] Step 9:

[1595] The server analyzes the information it receives and generates a customized training program.

[1596] Step 10:

[1597] The server displays the generated training program on the user's dashboard.

[1598] Step 11:

[1599] Users enter their dietary preferences and allergy information.

[1600] Step 12:

[1601] The terminal sends the entered meal information to the server.

[1602] Step 13:

[1603] The server analyzes the received meal information and generates customized nutritional advice.

[1604] Step 14:

[1605] The server displays the generated nutritional advice on the user's dashboard.

[1606] Step 15:

[1607] The user books a training session.

[1608] Step 16:

[1609] The device sends the reservation data to the server.

[1610] Step 17:

[1611] The server receives the reservation information and notifies the appropriate virtual trainer.

[1612] Step 18:

[1613] As the session time approaches, the device will notify the user.

[1614] Step 19:

[1615] The user launches the video chat interface and starts a session.

[1616] Step 20:

[1617] A virtual trainer monitors the user's training in real time and provides feedback.

[1618] Step 21:

[1619] The user puts on a VR headset and launches a specific training application.

[1620] Step 22:

[1621] The server generates an appropriate virtual reality environment based on the user's training program.

[1622] Step 23:

[1623] The server sends the generated virtual reality environment to the user's VR headset.

[1624] Step 24:

[1625] Users train in a virtual reality environment and receive real-time feedback from the server.

[1626] Step 25:

[1627] Users provide the emotion engine with their facial expressions and voice tone during training via their device's camera and microphone.

[1628] Step 26:

[1629] The emotion engine analyzes the received data and evaluates the user's emotional state.

[1630] Step 27:

[1631] The server receives emotional state data from the emotion engine and adjusts the training program or feedback accordingly.

[1632] Step 28:

[1633] If a user is in a negative emotional state, the server adjusts the virtual trainer and training scenario to provide the user with appropriate ways to improve their motivation.

[1634] Step 29:

[1635] When the user is in a positive emotional state, the server makes adjustments such as increasing the training load.

[1636] Step 30:

[1637] After the user finishes training, the server saves the training data and emotional state data, which are then used to optimize the next training program.

[1638] (Example 2)

[1639] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1640] Traditional fitness systems lack sufficient customization based on users' personal information and training goals, and they also lack the ability to provide feedback that takes into account the user's emotional state. This makes it difficult to motivate users, provide appropriate advice in real time, and achieve effective fitness guidance and nutritional management.

[1641] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server is

[1642] Means for receiving users' personal information and training goals,

[1643] A means for generating a customized training program based on received personal information and training objectives,

[1644] A means of displaying the generated training program to the user,

[1645] A means of providing real-time video chat training sessions between users and trainers,

[1646] A means of providing users with a training experience in a virtual reality environment,

[1647] A means of recognizing the user's emotional state and providing appropriate feedback,

[1648] This includes [specific features / features]. This enables comprehensive fitness support that takes into account the user's psychological state.

[1649] "Personal information" refers to information used to identify a specific user, such as the user's name, email address, password, age, height, weight, and exercise history.

[1650] "Training goals" refer to specific fitness objectives that a user aims to achieve, such as weight loss, muscle strength improvement, or endurance enhancement.

[1651] A "customized training program" is an individually optimized exercise plan generated based on the user's personal information and training goals.

[1652] A "video chat training session" is a training session conducted through real-time video calls between the user and the trainer over the internet.

[1653] A "virtual reality environment" is a system that provides users with a virtual training environment using devices such as VR headsets, allowing users to experience exercise in a virtual reality setting.

[1654] "Emotional state" refers to the user's psychological state, which is specifically judged through facial expressions, tone of voice, body movements, and other factors.

[1655] "Feedback" refers to responses such as instructions, advice, and encouragement provided based on the user's actions and status.

[1656] "Nutritional advice" refers to personalized guidance and recommendations regarding diet based on the user's dietary preferences and allergy information.

[1657] This invention relates to a system that receives a user's personal information and training goals, and provides a customized training program and nutritional advice. It also includes a function to recognize the user's emotional state and provide feedback accordingly. The specific operation of each component is described below.

[1658] 1. User registration and login

[1659] When a user uses the system for the first time, they access a new registration form on their device and enter personal information such as their name, email address, and password. The device sends this information to the server via an HTTP POST request. The server checks the received information and stores it in its database. If the storage is successful, the server generates an authentication token, such as a JWT (JSON Web Token), and sends it to the device. This allows the user to log in using the login form and access their personal dashboard.

[1660] 2. Creating a customized training program

[1661] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history) and training goals (e.g., weight loss, muscle gain). The device sends this data to the server via an HTTP POST request. The server analyzes the received data and generates a customized training program using a generative AI model. This program is stored in a database and sent to the device. This program is then displayed on the user's personal dashboard.

[1662] 3. Providing nutritional advice

[1663] When a user enters their dietary preferences and allergy information, the device sends this information to the server via an HTTP POST request. Based on the received data, the server consults a nutritionist advice database and generates customized nutritional advice. This generated meal plan is saved to the database and sent back to the device. The device then displays this plan on the user's dashboard.

[1664] 4. Virtual trainer service via video chat

[1665] When a user books a training session, the device sends the booking data to the server via an HTTP POST request. The server receives the booking information and notifies the appropriate virtual trainer. As the session time approaches, the device notifies the user and starts a video chat. The virtual trainer monitors the user's training in real time and provides guidance on correcting form and improving motivation.

[1666] 5. Training utilizing virtual reality

[1667] The user puts on a VR headset and launches a dedicated training application. The server generates an appropriate virtual reality environment based on the user's training program. This environment is stored in a database and sent to the user's VR headset. The user trains in this virtual environment and receives real-time feedback from the server.

[1668] 6. Recognition and adaptation to emotional states

[1669] The camera and microphone on the user's device capture their facial expressions, voice tone, and body movements. This data is transmitted to a server in real time. The server uses an emotion engine to analyze the data and evaluate the user's emotional state. Based on this evaluation, training and nutritional advice are tailored to the user. For example, if the user is in a negative emotional state, the server notifies the trainer and instructs them to add words of encouragement, etc.

[1670] Specific example

[1671] User B uses the system with the goal of improving their muscle strength. User B registers with the system and, after logging in, enters their physical information (height 180cm, weight 85kg, age 25, gym experience 3 years). Based on this data, the server generates a training program that includes dumbbell exercises and cardio exercises. Subsequently, User B enters their dairy allergy, and based on this, a high-protein diet menu that avoids dairy products is provided. If the emotion engine detects negative emotions from User B during a session with the virtual trainer, the server notifies the trainer, who then offers words of encouragement. Conversely, if positive emotions are detected during VR training, instructions are given to moderately increase the training load.

[1672] Examples of prompt statements are as follows:

[1673] "Please enter the user's height, weight, age, and exercise history."

[1674] "Next, please select your training goal."

[1675] Please enter your dietary preferences and allergy information.

[1676] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1677] 1. User registration and login

[1678] Step 1:

[1679] The user accesses the new registration form. The user enters their name, email address, and password. The user is given the name, email address, and password as input.

[1680] Step 2:

[1681] The terminal sends the entered information to the server via an HTTP POST request. The server receives the information and saves it to the database. A message indicating successful saving is output.

[1682] Step 3:

[1683] The server generates an authentication token (e.g., a JWT) and sends it to the terminal. The token is issued as output.

[1684] Step 4:

[1685] The device saves the received token. The user uses the token to log in through the login form and access their personal dashboard. A login success message is output.

[1686] 2. Creating a customized training program

[1687] Step 1:

[1688] After logging in, the user enters physical information (e.g., height, weight, age, exercise history) and training goals (e.g., weight loss, muscle strength improvement). Physical information and training goals are provided as input fields.

[1689] Step 2:

[1690] The device sends this data to the server via an HTTP POST request. The server analyzes the received data and uses it to generate a customized training program using a generated AI model. The training program is obtained as output.

[1691] Step 3:

[1692] The generated training program is sent from the server to the terminal. The terminal displays the program on the user's personal dashboard. The displayed training program is obtained as output.

[1693] 3. Providing nutritional advice

[1694] Step 1:

[1695] The user enters their dietary preferences and allergy information. The input provided includes dietary preferences and allergy information.

[1696] Step 2:

[1697] The device sends this information to the server via an HTTP POST request. The server analyzes the received data, consults a nutritionist advice database, and generates customized nutrition advice. The output is the nutrition advice.

[1698] Step 3:

[1699] The generated nutritional advice is sent from the server to the terminal and displayed on the user's personal dashboard. The output is the displayed nutritional advice.

[1700] 4. Virtual trainer service via video chat

[1701] Step 1:

[1702] The user books a training session. The booking information is provided as input.

[1703] Step 2:

[1704] The terminal sends reservation data to the server via an HTTP POST request. The server receives the reservation information and notifies the appropriate virtual trainer. The output is the notification to the trainer.

[1705] Step 3:

[1706] As the session time approaches, the device notifies the user and initiates the video chat. A real-time video chat takes place between the user and the trainer. The output is a video session start notification.

[1707] Step 4:

[1708] During video chat, the trainer monitors the user's training, providing guidance on form correction and motivation improvement. The output is real-time training instruction.

[1709] 5. Training utilizing virtual reality

[1710] Step 1:

[1711] The user puts on a VR headset and launches a dedicated training application. The inputs provided are the wearing of the VR headset and the launch of the application.

[1712] Step 2:

[1713] The server generates an appropriate virtual reality environment based on the user's training program. The output is a VR environment.

[1714] Step 3:

[1715] The VR environment is transmitted from the server to the user's VR headset. The user performs training within the virtual environment. The output is the transmitted VR environment.

[1716] Step 4:

[1717] Users train in a virtual reality environment and receive real-time feedback from the server. The output is real-time feedback.

[1718] 6. Recognition and adaptation to emotional states

[1719] Step 1:

[1720] The camera and microphone on the user's device capture facial expressions, voice tone, and body movements. Facial expressions, voice tone, and body movements are provided as input.

[1721] Step 2:

[1722] The device sends the collected data to the server in real time. The server uses an emotion engine to analyze the data and evaluate the user's emotional state. The output is the evaluation result of the emotional state.

[1723] Step 3:

[1724] Based on the user's emotional state, training programs and nutritional advice are tailored to their needs. If the user is in a negative emotional state, the server notifies the trainer and instructs them to add encouraging words, etc. The output is the tailored training and nutritional advice.

[1725] (Application Example 2)

[1726] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1727] While conventional fitness support systems provide customized programs based on the user's physical information and training goals, they lack real-time feedback and adjustments that take into account the user's emotional state. As a result, maintaining user motivation and optimizing performance is difficult, leading to challenges in fully realizing the effects of training. Furthermore, even in training sessions utilizing virtual reality environments and real-time video chat, individualized support that takes into account the user's psychological state is required, but this is difficult to achieve with current systems.

[1728] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for receiving the user's personal information and training goals, means for generating a customized training program based on the received personal information and training goals, means for displaying the generated training program to the user, means for providing a real-time video chat training session between the user and the instructor, means for providing the user with a training experience in a virtual reality environment, means for recognizing the user's emotional state and providing adjustments and feedback accordingly, and means for collecting data from a camera and microphone for analyzing the emotional state. This enables comprehensive fitness support that takes the user's emotional state into consideration.

[1729] A "user" is an individual who uses the system to receive training programs and nutritional advice.

[1730] "Personal information" refers to data that includes physical information about the user, such as height, weight, and age, as well as contact information.

[1731] "Training goals" refer to specific fitness objectives that users want to achieve, such as weight loss or muscle gain.

[1732] A "customized training program" refers to an exercise plan generated individually based on the user's personal information and training goals.

[1733] "Means of display" refers to methods and devices for outputting the generated training program to the user's device or a display in the gym.

[1734] A "trainer" is a professional who provides exercise guidance and advice to users through training sessions.

[1735] A "real-time video chat training session" is a session in which instructors and users conduct training in real time via video and audio over a network.

[1736] A "virtual reality environment" refers to a technology and system that allows users to exercise in a virtual training space.

[1737] "Emotional state" refers to the user's psychological state or emotions, such as joy, sadness, or anger.

[1738] "Means of providing adjustments and feedback" refers to methods and systems that appropriately modify training programs and instruction content based on the user's emotional state and provide appropriate advice.

[1739] "Means of collecting data from cameras and microphones" refers to devices for recording a user's facial expressions and voice tone, and methods for transmitting that data to a system.

[1740] This invention relates to a system that provides comprehensive fitness support by offering customized training programs and nutritional advice based on the user's personal information and training goals, and by providing adjustments and feedback according to the user's emotional state. Specific embodiments are described below.

[1741] System Overview

[1742] This system mainly consists of the following components:

[1743] 1. Ability to receive users' personal information and training goals.

[1744] 2. Ability to generate customized training programs

[1745] 3. Function to display the training program to the user.

[1746] 4. A feature that provides real-time video chat training sessions between users and instructors.

[1747] 5. Features that provide a training experience in a virtual reality environment.

[1748] 6. A function that recognizes the user's emotional state and provides adjustments and feedback accordingly.

[1749] 7. Function to collect data from cameras and microphones to analyze emotional states.

[1750] System Implementation Procedures

[1751] Regarding program generation and processing

[1752] Hardware and software to be used

[1753] Hardware: Smartphones, cameras in the gym, fitness machines with sensors

[1754] Software: Python, OpenCV (face recognition), Azure Emotion API (sentiment analysis), frontend is React Native or Flutter

[1755] 1. User registration and login

[1756] When a user uses the system for the first time, they access a new registration form on their smartphone or a terminal in the gym and enter their personal information (e.g., name, email address, password). The terminal sends the entered information to the server, which stores the received information in a database. At the same time, an authentication token is generated to activate the user account, and the user can log in using the login form and access their personal dashboard.

[1757] 2. Creating a customized training program

[1758] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history) and training goals. The device sends this data to the server, which analyzes it and generates a personalized training program for the user. The generated program is then displayed on the user's personal dashboard.

[1759] 3. Providing nutritional advice

[1760] When a user enters their dietary preferences and allergy information, the device sends this information to a server. The server then consults a database of nutritionist advice and generates personalized nutritional advice. This advice is then displayed on the user's dashboard.

[1761] 4. Coaching services via video chat

[1762] When a user books a training session, the device sends the booking data to the server. The server receives the booking information and notifies the appropriate instructor. As the session time approaches, the device notifies the user and starts a video chat. The instructor monitors the user's training in real time and provides guidance on form correction and motivation improvement.

[1763] 5. Training utilizing virtual reality

[1764] The user puts on a VR headset and launches a specific training application. The server generates an appropriate virtual reality environment based on the user's training program. The generated virtual reality environment is sent to the user's VR headset. The user trains within this virtual environment and receives real-time feedback from the server.

[1765] 6. Recognition and adaptation to emotional states

[1766] This system includes an emotion engine to recognize the user's emotional state. Using the camera and microphone on the user's device (e.g., smartphone or VR headset), the emotion engine analyzes facial expressions, voice tone, body movements, etc. The server receives this data and evaluates the user's emotional state. Based on the emotional state, it adjusts the training load and provides feedback in real time.

[1767] Specific example

[1768] For example, if the emotion engine detects that the user is fatigued during training, the server will instruct it to reduce the training load. Also, if the user is excited about achieving their goal, the server will suggest a more challenging training session. Examples of prompts for the generative AI model include, "Analyze my emotional state and give me appropriate training feedback," and "Adjust my future training plan based on my emotional data."

[1769] In this way, comprehensive fitness support that takes into account the user's emotional state can be realized.

[1770] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1771] Step 1: User registration and login

[1772] Users access a new registration form on their smartphone or a terminal within the gym and enter personal information such as their name, email address, and password. The terminal sends the entered information to the server. The server stores the received information in a database, generates an authentication token, and activates the user account. This allows the user to log in using the login form and access their personal dashboard. The input is the user's personal information, and the output is the user information and authentication token stored in the database.

[1773] Step 2: Create a customized training program

[1774] After logging in, the user enters their physical information (e.g., height, weight, age, exercise history, etc.) and training goals. The device sends this data to the server. The server analyzes this data and generates a customized training program. The generated program is displayed on the user's personal dashboard. The input is the user's physical information and training goals, and the output is the customized training program.

[1775] Step 3: Provide nutritional advice

[1776] The user enters their dietary preferences and allergy information. The terminal sends this information to the server. The server consults a nutritionist advice database and generates customized nutritional advice. The generated nutritional advice is displayed on the user's dashboard. The input is the user's dietary and allergy information, and the output is customized nutritional advice.

[1777] Step 4: Coaching services via video chat

[1778] The user books a fitness session. The device sends the booking data to the server. The server receives the booking information and notifies the appropriate instructor. As the session time approaches, the device notifies the user and starts a video chat. The instructor monitors the user's training in real time and provides appropriate corrections and motivational guidance. The input is the user's session booking information, and the output is the video chat connection for the training session.

[1779] Step 5: Training using virtual reality

[1780] The user puts on a VR headset and launches a virtual training application. The server generates a suitable virtual reality environment based on the user's training program. The generated virtual reality environment is sent to the VR headset, and the user trains in this virtual environment. The server provides real-time feedback. The input is the user's training program, and the output is the virtual reality environment and real-time feedback.

[1781] Step 6: Recognition and feedback on emotional state

[1782] Users utilize cameras and microphones built into their smartphones or VR headsets. Data such as facial expressions, voice tone, and body movements are collected from these devices. The devices transmit this data to a server, which uses an emotion engine to analyze the user's emotional state. Based on the analysis results, the server adjusts the training load and feedback as needed and provides it to the user. The input is the user's emotional data, and the output is the adjusted training load and feedback.

[1783] Specific example:

[1784] For example, if a user shows signs of fatigue during training, the emotion engine analyzes this information and notifies the server. The server then instructs the system to reduce the training load and notifies the user via a pop-up message. Examples of prompts for the generative AI model include, "Analyze my emotional state and provide appropriate training feedback," and "Adjust future training plans based on the user's emotional data."

[1785] In this way, the system is designed to provide users with optimal training and advice by performing appropriate data processing and calculations based on the user's input data at each step and providing feedback on the results.

[1786] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1787] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1788] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[1789] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1790] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[1791] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[1792] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[1793] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[1794] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[1795] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[1796] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[1797] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[1798] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[1799] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1800] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[1801] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[1802] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[1803] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[1804] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[1805] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[1806] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[1807] The following is further disclosed regarding the embodiments described above.

[1808] (Claim 1)

[1809] Means for receiving users' personal information and training goals,

[1810] A means for generating a customized training program based on received personal information and training objectives,

[1811] A means of displaying the generated training program to the user,

[1812] A means of providing real-time video chat training sessions between users and trainers,

[1813] A means of providing users with a training experience in a virtual reality environment,

[1814] A system that includes this.

[1815] (Claim 2)

[1816] A means of receiving the user's dietary preferences and allergy information,

[1817] A means for generating customized nutritional advice based on received dietary preferences and allergy information,

[1818] A means of providing users with generated nutritional advice,

[1819] The system according to claim 1, further comprising:

[1820] (Claim 3)

[1821] A means to monitor users' training performance in real time and provide feedback,

[1822] A means for saving the aforementioned training performance data and making it available for later reference,

[1823] The system according to claim 1, further comprising:

[1824] "Example 1"

[1825] (Claim 1)

[1826] Means for receiving users' personal information and training goals,

[1827] A means for generating a customized training program based on received personal information and training objectives,

[1828] A means of displaying the generated training program to the user,

[1829] A means for receiving user dietary preferences and allergy information,

[1830] A means for generating customized nutritional advice based on received dietary preferences and allergy information,

[1831] A means of providing users with generated nutritional advice,

[1832] A means of providing real-time video chat training sessions between users and instructors,

[1833] A means of providing users with a training experience in a virtual reality environment,

[1834] A system that includes this.

[1835] (Claim 2)

[1836] A means of monitoring the user's exercise performance in real time and providing feedback,

[1837] A means for saving the aforementioned athletic performance data and making it available for later reference,

[1838] The system according to claim 1, further comprising:

[1839] (Claim 3)

[1840] The system according to claim 1, comprising means for generating a customized training program and nutritional advice based on user information using a generative AI model.

[1841] "Application Example 1"

[1842] (Claim 1)

[1843] Means for receiving users' personal information and operational targets,

[1844] Means for generating a customized training program based on received personal information and operational objectives,

[1845] A means of displaying the generated training program to the user,

[1846] A means of providing real-time video chat training sessions between users and technicians,

[1847] A means of providing users with an operational experience in a virtual environment,

[1848] In factory settings, means of providing customized maintenance schedules and training plans for work equipment,

[1849] A system that includes this.

[1850] (Claim 2)

[1851] Means for receiving information on the capabilities and maintenance of the user's operating equipment,

[1852] A means for generating customized maintenance advice based on the capabilities and maintenance information of the received operating equipment,

[1853] A means of providing the generated maintenance advice to the user,

[1854] The system according to claim 1, further comprising:

[1855] (Claim 3)

[1856] A means of monitoring user performance in real time and providing feedback,

[1857] A means for saving the aforementioned operation performance data and making it available for later reference,

[1858] The system according to claim 1, further comprising:

[1859] "Example 2 of combining an emotion engine"

[1860] (Claim 1)

[1861] Means for receiving users' personal information and training goals,

[1862] A means for generating a customized training program based on received personal information and training objectives,

[1863] A means of displaying the generated training program to the user,

[1864] A means of providing real-time video chat training sessions between users and trainers,

[1865] A means of providing users with a training experience in a virtual reality environment,

[1866] A means of recognizing the user's emotional state and providing appropriate feedback,

[1867] A system that includes this.

[1868] (Claim 2)

[1869] A means of receiving the user's dietary preferences and allergy information,

[1870] A means for generating customized nutritional advice based on received dietary preferences and allergy information,

[1871] A means of providing users with generated nutritional advice,

[1872] A means of adjusting nutritional advice based on emotional state,

[1873] The system according to claim 1, further comprising:

[1874] (Claim 3)

[1875] A means to monitor users' training performance in real time and provide feedback,

[1876] A means for saving the aforementioned training performance data and making it available for later reference,

[1877] A means of evaluating the user's emotional state using an emotion engine and storing it along with performance data,

[1878] The system according to claim 1, further comprising:

[1879] "Application example 2 when combining with an emotional engine"

[1880] (Claim 1)

[1881] Means for receiving users' personal information and training goals,

[1882] A means for generating a customized training program based on received personal information and training objectives,

[1883] A means of displaying the generated training program to the user,

[1884] A means of providing real-time video chat training sessions between users and instructors,

[1885] A means of providing users with a training experience in a virtual reality environment,

[1886] A means of recognizing the user's emotional state and providing appropriate adjustments and feedback,

[1887] A means of collecting data from cameras and microphones to analyze emotional states,

[1888] A system that includes this.

[1889] (Claim 2)

[1890] A means of receiving the user's dietary preferences and allergy information,

[1891] A means for generating customized nutritional advice based on received dietary preferences and allergy information,

[1892] A means of providing users with generated nutritional advice,

[1893] The system according to claim 1, further comprising:

[1894] (Claim 3)

[1895] A means to monitor users' training performance in real time and provide feedback,

[1896] A means for saving the aforementioned training performance data and making it available for later reference,

[1897] The system according to claim 1, further comprising: [Explanation of symbols]

[1898] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. Means for receiving users' personal information and training goals, A means for generating a customized training program based on received personal information and training objectives, A means of displaying the generated training program to the user, A means of providing real-time video chat training sessions between users and trainers, A means of providing users with a training experience in a virtual reality environment, A system that includes this.

2. A means of receiving the user's dietary preferences and allergy information, A means for generating customized nutritional advice based on received dietary preferences and allergy information, A means of providing users with generated nutritional advice, The system according to claim 1, further comprising:

3. A means to monitor users' training performance in real time and provide feedback, A means for saving the aforementioned training performance data and making it available for later reference, The system according to claim 1, further comprising:

Images