System

Abstract

A system is provided.SOLUTION: A system comprising: means for registering information concerning a body of a user; means for generating an optimum exercise menu on the basis of the registered information; means for notifying an execution timing of the exercise menu; means for receiving an exercise form moving image photographed by the user and pointing out a difference in a form; and means for supporting the user to be able to continue exercise.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern society, individuals seeking to exercise for fitness and health maintenance face the challenge of finding the optimal exercise method among the overwhelming amount of information available on the Internet. Continuing to use the wrong exercise method also poses the risk of injury. Furthermore, it is difficult to continue exercising, and there is a lack of mechanisms to maintain motivation. There is a need for a system that can solve these issues and enable users to exercise effectively, safely, and continuously. [Means for solving the problem]

[0005] This invention solves the above-mentioned problems by providing a system that includes a means for registering information about a user's body and a means for generating an optimal exercise menu based on the registered information. Furthermore, the system includes a means for notifying the user of the timing of the exercise menu and a means for receiving and analyzing videos of the user's exercise form to identify differences in form. Furthermore, by generating a new exercise menu based on the analysis results and providing it to the user, the effects of exercise can be maximized. Furthermore, the system incorporates means for supporting the user to continue exercising, helping to maintain motivation. In this way, a system is provided that allows the user to continue exercising safely and effectively.

[0006] "User Information" refers to all physical and health information about you, such as your goals, body type, age, height, weight, and pain points.

[0007] An "exercise menu" refers to a plan that includes the optimal type, number of repetitions, frequency, and method of exercise and stretching based on the user's physical information.

[0008] "Reminder" refers to a function that notifies the user when it is time to exercise.

[0009] "Exercise form video" refers to a video taken by a user of their own exercise movements.

[0010] "Analysis means" refers to a function for analyzing the recorded video of exercise form and evaluating its accuracy.

[0011] "Improvement suggestions" refer to suggestions including corrections based on errors in form pointed out by the analysis means and new exercise menus.

[0012] "Continued support means" refers to support functions that make it easier for users to continue exercising, such as character settings and functions for interacting with other users. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0014] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0017] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0018] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0019] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0021] [First embodiment]

[0022] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0023] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0026] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0029] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0033] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0034] The present invention is a system that provides users with an optimal exercise menu based on their health condition and exercise goals, and supports them in exercising safely and effectively on a regular basis. This system is realized using a user terminal, a server, and an AI module.

[0035] User Device

[0036] user

[0037] First, the user installs the application on their device and launches it. On the screen that appears when the application is launched, they enter their profile information, such as their goal (muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in particular.

[0038] Terminal

[0039] The device receives these inputs and sends them to the server, where they are properly formatted and encrypted for security and privacy.

[0040] server

[0041] server

[0042] The server receives the user information sent from the device and stores it in a database. The server then sends the stored information to the AI ​​module, which then generates an optimal exercise menu based on the user information.

[0043] Server (AI module)

[0044] The AI ​​module selects appropriate stretching, training videos, and exercise menus based on the user's goals and physical information. It also provides dietary advice and suggests supplements based on the user's areas for improvement. The generated menus and advice are then returned to the server and sent to the device.

[0045] Providing exercise menus and checking form

[0046] Terminal

[0047] The device receives the exercise menu and dietary advice sent from the server and displays it to the user. It also notifies the user as needed to remind them to exercise. When the user exercises, the device captures their movements with a camera, and the device receives the video and sends it back to the server.

[0048] server

[0049] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video and evaluates accuracy and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[0050] Ongoing support

[0051] Terminal

[0052] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides character development and interaction with other users to maintain ongoing motivation.

[0053] user

[0054] Users can use these features to continue exercising and maintain their motivation by developing their characters and exchanging opinions with other users.

[0055] Specific examples

[0056] For example, if a 34-year-old female user wants to improve her stiff shoulders, she can enter her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). This information is sent to the server, and the AI ​​module generates an optimal exercise menu to improve shoulder stiffness. It also suggests foods rich in B vitamins and supplements to supplement them.

[0057] When users receive a reminder to exercise, they follow the provided exercise menu. To check their form, the movements are recorded as a video and sent to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In this way, users can always continue exercising with the correct form, helping to alleviate shoulder stiffness.

[0058] In this way, the system of the present invention provides the user with an optimal exercise menu and provides continuous support, thereby effectively helping the user maintain their health.

[0059] The processing flow will be explained below.

[0060] Step 1: Enter your user information

[0061] user

[0062] The user installs the application on their device and launches it. On the registration screen that appears when the application is launched for the first time, the user enters profile information such as their purpose (e.g., muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in particular.

[0063] Step 2: Submit user information

[0064] Terminal

[0065] The terminal formats the information entered by the user for transmission to the server and appropriately encrypts the data before transmission.

[0066] Step 3: Save user information

[0067] server

[0068] The server receives user information sent from the device and stores it in a database, after which it sends this information to an AI module for analysis.

[0069] Step 4: Generate an exercise menu

[0070] Server (AI module)

[0071] The AI ​​module analyzes information such as the user's goals, body type, age, and areas of pain to create an optimal exercise menu. It also provides dietary advice and suggests supplements to help achieve goals.

[0072] Step 5: Distribution of exercise menu

[0073] server

[0074] The generated exercise menu and dietary advice are stored in a database and prepared for transmission to the device, where the data is re-encrypted.

[0075] Step 6: View the exercise menu

[0076] Terminal

[0077] The terminal displays the exercise menu and dietary advice received from the server to the user.

[0078] Step 7: Remind yourself to exercise

[0079] Terminal

[0080] Based on the user's schedule, reminders are sent for exercise.

[0081] Step 8: Video your exercise form

[0082] user

[0083] Users receive reminders and follow the instructions to exercise, while their movements are recorded with the device's camera.

[0084] Step 9: Submit your exercise form video

[0085] Terminal

[0086] The captured exercise form video is received, formatted for transmission to a server, and the data is encrypted before being transmitted.

[0087] Step 10: Analyze the video

[0088] Server (AI module)

[0089] The server receives the video and analyzes it using an AI module, which evaluates the exercise form and determines what corrections are needed.

[0090] Step 11: Generate improvement suggestions

[0091] Server (AI module)

[0092] Based on the results of form analysis, points that need to be corrected and new exercise menus are generated.

[0093] Step 12: Distributing improvement proposals

[0094] server

[0095] The generated improvement suggestions and new exercise menus are stored in a database and prepared for transmission to the device. The data is encrypted during transmission.

[0096] Step 13: Viewing improvement suggestions

[0097] Terminal

[0098] The device notifies the user of and displays improvement suggestions and new exercise menus received from the server.

[0099] Step 14: Support for continued exercise

[0100] Terminal

[0101] To make it easier for users to continue exercising, the app provides features for character development and interaction with other users.

[0102] Step 15: Stay motivated

[0103] user

[0104] Users maintain their motivation to exercise by developing their characters and exchanging opinions with other users.

[0105] Example 1

[0106] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0107] In modern society, an increasing number of people are experiencing a decline in their health due to lack of exercise or improper exercise form. It is particularly difficult to propose appropriate exercise programs tailored to individual health conditions and goals, and maintaining ongoing motivation is also a challenge. Furthermore, there is a lack of means to check the appropriateness of users' exercise form and provide feedback on areas for improvement. These issues need to be resolved.

[0108] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0109] In this invention, the server includes means for registering information about the user's body, means for encrypting the registered information and transmitting it to the server, means for generating an optimal exercise menu using an artificial intelligence module based on the registered information, means for notifying the timing of performing the exercise menu, means for receiving a video of the exercise form taken by the user and requesting form analysis, means for providing form improvements based on the analysis results, and means for generating and providing a new exercise menu based on the analysis results, thereby enabling the provision of an exercise menu that meets the individual needs of the user, form checks and improvements, and continuous motivation support.

[0110] "User" refers to an individual who uses the system to carry out exercise programs and manage their health.

[0111] "Physical Information" refers to personal health information, including your height, weight, age, goals, and areas of particular interest or pain.

[0112] "Encryption" refers to the process of transforming information using a specific algorithm to protect it from unauthorized access by third parties.

[0113] "Server" refers to a computer system that receives, stores, and processes information sent from a user terminal and interacts with an artificial intelligence module.

[0114] "Artificial intelligence module" refers to a system that includes a program for generating optimal exercise menus and dietary advice based on user information.

[0115] An "exercise menu" refers to a specific exercise or training plan that a user should undertake to maintain their health and achieve their goals.

[0116] "Notification" refers to a means of informing users of the timing of exercise and suggestions for improving their form.

[0117] "Exercise form video" refers to footage of a user filming themselves exercising.

[0118] "Analysis" refers to the process by which an artificial intelligence module evaluates exercise form videos to identify accuracy and areas for improvement.

[0119] "Form improvement points" refer to points that the user should correct in order to perform the exercise more accurately.

[0120] "Motivation support" refers to functions and services that enable users to continue exercising.

[0121] "Character growth function" refers to a function that allows a virtual character to grow as the user continues to exercise.

[0122] "Function for interacting with other users" refers to a function that allows users to exchange information and communicate with other system users.

[0123] The present invention is a system that provides users with an optimal exercise menu based on their health condition and exercise goals, and supports them in exercising safely and effectively on a regular basis. This system is realized using a user terminal, a server, and an AI module.

[0124] User Device

[0125] user:

[0126] First, the user installs the application on their device and launches it. On the screen that appears when the application is launched, the user enters profile information such as their goal (muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in particular.

[0127] Device:

[0128] The device receives the information entered by the user, properly formats the data, encrypts it, and sends it to the server, using encryption technology to ensure security and privacy during the process.

[0129] server

[0130] server:

[0131] The server receives the encrypted user information sent from the user terminal, decrypts the received data, stores it in a database, and then sends the stored information to the AI ​​module.

[0132] AI Module:

[0133] The AI ​​module generates optimal exercise menus, stretching videos, and dietary advice based on the user's goals and physical information. It also suggests supplements based on the user's areas for improvement. The generated exercise menus and advice are then sent back to the server and sent to the user's device.

[0134] Providing exercise menus and checking form

[0135] Device:

[0136] The device receives the exercise menu and dietary advice sent from the server and displays them to the user. It also notifies the user as needed to remind them to exercise. When the user exercises, the device captures their movements with a camera and receives the video and sends it back to the server.

[0137] server:

[0138] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video, assessing accuracy and areas for improvement. If necessary, it generates corrections and new exercise menus and sends them back to the device.

[0139] Ongoing support

[0140] Device:

[0141] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides character development and interaction with other users to maintain ongoing motivation.

[0142] user:

[0143] Users can use these features to continue exercising and maintain their motivation by developing their characters and exchanging opinions with other users.

[0144] Specific examples

[0145] For example, if a 34-year-old female user wants to improve her stiff shoulders, she can enter her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). This information is sent to the server, and the AI ​​module generates an optimal exercise menu to improve shoulder stiffness. It also suggests foods rich in B vitamins and supplements to supplement them.

[0146] When users receive a reminder to exercise, they follow the provided exercise menu. To check their form, the movements are recorded as a video and sent to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In this way, users can always continue exercising with the correct form, helping to alleviate shoulder stiffness.

[0147] Prompt Sentence Examples

[0148] "Please explain how an app works, suggesting exercises to improve shoulder stiffness for a 34-year-old woman. Please include specific input information and related dietary advice."

[0149] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0150] System program processing flow

[0151] Step 1:

[0152] A user installs and launches an application on a device. The first time the application is launched, the user is prompted to log in or register. Input includes a username, password, and any initial configuration information. Output is the application's home screen.

[0153] Step 2:

[0154] On the application's home screen, the user enters the purpose of their exercise (e.g., muscle training, improving posture, preventing stiff shoulders, etc.) and profile information (e.g., height, weight, age, areas they want to improve, areas of pain, etc.). The entered information is temporarily stored on the device. Inputs include the user's health status and personal information. As output, the entered data is temporarily stored in the device's local storage.

[0155] Step 3:

[0156] The terminal receives information entered by the user and formats and encrypts the data appropriately. User information entered is received in plain text, but is encrypted on output, ready to be sent to the server.

[0157] Step 4:

[0158] The terminal sends encrypted user information to the server. The data sent is encrypted to ensure security. The input contains the encrypted user information, and the output is the data sent to the server.

[0159] Step 5:

[0160] The server receives the encrypted data sent from the terminal. The server decrypts the received data and stores it in the database. The input contains the encrypted user information and the decrypted data is stored in the database. The output is the new user information stored in the database.

[0161] Step 6:

[0162] The server sends the stored user information to the AI ​​module. As input, it contains the user information stored in the database and sends the data to the AI ​​module. As output, it provides the data to the AI ​​module.

[0163] Step 7:

[0164] The AI ​​module generates optimal exercise menus and dietary advice based on the user's goals and physical information. Data processing involves generating stretching videos and exercise menus based on the user's input information. User information is included as input, and the generated exercise menus and dietary advice are returned to the server as output.

[0165] Step 8:

[0166] The server receives the exercise menu and dietary advice generated by the AI ​​module and sends it to the user's device. The input contains the data generated by the AI, and the output is sent to the user's device.

[0167] Step 9:

[0168] The device receives exercise menus and dietary advice from the server and displays them to the user. It also sends notifications to remind the user to exercise. The input contains the data sent from the server and the output is displayed to the user.

[0169] Step 10:

[0170] The user exercises based on the displayed exercise menu, and records their movements with the camera. The input includes the user's exercise and the recorded video, and the output is the video saved on the device.

[0171] Step 11:

[0172] The device receives the captured video and sends it to the server. The input includes the captured video of the exercise form, and the video is sent to the server as the output.

[0173] Step 12:

[0174] The server receives the video sent by the user and requests the AI ​​module to analyze it. The video data is included as input and an analysis request is sent to the AI ​​module. As output, data for form analysis is provided to the AI ​​module.

[0175] Step 13:

[0176] The AI ​​module analyzes the user's form based on the video sent to it, assessing accuracy and areas for improvement. A posture analysis algorithm is used for data calculations. The input is the video data, and the output is the analysis results.

[0177] Step 14:

[0178] The AI ​​module generates correction points and new exercise menus based on the results of form analysis and sends them to the server. The form analysis results are included as input, and the new exercise menus and correction suggestions are sent to the server as output.

[0179] Step 15:

[0180] The server receives new exercise menus and modification suggestions from the AI ​​module and sends them to the user's device. The input contains the new exercise menus and modification suggestions, and the output contains the data sent to the user's device.

[0181] Step 16:

[0182] The terminal notifies and displays the improvement suggestions and new exercise menus sent from the server to the user.The new exercise menus and correction suggestions are included as inputs and displayed to the user as outputs.

[0183] Step 17:

[0184] The device provides motivational support to help users continue exercising. This includes character development and interaction with other users. Inputs include data sent from the server and the user's exercise history, and outputs provide functions to maintain the user's motivation.

[0185] Prompt Sentence Examples

[0186] "Please explain how an app works, suggesting exercises to improve shoulder stiffness for a 34-year-old woman. Please include specific input information and related dietary advice."

[0187] (Application example 1)

[0188] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0189] Conventional exercise support systems provide optimal exercise menus based on the user's health condition and exercise goals, but it is difficult to obtain real-time feedback during actual training, making it difficult to quickly correct errors in form. There are also challenges in maintaining motivation, making it difficult to continue exercising sustainably. In particular, in a home training environment, it is difficult to receive proper form guidance, making it difficult to achieve effective exercise.

[0190] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0191] In this invention, the server includes means for registering information about the user's body, means for generating an optimal exercise menu based on the registered information, means for notifying the user of the timing of performing the exercise menu, means for receiving videos of the user's exercise form and pointing out any discrepancies in form, means for supporting the user so that they can continue exercising, and means for providing training in a virtual space using a virtual reality device and providing real-time feedback on exercise form. This allows users to train effectively at home or anywhere they like while receiving real-time feedback, enabling them to continue exercising consistently. Furthermore, training in a virtual space can increase motivation and ensure proper form.

[0192] "User's physical information" includes information about the user's purpose, body type, age, height, weight, and pain points.

[0193] An "exercise menu" is training content generated based on the user's physical information and exercise goals.

[0194] The "means for notifying the timing of the exercise" has a function of notifying the user of the time to perform the exercise menu.

[0195] An "exercise form video" is a video recording of a user exercising.

[0196] The "means for pointing out differences in form" is a function that evaluates the user's exercise form and points out errors and areas for improvement.

[0197] The "means for supporting continuation" has the function of providing support to enable the user to exercise continuously.

[0198] A "virtual reality device" is a device that generates a virtual space and allows users to have an interactive experience within it.

[0199] A "virtual space" is a virtual environment generated using virtual reality technology.

[0200] "Means for providing feedback on exercise form in real time" refers to a function that evaluates the user's form while they are exercising and provides immediate feedback.

[0201] "Form check" is the process of analyzing a user's physical movements during exercise and evaluating their accuracy.

[0202] This invention is a system that provides users with an optimal exercise menu based on their health condition and exercise goals, and supports them in exercising safely and effectively on a regular basis. This system is realized using a user terminal, a server, and an AI module.

[0203] User Device

[0204] user

[0205] First, the user installs the application on their device and launches it. On the screen that appears when the application is launched, they enter their profile information, such as their goal (muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in particular.

[0206] Terminal

[0207] The device receives these inputs and sends them to the server, where they are properly formatted and encrypted for security and privacy.

[0208] server

[0209] server

[0210] The server receives the user information sent from the device and stores it in a database. The server then sends the stored information to the AI ​​module, which then generates an optimal exercise menu based on the user information.

[0211] AI Module

[0212] The AI ​​module selects appropriate stretching, training videos, and exercise menus based on the user's goals and physical information. It also provides dietary advice and suggests supplements based on the user's areas for improvement. The generated menus and advice are then returned to the server and sent to the device.

[0213] Providing exercise menus and checking form

[0214] Terminal

[0215] The device receives exercise menus and dietary advice sent from the server and displays them to the user. It also notifies the user as needed to remind them to exercise. When the user exercises, the device captures their movements with a camera or virtual reality device, and the device receives the video and sends it back to the server.

[0216] server

[0217] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video and evaluates accuracy and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[0218] Ongoing support

[0219] Terminal

[0220] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides training in a virtual reality space and the ability to interact with other users to maintain ongoing motivation.

[0221] user

[0222] Users can use these features to continue exercising and stay motivated by training in a virtual reality space and exchanging ideas with other users.

[0223] Hardware and software used

[0224] Hardware

[0225] VR headset (e.g. Meta Quest 2)

[0226] Camera or VR tracking sensor

[0227] software

[0228] User Interface (UI): Unity or Unreal Engine

[0229] Database: MySQL or MongoDB

[0230] AI Module: TensorFlow or PyTorch

[0231] Video analysis module: OpenCV

[0232] Specific examples

[0233] For example, let's say a 45-year-old male user wants to improve his lower back pain. He puts on a VR headset, logs into "VirtualGym," and enters his personal information (goal: improve lower back pain, height: 175 cm, weight: 80 kg, area of ​​pain: lower back). This information is sent to the server, and the AI ​​module generates an optimal exercise menu. The user receives a reminder to exercise and follows the provided menu. He trains while receiving feedback in the virtual reality space, and is able to see any corrections to his form in real time.

[0234] Example of input prompt for generative AI model

[0235] Enter the following prompt into the AI ​​model:

[0236] User information: 45 years old, male, 175cm tall, 80kg weight, looking to improve lower back pain. What kind of exercise program would be suitable for me?

[0237] Based on this, the AI ​​generates stretches and training menus to improve lower back pain and provides a virtual fitness experience.

[0238] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0239] Step 1:

[0240] User registration and data entry

[0241] The user installs the application on their device and launches it. On the screen that appears when the application is launched, they enter their profile information, such as their exercise purpose (e.g., muscle training, improving posture, alleviating lower back pain, etc.), body type (e.g., height, weight), age, and areas they would like to improve or have pain in particular.

[0242] Input: Information such as purpose of exercise, body type, age, height, weight, and areas of pain

[0243] Output: Formatted user information data

[0244] Step 2:

[0245] Data transmission and storage

[0246] The device properly formats and encrypts the entered user information and sends it to the server, which stores it in a database.

[0247] Input: Formatted user information data

[0248] Output: User information stored in the database

[0249] Step 3:

[0250] Generate exercise menu

[0251] The server sends the user information stored in the AI ​​module. The AI ​​module generates an optimal exercise menu based on the received user information. For example, a prompt sentence is input: "45 years old, male, 175 cm tall, 80 kg weight, aiming to improve lower back pain. What kind of exercise menu would be suitable?" The AI ​​generates an exercise menu and dietary advice based on this.

[0252] Input: User information

[0253] Output: Exercise menu and dietary advice

[0254] Step 4:

[0255] Providing exercise menus and advice

[0256] The server sends the exercise menu and dietary advice received from the AI ​​module to the device, which receives it, displays it to the user, and sends notifications to remind the user to exercise.

[0257] Input: Exercise menu and dietary advice

[0258] Output: Exercise menu, dietary advice, and reminder notifications displayed on the user's device

[0259] Step 5:

[0260] Photograph and send your exercise form

[0261] When a user exercises, they use a VR headset or camera to record video of their movements, which is then sent back to the server.

[0262] Input: Video of the user's exercise form

[0263] Output: Video of the exercise form sent to the server

[0264] Step 6:

[0265] Form Analytics and Feedback

[0266] The server receives the submitted exercise form video and sends it to the AI ​​module. The AI ​​module analyzes the video, evaluates the accuracy of the form and areas for improvement, generates points to be corrected and a new exercise menu, and sends it to the device via the server.

[0267] Input: Video of the user's exercise form

[0268] Output: Form feedback and new exercise menu

[0269] Step 7:

[0270] Providing feedback and ongoing support

[0271] The device receives form feedback and new exercise menus sent from the server and notifies the user. It also provides training in a virtual space and the ability to interact with other users, helping to maintain user motivation.

[0272] Input: Form feedback, new exercise menu

[0273] Output: Feedback provided to the user, new exercise menus, and support within the virtual space

[0274] This allows users to receive real-time feedback, allowing them to continue exercising appropriately and maintain motivation.

[0275] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0276] This invention is a system that allows users to exercise safely and effectively on a continuous basis by generating an optimal exercise menu based on the user's health condition and exercise goals, and by combining it with an emotion engine that recognizes the user's emotions. This system is realized using a user terminal, a server, an AI module, and an emotion engine.

[0277] User Device

[0278] user

[0279] First, the user installs and launches the application on their device. On the screen that appears when the application is launched, the user enters profile information such as their goal (e.g., muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in. Furthermore, the emotion engine allows users to easily input their emotional state or recognize emotions using the camera function.

[0280] Terminal

[0281] The device receives these inputs and sends them to the server, where they are properly formatted and encrypted for security and privacy.

[0282] server

[0283] server

[0284] The server receives user information and emotion data sent from the device, stores it in a database, and then sends the stored information to an AI module for analysis.

[0285] Server (AI module)

[0286] The AI ​​module analyzes the user's goals, body type, age, pain points, and emotional state to generate an optimal exercise menu. It also provides dietary advice and suggests supplements to help achieve goals. Emotional data is used to adjust exercise menus and notification methods, taking into account the user's motivation and stress level.

[0287] Providing exercise menus and checking form

[0288] server

[0289] The generated exercise menu and dietary advice are stored in a database and sent to the device, where the data is re-encrypted.

[0290] Terminal

[0291] The device displays the exercise menu and dietary advice received from the server to the user. It also notifies the user as needed to remind them to exercise. The timing and content of notifications are adjusted according to the user's emotional state. When the user exercises, the device receives the video and sends it back to the server.

[0292] server

[0293] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video, assessing accuracy and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[0294] Ongoing support

[0295] Terminal

[0296] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides character reactions based on data from the emotion engine and the ability to interact with other users to maintain ongoing motivation.

[0297] user

[0298] Users can use these features to stay motivated by continuing to exercise and by developing their character and exchanging opinions with other users. The emotion engine adjusts the character's reactions and interactions with other users based on the user's emotional state, providing a more personalized experience.

[0299] Specific examples

[0300] For example, if a 34-year-old female user wants to improve her stiff shoulders, she enters her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). The emotion engine also provides information about her stress level and motivation for the day. This information is sent to the server, where it is analyzed by the AI ​​module and emotion engine to generate an optimal exercise menu for improving stiff shoulders.

[0301] When a user receives a reminder to exercise, they follow the provided exercise menu. To check their form, they record their movements as a video and send it to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In addition, an emotion engine displays appropriate advice and encouraging messages based on the user's emotional state that day.

[0302] In this way, the system of the present invention provides users with an optimal exercise menu and provides continuous support, effectively helping them maintain their health. Furthermore, by combining it with an emotion engine, the system can provide more personalized support and maintain the user's motivation.

[0303] The processing flow will be explained below.

[0304] Step 1: Enter user information and emotion data

[0305] user

[0306] Users install and launch the application on their device. On the first launch, they enter their profile information on the registration screen that appears, including their goal (e.g., muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they want to improve or have pain in. They can also enter their mood and stress level for the day, or use the camera function to recognize their emotions, using the emotion engine.

[0307] Step 2: Send user information and emotion data

[0308] Terminal

[0309] The terminal formats the information and emotion data entered by the user for transmission to the server, and appropriately encrypts the data before transmission.

[0310] Step 3: Storing user information and emotion data

[0311] server

[0312] The server receives user information and emotion data sent from the device and stores it in a database, after which it sends this information to the AI ​​module and emotion engine for analysis.

[0313] Step 4: Generate an exercise menu

[0314] Server (AI module and emotion engine)

[0315] The AI ​​module and emotion engine analyze the user's goals, body type, age, pain points, and emotional state to generate an optimal exercise menu. It also suggests dietary advice and supplements to help achieve goals. Emotional data is used to adjust exercise menus and notification methods, taking into account the user's motivation and stress level.

[0316] Step 5: Distribution of exercise menu

[0317] server

[0318] The generated exercise menu and dietary advice are stored in a database and prepared for transmission to the device, where the data is re-encrypted.

[0319] Step 6: View the exercise menu

[0320] Terminal

[0321] The device displays the exercise menu and dietary advice received from the server to the user. It also sends appropriate notifications to remind the user to exercise. The emotion engine adjusts the timing and content of notifications according to the user's emotional state.

[0322] Step 7: Video your exercise form

[0323] user

[0324] Users receive reminders and follow the instructions to exercise, while their movements are recorded with the device's camera.

[0325] Step 8: Submit your exercise form video

[0326] Terminal

[0327] The captured exercise form video is received, formatted for transmission to a server, and the data is encrypted before being transmitted.

[0328] Step 9: Analyze the video

[0329] Server (AI module)

[0330] The server receives the video and analyzes it using an AI module, which evaluates the exercise form and determines what corrections are needed.

[0331] Step 10: Generate improvement suggestions

[0332] Server (AI module)

[0333] Based on the results of form analysis, points that need to be corrected and new exercise menus are generated.

[0334] Step 11: Distributing improvement proposals

[0335] server

[0336] The generated improvement suggestions and new exercise menus are stored in a database and prepared for transmission to the device. The data is encrypted during transmission.

[0337] Step 12: Viewing improvement suggestions

[0338] Terminal

[0339] The device notifies the user of and displays improvement suggestions and new exercise menus received from the server.

[0340] Step 13: Support for continued exercise

[0341] Terminal

[0342] To make it easier for users to continue exercising, the app provides users with character reactions based on data from the emotion engine and the ability to interact with other users.

[0343] Step 14: Stay motivated

[0344] user

[0345] Users can maintain their motivation to exercise by developing their character and exchanging opinions with other users. The emotion engine displays appropriate encouragement messages and advice based on the user's emotional state that day, providing a personalized experience.

[0346] Specific examples

[0347] For example, if a 34-year-old female user wants to improve her stiff shoulders, she enters her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). The emotion engine also provides information about her stress level and motivation for the day. This information is sent to the server, where it is analyzed by the AI ​​module and emotion engine to generate an optimal exercise menu for improving stiff shoulders.

[0348] When a user receives a reminder to exercise, they follow the provided exercise menu. To check their form, they record their movements as a video and send it to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In addition, an emotion engine displays encouraging messages and suggestions for improvement based on the user's emotional state that day.

[0349] In this way, the system of the present invention provides users with an optimal exercise menu and provides continuous support, effectively helping them maintain their health. Furthermore, by combining it with an emotion engine, the system can provide more personalized support and maintain the user's motivation.

[0350] Example 2

[0351] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0352] Conventional exercise menu generation systems generate exercise menus based on the user's physical information, but do not take the user's emotional state into account, resulting in a lack of motivation maintenance and individualized notification content adjustment. Furthermore, while there are functions that point out differences in exercise form, they lack emotional support to support the user's continued motivation. This has led to the challenge of making it difficult for users to maintain their motivation to continue exercising.

[0353] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0354] In this invention, the server includes means for registering information about the user's body, means for generating an optimal exercise menu based on the registered information and the user's emotional state, means for notifying the user of the timing to perform the exercise menu, means for receiving videos of the user's exercise form and pointing out any discrepancies in form, means for supporting the user so that they can continue exercising, and means for adjusting the user's motivation and notification content based on emotion recognition. This makes it possible to provide a personalized exercise menu based on the user's individual physical information and emotional state, and to maintain continuous motivation.

[0355] "User" refers to a person who uses the system to create and implement an exercise menu.

[0356] "Physical information" refers to data about the user's goals, body type, age, height, weight, and pain points.

[0357] An "optimal exercise menu" is an exercise plan that is individually tailored based on the user's physical information and emotional state.

[0358] "Emotional state" refers to information that indicates a user's psychological state, such as their daily stress level and motivation.

[0359] "Notifications" are messages that inform users of the timing of exercise routines and other important notices.

[0360] "Exercise form video" refers to video data captured while a user is exercising.

[0361] "Form differences" refers to errors or discrepancies that occur between the correct exercise form and the user's actual exercise form.

[0362] "Support" refers to services and features that help users continue exercising.

[0363] "Emotion recognition" refers to technology that analyzes a user's emotional state.

[0364] "Motivation adjustment" refers to the process of changing and optimizing exercise menus and notifications based on the user's emotional state.

[0365] This invention is a system that allows users to exercise safely and effectively on a continuous basis by generating an optimal exercise menu based on the user's health condition and exercise goals, and by combining it with an emotion engine that recognizes the user's emotions. This system is realized using a user terminal, a server, an AI module, and an emotion engine.

[0366] User Device

[0367] user

[0368] First, the user installs and launches the application on their device. On the screen that appears when the application is launched, the user enters profile information such as the purpose of the exercise (e.g., muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas of particular interest or pain. Furthermore, the emotion engine allows for simple input of emotional state and recognition of emotions using the camera function.

[0369] Terminal

[0370] The device receives this input information and sends it to the server, where it properly formats the data and encrypts it to protect security and privacy.

[0371] server

[0372] server

[0373] The server receives user information and emotion data sent from the device, stores it in a database, and then sends the stored information to an AI module for analysis.

[0374] Server (AI module)

[0375] The AI ​​module analyzes the user's goals, body type, age, pain points, and emotional state to generate an optimal exercise menu. It also provides dietary advice and suggests supplements to help achieve goals. Emotional data is used to adjust exercise menus and notification methods, taking into account the user's motivation and stress level.

[0376] Providing exercise menus and checking form

[0377] server

[0378] The generated exercise menu and dietary advice are stored in a database and sent to the device, where the data is re-encrypted.

[0379] Terminal

[0380] The device displays the exercise menu and dietary advice received from the server to the user. It also notifies the user as needed to remind them to exercise. The timing and content of notifications are adjusted according to the user's emotional state. When the user exercises, the device receives the video and sends it back to the server.

[0381] server

[0382] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video, assessing accuracy and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[0383] Ongoing support

[0384] Terminal

[0385] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides character reactions based on data from the emotion engine and the ability to interact with other users to maintain ongoing motivation.

[0386] user

[0387] Users can use these features to stay motivated by continuing to exercise and by developing their character and exchanging opinions with other users. The emotion engine adjusts the character's reactions and interactions with other users based on the user's emotional state, providing a more personalized experience.

[0388] Specific examples

[0389] For example, if a 34-year-old female user wants to improve her stiff shoulders, she enters her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). The emotion engine also provides information about her stress level and motivation for the day. This information is sent to the server, where it is analyzed by the AI ​​module and emotion engine to generate an optimal exercise menu for improving stiff shoulders.

[0390] When a user receives a reminder to exercise, they follow the provided exercise menu. To check their form, they record their movements as a video and send it to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In addition, an emotion engine displays appropriate advice and encouraging messages based on the user's emotional state that day.

[0391] Example prompts for generative AI models

[0392] "Generate an exercise menu to improve shoulder stiffness for a woman in her 30s. The model is 160cm tall and weighs 55kg. Please also consider the stress level and motivation of the day."

[0393] In this way, the system of the present invention provides users with an optimal exercise menu and provides continuous support, effectively helping them maintain their health. Furthermore, by combining it with an emotion engine, the system can provide more personalized support and maintain the user's motivation.

[0394] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0395] Step 1:

[0396] Input: Profile information based on your health and fitness goals, and your emotional state

[0397] Specific operation:

[0398] After installing and launching the application, users enter their profile information, such as their exercise goals, body type, age, areas they want to improve, and areas of pain. Users also use the camera to capture their facial expressions or answer simple questions to provide their emotional state for the day (stress level and motivation).

[0399] Output: A dataset of the input profile information and emotional states

[0400] Step 2:

[0401] Input: The dataset of profile information and emotional states entered in step 1.

[0402] Specific operation:

[0403] The device converts the user input data into an appropriate format (e.g., JSON format), encrypts the data for security and privacy reasons, and then transmits it to the server using a secure communication protocol (e.g., HTTPS).

[0404] Output: Notification that encrypted profile information and emotional state data has been sent

[0405] Step 3:

[0406] Input: Encrypted profile information and emotional state data

[0407] Specific operation:

[0408] The server receives and decrypts the encrypted data sent by the device, verifies the received data to ensure its accuracy and consistency, and then stores it in a database, where it is prepared for analysis by the AI ​​module.

[0409] Output: Analysis-ready user information and emotional state data

[0410] Step 4:

[0411] Input: Analysis-ready user information and emotional state data

[0412] Specific operation:

[0413] The AI ​​module on the server analyzes the user's goals, body type, age, areas of pain, and emotional state, and uses various algorithms to generate the optimal exercise menu for the user. It also provides dietary advice and suggests supplements, and sets notification methods and timing that are best suited to the user based on their emotional state.

[0414] Output: Generated exercise menu, dietary advice, and notification settings data

[0415] Step 5:

[0416] Input: Generated exercise menu, dietary advice, and notification setting data

[0417] Specific operation:

[0418] The server stores the generated exercise menu and dietary advice in a database, encrypts the data again, and then transmits it to the terminal.

[0419] Output: Notification of completion of sending encrypted exercise menu and dietary advice data

[0420] Step 6:

[0421] Input: Encrypted exercise menu and dietary advice data

[0422] Specific operation:

[0423] The device decrypts the encrypted data received from the server and displays it to the user. Depending on the user's emotional state, the device adjusts the timing and content of reminder notifications and notifies the user appropriately.

[0424] Output: Exercise menu and dietary advice displayed on the user's screen

[0425] Step 7:

[0426] Input: Displayed exercise menu and dietary advice

[0427] Specific operation:

[0428] The user follows the exercise menu provided and performs the exercise. The camera records the user's movements during the exercise, encrypts the video, and sends it to the server via the device.

[0429] Output: Notification of completion of sending encrypted exercise form video data

[0430] Step 8:

[0431] Input: Encrypted exercise form video data

[0432] Specific operation:

[0433] The server receives and decodes the exercise form video data. The AI ​​module analyzes the video and evaluates the accuracy of the user's form and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[0434] Output: Analysis results and suggested corrections, new exercise menu

[0435] Step 9:

[0436] Input: Analysis results and suggested correction data, new exercise menu

[0437] Specific operation:

[0438] The device decodes the data received from the server and displays it to the user. It also provides character reactions and interaction with other users based on data from the emotion engine, helping to maintain motivation.

[0439] Output: Analysis results, suggested corrections, new exercise menus, and character reactions displayed on the user's screen

[0440] Step 10:

[0441] Input: Analysis results, suggested modifications, new movement menus and character reactions

[0442] Specific operation:

[0443] Users can continue exercising while referring to the displayed results, suggestions, and reactions of the character, and can maintain further motivation by using the function to interact with other users.

[0444] Output: Feedback data that encourages users to continue exercising and improve their health

[0445] (Application example 2)

[0446] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0447] In modern society, it is difficult for users to effectively continue exercising and eating to maintain their health. The objective of the present invention is to provide a system that supports healthy activities more effectively and continuously by providing optimal exercise and meal menus based on the user's health condition and exercise goals, and further adjusting notification methods and suggested content taking the user's emotional state into consideration.

[0448] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0449] In this invention, the server includes means for registering information about the user's body, means for generating optimal exercise and meal menus based on the registered information, means for notifying the user of the timing to perform the exercise and meal menus, means for receiving videos of exercise form taken by the user and pointing out differences in form, means for analyzing the user's emotional state using an emotion engine and adjusting the exercise and meal menus and notification method, and means for supporting the user to continue exercising and eating a healthy diet. This allows the user to effectively continue exercising and eating a healthy diet and receive individual support according to their emotional state in the process.

[0450] "User's physical information" refers to physiological data such as the user's body type, age, height, weight, and areas of pain.

[0451] "Exercise menu" refers to a series of training programs provided based on the user's health condition and exercise goals.

[0452] "Meal Menu" refers to an optimal meal plan suggested based on the user's health and emotional state.

[0453] An "emotion engine" refers to a software module that analyzes a user's facial expressions and input data to recognize their emotional state.

[0454] "Notification means" refers to a method or device for notifying the user of the timing of performing an exercise menu or meal menu.

[0455] "Exercise form video" refers to video data recorded by a user's own movements.

[0456] "Means for pointing out differences in form" refers to systems or algorithms that analyze videos of exercise form and point out errors in the user's movements and areas for improvement.

[0457] "Emotional state" refers to the user's psychological state, such as stress level and motivation.

[0458] "Support measures" refers to methods and systems that help users continue to exercise and eat healthy.

[0459] MODE FOR CARRYING OUT THE INVENTION

[0460] The present invention is a system that supports users' health activities by generating optimal exercise and meal menus based on the user's health condition and exercise goals, and adjusting the notification method and suggested content taking into account the user's emotional state, using a system that utilizes a user terminal, server, AI module, and emotion engine.

[0461] System configuration

[0462] User Device

[0463] The user device takes the form of a smartphone with a dedicated application installed, which includes the following functions:

[0464] 1. Data input: Users input their health information (goals, body type, age, height, weight, pain points, etc.), and then input or recognize their emotional state for the day through the emotion engine.

[0465] 2. Displaying exercise and meal menus: Displaying the exercise and meal menus sent from the server and sending reminder notifications to the user.

[0466] 3. Recording and sending video of exercise form: The user performs exercise, records the exercise as a video using the app's camera function, and sends the video to the server.

[0467] server

[0468] The server has the following features:

[0469] 1. Data reception and storage: Receives health information and emotion data sent from the user device and stores it in a database.

[0470] 2. Data analysis: The stored data is sent to the AI ​​module for analysis, and the optimal exercise and meal menus are generated based on the analysis results.

[0471] 3. Exercise form analysis: Analyzes exercise form videos submitted by users, identifies differences in form, and generates new exercise menus as needed.

[0472] 4. Data transmission: The generated exercise menu, meal menu, and form analysis results are sent to the user's device.

[0473] AI Module and Emotion Engine

[0474] The AI ​​module is built using machine learning frameworks such as TensorFlow and PyTorch. The emotion engine recognizes user emotions and provides them to the server as analysis data.

[0475] Processing flow and specific examples

[0476] 1. User Input:

[0477] A 45-year-old male user launches the app and enters his health information (goal: diet, height: 175 cm, weight: 80 kg).

[0478] It also uses an emotion engine to recognize your stress level for the day.

[0479] 2. Data transmission and analysis:

[0480] The user terminal encrypts the entered data and sends it to the server.

[0481] The server receives the data, analyzes it with an AI module, and generates optimal exercise and meal plans. For example, it suggests low-calorie, stress-relieving meals (e.g., tuna salad bowl, grilled chicken).

[0482] 3. Notifications and Reminders:

[0483] The menu and reminder notifications sent from the server are displayed on the user's device.

[0484] Send a reminder before lunch such as, "Great work! Why not try a macro-balanced tuna salad bowl today?"

[0485] 4. Exercise form feedback:

[0486] The user performs exercise, records the exercise as a video, and sends it to the server.

[0487] The server analyzes the video using an AI module, points out differences in form, and suggests new exercise menus.

[0488] Prompt Sentence Examples

[0489] Username: Yamada Taro

[0490] Age: 45

[0491] Purpose: Diet

[0492] Body type: Height 175cm, Weight 80kg

[0493] Allergies: None

[0494] Food preference: Japanese food, low calorie

[0495] Stress level: High

[0496] Question 1: Please suggest the best meal plan.

[0497] Question 2: What reminder message would you use to respond to high stress levels?

[0498] This allows users to effectively exercise and eat healthily, and receive personalized emotional support along the way.

[0499] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0500] Step 1:

[0501] User Input

[0502] The user launches the application on their device and inputs their health information (e.g., goals, body type, age, height, weight, pain points), and the emotion engine also inputs or recognizes their emotional state for the day (e.g., stress level, motivation) via the camera.

[0503] Input: Health information, emotional state

[0504] Output: Encrypted data packet

[0505] Specific behavior: The user fills out a form on the application screen and clicks the "Submit" button.

[0506] Step 2:

[0507] Data transmission

[0508] The device encrypts the entered health information and emotion data and transmits it to the server using a secure communication protocol (e.g., HTTPS).

[0509] Input: Encrypted data packet

[0510] Output: Data sent to server completed

[0511] Specific operation: Data is encrypted on the terminal side and sent to the server via the network.

[0512] Step 3:

[0513] Data Receipt and Storage

[0514] The server receives the data sent from the device and stores it in a database. When storing the data, it checks the consistency of the data format and eliminates any invalid data.

[0515] Input: Encrypted data packet

[0516] Output: Saved to database successfully

[0517] Specific operation: The server receives the data and stores it in the database.

[0518] Step 4:

[0519] Data analysis

[0520] The server sends the received data to an AI module, which generates optimal exercise and meal menus based on the user's health information and emotional state. The content of the meal menu and notification method are adjusted according to the user's emotional state.

[0521] Input: Health information, emotional state

[0522] Output: Exercise menu, meal menu

[0523] Specific operation: The AI ​​module analyzes the data and calculates the appropriate menu.

[0524] Step 5:

[0525] Send Menu

[0526] The server encrypts the generated exercise and meal menus and transmits them to the user terminal.

[0527] Input: Exercise menu, meal menu

[0528] Output: Encrypted menu data

[0529] Specific operation: The server packets the menu data and sends it to the terminal.

[0530] Step 6:

[0531] Menu display and reminders

[0532] The device displays the received exercise and meal menus to the user and sends reminder notifications at specified times.

[0533] Input: Encrypted menu data

[0534] Output: Display on user device, reminder notification

[0535] Specific operation: The device decodes the menu data and displays it in the user interface. It also sends a notification at the reminder time.

[0536] Step 7:

[0537] Photograph and submit your exercise form

[0538] The user performs exercise, takes pictures of the exercise using the device's camera function, and sends the pictures to the server.

[0539] Input: Exercise form video

[0540] Output: Encrypted video data

[0541] Specific actions: The user records a video of their exercise and clicks the "Send" button.

[0542] Step 8:

[0543] Form Analysis

[0544] The server uses an AI module to analyze the received video, pointing out any discrepancies in form and generating new exercise menus as needed.

[0545] Input: Exercise form video

[0546] Output: Form analysis results, new exercise menu

[0547] How it works: The AI ​​module analyzes the video and generates results.

[0548] Step 9:

[0549] Send Feedback

[0550] The server encrypts the analysis results and new exercise menu and sends them to the user's device.

[0551] Input: Form analysis results, new exercise menu

[0552] Output: Encrypted feedback data

[0553] Specific operation: The server encrypts the data and sends it to the device.

[0554] Step 10:

[0555] User Feedback

[0556] The device will notify the user of the results received and provide appropriate feedback, allowing the user to identify areas for improvement or new exercise routines.

[0557] Input: Encrypted feedback data

[0558] Output: Display on user terminal

[0559] Specific operation: The feedback data is decoded on the terminal and displayed on the user interface.

[0560] This series of processing steps allows users to continue optimal exercise and diet according to their health and emotional state, and allows them to engage in healthy activities while receiving appropriate feedback.

[0561] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0562] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0563] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0564] [Second embodiment]

[0565] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0566] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0567] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0568] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0569] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0570] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0571] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0572] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0573] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0574] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0575] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0576] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0577] The present invention is a system that provides users with an optimal exercise menu based on their health condition and exercise goals, and supports them in exercising safely and effectively on a regular basis. This system is realized using a user terminal, a server, and an AI module.

[0578] User Device

[0579] user

[0580] First, the user installs the application on their device and launches it. On the screen that appears when the application is launched, they enter their profile information, such as their goal (muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in particular.

[0581] Terminal

[0582] The device receives these inputs and sends them to the server, where they are properly formatted and encrypted for security and privacy.

[0583] server

[0584] server

[0585] The server receives the user information sent from the device and stores it in a database. The server then sends the stored information to the AI ​​module, which then generates an optimal exercise menu based on the user information.

[0586] Server (AI module)

[0587] The AI ​​module selects appropriate stretching, training videos, and exercise menus based on the user's goals and physical information. It also provides dietary advice and suggests supplements based on the user's areas for improvement. The generated menus and advice are then returned to the server and sent to the device.

[0588] Providing exercise menus and checking form

[0589] Terminal

[0590] The device receives the exercise menu and dietary advice sent from the server and displays it to the user. It also notifies the user as needed to remind them to exercise. When the user exercises, the device captures their movements with a camera, and the device receives the video and sends it back to the server.

[0591] server

[0592] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video and evaluates accuracy and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[0593] Ongoing support

[0594] Terminal

[0595] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides character development and interaction with other users to maintain ongoing motivation.

[0596] user

[0597] Users can use these features to continue exercising and maintain their motivation by developing their characters and exchanging opinions with other users.

[0598] Specific examples

[0599] For example, if a 34-year-old female user wants to improve her stiff shoulders, she can enter her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). This information is sent to the server, and the AI ​​module generates an optimal exercise menu to improve shoulder stiffness. It also suggests foods rich in B vitamins and supplements to supplement them.

[0600] When users receive a reminder to exercise, they follow the provided exercise menu. To check their form, the movements are recorded as a video and sent to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In this way, users can always continue exercising with the correct form, helping to alleviate shoulder stiffness.

[0601] In this way, the system of the present invention provides the user with an optimal exercise menu and provides continuous support, thereby effectively helping the user maintain their health.

[0602] The processing flow will be explained below.

[0603] Step 1: Enter your user information

[0604] user

[0605] The user installs the application on their device and launches it. On the registration screen that appears when the application is launched for the first time, the user enters profile information such as their purpose (e.g., muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in particular.

[0606] Step 2: Submit user information

[0607] Terminal

[0608] The terminal formats the information entered by the user for transmission to the server and appropriately encrypts the data before transmission.

[0609] Step 3: Save user information

[0610] server

[0611] The server receives user information sent from the device and stores it in a database, after which it sends this information to an AI module for analysis.

[0612] Step 4: Generate an exercise menu

[0613] Server (AI module)

[0614] The AI ​​module analyzes information such as the user's goals, body type, age, and areas of pain to create an optimal exercise menu. It also provides dietary advice and suggests supplements to help achieve goals.

[0615] Step 5: Distribution of exercise menu

[0616] server

[0617] The generated exercise menu and dietary advice are stored in a database and prepared for transmission to the device, where the data is re-encrypted.

[0618] Step 6: View the exercise menu

[0619] Terminal

[0620] The terminal displays the exercise menu and dietary advice received from the server to the user.

[0621] Step 7: Remind yourself to exercise

[0622] Terminal

[0623] Based on the user's schedule, reminders are sent for exercise.

[0624] Step 8: Video your exercise form

[0625] user

[0626] Users receive reminders and follow the instructions to exercise, while their movements are recorded with the device's camera.

[0627] Step 9: Submit your exercise form video

[0628] Terminal

[0629] The captured exercise form video is received, formatted for transmission to a server, and the data is encrypted before being transmitted.

[0630] Step 10: Analyze the video

[0631] Server (AI module)

[0632] The server receives the video and analyzes it using an AI module, which evaluates the exercise form and determines what corrections are needed.

[0633] Step 11: Generate improvement suggestions

[0634] Server (AI module)

[0635] Based on the results of form analysis, points that need to be corrected and new exercise menus are generated.

[0636] Step 12: Distributing improvement proposals

[0637] server

[0638] The generated improvement suggestions and new exercise menus are stored in a database and prepared for transmission to the device. The data is encrypted during transmission.

[0639] Step 13: Viewing improvement suggestions

[0640] Terminal

[0641] The device notifies the user of and displays improvement suggestions and new exercise menus received from the server.

[0642] Step 14: Support for continued exercise

[0643] Terminal

[0644] To make it easier for users to continue exercising, the app provides features for character development and interaction with other users.

[0645] Step 15: Stay motivated

[0646] user

[0647] Users maintain their motivation to exercise by developing their characters and exchanging opinions with other users.

[0648] Example 1

[0649] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0650] In modern society, an increasing number of people are experiencing a decline in their health due to lack of exercise or improper exercise form. It is particularly difficult to propose appropriate exercise programs tailored to individual health conditions and goals, and maintaining ongoing motivation is also a challenge. Furthermore, there is a lack of means to check the appropriateness of users' exercise form and provide feedback on areas for improvement. These issues need to be resolved.

[0651] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0652] In this invention, the server includes means for registering information about the user's body, means for encrypting the registered information and transmitting it to the server, means for generating an optimal exercise menu using an artificial intelligence module based on the registered information, means for notifying the timing of performing the exercise menu, means for receiving a video of the exercise form taken by the user and requesting form analysis, means for providing form improvements based on the analysis results, and means for generating and providing a new exercise menu based on the analysis results, thereby enabling the provision of an exercise menu that meets the individual needs of the user, form checks and improvements, and continuous motivation support.

[0653] "User" refers to an individual who uses the system to carry out exercise programs and manage their health.

[0654] "Physical Information" refers to personal health information, including your height, weight, age, goals, and areas of particular interest or pain.

[0655] "Encryption" refers to the process of transforming information using a specific algorithm to protect it from unauthorized access by third parties.

[0656] "Server" refers to a computer system that receives, stores, and processes information sent from a user terminal and interacts with an artificial intelligence module.

[0657] "Artificial intelligence module" refers to a system that includes a program for generating optimal exercise menus and dietary advice based on user information.

[0658] An "exercise menu" refers to a specific exercise or training plan that a user should undertake to maintain their health and achieve their goals.

[0659] "Notification" refers to a means of informing users of the timing of exercise and suggestions for improving their form.

[0660] "Exercise form video" refers to footage of a user filming themselves exercising.

[0661] "Analysis" refers to the process by which an artificial intelligence module evaluates exercise form videos to identify accuracy and areas for improvement.

[0662] "Form improvement points" refer to points that the user should correct in order to perform the exercise more accurately.

[0663] "Motivation support" refers to functions and services that enable users to continue exercising.

[0664] "Character growth function" refers to a function that allows a virtual character to grow as the user continues to exercise.

[0665] "Function for interacting with other users" refers to a function that allows users to exchange information and communicate with other system users.

[0666] The present invention is a system that provides users with an optimal exercise menu based on their health condition and exercise goals, and supports them in exercising safely and effectively on a regular basis. This system is realized using a user terminal, a server, and an AI module.

[0667] User Device

[0668] user:

[0669] First, the user installs the application on their device and launches it. On the screen that appears when the application is launched, the user enters profile information such as their goal (muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in particular.

[0670] Device:

[0671] The device receives the information entered by the user, properly formats the data, encrypts it, and sends it to the server, using encryption technology to ensure security and privacy during the process.

[0672] server

[0673] server:

[0674] The server receives the encrypted user information sent from the user terminal, decrypts the received data, stores it in a database, and then sends the stored information to the AI ​​module.

[0675] AI Module:

[0676] The AI ​​module generates optimal exercise menus, stretching videos, and dietary advice based on the user's goals and physical information. It also suggests supplements based on the user's areas for improvement. The generated exercise menus and advice are then sent back to the server and sent to the user's device.

[0677] Providing exercise menus and checking form

[0678] Device:

[0679] The device receives the exercise menu and dietary advice sent from the server and displays them to the user. It also notifies the user as needed to remind them to exercise. When the user exercises, the device captures their movements with a camera and receives the video and sends it back to the server.

[0680] server:

[0681] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video, assessing accuracy and areas for improvement. If necessary, it generates corrections and new exercise menus and sends them back to the device.

[0682] Ongoing support

[0683] Device:

[0684] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides character development and interaction with other users to maintain ongoing motivation.

[0685] user:

[0686] Users can use these features to continue exercising and maintain their motivation by developing their characters and exchanging opinions with other users.

[0687] Specific examples

[0688] For example, if a 34-year-old female user wants to improve her stiff shoulders, she can enter her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). This information is sent to the server, and the AI ​​module generates an optimal exercise menu to improve shoulder stiffness. It also suggests foods rich in B vitamins and supplements to supplement them.

[0689] When users receive a reminder to exercise, they follow the provided exercise menu. To check their form, the movements are recorded as a video and sent to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In this way, users can always continue exercising with the correct form, helping to alleviate shoulder stiffness.

[0690] Prompt Sentence Examples

[0691] "Please explain how an app works, suggesting exercises to improve shoulder stiffness for a 34-year-old woman. Please include specific input information and related dietary advice."

[0692] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0693] System program processing flow

[0694] Step 1:

[0695] A user installs and launches an application on a device. The first time the application is launched, the user is prompted to log in or register. Input includes a username, password, and any initial configuration information. Output is the application's home screen.

[0696] Step 2:

[0697] On the application's home screen, the user enters the purpose of their exercise (e.g., muscle training, improving posture, preventing stiff shoulders, etc.) and profile information (e.g., height, weight, age, areas they want to improve, areas of pain, etc.). The entered information is temporarily stored on the device. Inputs include the user's health status and personal information. As output, the entered data is temporarily stored in the device's local storage.

[0698] Step 3:

[0699] The terminal receives information entered by the user and formats and encrypts the data appropriately. User information entered is received in plain text, but is encrypted on output, ready to be sent to the server.

[0700] Step 4:

[0701] The terminal sends encrypted user information to the server. The data sent is encrypted to ensure security. The input contains the encrypted user information, and the output is the data sent to the server.

[0702] Step 5:

[0703] The server receives the encrypted data sent from the terminal. The server decrypts the received data and stores it in the database. The input contains the encrypted user information and the decrypted data is stored in the database. The output is the new user information stored in the database.

[0704] Step 6:

[0705] The server sends the stored user information to the AI ​​module. As input, it contains the user information stored in the database and sends the data to the AI ​​module. As output, it provides the data to the AI ​​module.

[0706] Step 7:

[0707] The AI ​​module generates optimal exercise menus and dietary advice based on the user's goals and physical information. Data processing involves generating stretching videos and exercise menus based on the user's input information. User information is included as input, and the generated exercise menus and dietary advice are returned to the server as output.

[0708] Step 8:

[0709] The server receives the exercise menu and dietary advice generated by the AI ​​module and sends it to the user's device. The input contains the data generated by the AI, and the output is sent to the user's device.

[0710] Step 9:

[0711] The device receives exercise menus and dietary advice from the server and displays them to the user. It also sends notifications to remind the user to exercise. The input contains the data sent from the server and the output is displayed to the user.

[0712] Step 10:

[0713] The user exercises based on the displayed exercise menu, and records their movements with the camera. The input includes the user's exercise and the recorded video, and the output is the video saved on the device.

[0714] Step 11:

[0715] The device receives the captured video and sends it to the server. The input includes the captured video of the exercise form, and the video is sent to the server as the output.

[0716] Step 12:

[0717] The server receives the video sent by the user and requests the AI ​​module to analyze it. The video data is included as input and an analysis request is sent to the AI ​​module. As output, data for form analysis is provided to the AI ​​module.

[0718] Step 13:

[0719] The AI ​​module analyzes the user's form based on the video sent to it, assessing accuracy and areas for improvement. A posture analysis algorithm is used for data calculations. The input is the video data, and the output is the analysis results.

[0720] Step 14:

[0721] The AI ​​module generates correction points and new exercise menus based on the results of form analysis and sends them to the server. The form analysis results are included as input, and the new exercise menus and correction suggestions are sent to the server as output.

[0722] Step 15:

[0723] The server receives new exercise menus and modification suggestions from the AI ​​module and sends them to the user's device. The input contains the new exercise menus and modification suggestions, and the output contains the data sent to the user's device.

[0724] Step 16:

[0725] The terminal notifies and displays the improvement suggestions and new exercise menus sent from the server to the user.The new exercise menus and correction suggestions are included as inputs and displayed to the user as outputs.

[0726] Step 17:

[0727] The device provides motivational support to help users continue exercising. This includes character development and interaction with other users. Inputs include data sent from the server and the user's exercise history, and outputs provide functions to maintain the user's motivation.

[0728] Prompt Sentence Examples

[0729] "Please explain how an app works, suggesting exercises to improve shoulder stiffness for a 34-year-old woman. Please include specific input information and related dietary advice."

[0730] (Application example 1)

[0731] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0732] Conventional exercise support systems provide optimal exercise menus based on the user's health condition and exercise goals, but it is difficult to obtain real-time feedback during actual training, making it difficult to quickly correct errors in form. There are also challenges in maintaining motivation, making it difficult to continue exercising sustainably. In particular, in a home training environment, it is difficult to receive proper form guidance, making it difficult to achieve effective exercise.

[0733] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0734] In this invention, the server includes means for registering information about the user's body, means for generating an optimal exercise menu based on the registered information, means for notifying the user of the timing of performing the exercise menu, means for receiving videos of the user's exercise form and pointing out any discrepancies in form, means for supporting the user so that they can continue exercising, and means for providing training in a virtual space using a virtual reality device and providing real-time feedback on exercise form. This allows users to train effectively at home or anywhere they like while receiving real-time feedback, enabling them to continue exercising consistently. Furthermore, training in a virtual space can increase motivation and ensure proper form.

[0735] "User's physical information" includes information about the user's purpose, body type, age, height, weight, and pain points.

[0736] An "exercise menu" is training content generated based on the user's physical information and exercise goals.

[0737] The "means for notifying the timing of the exercise" has a function of notifying the user of the time to perform the exercise menu.

[0738] An "exercise form video" is a video recording of a user exercising.

[0739] The "means for pointing out differences in form" is a function that evaluates the user's exercise form and points out errors and areas for improvement.

[0740] The "means for supporting continuation" has the function of providing support to enable the user to exercise continuously.

[0741] A "virtual reality device" is a device that generates a virtual space and allows users to have an interactive experience within it.

[0742] A "virtual space" is a virtual environment generated using virtual reality technology.

[0743] "Means for providing feedback on exercise form in real time" refers to a function that evaluates the user's form while they are exercising and provides immediate feedback.

[0744] "Form check" is the process of analyzing a user's physical movements during exercise and evaluating their accuracy.

[0745] This invention is a system that provides users with an optimal exercise menu based on their health condition and exercise goals, and supports them in exercising safely and effectively on a regular basis. This system is realized using a user terminal, a server, and an AI module.

[0746] User Device

[0747] user

[0748] First, the user installs the application on their device and launches it. On the screen that appears when the application is launched, they enter their profile information, such as their goal (muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in particular.

[0749] Terminal

[0750] The device receives these inputs and sends them to the server, where they are properly formatted and encrypted for security and privacy.

[0751] server

[0752] server

[0753] The server receives the user information sent from the device and stores it in a database. The server then sends the stored information to the AI ​​module, which then generates an optimal exercise menu based on the user information.

[0754] AI Module

[0755] The AI ​​module selects appropriate stretching, training videos, and exercise menus based on the user's goals and physical information. It also provides dietary advice and suggests supplements based on the user's areas for improvement. The generated menus and advice are then returned to the server and sent to the device.

[0756] Providing exercise menus and checking form

[0757] Terminal

[0758] The device receives exercise menus and dietary advice sent from the server and displays them to the user. It also notifies the user as needed to remind them to exercise. When the user exercises, the device captures their movements with a camera or virtual reality device, and the device receives the video and sends it back to the server.

[0759] server

[0760] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video and evaluates accuracy and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[0761] Ongoing support

[0762] Terminal

[0763] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides training in a virtual reality space and the ability to interact with other users to maintain ongoing motivation.

[0764] user

[0765] Users can use these features to continue exercising and stay motivated by training in a virtual reality space and exchanging ideas with other users.

[0766] Hardware and software used

[0767] Hardware

[0768] VR headset (e.g. Meta Quest 2)

[0769] Camera or VR tracking sensor

[0770] software

[0771] User Interface (UI): Unity or Unreal Engine

[0772] Database: MySQL or MongoDB

[0773] AI Module: TensorFlow or PyTorch

[0774] Video analysis module: OpenCV

[0775] Specific examples

[0776] For example, let's say a 45-year-old male user wants to improve his lower back pain. He puts on a VR headset, logs into "VirtualGym," and enters his personal information (goal: improve lower back pain, height: 175 cm, weight: 80 kg, area of ​​pain: lower back). This information is sent to the server, and the AI ​​module generates an optimal exercise menu. The user receives a reminder to exercise and follows the provided menu. He trains while receiving feedback in the virtual reality space, and is able to see any corrections to his form in real time.

[0777] Example of input prompt for generative AI model

[0778] Enter the following prompt into the AI ​​model:

[0779] User information: 45 years old, male, 175cm tall, 80kg weight, looking to improve lower back pain. What kind of exercise program would be suitable for me?

[0780] Based on this, the AI ​​generates stretches and training menus to improve lower back pain and provides a virtual fitness experience.

[0781] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0782] Step 1:

[0783] User registration and data entry

[0784] The user installs the application on their device and launches it. On the screen that appears when the application is launched, they enter their profile information, such as their exercise purpose (e.g., muscle training, improving posture, alleviating lower back pain, etc.), body type (e.g., height, weight), age, and areas they would like to improve or have pain in particular.

[0785] Input: Information such as purpose of exercise, body type, age, height, weight, and areas of pain

[0786] Output: Formatted user information data

[0787] Step 2:

[0788] Data transmission and storage

[0789] The device properly formats and encrypts the entered user information and sends it to the server, which stores it in a database.

[0790] Input: Formatted user information data

[0791] Output: User information stored in the database

[0792] Step 3:

[0793] Generate exercise menu

[0794] The server sends the user information stored in the AI ​​module. The AI ​​module generates an optimal exercise menu based on the received user information. For example, a prompt sentence is input: "45 years old, male, 175 cm tall, 80 kg weight, aiming to improve lower back pain. What kind of exercise menu would be suitable?" The AI ​​generates an exercise menu and dietary advice based on this.

[0795] Input: User information

[0796] Output: Exercise menu and dietary advice

[0797] Step 4:

[0798] Providing exercise menus and advice

[0799] The server sends the exercise menu and dietary advice received from the AI ​​module to the device, which receives it, displays it to the user, and sends notifications to remind the user to exercise.

[0800] Input: Exercise menu and dietary advice

[0801] Output: Exercise menu, dietary advice, and reminder notifications displayed on the user's device

[0802] Step 5:

[0803] Photograph and send your exercise form

[0804] When a user exercises, they use a VR headset or camera to record video of their movements, which is then sent back to the server.

[0805] Input: Video of the user's exercise form

[0806] Output: Video of the exercise form sent to the server

[0807] Step 6:

[0808] Form Analytics and Feedback

[0809] The server receives the submitted exercise form video and sends it to the AI ​​module. The AI ​​module analyzes the video, evaluates the accuracy of the form and areas for improvement, generates points to be corrected and a new exercise menu, and sends it to the device via the server.

[0810] Input: Video of the user's exercise form

[0811] Output: Form feedback and new exercise menu

[0812] Step 7:

[0813] Providing feedback and ongoing support

[0814] The device receives form feedback and new exercise menus sent from the server and notifies the user. It also provides training in a virtual space and the ability to interact with other users, helping to maintain user motivation.

[0815] Input: Form feedback, new exercise menu

[0816] Output: Feedback provided to the user, new exercise menus, and support within the virtual space

[0817] This allows users to receive real-time feedback, allowing them to continue exercising appropriately and maintain motivation.

[0818] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0819] This invention is a system that allows users to exercise safely and effectively on a continuous basis by generating an optimal exercise menu based on the user's health condition and exercise goals, and by combining it with an emotion engine that recognizes the user's emotions. This system is realized using a user terminal, a server, an AI module, and an emotion engine.

[0820] User Device

[0821] user

[0822] First, the user installs and launches the application on their device. On the screen that appears when the application is launched, the user enters profile information such as their goal (e.g., muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in. Furthermore, the emotion engine allows users to easily input their emotional state or recognize emotions using the camera function.

[0823] Terminal

[0824] The device receives these inputs and sends them to the server, where they are properly formatted and encrypted for security and privacy.

[0825] server

[0826] server

[0827] The server receives user information and emotion data sent from the device, stores it in a database, and then sends the stored information to an AI module for analysis.

[0828] Server (AI module)

[0829] The AI ​​module analyzes the user's goals, body type, age, pain points, and emotional state to generate an optimal exercise menu. It also provides dietary advice and suggests supplements to help achieve goals. Emotional data is used to adjust exercise menus and notification methods, taking into account the user's motivation and stress level.

[0830] Providing exercise menus and checking form

[0831] server

[0832] The generated exercise menu and dietary advice are stored in a database and sent to the device, where the data is re-encrypted.

[0833] Terminal

[0834] The device displays the exercise menu and dietary advice received from the server to the user. It also notifies the user as needed to remind them to exercise. The timing and content of notifications are adjusted according to the user's emotional state. When the user exercises, the device receives the video and sends it back to the server.

[0835] server

[0836] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video, assessing accuracy and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[0837] Ongoing support

[0838] Terminal

[0839] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides character reactions based on data from the emotion engine and the ability to interact with other users to maintain ongoing motivation.

[0840] user

[0841] Users can use these features to stay motivated by continuing to exercise and by developing their character and exchanging opinions with other users. The emotion engine adjusts the character's reactions and interactions with other users based on the user's emotional state, providing a more personalized experience.

[0842] Specific examples

[0843] For example, if a 34-year-old female user wants to improve her stiff shoulders, she enters her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). The emotion engine also provides information about her stress level and motivation for the day. This information is sent to the server, where it is analyzed by the AI ​​module and emotion engine to generate an optimal exercise menu for improving stiff shoulders.

[0844] When a user receives a reminder to exercise, they follow the provided exercise menu. To check their form, they record their movements as a video and send it to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In addition, an emotion engine displays appropriate advice and encouraging messages based on the user's emotional state that day.

[0845] In this way, the system of the present invention provides users with an optimal exercise menu and provides continuous support, effectively helping them maintain their health. Furthermore, by combining it with an emotion engine, the system can provide more personalized support and maintain the user's motivation.

[0846] The processing flow will be explained below.

[0847] Step 1: Enter user information and emotion data

[0848] user

[0849] Users install and launch the application on their device. On the first launch, they enter their profile information on the registration screen that appears, including their goal (e.g., muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they want to improve or have pain in. They can also enter their mood and stress level for the day, or use the camera function to recognize their emotions, using the emotion engine.

[0850] Step 2: Send user information and emotion data

[0851] Terminal

[0852] The terminal formats the information and emotion data entered by the user for transmission to the server, and appropriately encrypts the data before transmission.

[0853] Step 3: Storing user information and emotion data

[0854] server

[0855] The server receives user information and emotion data sent from the device and stores it in a database, after which it sends this information to the AI ​​module and emotion engine for analysis.

[0856] Step 4: Generate an exercise menu

[0857] Server (AI module and emotion engine)

[0858] The AI ​​module and emotion engine analyze the user's goals, body type, age, pain points, and emotional state to generate an optimal exercise menu. It also suggests dietary advice and supplements to help achieve goals. Emotional data is used to adjust exercise menus and notification methods, taking into account the user's motivation and stress level.

[0859] Step 5: Distribution of exercise menu

[0860] server

[0861] The generated exercise menu and dietary advice are stored in a database and prepared for transmission to the device, where the data is re-encrypted.

[0862] Step 6: View the exercise menu

[0863] Terminal

[0864] The device displays the exercise menu and dietary advice received from the server to the user. It also sends appropriate notifications to remind the user to exercise. The emotion engine adjusts the timing and content of notifications according to the user's emotional state.

[0865] Step 7: Video your exercise form

[0866] user

[0867] Users receive reminders and follow the instructions to exercise, while their movements are recorded with the device's camera.

[0868] Step 8: Submit your exercise form video

[0869] Terminal

[0870] The captured exercise form video is received, formatted for transmission to a server, and the data is encrypted before being transmitted.

[0871] Step 9: Analyze the video

[0872] Server (AI module)

[0873] The server receives the video and analyzes it using an AI module, which evaluates the exercise form and determines what corrections are needed.

[0874] Step 10: Generate improvement suggestions

[0875] Server (AI module)

[0876] Based on the results of form analysis, points that need to be corrected and new exercise menus are generated.

[0877] Step 11: Distributing improvement proposals

[0878] server

[0879] The generated improvement suggestions and new exercise menus are stored in a database and prepared for transmission to the device. The data is encrypted during transmission.

[0880] Step 12: Viewing improvement suggestions

[0881] Terminal

[0882] The device notifies the user of and displays improvement suggestions and new exercise menus received from the server.

[0883] Step 13: Support for continued exercise

[0884] Terminal

[0885] To make it easier for users to continue exercising, the app provides users with character reactions based on data from the emotion engine and the ability to interact with other users.

[0886] Step 14: Stay motivated

[0887] user

[0888] Users can maintain their motivation to exercise by developing their character and exchanging opinions with other users. The emotion engine displays appropriate encouragement messages and advice based on the user's emotional state that day, providing a personalized experience.

[0889] Specific examples

[0890] For example, if a 34-year-old female user wants to improve her stiff shoulders, she enters her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). The emotion engine also provides information about her stress level and motivation for the day. This information is sent to the server, where it is analyzed by the AI ​​module and emotion engine to generate an optimal exercise menu for improving stiff shoulders.

[0891] When a user receives a reminder to exercise, they follow the provided exercise menu. To check their form, they record their movements as a video and send it to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In addition, an emotion engine displays encouraging messages and suggestions for improvement based on the user's emotional state that day.

[0892] In this way, the system of the present invention provides users with an optimal exercise menu and provides continuous support, effectively helping them maintain their health. Furthermore, by combining it with an emotion engine, the system can provide more personalized support and maintain the user's motivation.

[0893] Example 2

[0894] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0895] Conventional exercise menu generation systems generate exercise menus based on the user's physical information, but do not take the user's emotional state into account, resulting in a lack of motivation maintenance and individualized notification content adjustment. Furthermore, while there are functions that point out differences in exercise form, they lack emotional support to support the user's continued motivation. This has led to the challenge of making it difficult for users to maintain their motivation to continue exercising.

[0896] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0897] In this invention, the server includes means for registering information about the user's body, means for generating an optimal exercise menu based on the registered information and the user's emotional state, means for notifying the user of the timing to perform the exercise menu, means for receiving videos of the user's exercise form and pointing out any discrepancies in form, means for supporting the user so that they can continue exercising, and means for adjusting the user's motivation and notification content based on emotion recognition. This makes it possible to provide a personalized exercise menu based on the user's individual physical information and emotional state, and to maintain continuous motivation.

[0898] "User" refers to a person who uses the system to create and implement an exercise menu.

[0899] "Physical information" refers to data about the user's goals, body type, age, height, weight, and pain points.

[0900] An "optimal exercise menu" is an exercise plan that is individually tailored based on the user's physical information and emotional state.

[0901] "Emotional state" refers to information that indicates a user's psychological state, such as their daily stress level and motivation.

[0902] "Notifications" are messages that inform users of the timing of exercise routines and other important notices.

[0903] "Exercise form video" refers to video data captured while a user is exercising.

[0904] "Form differences" refers to errors or discrepancies that occur between the correct exercise form and the user's actual exercise form.

[0905] "Support" refers to services and features that help users continue exercising.

[0906] "Emotion recognition" refers to technology that analyzes a user's emotional state.

[0907] "Motivation adjustment" refers to the process of changing and optimizing exercise menus and notifications based on the user's emotional state.

[0908] This invention is a system that allows users to exercise safely and effectively on a continuous basis by generating an optimal exercise menu based on the user's health condition and exercise goals, and by combining it with an emotion engine that recognizes the user's emotions. This system is realized using a user terminal, a server, an AI module, and an emotion engine.

[0909] User Device

[0910] user

[0911] First, the user installs and launches the application on their device. On the screen that appears when the application is launched, the user enters profile information such as the purpose of the exercise (e.g., muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas of particular interest or pain. Furthermore, the emotion engine allows for simple input of emotional state and recognition of emotions using the camera function.

[0912] Terminal

[0913] The device receives this input information and sends it to the server, where it properly formats the data and encrypts it to protect security and privacy.

[0914] server

[0915] server

[0916] The server receives user information and emotion data sent from the device, stores it in a database, and then sends the stored information to an AI module for analysis.

[0917] Server (AI module)

[0918] The AI ​​module analyzes the user's goals, body type, age, pain points, and emotional state to generate an optimal exercise menu. It also provides dietary advice and suggests supplements to help achieve goals. Emotional data is used to adjust exercise menus and notification methods, taking into account the user's motivation and stress level.

[0919] Providing exercise menus and checking form

[0920] server

[0921] The generated exercise menu and dietary advice are stored in a database and sent to the device, where the data is re-encrypted.

[0922] Terminal

[0923] The device displays the exercise menu and dietary advice received from the server to the user. It also notifies the user as needed to remind them to exercise. The timing and content of notifications are adjusted according to the user's emotional state. When the user exercises, the device receives the video and sends it back to the server.

[0924] server

[0925] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video, assessing accuracy and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[0926] Ongoing support

[0927] Terminal

[0928] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides character reactions based on data from the emotion engine and the ability to interact with other users to maintain ongoing motivation.

[0929] user

[0930] Users can use these features to stay motivated by continuing to exercise and by developing their character and exchanging opinions with other users. The emotion engine adjusts the character's reactions and interactions with other users based on the user's emotional state, providing a more personalized experience.

[0931] Specific examples

[0932] For example, if a 34-year-old female user wants to improve her stiff shoulders, she enters her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). The emotion engine also provides information about her stress level and motivation for the day. This information is sent to the server, where it is analyzed by the AI ​​module and emotion engine to generate an optimal exercise menu for improving stiff shoulders.

[0933] When a user receives a reminder to exercise, they follow the provided exercise menu. To check their form, they record their movements as a video and send it to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In addition, an emotion engine displays appropriate advice and encouraging messages based on the user's emotional state that day.

[0934] Example prompts for generative AI models

[0935] "Generate an exercise menu to improve shoulder stiffness for a woman in her 30s. The model is 160cm tall and weighs 55kg. Please also consider the stress level and motivation of the day."

[0936] In this way, the system of the present invention provides users with an optimal exercise menu and provides continuous support, effectively helping them maintain their health. Furthermore, by combining it with an emotion engine, the system can provide more personalized support and maintain the user's motivation.

[0937] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0938] Step 1:

[0939] Input: Profile information based on your health and fitness goals, and your emotional state

[0940] Specific operation:

[0941] After installing and launching the application, users enter their profile information, such as their exercise goals, body type, age, areas they want to improve, and areas of pain. Users also use the camera to capture their facial expressions or answer simple questions to provide their emotional state for the day (stress level and motivation).

[0942] Output: A dataset of the input profile information and emotional states

[0943] Step 2:

[0944] Input: The dataset of profile information and emotional states entered in step 1.

[0945] Specific operation:

[0946] The device converts the user input data into an appropriate format (e.g., JSON format), encrypts the data for security and privacy reasons, and then transmits it to the server using a secure communication protocol (e.g., HTTPS).

[0947] Output: Notification that encrypted profile information and emotional state data has been sent

[0948] Step 3:

[0949] Input: Encrypted profile information and emotional state data

[0950] Specific operation:

[0951] The server receives and decrypts the encrypted data sent by the device, verifies the received data to ensure its accuracy and consistency, and then stores it in a database, where it is prepared for analysis by the AI ​​module.

[0952] Output: Analysis-ready user information and emotional state data

[0953] Step 4:

[0954] Input: Analysis-ready user information and emotional state data

[0955] Specific operation:

[0956] The AI ​​module on the server analyzes the user's goals, body type, age, areas of pain, and emotional state, and uses various algorithms to generate the optimal exercise menu for the user. It also provides dietary advice and suggests supplements, and sets notification methods and timing that are best suited to the user based on their emotional state.

[0957] Output: Generated exercise menu, dietary advice, and notification settings data

[0958] Step 5:

[0959] Input: Generated exercise menu, dietary advice, and notification setting data

[0960] Specific operation:

[0961] The server stores the generated exercise menu and dietary advice in a database, encrypts the data again, and then transmits it to the terminal.

[0962] Output: Notification of completion of sending encrypted exercise menu and dietary advice data

[0963] Step 6:

[0964] Input: Encrypted exercise menu and dietary advice data

[0965] Specific operation:

[0966] The device decrypts the encrypted data received from the server and displays it to the user. Depending on the user's emotional state, the device adjusts the timing and content of reminder notifications and notifies the user appropriately.

[0967] Output: Exercise menu and dietary advice displayed on the user's screen

[0968] Step 7:

[0969] Input: Displayed exercise menu and dietary advice

[0970] Specific operation:

[0971] The user follows the exercise menu provided and performs the exercise. The camera records the user's movements during the exercise, encrypts the video, and sends it to the server via the device.

[0972] Output: Notification of completion of sending encrypted exercise form video data

[0973] Step 8:

[0974] Input: Encrypted exercise form video data

[0975] Specific operation:

[0976] The server receives and decodes the exercise form video data. The AI ​​module analyzes the video and evaluates the accuracy of the user's form and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[0977] Output: Analysis results and suggested corrections, new exercise menu

[0978] Step 9:

[0979] Input: Analysis results and suggested correction data, new exercise menu

[0980] Specific operation:

[0981] The device decodes the data received from the server and displays it to the user. It also provides character reactions and interaction with other users based on data from the emotion engine, helping to maintain motivation.

[0982] Output: Analysis results, suggested corrections, new exercise menus, and character reactions displayed on the user's screen

[0983] Step 10:

[0984] Input: Analysis results, suggested modifications, new movement menus and character reactions

[0985] Specific operation:

[0986] Users can continue exercising while referring to the displayed results, suggestions, and reactions of the character, and can maintain further motivation by using the function to interact with other users.

[0987] Output: Feedback data that encourages users to continue exercising and improve their health

[0988] (Application example 2)

[0989] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0990] In modern society, it is difficult for users to effectively continue exercising and eating to maintain their health. The objective of the present invention is to provide a system that supports healthy activities more effectively and continuously by providing optimal exercise and meal menus based on the user's health condition and exercise goals, and further adjusting notification methods and suggested content taking the user's emotional state into consideration.

[0991] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0992] In this invention, the server includes means for registering information about the user's body, means for generating optimal exercise and meal menus based on the registered information, means for notifying the user of the timing to perform the exercise and meal menus, means for receiving videos of exercise form taken by the user and pointing out differences in form, means for analyzing the user's emotional state using an emotion engine and adjusting the exercise and meal menus and notification method, and means for supporting the user to continue exercising and eating a healthy diet. This allows the user to effectively continue exercising and eating a healthy diet and receive individual support according to their emotional state in the process.

[0993] "User's physical information" refers to physiological data such as the user's body type, age, height, weight, and areas of pain.

[0994] "Exercise menu" refers to a series of training programs provided based on the user's health condition and exercise goals.

[0995] "Meal Menu" refers to an optimal meal plan suggested based on the user's health and emotional state.

[0996] An "emotion engine" refers to a software module that analyzes a user's facial expressions and input data to recognize their emotional state.

[0997] "Notification means" refers to a method or device for notifying the user of the timing of performing an exercise menu or meal menu.

[0998] "Exercise form video" refers to video data recorded by a user's own movements.

[0999] "Means for pointing out differences in form" refers to systems or algorithms that analyze videos of exercise form and point out errors in the user's movements and areas for improvement.

[1000] "Emotional state" refers to the user's psychological state, such as stress level and motivation.

[1001] "Support measures" refers to methods and systems that help users continue to exercise and eat healthy.

[1002] MODE FOR CARRYING OUT THE INVENTION

[1003] The present invention is a system that supports users' health activities by generating optimal exercise and meal menus based on the user's health condition and exercise goals, and adjusting the notification method and suggested content taking into account the user's emotional state, using a system that utilizes a user terminal, server, AI module, and emotion engine.

[1004] System configuration

[1005] User Device

[1006] The user device takes the form of a smartphone with a dedicated application installed, which includes the following functions:

[1007] 1. Data input: Users input their health information (goals, body type, age, height, weight, pain points, etc.), and then input or recognize their emotional state for the day through the emotion engine.

[1008] 2. Displaying exercise and meal menus: Displaying the exercise and meal menus sent from the server and sending reminder notifications to the user.

[1009] 3. Recording and sending video of exercise form: The user performs exercise, records the exercise as a video using the app's camera function, and sends the video to the server.

[1010] server

[1011] The server has the following features:

[1012] 1. Data reception and storage: Receives health information and emotion data sent from the user device and stores it in a database.

[1013] 2. Data analysis: The stored data is sent to the AI ​​module for analysis, and the optimal exercise and meal menus are generated based on the analysis results.

[1014] 3. Exercise form analysis: Analyzes exercise form videos submitted by users, identifies differences in form, and generates new exercise menus as needed.

[1015] 4. Data transmission: The generated exercise menu, meal menu, and form analysis results are sent to the user's device.

[1016] AI Module and Emotion Engine

[1017] The AI ​​module is built using machine learning frameworks such as TensorFlow and PyTorch. The emotion engine recognizes user emotions and provides them to the server as analysis data.

[1018] Processing flow and specific examples

[1019] 1. User Input:

[1020] A 45-year-old male user launches the app and enters his health information (goal: diet, height: 175 cm, weight: 80 kg).

[1021] It also uses an emotion engine to recognize your stress level for the day.

[1022] 2. Data transmission and analysis:

[1023] The user terminal encrypts the entered data and sends it to the server.

[1024] The server receives the data, analyzes it with an AI module, and generates optimal exercise and meal plans. For example, it suggests low-calorie, stress-relieving meals (e.g., tuna salad bowl, grilled chicken).

[1025] 3. Notifications and Reminders:

[1026] The menu and reminder notifications sent from the server are displayed on the user's device.

[1027] Send a reminder before lunch such as, "Great work! Why not try a macro-balanced tuna salad bowl today?"

[1028] 4. Exercise form feedback:

[1029] The user performs exercise, records the exercise as a video, and sends it to the server.

[1030] The server analyzes the video using an AI module, points out differences in form, and suggests new exercise menus.

[1031] Prompt Sentence Examples

[1032] Username: Yamada Taro

[1033] Age: 45

[1034] Purpose: Diet

[1035] Body type: Height 175cm, Weight 80kg

[1036] Allergies: None

[1037] Food preference: Japanese food, low calorie

[1038] Stress level: High

[1039] Question 1: Please suggest the best meal plan.

[1040] Question 2: What reminder message would you use to respond to high stress levels?

[1041] This allows users to effectively exercise and eat healthily, and receive personalized emotional support along the way.

[1042] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1043] Step 1:

[1044] User Input

[1045] The user launches the application on their device and inputs their health information (e.g., goals, body type, age, height, weight, pain points), and the emotion engine also inputs or recognizes their emotional state for the day (e.g., stress level, motivation) via the camera.

[1046] Input: Health information, emotional state

[1047] Output: Encrypted data packet

[1048] Specific behavior: The user fills out a form on the application screen and clicks the "Submit" button.

[1049] Step 2:

[1050] Data transmission

[1051] The device encrypts the entered health information and emotion data and transmits it to the server using a secure communication protocol (e.g., HTTPS).

[1052] Input: Encrypted data packet

[1053] Output: Data sent to server completed

[1054] Specific operation: Data is encrypted on the terminal side and sent to the server via the network.

[1055] Step 3:

[1056] Data Receipt and Storage

[1057] The server receives the data sent from the device and stores it in a database. When storing the data, it checks the consistency of the data format and eliminates any invalid data.

[1058] Input: Encrypted data packet

[1059] Output: Saved to database successfully

[1060] Specific operation: The server receives the data and stores it in the database.

[1061] Step 4:

[1062] Data analysis

[1063] The server sends the received data to an AI module, which generates optimal exercise and meal menus based on the user's health information and emotional state. The content of the meal menu and notification method are adjusted according to the user's emotional state.

[1064] Input: Health information, emotional state

[1065] Output: Exercise menu, meal menu

[1066] Specific operation: The AI ​​module analyzes the data and calculates the appropriate menu.

[1067] Step 5:

[1068] Send Menu

[1069] The server encrypts the generated exercise and meal menus and transmits them to the user terminal.

[1070] Input: Exercise menu, meal menu

[1071] Output: Encrypted menu data

[1072] Specific operation: The server packets the menu data and sends it to the terminal.

[1073] Step 6:

[1074] Menu display and reminders

[1075] The device displays the received exercise and meal menus to the user and sends reminder notifications at specified times.

[1076] Input: Encrypted menu data

[1077] Output: Display on user device, reminder notification

[1078] Specific operation: The device decodes the menu data and displays it in the user interface. It also sends a notification at the reminder time.

[1079] Step 7:

[1080] Photograph and submit your exercise form

[1081] The user performs exercise, takes pictures of the exercise using the device's camera function, and sends the pictures to the server.

[1082] Input: Exercise form video

[1083] Output: Encrypted video data

[1084] Specific actions: The user records a video of their exercise and clicks the "Send" button.

[1085] Step 8:

[1086] Form Analysis

[1087] The server uses an AI module to analyze the received video, pointing out any discrepancies in form and generating new exercise menus as needed.

[1088] Input: Exercise form video

[1089] Output: Form analysis results, new exercise menu

[1090] How it works: The AI ​​module analyzes the video and generates results.

[1091] Step 9:

[1092] Send Feedback

[1093] The server encrypts the analysis results and new exercise menu and sends them to the user's device.

[1094] Input: Form analysis results, new exercise menu

[1095] Output: Encrypted feedback data

[1096] Specific operation: The server encrypts the data and sends it to the device.

[1097] Step 10:

[1098] User Feedback

[1099] The device will notify the user of the results received and provide appropriate feedback, allowing the user to identify areas for improvement or new exercise routines.

[1100] Input: Encrypted feedback data

[1101] Output: Display on user terminal

[1102] Specific operation: The feedback data is decoded on the terminal and displayed on the user interface.

[1103] This series of processing steps allows users to continue optimal exercise and diet according to their health and emotional state, and allows them to engage in healthy activities while receiving appropriate feedback.

[1104] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1105] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1106] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1107] [Third embodiment]

[1108] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1109] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1110] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1111] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1112] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1113] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1114] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1115] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1116] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1117] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1118] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1119] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1120] The present invention is a system that provides users with an optimal exercise menu based on their health condition and exercise goals, and supports them in exercising safely and effectively on a regular basis. This system is realized using a user terminal, a server, and an AI module.

[1121] User Device

[1122] user

[1123] First, the user installs the application on their device and launches it. On the screen that appears when the application is launched, they enter their profile information, such as their goal (muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in particular.

[1124] Terminal

[1125] The device receives these inputs and sends them to the server, where they are properly formatted and encrypted for security and privacy.

[1126] server

[1127] server

[1128] The server receives the user information sent from the device and stores it in a database. The server then sends the stored information to the AI ​​module, which then generates an optimal exercise menu based on the user information.

[1129] Server (AI module)

[1130] The AI ​​module selects appropriate stretching, training videos, and exercise menus based on the user's goals and physical information. It also provides dietary advice and suggests supplements based on the user's areas for improvement. The generated menus and advice are then returned to the server and sent to the device.

[1131] Providing exercise menus and checking form

[1132] Terminal

[1133] The device receives the exercise menu and dietary advice sent from the server and displays it to the user. It also notifies the user as needed to remind them to exercise. When the user exercises, the device captures their movements with a camera, and the device receives the video and sends it back to the server.

[1134] server

[1135] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video and evaluates accuracy and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[1136] Ongoing support

[1137] Terminal

[1138] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides character development and interaction with other users to maintain ongoing motivation.

[1139] user

[1140] Users can use these features to continue exercising and maintain their motivation by developing their characters and exchanging opinions with other users.

[1141] Specific examples

[1142] For example, if a 34-year-old female user wants to improve her stiff shoulders, she can enter her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). This information is sent to the server, and the AI ​​module generates an optimal exercise menu to improve shoulder stiffness. It also suggests foods rich in B vitamins and supplements to supplement them.

[1143] When users receive a reminder to exercise, they follow the provided exercise menu. To check their form, the movements are recorded as a video and sent to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In this way, users can always continue exercising with the correct form, helping to alleviate shoulder stiffness.

[1144] In this way, the system of the present invention provides the user with an optimal exercise menu and provides continuous support, thereby effectively helping the user maintain their health.

[1145] The processing flow will be explained below.

[1146] Step 1: Enter your user information

[1147] user

[1148] The user installs the application on their device and launches it. On the registration screen that appears when the application is launched for the first time, the user enters profile information such as their purpose (e.g., muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in particular.

[1149] Step 2: Submit user information

[1150] Terminal

[1151] The terminal formats the information entered by the user for transmission to the server and appropriately encrypts the data before transmission.

[1152] Step 3: Save user information

[1153] server

[1154] The server receives user information sent from the device and stores it in a database, after which it sends this information to an AI module for analysis.

[1155] Step 4: Generate an exercise menu

[1156] Server (AI module)

[1157] The AI ​​module analyzes information such as the user's goals, body type, age, and areas of pain to create an optimal exercise menu. It also provides dietary advice and suggests supplements to help achieve goals.

[1158] Step 5: Distribution of exercise menu

[1159] server

[1160] The generated exercise menu and dietary advice are stored in a database and prepared for transmission to the device, where the data is re-encrypted.

[1161] Step 6: View the exercise menu

[1162] Terminal

[1163] The terminal displays the exercise menu and dietary advice received from the server to the user.

[1164] Step 7: Remind yourself to exercise

[1165] Terminal

[1166] Based on the user's schedule, reminders are sent for exercise.

[1167] Step 8: Video your exercise form

[1168] user

[1169] Users receive reminders and follow the instructions to exercise, while their movements are recorded with the device's camera.

[1170] Step 9: Submit your exercise form video

[1171] Terminal

[1172] The captured exercise form video is received, formatted for transmission to a server, and the data is encrypted before being transmitted.

[1173] Step 10: Analyze the video

[1174] Server (AI module)

[1175] The server receives the video and analyzes it using an AI module, which evaluates the exercise form and determines what corrections are needed.

[1176] Step 11: Generate improvement suggestions

[1177] Server (AI module)

[1178] Based on the results of form analysis, points that need to be corrected and new exercise menus are generated.

[1179] Step 12: Distributing improvement proposals

[1180] server

[1181] The generated improvement suggestions and new exercise menus are stored in a database and prepared for transmission to the device. The data is encrypted during transmission.

[1182] Step 13: Viewing improvement suggestions

[1183] Terminal

[1184] The device notifies the user of and displays improvement suggestions and new exercise menus received from the server.

[1185] Step 14: Support for continued exercise

[1186] Terminal

[1187] To make it easier for users to continue exercising, the app provides features for character development and interaction with other users.

[1188] Step 15: Stay motivated

[1189] user

[1190] Users maintain their motivation to exercise by developing their characters and exchanging opinions with other users.

[1191] Example 1

[1192] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1193] In modern society, an increasing number of people are experiencing a decline in their health due to lack of exercise or improper exercise form. It is particularly difficult to propose appropriate exercise programs tailored to individual health conditions and goals, and maintaining ongoing motivation is also a challenge. Furthermore, there is a lack of means to check the appropriateness of users' exercise form and provide feedback on areas for improvement. These issues need to be resolved.

[1194] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1195] In this invention, the server includes means for registering information about the user's body, means for encrypting the registered information and transmitting it to the server, means for generating an optimal exercise menu using an artificial intelligence module based on the registered information, means for notifying the timing of performing the exercise menu, means for receiving a video of the exercise form taken by the user and requesting form analysis, means for providing form improvements based on the analysis results, and means for generating and providing a new exercise menu based on the analysis results, thereby enabling the provision of an exercise menu that meets the individual needs of the user, form checks and improvements, and continuous motivation support.

[1196] "User" refers to an individual who uses the system to carry out exercise programs and manage their health.

[1197] "Physical Information" refers to personal health information, including your height, weight, age, goals, and areas of particular interest or pain.

[1198] "Encryption" refers to the process of transforming information using a specific algorithm to protect it from unauthorized access by third parties.

[1199] "Server" refers to a computer system that receives, stores, and processes information sent from a user terminal and interacts with an artificial intelligence module.

[1200] "Artificial intelligence module" refers to a system that includes a program for generating optimal exercise menus and dietary advice based on user information.

[1201] An "exercise menu" refers to a specific exercise or training plan that a user should undertake to maintain their health and achieve their goals.

[1202] "Notification" refers to a means of informing users of the timing of exercise and suggestions for improving their form.

[1203] "Exercise form video" refers to footage of a user filming themselves exercising.

[1204] "Analysis" refers to the process by which an artificial intelligence module evaluates exercise form videos to identify accuracy and areas for improvement.

[1205] "Form improvement points" refer to points that the user should correct in order to perform the exercise more accurately.

[1206] "Motivation support" refers to functions and services that enable users to continue exercising.

[1207] "Character growth function" refers to a function that allows a virtual character to grow as the user continues to exercise.

[1208] "Function for interacting with other users" refers to a function that allows users to exchange information and communicate with other system users.

[1209] The present invention is a system that provides users with an optimal exercise menu based on their health condition and exercise goals, and supports them in exercising safely and effectively on a regular basis. This system is realized using a user terminal, a server, and an AI module.

[1210] User Device

[1211] user:

[1212] First, the user installs the application on their device and launches it. On the screen that appears when the application is launched, the user enters profile information such as their goal (muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in particular.

[1213] Device:

[1214] The device receives the information entered by the user, properly formats the data, encrypts it, and sends it to the server, using encryption technology to ensure security and privacy during the process.

[1215] server

[1216] server:

[1217] The server receives the encrypted user information sent from the user terminal, decrypts the received data, stores it in a database, and then sends the stored information to the AI ​​module.

[1218] AI Module:

[1219] The AI ​​module generates optimal exercise menus, stretching videos, and dietary advice based on the user's goals and physical information. It also suggests supplements based on the user's areas for improvement. The generated exercise menus and advice are then sent back to the server and sent to the user's device.

[1220] Providing exercise menus and checking form

[1221] Device:

[1222] The device receives the exercise menu and dietary advice sent from the server and displays them to the user. It also notifies the user as needed to remind them to exercise. When the user exercises, the device captures their movements with a camera and receives the video and sends it back to the server.

[1223] server:

[1224] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video, assessing accuracy and areas for improvement. If necessary, it generates corrections and new exercise menus and sends them back to the device.

[1225] Ongoing support

[1226] Device:

[1227] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides character development and interaction with other users to maintain ongoing motivation.

[1228] user:

[1229] Users can use these features to continue exercising and maintain their motivation by developing their characters and exchanging opinions with other users.

[1230] Specific examples

[1231] For example, if a 34-year-old female user wants to improve her stiff shoulders, she can enter her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). This information is sent to the server, and the AI ​​module generates an optimal exercise menu to improve shoulder stiffness. It also suggests foods rich in B vitamins and supplements to supplement them.

[1232] When users receive a reminder to exercise, they follow the provided exercise menu. To check their form, the movements are recorded as a video and sent to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In this way, users can always continue exercising with the correct form, helping to alleviate shoulder stiffness.

[1233] Prompt Sentence Examples

[1234] "Please explain how an app works, suggesting exercises to improve shoulder stiffness for a 34-year-old woman. Please include specific input information and related dietary advice."

[1235] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1236] System program processing flow

[1237] Step 1:

[1238] A user installs and launches an application on a device. The first time the application is launched, the user is prompted to log in or register. Input includes a username, password, and any initial configuration information. Output is the application's home screen.

[1239] Step 2:

[1240] On the application's home screen, the user enters the purpose of their exercise (e.g., muscle training, improving posture, preventing stiff shoulders, etc.) and profile information (e.g., height, weight, age, areas they want to improve, areas of pain, etc.). The entered information is temporarily stored on the device. Inputs include the user's health status and personal information. As output, the entered data is temporarily stored in the device's local storage.

[1241] Step 3:

[1242] The terminal receives information entered by the user and formats and encrypts the data appropriately. User information entered is received in plain text, but is encrypted on output, ready to be sent to the server.

[1243] Step 4:

[1244] The terminal sends encrypted user information to the server. The data sent is encrypted to ensure security. The input contains the encrypted user information, and the output is the data sent to the server.

[1245] Step 5:

[1246] The server receives the encrypted data sent from the terminal. The server decrypts the received data and stores it in the database. The input contains the encrypted user information and the decrypted data is stored in the database. The output is the new user information stored in the database.

[1247] Step 6:

[1248] The server sends the stored user information to the AI ​​module. As input, it contains the user information stored in the database and sends the data to the AI ​​module. As output, it provides the data to the AI ​​module.

[1249] Step 7:

[1250] The AI ​​module generates optimal exercise menus and dietary advice based on the user's goals and physical information. Data processing involves generating stretching videos and exercise menus based on the user's input information. User information is included as input, and the generated exercise menus and dietary advice are returned to the server as output.

[1251] Step 8:

[1252] The server receives the exercise menu and dietary advice generated by the AI ​​module and sends it to the user's device. The input contains the data generated by the AI, and the output is sent to the user's device.

[1253] Step 9:

[1254] The device receives exercise menus and dietary advice from the server and displays them to the user. It also sends notifications to remind the user to exercise. The input contains the data sent from the server and the output is displayed to the user.

[1255] Step 10:

[1256] The user exercises based on the displayed exercise menu, and records their movements with the camera. The input includes the user's exercise and the recorded video, and the output is the video saved on the device.

[1257] Step 11:

[1258] The device receives the captured video and sends it to the server. The input includes the captured video of the exercise form, and the video is sent to the server as the output.

[1259] Step 12:

[1260] The server receives the video sent by the user and requests the AI ​​module to analyze it. The video data is included as input and an analysis request is sent to the AI ​​module. As output, data for form analysis is provided to the AI ​​module.

[1261] Step 13:

[1262] The AI ​​module analyzes the user's form based on the video sent to it, assessing accuracy and areas for improvement. A posture analysis algorithm is used for data calculations. The input is the video data, and the output is the analysis results.

[1263] Step 14:

[1264] The AI ​​module generates correction points and new exercise menus based on the results of form analysis and sends them to the server. The form analysis results are included as input, and the new exercise menus and correction suggestions are sent to the server as output.

[1265] Step 15:

[1266] The server receives new exercise menus and modification suggestions from the AI ​​module and sends them to the user's device. The input contains the new exercise menus and modification suggestions, and the output contains the data sent to the user's device.

[1267] Step 16:

[1268] The terminal notifies and displays the improvement suggestions and new exercise menus sent from the server to the user.The new exercise menus and correction suggestions are included as inputs and displayed to the user as outputs.

[1269] Step 17:

[1270] The device provides motivational support to help users continue exercising. This includes character development and interaction with other users. Inputs include data sent from the server and the user's exercise history, and outputs provide functions to maintain the user's motivation.

[1271] Prompt Sentence Examples

[1272] "Please explain how an app works, suggesting exercises to improve shoulder stiffness for a 34-year-old woman. Please include specific input information and related dietary advice."

[1273] (Application example 1)

[1274] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1275] Conventional exercise support systems provide optimal exercise menus based on the user's health condition and exercise goals, but it is difficult to obtain real-time feedback during actual training, making it difficult to quickly correct errors in form. There are also challenges in maintaining motivation, making it difficult to continue exercising sustainably. In particular, in a home training environment, it is difficult to receive proper form guidance, making it difficult to achieve effective exercise.

[1276] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1277] In this invention, the server includes means for registering information about the user's body, means for generating an optimal exercise menu based on the registered information, means for notifying the user of the timing of performing the exercise menu, means for receiving videos of the user's exercise form and pointing out any discrepancies in form, means for supporting the user so that they can continue exercising, and means for providing training in a virtual space using a virtual reality device and providing real-time feedback on exercise form. This allows users to train effectively at home or anywhere they like while receiving real-time feedback, enabling them to continue exercising consistently. Furthermore, training in a virtual space can increase motivation and ensure proper form.

[1278] "User's physical information" includes information about the user's purpose, body type, age, height, weight, and pain points.

[1279] An "exercise menu" is training content generated based on the user's physical information and exercise goals.

[1280] The "means for notifying the timing of the exercise" has a function of notifying the user of the time to perform the exercise menu.

[1281] An "exercise form video" is a video recording of a user exercising.

[1282] The "means for pointing out differences in form" is a function that evaluates the user's exercise form and points out errors and areas for improvement.

[1283] The "means for supporting continuation" has the function of providing support to enable the user to exercise continuously.

[1284] A "virtual reality device" is a device that generates a virtual space and allows users to have an interactive experience within it.

[1285] A "virtual space" is a virtual environment generated using virtual reality technology.

[1286] "Means for providing feedback on exercise form in real time" refers to a function that evaluates the user's form while they are exercising and provides immediate feedback.

[1287] "Form check" is the process of analyzing a user's physical movements during exercise and evaluating their accuracy.

[1288] This invention is a system that provides users with an optimal exercise menu based on their health condition and exercise goals, and supports them in exercising safely and effectively on a regular basis. This system is realized using a user terminal, a server, and an AI module.

[1289] User Device

[1290] user

[1291] First, the user installs the application on their device and launches it. On the screen that appears when the application is launched, they enter their profile information, such as their goal (muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in particular.

[1292] Terminal

[1293] The device receives these inputs and sends them to the server, where they are properly formatted and encrypted for security and privacy.

[1294] server

[1295] server

[1296] The server receives the user information sent from the device and stores it in a database. The server then sends the stored information to the AI ​​module, which then generates an optimal exercise menu based on the user information.

[1297] AI Module

[1298] The AI ​​module selects appropriate stretching, training videos, and exercise menus based on the user's goals and physical information. It also provides dietary advice and suggests supplements based on the user's areas for improvement. The generated menus and advice are then returned to the server and sent to the device.

[1299] Providing exercise menus and checking form

[1300] Terminal

[1301] The device receives exercise menus and dietary advice sent from the server and displays them to the user. It also notifies the user as needed to remind them to exercise. When the user exercises, the device captures their movements with a camera or virtual reality device, and the device receives the video and sends it back to the server.

[1302] server

[1303] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video and evaluates accuracy and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[1304] Ongoing support

[1305] Terminal

[1306] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides training in a virtual reality space and the ability to interact with other users to maintain ongoing motivation.

[1307] user

[1308] Users can use these features to continue exercising and stay motivated by training in a virtual reality space and exchanging ideas with other users.

[1309] Hardware and software used

[1310] Hardware

[1311] VR headset (e.g. Meta Quest 2)

[1312] Camera or VR tracking sensor

[1313] software

[1314] User Interface (UI): Unity or Unreal Engine

[1315] Database: MySQL or MongoDB

[1316] AI Module: TensorFlow or PyTorch

[1317] Video analysis module: OpenCV

[1318] Specific examples

[1319] For example, let's say a 45-year-old male user wants to improve his lower back pain. He puts on a VR headset, logs into "VirtualGym," and enters his personal information (goal: improve lower back pain, height: 175 cm, weight: 80 kg, area of ​​pain: lower back). This information is sent to the server, and the AI ​​module generates an optimal exercise menu. The user receives a reminder to exercise and follows the provided menu. He trains while receiving feedback in the virtual reality space, and is able to see any corrections to his form in real time.

[1320] Example of input prompt for generative AI model

[1321] Enter the following prompt into the AI ​​model:

[1322] User information: 45 years old, male, 175cm tall, 80kg weight, looking to improve lower back pain. What kind of exercise program would be suitable for me?

[1323] Based on this, the AI ​​generates stretches and training menus to improve lower back pain and provides a virtual fitness experience.

[1324] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1325] Step 1:

[1326] User registration and data entry

[1327] The user installs the application on their device and launches it. On the screen that appears when the application is launched, they enter their profile information, such as their exercise purpose (e.g., muscle training, improving posture, alleviating lower back pain, etc.), body type (e.g., height, weight), age, and areas they would like to improve or have pain in particular.

[1328] Input: Information such as purpose of exercise, body type, age, height, weight, and areas of pain

[1329] Output: Formatted user information data

[1330] Step 2:

[1331] Data transmission and storage

[1332] The device properly formats and encrypts the entered user information and sends it to the server, which stores it in a database.

[1333] Input: Formatted user information data

[1334] Output: User information stored in the database

[1335] Step 3:

[1336] Generate exercise menu

[1337] The server sends the user information stored in the AI ​​module. The AI ​​module generates an optimal exercise menu based on the received user information. For example, a prompt sentence is input: "45 years old, male, 175 cm tall, 80 kg weight, aiming to improve lower back pain. What kind of exercise menu would be suitable?" The AI ​​generates an exercise menu and dietary advice based on this.

[1338] Input: User information

[1339] Output: Exercise menu and dietary advice

[1340] Step 4:

[1341] Providing exercise menus and advice

[1342] The server sends the exercise menu and dietary advice received from the AI ​​module to the device, which receives it, displays it to the user, and sends notifications to remind the user to exercise.

[1343] Input: Exercise menu and dietary advice

[1344] Output: Exercise menu, dietary advice, and reminder notifications displayed on the user's device

[1345] Step 5:

[1346] Photograph and send your exercise form

[1347] When a user exercises, they use a VR headset or camera to record video of their movements, which is then sent back to the server.

[1348] Input: Video of the user's exercise form

[1349] Output: Video of the exercise form sent to the server

[1350] Step 6:

[1351] Form Analytics and Feedback

[1352] The server receives the submitted exercise form video and sends it to the AI ​​module. The AI ​​module analyzes the video, evaluates the accuracy of the form and areas for improvement, generates points to be corrected and a new exercise menu, and sends it to the device via the server.

[1353] Input: Video of the user's exercise form

[1354] Output: Form feedback and new exercise menu

[1355] Step 7:

[1356] Providing feedback and ongoing support

[1357] The device receives form feedback and new exercise menus sent from the server and notifies the user. It also provides training in a virtual space and the ability to interact with other users, helping to maintain user motivation.

[1358] Input: Form feedback, new exercise menu

[1359] Output: Feedback provided to the user, new exercise menus, and support within the virtual space

[1360] This allows users to receive real-time feedback, allowing them to continue exercising appropriately and maintain motivation.

[1361] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1362] This invention is a system that allows users to exercise safely and effectively on a continuous basis by generating an optimal exercise menu based on the user's health condition and exercise goals, and by combining it with an emotion engine that recognizes the user's emotions. This system is realized using a user terminal, a server, an AI module, and an emotion engine.

[1363] User Device

[1364] user

[1365] First, the user installs and launches the application on their device. On the screen that appears when the application is launched, the user enters profile information such as their goal (e.g., muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in. Furthermore, the emotion engine allows users to easily input their emotional state or recognize emotions using the camera function.

[1366] Terminal

[1367] The device receives these inputs and sends them to the server, where they are properly formatted and encrypted for security and privacy.

[1368] server

[1369] server

[1370] The server receives user information and emotion data sent from the device, stores it in a database, and then sends the stored information to an AI module for analysis.

[1371] Server (AI module)

[1372] The AI ​​module analyzes the user's goals, body type, age, pain points, and emotional state to generate an optimal exercise menu. It also provides dietary advice and suggests supplements to help achieve goals. Emotional data is used to adjust exercise menus and notification methods, taking into account the user's motivation and stress level.

[1373] Providing exercise menus and checking form

[1374] server

[1375] The generated exercise menu and dietary advice are stored in a database and sent to the device, where the data is re-encrypted.

[1376] Terminal

[1377] The device displays the exercise menu and dietary advice received from the server to the user. It also notifies the user as needed to remind them to exercise. The timing and content of notifications are adjusted according to the user's emotional state. When the user exercises, the device receives the video and sends it back to the server.

[1378] server

[1379] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video, assessing accuracy and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[1380] Ongoing support

[1381] Terminal

[1382] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides character reactions based on data from the emotion engine and the ability to interact with other users to maintain ongoing motivation.

[1383] user

[1384] Users can use these features to stay motivated by continuing to exercise and by developing their character and exchanging opinions with other users. The emotion engine adjusts the character's reactions and interactions with other users based on the user's emotional state, providing a more personalized experience.

[1385] Specific examples

[1386] For example, if a 34-year-old female user wants to improve her stiff shoulders, she enters her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). The emotion engine also provides information about her stress level and motivation for the day. This information is sent to the server, where it is analyzed by the AI ​​module and emotion engine to generate an optimal exercise menu for improving stiff shoulders.

[1387] When a user receives a reminder to exercise, they follow the provided exercise menu. To check their form, they record their movements as a video and send it to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In addition, an emotion engine displays appropriate advice and encouraging messages based on the user's emotional state that day.

[1388] In this way, the system of the present invention provides users with an optimal exercise menu and provides continuous support, effectively helping them maintain their health. Furthermore, by combining it with an emotion engine, the system can provide more personalized support and maintain the user's motivation.

[1389] The processing flow will be explained below.

[1390] Step 1: Enter user information and emotion data

[1391] user

[1392] Users install and launch the application on their device. On the first launch, they enter their profile information on the registration screen that appears, including their goal (e.g., muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they want to improve or have pain in. They can also enter their mood and stress level for the day, or use the camera function to recognize their emotions, using the emotion engine.

[1393] Step 2: Send user information and emotion data

[1394] Terminal

[1395] The terminal formats the information and emotion data entered by the user for transmission to the server, and appropriately encrypts the data before transmission.

[1396] Step 3: Storing user information and emotion data

[1397] server

[1398] The server receives user information and emotion data sent from the device and stores it in a database, after which it sends this information to the AI ​​module and emotion engine for analysis.

[1399] Step 4: Generate an exercise menu

[1400] Server (AI module and emotion engine)

[1401] The AI ​​module and emotion engine analyze the user's goals, body type, age, pain points, and emotional state to generate an optimal exercise menu. It also suggests dietary advice and supplements to help achieve goals. Emotional data is used to adjust exercise menus and notification methods, taking into account the user's motivation and stress level.

[1402] Step 5: Distribution of exercise menu

[1403] server

[1404] The generated exercise menu and dietary advice are stored in a database and prepared for transmission to the device, where the data is re-encrypted.

[1405] Step 6: View the exercise menu

[1406] Terminal

[1407] The device displays the exercise menu and dietary advice received from the server to the user. It also sends appropriate notifications to remind the user to exercise. The emotion engine adjusts the timing and content of notifications according to the user's emotional state.

[1408] Step 7: Video your exercise form

[1409] user

[1410] Users receive reminders and follow the instructions to exercise, while their movements are recorded with the device's camera.

[1411] Step 8: Submit your exercise form video

[1412] Terminal

[1413] The captured exercise form video is received, formatted for transmission to a server, and the data is encrypted before being transmitted.

[1414] Step 9: Analyze the video

[1415] Server (AI module)

[1416] The server receives the video and analyzes it using an AI module, which evaluates the exercise form and determines what corrections are needed.

[1417] Step 10: Generate improvement suggestions

[1418] Server (AI module)

[1419] Based on the results of form analysis, points that need to be corrected and new exercise menus are generated.

[1420] Step 11: Distributing improvement proposals

[1421] server

[1422] The generated improvement suggestions and new exercise menus are stored in a database and prepared for transmission to the device. The data is encrypted during transmission.

[1423] Step 12: Viewing improvement suggestions

[1424] Terminal

[1425] The device notifies the user of and displays improvement suggestions and new exercise menus received from the server.

[1426] Step 13: Support for continued exercise

[1427] Terminal

[1428] To make it easier for users to continue exercising, the app provides users with character reactions based on data from the emotion engine and the ability to interact with other users.

[1429] Step 14: Stay motivated

[1430] user

[1431] Users can maintain their motivation to exercise by developing their character and exchanging opinions with other users. The emotion engine displays appropriate encouragement messages and advice based on the user's emotional state that day, providing a personalized experience.

[1432] Specific examples

[1433] For example, if a 34-year-old female user wants to improve her stiff shoulders, she enters her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). The emotion engine also provides information about her stress level and motivation for the day. This information is sent to the server, where it is analyzed by the AI ​​module and emotion engine to generate an optimal exercise menu for improving stiff shoulders.

[1434] When a user receives a reminder to exercise, they follow the provided exercise menu. To check their form, they record their movements as a video and send it to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In addition, an emotion engine displays encouraging messages and suggestions for improvement based on the user's emotional state that day.

[1435] In this way, the system of the present invention provides users with an optimal exercise menu and provides continuous support, effectively helping them maintain their health. Furthermore, by combining it with an emotion engine, the system can provide more personalized support and maintain the user's motivation.

[1436] Example 2

[1437] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1438] Conventional exercise menu generation systems generate exercise menus based on the user's physical information, but do not take the user's emotional state into account, resulting in a lack of motivation maintenance and individualized notification content adjustment. Furthermore, while there are functions that point out differences in exercise form, they lack emotional support to support the user's continued motivation. This has led to the challenge of making it difficult for users to maintain their motivation to continue exercising.

[1439] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1440] In this invention, the server includes means for registering information about the user's body, means for generating an optimal exercise menu based on the registered information and the user's emotional state, means for notifying the user of the timing to perform the exercise menu, means for receiving videos of the user's exercise form and pointing out any discrepancies in form, means for supporting the user so that they can continue exercising, and means for adjusting the user's motivation and notification content based on emotion recognition. This makes it possible to provide a personalized exercise menu based on the user's individual physical information and emotional state, and to maintain continuous motivation.

[1441] "User" refers to a person who uses the system to create and implement an exercise menu.

[1442] "Physical information" refers to data about the user's goals, body type, age, height, weight, and pain points.

[1443] An "optimal exercise menu" is an exercise plan that is individually tailored based on the user's physical information and emotional state.

[1444] "Emotional state" refers to information that indicates a user's psychological state, such as their daily stress level and motivation.

[1445] "Notifications" are messages that inform users of the timing of exercise routines and other important notices.

[1446] "Exercise form video" refers to video data captured while a user is exercising.

[1447] "Form differences" refers to errors or discrepancies that occur between the correct exercise form and the user's actual exercise form.

[1448] "Support" refers to services and features that help users continue exercising.

[1449] "Emotion recognition" refers to technology that analyzes a user's emotional state.

[1450] "Motivation adjustment" refers to the process of changing and optimizing exercise menus and notifications based on the user's emotional state.

[1451] This invention is a system that allows users to exercise safely and effectively on a continuous basis by generating an optimal exercise menu based on the user's health condition and exercise goals, and by combining it with an emotion engine that recognizes the user's emotions. This system is realized using a user terminal, a server, an AI module, and an emotion engine.

[1452] User Device

[1453] user

[1454] First, the user installs and launches the application on their device. On the screen that appears when the application is launched, the user enters profile information such as the purpose of the exercise (e.g., muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas of particular interest or pain. Furthermore, the emotion engine allows for simple input of emotional state and recognition of emotions using the camera function.

[1455] Terminal

[1456] The device receives this input information and sends it to the server, where it properly formats the data and encrypts it to protect security and privacy.

[1457] server

[1458] server

[1459] The server receives user information and emotion data sent from the device, stores it in a database, and then sends the stored information to an AI module for analysis.

[1460] Server (AI module)

[1461] The AI ​​module analyzes the user's goals, body type, age, pain points, and emotional state to generate an optimal exercise menu. It also provides dietary advice and suggests supplements to help achieve goals. Emotional data is used to adjust exercise menus and notification methods, taking into account the user's motivation and stress level.

[1462] Providing exercise menus and checking form

[1463] server

[1464] The generated exercise menu and dietary advice are stored in a database and sent to the device, where the data is re-encrypted.

[1465] Terminal

[1466] The device displays the exercise menu and dietary advice received from the server to the user. It also notifies the user as needed to remind them to exercise. The timing and content of notifications are adjusted according to the user's emotional state. When the user exercises, the device receives the video and sends it back to the server.

[1467] server

[1468] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video, assessing accuracy and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[1469] Ongoing support

[1470] Terminal

[1471] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides character reactions based on data from the emotion engine and the ability to interact with other users to maintain ongoing motivation.

[1472] user

[1473] Users can use these features to stay motivated by continuing to exercise and by developing their character and exchanging opinions with other users. The emotion engine adjusts the character's reactions and interactions with other users based on the user's emotional state, providing a more personalized experience.

[1474] Specific examples

[1475] For example, if a 34-year-old female user wants to improve her stiff shoulders, she enters her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). The emotion engine also provides information about her stress level and motivation for the day. This information is sent to the server, where it is analyzed by the AI ​​module and emotion engine to generate an optimal exercise menu for improving stiff shoulders.

[1476] When a user receives a reminder to exercise, they follow the provided exercise menu. To check their form, they record their movements as a video and send it to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In addition, an emotion engine displays appropriate advice and encouraging messages based on the user's emotional state that day.

[1477] Example prompts for generative AI models

[1478] "Generate an exercise menu to improve shoulder stiffness for a woman in her 30s. The model is 160cm tall and weighs 55kg. Please also consider the stress level and motivation of the day."

[1479] In this way, the system of the present invention provides users with an optimal exercise menu and provides continuous support, effectively helping them maintain their health. Furthermore, by combining it with an emotion engine, the system can provide more personalized support and maintain the user's motivation.

[1480] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1481] Step 1:

[1482] Input: Profile information based on your health and fitness goals, and your emotional state

[1483] Specific operation:

[1484] After installing and launching the application, users enter their profile information, such as their exercise goals, body type, age, areas they want to improve, and areas of pain. Users also use the camera to capture their facial expressions or answer simple questions to provide their emotional state for the day (stress level and motivation).

[1485] Output: A dataset of the input profile information and emotional states

[1486] Step 2:

[1487] Input: The dataset of profile information and emotional states entered in step 1.

[1488] Specific operation:

[1489] The device converts the user input data into an appropriate format (e.g., JSON format), encrypts the data for security and privacy reasons, and then transmits it to the server using a secure communication protocol (e.g., HTTPS).

[1490] Output: Notification that encrypted profile information and emotional state data has been sent

[1491] Step 3:

[1492] Input: Encrypted profile information and emotional state data

[1493] Specific operation:

[1494] The server receives and decrypts the encrypted data sent by the device, verifies the received data to ensure its accuracy and consistency, and then stores it in a database, where it is prepared for analysis by the AI ​​module.

[1495] Output: Analysis-ready user information and emotional state data

[1496] Step 4:

[1497] Input: Analysis-ready user information and emotional state data

[1498] Specific operation:

[1499] The AI ​​module on the server analyzes the user's goals, body type, age, areas of pain, and emotional state, and uses various algorithms to generate the optimal exercise menu for the user. It also provides dietary advice and suggests supplements, and sets notification methods and timing that are best suited to the user based on their emotional state.

[1500] Output: Generated exercise menu, dietary advice, and notification settings data

[1501] Step 5:

[1502] Input: Generated exercise menu, dietary advice, and notification setting data

[1503] Specific operation:

[1504] The server stores the generated exercise menu and dietary advice in a database, encrypts the data again, and then transmits it to the terminal.

[1505] Output: Notification of completion of sending encrypted exercise menu and dietary advice data

[1506] Step 6:

[1507] Input: Encrypted exercise menu and dietary advice data

[1508] Specific operation:

[1509] The device decrypts the encrypted data received from the server and displays it to the user. Depending on the user's emotional state, the device adjusts the timing and content of reminder notifications and notifies the user appropriately.

[1510] Output: Exercise menu and dietary advice displayed on the user's screen

[1511] Step 7:

[1512] Input: Displayed exercise menu and dietary advice

[1513] Specific operation:

[1514] The user follows the exercise menu provided and performs the exercise. The camera records the user's movements during the exercise, encrypts the video, and sends it to the server via the device.

[1515] Output: Notification of completion of sending encrypted exercise form video data

[1516] Step 8:

[1517] Input: Encrypted exercise form video data

[1518] Specific operation:

[1519] The server receives and decodes the exercise form video data. The AI ​​module analyzes the video and evaluates the accuracy of the user's form and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[1520] Output: Analysis results and suggested corrections, new exercise menu

[1521] Step 9:

[1522] Input: Analysis results and suggested correction data, new exercise menu

[1523] Specific operation:

[1524] The device decodes the data received from the server and displays it to the user. It also provides character reactions and interaction with other users based on data from the emotion engine, helping to maintain motivation.

[1525] Output: Analysis results, suggested corrections, new exercise menus, and character reactions displayed on the user's screen

[1526] Step 10:

[1527] Input: Analysis results, suggested modifications, new movement menus and character reactions

[1528] Specific operation:

[1529] Users can continue exercising while referring to the displayed results, suggestions, and reactions of the character, and can maintain further motivation by using the function to interact with other users.

[1530] Output: Feedback data that encourages users to continue exercising and improve their health

[1531] (Application example 2)

[1532] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1533] In modern society, it is difficult for users to effectively continue exercising and eating to maintain their health. The objective of the present invention is to provide a system that supports healthy activities more effectively and continuously by providing optimal exercise and meal menus based on the user's health condition and exercise goals, and further adjusting notification methods and suggested content taking the user's emotional state into consideration.

[1534] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1535] In this invention, the server includes means for registering information about the user's body, means for generating optimal exercise and meal menus based on the registered information, means for notifying the user of the timing to perform the exercise and meal menus, means for receiving videos of exercise form taken by the user and pointing out differences in form, means for analyzing the user's emotional state using an emotion engine and adjusting the exercise and meal menus and notification method, and means for supporting the user to continue exercising and eating a healthy diet. This allows the user to effectively continue exercising and eating a healthy diet and receive individual support according to their emotional state in the process.

[1536] "User's physical information" refers to physiological data such as the user's body type, age, height, weight, and areas of pain.

[1537] "Exercise menu" refers to a series of training programs provided based on the user's health condition and exercise goals.

[1538] "Meal Menu" refers to an optimal meal plan suggested based on the user's health and emotional state.

[1539] An "emotion engine" refers to a software module that analyzes a user's facial expressions and input data to recognize their emotional state.

[1540] "Notification means" refers to a method or device for notifying the user of the timing of performing an exercise menu or meal menu.

[1541] "Exercise form video" refers to video data recorded by a user's own movements.

[1542] "Means for pointing out differences in form" refers to systems or algorithms that analyze videos of exercise form and point out errors in the user's movements and areas for improvement.

[1543] "Emotional state" refers to the user's psychological state, such as stress level and motivation.

[1544] "Support measures" refers to methods and systems that help users continue to exercise and eat healthy.

[1545] MODE FOR CARRYING OUT THE INVENTION

[1546] The present invention is a system that supports users' health activities by generating optimal exercise and meal menus based on the user's health condition and exercise goals, and adjusting the notification method and suggested content taking into account the user's emotional state, using a system that utilizes a user terminal, server, AI module, and emotion engine.

[1547] System configuration

[1548] User Device

[1549] The user device takes the form of a smartphone with a dedicated application installed, which includes the following functions:

[1550] 1. Data input: Users input their health information (goals, body type, age, height, weight, pain points, etc.), and then input or recognize their emotional state for the day through the emotion engine.

[1551] 2. Displaying exercise and meal menus: Displaying the exercise and meal menus sent from the server and sending reminder notifications to the user.

[1552] 3. Recording and sending video of exercise form: The user performs exercise, records the exercise as a video using the app's camera function, and sends the video to the server.

[1553] server

[1554] The server has the following features:

[1555] 1. Data reception and storage: Receives health information and emotion data sent from the user device and stores it in a database.

[1556] 2. Data analysis: The stored data is sent to the AI ​​module for analysis, and the optimal exercise and meal menus are generated based on the analysis results.

[1557] 3. Exercise form analysis: Analyzes exercise form videos submitted by users, identifies differences in form, and generates new exercise menus as needed.

[1558] 4. Data transmission: The generated exercise menu, meal menu, and form analysis results are sent to the user's device.

[1559] AI Module and Emotion Engine

[1560] The AI ​​module is built using machine learning frameworks such as TensorFlow and PyTorch. The emotion engine recognizes user emotions and provides them to the server as analysis data.

[1561] Processing flow and specific examples

[1562] 1. User Input:

[1563] A 45-year-old male user launches the app and enters his health information (goal: diet, height: 175 cm, weight: 80 kg).

[1564] It also uses an emotion engine to recognize your stress level for the day.

[1565] 2. Data transmission and analysis:

[1566] The user terminal encrypts the entered data and sends it to the server.

[1567] The server receives the data, analyzes it with an AI module, and generates optimal exercise and meal plans. For example, it suggests low-calorie, stress-relieving meals (e.g., tuna salad bowl, grilled chicken).

[1568] 3. Notifications and Reminders:

[1569] The menu and reminder notifications sent from the server are displayed on the user's device.

[1570] Send a reminder before lunch such as, "Great work! Why not try a macro-balanced tuna salad bowl today?"

[1571] 4. Exercise form feedback:

[1572] The user performs exercise, records the exercise as a video, and sends it to the server.

[1573] The server analyzes the video using an AI module, points out differences in form, and suggests new exercise menus.

[1574] Prompt Sentence Examples

[1575] Username: Yamada Taro

[1576] Age: 45

[1577] Purpose: Diet

[1578] Body type: Height 175cm, Weight 80kg

[1579] Allergies: None

[1580] Food preference: Japanese food, low calorie

[1581] Stress level: High

[1582] Question 1: Please suggest the best meal plan.

[1583] Question 2: What reminder message would you use to respond to high stress levels?

[1584] This allows users to effectively exercise and eat healthily, and receive personalized emotional support along the way.

[1585] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1586] Step 1:

[1587] User Input

[1588] The user launches the application on their device and inputs their health information (e.g., goals, body type, age, height, weight, pain points), and the emotion engine also inputs or recognizes their emotional state for the day (e.g., stress level, motivation) via the camera.

[1589] Input: Health information, emotional state

[1590] Output: Encrypted data packet

[1591] Specific behavior: The user fills out a form on the application screen and clicks the "Submit" button.

[1592] Step 2:

[1593] Data transmission

[1594] The device encrypts the entered health information and emotion data and transmits it to the server using a secure communication protocol (e.g., HTTPS).

[1595] Input: Encrypted data packet

[1596] Output: Data sent to server completed

[1597] Specific operation: Data is encrypted on the terminal side and sent to the server via the network.

[1598] Step 3:

[1599] Data Receipt and Storage

[1600] The server receives the data sent from the device and stores it in a database. When storing the data, it checks the consistency of the data format and eliminates any invalid data.

[1601] Input: Encrypted data packet

[1602] Output: Saved to database successfully

[1603] Specific operation: The server receives the data and stores it in the database.

[1604] Step 4:

[1605] Data analysis

[1606] The server sends the received data to an AI module, which generates optimal exercise and meal menus based on the user's health information and emotional state. The content of the meal menu and notification method are adjusted according to the user's emotional state.

[1607] Input: Health information, emotional state

[1608] Output: Exercise menu, meal menu

[1609] Specific operation: The AI ​​module analyzes the data and calculates the appropriate menu.

[1610] Step 5:

[1611] Send Menu

[1612] The server encrypts the generated exercise and meal menus and transmits them to the user terminal.

[1613] Input: Exercise menu, meal menu

[1614] Output: Encrypted menu data

[1615] Specific operation: The server packets the menu data and sends it to the terminal.

[1616] Step 6:

[1617] Menu display and reminders

[1618] The device displays the received exercise and meal menus to the user and sends reminder notifications at specified times.

[1619] Input: Encrypted menu data

[1620] Output: Display on user device, reminder notification

[1621] Specific operation: The device decodes the menu data and displays it in the user interface. It also sends a notification at the reminder time.

[1622] Step 7:

[1623] Photograph and submit your exercise form

[1624] The user performs exercise, takes pictures of the exercise using the device's camera function, and sends the pictures to the server.

[1625] Input: Exercise form video

[1626] Output: Encrypted video data

[1627] Specific actions: The user records a video of their exercise and clicks the "Send" button.

[1628] Step 8:

[1629] Form Analysis

[1630] The server uses an AI module to analyze the received video, pointing out any discrepancies in form and generating new exercise menus as needed.

[1631] Input: Exercise form video

[1632] Output: Form analysis results, new exercise menu

[1633] How it works: The AI ​​module analyzes the video and generates results.

[1634] Step 9:

[1635] Send Feedback

[1636] The server encrypts the analysis results and new exercise menu and sends them to the user's device.

[1637] Input: Form analysis results, new exercise menu

[1638] Output: Encrypted feedback data

[1639] Specific operation: The server encrypts the data and sends it to the device.

[1640] Step 10:

[1641] User Feedback

[1642] The device will notify the user of the results received and provide appropriate feedback, allowing the user to identify areas for improvement or new exercise routines.

[1643] Input: Encrypted feedback data

[1644] Output: Display on user terminal

[1645] Specific operation: The feedback data is decoded on the terminal and displayed on the user interface.

[1646] This series of processing steps allows users to continue optimal exercise and diet according to their health and emotional state, and allows them to engage in healthy activities while receiving appropriate feedback.

[1647] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1648] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1649] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1650] [Fourth embodiment]

[1651] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1652] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1653] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1654] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1655] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1656] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1657] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1658] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1659] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1660] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1661] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1662] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1663] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1664] The present invention is a system that provides users with an optimal exercise menu based on their health condition and exercise goals, and supports them in exercising safely and effectively on a regular basis. This system is realized using a user terminal, a server, and an AI module.

[1665] User Device

[1666] user

[1667] First, the user installs the application on their device and launches it. On the screen that appears when the application is launched, they enter their profile information, such as their goal (muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in particular.

[1668] Terminal

[1669] The device receives these inputs and sends them to the server, where they are properly formatted and encrypted for security and privacy.

[1670] server

[1671] server

[1672] The server receives the user information sent from the device and stores it in a database. The server then sends the stored information to the AI ​​module, which then generates an optimal exercise menu based on the user information.

[1673] Server (AI module)

[1674] The AI ​​module selects appropriate stretching, training videos, and exercise menus based on the user's goals and physical information. It also provides dietary advice and suggests supplements based on the user's areas for improvement. The generated menus and advice are then returned to the server and sent to the device.

[1675] Providing exercise menus and checking form

[1676] Terminal

[1677] The device receives the exercise menu and dietary advice sent from the server and displays it to the user. It also notifies the user as needed to remind them to exercise. When the user exercises, the device captures their movements with a camera, and the device receives the video and sends it back to the server.

[1678] server

[1679] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video and evaluates accuracy and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[1680] Ongoing support

[1681] Terminal

[1682] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides character development and interaction with other users to maintain ongoing motivation.

[1683] user

[1684] Users can use these features to continue exercising and maintain their motivation by developing their characters and exchanging opinions with other users.

[1685] Specific examples

[1686] For example, if a 34-year-old female user wants to improve her stiff shoulders, she can enter her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). This information is sent to the server, and the AI ​​module generates an optimal exercise menu to improve shoulder stiffness. It also suggests foods rich in B vitamins and supplements to supplement them.

[1687] When users receive a reminder to exercise, they follow the provided exercise menu. To check their form, the movements are recorded as a video and sent to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In this way, users can always continue exercising with the correct form, helping to alleviate shoulder stiffness.

[1688] In this way, the system of the present invention provides the user with an optimal exercise menu and provides continuous support, thereby effectively helping the user maintain their health.

[1689] The processing flow will be explained below.

[1690] Step 1: Enter your user information

[1691] user

[1692] The user installs the application on their device and launches it. On the registration screen that appears when the application is launched for the first time, the user enters profile information such as their purpose (e.g., muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in particular.

[1693] Step 2: Submit user information

[1694] Terminal

[1695] The terminal formats the information entered by the user for transmission to the server and appropriately encrypts the data before transmission.

[1696] Step 3: Save user information

[1697] server

[1698] The server receives user information sent from the device and stores it in a database, after which it sends this information to an AI module for analysis.

[1699] Step 4: Generate an exercise menu

[1700] Server (AI module)

[1701] The AI ​​module analyzes information such as the user's goals, body type, age, and areas of pain to create an optimal exercise menu. It also provides dietary advice and suggests supplements to help achieve goals.

[1702] Step 5: Distribution of exercise menu

[1703] server

[1704] The generated exercise menu and dietary advice are stored in a database and prepared for transmission to the device, where the data is re-encrypted.

[1705] Step 6: View the exercise menu

[1706] Terminal

[1707] The terminal displays the exercise menu and dietary advice received from the server to the user.

[1708] Step 7: Remind yourself to exercise

[1709] Terminal

[1710] Based on the user's schedule, reminders are sent for exercise.

[1711] Step 8: Video your exercise form

[1712] user

[1713] Users receive reminders and follow the instructions to exercise, while their movements are recorded with the device's camera.

[1714] Step 9: Submit your exercise form video

[1715] Terminal

[1716] The captured exercise form video is received, formatted for transmission to a server, and the data is encrypted before being transmitted.

[1717] Step 10: Analyze the video

[1718] Server (AI module)

[1719] The server receives the video and analyzes it using an AI module, which evaluates the exercise form and determines what corrections are needed.

[1720] Step 11: Generate improvement suggestions

[1721] Server (AI module)

[1722] Based on the results of form analysis, points that need to be corrected and new exercise menus are generated.

[1723] Step 12: Distributing improvement proposals

[1724] server

[1725] The generated improvement suggestions and new exercise menus are stored in a database and prepared for transmission to the device. The data is encrypted during transmission.

[1726] Step 13: Viewing improvement suggestions

[1727] Terminal

[1728] The device notifies the user of and displays improvement suggestions and new exercise menus received from the server.

[1729] Step 14: Support for continued exercise

[1730] Terminal

[1731] To make it easier for users to continue exercising, the app provides features for character development and interaction with other users.

[1732] Step 15: Stay motivated

[1733] user

[1734] Users maintain their motivation to exercise by developing their characters and exchanging opinions with other users.

[1735] Example 1

[1736] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1737] In modern society, an increasing number of people are experiencing a decline in their health due to lack of exercise or improper exercise form. It is particularly difficult to propose appropriate exercise programs tailored to individual health conditions and goals, and maintaining ongoing motivation is also a challenge. Furthermore, there is a lack of means to check the appropriateness of users' exercise form and provide feedback on areas for improvement. These issues need to be resolved.

[1738] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1739] In this invention, the server includes means for registering information about the user's body, means for encrypting the registered information and transmitting it to the server, means for generating an optimal exercise menu using an artificial intelligence module based on the registered information, means for notifying the timing of performing the exercise menu, means for receiving a video of the exercise form taken by the user and requesting form analysis, means for providing form improvements based on the analysis results, and means for generating and providing a new exercise menu based on the analysis results, thereby enabling the provision of an exercise menu that meets the individual needs of the user, form checks and improvements, and continuous motivation support.

[1740] "User" refers to an individual who uses the system to carry out exercise programs and manage their health.

[1741] "Physical Information" refers to personal health information, including your height, weight, age, goals, and areas of particular interest or pain.

[1742] "Encryption" refers to the process of transforming information using a specific algorithm to protect it from unauthorized access by third parties.

[1743] "Server" refers to a computer system that receives, stores, and processes information sent from a user terminal and interacts with an artificial intelligence module.

[1744] "Artificial intelligence module" refers to a system that includes a program for generating optimal exercise menus and dietary advice based on user information.

[1745] An "exercise menu" refers to a specific exercise or training plan that a user should undertake to maintain their health and achieve their goals.

[1746] "Notification" refers to a means of informing users of the timing of exercise and suggestions for improving their form.

[1747] "Exercise form video" refers to footage of a user filming themselves exercising.

[1748] "Analysis" refers to the process by which an artificial intelligence module evaluates exercise form videos to identify accuracy and areas for improvement.

[1749] "Form improvement points" refer to points that the user should correct in order to perform the exercise more accurately.

[1750] "Motivation support" refers to functions and services that enable users to continue exercising.

[1751] "Character growth function" refers to a function that allows a virtual character to grow as the user continues to exercise.

[1752] "Function for interacting with other users" refers to a function that allows users to exchange information and communicate with other system users.

[1753] The present invention is a system that provides users with an optimal exercise menu based on their health condition and exercise goals, and supports them in exercising safely and effectively on a regular basis. This system is realized using a user terminal, a server, and an AI module.

[1754] User Device

[1755] user:

[1756] First, the user installs the application on their device and launches it. On the screen that appears when the application is launched, the user enters profile information such as their goal (muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in particular.

[1757] Device:

[1758] The device receives the information entered by the user, properly formats the data, encrypts it, and sends it to the server, using encryption technology to ensure security and privacy during the process.

[1759] server

[1760] server:

[1761] The server receives the encrypted user information sent from the user terminal, decrypts the received data, stores it in a database, and then sends the stored information to the AI ​​module.

[1762] AI Module:

[1763] The AI ​​module generates optimal exercise menus, stretching videos, and dietary advice based on the user's goals and physical information. It also suggests supplements based on the user's areas for improvement. The generated exercise menus and advice are then sent back to the server and sent to the user's device.

[1764] Providing exercise menus and checking form

[1765] Device:

[1766] The device receives the exercise menu and dietary advice sent from the server and displays them to the user. It also notifies the user as needed to remind them to exercise. When the user exercises, the device captures their movements with a camera and receives the video and sends it back to the server.

[1767] server:

[1768] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video, assessing accuracy and areas for improvement. If necessary, it generates corrections and new exercise menus and sends them back to the device.

[1769] Ongoing support

[1770] Device:

[1771] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides character development and interaction with other users to maintain ongoing motivation.

[1772] user:

[1773] Users can use these features to continue exercising and maintain their motivation by developing their characters and exchanging opinions with other users.

[1774] Specific examples

[1775] For example, if a 34-year-old female user wants to improve her stiff shoulders, she can enter her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). This information is sent to the server, and the AI ​​module generates an optimal exercise menu to improve shoulder stiffness. It also suggests foods rich in B vitamins and supplements to supplement them.

[1776] When users receive a reminder to exercise, they follow the provided exercise menu. To check their form, the movements are recorded as a video and sent to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In this way, users can always continue exercising with the correct form, helping to alleviate shoulder stiffness.

[1777] Prompt Sentence Examples

[1778] "Please explain how an app works, suggesting exercises to improve shoulder stiffness for a 34-year-old woman. Please include specific input information and related dietary advice."

[1779] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1780] System program processing flow

[1781] Step 1:

[1782] A user installs and launches an application on a device. The first time the application is launched, the user is prompted to log in or register. Input includes a username, password, and any initial configuration information. Output is the application's home screen.

[1783] Step 2:

[1784] On the application's home screen, the user enters the purpose of their exercise (e.g., muscle training, improving posture, preventing stiff shoulders, etc.) and profile information (e.g., height, weight, age, areas they want to improve, areas of pain, etc.). The entered information is temporarily stored on the device. Inputs include the user's health status and personal information. As output, the entered data is temporarily stored in the device's local storage.

[1785] Step 3:

[1786] The terminal receives information entered by the user and formats and encrypts the data appropriately. User information entered is received in plain text, but is encrypted on output, ready to be sent to the server.

[1787] Step 4:

[1788] The terminal sends encrypted user information to the server. The data sent is encrypted to ensure security. The input contains the encrypted user information, and the output is the data sent to the server.

[1789] Step 5:

[1790] The server receives the encrypted data sent from the terminal. The server decrypts the received data and stores it in the database. The input contains the encrypted user information and the decrypted data is stored in the database. The output is the new user information stored in the database.

[1791] Step 6:

[1792] The server sends the stored user information to the AI ​​module. As input, it contains the user information stored in the database and sends the data to the AI ​​module. As output, it provides the data to the AI ​​module.

[1793] Step 7:

[1794] The AI ​​module generates optimal exercise menus and dietary advice based on the user's goals and physical information. Data processing involves generating stretching videos and exercise menus based on the user's input information. User information is included as input, and the generated exercise menus and dietary advice are returned to the server as output.

[1795] Step 8:

[1796] The server receives the exercise menu and dietary advice generated by the AI ​​module and sends it to the user's device. The input contains the data generated by the AI, and the output is sent to the user's device.

[1797] Step 9:

[1798] The device receives exercise menus and dietary advice from the server and displays them to the user. It also sends notifications to remind the user to exercise. The input contains the data sent from the server and the output is displayed to the user.

[1799] Step 10:

[1800] The user exercises based on the displayed exercise menu, and records their movements with the camera. The input includes the user's exercise and the recorded video, and the output is the video saved on the device.

[1801] Step 11:

[1802] The device receives the captured video and sends it to the server. The input includes the captured video of the exercise form, and the video is sent to the server as the output.

[1803] Step 12:

[1804] The server receives the video sent by the user and requests the AI ​​module to analyze it. The video data is included as input and an analysis request is sent to the AI ​​module. As output, data for form analysis is provided to the AI ​​module.

[1805] Step 13:

[1806] The AI ​​module analyzes the user's form based on the video sent to it, assessing accuracy and areas for improvement. A posture analysis algorithm is used for data calculations. The input is the video data, and the output is the analysis results.

[1807] Step 14:

[1808] The AI ​​module generates correction points and new exercise menus based on the results of form analysis and sends them to the server. The form analysis results are included as input, and the new exercise menus and correction suggestions are sent to the server as output.

[1809] Step 15:

[1810] The server receives new exercise menus and modification suggestions from the AI ​​module and sends them to the user's device. The input contains the new exercise menus and modification suggestions, and the output contains the data sent to the user's device.

[1811] Step 16:

[1812] The terminal notifies and displays the improvement suggestions and new exercise menus sent from the server to the user.The new exercise menus and correction suggestions are included as inputs and displayed to the user as outputs.

[1813] Step 17:

[1814] The device provides motivational support to help users continue exercising. This includes character development and interaction with other users. Inputs include data sent from the server and the user's exercise history, and outputs provide functions to maintain the user's motivation.

[1815] Prompt Sentence Examples

[1816] "Please explain how an app works, suggesting exercises to improve shoulder stiffness for a 34-year-old woman. Please include specific input information and related dietary advice."

[1817] (Application example 1)

[1818] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1819] Conventional exercise support systems provide optimal exercise menus based on the user's health condition and exercise goals, but it is difficult to obtain real-time feedback during actual training, making it difficult to quickly correct errors in form. There are also challenges in maintaining motivation, making it difficult to continue exercising sustainably. In particular, in a home training environment, it is difficult to receive proper form guidance, making it difficult to achieve effective exercise.

[1820] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1821] In this invention, the server includes means for registering information about the user's body, means for generating an optimal exercise menu based on the registered information, means for notifying the user of the timing of performing the exercise menu, means for receiving videos of the user's exercise form and pointing out any discrepancies in form, means for supporting the user so that they can continue exercising, and means for providing training in a virtual space using a virtual reality device and providing real-time feedback on exercise form. This allows users to train effectively at home or anywhere they like while receiving real-time feedback, enabling them to continue exercising consistently. Furthermore, training in a virtual space can increase motivation and ensure proper form.

[1822] "User's physical information" includes information about the user's purpose, body type, age, height, weight, and pain points.

[1823] An "exercise menu" is training content generated based on the user's physical information and exercise goals.

[1824] The "means for notifying the timing of the exercise" has a function of notifying the user of the time to perform the exercise menu.

[1825] An "exercise form video" is a video recording of a user exercising.

[1826] The "means for pointing out differences in form" is a function that evaluates the user's exercise form and points out errors and areas for improvement.

[1827] The "means for supporting continuation" has the function of providing support to enable the user to exercise continuously.

[1828] A "virtual reality device" is a device that generates a virtual space and allows users to have an interactive experience within it.

[1829] A "virtual space" is a virtual environment generated using virtual reality technology.

[1830] "Means for providing feedback on exercise form in real time" refers to a function that evaluates the user's form while they are exercising and provides immediate feedback.

[1831] "Form check" is the process of analyzing a user's physical movements during exercise and evaluating their accuracy.

[1832] This invention is a system that provides users with an optimal exercise menu based on their health condition and exercise goals, and supports them in exercising safely and effectively on a regular basis. This system is realized using a user terminal, a server, and an AI module.

[1833] User Device

[1834] user

[1835] First, the user installs the application on their device and launches it. On the screen that appears when the application is launched, they enter their profile information, such as their goal (muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in particular.

[1836] Terminal

[1837] The device receives these inputs and sends them to the server, where they are properly formatted and encrypted for security and privacy.

[1838] server

[1839] server

[1840] The server receives the user information sent from the device and stores it in a database. The server then sends the stored information to the AI ​​module, which then generates an optimal exercise menu based on the user information.

[1841] AI Module

[1842] The AI ​​module selects appropriate stretching, training videos, and exercise menus based on the user's goals and physical information. It also provides dietary advice and suggests supplements based on the user's areas for improvement. The generated menus and advice are then returned to the server and sent to the device.

[1843] Providing exercise menus and checking form

[1844] Terminal

[1845] The device receives exercise menus and dietary advice sent from the server and displays them to the user. It also notifies the user as needed to remind them to exercise. When the user exercises, the device captures their movements with a camera or virtual reality device, and the device receives the video and sends it back to the server.

[1846] server

[1847] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video and evaluates accuracy and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[1848] Ongoing support

[1849] Terminal

[1850] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides training in a virtual reality space and the ability to interact with other users to maintain ongoing motivation.

[1851] user

[1852] Users can use these features to continue exercising and stay motivated by training in a virtual reality space and exchanging ideas with other users.

[1853] Hardware and software used

[1854] Hardware

[1855] VR headset (e.g. Meta Quest 2)

[1856] Camera or VR tracking sensor

[1857] software

[1858] User Interface (UI): Unity or Unreal Engine

[1859] Database: MySQL or MongoDB

[1860] AI Module: TensorFlow or PyTorch

[1861] Video analysis module: OpenCV

[1862] Specific examples

[1863] For example, let's say a 45-year-old male user wants to improve his lower back pain. He puts on a VR headset, logs into "VirtualGym," and enters his personal information (goal: improve lower back pain, height: 175 cm, weight: 80 kg, area of ​​pain: lower back). This information is sent to the server, and the AI ​​module generates an optimal exercise menu. The user receives a reminder to exercise and follows the provided menu. He trains while receiving feedback in the virtual reality space, and is able to see any corrections to his form in real time.

[1864] Example of input prompt for generative AI model

[1865] Enter the following prompt into the AI ​​model:

[1866] User information: 45 years old, male, 175cm tall, 80kg weight, looking to improve lower back pain. What kind of exercise program would be suitable for me?

[1867] Based on this, the AI ​​generates stretches and training menus to improve lower back pain and provides a virtual fitness experience.

[1868] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1869] Step 1:

[1870] User registration and data entry

[1871] The user installs the application on their device and launches it. On the screen that appears when the application is launched, they enter their profile information, such as their exercise purpose (e.g., muscle training, improving posture, alleviating lower back pain, etc.), body type (e.g., height, weight), age, and areas they would like to improve or have pain in particular.

[1872] Input: Information such as purpose of exercise, body type, age, height, weight, and areas of pain

[1873] Output: Formatted user information data

[1874] Step 2:

[1875] Data transmission and storage

[1876] The device properly formats and encrypts the entered user information and sends it to the server, which stores it in a database.

[1877] Input: Formatted user information data

[1878] Output: User information stored in the database

[1879] Step 3:

[1880] Generate exercise menu

[1881] The server sends the user information stored in the AI ​​module. The AI ​​module generates an optimal exercise menu based on the received user information. For example, a prompt sentence is input: "45 years old, male, 175 cm tall, 80 kg weight, aiming to improve lower back pain. What kind of exercise menu would be suitable?" The AI ​​generates an exercise menu and dietary advice based on this.

[1882] Input: User information

[1883] Output: Exercise menu and dietary advice

[1884] Step 4:

[1885] Providing exercise menus and advice

[1886] The server sends the exercise menu and dietary advice received from the AI ​​module to the device, which receives it, displays it to the user, and sends notifications to remind the user to exercise.

[1887] Input: Exercise menu and dietary advice

[1888] Output: Exercise menu, dietary advice, and reminder notifications displayed on the user's device

[1889] Step 5:

[1890] Photograph and send your exercise form

[1891] When a user exercises, they use a VR headset or camera to record video of their movements, which is then sent back to the server.

[1892] Input: Video of the user's exercise form

[1893] Output: Video of the exercise form sent to the server

[1894] Step 6:

[1895] Form Analytics and Feedback

[1896] The server receives the submitted exercise form video and sends it to the AI ​​module. The AI ​​module analyzes the video, evaluates the accuracy of the form and areas for improvement, generates points to be corrected and a new exercise menu, and sends it to the device via the server.

[1897] Input: Video of the user's exercise form

[1898] Output: Form feedback and new exercise menu

[1899] Step 7:

[1900] Providing feedback and ongoing support

[1901] The device receives form feedback and new exercise menus sent from the server and notifies the user. It also provides training in a virtual space and the ability to interact with other users, helping to maintain user motivation.

[1902] Input: Form feedback, new exercise menu

[1903] Output: Feedback provided to the user, new exercise menus, and support within the virtual space

[1904] This allows users to receive real-time feedback, allowing them to continue exercising appropriately and maintain motivation.

[1905] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1906] This invention is a system that allows users to exercise safely and effectively on a continuous basis by generating an optimal exercise menu based on the user's health condition and exercise goals, and by combining it with an emotion engine that recognizes the user's emotions. This system is realized using a user terminal, a server, an AI module, and an emotion engine.

[1907] User Device

[1908] user

[1909] First, the user installs and launches the application on their device. On the screen that appears when the application is launched, the user enters profile information such as their goal (e.g., muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they would like to improve or have pain in. Furthermore, the emotion engine allows users to easily input their emotional state or recognize emotions using the camera function.

[1910] Terminal

[1911] The device receives these inputs and sends them to the server, where they are properly formatted and encrypted for security and privacy.

[1912] server

[1913] server

[1914] The server receives user information and emotion data sent from the device, stores it in a database, and then sends the stored information to an AI module for analysis.

[1915] Server (AI module)

[1916] The AI ​​module analyzes the user's goals, body type, age, pain points, and emotional state to generate an optimal exercise menu. It also provides dietary advice and suggests supplements to help achieve goals. Emotional data is used to adjust exercise menus and notification methods, taking into account the user's motivation and stress level.

[1917] Providing exercise menus and checking form

[1918] server

[1919] The generated exercise menu and dietary advice are stored in a database and sent to the device, where the data is re-encrypted.

[1920] Terminal

[1921] The device displays the exercise menu and dietary advice received from the server to the user. It also notifies the user as needed to remind them to exercise. The timing and content of notifications are adjusted according to the user's emotional state. When the user exercises, the device receives the video and sends it back to the server.

[1922] server

[1923] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video, assessing accuracy and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[1924] Ongoing support

[1925] Terminal

[1926] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides character reactions based on data from the emotion engine and the ability to interact with other users to maintain ongoing motivation.

[1927] user

[1928] Users can use these features to stay motivated by continuing to exercise and by developing their character and exchanging opinions with other users. The emotion engine adjusts the character's reactions and interactions with other users based on the user's emotional state, providing a more personalized experience.

[1929] Specific examples

[1930] For example, if a 34-year-old female user wants to improve her stiff shoulders, she enters her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). The emotion engine also provides information about her stress level and motivation for the day. This information is sent to the server, where it is analyzed by the AI ​​module and emotion engine to generate an optimal exercise menu for improving stiff shoulders.

[1931] When a user receives a reminder to exercise, they follow the provided exercise menu. To check their form, they record their movements as a video and send it to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In addition, an emotion engine displays appropriate advice and encouraging messages based on the user's emotional state that day.

[1932] In this way, the system of the present invention provides users with an optimal exercise menu and provides continuous support, effectively helping them maintain their health. Furthermore, by combining it with an emotion engine, the system can provide more personalized support and maintain the user's motivation.

[1933] The processing flow will be explained below.

[1934] Step 1: Enter user information and emotion data

[1935] user

[1936] Users install and launch the application on their device. On the first launch, they enter their profile information on the registration screen that appears, including their goal (e.g., muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas they want to improve or have pain in. They can also enter their mood and stress level for the day, or use the camera function to recognize their emotions, using the emotion engine.

[1937] Step 2: Send user information and emotion data

[1938] Terminal

[1939] The terminal formats the information and emotion data entered by the user for transmission to the server, and appropriately encrypts the data before transmission.

[1940] Step 3: Storing user information and emotion data

[1941] server

[1942] The server receives user information and emotion data sent from the device and stores it in a database, after which it sends this information to the AI ​​module and emotion engine for analysis.

[1943] Step 4: Generate an exercise menu

[1944] Server (AI module and emotion engine)

[1945] The AI ​​module and emotion engine analyze the user's goals, body type, age, pain points, and emotional state to generate an optimal exercise menu. It also suggests dietary advice and supplements to help achieve goals. Emotional data is used to adjust exercise menus and notification methods, taking into account the user's motivation and stress level.

[1946] Step 5: Distribution of exercise menu

[1947] server

[1948] The generated exercise menu and dietary advice are stored in a database and prepared for transmission to the device, where the data is re-encrypted.

[1949] Step 6: View the exercise menu

[1950] Terminal

[1951] The device displays the exercise menu and dietary advice received from the server to the user. It also sends appropriate notifications to remind the user to exercise. The emotion engine adjusts the timing and content of notifications according to the user's emotional state.

[1952] Step 7: Video your exercise form

[1953] user

[1954] Users receive reminders and follow the instructions to exercise, while their movements are recorded with the device's camera.

[1955] Step 8: Submit your exercise form video

[1956] Terminal

[1957] The captured exercise form video is received, formatted for transmission to a server, and the data is encrypted before being transmitted.

[1958] Step 9: Analyze the video

[1959] Server (AI module)

[1960] The server receives the video and analyzes it using an AI module, which evaluates the exercise form and determines what corrections are needed.

[1961] Step 10: Generate improvement suggestions

[1962] Server (AI module)

[1963] Based on the results of form analysis, points that need to be corrected and new exercise menus are generated.

[1964] Step 11: Distributing improvement proposals

[1965] server

[1966] The generated improvement suggestions and new exercise menus are stored in a database and prepared for transmission to the device. The data is encrypted during transmission.

[1967] Step 12: Viewing improvement suggestions

[1968] Terminal

[1969] The device notifies the user of and displays improvement suggestions and new exercise menus received from the server.

[1970] Step 13: Support for continued exercise

[1971] Terminal

[1972] To make it easier for users to continue exercising, the app provides users with character reactions based on data from the emotion engine and the ability to interact with other users.

[1973] Step 14: Stay motivated

[1974] user

[1975] Users can maintain their motivation to exercise by developing their character and exchanging opinions with other users. The emotion engine displays appropriate encouragement messages and advice based on the user's emotional state that day, providing a personalized experience.

[1976] Specific examples

[1977] For example, if a 34-year-old female user wants to improve her stiff shoulders, she enters her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). The emotion engine also provides information about her stress level and motivation for the day. This information is sent to the server, where it is analyzed by the AI ​​module and emotion engine to generate an optimal exercise menu for improving stiff shoulders.

[1978] When a user receives a reminder to exercise, they follow the provided exercise menu. To check their form, they record their movements as a video and send it to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In addition, an emotion engine displays encouraging messages and suggestions for improvement based on the user's emotional state that day.

[1979] In this way, the system of the present invention provides users with an optimal exercise menu and provides continuous support, effectively helping them maintain their health. Furthermore, by combining it with an emotion engine, the system can provide more personalized support and maintain the user's motivation.

[1980] Example 2

[1981] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1982] Conventional exercise menu generation systems generate exercise menus based on the user's physical information, but do not take the user's emotional state into account, resulting in a lack of motivation maintenance and individualized notification content adjustment. Furthermore, while there are functions that point out differences in exercise form, they lack emotional support to support the user's continued motivation. This has led to the challenge of making it difficult for users to maintain their motivation to continue exercising.

[1983] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1984] In this invention, the server includes means for registering information about the user's body, means for generating an optimal exercise menu based on the registered information and the user's emotional state, means for notifying the user of the timing to perform the exercise menu, means for receiving videos of the user's exercise form and pointing out any discrepancies in form, means for supporting the user so that they can continue exercising, and means for adjusting the user's motivation and notification content based on emotion recognition. This makes it possible to provide a personalized exercise menu based on the user's individual physical information and emotional state, and to maintain continuous motivation.

[1985] "User" refers to a person who uses the system to create and implement an exercise menu.

[1986] "Physical information" refers to data about the user's goals, body type, age, height, weight, and pain points.

[1987] An "optimal exercise menu" is an exercise plan that is individually tailored based on the user's physical information and emotional state.

[1988] "Emotional state" refers to information that indicates a user's psychological state, such as their daily stress level and motivation.

[1989] "Notifications" are messages that inform users of the timing of exercise routines and other important notices.

[1990] "Exercise form video" refers to video data captured while a user is exercising.

[1991] "Form differences" refers to errors or discrepancies that occur between the correct exercise form and the user's actual exercise form.

[1992] "Support" refers to services and features that help users continue exercising.

[1993] "Emotion recognition" refers to technology that analyzes a user's emotional state.

[1994] "Motivation adjustment" refers to the process of changing and optimizing exercise menus and notifications based on the user's emotional state.

[1995] This invention is a system that allows users to exercise safely and effectively on a continuous basis by generating an optimal exercise menu based on the user's health condition and exercise goals, and by combining it with an emotion engine that recognizes the user's emotions. This system is realized using a user terminal, a server, an AI module, and an emotion engine.

[1996] User Device

[1997] user

[1998] First, the user installs and launches the application on their device. On the screen that appears when the application is launched, the user enters profile information such as the purpose of the exercise (e.g., muscle training, improving posture, preventing stiff shoulders and back pain, etc.), body type (height, weight), age, and areas of particular interest or pain. Furthermore, the emotion engine allows for simple input of emotional state and recognition of emotions using the camera function.

[1999] Terminal

[2000] The device receives this input information and sends it to the server, where it properly formats the data and encrypts it to protect security and privacy.

[2001] server

[2002] server

[2003] The server receives user information and emotion data sent from the device, stores it in a database, and then sends the stored information to an AI module for analysis.

[2004] Server (AI module)

[2005] The AI ​​module analyzes the user's goals, body type, age, pain points, and emotional state to generate an optimal exercise menu. It also provides dietary advice and suggests supplements to help achieve goals. Emotional data is used to adjust exercise menus and notification methods, taking into account the user's motivation and stress level.

[2006] Providing exercise menus and checking form

[2007] server

[2008] The generated exercise menu and dietary advice are stored in a database and sent to the device, where the data is re-encrypted.

[2009] Terminal

[2010] The device displays the exercise menu and dietary advice received from the server to the user. It also notifies the user as needed to remind them to exercise. The timing and content of notifications are adjusted according to the user's emotional state. When the user exercises, the device receives the video and sends it back to the server.

[2011] server

[2012] The server receives the video and requests an analysis from the AI ​​module. The AI ​​module analyzes the user's form based on the video, assessing accuracy and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[2013] Ongoing support

[2014] Terminal

[2015] The device notifies users of improvement suggestions and new exercise menus sent from the server, and also provides character reactions based on data from the emotion engine and the ability to interact with other users to maintain ongoing motivation.

[2016] user

[2017] Users can use these features to stay motivated by continuing to exercise and by developing their character and exchanging opinions with other users. The emotion engine adjusts the character's reactions and interactions with other users based on the user's emotional state, providing a more personalized experience.

[2018] Specific examples

[2019] For example, if a 34-year-old female user wants to improve her stiff shoulders, she enters her personal information into the app (purpose, height 160cm, weight 55kg, area of ​​pain, etc.). The emotion engine also provides information about her stress level and motivation for the day. This information is sent to the server, where it is analyzed by the AI ​​module and emotion engine to generate an optimal exercise menu for improving stiff shoulders.

[2020] When a user receives a reminder to exercise, they follow the provided exercise menu. To check their form, they record their movements as a video and send it to a server via the app. AI analyzes their form based on the video, and suggestions for corrections and new exercise menus are sent to the user's device. In addition, an emotion engine displays appropriate advice and encouraging messages based on the user's emotional state that day.

[2021] Example prompts for generative AI models

[2022] "Generate an exercise menu to improve shoulder stiffness for a woman in her 30s. The model is 160cm tall and weighs 55kg. Please also consider the stress level and motivation of the day."

[2023] In this way, the system of the present invention provides users with an optimal exercise menu and provides continuous support, effectively helping them maintain their health. Furthermore, by combining it with an emotion engine, the system can provide more personalized support and maintain the user's motivation.

[2024] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2025] Step 1:

[2026] Input: Profile information based on your health and fitness goals, and your emotional state

[2027] Specific operation:

[2028] After installing and launching the application, users enter their profile information, such as their exercise goals, body type, age, areas they want to improve, and areas of pain. Users also use the camera to capture their facial expressions or answer simple questions to provide their emotional state for the day (stress level and motivation).

[2029] Output: A dataset of the input profile information and emotional states

[2030] Step 2:

[2031] Input: The dataset of profile information and emotional states entered in step 1.

[2032] Specific operation:

[2033] The device converts the user input data into an appropriate format (e.g., JSON format), encrypts the data for security and privacy reasons, and then transmits it to the server using a secure communication protocol (e.g., HTTPS).

[2034] Output: Notification that encrypted profile information and emotional state data has been sent

[2035] Step 3:

[2036] Input: Encrypted profile information and emotional state data

[2037] Specific operation:

[2038] The server receives and decrypts the encrypted data sent by the device, verifies the received data to ensure its accuracy and consistency, and then stores it in a database, where it is prepared for analysis by the AI ​​module.

[2039] Output: Analysis-ready user information and emotional state data

[2040] Step 4:

[2041] Input: Analysis-ready user information and emotional state data

[2042] Specific operation:

[2043] The AI ​​module on the server analyzes the user's goals, body type, age, areas of pain, and emotional state, and uses various algorithms to generate the optimal exercise menu for the user. It also provides dietary advice and suggests supplements, and sets notification methods and timing that are best suited to the user based on their emotional state.

[2044] Output: Generated exercise menu, dietary advice, and notification settings data

[2045] Step 5:

[2046] Input: Generated exercise menu, dietary advice, and notification setting data

[2047] Specific operation:

[2048] The server stores the generated exercise menu and dietary advice in a database, encrypts the data again, and then transmits it to the terminal.

[2049] Output: Notification of completion of sending encrypted exercise menu and dietary advice data

[2050] Step 6:

[2051] Input: Encrypted exercise menu and dietary advice data

[2052] Specific operation:

[2053] The device decrypts the encrypted data received from the server and displays it to the user. Depending on the user's emotional state, the device adjusts the timing and content of reminder notifications and notifies the user appropriately.

[2054] Output: Exercise menu and dietary advice displayed on the user's screen

[2055] Step 7:

[2056] Input: Displayed exercise menu and dietary advice

[2057] Specific operation:

[2058] The user follows the exercise menu provided and performs the exercise. The camera records the user's movements during the exercise, encrypts the video, and sends it to the server via the device.

[2059] Output: Notification of completion of sending encrypted exercise form video data

[2060] Step 8:

[2061] Input: Encrypted exercise form video data

[2062] Specific operation:

[2063] The server receives and decodes the exercise form video data. The AI ​​module analyzes the video and evaluates the accuracy of the user's form and areas for improvement. If there are any errors in the form, it generates corrections and a new exercise menu and sends it back to the device.

[2064] Output: Analysis results and suggested corrections, new exercise menu

[2065] Step 9:

[2066] Input: Analysis results and suggested correction data, new exercise menu

[2067] Specific operation:

[2068] The device decodes the data received from the server and displays it to the user. It also provides character reactions and interaction with other users based on data from the emotion engine, helping to maintain motivation.

[2069] Output: Analysis results, suggested corrections, new exercise menus, and character reactions displayed on the user's screen

[2070] Step 10:

[2071] Input: Analysis results, suggested modifications, new movement menus and character reactions

[2072] Specific operation:

[2073] Users can continue exercising while referring to the displayed results, suggestions, and reactions of the character, and can maintain further motivation by using the function to interact with other users.

[2074] Output: Feedback data that encourages users to continue exercising and improve their health

[2075] (Application example 2)

[2076] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2077] In modern society, it is difficult for users to effectively continue exercising and eating to maintain their health. The objective of the present invention is to provide a system that supports healthy activities more effectively and continuously by providing optimal exercise and meal menus based on the user's health condition and exercise goals, and further adjusting notification methods and suggested content taking the user's emotional state into consideration.

[2078] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2079] In this invention, the server includes means for registering information about the user's body, means for generating optimal exercise and meal menus based on the registered information, means for notifying the user of the timing to perform the exercise and meal menus, means for receiving videos of exercise form taken by the user and pointing out differences in form, means for analyzing the user's emotional state using an emotion engine and adjusting the exercise and meal menus and notification method, and means for supporting the user to continue exercising and eating a healthy diet. This allows the user to effectively continue exercising and eating a healthy diet and receive individual support according to their emotional state in the process.

[2080] "User's physical information" refers to physiological data such as the user's body type, age, height, weight, and areas of pain.

[2081] "Exercise menu" refers to a series of training programs provided based on the user's health condition and exercise goals.

[2082] "Meal Menu" refers to an optimal meal plan suggested based on the user's health and emotional state.

[2083] An "emotion engine" refers to a software module that analyzes a user's facial expressions and input data to recognize their emotional state.

[2084] "Notification means" refers to a method or device for notifying the user of the timing of performing an exercise menu or meal menu.

[2085] "Exercise form video" refers to video data recorded by a user's own movements.

[2086] "Means for pointing out differences in form" refers to systems or algorithms that analyze videos of exercise form and point out errors in the user's movements and areas for improvement.

[2087] "Emotional state" refers to the user's psychological state, such as stress level and motivation.

[2088] "Support measures" refers to methods and systems that help users continue to exercise and eat healthy.

[2089] MODE FOR CARRYING OUT THE INVENTION

[2090] The present invention is a system that supports users' health activities by generating optimal exercise and meal menus based on the user's health condition and exercise goals, and adjusting the notification method and suggested content taking into account the user's emotional state, using a system that utilizes a user terminal, server, AI module, and emotion engine.

[2091] System configuration

[2092] User Device

[2093] The user device takes the form of a smartphone with a dedicated application installed, which includes the following functions:

[2094] 1. Data input: Users input their health information (goals, body type, age, height, weight, pain points, etc.), and then input or recognize their emotional state for the day through the emotion engine.

[2095] 2. Displaying exercise and meal menus: Displaying the exercise and meal menus sent from the server and sending reminder notifications to the user.

[2096] 3. Recording and sending video of exercise form: The user performs exercise, records the exercise as a video using the app's camera function, and sends the video to the server.

[2097] server

[2098] The server has the following features:

[2099] 1. Data reception and storage: Receives health information and emotion data sent from the user device and stores it in a database.

[2100] 2. Data analysis: The stored data is sent to the AI ​​module for analysis, and the optimal exercise and meal menus are generated based on the analysis results.

[2101] 3. Exercise form analysis: Analyzes exercise form videos submitted by users, identifies differences in form, and generates new exercise menus as needed.

[2102] 4. Data transmission: The generated exercise menu, meal menu, and form analysis results are sent to the user's device.

[2103] AI Module and Emotion Engine

[2104] The AI ​​module is built using machine learning frameworks such as TensorFlow and PyTorch. The emotion engine recognizes user emotions and provides them to the server as analysis data.

[2105] Processing flow and specific examples

[2106] 1. User Input:

[2107] A 45-year-old male user launches the app and enters his health information (goal: diet, height: 175 cm, weight: 80 kg).

[2108] It also uses an emotion engine to recognize your stress level for the day.

[2109] 2. Data transmission and analysis:

[2110] The user terminal encrypts the entered data and sends it to the server.

[2111] The server receives the data, analyzes it with an AI module, and generates optimal exercise and meal plans. For example, it suggests low-calorie, stress-relieving meals (e.g., tuna salad bowl, grilled chicken).

[2112] 3. Notifications and Reminders:

[2113] The menu and reminder notifications sent from the server are displayed on the user's device.

[2114] Send a reminder before lunch such as, "Great work! Why not try a macro-balanced tuna salad bowl today?"

[2115] 4. Exercise form feedback:

[2116] The user performs exercise, records the exercise as a video, and sends it to the server.

[2117] The server analyzes the video using an AI module, points out differences in form, and suggests new exercise menus.

[2118] Prompt Sentence Examples

[2119] Username: Yamada Taro

[2120] Age: 45

[2121] Purpose: Diet

[2122] Body type: Height 175cm, Weight 80kg

[2123] Allergies: None

[2124] Food preference: Japanese food, low calorie

[2125] Stress level: High

[2126] Question 1: Please suggest the best meal plan.

[2127] Question 2: What reminder message would you use to respond to high stress levels?

[2128] This allows users to effectively exercise and eat healthily, and receive personalized emotional support along the way.

[2129] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2130] Step 1:

[2131] User Input

[2132] The user launches the application on their device and inputs their health information (e.g., goals, body type, age, height, weight, pain points), and the emotion engine also inputs or recognizes their emotional state for the day (e.g., stress level, motivation) via the camera.

[2133] Input: Health information, emotional state

[2134] Output: Encrypted data packet

[2135] Specific behavior: The user fills out a form on the application screen and clicks the "Submit" button.

[2136] Step 2:

[2137] Data transmission

[2138] The device encrypts the entered health information and emotion data and transmits it to the server using a secure communication protocol (e.g., HTTPS).

[2139] Input: Encrypted data packet

[2140] Output: Data sent to server completed

[2141] Specific operation: Data is encrypted on the terminal side and sent to the server via the network.

[2142] Step 3:

[2143] Data Receipt and Storage

[2144] The server receives the data sent from the device and stores it in a database. When storing the data, it checks the consistency of the data format and eliminates any invalid data.

[2145] Input: Encrypted data packet

[2146] Output: Saved to database successfully

[2147] Specific operation: The server receives the data and stores it in the database.

[2148] Step 4:

[2149] Data analysis

[2150] The server sends the received data to an AI module, which generates optimal exercise and meal menus based on the user's health information and emotional state. The content of the meal menu and notification method are adjusted according to the user's emotional state.

[2151] Input: Health information, emotional state

[2152] Output: Exercise menu, meal menu

[2153] Specific operation: The AI ​​module analyzes the data and calculates the appropriate menu.

[2154] Step 5:

[2155] Send Menu

[2156] The server encrypts the generated exercise and meal menus and transmits them to the user terminal.

[2157] Input: Exercise menu, meal menu

[2158] Output: Encrypted menu data

[2159] Specific operation: The server packets the menu data and sends it to the terminal.

[2160] Step 6:

[2161] Menu display and reminders

[2162] The device displays the received exercise and meal menus to the user and sends reminder notifications at specified times.

[2163] Input: Encrypted menu data

[2164] Output: Display on user device, reminder notification

[2165] Specific operation: The device decodes the menu data and displays it in the user interface. It also sends a notification at the reminder time.

[2166] Step 7:

[2167] Photograph and submit your exercise form

[2168] The user performs exercise, takes pictures of the exercise using the device's camera function, and sends the pictures to the server.

[2169] Input: Exercise form video

[2170] Output: Encrypted video data

[2171] Specific actions: The user records a video of their exercise and clicks the "Send" button.

[2172] Step 8:

[2173] Form Analysis

[2174] The server uses an AI module to analyze the received video, pointing out any discrepancies in form and generating new exercise menus as needed.

[2175] Input: Exercise form video

[2176] Output: Form analysis results, new exercise menu

[2177] How it works: The AI ​​module analyzes the video and generates results.

[2178] Step 9:

[2179] Send Feedback

[2180] The server encrypts the analysis results and new exercise menu and sends them to the user's device.

[2181] Input: Form analysis results, new exercise menu

[2182] Output: Encrypted feedback data

[2183] Specific operation: The server encrypts the data and sends it to the device.

[2184] Step 10:

[2185] User Feedback

[2186] The device will notify the user of the results received and provide appropriate feedback, allowing the user to identify areas for improvement or new exercise routines.

[2187] Input: Encrypted feedback data

[2188] Output: Display on user terminal

[2189] Specific operation: The feedback data is decoded on the terminal and displayed on the user interface.

[2190] This series of processing steps allows users to continue optimal exercise and diet according to their health and emotional state, and allows them to engage in healthy activities while receiving appropriate feedback.

[2191] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2192] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2193] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2194] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2195] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2196] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2197] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2198] Human...

Claims

1. A means for registering information about the user's body; means for generating an optimal exercise menu based on the registered information; a means for notifying the timing of performing the exercise menu; A means for receiving a video of exercise form taken by a user and pointing out differences in form; and a means for supporting the user to continue exercising.

2. The system according to claim 1 , further comprising means for utilizing information on the user's purpose, body type, age, height, weight, and pain points in generating the exercise menu.

3. The system according to claim 1 , further comprising means for generating a new exercise menu by analyzing the exercise form video and providing the new exercise menu to the user.

Images