system
A system with a server and generative AI model provides personalized dietary and exercise plans, addressing the inadequacies of conventional health management systems by offering tailored advice and plans, thereby aiding users in achieving their health goals.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-22
- Publication Date
- 2026-03-06
AI Technical Summary
Conventional health management systems fail to provide tailored dietary and exercise plans based on individual user needs, making it difficult for users to achieve their health goals effectively.
A system that includes a server for storing user input data, analyzing dietary and exercise details, and generating personalized advice and plans, supported by a generative AI model, to provide users with specific guidance tailored to their health goals.
Enables users to receive comprehensive support for their health management, receiving advice and plans that align with their individual circumstances, facilitating effective goal achievement.
Smart Images

Figure 2026038132000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] In today's modern lifestyles, many people face challenges in managing their health. In particular, the difficulty of creating appropriate dietary and exercise plans can prevent people from achieving their target weight or maintaining sustainable health. Conventional health management methods struggle to provide advice and plans tailored to individual user needs, resulting in ineffective support. Therefore, there is a need for a system that provides appropriate advice and plans based on individual circumstances to help users achieve their health goals. [Means for solving the problem]
[0005] The present invention is a system for providing support to users to set health goals and work effectively toward those goals. The system includes an input means for the user to set health goals, a server means for storing information in a database based on the health goals, a terminal means for transmitting the meal details and exercise details entered by the user to the server, a means for the server to analyze the meal details and exercise details and generate dietary advice, a means for the server to create an exercise plan based on the exercise details and health goals, and a terminal means for presenting the generated dietary advice and exercise plan to the user. This allows users to receive specific advice and plans tailored to their individual circumstances, enabling them to work effectively toward their set health goals.
[0006] "User" refers to an individual who uses the system to set health goals and record their diet and exercise.
[0007] A "health goal" refers to a specific goal, such as weight loss or exercise goal, that a user wishes to achieve.
[0008] "Input means" refers to an interface that allows the user to input health goals, dietary details, and exercise details.
[0009] The term "server means" refers to a computer system and its management device that receives input information from users and stores it in a database.
[0010] "Terminal means" refers to a device (e.g., smartphone, tablet, or PC) through which a user inputs data and communicates with server means.
[0011] The term "dietary advice generating means" refers to a system that has the function of analyzing the user's diet and proposing appropriate meals to achieve health goals.
[0012] "Exercise plan creation means" refers to a system that has the function of analyzing the user's exercise content and creating a personalized exercise plan toward health goals.
[0013] "Database" refers to a collection of information that is stored by a server means for analysis and processing.
[0014] "Dietary details" refers to detailed information about the meals a user takes in daily (e.g., calories, nutrients, etc.).
[0015] "Exercise content" refers to detailed information about the exercise a user performs daily (e.g., type of exercise, duration, intensity, etc.). [Brief explanation of the drawings]
[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0018] First, the terms used in the following description will be explained.
[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0024] [First embodiment]
[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0037] The present invention relates to a system that provides support for users to set health goals and work effectively toward those goals. This system supports health management by providing dietary advice and exercise plans based on information entered by the user.
[0038] As a concrete embodiment of this system, the processing of the program will be explained below in natural language.
[0039] User Registration and Login
[0040] The user first launches the application and enters information such as their name, email address, and password on the new registration screen.
[0041] The terminal transmits the input information to the server.
[0042] The server stores the received information in a database and generates a user ID.
[0043] After registering, the user enters their email address and password on the login screen for authentication.
[0044] The server compares the input information with the information in the database and determines whether the authentication is successful. If the authentication is successful, it generates an authentication token and sends it to the terminal.
[0045] The terminal receives the authentication token and uses it when accessing the server in subsequent operations.
[0046] goal setting
[0047] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[0048] The terminal transmits the inputted goal to the server.
[0049] The server stores the target information in a database.
[0050] The terminal displays a confirmation message to the user that the settings have been completed.
[0051] Health Record
[0052] The user opens an input screen to record their daily diet and exercise.
[0053] The dietary information includes the type and amount of food consumed, calories, nutrients, etc.
[0054] The type of exercise, time, intensity, etc. are input as exercise content.
[0055] The terminal transmits the input information to the server.
[0056] The server stores the received information in a database.
[0057] The terminal displays a message to the user confirming that the save is complete.
[0058] Providing dietary advice
[0059] The server analyzes nutritional balance based on the user's food records.
[0060] Based on the analysis results, the server generates appropriate dietary advice that matches the user's health goals, such as "eat more vegetables" or "cut back on your calorie intake."
[0061] The server transmits the generated advice to the terminal.
[0062] The terminal displays the received advice to the user.
[0063] Providing exercise plans
[0064] The server creates a personalized exercise plan based on the user's exercise records and goals, taking into account the frequency, type, and duration of exercise.
[0065] For example, it generates a specific exercise plan such as "a plan that includes jogging and strength training three times a week."
[0066] The server sends the created exercise plan to the terminal.
[0067] The terminal displays the received exercise plan to the user.
[0068] In this way, the system can provide comprehensive support for users' health management and provide specific advice and plans to effectively work toward set goals. As a result, users receive support tailored to their individual circumstances, making it easier for them to achieve their health goals.
[0069] The processing flow will be explained below.
[0070] User Registration and Login
[0071] User Registration
[0072] Step 1:
[0073] The user launches the application and enters information such as their name, email address, and password on the new registration screen.
[0074] Step 2:
[0075] The terminal transmits the input user information to the server.
[0076] Step 3:
[0077] The server stores the received user information in a database and generates a user ID.
[0078] Step 4:
[0079] The server returns the registration result to the terminal.
[0080] Log in
[0081] Step 1:
[0082] The user enters their email address and password on the login screen.
[0083] Step 2:
[0084] The terminal sends authentication information to the server and requests authentication.
[0085] Step 3:
[0086] The server checks the information in the database and determines whether or not to allow login.
[0087] Step 4:
[0088] If the authentication is successful, the server generates an authentication token and returns it to the terminal.
[0089] Step 5:
[0090] When the terminal receives the authentication token, it displays the main screen to the user.
[0091] goal setting
[0092] Step 1:
[0093] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[0094] Step 2:
[0095] The terminal transmits the inputted goal to the server.
[0096] Step 3:
[0097] The server stores the target information in a database.
[0098] Step 4:
[0099] The server returns a notification of completion of the setting to the terminal.
[0100] Step 5:
[0101] The terminal displays a screen to the user confirming the set goal.
[0102] Health Record
[0103] Step 1:
[0104] The user opens an input screen to record their daily diet and exercise.
[0105] Step 2:
[0106] The user inputs the details of their diet (type and amount of food ingested, calories, nutrients, etc.) and exercise details (type of exercise, time, intensity, etc.).
[0107] Step 3:
[0108] The terminal transmits the input information to the server.
[0109] Step 4:
[0110] The server stores the received information in a database.
[0111] Step 5:
[0112] The server returns a notification of completion of saving to the terminal.
[0113] Step 6:
[0114] The terminal displays a screen to the user confirming the entered information.
[0115] Providing dietary advice
[0116] Step 1:
[0117] The server retrieves the user's food record data from the database.
[0118] Step 2:
[0119] The server analyzes nutritional balance based on the acquired data.
[0120] Step 3:
[0121] Based on the analysis results, the server generates dietary advice that matches health goals.
[0122] Step 4:
[0123] The server transmits the generated dietary advice to the terminal.
[0124] Step 5:
[0125] The terminal displays the received dietary advice to the user.
[0126] Providing exercise plans
[0127] Step 1:
[0128] The server retrieves the user's exercise record data and health goals from a database.
[0129] Step 2:
[0130] Based on the acquired data, the server analyzes an exercise plan that takes into account the frequency, type, and duration of exercise.
[0131] Step 3:
[0132] The server creates a personalized exercise plan based on the analysis results.
[0133] Step 4:
[0134] The server sends the created exercise plan to the terminal.
[0135] Step 5:
[0136] The terminal displays the received exercise plan to the user.
[0137] The above is a detailed step-by-step explanation of the program's processing, which allows users to receive specific support for managing their health.
[0138] Example 1
[0139] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0140] In modern society, health management is an important concern for many people. However, few systems provide continuous, specific advice and plans tailored to individual lifestyles and health conditions. This makes it difficult for users to receive support to effectively achieve their health goals. Furthermore, existing health management systems have technical limitations in providing detailed analysis and generating personalized plans based on diet and exercise records, and specific improvements are needed to improve the user experience.
[0141] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0142] In this invention, the server includes a generating AI model means, a means for analyzing the dietary details and exercise details to generate dietary advice, and a means for creating an exercise plan based on the exercise details and health goals, thereby enabling users to continuously receive specific advice and plans tailored to their individual lifestyles and health conditions.
[0143] "User" refers to an individual who uses the health care system.
[0144] "Health goal" refers to a specific health-related goal that a user sets to achieve.
[0145] "Input means" refers to a device or interface that allows a user to input information.
[0146] "Server means" refers to a computing system for processing, storing, and managing data.
[0147] A "database" refers to a system for systematically storing, managing, and retrieving information.
[0148] "Terminal means" refers to a device used by a user that has the function of sending and receiving information.
[0149] "Generative AI modeling means" refers to technology that uses artificial intelligence to analyze data and generate specific advice and plans.
[0150] "Dietary advice" refers to instructions recommending a nutritionally balanced diet based on the user's eating habits.
[0151] An "exercise plan" refers to a specific exercise schedule created based on a user's exercise habits and health goals.
[0152] "Presentation means" refers to an interface for displaying the generated advice and plan to the user.
[0153] These definitions allow for a precise understanding of each element of the system and clarify the scope of the claims.
[0154] The present invention relates to a system that provides support for users to set health goals and work effectively toward those goals. This system supports health management by providing dietary advice and exercise plans based on information entered by the user.
[0155] System configuration
[0156] This system is mainly composed of three components: a server, a terminal, and a user. These components work together to provide personalized health management support to users.
[0157] Hardware and software used
[0158] 1. Server: Processes, stores, and manages data. This can be a general cloud server or a dedicated server.
[0159] 2. Terminal: A device through which a user inputs and receives information. This includes smartphones, tablets, and computers.
[0160] 3. Generative AI models: Artificial intelligence software for generating dietary advice and exercise plans, primarily using the latest deep learning techniques.
[0161] Details of data processing and calculation
[0162] User Registration and Login
[0163] A user launches an application and enters information such as their name, email address, and password.
[0164] The terminal sends the entered information to the server using an HTTP POST request.
[0165] The server stores the received information in a database and uses an SQL query to register new users, along with their authentication information.
[0166] Setting Health Goals
[0167] The user inputs a specific health goal (e.g., "lose 5 kilos").
[0168] The terminal sends the target information to the server via an HTTP POST request.
[0169] The server stores the target information in a database and returns a setting completion message to the terminal.
[0170] Daily health record
[0171] The user inputs the details of meals, calorie intake, exercise, etc.
[0172] The device sends this information to the server via an HTTP POST request.
[0173] The server stores the information in a database and sends a confirmation message back to the terminal.
[0174] Providing dietary advice
[0175] The server analyzes the user's food records stored in a database.
[0176] The generative AI model uses food record data as input prompts to analyze nutritional balance. For example, the following prompts are used:
[0177] "The user's recent food log shows a lot of carbohydrates and vitamin C. What other nutrients should they be getting?"
[0178] The server receives the advice generated by the generative AI model and sends it to the device.
[0179] The device then displays the received advice to the user, for example, "You should eat more vegetables."
[0180] Providing exercise plans
[0181] The server analyzes the user's exercise information recorded in the database.
[0182] The generative AI model uses exercise recording data as input prompts to create a personalized exercise plan, for example, using the following prompt sentences:
[0183] "The user's exercise log includes 30 minutes of jogging every week. Based on this log, create a plan for jogging and strength training three times a week."
[0184] The server receives the motion plan generated by the generative AI model and sends it to the terminal.
[0185] The device then displays the received exercise plan to the user, such as a specific plan such as "jogging three times a week (30 minutes each time) and strength training twice a week (45 minutes each time)."
[0186] Specific examples
[0187] This system analyzes the dietary and exercise data entered by the user, and the generative AI model provides personalized advice and plans based on the results. For example, if a user selects "I want to do aerobic exercise five days a week," the server will generate an appropriate exercise schedule based on the user's exercise record and display it on the device.
[0188] This system provides comprehensive support for users' health management and provides specific advice and plans tailored to individual lifestyles, enabling users to effectively achieve their health goals.
[0189] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0190] Step 1:
[0191] The user launches the application and enters information such as name, email address, and password on the new registration screen.
[0192] Input: Name, Email Address, Password
[0193] Specific behavior: The information entered by the user is entered into the application's input fields.
[0194] Step 2:
[0195] The terminal transmits the input information to the server.
[0196] Input: Registration information entered by the user
[0197] What happens: The user's registration information is sent to the server's registration API endpoint using an HTTP POST request.
[0198] Output: Registration information sent to the server
[0199] Step 3:
[0200] The server stores the received information in a database and generates a new user ID.
[0201] Input: Received user registration information
[0202] Specific data manipulation: An SQL query (e.g. INSERT INTO users (name, email, password) VALUES (?, ?, ?);) is executed.
[0203] Output: User information stored in the database and the generated user ID.
[0204] Step 4:
[0205] After registering, the user enters their email address and password on the login screen.
[0206] Input: Email address, Password
[0207] What happens: The login information entered by the user is entered into the application's input fields.
[0208] Step 5:
[0209] The terminal sends the login information to the server.
[0210] Input: The login information entered by the user
[0211] What happens: Your login information is sent to the server's authentication API using an HTTP POST request.
[0212] Output: Login information sent to the server
[0213] Step 6:
[0214] The server compares the information stored in the database with the information entered by the user and performs authentication.
[0215] Input: User login information
[0216] Specific data manipulation: Searching the database with an SQL query (e.g. SELECT FROM users WHERE email = ? AND password = ?;).
[0217] Output: Authentication token (if authentication is successful)
[0218] Step 7:
[0219] The server generates an authentication token and sends it to the terminal.
[0220] Input: Successfully authenticated login information
[0221] Specific operation: Generates a JSON Web Token (JWT) and sends it to the device in the HTTP response.
[0222] Output: Authentication token sent to the device
[0223] Step 8:
[0224] Users access the creator dashboard and enter their health goal (e.g., "lose 5 kilos").
[0225] Enter: Health Goals
[0226] Specific behavior: The goal entered by the user is entered into the application's input field.
[0227] Step 9:
[0228] The terminal transmits the health goal to the server.
[0229] Input: User-entered health goals
[0230] What happens: Goal information is sent to the server's goal setting API using an HTTP POST request.
[0231] Output: Health goals sent to the server
[0232] Step 10:
[0233] The server stores the target information in a database.
[0234] Input: User-entered health goals
[0235] Specific data manipulation: Issue an SQL query (e.g., INSERT INTO goals (user_id, goal_description) VALUES (?, ?);).
[0236] Output: Health goal information stored in a database
[0237] Step 11:
[0238] The terminal receives a confirmation message from the server confirming the completion of the setup and displays it to the user.
[0239] Input: Response from the server
[0240] Specific behavior: Receives the HTTP response and displays a confirmation message in the UI that the settings have been completed.
[0241] Step 12:
[0242] The user opens a screen to input their daily diet and exercise routine. For example, they can input "toast and orange juice" for breakfast and "30 minutes of jogging" for exercise.
[0243] Input: Meal details, exercise details
[0244] What happens: The user's input is entered into the application's input field.
[0245] Step 13:
[0246] The terminal transmits the input information to the server.
[0247] Input: User-recorded diet and exercise information
[0248] What happens: Record information is sent to the server's Record API using an HTTP POST request.
[0249] Output: Record information sent to the server
[0250] Step 14:
[0251] The server stores the received information in a database.
[0252] Input: Information recorded by the user
[0253] Specific data manipulation: Issue an SQL query (e.g., INSERT INTO health_records (user_id, record_type, record_details) VALUES (?, ?, ?);).
[0254] Output: Record information stored in a database
[0255] Step 15:
[0256] The terminal receives a save completion message from the server and displays it to the user.
[0257] Input: Response from the server
[0258] Specific behavior: Receives the HTTP response and displays a message in the UI confirming that the save was successful.
[0259] Step 16:
[0260] The server analyzes the user's food records stored in a database.
[0261] Input: User's food log data
[0262] Specific data manipulation: Using a generative AI model, food log data is analyzed as an input prompt. For example, the following prompt sentence is used:
[0263] "The user's recent food log shows a lot of carbohydrates and vitamin C. What other nutrients should they be getting?"
[0264] Output: Dietary advice as a result of the analysis
[0265] Step 17:
[0266] The server transmits the generated advice to the terminal.
[0267] Input: Advice generated by a generative AI model
[0268] Specific operation: JSON data containing advice content is sent to the terminal in the HTTP response.
[0269] Output: Dietary advice sent to the device
[0270] Step 18:
[0271] The terminal displays the received advice to the user.
[0272] Input: Advice received from the server
[0273] Specific behavior: Display an advice message in the UI, for example, "You should eat more vegetables."
[0274] Step 19:
[0275] The server analyzes the user's exercise information recorded in the database.
[0276] Input: User's exercise log data
[0277] Specific data manipulation: Using a generative AI model, the exercise record data is analyzed as an input prompt. For example, the following prompt sentence is used:
[0278] "The user's exercise log includes 30 minutes of jogging every week. Based on this log, create a plan for jogging and strength training three times a week."
[0279] Output: Motion plan as the analysis result
[0280] Step 20:
[0281] The server transmits the generated exercise plan to the terminal.
[0282] Input: A motion plan generated by a generative AI model
[0283] Specific operation: JSON data containing the exercise plan details is sent to the device in the HTTP response.
[0284] Output: The exercise plan sent to the device
[0285] Step 21:
[0286] The terminal displays the received exercise plan to the user.
[0287] Input: Movement plan received from the server
[0288] Specific action: Display an exercise plan message on the UI. For example, a specific plan such as "Jogging three times a week (30 minutes each time) and strength training twice a week (45 minutes each time)."
[0289] Through the above steps, this system can comprehensively support the user's health management and provide specific advice and plans tailored to each individual's lifestyle habits.
[0290] (Application example 1)
[0291] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0292] Many factory workers tend to neglect their health management in the midst of their daily work, which often leads to long-term health problems and reduced productivity. Furthermore, they have few opportunities to receive advice on diet and exercise in between their busy work schedules, making it difficult to manage their health efficiently. Furthermore, it is not easy to instantly provide dietary advice and exercise plans tailored to each individual employee.
[0293] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0294] In this invention, the server is mounted on a factory robot to support health management of employees in a factory environment, and includes means for presenting the generated dietary advice and exercise plan to employees, means for the dietary advice generation means to compare the employee's goals with their current eating habits to calculate nutritional values and suggest meals containing nutrients that are lacking, and means for the exercise plan creation means to analyze the employee's goals and current exercise status and create personalized exercise plans on a weekly basis, thereby enabling factory employees to efficiently manage their health according to their individual circumstances.
[0295] A "health goal" is a specific health condition that a user or factory employee wants to achieve or a goal of a health habit that the user wants to improve.
[0296] "Input means" refers to a device or interface that allows a user or factory employee to input information such as health goals, daily diet, and exercise details.
[0297] "Server means" refers to a server and its functions for storing input data and performing necessary analysis and processing.
[0298] "Terminal means" refers to a device used by a user or factory employee to input data or to check advice or plans.
[0299] "Dietary advice generation means" refers to a function that analyzes the inputted meal contents and suggests appropriate meals based on nutritional balance.
[0300] The "exercise plan creation means" is a function that creates an exercise plan suitable for the user based on the input exercise content and health goals.
[0301] "Factory robots" refer to automated systems and devices installed within a factory environment to assist with employee health management.
[0302] This invention is a system that supports employee health management in a factory environment. In particular, it aims to provide employees with dietary advice and exercise plans to help them set health goals and work effectively toward those goals.
[0303] Hardware and software used
[0304] Server: Stores and analyzes data, generates advice, and creates exercise plans.
[0305] Terminal: A device (e.g., smartphone, touchscreen, factory robot) through which an employee enters data and receives advice and exercise plans.
[0306] Database: Use a relational database such as SQLite to store employee health information and goals.
[0307] Generative AI model: An AI model that generates nutritional balance and exercise plans based on input data.
[0308] User Registration and Login
[0309] Users (factory employees) use touch panels installed in the factory or a dedicated smartphone app to enter their name, employee ID, password, etc. and register with the system. The server stores the received information in a database and generates a user ID for authentication. The user then logs in using their email address and password, and the server authenticates the entered information.
[0310] goal setting
[0311] After logging in, users can set specific health goals, such as "lose 5 kilos" or "improve physical fitness." The device sends this information to the server, which then stores it in a database.
[0312] Health Record
[0313] Every day, users input their dietary and exercise information. For example, they record their dietary information such as "chicken breast, vegetable salad, and apple" and their exercise information such as "30 minutes of jogging." This information is sent from the device to the server, which then stores it in a database.
[0314] Providing dietary advice
[0315] The server analyzes the dietary information entered by the user and evaluates the nutritional balance using a generative AI model. For example, it generates specific advice such as "eat more vegetables" or "cut back on fat." The generated dietary advice is sent to the device and presented to the user.
[0316] Providing exercise plans
[0317] The server uses a generative AI model to create a personalized exercise plan based on the user's input and health goals. For example, it might suggest a plan that includes jogging and strength training three times a week. The generated exercise plan is then sent to the device and presented to the user.
[0318] Specific examples
[0319] An employee sets a goal of losing 5 kilograms.
[0320] Meal contents: "Chicken breast, vegetable salad, and apple"
[0321] Exercise: "30 minutes of jogging"
[0322] By entering these, the server generates suggestions such as "Eat more vegetables" and "A plan that includes jogging and strength training three times a week," and displays them on the user's device.
[0323] The present invention enables employees in a factory environment to efficiently manage their health in a way that is suited to their individual circumstances, which is expected to prevent health problems and improve productivity.
[0324] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0325] Step 1:
[0326] Users set health goals
[0327] Input: The user fills out an application form and enters a specific health goal, such as "lose 5 kilos."
[0328] Specific behavior: The user enters information and presses the submit button.
[0329] Output: The device sends the entered health goals to the server, which stores the received information in a database and registers the user's goals.
[0330] Step 2:
[0331] Record your daily health status
[0332] Input: The user inputs their daily diet and exercise information into the application. Examples: "chicken breast, vegetable salad, apple" or "30 minutes of jogging."
[0333] Specific actions: The user enters information about their diet and exercise and presses the submit button.
[0334] Output: The device sends the entered diet and exercise information to the server, which stores the received information in a database.
[0335] Step 3:
[0336] Generate dietary advice
[0337] Input: The server retrieves the user's daily dietary information stored in a database.
[0338] Specific operation: The server uses a generative AI model to evaluate meal content from the perspective of nutritional balance.
[0339] Output: The server analyzes the nutritional balance, generates specific advice such as "eat more vegetables" or "cut back on fat," and sends it to the device. The device then displays the received dietary advice to the user.
[0340] Step 4:
[0341] Create an exercise plan
[0342] Input: The server retrieves the user's exercise and health goals stored in a database.
[0343] Specific actions: The server uses a generative AI model to create a personalized exercise plan for the user.
[0344] Output: The server proposes a plan that includes jogging and strength training three times a week and sends it to the device. The device displays the received exercise plan to the user.
[0345] Step 5:
[0346] Present advice and plans to users
[0347] Input: Dietary advice and exercise plan data sent from the server.
[0348] Specific operation: The device displays the received data on the screen and presents it to the user, who can then check the advice and plan to help with daily health management.
[0349] Output: The user follows the advice and plan provided and works towards their health goals.
[0350] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0351] The present invention is a system that provides support to users to set health goals and work effectively towards those goals, and in particular, by combining it with an emotion engine that recognizes the user's emotional state, it provides more personalized and effective advice and plans.
[0352] As a concrete embodiment of this system, the processing of the program will be explained below in natural language.
[0353] User Registration and Login
[0354] The user first launches the application and enters information such as their name, email address, and password on the new registration screen.
[0355] The terminal transmits the input user information to the server.
[0356] The server stores the received information in a database and generates a user ID.
[0357] After registering, the user enters their email address and password on the login screen for authentication.
[0358] The server compares the input information with the information in the database and determines whether the authentication is successful. If the authentication is successful, it generates an authentication token and sends it to the terminal.
[0359] The terminal receives the authentication token and uses it when accessing the server in subsequent operations.
[0360] goal setting
[0361] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[0362] The terminal transmits the inputted goal to the server.
[0363] The server stores the target information in a database.
[0364] The terminal displays a confirmation message to the user that the settings have been completed.
[0365] Health Record
[0366] The user opens an input screen to record their daily diet and exercise.
[0367] Dietary information includes the type and amount of food consumed, calories, nutrients, etc. Exercise information includes the type, duration, and intensity of exercise.
[0368] The terminal transmits the input information to the server.
[0369] The server stores the received information in a database.
[0370] The terminal displays a message to the user confirming that the save is complete.
[0371] Emotion recognition by emotion engine
[0372] While the user is using the app, their voice and facial expressions are captured through the device's built-in camera and microphone.
[0373] The terminal transmits the captured data to the server.
[0374] The server uses an emotion engine to analyze the user's voice and facial expression data and recognize their emotional state.
[0375] For example, if a user is feeling stressed or tired, their emotional state is recognized.
[0376] Providing dietary advice
[0377] The server analyzes the user's nutritional balance based on their food record data and their perceived emotional state.
[0378] The server generates appropriate dietary advice based on the analysis results, the user's health goals, and their emotional state, such as "increase your protein intake to increase your energy."
[0379] The server transmits the generated dietary advice to the terminal.
[0380] The terminal displays the received dietary advice to the user.
[0381] Providing exercise plans
[0382] The server analyzes an exercise plan based on the user's exercise record data, health goals, and recognized emotional state, taking into account the frequency, type, and duration of exercise.
[0383] The server then creates a personalized exercise plan based on the analysis results, the user's health goals, and their emotional state, suggesting specific exercise plans such as "incorporating relaxing yoga."
[0384] The server sends the created exercise plan to the terminal.
[0385] The terminal displays the received exercise plan to the user.
[0386] In this way, the system can provide comprehensive support for the user's health management, providing specific advice and plans to effectively work towards set goals, and by recognizing the user's emotional state, it can provide more personalized support.
[0387] The processing flow will be explained below.
[0388] User Registration and Login
[0389] User Registration
[0390] Step 1:
[0391] The user launches the application and enters information such as their name, email address, and password on the new registration screen.
[0392] Step 2:
[0393] The terminal transmits the input user information to the server.
[0394] Step 3:
[0395] The server stores the received user information in a database and generates a user ID.
[0396] Step 4:
[0397] The server returns the registration result to the terminal.
[0398] Log in
[0399] Step 1:
[0400] The user enters their email address and password on the login screen.
[0401] Step 2:
[0402] The terminal sends authentication information to the server and requests authentication.
[0403] Step 3:
[0404] The server checks the information in the database and determines whether or not to allow login.
[0405] Step 4:
[0406] If the authentication is successful, the server generates an authentication token and returns it to the terminal.
[0407] Step 5:
[0408] The terminal receives the authentication token and displays the main screen to the user.
[0409] goal setting
[0410] Step 1:
[0411] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[0412] Step 2:
[0413] The terminal transmits the inputted goal to the server.
[0414] Step 3:
[0415] The server stores the target information in a database.
[0416] Step 4:
[0417] The server returns a notification of completion of the setting to the terminal.
[0418] Step 5:
[0419] The terminal displays a screen to the user confirming the set goal.
[0420] Health Record
[0421] Step 1:
[0422] The user opens an input screen to record their daily diet and exercise.
[0423] Step 2:
[0424] The user inputs the details of their diet (type and amount of food ingested, calories, nutrients, etc.) and exercise details (type of exercise, time, intensity, etc.).
[0425] Step 3:
[0426] The terminal transmits the input information to the server.
[0427] Step 4:
[0428] The server stores the received information in a database.
[0429] Step 5:
[0430] The server returns a notification of completion of saving to the terminal.
[0431] Step 6:
[0432] The terminal displays a screen to the user confirming the entered information.
[0433] Emotion recognition by emotion engine
[0434] Step 1:
[0435] While the user is using the app, their voice and facial expressions are captured through the device's built-in camera and microphone.
[0436] Step 2:
[0437] The terminal transmits the captured audio and video data to the server.
[0438] Step 3:
[0439] The server analyzes the received data using an emotion engine to recognize the user's emotional state.
[0440] Step 4:
[0441] The server stores the recognized emotional states in a database.
[0442] Providing dietary advice
[0443] Step 1:
[0444] The server retrieves the user's food log data and perceived emotional state from a database.
[0445] Step 2:
[0446] The server analyzes nutritional balance based on the acquired data.
[0447] Step 3:
[0448] The server generates appropriate dietary advice based on the analysis results, the user's health goals, and the user's perceived emotional state. For example, a user feeling stressed might be advised to "increase their intake of B vitamins."
[0449] Step 4:
[0450] The server transmits the generated dietary advice to the terminal.
[0451] Step 5:
[0452] The terminal displays the received dietary advice to the user.
[0453] Providing exercise plans
[0454] Step 1:
[0455] The server retrieves the user's exercise record data, health goals, and perceived emotional state from a database.
[0456] Step 2:
[0457] Based on the acquired data, the server analyzes plans such as the frequency, type, and duration of exercise.
[0458] Step 3:
[0459] The server then creates a personalized exercise plan based on the analysis, the user's health goals, and their perceived emotional state. For example, a user who feels fatigued might be offered an exercise plan that includes relaxing yoga.
[0460] Step 4:
[0461] The server sends the created exercise plan to the terminal.
[0462] Step 5:
[0463] The terminal displays the received exercise plan to the user.
[0464] These are the specific processing steps of the program for the system that combines the emotion engine. This system enables users to receive personalized support for managing their health.
[0465] Example 2
[0466] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0467] Conventional health management systems mainly provide general advice and exercise plans based on the user's diet and exercise records, and it is difficult to provide personalized support that takes into account the emotional state of each individual user. As a result, there has been an issue of insufficient effective support for users to achieve their health goals.
[0468] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0469] In this invention, the server includes input means for a user to set a health goal, server means for saving information in a database based on the health goal, terminal means for transmitting the meal details and exercise details input by the user to the server, means for the server to analyze the meal details and exercise details and generate dietary advice, means for the server to create an exercise plan based on the exercise details and the health goal, terminal means for presenting the generated dietary advice and exercise plan to the user, means for capturing voice and facial expression data of the user using sensor means installed in the terminal, means for the server to recognize the user's emotional state using the captured voice and facial expression data, and means for the server to personalize advice and exercise plans based on the recognized emotional state. This enables individual support that takes the user's emotional state into consideration and makes it possible to provide effective support for the user to achieve their health goal.
[0470] "User" refers to an individual who utilizes the system to set and receive assistance in achieving health goals.
[0471] "Input means" refers to the interface on the terminal used by the user to set health goals and input other required information.
[0472] The "server means" refers to an information processing device that receives data such as health goals, diet, and exercise sent by the user and stores it in a database.
[0473] The term "terminal means" refers to an information processing device used by the user to input meal details and exercise details and transmit the data to the server.
[0474] The term "analysis means" refers to the process in which the server analyzes the user's dietary and exercise details and generates appropriate dietary advice.
[0475] The term "exercise plan creation means" refers to the process in which the server creates an individual exercise plan based on the user's exercise content and health goals.
[0476] The "sensor means" refers to a device that captures the user's voice and facial expression data using input devices such as a camera and microphone installed on the terminal.
[0477] The "emotion recognition means" refers to a process in which the server analyzes the user's voice and facial expression data captured by the sensor means and recognizes the user's emotional state.
[0478] "Personalization means" refers to a process for generating individual dietary advice and exercise plans based on the recognized emotional state to provide optimal support to the user.
[0479] "Database" refers to an information storage system for storing and managing information such as a user's health goals, diet, exercise, and emotional state.
[0480] The present invention is a system that provides comprehensive support for users to set health goals and work effectively toward those goals, and in particular, by combining an emotion engine that recognizes the user's emotional state, it provides more personalized and effective advice and plans. Specifically, it is configured as follows.
[0481] System configuration
[0482] 1. User Input Method:
[0483] This is an interface on a device that allows users to set health goals and input other necessary information. This can be done using information processing devices such as smartphones, tablets, and PCs.
[0484] 2. Server means:
[0485] This is an information processing device that receives data such as health goals, diet, and exercise sent by users, stores it in a database, and analyzes the data to generate appropriate advice and exercise plans. The server is equipped with a database management system (DBMS) that efficiently stores and manages user information and health data.
[0486] 3. Terminal means:
[0487] This is an information processing device that transmits the dietary and exercise details entered by the user to a server. This can be a smartphone, tablet, or PC, allowing users to easily record their daily health data.
[0488] 4. Analysis methods:
[0489] This is a process in which the server analyzes the user's diet and exercise habits and generates appropriate dietary advice. For example, specialized software and algorithms are used to analyze nutritional balance and calculate calorie intake. This analysis is performed using programming languages and data analysis tools such as Python and R.
[0490] 5. Exercise planning tools:
[0491] The server creates a personalized exercise plan based on the user's exercise habits and health goals. For example, it considers the user's weekly exercise frequency, exercise type, and intensity to generate a personalized exercise plan. This process incorporates machine learning models and specialized fitness algorithms.
[0492] 6. Sensor means:
[0493] This is a device that captures the user's voice and facial expression data using input devices such as cameras and microphones installed on the device. It acquires data in real time using capture devices and sensor APIs.
[0494] 7. Emotion recognition means:
[0495] This is a process in which the server analyzes the user's voice and facial expression data captured by the sensor means and recognizes the user's emotional state. This process uses an emotion engine or machine learning model. For example, Microsoft's Azure Cognitive Services or Google's Cloud Natural Language API can be used.
[0496] 8. Personalization methods:
[0497] This process generates personalized dietary advice and exercise plans based on the recognized emotional state, providing optimal support to the user. This provides optimal health support according to the user's emotions.
[0498] Specific examples
[0499] The user sets a goal of "lose 5 kg" and enters the information into the application's input screen.
[0500] The terminal sends this information to a server, which stores the information in a database.
[0501] The user records their daily diet and exercise habits, and facial expression data is captured via a camera.
[0502] The server analyzes the user's diet and exercise habits to generate nutritional advice based on nutritional balance. It also recognizes when the user is feeling stressed from the captured facial expression data and generates an exercise plan to reduce stress.
[0503] Dietary advice suggests "eating lots of protein," and exercise plan suggests "doing relaxing yoga three times a week."
[0504] Prompt Sentence Examples
[0505] What is the registration process? From the moment a user enters their email address and password, until the server saves the information.
[0506]
[0507] What is the process for setting a health goal? For example, how would a user set a goal to "lose 5 kilos"?
[0508]
[0509] What is the procedure for recording food and exercise? Please explain in detail how users can enter their daily food and exercise information.
[0510]
[0511] Please explain how the emotion engine recognizes the user's emotions. For example, if the user is tired, how does the camera recognize that facial expression and send it to the server?
[0512]
[0513] Please tell me the procedure for analyzing nutritional balance based on the user's dietary data and providing advice. Please explain in detail what kind of advice is generated for a user in a stressed state.
[0514]
[0515] Please explain your procedure for providing exercise plans that take into account the user's emotional state. For example, how would you create an exercise plan for a user in a stressed state?
[0516] In this way, the present invention realizes a system that comprehensively supports the user's health management and provides specific advice and plans to effectively work toward set goals. Furthermore, by recognizing the user's emotional state, it becomes possible to provide more personalized support.
[0517] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0518] System program processing flow
[0519] We will explain it in steps and add specific actions for each step.
[0520] User Registration and Login
[0521] Step 1: User enters information
[0522] The user launches the application and enters their name, email address, and password on the new registration screen.
[0523] Input: Name, email address, password
[0524] Specific action: The user enters "Yamada Taro", "taro@example.com", and "password123" into the smartphone app.
[0525] Step 2: Sending information by device
[0526] The terminal transmits the input user information to the server.
[0527] Output: User information (name, email address, password)
[0528] Specific operation: The device sends input information to the server via Wi-Fi or mobile network.
[0529] Step 3: Server storage and verification
[0530] The server validates the information received, stores it in a database, and generates a user ID.
[0531] Input: User information (name, email address, password)
[0532] Output: User ID, confirmation message
[0533] Specific operation: The server generates a unique user ID "user123" for "taro@example.com" and saves it in the database.
[0534] Step 4: Login screen and authentication
[0535] After registering, the user enters their email address and password on the login screen.
[0536] Input: Email address, password
[0537] Specific action: The user opens the app again and enters the login information "taro@example.com" and "password123".
[0538] Step 5: Device sends authentication information
[0539] The terminal transmits the entered authentication information to the server.
[0540] Output: Authentication information (email address, password)
[0541] Specific operation: The terminal sends the entered authentication information to the server.
[0542] Step 6: Authentication with the Server and Token Generation
[0543] The server checks the authentication information against the information in its database and, if authentication is successful, generates an authentication token.
[0544] Input: Authentication information (email address, password)
[0545] Output: Authentication token, authentication result
[0546] Specific operation: The server verifies that the entered information is correct and generates an authentication token for "abcdef123456".
[0547] Step 7: Receive and view your tokens
[0548] The terminal receives the authentication token and uses it when accessing the server in subsequent operations.
[0549] Output: Show authentication token
[0550] Specific operation: The terminal displays the authentication token "abcdef123456" to the user and saves it.
[0551] goal setting
[0552] Step 1: Enter your goals
[0553] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[0554] Enter: Health Goals
[0555] Specific operation: The user sets a goal of "lose 5 kg."
[0556] Step 2: Send target information
[0557] The terminal transmits the input health goal to the server.
[0558] Output: Health goal information
[0559] Specific operation: The device sends "lose 5 kg" to the server.
[0560] Step 3: Target storage and verification by the server
[0561] The server stores the target information in a database.
[0562] Input: Health goal information
[0563] Output:Confirmation message
[0564] Specific operation: The server saves the goal information in the database and returns the message "Goal setting completed."
[0565] Step 4: Goal setting completion display
[0566] The terminal displays a confirmation message to the user that the settings have been completed.
[0567] Output: Display a confirmation message
[0568] Specific operation: The device displays the message "Goal setting completed" to the user.
[0569] Health Record
[0570] Step 1: View the recording screen
[0571] The user opens an input screen to record their daily diet and exercise.
[0572] Specific actions: The user opens the app and accesses the screen for inputting meal and exercise details.
[0573] Step 2: Enter your diet and exercise details
[0574] Users enter details such as the type and amount of food consumed, calories, nutrients, type of exercise, time, and intensity.
[0575] Input: Meal details, exercise details
[0576] Specific actions: The user inputs "Breakfast: 50g of oatmeal, 200kcal" or "Exercise: 30 minutes of running."
[0577] Step 3: Sending data
[0578] The terminal transmits the input information to the server.
[0579] Output: Meal data, exercise data
[0580] Specific operation: The terminal transmits this information to the server.
[0581] Step 4: Data storage by server
[0582] The server stores the received information in a database.
[0583] Input: Meal data, exercise data
[0584] Output: Save complete message
[0585] Specific operation: The server saves the received information in the database and returns a message saying "Data saved."
[0586] Step 5: Save complete
[0587] The terminal displays a message to the user confirming that the save is complete.
[0588] Output: Display a confirmation message
[0589] Specific operation: The device displays the message "Data saved" to the user.
[0590] Emotion recognition by emotion engine
[0591] Step 1: Collecting emotion data
[0592] While the user is using the app, the device's built-in camera and microphone capture their voice and facial expressions.
[0593] Input: Voice data, facial expression data
[0594] Specific operation: The camera records the user's facial expressions as video data, and the microphone collects audio data.
[0595] Step 2: Sending data
[0596] The terminal transmits the captured data to the server.
[0597] Output: Captured data
[0598] Specific operation: Video and audio data are sent to the server in real time.
[0599] Step 3: Analyze emotional state
[0600] The server analyzes the transmitted data and recognizes the user's emotional state.
[0601] Input: Captured data
[0602] Output: Emotional state data
[0603] Specific operation: The server uses an emotion engine to analyze the data and recognize that the user is, for example, "feeling stressed."
[0604] Providing dietary advice
[0605] Step 1: Analyze the data
[0606] The server analyzes nutritional balance based on the user's food record data and perceived emotional state.
[0607] Input: Food record data, emotional state data
[0608] Output: Analysis results
[0609] Specific operation: The server analyzes the data and identifies nutritional balance and nutrient deficiencies.
[0610] Step 2: Advice generation
[0611] The server generates appropriate dietary advice based on the analysis results and the user's health goals and emotional state.
[0612] Input: Analysis results, health goals, emotional state data
[0613] Output: Dietary advice
[0614] Specific operation: The server generates advice such as "Eat more protein to reduce stress."
[0615] Step 3: Submitting and viewing advice
[0616] The server transmits the generated dietary advice to the terminal.
[0617] The terminal displays the received advice to the user.
[0618] Input: Dietary advice
[0619] Output: Display advice
[0620] Specific operation: The device displays a message to the user saying, "To reduce stress, eat more protein."
[0621] Providing exercise plans
[0622] Step 1: Analyzing the exercise data
[0623] The server analyzes an exercise plan that takes into account the frequency and type of exercise based on the user's exercise record data, health goals, and emotional state.
[0624] Input: Exercise record data, health goals, emotional state data
[0625] Output: Analysis results
[0626] Specific operation: The server analyzes the data and figures out, for example, how much exercise you should do per week.
[0627] Step 2: Create an exercise plan
[0628] The server creates a personalized exercise plan based on the analysis results.
[0629] Input: Analysis results
[0630] Output: Movement plan
[0631] Specific actions: The server generates an exercise plan such as "do relaxing yoga three times a week."
[0632] Step 3: Send and view your exercise plan
[0633] The server sends the created exercise plan to the terminal.
[0634] The terminal displays the received exercise plan to the user.
[0635] Input: Exercise plan
[0636] Output: Display of exercise plan
[0637] Specific action: The device displays an exercise plan to the user: "Do relaxing yoga three times a week."
[0638] (Application example 2)
[0639] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0640] Conventional health management systems provide uniform advice and plans without considering the user's emotional state, which has the problem of not effectively addressing individual health goals. Furthermore, guidance that ignores the user's current psychological state makes it difficult to support sustainable health management.
[0641] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: input means for a user to set a health goal; server means for saving information in a database based on the health goal; terminal means for transmitting the meal details and exercise details input by the user to the server; means for capturing the user's voice and facial expression through a camera and microphone mounted on the terminal; means for the server to analyze the meal details and exercise details and generate dietary advice; means for the server to create an exercise plan based on the exercise details and health goal; means for the server to analyze the user's voice and facial expression data using an emotion engine and recognize the user's emotional state; means for the server to generate dietary advice and an exercise plan taking the recognized emotional state into consideration; terminal means for presenting the generated dietary advice and exercise plan to the user; and means for the server to suggest an appropriate dietary plan based on the generated dietary advice. This makes it possible to provide personalized dietary advice and exercise plans that take the user's individual emotional state into consideration.
[0642] "Input means" refers to a means by which a user can set their own health goals and input related information.
[0643] The "server means" is a means for receiving information sent from a user, storing it in a database, and performing various processes based on the information.
[0644] "Terminal means" refers to a device used by a user, and is a means for transmitting input data to a server and presenting information from the server to the user.
[0645] "Means for capturing voice and facial expressions" through "cameras and microphones" refers to devices or functions for photographing or recording the user's facial expressions and voice and collecting that data.
[0646] The "means for generating dietary advice" is a means for analyzing dietary data input by the user and proposing dietary advice in line with the user's health goals.
[0647] The "means for creating an exercise plan" is a means for creating an exercise plan suitable for the user based on the exercise data and health goals input by the user.
[0648] An "emotion engine" refers to a system or algorithm that analyzes a user's voice and facial expression data to recognize the user's current emotional state.
[0649] The "means for recognizing an emotional state" is a means for analyzing the user's voice and facial expression data using an emotion engine to identify the user's emotions.
[0650] The "means for generating dietary advice and exercise plans" refers to means for providing optimal dietary and exercise suggestions based on the perceived emotional state and health goals.
[0651] The "means for proposing a meal plan" is a means for proposing an appropriate meal plan to the user based on the generated meal advice.
[0652] A "health advice system" is a comprehensive system that supports users in managing their health and effectively working towards set health goals.
[0653] The present invention provides a system that supports a user's health management and provides personalized advice combined with an emotion engine to achieve health goals. Specific embodiments of this system are described below.
[0654] System configuration
[0655] This system consists of a user terminal, a server, an emotion engine, and a database. Users access the system using devices such as smartphones and tablets. The server processes data sent from the user, and the emotion engine analyzes the user's voice and facial expression data.
[0656] Program processing explanation
[0657] 1. User Registration and Login:
[0658] The user first launches the application and enters information such as their name, email address, and password on the new registration screen. The device sends the entered user information to the server, which then stores the received information in a database. After registering, the user enters their email address and password on the login screen for authentication.
[0659] 2. Goal Setting:
[0660] After logging in, the user opens the goal setting screen and enters a specific health goal, such as "lose 5 kg." The device then sends the entered goal to the server, which then stores the goal information in a database.
[0661] 3. Health Records:
[0662] The user opens an input screen to record their daily diet and exercise. Dietary information includes the type and amount of food consumed, calories, nutrients, etc., and exercise information includes the type, time, and intensity of exercise. The device sends this information to the server, which then stores it in a database.
[0663] 4. Emotion Recognition with Emotion Engine:
[0664] While a user is using the app, their voice and facial expressions are captured through the device's built-in camera and microphone. The device then sends the captured data to a server, which then uses an emotion engine to analyze the user's voice and facial expression data and recognize their emotional state. For example, if the user is feeling stressed or tired, that emotional state is recognized.
[0665] 5. Providing dietary advice:
[0666] The server analyzes the nutritional balance based on the user's food record data and the user's recognized emotional state. The server generates appropriate dietary advice based on the analysis results, the user's health goals, and the user's emotional state. For example, the advice may be "increase your energy intake by eating more protein."
[0667] 6. Providing exercise plans:
[0668] The server analyzes the user's exercise record data, health goals, and recognized emotional state to create an exercise plan that takes into account the frequency, type, and duration of exercise. The server then creates a personalized exercise plan based on the analysis results, the user's health goals, and their emotional state. For example, it suggests a specific exercise plan such as "incorporating relaxing yoga."
[0669] Hardware and Software Used
[0670] This system consists of a mobile device such as a user's smartphone or tablet, a server, and an emotion engine. The emotion engine uses commercial software such as "EmotionEngine." The database uses MySQL (registered trademark) or PostgreSQL. The server is operated as a cloud service such as AWS (registered trademark) or Google Cloud.
[0671] Examples of concrete examples and prompts
[0672] For example, if a user is feeling stressed about their weight loss goal, they could input the following prompts into the generative AI model:
[0673] "If a user is trying to lose weight, what diet and exercise recommendations would you recommend if they are feeling stressed?"
[0674] Based on the prompts, the system suggests protein-rich meals and relaxing exercise plans, allowing users to receive optimal health care tailored to their emotional state.
[0675] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0676] Step 1:
[0677] The user launches the application and enters information such as their name, email address, and password on the new registration screen. The device sends this information to the server. The server stores the received information in a database, generates a user ID, and returns it to the device. This allows the user to register their information in the existing database.
[0678] Step 2:
[0679] The user attempts to log in by entering their email address and password on the login screen. The device sends this information to the server. The server compares it with the registered information in the database and determines whether the authentication is successful. If the authentication is successful, an authentication token is generated and returned to the device. This allows the user to log in and access the server in subsequent operations.
[0680] Step 3:
[0681] After logging in, the user opens the goal setting screen and enters a specific health goal, such as "lose 5 kg." The device then sends this goal to the server, which then stores the goal information in a database. This registers the user's health goal in the database.
[0682] Step 4:
[0683] The user opens an input screen to record their daily diet and exercise. Dietary information includes the type and amount of food consumed, calories, nutrients, etc., and exercise information includes the type, time, and intensity of exercise. The device then sends this information to the server, which then stores the received information in a database. This records the user's health data.
[0684] Step 5:
[0685] While the user is using the app, their voice and facial expressions are captured through the device's built-in camera and microphone. The device then sends this data to the server. The server then uses an emotion engine to analyze the voice and facial expression data and recognize the user's emotional state. The recognized emotional state is then stored in a database. This records the user's psychological state.
[0686] Step 6:
[0687] The server analyzes the nutritional balance based on the user's dietary records and the user's recognized emotional state. This includes data processing such as calculating nutrient deficiencies and suggesting ways to supplement them. The server then generates appropriate dietary advice based on the analysis results, the user's health goals, and the user's emotional state, and sends it to the device. This provides the user with specific dietary advice.
[0688] Step 7:
[0689] The server analyzes the user's exercise plan, taking into account the frequency, type, and duration of exercise based on the user's exercise record data, health goals, and emotional state. This includes data calculations such as "optimizing the exercise plan according to the user's physical fitness level." The server then creates a personalized exercise plan and sends it to the device, providing the user with a specific exercise plan.
[0690] Step 8:
[0691] The server proposes an appropriate meal plan based on the generated dietary advice. This includes data processing such as "proposing menus based on current ingredient inventory and the user's preferences." The terminal displays the meal plan to the user and allows them to place an order. This allows the user to easily select an appropriate meal plan and place an order.
[0692] In this way, the system provides comprehensive support for the user's health management, providing specific advice and plans to effectively work towards set goals, and by recognizing the user's emotional state, it can provide more personalized support.
[0693] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0694] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0695] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0696] [Second embodiment]
[0697] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0698] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0699] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0700] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0701] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0702] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0703] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0704] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0705] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0706] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0707] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0708] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0709] The present invention relates to a system that provides support for users to set health goals and work effectively toward those goals. This system supports health management by providing dietary advice and exercise plans based on information entered by the user.
[0710] As a concrete embodiment of this system, the processing of the program will be explained below in natural language.
[0711] User Registration and Login
[0712] The user first launches the application and enters information such as their name, email address, and password on the new registration screen.
[0713] The terminal transmits the input information to the server.
[0714] The server stores the received information in a database and generates a user ID.
[0715] After registering, the user enters their email address and password on the login screen for authentication.
[0716] The server compares the input information with the information in the database and determines whether the authentication is successful. If the authentication is successful, it generates an authentication token and sends it to the terminal.
[0717] The terminal receives the authentication token and uses it when accessing the server in subsequent operations.
[0718] goal setting
[0719] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[0720] The terminal transmits the inputted goal to the server.
[0721] The server stores the target information in a database.
[0722] The terminal displays a confirmation message to the user that the settings have been completed.
[0723] Health Record
[0724] The user opens an input screen to record their daily diet and exercise.
[0725] The dietary information includes the type and amount of food consumed, calories, nutrients, etc.
[0726] The type of exercise, time, intensity, etc. are input as exercise content.
[0727] The terminal transmits the input information to the server.
[0728] The server stores the received information in a database.
[0729] The terminal displays a message to the user confirming that the save is complete.
[0730] Providing dietary advice
[0731] The server analyzes nutritional balance based on the user's food records.
[0732] Based on the analysis results, the server generates appropriate dietary advice that matches the user's health goals, such as "eat more vegetables" or "cut back on your calorie intake."
[0733] The server transmits the generated advice to the terminal.
[0734] The terminal displays the received advice to the user.
[0735] Providing exercise plans
[0736] The server creates a personalized exercise plan based on the user's exercise records and goals, taking into account the frequency, type, and duration of exercise.
[0737] For example, it generates a specific exercise plan such as "a plan that includes jogging and strength training three times a week."
[0738] The server sends the created exercise plan to the terminal.
[0739] The terminal displays the received exercise plan to the user.
[0740] In this way, the system can provide comprehensive support for users' health management and provide specific advice and plans to effectively work toward set goals. As a result, users receive support tailored to their individual circumstances, making it easier for them to achieve their health goals.
[0741] The processing flow will be explained below.
[0742] User Registration and Login
[0743] User Registration
[0744] Step 1:
[0745] The user launches the application and enters information such as their name, email address, and password on the new registration screen.
[0746] Step 2:
[0747] The terminal transmits the input user information to the server.
[0748] Step 3:
[0749] The server stores the received user information in a database and generates a user ID.
[0750] Step 4:
[0751] The server returns the registration result to the terminal.
[0752] Log in
[0753] Step 1:
[0754] The user enters their email address and password on the login screen.
[0755] Step 2:
[0756] The terminal sends authentication information to the server and requests authentication.
[0757] Step 3:
[0758] The server checks the information in the database and determines whether or not to allow login.
[0759] Step 4:
[0760] If the authentication is successful, the server generates an authentication token and returns it to the terminal.
[0761] Step 5:
[0762] When the terminal receives the authentication token, it displays the main screen to the user.
[0763] goal setting
[0764] Step 1:
[0765] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[0766] Step 2:
[0767] The terminal transmits the inputted goal to the server.
[0768] Step 3:
[0769] The server stores the target information in a database.
[0770] Step 4:
[0771] The server returns a notification of completion of the setting to the terminal.
[0772] Step 5:
[0773] The terminal displays a screen to the user confirming the set goal.
[0774] Health Record
[0775] Step 1:
[0776] The user opens an input screen to record their daily diet and exercise.
[0777] Step 2:
[0778] The user inputs the details of their diet (type and amount of food ingested, calories, nutrients, etc.) and exercise details (type of exercise, time, intensity, etc.).
[0779] Step 3:
[0780] The terminal transmits the input information to the server.
[0781] Step 4:
[0782] The server stores the received information in a database.
[0783] Step 5:
[0784] The server returns a notification of completion of saving to the terminal.
[0785] Step 6:
[0786] The terminal displays a screen to the user confirming the entered information.
[0787] Providing dietary advice
[0788] Step 1:
[0789] The server retrieves the user's food record data from the database.
[0790] Step 2:
[0791] The server analyzes nutritional balance based on the acquired data.
[0792] Step 3:
[0793] Based on the analysis results, the server generates dietary advice that matches health goals.
[0794] Step 4:
[0795] The server transmits the generated dietary advice to the terminal.
[0796] Step 5:
[0797] The terminal displays the received dietary advice to the user.
[0798] Providing exercise plans
[0799] Step 1:
[0800] The server retrieves the user's exercise record data and health goals from a database.
[0801] Step 2:
[0802] Based on the acquired data, the server analyzes an exercise plan that takes into account the frequency, type, and duration of exercise.
[0803] Step 3:
[0804] The server creates a personalized exercise plan based on the analysis results.
[0805] Step 4:
[0806] The server sends the created exercise plan to the terminal.
[0807] Step 5:
[0808] The terminal displays the received exercise plan to the user.
[0809] The above is a detailed step-by-step explanation of the program's processing, which allows users to receive specific support for managing their health.
[0810] Example 1
[0811] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0812] In modern society, health management is an important concern for many people. However, few systems provide continuous, specific advice and plans tailored to individual lifestyles and health conditions. This makes it difficult for users to receive support to effectively achieve their health goals. Furthermore, existing health management systems have technical limitations in providing detailed analysis and generating personalized plans based on diet and exercise records, and specific improvements are needed to improve the user experience.
[0813] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0814] In this invention, the server includes a generating AI model means, a means for analyzing the dietary details and exercise details to generate dietary advice, and a means for creating an exercise plan based on the exercise details and health goals, thereby enabling users to continuously receive specific advice and plans tailored to their individual lifestyles and health conditions.
[0815] "User" refers to an individual who uses the health care system.
[0816] "Health goal" refers to a specific health-related goal that a user sets to achieve.
[0817] "Input means" refers to a device or interface that allows a user to input information.
[0818] "Server means" refers to a computing system for processing, storing, and managing data.
[0819] A "database" refers to a system for systematically storing, managing, and retrieving information.
[0820] "Terminal means" refers to a device used by a user that has the function of sending and receiving information.
[0821] "Generative AI modeling means" refers to technology that uses artificial intelligence to analyze data and generate specific advice and plans.
[0822] "Dietary advice" refers to instructions recommending a nutritionally balanced diet based on the user's eating habits.
[0823] An "exercise plan" refers to a specific exercise schedule created based on a user's exercise habits and health goals.
[0824] "Presentation means" refers to an interface for displaying the generated advice and plan to the user.
[0825] These definitions allow for a precise understanding of each element of the system and clarify the scope of the claims.
[0826] The present invention relates to a system that provides support for users to set health goals and work effectively toward those goals. This system supports health management by providing dietary advice and exercise plans based on information entered by the user.
[0827] System configuration
[0828] This system is mainly composed of three components: a server, a terminal, and a user. These components work together to provide personalized health management support to users.
[0829] Hardware and software used
[0830] 1. Server: Processes, stores, and manages data. This can be a general cloud server or a dedicated server.
[0831] 2. Terminal: A device through which a user inputs and receives information. This includes smartphones, tablets, and computers.
[0832] 3. Generative AI models: Artificial intelligence software for generating dietary advice and exercise plans, primarily using the latest deep learning techniques.
[0833] Details of data processing and calculation
[0834] User Registration and Login
[0835] A user launches an application and enters information such as their name, email address, and password.
[0836] The terminal sends the entered information to the server using an HTTP POST request.
[0837] The server stores the received information in a database and uses an SQL query to register new users, along with their authentication information.
[0838] Setting Health Goals
[0839] The user inputs a specific health goal (e.g., "lose 5 kilos").
[0840] The terminal sends the target information to the server via an HTTP POST request.
[0841] The server stores the target information in a database and returns a setting completion message to the terminal.
[0842] Daily health record
[0843] The user inputs the details of meals, calorie intake, exercise, etc.
[0844] The device sends this information to the server via an HTTP POST request.
[0845] The server stores the information in a database and sends a confirmation message back to the terminal.
[0846] Providing dietary advice
[0847] The server analyzes the user's food records stored in a database.
[0848] The generative AI model uses food record data as input prompts to analyze nutritional balance. For example, the following prompts are used:
[0849] "The user's recent food log shows a lot of carbohydrates and vitamin C. What other nutrients should they be getting?"
[0850] The server receives the advice generated by the generative AI model and sends it to the device.
[0851] The device then displays the received advice to the user, for example, "You should eat more vegetables."
[0852] Providing exercise plans
[0853] The server analyzes the user's exercise information recorded in the database.
[0854] The generative AI model uses exercise recording data as input prompts to create a personalized exercise plan, for example, using the following prompt sentences:
[0855] "The user's exercise log includes 30 minutes of jogging every week. Based on this log, create a plan for jogging and strength training three times a week."
[0856] The server receives the motion plan generated by the generative AI model and sends it to the terminal.
[0857] The device then displays the received exercise plan to the user, such as a specific plan such as "jogging three times a week (30 minutes each time) and strength training twice a week (45 minutes each time)."
[0858] Specific examples
[0859] This system analyzes the dietary and exercise data entered by the user, and the generative AI model provides personalized advice and plans based on the results. For example, if a user selects "I want to do aerobic exercise five days a week," the server will generate an appropriate exercise schedule based on the user's exercise record and display it on the device.
[0860] This system provides comprehensive support for users' health management and provides specific advice and plans tailored to individual lifestyles, enabling users to effectively achieve their health goals.
[0861] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0862] Step 1:
[0863] The user launches the application and enters information such as name, email address, and password on the new registration screen.
[0864] Input: Name, Email Address, Password
[0865] Specific behavior: The information entered by the user is entered into the application's input fields.
[0866] Step 2:
[0867] The terminal transmits the input information to the server.
[0868] Input: Registration information entered by the user
[0869] What happens: The user's registration information is sent to the server's registration API endpoint using an HTTP POST request.
[0870] Output: Registration information sent to the server
[0871] Step 3:
[0872] The server stores the received information in a database and generates a new user ID.
[0873] Input: Received user registration information
[0874] Specific data manipulation: An SQL query (e.g. INSERT INTO users (name, email, password) VALUES (?, ?, ?);) is executed.
[0875] Output: User information stored in the database and the generated user ID.
[0876] Step 4:
[0877] After registering, the user enters their email address and password on the login screen.
[0878] Input: Email address, Password
[0879] What happens: The login information entered by the user is entered into the application's input fields.
[0880] Step 5:
[0881] The terminal sends the login information to the server.
[0882] Input: The login information entered by the user
[0883] What happens: Your login information is sent to the server's authentication API using an HTTP POST request.
[0884] Output: Login information sent to the server
[0885] Step 6:
[0886] The server compares the information stored in the database with the information entered by the user and performs authentication.
[0887] Input: User login information
[0888] Specific data manipulation: Searching the database with an SQL query (e.g. SELECT FROM users WHERE email = ? AND password = ?;).
[0889] Output: Authentication token (if authentication is successful)
[0890] Step 7:
[0891] The server generates an authentication token and sends it to the terminal.
[0892] Input: Successfully authenticated login information
[0893] Specific operation: Generates a JSON Web Token (JWT) and sends it to the device in the HTTP response.
[0894] Output: Authentication token sent to the device
[0895] Step 8:
[0896] Users access the creator dashboard and enter their health goal (e.g., "lose 5 kilos").
[0897] Enter: Health Goals
[0898] Specific behavior: The goal entered by the user is entered into the application's input field.
[0899] Step 9:
[0900] The terminal transmits the health goal to the server.
[0901] Input: User-entered health goals
[0902] What happens: Goal information is sent to the server's goal setting API using an HTTP POST request.
[0903] Output: Health goals sent to the server
[0904] Step 10:
[0905] The server stores the target information in a database.
[0906] Input: User-entered health goals
[0907] Specific data manipulation: Issue an SQL query (e.g., INSERT INTO goals (user_id, goal_description) VALUES (?, ?);).
[0908] Output: Health goal information stored in a database
[0909] Step 11:
[0910] The terminal receives a confirmation message from the server confirming the completion of the setup and displays it to the user.
[0911] Input: Response from the server
[0912] Specific behavior: Receives the HTTP response and displays a confirmation message in the UI that the settings have been completed.
[0913] Step 12:
[0914] The user opens a screen to input their daily diet and exercise routine. For example, they can input "toast and orange juice" for breakfast and "30 minutes of jogging" for exercise.
[0915] Input: Meal details, exercise details
[0916] What happens: The user's input is entered into the application's input field.
[0917] Step 13:
[0918] The terminal transmits the input information to the server.
[0919] Input: User-recorded diet and exercise information
[0920] What happens: Record information is sent to the server's Record API using an HTTP POST request.
[0921] Output: Record information sent to the server
[0922] Step 14:
[0923] The server stores the received information in a database.
[0924] Input: Information recorded by the user
[0925] Specific data manipulation: Issue an SQL query (e.g., INSERT INTO health_records (user_id, record_type, record_details) VALUES (?, ?, ?);).
[0926] Output: Record information stored in a database
[0927] Step 15:
[0928] The terminal receives a save completion message from the server and displays it to the user.
[0929] Input: Response from the server
[0930] Specific behavior: Receives the HTTP response and displays a message in the UI confirming that the save was successful.
[0931] Step 16:
[0932] The server analyzes the user's food records stored in a database.
[0933] Input: User's food log data
[0934] Specific data manipulation: Using a generative AI model, food log data is analyzed as an input prompt. For example, the following prompt sentence is used:
[0935] "The user's recent food log shows a lot of carbohydrates and vitamin C. What other nutrients should they be getting?"
[0936] Output: Dietary advice as a result of the analysis
[0937] Step 17:
[0938] The server transmits the generated advice to the terminal.
[0939] Input: Advice generated by a generative AI model
[0940] Specific operation: JSON data containing advice content is sent to the terminal in the HTTP response.
[0941] Output: Dietary advice sent to the device
[0942] Step 18:
[0943] The terminal displays the received advice to the user.
[0944] Input: Advice received from the server
[0945] Specific behavior: Display an advice message in the UI, for example, "You should eat more vegetables."
[0946] Step 19:
[0947] The server analyzes the user's exercise information recorded in the database.
[0948] Input: User's exercise log data
[0949] Specific data manipulation: Using a generative AI model, the exercise record data is analyzed as an input prompt. For example, the following prompt sentence is used:
[0950] "The user's exercise log includes 30 minutes of jogging every week. Based on this log, create a plan for jogging and strength training three times a week."
[0951] Output: Motion plan as the analysis result
[0952] Step 20:
[0953] The server transmits the generated exercise plan to the terminal.
[0954] Input: A motion plan generated by a generative AI model
[0955] Specific operation: JSON data containing the exercise plan details is sent to the device in the HTTP response.
[0956] Output: The exercise plan sent to the device
[0957] Step 21:
[0958] The terminal displays the received exercise plan to the user.
[0959] Input: Movement plan received from the server
[0960] Specific action: Display an exercise plan message on the UI. For example, a specific plan such as "Jogging three times a week (30 minutes each time) and strength training twice a week (45 minutes each time)."
[0961] Through the above steps, this system can comprehensively support the user's health management and provide specific advice and plans tailored to each individual's lifestyle habits.
[0962] (Application example 1)
[0963] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0964] Many factory workers tend to neglect their health management in the midst of their daily work, which often leads to long-term health problems and reduced productivity. Furthermore, they have few opportunities to receive advice on diet and exercise in between their busy work schedules, making it difficult to manage their health efficiently. Furthermore, it is not easy to instantly provide dietary advice and exercise plans tailored to each individual employee.
[0965] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0966] In this invention, the server is mounted on a factory robot to support health management of employees in a factory environment, and includes means for presenting the generated dietary advice and exercise plan to employees, means for the dietary advice generation means to compare the employee's goals with their current eating habits to calculate nutritional values and suggest meals containing nutrients that are lacking, and means for the exercise plan creation means to analyze the employee's goals and current exercise status and create personalized exercise plans on a weekly basis, thereby enabling factory employees to efficiently manage their health according to their individual circumstances.
[0967] A "health goal" is a specific health condition that a user or factory employee wants to achieve or a goal of a health habit that the user wants to improve.
[0968] "Input means" refers to a device or interface that allows a user or factory employee to input information such as health goals, daily diet, and exercise details.
[0969] "Server means" refers to a server and its functions for storing input data and performing necessary analysis and processing.
[0970] "Terminal means" refers to a device used by a user or factory employee to input data or to check advice or plans.
[0971] "Dietary advice generation means" refers to a function that analyzes the inputted meal contents and suggests appropriate meals based on nutritional balance.
[0972] The "exercise plan creation means" is a function that creates an exercise plan suitable for the user based on the input exercise content and health goals.
[0973] "Factory robots" refer to automated systems and devices installed within a factory environment to assist with employee health management.
[0974] This invention is a system that supports employee health management in a factory environment. In particular, it aims to provide employees with dietary advice and exercise plans to help them set health goals and work effectively toward those goals.
[0975] Hardware and software used
[0976] Server: Stores and analyzes data, generates advice, and creates exercise plans.
[0977] Terminal: A device (e.g., smartphone, touchscreen, factory robot) through which an employee enters data and receives advice and exercise plans.
[0978] Database: Use a relational database such as SQLite to store employee health information and goals.
[0979] Generative AI model: An AI model that generates nutritional balance and exercise plans based on input data.
[0980] User Registration and Login
[0981] Users (factory employees) use touch panels installed in the factory or a dedicated smartphone app to enter their name, employee ID, password, etc. and register with the system. The server stores the received information in a database and generates a user ID for authentication. The user then logs in using their email address and password, and the server authenticates the entered information.
[0982] goal setting
[0983] After logging in, users can set specific health goals, such as "lose 5 kilos" or "improve physical fitness." The device sends this information to the server, which then stores it in a database.
[0984] Health Record
[0985] Every day, users input their dietary and exercise information. For example, they record their dietary information such as "chicken breast, vegetable salad, and apple" and their exercise information such as "30 minutes of jogging." This information is sent from the device to the server, which then stores it in a database.
[0986] Providing dietary advice
[0987] The server analyzes the dietary information entered by the user and evaluates the nutritional balance using a generative AI model. For example, it generates specific advice such as "eat more vegetables" or "cut back on fat." The generated dietary advice is sent to the device and presented to the user.
[0988] Providing exercise plans
[0989] The server uses a generative AI model to create a personalized exercise plan based on the user's input and health goals. For example, it might suggest a plan that includes jogging and strength training three times a week. The generated exercise plan is then sent to the device and presented to the user.
[0990] Specific examples
[0991] An employee sets a goal of losing 5 kilograms.
[0992] Meal contents: "Chicken breast, vegetable salad, and apple"
[0993] Exercise: "30 minutes of jogging"
[0994] By entering these, the server generates suggestions such as "Eat more vegetables" and "A plan that includes jogging and strength training three times a week," and displays them on the user's device.
[0995] The present invention enables employees in a factory environment to efficiently manage their health in a way that is suited to their individual circumstances, which is expected to prevent health problems and improve productivity.
[0996] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0997] Step 1:
[0998] Users set health goals
[0999] Input: The user fills out an application form and enters a specific health goal, such as "lose 5 kilos."
[1000] Specific behavior: The user enters information and presses the submit button.
[1001] Output: The device sends the entered health goals to the server, which stores the received information in a database and registers the user's goals.
[1002] Step 2:
[1003] Record your daily health status
[1004] Input: The user inputs their daily diet and exercise information into the application. Examples: "chicken breast, vegetable salad, apple" or "30 minutes of jogging."
[1005] Specific actions: The user enters information about their diet and exercise and presses the submit button.
[1006] Output: The device sends the entered diet and exercise information to the server, which stores the received information in a database.
[1007] Step 3:
[1008] Generate dietary advice
[1009] Input: The server retrieves the user's daily dietary information stored in a database.
[1010] Specific operation: The server uses a generative AI model to evaluate meal content from the perspective of nutritional balance.
[1011] Output: The server analyzes the nutritional balance, generates specific advice such as "eat more vegetables" or "cut back on fat," and sends it to the device. The device then displays the received dietary advice to the user.
[1012] Step 4:
[1013] Create an exercise plan
[1014] Input: The server retrieves the user's exercise and health goals stored in a database.
[1015] Specific actions: The server uses a generative AI model to create a personalized exercise plan for the user.
[1016] Output: The server proposes a plan that includes jogging and strength training three times a week and sends it to the device. The device displays the received exercise plan to the user.
[1017] Step 5:
[1018] Present advice and plans to users
[1019] Input: Dietary advice and exercise plan data sent from the server.
[1020] Specific operation: The device displays the received data on the screen and presents it to the user, who can then check the advice and plan to help with daily health management.
[1021] Output: The user follows the advice and plan provided and works towards their health goals.
[1022] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1023] The present invention is a system that provides support to users to set health goals and work effectively towards those goals, and in particular, by combining it with an emotion engine that recognizes the user's emotional state, it provides more personalized and effective advice and plans.
[1024] As a concrete embodiment of this system, the processing of the program will be explained below in natural language.
[1025] User Registration and Login
[1026] The user first launches the application and enters information such as their name, email address, and password on the new registration screen.
[1027] The terminal transmits the input user information to the server.
[1028] The server stores the received information in a database and generates a user ID.
[1029] After registering, the user enters their email address and password on the login screen for authentication.
[1030] The server compares the input information with the information in the database and determines whether the authentication is successful. If the authentication is successful, it generates an authentication token and sends it to the terminal.
[1031] The terminal receives the authentication token and uses it when accessing the server in subsequent operations.
[1032] goal setting
[1033] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[1034] The terminal transmits the inputted goal to the server.
[1035] The server stores the target information in a database.
[1036] The terminal displays a confirmation message to the user that the settings have been completed.
[1037] Health Record
[1038] The user opens an input screen to record their daily diet and exercise.
[1039] Dietary information includes the type and amount of food consumed, calories, nutrients, etc. Exercise information includes the type, duration, and intensity of exercise.
[1040] The terminal transmits the input information to the server.
[1041] The server stores the received information in a database.
[1042] The terminal displays a message to the user confirming that the save is complete.
[1043] Emotion recognition by emotion engine
[1044] While the user is using the app, their voice and facial expressions are captured through the device's built-in camera and microphone.
[1045] The terminal transmits the captured data to the server.
[1046] The server uses an emotion engine to analyze the user's voice and facial expression data and recognize their emotional state.
[1047] For example, if a user is feeling stressed or tired, their emotional state is recognized.
[1048] Providing dietary advice
[1049] The server analyzes the user's nutritional balance based on their food record data and their perceived emotional state.
[1050] The server generates appropriate dietary advice based on the analysis results, the user's health goals, and their emotional state, such as "increase your protein intake to increase your energy."
[1051] The server transmits the generated dietary advice to the terminal.
[1052] The terminal displays the received dietary advice to the user.
[1053] Providing exercise plans
[1054] The server analyzes an exercise plan based on the user's exercise record data, health goals, and recognized emotional state, taking into account the frequency, type, and duration of exercise.
[1055] The server then creates a personalized exercise plan based on the analysis results, the user's health goals, and their emotional state, suggesting specific exercise plans such as "incorporating relaxing yoga."
[1056] The server sends the created exercise plan to the terminal.
[1057] The terminal displays the received exercise plan to the user.
[1058] In this way, the system can provide comprehensive support for the user's health management, providing specific advice and plans to effectively work towards set goals, and by recognizing the user's emotional state, it can provide more personalized support.
[1059] The processing flow will be explained below.
[1060] User Registration and Login
[1061] User Registration
[1062] Step 1:
[1063] The user launches the application and enters information such as their name, email address, and password on the new registration screen.
[1064] Step 2:
[1065] The terminal transmits the input user information to the server.
[1066] Step 3:
[1067] The server stores the received user information in a database and generates a user ID.
[1068] Step 4:
[1069] The server returns the registration result to the terminal.
[1070] Log in
[1071] Step 1:
[1072] The user enters their email address and password on the login screen.
[1073] Step 2:
[1074] The terminal sends authentication information to the server and requests authentication.
[1075] Step 3:
[1076] The server checks the information in the database and determines whether or not to allow login.
[1077] Step 4:
[1078] If the authentication is successful, the server generates an authentication token and returns it to the terminal.
[1079] Step 5:
[1080] The terminal receives the authentication token and displays the main screen to the user.
[1081] goal setting
[1082] Step 1:
[1083] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[1084] Step 2:
[1085] The terminal transmits the inputted goal to the server.
[1086] Step 3:
[1087] The server stores the target information in a database.
[1088] Step 4:
[1089] The server returns a notification of completion of the setting to the terminal.
[1090] Step 5:
[1091] The terminal displays a screen to the user confirming the set goal.
[1092] Health Record
[1093] Step 1:
[1094] The user opens an input screen to record their daily diet and exercise.
[1095] Step 2:
[1096] The user inputs the details of their diet (type and amount of food ingested, calories, nutrients, etc.) and exercise details (type of exercise, time, intensity, etc.).
[1097] Step 3:
[1098] The terminal transmits the input information to the server.
[1099] Step 4:
[1100] The server stores the received information in a database.
[1101] Step 5:
[1102] The server returns a notification of completion of saving to the terminal.
[1103] Step 6:
[1104] The terminal displays a screen to the user confirming the entered information.
[1105] Emotion recognition by emotion engine
[1106] Step 1:
[1107] While the user is using the app, their voice and facial expressions are captured through the device's built-in camera and microphone.
[1108] Step 2:
[1109] The terminal transmits the captured audio and video data to the server.
[1110] Step 3:
[1111] The server analyzes the received data using an emotion engine to recognize the user's emotional state.
[1112] Step 4:
[1113] The server stores the recognized emotional states in a database.
[1114] Providing dietary advice
[1115] Step 1:
[1116] The server retrieves the user's food log data and perceived emotional state from a database.
[1117] Step 2:
[1118] The server analyzes nutritional balance based on the acquired data.
[1119] Step 3:
[1120] The server generates appropriate dietary advice based on the analysis results, the user's health goals, and the user's perceived emotional state. For example, a user feeling stressed might be advised to "increase their intake of B vitamins."
[1121] Step 4:
[1122] The server transmits the generated dietary advice to the terminal.
[1123] Step 5:
[1124] The terminal displays the received dietary advice to the user.
[1125] Providing exercise plans
[1126] Step 1:
[1127] The server retrieves the user's exercise record data, health goals, and perceived emotional state from a database.
[1128] Step 2:
[1129] Based on the acquired data, the server analyzes plans such as the frequency, type, and duration of exercise.
[1130] Step 3:
[1131] The server then creates a personalized exercise plan based on the analysis, the user's health goals, and their perceived emotional state. For example, a user who feels fatigued might be offered an exercise plan that includes relaxing yoga.
[1132] Step 4:
[1133] The server sends the created exercise plan to the terminal.
[1134] Step 5:
[1135] The terminal displays the received exercise plan to the user.
[1136] These are the specific processing steps of the program for the system that combines the emotion engine. This system enables users to receive personalized support for managing their health.
[1137] Example 2
[1138] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1139] Conventional health management systems mainly provide general advice and exercise plans based on the user's diet and exercise records, and it is difficult to provide personalized support that takes into account the emotional state of each individual user. As a result, there has been an issue of insufficient effective support for users to achieve their health goals.
[1140] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1141] In this invention, the server includes input means for a user to set a health goal, server means for saving information in a database based on the health goal, terminal means for transmitting the meal details and exercise details input by the user to the server, means for the server to analyze the meal details and exercise details and generate dietary advice, means for the server to create an exercise plan based on the exercise details and the health goal, terminal means for presenting the generated dietary advice and exercise plan to the user, means for capturing voice and facial expression data of the user using sensor means installed in the terminal, means for the server to recognize the user's emotional state using the captured voice and facial expression data, and means for the server to personalize advice and exercise plans based on the recognized emotional state. This enables individual support that takes the user's emotional state into consideration and makes it possible to provide effective support for the user to achieve their health goal.
[1142] "User" refers to an individual who utilizes the system to set and receive assistance in achieving health goals.
[1143] "Input means" refers to the interface on the terminal used by the user to set health goals and input other required information.
[1144] The "server means" refers to an information processing device that receives data such as health goals, diet, and exercise sent by the user and stores it in a database.
[1145] The term "terminal means" refers to an information processing device used by the user to input meal details and exercise details and transmit the data to the server.
[1146] The term "analysis means" refers to the process in which the server analyzes the user's dietary and exercise details and generates appropriate dietary advice.
[1147] The term "exercise plan creation means" refers to the process in which the server creates an individual exercise plan based on the user's exercise content and health goals.
[1148] The "sensor means" refers to a device that captures the user's voice and facial expression data using input devices such as a camera and microphone installed on the terminal.
[1149] The "emotion recognition means" refers to a process in which the server analyzes the user's voice and facial expression data captured by the sensor means and recognizes the user's emotional state.
[1150] "Personalization means" refers to a process for generating individual dietary advice and exercise plans based on the recognized emotional state to provide optimal support to the user.
[1151] "Database" refers to an information storage system for storing and managing information such as a user's health goals, diet, exercise, and emotional state.
[1152] The present invention is a system that provides comprehensive support for users to set health goals and work effectively toward those goals, and in particular, by combining an emotion engine that recognizes the user's emotional state, it provides more personalized and effective advice and plans. Specifically, it is configured as follows.
[1153] System configuration
[1154] 1. User Input Method:
[1155] This is an interface on a device that allows users to set health goals and input other necessary information. This can be done using information processing devices such as smartphones, tablets, and PCs.
[1156] 2. Server means:
[1157] This is an information processing device that receives data such as health goals, diet, and exercise sent by users, stores it in a database, and analyzes the data to generate appropriate advice and exercise plans. The server is equipped with a database management system (DBMS) that efficiently stores and manages user information and health data.
[1158] 3. Terminal means:
[1159] This is an information processing device that transmits the dietary and exercise details entered by the user to a server. This can be a smartphone, tablet, or PC, allowing users to easily record their daily health data.
[1160] 4. Analysis methods:
[1161] This is a process in which the server analyzes the user's diet and exercise habits and generates appropriate dietary advice. For example, specialized software and algorithms are used to analyze nutritional balance and calculate calorie intake. This analysis is performed using programming languages and data analysis tools such as Python and R.
[1162] 5. Exercise planning tools:
[1163] The server creates a personalized exercise plan based on the user's exercise habits and health goals. For example, it considers the user's weekly exercise frequency, exercise type, and intensity to generate a personalized exercise plan. This process incorporates machine learning models and specialized fitness algorithms.
[1164] 6. Sensor means:
[1165] This is a device that captures the user's voice and facial expression data using input devices such as cameras and microphones installed on the device. It acquires data in real time using capture devices and sensor APIs.
[1166] 7. Emotion recognition means:
[1167] The server analyzes the user's voice and facial expression data captured by sensors and recognizes the user's emotional state. This process uses an emotion engine or machine learning model. For example, Microsoft's Azure Cognitive Services or Google's Cloud Natural Language API can be used.
[1168] 8. Personalization methods:
[1169] This process generates personalized dietary advice and exercise plans based on the recognized emotional state, providing optimal support to the user. This provides optimal health support according to the user's emotions.
[1170] Specific examples
[1171] The user sets a goal of "lose 5 kg" and enters the information into the application's input screen.
[1172] The terminal sends this information to a server, which stores the information in a database.
[1173] The user records their daily diet and exercise habits, and facial expression data is captured via a camera.
[1174] The server analyzes the user's diet and exercise habits to generate nutritional advice based on nutritional balance. It also recognizes when the user is feeling stressed from the captured facial expression data and generates an exercise plan to reduce stress.
[1175] Dietary advice suggests "eating lots of protein," and exercise plan suggests "doing relaxing yoga three times a week."
[1176] Prompt Sentence Examples
[1177] What is the registration process? From the moment a user enters their email address and password, until the server saves the information.
[1178]
[1179] What is the process for setting a health goal? For example, how would a user set a goal to "lose 5 kilos"?
[1180]
[1181] What is the procedure for recording food and exercise? Please explain in detail how users can enter their daily food and exercise information.
[1182]
[1183] Please explain how the emotion engine recognizes the user's emotions. For example, if the user is tired, how does the camera recognize that facial expression and send it to the server?
[1184]
[1185] Please tell me the procedure for analyzing nutritional balance based on the user's dietary data and providing advice. Please explain in detail what kind of advice is generated for a user in a stressed state.
[1186]
[1187] Please explain your procedure for providing exercise plans that take into account the user's emotional state. For example, how would you create an exercise plan for a user in a stressed state?
[1188] In this way, the present invention realizes a system that comprehensively supports the user's health management and provides specific advice and plans to effectively work toward set goals. Furthermore, by recognizing the user's emotional state, it becomes possible to provide more personalized support.
[1189] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1190] System program processing flow
[1191] We will explain it in steps and add specific actions for each step.
[1192] User Registration and Login
[1193] Step 1: User enters information
[1194] The user launches the application and enters their name, email address, and password on the new registration screen.
[1195] Input: Name, email address, password
[1196] Specific action: The user enters "Yamada Taro", "taro@example.com", and "password123" into the smartphone app.
[1197] Step 2: Sending information by device
[1198] The terminal transmits the input user information to the server.
[1199] Output: User information (name, email address, password)
[1200] Specific operation: The device sends input information to the server via Wi-Fi or mobile network.
[1201] Step 3: Server storage and verification
[1202] The server validates the information received, stores it in a database, and generates a user ID.
[1203] Input: User information (name, email address, password)
[1204] Output: User ID, confirmation message
[1205] Specific operation: The server generates a unique user ID "user123" for "taro@example.com" and saves it in the database.
[1206] Step 4: Login screen and authentication
[1207] After registering, the user enters their email address and password on the login screen.
[1208] Input: Email address, password
[1209] Specific action: The user opens the app again and enters the login information "taro@example.com" and "password123".
[1210] Step 5: Device sends authentication information
[1211] The terminal transmits the entered authentication information to the server.
[1212] Output: Authentication information (email address, password)
[1213] Specific operation: The terminal sends the entered authentication information to the server.
[1214] Step 6: Authentication with the Server and Token Generation
[1215] The server checks the authentication information against the information in its database and, if authentication is successful, generates an authentication token.
[1216] Input: Authentication information (email address, password)
[1217] Output: Authentication token, authentication result
[1218] Specific operation: The server verifies that the entered information is correct and generates an authentication token for "abcdef123456".
[1219] Step 7: Receive and view your tokens
[1220] The terminal receives the authentication token and uses it when accessing the server in subsequent operations.
[1221] Output: Show authentication token
[1222] Specific operation: The terminal displays the authentication token "abcdef123456" to the user and saves it.
[1223] goal setting
[1224] Step 1: Enter your goals
[1225] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[1226] Enter: Health Goals
[1227] Specific operation: The user sets a goal of "lose 5 kg."
[1228] Step 2: Send target information
[1229] The terminal transmits the input health goal to the server.
[1230] Output: Health goal information
[1231] Specific operation: The device sends "lose 5 kg" to the server.
[1232] Step 3: Target storage and verification by the server
[1233] The server stores the target information in a database.
[1234] Input: Health goal information
[1235] Output:Confirmation message
[1236] Specific operation: The server saves the goal information in the database and returns the message "Goal setting completed."
[1237] Step 4: Goal setting completion display
[1238] The terminal displays a confirmation message to the user that the settings have been completed.
[1239] Output: Display a confirmation message
[1240] Specific operation: The device displays the message "Goal setting completed" to the user.
[1241] Health Record
[1242] Step 1: View the recording screen
[1243] The user opens an input screen to record their daily diet and exercise.
[1244] Specific actions: The user opens the app and accesses the screen for inputting meal and exercise details.
[1245] Step 2: Enter your diet and exercise details
[1246] Users enter details such as the type and amount of food consumed, calories, nutrients, type of exercise, time, and intensity.
[1247] Input: Meal details, exercise details
[1248] Specific actions: The user inputs "Breakfast: 50g of oatmeal, 200kcal" or "Exercise: 30 minutes of running."
[1249] Step 3: Sending data
[1250] The terminal transmits the input information to the server.
[1251] Output: Meal data, exercise data
[1252] Specific operation: The terminal transmits this information to the server.
[1253] Step 4: Data storage by server
[1254] The server stores the received information in a database.
[1255] Input: Meal data, exercise data
[1256] Output: Save complete message
[1257] Specific operation: The server saves the received information in the database and returns a message saying "Data saved."
[1258] Step 5: Save complete
[1259] The terminal displays a message to the user confirming that the save is complete.
[1260] Output: Display a confirmation message
[1261] Specific operation: The device displays the message "Data saved" to the user.
[1262] Emotion recognition by emotion engine
[1263] Step 1: Collecting emotion data
[1264] While the user is using the app, the device's built-in camera and microphone capture their voice and facial expressions.
[1265] Input: Voice data, facial expression data
[1266] Specific operation: The camera records the user's facial expressions as video data, and the microphone collects audio data.
[1267] Step 2: Sending data
[1268] The terminal transmits the captured data to the server.
[1269] Output: Captured data
[1270] Specific operation: Video and audio data are sent to the server in real time.
[1271] Step 3: Analyze emotional state
[1272] The server analyzes the transmitted data and recognizes the user's emotional state.
[1273] Input: Captured data
[1274] Output: Emotional state data
[1275] Specific operation: The server uses an emotion engine to analyze the data and recognize that the user is, for example, "feeling stressed."
[1276] Providing dietary advice
[1277] Step 1: Analyze the data
[1278] The server analyzes nutritional balance based on the user's food record data and perceived emotional state.
[1279] Input: Food record data, emotional state data
[1280] Output: Analysis results
[1281] Specific operation: The server analyzes the data and identifies nutritional balance and nutrient deficiencies.
[1282] Step 2: Advice generation
[1283] The server generates appropriate dietary advice based on the analysis results and the user's health goals and emotional state.
[1284] Input: Analysis results, health goals, emotional state data
[1285] Output: Dietary advice
[1286] Specific operation: The server generates advice such as "Eat more protein to reduce stress."
[1287] Step 3: Submitting and viewing advice
[1288] The server transmits the generated dietary advice to the terminal.
[1289] The terminal displays the received advice to the user.
[1290] Input: Dietary advice
[1291] Output: Display advice
[1292] Specific operation: The device displays a message to the user saying, "To reduce stress, eat more protein."
[1293] Providing exercise plans
[1294] Step 1: Analyzing the exercise data
[1295] The server analyzes an exercise plan that takes into account the frequency and type of exercise based on the user's exercise record data, health goals, and emotional state.
[1296] Input: Exercise record data, health goals, emotional state data
[1297] Output: Analysis results
[1298] Specific operation: The server analyzes the data and figures out, for example, how much exercise you should do per week.
[1299] Step 2: Create an exercise plan
[1300] The server creates a personalized exercise plan based on the analysis results.
[1301] Input: Analysis results
[1302] Output: Movement plan
[1303] Specific actions: The server generates an exercise plan such as "do relaxing yoga three times a week."
[1304] Step 3: Send and view your exercise plan
[1305] The server sends the created exercise plan to the terminal.
[1306] The terminal displays the received exercise plan to the user.
[1307] Input: Exercise plan
[1308] Output: Display of exercise plan
[1309] Specific action: The device displays an exercise plan to the user: "Do relaxing yoga three times a week."
[1310] (Application example 2)
[1311] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1312] Conventional health management systems provide uniform advice and plans without considering the user's emotional state, which has the problem of not effectively addressing individual health goals. Furthermore, guidance that ignores the user's current psychological state makes it difficult to support sustainable health management.
[1313] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: input means for a user to set a health goal; server means for saving information in a database based on the health goal; terminal means for transmitting the meal details and exercise details input by the user to the server; means for capturing the user's voice and facial expression through a camera and microphone mounted on the terminal; means for the server to analyze the meal details and exercise details and generate dietary advice; means for the server to create an exercise plan based on the exercise details and health goal; means for the server to analyze the user's voice and facial expression data using an emotion engine and recognize the user's emotional state; means for the server to generate dietary advice and an exercise plan taking the recognized emotional state into consideration; terminal means for presenting the generated dietary advice and exercise plan to the user; and means for the server to suggest an appropriate dietary plan based on the generated dietary advice. This makes it possible to provide personalized dietary advice and exercise plans that take the user's individual emotional state into consideration.
[1314] "Input means" refers to a means by which a user can set their own health goals and input related information.
[1315] The "server means" is a means for receiving information sent from a user, storing it in a database, and performing various processes based on the information.
[1316] "Terminal means" refers to a device used by a user, and is a means for transmitting input data to a server and presenting information from the server to the user.
[1317] "Means for capturing voice and facial expressions" through "cameras and microphones" refers to devices or functions for photographing or recording the user's facial expressions and voice and collecting that data.
[1318] The "means for generating dietary advice" is a means for analyzing dietary data input by the user and proposing dietary advice in line with the user's health goals.
[1319] The "means for creating an exercise plan" is a means for creating an exercise plan suitable for the user based on the exercise data and health goals input by the user.
[1320] An "emotion engine" refers to a system or algorithm that analyzes a user's voice and facial expression data to recognize the user's current emotional state.
[1321] The "means for recognizing an emotional state" is a means for analyzing the user's voice and facial expression data using an emotion engine to identify the user's emotions.
[1322] The "means for generating dietary advice and exercise plans" refers to means for providing optimal dietary and exercise suggestions based on the perceived emotional state and health goals.
[1323] The "means for proposing a meal plan" is a means for proposing an appropriate meal plan to the user based on the generated meal advice.
[1324] A "health advice system" is a comprehensive system that supports users in managing their health and effectively working towards set health goals.
[1325] The present invention provides a system that supports a user's health management and provides personalized advice combined with an emotion engine to achieve health goals. Specific embodiments of this system are described below.
[1326] System configuration
[1327] This system consists of a user terminal, a server, an emotion engine, and a database. Users access the system using devices such as smartphones and tablets. The server processes data sent from the user, and the emotion engine analyzes the user's voice and facial expression data.
[1328] Program processing explanation
[1329] 1. User Registration and Login:
[1330] The user first launches the application and enters information such as their name, email address, and password on the new registration screen. The device sends the entered user information to the server, which then stores the received information in a database. After registering, the user enters their email address and password on the login screen for authentication.
[1331] 2. Goal Setting:
[1332] After logging in, the user opens the goal setting screen and enters a specific health goal, such as "lose 5 kg." The device then sends the entered goal to the server, which then stores the goal information in a database.
[1333] 3. Health Records:
[1334] The user opens an input screen to record their daily diet and exercise. Dietary information includes the type and amount of food consumed, calories, nutrients, etc., and exercise information includes the type, time, and intensity of exercise. The device sends this information to the server, which then stores it in a database.
[1335] 4. Emotion Recognition with Emotion Engine:
[1336] While a user is using the app, their voice and facial expressions are captured through the device's built-in camera and microphone. The device then sends the captured data to a server, which then uses an emotion engine to analyze the user's voice and facial expression data and recognize their emotional state. For example, if the user is feeling stressed or tired, that emotional state is recognized.
[1337] 5. Providing dietary advice:
[1338] The server analyzes the nutritional balance based on the user's food record data and the user's recognized emotional state. The server generates appropriate dietary advice based on the analysis results, the user's health goals, and the user's emotional state. For example, the advice may be "increase your energy intake by eating more protein."
[1339] 6. Providing exercise plans:
[1340] The server analyzes the user's exercise record data, health goals, and recognized emotional state to create an exercise plan that takes into account the frequency, type, and duration of exercise. The server then creates a personalized exercise plan based on the analysis results, the user's health goals, and their emotional state. For example, it suggests a specific exercise plan such as "incorporating relaxing yoga."
[1341] Hardware and Software Used
[1342] This system consists of a mobile device such as a user's smartphone or tablet, a server, and an emotion engine. The emotion engine uses commercial software such as "EmotionEngine." The database uses MySQL or PostgreSQL, among others. The server is operated as a cloud service such as "AWS" or "Google Cloud."
[1343] Examples of concrete examples and prompts
[1344] For example, if a user is feeling stressed about their weight loss goal, they could input the following prompts into the generative AI model:
[1345] "If a user is trying to lose weight, what diet and exercise recommendations would you recommend if they are feeling stressed?"
[1346] Based on the prompts, the system suggests protein-rich meals and relaxing exercise plans, allowing users to receive optimal health care tailored to their emotional state.
[1347] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1348] Step 1:
[1349] The user launches the application and enters information such as their name, email address, and password on the new registration screen. The device sends this information to the server. The server stores the received information in a database, generates a user ID, and returns it to the device. This allows the user to register their information in the existing database.
[1350] Step 2:
[1351] The user attempts to log in by entering their email address and password on the login screen. The device sends this information to the server. The server compares it with the registered information in the database and determines whether the authentication is successful. If the authentication is successful, an authentication token is generated and returned to the device. This allows the user to log in and access the server in subsequent operations.
[1352] Step 3:
[1353] After logging in, the user opens the goal setting screen and enters a specific health goal, such as "lose 5 kg." The device then sends this goal to the server, which then stores the goal information in a database. This registers the user's health goal in the database.
[1354] Step 4:
[1355] The user opens an input screen to record their daily diet and exercise. Dietary information includes the type and amount of food consumed, calories, nutrients, etc., and exercise information includes the type, time, and intensity of exercise. The device then sends this information to the server, which then stores the received information in a database. This records the user's health data.
[1356] Step 5:
[1357] While the user is using the app, their voice and facial expressions are captured through the device's built-in camera and microphone. The device then sends this data to the server. The server then uses an emotion engine to analyze the voice and facial expression data and recognize the user's emotional state. The recognized emotional state is then stored in a database. This records the user's psychological state.
[1358] Step 6:
[1359] The server analyzes the nutritional balance based on the user's dietary records and the user's recognized emotional state. This includes data processing such as calculating nutrient deficiencies and suggesting ways to supplement them. The server then generates appropriate dietary advice based on the analysis results, the user's health goals, and the user's emotional state, and sends it to the device. This provides the user with specific dietary advice.
[1360] Step 7:
[1361] The server analyzes the user's exercise plan, taking into account the frequency, type, and duration of exercise based on the user's exercise record data, health goals, and emotional state. This includes data calculations such as "optimizing the exercise plan according to the user's physical fitness level." The server then creates a personalized exercise plan and sends it to the device, providing the user with a specific exercise plan.
[1362] Step 8:
[1363] The server proposes an appropriate meal plan based on the generated dietary advice. This includes data processing such as "proposing menus based on current ingredient inventory and the user's preferences." The terminal displays the meal plan to the user and allows them to place an order. This allows the user to easily select an appropriate meal plan and place an order.
[1364] In this way, the system provides comprehensive support for the user's health management, providing specific advice and plans to effectively work towards set goals, and by recognizing the user's emotional state, it can provide more personalized support.
[1365] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1366] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1367] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1368] [Third embodiment]
[1369] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1370] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[1371] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1372] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1373] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1374] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1375] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1376] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1377] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1378] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1379] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1380] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1381] The present invention relates to a system that provides support for users to set health goals and work effectively toward those goals. This system supports health management by providing dietary advice and exercise plans based on information entered by the user.
[1382] As a concrete embodiment of this system, the processing of the program will be explained below in natural language.
[1383] User Registration and Login
[1384] The user first launches the application and enters information such as their name, email address, and password on the new registration screen.
[1385] The terminal transmits the input information to the server.
[1386] The server stores the received information in a database and generates a user ID.
[1387] After registering, the user enters their email address and password on the login screen for authentication.
[1388] The server compares the input information with the information in the database and determines whether the authentication is successful. If the authentication is successful, it generates an authentication token and sends it to the terminal.
[1389] The terminal receives the authentication token and uses it when accessing the server in subsequent operations.
[1390] goal setting
[1391] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[1392] The terminal transmits the inputted goal to the server.
[1393] The server stores the target information in a database.
[1394] The terminal displays a confirmation message to the user that the settings have been completed.
[1395] Health Record
[1396] The user opens an input screen to record their daily diet and exercise.
[1397] The dietary information includes the type and amount of food consumed, calories, nutrients, etc.
[1398] The type of exercise, time, intensity, etc. are input as exercise content.
[1399] The terminal transmits the input information to the server.
[1400] The server stores the received information in a database.
[1401] The terminal displays a message to the user confirming that the save is complete.
[1402] Providing dietary advice
[1403] The server analyzes nutritional balance based on the user's food records.
[1404] Based on the analysis results, the server generates appropriate dietary advice that matches the user's health goals, such as "eat more vegetables" or "cut back on your calorie intake."
[1405] The server transmits the generated advice to the terminal.
[1406] The terminal displays the received advice to the user.
[1407] Providing exercise plans
[1408] The server creates a personalized exercise plan based on the user's exercise records and goals, taking into account the frequency, type, and duration of exercise.
[1409] For example, it generates a specific exercise plan such as "a plan that includes jogging and strength training three times a week."
[1410] The server sends the created exercise plan to the terminal.
[1411] The terminal displays the received exercise plan to the user.
[1412] In this way, the system can provide comprehensive support for users' health management and provide specific advice and plans to effectively work toward set goals. As a result, users receive support tailored to their individual circumstances, making it easier for them to achieve their health goals.
[1413] The processing flow will be explained below.
[1414] User Registration and Login
[1415] User Registration
[1416] Step 1:
[1417] The user launches the application and enters information such as their name, email address, and password on the new registration screen.
[1418] Step 2:
[1419] The terminal transmits the input user information to the server.
[1420] Step 3:
[1421] The server stores the received user information in a database and generates a user ID.
[1422] Step 4:
[1423] The server returns the registration result to the terminal.
[1424] Log in
[1425] Step 1:
[1426] The user enters their email address and password on the login screen.
[1427] Step 2:
[1428] The terminal sends authentication information to the server and requests authentication.
[1429] Step 3:
[1430] The server checks the information in the database and determines whether or not to allow login.
[1431] Step 4:
[1432] If the authentication is successful, the server generates an authentication token and returns it to the terminal.
[1433] Step 5:
[1434] When the terminal receives the authentication token, it displays the main screen to the user.
[1435] goal setting
[1436] Step 1:
[1437] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[1438] Step 2:
[1439] The terminal transmits the inputted goal to the server.
[1440] Step 3:
[1441] The server stores the target information in a database.
[1442] Step 4:
[1443] The server returns a notification of completion of the setting to the terminal.
[1444] Step 5:
[1445] The terminal displays a screen to the user confirming the set goal.
[1446] Health Record
[1447] Step 1:
[1448] The user opens an input screen to record their daily diet and exercise.
[1449] Step 2:
[1450] The user inputs the details of their diet (type and amount of food ingested, calories, nutrients, etc.) and exercise details (type of exercise, time, intensity, etc.).
[1451] Step 3:
[1452] The terminal transmits the input information to the server.
[1453] Step 4:
[1454] The server stores the received information in a database.
[1455] Step 5:
[1456] The server returns a notification of completion of saving to the terminal.
[1457] Step 6:
[1458] The terminal displays a screen to the user confirming the entered information.
[1459] Providing dietary advice
[1460] Step 1:
[1461] The server retrieves the user's food record data from the database.
[1462] Step 2:
[1463] The server analyzes nutritional balance based on the acquired data.
[1464] Step 3:
[1465] Based on the analysis results, the server generates dietary advice that matches health goals.
[1466] Step 4:
[1467] The server transmits the generated dietary advice to the terminal.
[1468] Step 5:
[1469] The terminal displays the received dietary advice to the user.
[1470] Providing exercise plans
[1471] Step 1:
[1472] The server retrieves the user's exercise record data and health goals from a database.
[1473] Step 2:
[1474] Based on the acquired data, the server analyzes an exercise plan that takes into account the frequency, type, and duration of exercise.
[1475] Step 3:
[1476] The server creates a personalized exercise plan based on the analysis results.
[1477] Step 4:
[1478] The server sends the created exercise plan to the terminal.
[1479] Step 5:
[1480] The terminal displays the received exercise plan to the user.
[1481] The above is a detailed step-by-step explanation of the program's processing, which allows users to receive specific support for managing their health.
[1482] Example 1
[1483] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1484] In modern society, health management is an important concern for many people. However, few systems provide continuous, specific advice and plans tailored to individual lifestyles and health conditions. This makes it difficult for users to receive support to effectively achieve their health goals. Furthermore, existing health management systems have technical limitations in providing detailed analysis and generating personalized plans based on diet and exercise records, and specific improvements are needed to improve the user experience.
[1485] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1486] In this invention, the server includes a generating AI model means, a means for analyzing the dietary details and exercise details to generate dietary advice, and a means for creating an exercise plan based on the exercise details and health goals, thereby enabling users to continuously receive specific advice and plans tailored to their individual lifestyles and health conditions.
[1487] "User" refers to an individual who uses the health care system.
[1488] "Health goal" refers to a specific health-related goal that a user sets to achieve.
[1489] "Input means" refers to a device or interface that allows a user to input information.
[1490] "Server means" refers to a computing system for processing, storing, and managing data.
[1491] A "database" refers to a system for systematically storing, managing, and retrieving information.
[1492] "Terminal means" refers to a device used by a user that has the function of sending and receiving information.
[1493] "Generative AI modeling means" refers to technology that uses artificial intelligence to analyze data and generate specific advice and plans.
[1494] "Dietary advice" refers to instructions recommending a nutritionally balanced diet based on the user's eating habits.
[1495] An "exercise plan" refers to a specific exercise schedule created based on a user's exercise habits and health goals.
[1496] "Presentation means" refers to an interface for displaying the generated advice and plan to the user.
[1497] These definitions allow for a precise understanding of each element of the system and clarify the scope of the claims.
[1498] The present invention relates to a system that provides support for users to set health goals and work effectively toward those goals. This system supports health management by providing dietary advice and exercise plans based on information entered by the user.
[1499] System configuration
[1500] This system is mainly composed of three components: a server, a terminal, and a user. These components work together to provide personalized health management support to users.
[1501] Hardware and software used
[1502] 1. Server: Processes, stores, and manages data. This can be a general cloud server or a dedicated server.
[1503] 2. Terminal: A device through which a user inputs and receives information. This includes smartphones, tablets, and computers.
[1504] 3. Generative AI models: Artificial intelligence software for generating dietary advice and exercise plans, primarily using the latest deep learning techniques.
[1505] Details of data processing and calculation
[1506] User Registration and Login
[1507] A user launches an application and enters information such as their name, email address, and password.
[1508] The terminal sends the entered information to the server using an HTTP POST request.
[1509] The server stores the received information in a database and uses an SQL query to register new users, along with their authentication information.
[1510] Setting Health Goals
[1511] The user inputs a specific health goal (e.g., "lose 5 kilos").
[1512] The terminal sends the target information to the server via an HTTP POST request.
[1513] The server stores the target information in a database and returns a setting completion message to the terminal.
[1514] Daily health record
[1515] The user inputs the details of meals, calorie intake, exercise, etc.
[1516] The device sends this information to the server via an HTTP POST request.
[1517] The server stores the information in a database and sends a confirmation message back to the terminal.
[1518] Providing dietary advice
[1519] The server analyzes the user's food records stored in a database.
[1520] The generative AI model uses food record data as input prompts to analyze nutritional balance. For example, the following prompts are used:
[1521] "The user's recent food log shows a lot of carbohydrates and vitamin C. What other nutrients should they be getting?"
[1522] The server receives the advice generated by the generative AI model and sends it to the device.
[1523] The device then displays the received advice to the user, for example, "You should eat more vegetables."
[1524] Providing exercise plans
[1525] The server analyzes the user's exercise information recorded in the database.
[1526] The generative AI model uses exercise recording data as input prompts to create a personalized exercise plan, for example, using the following prompt sentences:
[1527] "The user's exercise log includes 30 minutes of jogging every week. Based on this log, create a plan for jogging and strength training three times a week."
[1528] The server receives the motion plan generated by the generative AI model and sends it to the terminal.
[1529] The device then displays the received exercise plan to the user, such as a specific plan such as "jogging three times a week (30 minutes each time) and strength training twice a week (45 minutes each time)."
[1530] Specific examples
[1531] This system analyzes the dietary and exercise data entered by the user, and the generative AI model provides personalized advice and plans based on the results. For example, if a user selects "I want to do aerobic exercise five days a week," the server will generate an appropriate exercise schedule based on the user's exercise record and display it on the device.
[1532] This system provides comprehensive support for users' health management and provides specific advice and plans tailored to individual lifestyles, enabling users to effectively achieve their health goals.
[1533] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1534] Step 1:
[1535] The user launches the application and enters information such as name, email address, and password on the new registration screen.
[1536] Input: Name, Email Address, Password
[1537] Specific behavior: The information entered by the user is entered into the application's input fields.
[1538] Step 2:
[1539] The terminal transmits the input information to the server.
[1540] Input: Registration information entered by the user
[1541] What happens: The user's registration information is sent to the server's registration API endpoint using an HTTP POST request.
[1542] Output: Registration information sent to the server
[1543] Step 3:
[1544] The server stores the received information in a database and generates a new user ID.
[1545] Input: Received user registration information
[1546] Specific data manipulation: An SQL query (e.g. INSERT INTO users (name, email, password) VALUES (?, ?, ?);) is executed.
[1547] Output: User information stored in the database and the generated user ID.
[1548] Step 4:
[1549] After registering, the user enters their email address and password on the login screen.
[1550] Input: Email address, Password
[1551] What happens: The login information entered by the user is entered into the application's input fields.
[1552] Step 5:
[1553] The terminal sends the login information to the server.
[1554] Input: The login information entered by the user
[1555] What happens: Your login information is sent to the server's authentication API using an HTTP POST request.
[1556] Output: Login information sent to the server
[1557] Step 6:
[1558] The server compares the information stored in the database with the information entered by the user and performs authentication.
[1559] Input: User login information
[1560] Specific data manipulation: Searching the database with an SQL query (e.g. SELECT FROM users WHERE email = ? AND password = ?;).
[1561] Output: Authentication token (if authentication is successful)
[1562] Step 7:
[1563] The server generates an authentication token and sends it to the terminal.
[1564] Input: Successfully authenticated login information
[1565] Specific operation: Generates a JSON Web Token (JWT) and sends it to the device in the HTTP response.
[1566] Output: Authentication token sent to the device
[1567] Step 8:
[1568] Users access the creator dashboard and enter their health goal (e.g., "lose 5 kilos").
[1569] Enter: Health Goals
[1570] Specific behavior: The goal entered by the user is entered into the application's input field.
[1571] Step 9:
[1572] The terminal transmits the health goal to the server.
[1573] Input: User-entered health goals
[1574] What happens: Goal information is sent to the server's goal setting API using an HTTP POST request.
[1575] Output: Health goals sent to the server
[1576] Step 10:
[1577] The server stores the target information in a database.
[1578] Input: User-entered health goals
[1579] Specific data manipulation: Issue an SQL query (e.g., INSERT INTO goals (user_id, goal_description) VALUES (?, ?);).
[1580] Output: Health goal information stored in a database
[1581] Step 11:
[1582] The terminal receives a confirmation message from the server confirming the completion of the setup and displays it to the user.
[1583] Input: Response from the server
[1584] Specific behavior: Receives the HTTP response and displays a confirmation message in the UI that the settings have been completed.
[1585] Step 12:
[1586] The user opens a screen to input their daily diet and exercise routine. For example, they can input "toast and orange juice" for breakfast and "30 minutes of jogging" for exercise.
[1587] Input: Meal details, exercise details
[1588] What happens: The user's input is entered into the application's input field.
[1589] Step 13:
[1590] The terminal transmits the input information to the server.
[1591] Input: User-recorded diet and exercise information
[1592] What happens: Record information is sent to the server's Record API using an HTTP POST request.
[1593] Output: Record information sent to the server
[1594] Step 14:
[1595] The server stores the received information in a database.
[1596] Input: Information recorded by the user
[1597] Specific data manipulation: Issue an SQL query (e.g., INSERT INTO health_records (user_id, record_type, record_details) VALUES (?, ?, ?);).
[1598] Output: Record information stored in a database
[1599] Step 15:
[1600] The terminal receives a save completion message from the server and displays it to the user.
[1601] Input: Response from the server
[1602] Specific behavior: Receives the HTTP response and displays a message in the UI confirming that the save was successful.
[1603] Step 16:
[1604] The server analyzes the user's food records stored in a database.
[1605] Input: User's food log data
[1606] Specific data manipulation: Using a generative AI model, food log data is analyzed as an input prompt. For example, the following prompt sentence is used:
[1607] "The user's recent food log shows a lot of carbohydrates and vitamin C. What other nutrients should they be getting?"
[1608] Output: Dietary advice as a result of the analysis
[1609] Step 17:
[1610] The server transmits the generated advice to the terminal.
[1611] Input: Advice generated by a generative AI model
[1612] Specific operation: JSON data containing advice content is sent to the terminal in the HTTP response.
[1613] Output: Dietary advice sent to the device
[1614] Step 18:
[1615] The terminal displays the received advice to the user.
[1616] Input: Advice received from the server
[1617] Specific behavior: Display an advice message in the UI, for example, "You should eat more vegetables."
[1618] Step 19:
[1619] The server analyzes the user's exercise information recorded in the database.
[1620] Input: User's exercise log data
[1621] Specific data manipulation: Using a generative AI model, the exercise record data is analyzed as an input prompt. For example, the following prompt sentence is used:
[1622] "The user's exercise log includes 30 minutes of jogging every week. Based on this log, create a plan for jogging and strength training three times a week."
[1623] Output: Motion plan as the analysis result
[1624] Step 20:
[1625] The server transmits the generated exercise plan to the terminal.
[1626] Input: A motion plan generated by a generative AI model
[1627] Specific operation: JSON data containing the exercise plan details is sent to the device in the HTTP response.
[1628] Output: The exercise plan sent to the device
[1629] Step 21:
[1630] The terminal displays the received exercise plan to the user.
[1631] Input: Movement plan received from the server
[1632] Specific action: Display an exercise plan message on the UI. For example, a specific plan such as "Jogging three times a week (30 minutes each time) and strength training twice a week (45 minutes each time)."
[1633] Through the above steps, this system can comprehensively support the user's health management and provide specific advice and plans tailored to each individual's lifestyle habits.
[1634] (Application example 1)
[1635] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1636] Many factory workers tend to neglect their health management in the midst of their daily work, which often leads to long-term health problems and reduced productivity. Furthermore, they have few opportunities to receive advice on diet and exercise in between their busy work schedules, making it difficult to manage their health efficiently. Furthermore, it is not easy to instantly provide dietary advice and exercise plans tailored to each individual employee.
[1637] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1638] In this invention, the server is mounted on a factory robot to support health management of employees in a factory environment, and includes means for presenting the generated dietary advice and exercise plan to employees, means for the dietary advice generation means to compare the employee's goals with their current eating habits to calculate nutritional values and suggest meals containing nutrients that are lacking, and means for the exercise plan creation means to analyze the employee's goals and current exercise status and create personalized exercise plans on a weekly basis, thereby enabling factory employees to efficiently manage their health according to their individual circumstances.
[1639] A "health goal" is a specific health condition that a user or factory employee wants to achieve or a goal of a health habit that the user wants to improve.
[1640] "Input means" refers to a device or interface that allows a user or factory employee to input information such as health goals, daily diet, and exercise details.
[1641] "Server means" refers to a server and its functions for storing input data and performing necessary analysis and processing.
[1642] "Terminal means" refers to a device used by a user or factory employee to input data or to check advice or plans.
[1643] "Dietary advice generation means" refers to a function that analyzes the inputted meal contents and suggests appropriate meals based on nutritional balance.
[1644] The "exercise plan creation means" is a function that creates an exercise plan suitable for the user based on the input exercise content and health goals.
[1645] "Factory robots" refer to automated systems and devices installed within a factory environment to assist with employee health management.
[1646] This invention is a system that supports employee health management in a factory environment. In particular, it aims to provide employees with dietary advice and exercise plans to help them set health goals and work effectively toward those goals.
[1647] Hardware and software used
[1648] Server: Stores and analyzes data, generates advice, and creates exercise plans.
[1649] Terminal: A device (e.g., smartphone, touchscreen, factory robot) through which an employee enters data and receives advice and exercise plans.
[1650] Database: Use a relational database such as SQLite to store employee health information and goals.
[1651] Generative AI model: An AI model that generates nutritional balance and exercise plans based on input data.
[1652] User Registration and Login
[1653] Users (factory employees) use touch panels installed in the factory or a dedicated smartphone app to enter their name, employee ID, password, etc. and register with the system. The server stores the received information in a database and generates a user ID for authentication. The user then logs in using their email address and password, and the server authenticates the entered information.
[1654] goal setting
[1655] After logging in, users can set specific health goals, such as "lose 5 kilos" or "improve physical fitness." The device sends this information to the server, which then stores it in a database.
[1656] Health Record
[1657] Every day, users input their dietary and exercise information. For example, they record their dietary information such as "chicken breast, vegetable salad, and apple" and their exercise information such as "30 minutes of jogging." This information is sent from the device to the server, which then stores it in a database.
[1658] Providing dietary advice
[1659] The server analyzes the dietary information entered by the user and evaluates the nutritional balance using a generative AI model. For example, it generates specific advice such as "eat more vegetables" or "cut back on fat." The generated dietary advice is sent to the device and presented to the user.
[1660] Providing exercise plans
[1661] The server uses a generative AI model to create a personalized exercise plan based on the user's input and health goals. For example, it might suggest a plan that includes jogging and strength training three times a week. The generated exercise plan is then sent to the device and presented to the user.
[1662] Specific examples
[1663] An employee sets a goal of losing 5 kilograms.
[1664] Meal contents: "Chicken breast, vegetable salad, and apple"
[1665] Exercise: "30 minutes of jogging"
[1666] By entering these, the server generates suggestions such as "Eat more vegetables" and "A plan that includes jogging and strength training three times a week," and displays them on the user's device.
[1667] The present invention enables employees in a factory environment to efficiently manage their health in a way that is suited to their individual circumstances, which is expected to prevent health problems and improve productivity.
[1668] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1669] Step 1:
[1670] Users set health goals
[1671] Input: The user fills out an application form and enters a specific health goal, such as "lose 5 kilos."
[1672] Specific behavior: The user enters information and presses the submit button.
[1673] Output: The device sends the entered health goals to the server, which stores the received information in a database and registers the user's goals.
[1674] Step 2:
[1675] Record your daily health status
[1676] Input: The user inputs their daily diet and exercise information into the application. Examples: "chicken breast, vegetable salad, apple" or "30 minutes of jogging."
[1677] Specific actions: The user enters information about their diet and exercise and presses the submit button.
[1678] Output: The device sends the entered diet and exercise information to the server, which stores the received information in a database.
[1679] Step 3:
[1680] Generate dietary advice
[1681] Input: The server retrieves the user's daily dietary information stored in a database.
[1682] Specific operation: The server uses a generative AI model to evaluate meal content from the perspective of nutritional balance.
[1683] Output: The server analyzes the nutritional balance, generates specific advice such as "eat more vegetables" or "cut back on fat," and sends it to the device. The device then displays the received dietary advice to the user.
[1684] Step 4:
[1685] Create an exercise plan
[1686] Input: The server retrieves the user's exercise and health goals stored in a database.
[1687] Specific actions: The server uses a generative AI model to create a personalized exercise plan for the user.
[1688] Output: The server proposes a plan that includes jogging and strength training three times a week and sends it to the device. The device displays the received exercise plan to the user.
[1689] Step 5:
[1690] Present advice and plans to users
[1691] Input: Dietary advice and exercise plan data sent from the server.
[1692] Specific operation: The device displays the received data on the screen and presents it to the user, who can then check the advice and plan to help with daily health management.
[1693] Output: The user follows the advice and plan provided and works towards their health goals.
[1694] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1695] The present invention is a system that provides support to users to set health goals and work effectively towards those goals, and in particular, by combining it with an emotion engine that recognizes the user's emotional state, it provides more personalized and effective advice and plans.
[1696] As a concrete embodiment of this system, the processing of the program will be explained below in natural language.
[1697] User Registration and Login
[1698] The user first launches the application and enters information such as their name, email address, and password on the new registration screen.
[1699] The terminal transmits the input user information to the server.
[1700] The server stores the received information in a database and generates a user ID.
[1701] After registering, the user enters their email address and password on the login screen for authentication.
[1702] The server compares the input information with the information in the database and determines whether the authentication is successful. If the authentication is successful, it generates an authentication token and sends it to the terminal.
[1703] The terminal receives the authentication token and uses it when accessing the server in subsequent operations.
[1704] goal setting
[1705] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[1706] The terminal transmits the inputted goal to the server.
[1707] The server stores the target information in a database.
[1708] The terminal displays a confirmation message to the user that the settings have been completed.
[1709] Health Record
[1710] The user opens an input screen to record their daily diet and exercise.
[1711] Dietary information includes the type and amount of food consumed, calories, nutrients, etc. Exercise information includes the type, duration, and intensity of exercise.
[1712] The terminal transmits the input information to the server.
[1713] The server stores the received information in a database.
[1714] The terminal displays a message to the user confirming that the save is complete.
[1715] Emotion recognition by emotion engine
[1716] While the user is using the app, their voice and facial expressions are captured through the device's built-in camera and microphone.
[1717] The terminal transmits the captured data to the server.
[1718] The server uses an emotion engine to analyze the user's voice and facial expression data and recognize their emotional state.
[1719] For example, if a user is feeling stressed or tired, their emotional state is recognized.
[1720] Providing dietary advice
[1721] The server analyzes the user's nutritional balance based on their food record data and their perceived emotional state.
[1722] The server generates appropriate dietary advice based on the analysis results, the user's health goals, and their emotional state, such as "increase your protein intake to increase your energy."
[1723] The server transmits the generated dietary advice to the terminal.
[1724] The terminal displays the received dietary advice to the user.
[1725] Providing exercise plans
[1726] The server analyzes an exercise plan based on the user's exercise record data, health goals, and recognized emotional state, taking into account the frequency, type, and duration of exercise.
[1727] The server then creates a personalized exercise plan based on the analysis results, the user's health goals, and their emotional state, suggesting specific exercise plans such as "incorporating relaxing yoga."
[1728] The server sends the created exercise plan to the terminal.
[1729] The terminal displays the received exercise plan to the user.
[1730] In this way, the system can provide comprehensive support for the user's health management, providing specific advice and plans to effectively work towards set goals, and by recognizing the user's emotional state, it can provide more personalized support.
[1731] The processing flow will be explained below.
[1732] User Registration and Login
[1733] User Registration
[1734] Step 1:
[1735] The user launches the application and enters information such as their name, email address, and password on the new registration screen.
[1736] Step 2:
[1737] The terminal transmits the input user information to the server.
[1738] Step 3:
[1739] The server stores the received user information in a database and generates a user ID.
[1740] Step 4:
[1741] The server returns the registration result to the terminal.
[1742] Log in
[1743] Step 1:
[1744] The user enters their email address and password on the login screen.
[1745] Step 2:
[1746] The terminal sends authentication information to the server and requests authentication.
[1747] Step 3:
[1748] The server checks the information in the database and determines whether or not to allow login.
[1749] Step 4:
[1750] If the authentication is successful, the server generates an authentication token and returns it to the terminal.
[1751] Step 5:
[1752] The terminal receives the authentication token and displays the main screen to the user.
[1753] goal setting
[1754] Step 1:
[1755] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[1756] Step 2:
[1757] The terminal transmits the inputted goal to the server.
[1758] Step 3:
[1759] The server stores the target information in a database.
[1760] Step 4:
[1761] The server returns a notification of completion of the setting to the terminal.
[1762] Step 5:
[1763] The terminal displays a screen to the user confirming the set goal.
[1764] Health Record
[1765] Step 1:
[1766] The user opens an input screen to record their daily diet and exercise.
[1767] Step 2:
[1768] The user inputs the details of their diet (type and amount of food ingested, calories, nutrients, etc.) and exercise details (type of exercise, time, intensity, etc.).
[1769] Step 3:
[1770] The terminal transmits the input information to the server.
[1771] Step 4:
[1772] The server stores the received information in a database.
[1773] Step 5:
[1774] The server returns a notification of completion of saving to the terminal.
[1775] Step 6:
[1776] The terminal displays a screen to the user confirming the entered information.
[1777] Emotion recognition by emotion engine
[1778] Step 1:
[1779] While the user is using the app, their voice and facial expressions are captured through the device's built-in camera and microphone.
[1780] Step 2:
[1781] The terminal transmits the captured audio and video data to the server.
[1782] Step 3:
[1783] The server analyzes the received data using an emotion engine to recognize the user's emotional state.
[1784] Step 4:
[1785] The server stores the recognized emotional states in a database.
[1786] Providing dietary advice
[1787] Step 1:
[1788] The server retrieves the user's food log data and perceived emotional state from a database.
[1789] Step 2:
[1790] The server analyzes nutritional balance based on the acquired data.
[1791] Step 3:
[1792] The server generates appropriate dietary advice based on the analysis results, the user's health goals, and the user's perceived emotional state. For example, a user feeling stressed might be advised to "increase their intake of B vitamins."
[1793] Step 4:
[1794] The server transmits the generated dietary advice to the terminal.
[1795] Step 5:
[1796] The terminal displays the received dietary advice to the user.
[1797] Providing exercise plans
[1798] Step 1:
[1799] The server retrieves the user's exercise record data, health goals, and perceived emotional state from a database.
[1800] Step 2:
[1801] Based on the acquired data, the server analyzes plans such as the frequency, type, and duration of exercise.
[1802] Step 3:
[1803] The server then creates a personalized exercise plan based on the analysis, the user's health goals, and their perceived emotional state. For example, a user who feels fatigued might be offered an exercise plan that includes relaxing yoga.
[1804] Step 4:
[1805] The server sends the created exercise plan to the terminal.
[1806] Step 5:
[1807] The terminal displays the received exercise plan to the user.
[1808] These are the specific processing steps of the program for the system that combines the emotion engine. This system enables users to receive personalized support for managing their health.
[1809] Example 2
[1810] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1811] Conventional health management systems mainly provide general advice and exercise plans based on the user's diet and exercise records, and it is difficult to provide personalized support that takes into account the emotional state of each individual user. As a result, there has been an issue of insufficient effective support for users to achieve their health goals.
[1812] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1813] In this invention, the server includes input means for a user to set a health goal, server means for saving information in a database based on the health goal, terminal means for transmitting the meal details and exercise details input by the user to the server, means for the server to analyze the meal details and exercise details and generate dietary advice, means for the server to create an exercise plan based on the exercise details and the health goal, terminal means for presenting the generated dietary advice and exercise plan to the user, means for capturing voice and facial expression data of the user using sensor means installed in the terminal, means for the server to recognize the user's emotional state using the captured voice and facial expression data, and means for the server to personalize advice and exercise plans based on the recognized emotional state. This enables individual support that takes the user's emotional state into consideration and makes it possible to provide effective support for the user to achieve their health goal.
[1814] "User" refers to an individual who utilizes the system to set and receive assistance in achieving health goals.
[1815] "Input means" refers to the interface on the terminal used by the user to set health goals and input other required information.
[1816] The "server means" refers to an information processing device that receives data such as health goals, diet, and exercise sent by the user and stores it in a database.
[1817] The term "terminal means" refers to an information processing device used by the user to input meal details and exercise details and transmit the data to the server.
[1818] The term "analysis means" refers to the process in which the server analyzes the user's dietary and exercise details and generates appropriate dietary advice.
[1819] The term "exercise plan creation means" refers to the process in which the server creates an individual exercise plan based on the user's exercise content and health goals.
[1820] The "sensor means" refers to a device that captures the user's voice and facial expression data using input devices such as a camera and microphone installed on the terminal.
[1821] The "emotion recognition means" refers to a process in which the server analyzes the user's voice and facial expression data captured by the sensor means and recognizes the user's emotional state.
[1822] "Personalization means" refers to a process for generating individual dietary advice and exercise plans based on the recognized emotional state to provide optimal support to the user.
[1823] "Database" refers to an information storage system for storing and managing information such as a user's health goals, diet, exercise, and emotional state.
[1824] The present invention is a system that provides comprehensive support for users to set health goals and work effectively toward those goals, and in particular, by combining an emotion engine that recognizes the user's emotional state, it provides more personalized and effective advice and plans. Specifically, it is configured as follows.
[1825] System configuration
[1826] 1. User Input Method:
[1827] This is an interface on a device that allows users to set health goals and input other necessary information. This can be done using information processing devices such as smartphones, tablets, and PCs.
[1828] 2. Server means:
[1829] This is an information processing device that receives data such as health goals, diet, and exercise sent by users, stores it in a database, and analyzes the data to generate appropriate advice and exercise plans. The server is equipped with a database management system (DBMS) that efficiently stores and manages user information and health data.
[1830] 3. Terminal means:
[1831] This is an information processing device that transmits the dietary and exercise details entered by the user to a server. This can be a smartphone, tablet, or PC, allowing users to easily record their daily health data.
[1832] 4. Analysis methods:
[1833] This is a process in which the server analyzes the user's diet and exercise habits and generates appropriate dietary advice. For example, specialized software and algorithms are used to analyze nutritional balance and calculate calorie intake. This analysis is performed using programming languages and data analysis tools such as Python and R.
[1834] 5. Exercise planning tools:
[1835] The server creates a personalized exercise plan based on the user's exercise habits and health goals. For example, it considers the user's weekly exercise frequency, exercise type, and intensity to generate a personalized exercise plan. This process incorporates machine learning models and specialized fitness algorithms.
[1836] 6. Sensor means:
[1837] This is a device that captures the user's voice and facial expression data using input devices such as cameras and microphones installed on the device. It acquires data in real time using capture devices and sensor APIs.
[1838] 7. Emotion recognition means:
[1839] The server analyzes the user's voice and facial expression data captured by sensors and recognizes the user's emotional state. This process uses an emotion engine or machine learning model. For example, Microsoft's Azure Cognitive Services or Google's Cloud Natural Language API can be used.
[1840] 8. Personalization methods:
[1841] This process generates personalized dietary advice and exercise plans based on the recognized emotional state, providing optimal support to the user. This provides optimal health support according to the user's emotions.
[1842] Specific examples
[1843] The user sets a goal of "lose 5 kg" and enters the information into the application's input screen.
[1844] The terminal sends this information to a server, which stores the information in a database.
[1845] The user records their daily diet and exercise habits, and facial expression data is captured via a camera.
[1846] The server analyzes the user's diet and exercise habits to generate nutritional advice based on nutritional balance. It also recognizes when the user is feeling stressed from the captured facial expression data and generates an exercise plan to reduce stress.
[1847] Dietary advice suggests "eating lots of protein," and exercise plan suggests "doing relaxing yoga three times a week."
[1848] Prompt Sentence Examples
[1849] What is the registration process? From the moment a user enters their email address and password, until the server saves the information.
[1850]
[1851] What is the process for setting a health goal? For example, how would a user set a goal to "lose 5 kilos"?
[1852]
[1853] What is the procedure for recording food and exercise? Please explain in detail how users can enter their daily food and exercise information.
[1854]
[1855] Please explain how the emotion engine recognizes the user's emotions. For example, if the user is tired, how does the camera recognize that facial expression and send it to the server?
[1856]
[1857] Please tell me the procedure for analyzing nutritional balance based on the user's dietary data and providing advice. Please explain in detail what kind of advice is generated for a user in a stressed state.
[1858]
[1859] Please explain your procedure for providing exercise plans that take into account the user's emotional state. For example, how would you create an exercise plan for a user in a stressed state?
[1860] In this way, the present invention realizes a system that comprehensively supports the user's health management and provides specific advice and plans to effectively work toward set goals. Furthermore, by recognizing the user's emotional state, it becomes possible to provide more personalized support.
[1861] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1862] System program processing flow
[1863] We will explain it in steps and add specific actions for each step.
[1864] User Registration and Login
[1865] Step 1: User enters information
[1866] The user launches the application and enters their name, email address, and password on the new registration screen.
[1867] Input: Name, email address, password
[1868] Specific action: The user enters "Yamada Taro", "taro@example.com", and "password123" into the smartphone app.
[1869] Step 2: Sending information by device
[1870] The terminal transmits the input user information to the server.
[1871] Output: User information (name, email address, password)
[1872] Specific operation: The device sends input information to the server via Wi-Fi or mobile network.
[1873] Step 3: Server storage and verification
[1874] The server validates the information received, stores it in a database, and generates a user ID.
[1875] Input: User information (name, email address, password)
[1876] Output: User ID, confirmation message
[1877] Specific operation: The server generates a unique user ID "user123" for "taro@example.com" and saves it in the database.
[1878] Step 4: Login screen and authentication
[1879] After registering, the user enters their email address and password on the login screen.
[1880] Input: Email address, password
[1881] Specific action: The user opens the app again and enters the login information "taro@example.com" and "password123".
[1882] Step 5: Device sends authentication information
[1883] The terminal transmits the entered authentication information to the server.
[1884] Output: Authentication information (email address, password)
[1885] Specific operation: The terminal sends the entered authentication information to the server.
[1886] Step 6: Authentication with the Server and Token Generation
[1887] The server checks the authentication information against the information in its database and, if authentication is successful, generates an authentication token.
[1888] Input: Authentication information (email address, password)
[1889] Output: Authentication token, authentication result
[1890] Specific operation: The server verifies that the entered information is correct and generates an authentication token for "abcdef123456".
[1891] Step 7: Receive and view your tokens
[1892] The terminal receives the authentication token and uses it when accessing the server in subsequent operations.
[1893] Output: Show authentication token
[1894] Specific operation: The terminal displays the authentication token "abcdef123456" to the user and saves it.
[1895] goal setting
[1896] Step 1: Enter your goals
[1897] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[1898] Enter: Health Goals
[1899] Specific operation: The user sets a goal of "lose 5 kg."
[1900] Step 2: Send target information
[1901] The terminal transmits the input health goal to the server.
[1902] Output: Health goal information
[1903] Specific operation: The device sends "lose 5 kg" to the server.
[1904] Step 3: Target storage and verification by the server
[1905] The server stores the target information in a database.
[1906] Input: Health goal information
[1907] Output:Confirmation message
[1908] Specific operation: The server saves the goal information in the database and returns the message "Goal setting completed."
[1909] Step 4: Goal setting completion display
[1910] The terminal displays a confirmation message to the user that the settings have been completed.
[1911] Output: Display a confirmation message
[1912] Specific operation: The device displays the message "Goal setting completed" to the user.
[1913] Health Record
[1914] Step 1: View the recording screen
[1915] The user opens an input screen to record their daily diet and exercise.
[1916] Specific actions: The user opens the app and accesses the screen for inputting meal and exercise details.
[1917] Step 2: Enter your diet and exercise details
[1918] Users enter details such as the type and amount of food consumed, calories, nutrients, type of exercise, time, and intensity.
[1919] Input: Meal details, exercise details
[1920] Specific actions: The user inputs "Breakfast: 50g of oatmeal, 200kcal" or "Exercise: 30 minutes of running."
[1921] Step 3: Sending data
[1922] The terminal transmits the input information to the server.
[1923] Output: Meal data, exercise data
[1924] Specific operation: The terminal transmits this information to the server.
[1925] Step 4: Data storage by server
[1926] The server stores the received information in a database.
[1927] Input: Meal data, exercise data
[1928] Output: Save complete message
[1929] Specific operation: The server saves the received information in the database and returns a message saying "Data saved."
[1930] Step 5: Save complete
[1931] The terminal displays a message to the user confirming that the save is complete.
[1932] Output: Display a confirmation message
[1933] Specific operation: The device displays the message "Data saved" to the user.
[1934] Emotion recognition by emotion engine
[1935] Step 1: Collecting emotion data
[1936] While the user is using the app, the device's built-in camera and microphone capture their voice and facial expressions.
[1937] Input: Voice data, facial expression data
[1938] Specific operation: The camera records the user's facial expressions as video data, and the microphone collects audio data.
[1939] Step 2: Sending data
[1940] The terminal transmits the captured data to the server.
[1941] Output: Captured data
[1942] Specific operation: Video and audio data are sent to the server in real time.
[1943] Step 3: Analyze emotional state
[1944] The server analyzes the transmitted data and recognizes the user's emotional state.
[1945] Input: Captured data
[1946] Output: Emotional state data
[1947] Specific operation: The server uses an emotion engine to analyze the data and recognize that the user is, for example, "feeling stressed."
[1948] Providing dietary advice
[1949] Step 1: Analyze the data
[1950] The server analyzes nutritional balance based on the user's food record data and perceived emotional state.
[1951] Input: Food record data, emotional state data
[1952] Output: Analysis results
[1953] Specific operation: The server analyzes the data and identifies nutritional balance and nutrient deficiencies.
[1954] Step 2: Advice generation
[1955] The server generates appropriate dietary advice based on the analysis results and the user's health goals and emotional state.
[1956] Input: Analysis results, health goals, emotional state data
[1957] Output: Dietary advice
[1958] Specific operation: The server generates advice such as "Eat more protein to reduce stress."
[1959] Step 3: Submitting and viewing advice
[1960] The server transmits the generated dietary advice to the terminal.
[1961] The terminal displays the received advice to the user.
[1962] Input: Dietary advice
[1963] Output: Display advice
[1964] Specific operation: The device displays a message to the user saying, "To reduce stress, eat more protein."
[1965] Providing exercise plans
[1966] Step 1: Analyzing the exercise data
[1967] The server analyzes an exercise plan that takes into account the frequency and type of exercise based on the user's exercise record data, health goals, and emotional state.
[1968] Input: Exercise record data, health goals, emotional state data
[1969] Output: Analysis results
[1970] Specific operation: The server analyzes the data and figures out, for example, how much exercise you should do per week.
[1971] Step 2: Create an exercise plan
[1972] The server creates a personalized exercise plan based on the analysis results.
[1973] Input: Analysis results
[1974] Output: Movement plan
[1975] Specific actions: The server generates an exercise plan such as "do relaxing yoga three times a week."
[1976] Step 3: Send and view your exercise plan
[1977] The server sends the created exercise plan to the terminal.
[1978] The terminal displays the received exercise plan to the user.
[1979] Input: Exercise plan
[1980] Output: Display of exercise plan
[1981] Specific action: The device displays an exercise plan to the user: "Do relaxing yoga three times a week."
[1982] (Application example 2)
[1983] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1984] Conventional health management systems provide uniform advice and plans without considering the user's emotional state, which has the problem of not effectively addressing individual health goals. Furthermore, guidance that ignores the user's current psychological state makes it difficult to support sustainable health management.
[1985] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: input means for a user to set a health goal; server means for saving information in a database based on the health goal; terminal means for transmitting the meal details and exercise details input by the user to the server; means for capturing the user's voice and facial expression through a camera and microphone mounted on the terminal; means for the server to analyze the meal details and exercise details and generate dietary advice; means for the server to create an exercise plan based on the exercise details and health goal; means for the server to analyze the user's voice and facial expression data using an emotion engine and recognize the user's emotional state; means for the server to generate dietary advice and an exercise plan taking the recognized emotional state into consideration; terminal means for presenting the generated dietary advice and exercise plan to the user; and means for the server to suggest an appropriate dietary plan based on the generated dietary advice. This makes it possible to provide personalized dietary advice and exercise plans that take the user's individual emotional state into consideration.
[1986] "Input means" refers to a means by which a user can set their own health goals and input related information.
[1987] The "server means" is a means for receiving information sent from a user, storing it in a database, and performing various processes based on the information.
[1988] "Terminal means" refers to a device used by a user, and is a means for transmitting input data to a server and presenting information from the server to the user.
[1989] "Means for capturing voice and facial expressions" through "cameras and microphones" refers to devices or functions for photographing or recording the user's facial expressions and voice and collecting that data.
[1990] The "means for generating dietary advice" is a means for analyzing dietary data input by the user and proposing dietary advice in line with the user's health goals.
[1991] The "means for creating an exercise plan" is a means for creating an exercise plan suitable for the user based on the exercise data and health goals input by the user.
[1992] An "emotion engine" refers to a system or algorithm that analyzes a user's voice and facial expression data to recognize the user's current emotional state.
[1993] The "means for recognizing an emotional state" is a means for analyzing the user's voice and facial expression data using an emotion engine to identify the user's emotions.
[1994] The "means for generating dietary advice and exercise plans" refers to means for providing optimal dietary and exercise suggestions based on the perceived emotional state and health goals.
[1995] The "means for proposing a meal plan" is a means for proposing an appropriate meal plan to the user based on the generated meal advice.
[1996] A "health advice system" is a comprehensive system that supports users in managing their health and effectively working towards set health goals.
[1997] The present invention provides a system that supports a user's health management and provides personalized advice combined with an emotion engine to achieve health goals. Specific embodiments of this system are described below.
[1998] System configuration
[1999] This system consists of a user terminal, a server, an emotion engine, and a database. Users access the system using devices such as smartphones and tablets. The server processes data sent from the user, and the emotion engine analyzes the user's voice and facial expression data.
[2000] Program processing explanation
[2001] 1. User Registration and Login:
[2002] The user first launches the application and enters information such as their name, email address, and password on the new registration screen. The device sends the entered user information to the server, which then stores the received information in a database. After registering, the user enters their email address and password on the login screen for authentication.
[2003] 2. Goal Setting:
[2004] After logging in, the user opens the goal setting screen and enters a specific health goal, such as "lose 5 kg." The device then sends the entered goal to the server, which then stores the goal information in a database.
[2005] 3. Health Records:
[2006] The user opens an input screen to record their daily diet and exercise. Dietary information includes the type and amount of food consumed, calories, nutrients, etc., and exercise information includes the type, time, and intensity of exercise. The device sends this information to the server, which then stores it in a database.
[2007] 4. Emotion Recognition with Emotion Engine:
[2008] While a user is using the app, their voice and facial expressions are captured through the device's built-in camera and microphone. The device then sends the captured data to a server, which then uses an emotion engine to analyze the user's voice and facial expression data and recognize their emotional state. For example, if the user is feeling stressed or tired, that emotional state is recognized.
[2009] 5. Providing dietary advice:
[2010] The server analyzes the nutritional balance based on the user's food record data and the user's recognized emotional state. The server generates appropriate dietary advice based on the analysis results, the user's health goals, and the user's emotional state. For example, the advice may be "increase your energy intake by eating more protein."
[2011] 6. Providing exercise plans:
[2012] The server analyzes the user's exercise record data, health goals, and recognized emotional state to create an exercise plan that takes into account the frequency, type, and duration of exercise. The server then creates a personalized exercise plan based on the analysis results, the user's health goals, and their emotional state. For example, it suggests a specific exercise plan such as "incorporating relaxing yoga."
[2013] Hardware and Software Used
[2014] This system consists of a mobile device such as a user's smartphone or tablet, a server, and an emotion engine. The emotion engine uses commercial software such as "EmotionEngine." The database uses MySQL or PostgreSQL, among others. The server is operated as a cloud service such as "AWS" or "Google Cloud."
[2015] Examples of concrete examples and prompts
[2016] For example, if a user is feeling stressed about their weight loss goal, they could input the following prompts into the generative AI model:
[2017] "If a user is trying to lose weight, what diet and exercise recommendations would you recommend if they are feeling stressed?"
[2018] Based on the prompts, the system suggests protein-rich meals and relaxing exercise plans, allowing users to receive optimal health care tailored to their emotional state.
[2019] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[2020] Step 1:
[2021] The user launches the application and enters information such as their name, email address, and password on the new registration screen. The device sends this information to the server. The server stores the received information in a database, generates a user ID, and returns it to the device. This allows the user to register their information in the existing database.
[2022] Step 2:
[2023] The user attempts to log in by entering their email address and password on the login screen. The device sends this information to the server. The server compares it with the registered information in the database and determines whether the authentication is successful. If the authentication is successful, an authentication token is generated and returned to the device. This allows the user to log in and access the server in subsequent operations.
[2024] Step 3:
[2025] After logging in, the user opens the goal setting screen and enters a specific health goal, such as "lose 5 kg." The device then sends this goal to the server, which then stores the goal information in a database. This registers the user's health goal in the database.
[2026] Step 4:
[2027] The user opens an input screen to record their daily diet and exercise. Dietary information includes the type and amount of food consumed, calories, nutrients, etc., and exercise information includes the type, time, and intensity of exercise. The device then sends this information to the server, which then stores the received information in a database. This records the user's health data.
[2028] Step 5:
[2029] While the user is using the app, their voice and facial expressions are captured through the device's built-in camera and microphone. The device then sends this data to the server. The server then uses an emotion engine to analyze the voice and facial expression data and recognize the user's emotional state. The recognized emotional state is then stored in a database. This records the user's psychological state.
[2030] Step 6:
[2031] The server analyzes the nutritional balance based on the user's dietary records and the user's recognized emotional state. This includes data processing such as calculating nutrient deficiencies and suggesting ways to supplement them. The server then generates appropriate dietary advice based on the analysis results, the user's health goals, and the user's emotional state, and sends it to the device. This provides the user with specific dietary advice.
[2032] Step 7:
[2033] The server analyzes the user's exercise plan, taking into account the frequency, type, and duration of exercise based on the user's exercise record data, health goals, and emotional state. This includes data calculations such as "optimizing the exercise plan according to the user's physical fitness level." The server then creates a personalized exercise plan and sends it to the device, providing the user with a specific exercise plan.
[2034] Step 8:
[2035] The server proposes an appropriate meal plan based on the generated dietary advice. This includes data processing such as "proposing menus based on current ingredient inventory and the user's preferences." The terminal displays the meal plan to the user and allows them to place an order. This allows the user to easily select an appropriate meal plan and place an order.
[2036] In this way, the system provides comprehensive support for the user's health management, providing specific advice and plans to effectively work towards set goals, and by recognizing the user's emotional state, it can provide more personalized support.
[2037] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[2038] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[2039] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[2040] [Fourth embodiment]
[2041] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[2042] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[2043] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[2044] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[2045] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[2046] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[2047] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[2048] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[2049] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[2050] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[2051] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[2052] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[2053] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2054] The present invention relates to a system that provides support for users to set health goals and work effectively toward those goals. This system supports health management by providing dietary advice and exercise plans based on information entered by the user.
[2055] As a concrete embodiment of this system, the processing of the program will be explained below in natural language.
[2056] User Registration and Login
[2057] The user first launches the application and enters information such as their name, email address, and password on the new registration screen.
[2058] The terminal transmits the input information to the server.
[2059] The server stores the received information in a database and generates a user ID.
[2060] After registering, the user enters their email address and password on the login screen for authentication.
[2061] The server compares the input information with the information in the database and determines whether the authentication is successful. If the authentication is successful, it generates an authentication token and sends it to the terminal.
[2062] The terminal receives the authentication token and uses it when accessing the server in subsequent operations.
[2063] goal setting
[2064] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[2065] The terminal transmits the inputted goal to the server.
[2066] The server stores the target information in a database.
[2067] The terminal displays a confirmation message to the user that the settings have been completed.
[2068] Health Record
[2069] The user opens an input screen to record their daily diet and exercise.
[2070] The dietary information includes the type and amount of food consumed, calories, nutrients, etc.
[2071] The type of exercise, time, intensity, etc. are input as exercise content.
[2072] The terminal transmits the input information to the server.
[2073] The server stores the received information in a database.
[2074] The terminal displays a message to the user confirming that the save is complete.
[2075] Providing dietary advice
[2076] The server analyzes nutritional balance based on the user's food records.
[2077] Based on the analysis results, the server generates appropriate dietary advice that matches the user's health goals, such as "eat more vegetables" or "cut back on your calorie intake."
[2078] The server transmits the generated advice to the terminal.
[2079] The terminal displays the received advice to the user.
[2080] Providing exercise plans
[2081] The server creates a personalized exercise plan based on the user's exercise records and goals, taking into account the frequency, type, and duration of exercise.
[2082] For example, it generates a specific exercise plan such as "a plan that includes jogging and strength training three times a week."
[2083] The server sends the created exercise plan to the terminal.
[2084] The terminal displays the received exercise plan to the user.
[2085] In this way, the system can provide comprehensive support for users' health management and provide specific advice and plans to effectively work toward set goals. As a result, users receive support tailored to their individual circumstances, making it easier for them to achieve their health goals.
[2086] The processing flow will be explained below.
[2087] User Registration and Login
[2088] User Registration
[2089] Step 1:
[2090] The user launches the application and enters information such as their name, email address, and password on the new registration screen.
[2091] Step 2:
[2092] The terminal transmits the input user information to the server.
[2093] Step 3:
[2094] The server stores the received user information in a database and generates a user ID.
[2095] Step 4:
[2096] The server returns the registration result to the terminal.
[2097] Log in
[2098] Step 1:
[2099] The user enters their email address and password on the login screen.
[2100] Step 2:
[2101] The terminal sends authentication information to the server and requests authentication.
[2102] Step 3:
[2103] The server checks the information in the database and determines whether or not to allow login.
[2104] Step 4:
[2105] If the authentication is successful, the server generates an authentication token and returns it to the terminal.
[2106] Step 5:
[2107] When the terminal receives the authentication token, it displays the main screen to the user.
[2108] goal setting
[2109] Step 1:
[2110] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[2111] Step 2:
[2112] The terminal transmits the inputted goal to the server.
[2113] Step 3:
[2114] The server stores the target information in a database.
[2115] Step 4:
[2116] The server returns a notification of completion of the setting to the terminal.
[2117] Step 5:
[2118] The terminal displays a screen to the user confirming the set goal.
[2119] Health Record
[2120] Step 1:
[2121] The user opens an input screen to record their daily diet and exercise.
[2122] Step 2:
[2123] The user inputs the details of their diet (type and amount of food ingested, calories, nutrients, etc.) and exercise details (type of exercise, time, intensity, etc.).
[2124] Step 3:
[2125] The terminal transmits the input information to the server.
[2126] Step 4:
[2127] The server stores the received information in a database.
[2128] Step 5:
[2129] The server returns a notification of completion of saving to the terminal.
[2130] Step 6:
[2131] The terminal displays a screen to the user confirming the entered information.
[2132] Providing dietary advice
[2133] Step 1:
[2134] The server retrieves the user's food record data from the database.
[2135] Step 2:
[2136] The server analyzes nutritional balance based on the acquired data.
[2137] Step 3:
[2138] Based on the analysis results, the server generates dietary advice that matches health goals.
[2139] Step 4:
[2140] The server transmits the generated dietary advice to the terminal.
[2141] Step 5:
[2142] The terminal displays the received dietary advice to the user.
[2143] Providing exercise plans
[2144] Step 1:
[2145] The server retrieves the user's exercise record data and health goals from a database.
[2146] Step 2:
[2147] Based on the acquired data, the server analyzes an exercise plan that takes into account the frequency, type, and duration of exercise.
[2148] Step 3:
[2149] The server creates a personalized exercise plan based on the analysis results.
[2150] Step 4:
[2151] The server sends the created exercise plan to the terminal.
[2152] Step 5:
[2153] The terminal displays the received exercise plan to the user.
[2154] The above is a detailed step-by-step explanation of the program's processing, which allows users to receive specific support for managing their health.
[2155] Example 1
[2156] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2157] In modern society, health management is an important concern for many people. However, few systems provide continuous, specific advice and plans tailored to individual lifestyles and health conditions. This makes it difficult for users to receive support to effectively achieve their health goals. Furthermore, existing health management systems have technical limitations in providing detailed analysis and generating personalized plans based on diet and exercise records, and specific improvements are needed to improve the user experience.
[2158] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[2159] In this invention, the server includes a generating AI model means, a means for analyzing the dietary details and exercise details to generate dietary advice, and a means for creating an exercise plan based on the exercise details and health goals, thereby enabling users to continuously receive specific advice and plans tailored to their individual lifestyles and health conditions.
[2160] "User" refers to an individual who uses the health care system.
[2161] "Health goal" refers to a specific health-related goal that a user sets to achieve.
[2162] "Input means" refers to a device or interface that allows a user to input information.
[2163] "Server means" refers to a computing system for processing, storing, and managing data.
[2164] A "database" refers to a system for systematically storing, managing, and retrieving information.
[2165] "Terminal means" refers to a device used by a user that has the function of sending and receiving information.
[2166] "Generative AI modeling means" refers to technology that uses artificial intelligence to analyze data and generate specific advice and plans.
[2167] "Dietary advice" refers to instructions recommending a nutritionally balanced diet based on the user's eating habits.
[2168] An "exercise plan" refers to a specific exercise schedule created based on a user's exercise habits and health goals.
[2169] "Presentation means" refers to an interface for displaying the generated advice and plan to the user.
[2170] These definitions allow for a precise understanding of each element of the system and clarify the scope of the claims.
[2171] The present invention relates to a system that provides support for users to set health goals and work effectively toward those goals. This system supports health management by providing dietary advice and exercise plans based on information entered by the user.
[2172] System configuration
[2173] This system is mainly composed of three components: a server, a terminal, and a user. These components work together to provide personalized health management support to users.
[2174] Hardware and software used
[2175] 1. Server: Processes, stores, and manages data. This can be a general cloud server or a dedicated server.
[2176] 2. Terminal: A device through which a user inputs and receives information. This includes smartphones, tablets, and computers.
[2177] 3. Generative AI models: Artificial intelligence software for generating dietary advice and exercise plans, primarily using the latest deep learning techniques.
[2178] Details of data processing and calculation
[2179] User Registration and Login
[2180] A user launches an application and enters information such as their name, email address, and password.
[2181] The terminal sends the entered information to the server using an HTTP POST request.
[2182] The server stores the received information in a database and uses an SQL query to register new users, along with their authentication information.
[2183] Setting Health Goals
[2184] The user inputs a specific health goal (e.g., "lose 5 kilos").
[2185] The terminal sends the target information to the server via an HTTP POST request.
[2186] The server stores the target information in a database and returns a setting completion message to the terminal.
[2187] Daily health record
[2188] The user inputs the details of meals, calorie intake, exercise, etc.
[2189] The device sends this information to the server via an HTTP POST request.
[2190] The server stores the information in a database and sends a confirmation message back to the terminal.
[2191] Providing dietary advice
[2192] The server analyzes the user's food records stored in a database.
[2193] The generative AI model uses food record data as input prompts to analyze nutritional balance. For example, the following prompts are used:
[2194] "The user's recent food log shows a lot of carbohydrates and vitamin C. What other nutrients should they be getting?"
[2195] The server receives the advice generated by the generative AI model and sends it to the device.
[2196] The device then displays the received advice to the user, for example, "You should eat more vegetables."
[2197] Providing exercise plans
[2198] The server analyzes the user's exercise information recorded in the database.
[2199] The generative AI model uses exercise recording data as input prompts to create a personalized exercise plan, for example, using the following prompt sentences:
[2200] "The user's exercise log includes 30 minutes of jogging every week. Based on this log, create a plan for jogging and strength training three times a week."
[2201] The server receives the motion plan generated by the generative AI model and sends it to the terminal.
[2202] The device then displays the received exercise plan to the user, such as a specific plan such as "jogging three times a week (30 minutes each time) and strength training twice a week (45 minutes each time)."
[2203] Specific examples
[2204] This system analyzes the dietary and exercise data entered by the user, and the generative AI model provides personalized advice and plans based on the results. For example, if a user selects "I want to do aerobic exercise five days a week," the server will generate an appropriate exercise schedule based on the user's exercise record and display it on the device.
[2205] This system provides comprehensive support for users' health management and provides specific advice and plans tailored to individual lifestyles, enabling users to effectively achieve their health goals.
[2206] The flow of the identification process in the first embodiment will be described with reference to FIG.
[2207] Step 1:
[2208] The user launches the application and enters information such as name, email address, and password on the new registration screen.
[2209] Input: Name, Email Address, Password
[2210] Specific behavior: The information entered by the user is entered into the application's input fields.
[2211] Step 2:
[2212] The terminal transmits the input information to the server.
[2213] Input: Registration information entered by the user
[2214] What happens: The user's registration information is sent to the server's registration API endpoint using an HTTP POST request.
[2215] Output: Registration information sent to the server
[2216] Step 3:
[2217] The server stores the received information in a database and generates a new user ID.
[2218] Input: Received user registration information
[2219] Specific data manipulation: An SQL query (e.g. INSERT INTO users (name, email, password) VALUES (?, ?, ?);) is executed.
[2220] Output: User information stored in the database and the generated user ID.
[2221] Step 4:
[2222] After registering, the user enters their email address and password on the login screen.
[2223] Input: Email address, Password
[2224] What happens: The login information entered by the user is entered into the application's input fields.
[2225] Step 5:
[2226] The terminal sends the login information to the server.
[2227] Input: The login information entered by the user
[2228] What happens: Your login information is sent to the server's authentication API using an HTTP POST request.
[2229] Output: Login information sent to the server
[2230] Step 6:
[2231] The server compares the information stored in the database with the information entered by the user and performs authentication.
[2232] Input: User login information
[2233] Specific data manipulation: Searching the database with an SQL query (e.g. SELECT FROM users WHERE email = ? AND password = ?;).
[2234] Output: Authentication token (if authentication is successful)
[2235] Step 7:
[2236] The server generates an authentication token and sends it to the terminal.
[2237] Input: Successfully authenticated login information
[2238] Specific operation: Generates a JSON Web Token (JWT) and sends it to the device in the HTTP response.
[2239] Output: Authentication token sent to the device
[2240] Step 8:
[2241] Users access the creator dashboard and enter their health goal (e.g., "lose 5 kilos").
[2242] Enter: Health Goals
[2243] Specific behavior: The goal entered by the user is entered into the application's input field.
[2244] Step 9:
[2245] The terminal transmits the health goal to the server.
[2246] Input: User-entered health goals
[2247] What happens: Goal information is sent to the server's goal setting API using an HTTP POST request.
[2248] Output: Health goals sent to the server
[2249] Step 10:
[2250] The server stores the target information in a database.
[2251] Input: User-entered health goals
[2252] Specific data manipulation: Issue an SQL query (e.g., INSERT INTO goals (user_id, goal_description) VALUES (?, ?);).
[2253] Output: Health goal information stored in a database
[2254] Step 11:
[2255] The terminal receives a confirmation message from the server confirming the completion of the setup and displays it to the user.
[2256] Input: Response from the server
[2257] Specific behavior: Receives the HTTP response and displays a confirmation message in the UI that the settings have been completed.
[2258] Step 12:
[2259] The user opens a screen to input their daily diet and exercise routine. For example, they can input "toast and orange juice" for breakfast and "30 minutes of jogging" for exercise.
[2260] Input: Meal details, exercise details
[2261] What happens: The user's input is entered into the application's input field.
[2262] Step 13:
[2263] The terminal transmits the input information to the server.
[2264] Input: User-recorded diet and exercise information
[2265] What happens: Record information is sent to the server's Record API using an HTTP POST request.
[2266] Output: Record information sent to the server
[2267] Step 14:
[2268] The server stores the received information in a database.
[2269] Input: Information recorded by the user
[2270] Specific data manipulation: Issue an SQL query (e.g., INSERT INTO health_records (user_id, record_type, record_details) VALUES (?, ?, ?);).
[2271] Output: Record information stored in a database
[2272] Step 15:
[2273] The terminal receives a save completion message from the server and displays it to the user.
[2274] Input: Response from the server
[2275] Specific behavior: Receives the HTTP response and displays a message in the UI confirming that the save was successful.
[2276] Step 16:
[2277] The server analyzes the user's food records stored in a database.
[2278] Input: User's food log data
[2279] Specific data manipulation: Using a generative AI model, food log data is analyzed as an input prompt. For example, the following prompt sentence is used:
[2280] "The user's recent food log shows a lot of carbohydrates and vitamin C. What other nutrients should they be getting?"
[2281] Output: Dietary advice as a result of the analysis
[2282] Step 17:
[2283] The server transmits the generated advice to the terminal.
[2284] Input: Advice generated by a generative AI model
[2285] Specific operation: JSON data containing advice content is sent to the terminal in the HTTP response.
[2286] Output: Dietary advice sent to the device
[2287] Step 18:
[2288] The terminal displays the received advice to the user.
[2289] Input: Advice received from the server
[2290] Specific behavior: Display an advice message in the UI, for example, "You should eat more vegetables."
[2291] Step 19:
[2292] The server analyzes the user's exercise information recorded in the database.
[2293] Input: User's exercise log data
[2294] Specific data manipulation: Using a generative AI model, the exercise record data is analyzed as an input prompt. For example, the following prompt sentence is used:
[2295] "The user's exercise log includes 30 minutes of jogging every week. Based on this log, create a plan for jogging and strength training three times a week."
[2296] Output: Motion plan as the analysis result
[2297] Step 20:
[2298] The server transmits the generated exercise plan to the terminal.
[2299] Input: A motion plan generated by a generative AI model
[2300] Specific operation: JSON data containing the exercise plan details is sent to the device in the HTTP response.
[2301] Output: The exercise plan sent to the device
[2302] Step 21:
[2303] The terminal displays the received exercise plan to the user.
[2304] Input: Movement plan received from the server
[2305] Specific action: Display an exercise plan message on the UI. For example, a specific plan such as "Jogging three times a week (30 minutes each time) and strength training twice a week (45 minutes each time)."
[2306] Through the above steps, this system can comprehensively support the user's health management and provide specific advice and plans tailored to each individual's lifestyle habits.
[2307] (Application example 1)
[2308] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2309] Many factory workers tend to neglect their health management in the midst of their daily work, which often leads to long-term health problems and reduced productivity. Furthermore, they have few opportunities to receive advice on diet and exercise in between their busy work schedules, making it difficult to manage their health efficiently. Furthermore, it is not easy to instantly provide dietary advice and exercise plans tailored to each individual employee.
[2310] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[2311] In this invention, the server is mounted on a factory robot to support health management of employees in a factory environment, and includes means for presenting the generated dietary advice and exercise plan to employees, means for the dietary advice generation means to compare the employee's goals with their current eating habits to calculate nutritional values and suggest meals containing nutrients that are lacking, and means for the exercise plan creation means to analyze the employee's goals and current exercise status and create personalized exercise plans on a weekly basis, thereby enabling factory employees to efficiently manage their health according to their individual circumstances.
[2312] A "health goal" is a specific health condition that a user or factory employee wants to achieve or a goal of a health habit that the user wants to improve.
[2313] "Input means" refers to a device or interface that allows a user or factory employee to input information such as health goals, daily diet, and exercise details.
[2314] "Server means" refers to a server and its functions for storing input data and performing necessary analysis and processing.
[2315] "Terminal means" refers to a device used by a user or factory employee to input data or to check advice or plans.
[2316] "Dietary advice generation means" refers to a function that analyzes the inputted meal contents and suggests appropriate meals based on nutritional balance.
[2317] The "exercise plan creation means" is a function that creates an exercise plan suitable for the user based on the input exercise content and health goals.
[2318] "Factory robots" refer to automated systems and devices installed within a factory environment to assist with employee health management.
[2319] This invention is a system that supports employee health management in a factory environment. In particular, it aims to provide employees with dietary advice and exercise plans to help them set health goals and work effectively toward those goals.
[2320] Hardware and software used
[2321] Server: Stores and analyzes data, generates advice, and creates exercise plans.
[2322] Terminal: A device (e.g., smartphone, touchscreen, factory robot) through which an employee enters data and receives advice and exercise plans.
[2323] Database: Use a relational database such as SQLite to store employee health information and goals.
[2324] Generative AI model: An AI model that generates nutritional balance and exercise plans based on input data.
[2325] User Registration and Login
[2326] Users (factory employees) use touch panels installed in the factory or a dedicated smartphone app to enter their name, employee ID, password, etc. and register with the system. The server stores the received information in a database and generates a user ID for authentication. The user then logs in using their email address and password, and the server authenticates the entered information.
[2327] goal setting
[2328] After logging in, users can set specific health goals, such as "lose 5 kilos" or "improve physical fitness." The device sends this information to the server, which then stores it in a database.
[2329] Health Record
[2330] Every day, users input their dietary and exercise information. For example, they record their dietary information such as "chicken breast, vegetable salad, and apple" and their exercise information such as "30 minutes of jogging." This information is sent from the device to the server, which then stores it in a database.
[2331] Providing dietary advice
[2332] The server analyzes the dietary information entered by the user and evaluates the nutritional balance using a generative AI model. For example, it generates specific advice such as "eat more vegetables" or "cut back on fat." The generated dietary advice is sent to the device and presented to the user.
[2333] Providing exercise plans
[2334] The server uses a generative AI model to create a personalized exercise plan based on the user's input and health goals. For example, it might suggest a plan that includes jogging and strength training three times a week. The generated exercise plan is then sent to the device and presented to the user.
[2335] Specific examples
[2336] An employee sets a goal of losing 5 kilograms.
[2337] Meal contents: "Chicken breast, vegetable salad, and apple"
[2338] Exercise: "30 minutes of jogging"
[2339] By entering these, the server generates suggestions such as "Eat more vegetables" and "A plan that includes jogging and strength training three times a week," and displays them on the user's device.
[2340] The present invention enables employees in a factory environment to efficiently manage their health in a way that is suited to their individual circumstances, which is expected to prevent health problems and improve productivity.
[2341] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[2342] Step 1:
[2343] Users set health goals
[2344] Input: The user fills out an application form and enters a specific health goal, such as "lose 5 kilos."
[2345] Specific behavior: The user enters information and presses the submit button.
[2346] Output: The device sends the entered health goals to the server, which stores the received information in a database and registers the user's goals.
[2347] Step 2:
[2348] Record your daily health status
[2349] Input: The user inputs their daily diet and exercise information into the application. Examples: "chicken breast, vegetable salad, apple" or "30 minutes of jogging."
[2350] Specific actions: The user enters information about their diet and exercise and presses the submit button.
[2351] Output: The device sends the entered diet and exercise information to the server, which stores the received information in a database.
[2352] Step 3:
[2353] Generate dietary advice
[2354] Input: The server retrieves the user's daily dietary information stored in a database.
[2355] Specific operation: The server uses a generative AI model to evaluate meal content from the perspective of nutritional balance.
[2356] Output: The server analyzes the nutritional balance, generates specific advice such as "eat more vegetables" or "cut back on fat," and sends it to the device. The device then displays the received dietary advice to the user.
[2357] Step 4:
[2358] Create an exercise plan
[2359] Input: The server retrieves the user's exercise and health goals stored in a database.
[2360] Specific actions: The server uses a generative AI model to create a personalized exercise plan for the user.
[2361] Output: The server proposes a plan that includes jogging and strength training three times a week and sends it to the device. The device displays the received exercise plan to the user.
[2362] Step 5:
[2363] Present advice and plans to users
[2364] Input: Dietary advice and exercise plan data sent from the server.
[2365] Specific operation: The device displays the received data on the screen and presents it to the user, who can then check the advice and plan to help with daily health management.
[2366] Output: The user follows the advice and plan provided and works towards their health goals.
[2367] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[2368] The present invention is a system that provides support to users to set health goals and work effectively towards those goals, and in particular, by combining it with an emotion engine that recognizes the user's emotional state, it provides more personalized and effective advice and plans.
[2369] As a concrete embodiment of this system, the processing of the program will be explained below in natural language.
[2370] User Registration and Login
[2371] The user first launches the application and enters information such as their name, email address, and password on the new registration screen.
[2372] The terminal transmits the input user information to the server.
[2373] The server stores the received information in a database and generates a user ID.
[2374] After registering, the user enters their email address and password on the login screen for authentication.
[2375] The server compares the input information with the information in the database and determines whether the authentication is successful. If the authentication is successful, it generates an authentication token and sends it to the terminal.
[2376] The terminal receives the authentication token and uses it when accessing the server in subsequent operations.
[2377] goal setting
[2378] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[2379] The terminal transmits the inputted goal to the server.
[2380] The server stores the target information in a database.
[2381] The terminal displays a confirmation message to the user that the settings have been completed.
[2382] Health Record
[2383] The user opens an input screen to record their daily diet and exercise.
[2384] Dietary information includes the type and amount of food consumed, calories, nutrients, etc. Exercise information includes the type, duration, and intensity of exercise.
[2385] The terminal transmits the input information to the server.
[2386] The server stores the received information in a database.
[2387] The terminal displays a message to the user confirming that the save is complete.
[2388] Emotion recognition by emotion engine
[2389] While the user is using the app, their voice and facial expressions are captured through the device's built-in camera and microphone.
[2390] The terminal transmits the captured data to the server.
[2391] The server uses an emotion engine to analyze the user's voice and facial expression data and recognize their emotional state.
[2392] For example, if a user is feeling stressed or tired, their emotional state is recognized.
[2393] Providing dietary advice
[2394] The server analyzes the user's nutritional balance based on their food record data and their perceived emotional state.
[2395] The server generates appropriate dietary advice based on the analysis results, the user's health goals, and their emotional state, such as "increase your protein intake to increase your energy."
[2396] The server transmits the generated dietary advice to the terminal.
[2397] The terminal displays the received dietary advice to the user.
[2398] Providing exercise plans
[2399] The server analyzes an exercise plan based on the user's exercise record data, health goals, and recognized emotional state, taking into account the frequency, type, and duration of exercise.
[2400] The server then creates a personalized exercise plan based on the analysis results, the user's health goals, and their emotional state, suggesting specific exercise plans such as "incorporating relaxing yoga."
[2401] The server sends the created exercise plan to the terminal.
[2402] The terminal displays the received exercise plan to the user.
[2403] In this way, the system can provide comprehensive support for the user's health management, providing specific advice and plans to effectively work towards set goals, and by recognizing the user's emotional state, it can provide more personalized support.
[2404] The processing flow will be explained below.
[2405] User Registration and Login
[2406] User Registration
[2407] Step 1:
[2408] The user launches the application and enters information such as their name, email address, and password on the new registration screen.
[2409] Step 2:
[2410] The terminal transmits the input user information to the server.
[2411] Step 3:
[2412] The server stores the received user information in a database and generates a user ID.
[2413] Step 4:
[2414] The server returns the registration result to the terminal.
[2415] Log in
[2416] Step 1:
[2417] The user enters their email address and password on the login screen.
[2418] Step 2:
[2419] The terminal sends authentication information to the server and requests authentication.
[2420] Step 3:
[2421] The server checks the information in the database and determines whether or not to allow login.
[2422] Step 4:
[2423] If the authentication is successful, the server generates an authentication token and returns it to the terminal.
[2424] Step 5:
[2425] The terminal receives the authentication token and displays the main screen to the user.
[2426] goal setting
[2427] Step 1:
[2428] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[2429] Step 2:
[2430] The terminal transmits the inputted goal to the server.
[2431] Step 3:
[2432] The server stores the target information in a database.
[2433] Step 4:
[2434] The server returns a notification of completion of the setting to the terminal.
[2435] Step 5:
[2436] The terminal displays a screen to the user confirming the set goal.
[2437] Health Record
[2438] Step 1:
[2439] The user opens an input screen to record their daily diet and exercise.
[2440] Step 2:
[2441] The user inputs the details of their diet (type and amount of food ingested, calories, nutrients, etc.) and exercise details (type of exercise, time, intensity, etc.).
[2442] Step 3:
[2443] The terminal transmits the input information to the server.
[2444] Step 4:
[2445] The server stores the received information in a database.
[2446] Step 5:
[2447] The server returns a notification of completion of saving to the terminal.
[2448] Step 6:
[2449] The terminal displays a screen to the user confirming the entered information.
[2450] Emotion recognition by emotion engine
[2451] Step 1:
[2452] While the user is using the app, their voice and facial expressions are captured through the device's built-in camera and microphone.
[2453] Step 2:
[2454] The terminal transmits the captured audio and video data to the server.
[2455] Step 3:
[2456] The server analyzes the received data using an emotion engine to recognize the user's emotional state.
[2457] Step 4:
[2458] The server stores the recognized emotional states in a database.
[2459] Providing dietary advice
[2460] Step 1:
[2461] The server retrieves the user's food log data and perceived emotional state from a database.
[2462] Step 2:
[2463] The server analyzes nutritional balance based on the acquired data.
[2464] Step 3:
[2465] The server generates appropriate dietary advice based on the analysis results, the user's health goals, and the user's perceived emotional state. For example, a user feeling stressed might be advised to "increase their intake of B vitamins."
[2466] Step 4:
[2467] The server transmits the generated dietary advice to the terminal.
[2468] Step 5:
[2469] The terminal displays the received dietary advice to the user.
[2470] Providing exercise plans
[2471] Step 1:
[2472] The server retrieves the user's exercise record data, health goals, and perceived emotional state from a database.
[2473] Step 2:
[2474] Based on the acquired data, the server analyzes plans such as the frequency, type, and duration of exercise.
[2475] Step 3:
[2476] The server then creates a personalized exercise plan based on the analysis, the user's health goals, and their perceived emotional state. For example, a user who feels fatigued might be offered an exercise plan that includes relaxing yoga.
[2477] Step 4:
[2478] The server sends the created exercise plan to the terminal.
[2479] Step 5:
[2480] The terminal displays the received exercise plan to the user.
[2481] These are the specific processing steps of the program for the system that combines the emotion engine. This system enables users to receive personalized support for managing their health.
[2482] Example 2
[2483] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2484] Conventional health management systems mainly provide general advice and exercise plans based on the user's diet and exercise records, and it is difficult to provide personalized support that takes into account the emotional state of each individual user. As a result, there has been an issue of insufficient effective support for users to achieve their health goals.
[2485] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[2486] In this invention, the server includes input means for a user to set a health goal, server means for saving information in a database based on the health goal, terminal means for transmitting the meal details and exercise details input by the user to the server, means for the server to analyze the meal details and exercise details and generate dietary advice, means for the server to create an exercise plan based on the exercise details and the health goal, terminal means for presenting the generated dietary advice and exercise plan to the user, means for capturing voice and facial expression data of the user using sensor means installed in the terminal, means for the server to recognize the user's emotional state using the captured voice and facial expression data, and means for the server to personalize advice and exercise plans based on the recognized emotional state. This enables individual support that takes the user's emotional state into consideration and makes it possible to provide effective support for the user to achieve their health goal.
[2487] "User" refers to an individual who utilizes the system to set and receive assistance in achieving health goals.
[2488] "Input means" refers to the interface on the terminal used by the user to set health goals and input other required information.
[2489] The "server means" refers to an information processing device that receives data such as health goals, diet, and exercise sent by the user and stores it in a database.
[2490] The term "terminal means" refers to an information processing device used by the user to input meal details and exercise details and transmit the data to the server.
[2491] The term "analysis means" refers to the process in which the server analyzes the user's dietary and exercise details and generates appropriate dietary advice.
[2492] The term "exercise plan creation means" refers to the process in which the server creates an individual exercise plan based on the user's exercise content and health goals.
[2493] The "sensor means" refers to a device that captures the user's voice and facial expression data using input devices such as a camera and microphone installed on the terminal.
[2494] The "emotion recognition means" refers to a process in which the server analyzes the user's voice and facial expression data captured by the sensor means and recognizes the user's emotional state.
[2495] "Personalization means" refers to a process for generating individual dietary advice and exercise plans based on the recognized emotional state to provide optimal support to the user.
[2496] "Database" refers to an information storage system for storing and managing information such as a user's health goals, diet, exercise, and emotional state.
[2497] The present invention is a system that provides comprehensive support for users to set health goals and work effectively toward those goals, and in particular, by combining an emotion engine that recognizes the user's emotional state, it provides more personalized and effective advice and plans. Specifically, it is configured as follows.
[2498] System configuration
[2499] 1. User Input Method:
[2500] This is an interface on a device that allows users to set health goals and input other necessary information. This can be done using information processing devices such as smartphones, tablets, and PCs.
[2501] 2. Server means:
[2502] This is an information processing device that receives data such as health goals, diet, and exercise sent by users, stores it in a database, and analyzes the data to generate appropriate advice and exercise plans. The server is equipped with a database management system (DBMS) that efficiently stores and manages user information and health data.
[2503] 3. Terminal means:
[2504] This is an information processing device that transmits the dietary and exercise details entered by the user to a server. This can be a smartphone, tablet, or PC, allowing users to easily record their daily health data.
[2505] 4. Analysis methods:
[2506] This is a process in which the server analyzes the user's diet and exercise habits and generates appropriate dietary advice. For example, specialized software and algorithms are used to analyze nutritional balance and calculate calorie intake. This analysis is performed using programming languages and data analysis tools such as Python and R.
[2507] 5. Exercise planning tools:
[2508] The server creates a personalized exercise plan based on the user's exercise habits and health goals. For example, it considers the user's weekly exercise frequency, exercise type, and intensity to generate a personalized exercise plan. This process incorporates machine learning models and specialized fitness algorithms.
[2509] 6. Sensor means:
[2510] This is a device that captures the user's voice and facial expression data using input devices such as cameras and microphones installed on the device. It acquires data in real time using capture devices and sensor APIs.
[2511] 7. Emotion recognition means:
[2512] The server analyzes the user's voice and facial expression data captured by sensors and recognizes the user's emotional state. This process uses an emotion engine or machine learning model. For example, Microsoft's Azure Cognitive Services or Google's Cloud Natural Language API can be used.
[2513] 8. Personalization methods:
[2514] This process generates personalized dietary advice and exercise plans based on the recognized emotional state, providing optimal support to the user. This provides optimal health support according to the user's emotions.
[2515] Specific examples
[2516] The user sets a goal of "lose 5 kg" and enters the information into the application's input screen.
[2517] The terminal sends this information to a server, which stores the information in a database.
[2518] The user records their daily diet and exercise habits, and facial expression data is captured via a camera.
[2519] The server analyzes the user's diet and exercise habits to generate nutritional advice based on nutritional balance. It also recognizes when the user is feeling stressed from the captured facial expression data and generates an exercise plan to reduce stress.
[2520] Dietary advice suggests "eating lots of protein," and exercise plan suggests "doing relaxing yoga three times a week."
[2521] Prompt Sentence Examples
[2522] What is the registration process? From the moment a user enters their email address and password, until the server saves the information.
[2523]
[2524] What is the process for setting a health goal? For example, how would a user set a goal to "lose 5 kilos"?
[2525]
[2526] What is the procedure for recording food and exercise? Please explain in detail how users can enter their daily food and exercise information.
[2527]
[2528] Please explain how the emotion engine recognizes the user's emotions. For example, if the user is tired, how does the camera recognize that facial expression and send it to the server?
[2529]
[2530] Please tell me the procedure for analyzing nutritional balance based on the user's dietary data and providing advice. Please explain in detail what kind of advice is generated for a user in a stressed state.
[2531]
[2532] Please explain your procedure for providing exercise plans that take into account the user's emotional state. For example, how would you create an exercise plan for a user in a stressed state?
[2533] In this way, the present invention realizes a system that comprehensively supports the user's health management and provides specific advice and plans to effectively work toward set goals. Furthermore, by recognizing the user's emotional state, it becomes possible to provide more personalized support.
[2534] The flow of the identification process in the second embodiment will be described with reference to FIG.
[2535] System program processing flow
[2536] We will explain it in steps and add specific actions for each step.
[2537] User Registration and Login
[2538] Step 1: User enters information
[2539] The user launches the application and enters their name, email address, and password on the new registration screen.
[2540] Input: Name, email address, password
[2541] Specific action: The user enters "Yamada Taro", "taro@example.com", and "password123" into the smartphone app.
[2542] Step 2: Sending information by device
[2543] The terminal transmits the input user information to the server.
[2544] Output: User information (name, email address, password)
[2545] Specific operation: The device sends input information to the server via Wi-Fi or mobile network.
[2546] Step 3: Server storage and verification
[2547] The server validates the information received, stores it in a database, and generates a user ID.
[2548] Input: User information (name, email address, password)
[2549] Output: User ID, confirmation message
[2550] Specific operation: The server generates a unique user ID "user123" for "taro@example.com" and saves it in the database.
[2551] Step 4: Login screen and authentication
[2552] After registering, the user enters their email address and password on the login screen.
[2553] Input: Email address, password
[2554] Specific action: The user opens the app again and enters the login information "taro@example.com" and "password123".
[2555] Step 5: Device sends authentication information
[2556] The terminal transmits the entered authentication information to the server.
[2557] Output: Authentication information (email address, password)
[2558] Specific operation: The terminal sends the entered authentication information to the server.
[2559] Step 6: Authentication with the Server and Token Generation
[2560] The server checks the authentication information against the information in its database and, if authentication is successful, generates an authentication token.
[2561] Input: Authentication information (email address, password)
[2562] Output: Authentication token, authentication result
[2563] Specific operation: The server verifies that the entered information is correct and generates an authentication token for "abcdef123456".
[2564] Step 7: Receive and view your tokens
[2565] The terminal receives the authentication token and uses it when accessing the server in subsequent operations.
[2566] Output: Show authentication token
[2567] Specific operation: The terminal displays the authentication token "abcdef123456" to the user and saves it.
[2568] goal setting
[2569] Step 1: Enter your goals
[2570] After logging in, users open the goal setting screen and enter specific health goals, such as "lose 5 kilograms."
[2571] Enter: Health Goals
[2572] Specific operation: The user sets a goal of "lose 5 kg."
[2573] Step 2: Send target information
[2574] The terminal transmits the input health goal to the server.
[2575] Output: Health goal information
[2576] Specific operation: The device sends "lose 5 kg" to the server.
[2577] Step 3: Target storage and verification by the server
[2578] The server stores the target information in a database.
[2579] Input: Health goal information
[2580] Output:Confirmation message
[2581] Specific operation: The server saves the goal information in the database and returns the message "Goal setting completed."
[2582] Step 4: Goal setting completion display
[2583] The terminal displays a confirmation message to the user that the settings have been completed.
[2584] Output: Display a confirmation message
[2585] Specific operation: The device displays the message "Goal setting completed" to the user.
[2586] Health Record
[2587] Step 1: View the recording screen
[2588] The user opens an input screen to record their daily diet and exercise.
[2589] Specific actions: The user opens the app and accesses the screen for inputting meal and exercise details.
[2590] Step 2: Enter your diet and exercise details
[2591] Users enter details such as the type and amount of food consumed, calories, nutrients, type of exercise, time, and intensity.
[2592] Input: Meal details, exercise details
[2593] Specific actions: The user inputs "Breakfast: 50g of oatmeal, 200kcal" or "Exercise: 30 minutes of running."
[2594] Step 3: Sending data
[2595] The terminal transmits the input information to the server.
[2596] Output: Meal data, exercise data
[2597] Specific operation: The terminal transmits this information to the server.
[2598] Step 4: Data storage by server
[2599] The server stores the received information in a database.
[2600] Input: Meal data, exercise data
[2601] Output: Save complete message
[2602] Specific operation: The server saves the received information in the database and returns a message saying "Data saved."
[2603] Step 5: Save complete
[2604] The terminal displays a message to the user confirming that the save is complete.
[2605] Output: Display a confirmation message
[2606] Specific operation: The device displays the message "Data saved" to the user.
[2607] Emotion recognition by emotion engine
[2608] Step 1: Collecting emotion data
[2609] While the user is using the app, the device's built-in camera and microphone capture their voice and facial expressions.
[2610] Input: Voice data, facial expression data
[2611] Specific operation: The camera records the user's facial expressions as video data, and the microphone collects audio data.
[2612] Step 2: Sending data
[2613] The terminal transmits the captured data to the server.
[2614] Output: Captured data
[2615] Specific operation: Video and audio data are sent to the server in real time.
[2616] Step 3: Analyze emotional state
[2617] The server analyzes the transmitted data and recognizes the user's emotional state.
[2618] Input: Captured data
[2619] Output: Emotional state data
[2620] Specific operation: The server uses an emotion engine to analyze the data and recognize that the user is, for example, "feeling stressed."
[2621] Providing dietary advice
[2622] Step 1: Analyze the data
[2623] The server analyzes nutritional balance based on the user's food record data and perceived emotional state.
[2624] Input: Food record data, emotional state data
[2625] Output: Analysis results
[2626] Specific operation: The server analyzes the data and identifies nutritional balance and nutrient deficiencies.
[2627] Step 2: Advice generation
[2628] The server generates appropriate dietary advice based on the analysis results and the user's health goals and emotional state.
[2629] Input: Analysis results, health goals, emotional state data
[2630] Output: Dietary advice
[2631] Specific operation: The server generates advice such as "Eat more protein to reduce stress."
[2632] Step 3: Submitting and viewing advice
[2633] The server transmits the generated dietary advice to the terminal.
[2634] The terminal displays the received advice to the user.
[2635] Input: Dietary advice
[2636] Output: Display advice
[2637] Specific operation: The device displays a message to the user saying, "To reduce stress, eat more protein."
[2638] Providing exercise plans
[2639] Step 1: Analyzing the exercise data
[2640] The server analyzes an exercise plan that takes into account the frequency and type of exercise based on the user's exercise record data, health goals, and emotional state.
[2641] Input: Exercise record data, health goals, emotional state data
[2642] Output: Analysis results
[2643] Specific operation: The server analyzes the data and figures out, for example, how much exercise you should do per week.
[2644] Step 2: Create an exercise plan
[2645] The server creates a personalized exercise plan based on the analysis results.
[2646] Input: Analysis results
[2647] Output: Movement plan
[2648] Specific actions: The server generates an exercise plan such as "do relaxing yoga three times a week."
[2649] Step 3: Send and view your exercise plan
[2650] The server sends the created exercise plan to the terminal.
[2651] The terminal displays the received exercise plan to the user.
[2652] Input: Exercise plan
[2653] Output: Display of exercise plan
[2654] Specific action: The device displays an exercise plan to the user: "Do relaxing yoga three times a week."
[2655] (Application example 2)
[2656] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "se...
Claims
1. an input means for a user to set a health goal; a server means for storing information in a database based on said health goals; a terminal means for transmitting the meal details and exercise details input by the user to a server; a means for the server to analyze the dietary details and exercise details and generate dietary advice; a means for the server to create an exercise plan based on the exercise content and health goals; a terminal means for presenting the generated dietary advice and exercise plan to a user; A system including:
2. The system according to claim 1 , wherein the means for generating dietary advice calculates nutritional values by comparing the user's goals with the user's current eating habits, and suggests meals containing nutrients that are lacking.
3. 2. The system according to claim 1, wherein the means for creating an exercise plan analyzes the user's goals and current exercise status and creates a personalized exercise plan on a weekly basis.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A