System

Abstract

A system is provided.SOLUTION: Means for inputting a physical disorder or skin problem of a user, a favorite food, a category of a desired dish, and a current health condition from the user, means for transmitting the input information to a server, means for specifying a necessary nutrient based on the information, means for specifying a food containing the nutrient, means for generating an appropriate recipe based on the favorite food and the category of the dish, means for selecting an appropriate exercise method based on the physical disorder or the health condition, means for transmitting the generated recipe and the exercise method to the terminal; A means for the terminal to display the recipe and the exercise method to the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Many people experience minor physical discomforts or skin problems in their daily lives. However, even when they visit a medical institution to resolve these issues, tests often show no abnormalities. Furthermore, finding the right ingredients and exercise methods to suit one's own physical condition and preferences can be difficult. In particular, nutrients are lost during the cooking process, and many people lack the technical knowledge to determine appropriate exercise intensity, preventing them from implementing effective improvement methods. There is a need for a way to solve these issues and provide optimal diet and exercise recipes tailored to each user's individual health condition. [Means for solving the problem]

[0005] This invention is a system that presents ingredients and cooking recipes containing optimal nutrients, as well as exercise methods, based on the user's input of physical ailments, skin concerns, favorite ingredients, desired food categories, and current health status. This system solves the above-mentioned problems by the following means:

[0006] A means for users to input information about their physical ailments, skin concerns, favorite ingredients, food categories they want to eat, and their current health condition

[0007] A means of sending input information to the server

[0008] A means for the server to make informed decisions about nutrient needs

[0009] A way to identify foods that are rich in nutrients

[0010] A way to generate suitable recipes based on your preferred ingredients and cooking categories

[0011] A method for selecting appropriate exercise methods based on physical condition and health status

[0012] A means to send the generated recipe and exercise method to the device

[0013] A means for the device to display recipes and exercise instructions to the user

[0014] This allows users to incorporate optimal diet and exercise into their physical condition and preferences, improving their health and beauty. Specific cooking techniques can also prevent the loss of nutrients. Furthermore, by setting an appropriate exercise intensity according to the user's health condition, they can exercise safely and effectively.

[0015] A "user" refers to an individual who uses this system, inputs physical ailments and skin concerns, and practices the suggested recipes and exercise methods.

[0016] A "terminal" refers to a device that allows a user to manipulate input data and display information from a server, such as a smartphone, tablet, or PC.

[0017] The "server" is a computer system that analyzes information sent by the user via the terminal, identifies the necessary nutrients, generates optimal ingredients, recipes, and exercise methods, and sends them to the terminal.

[0018] "Physical discomfort" refers to minor health abnormalities or discomforts that users experience in their daily lives, such as fatigue or stiff shoulders.

[0019] "Skin concerns" refers to skin-related problems or complaints that users have, and specific examples include rough skin and dry skin.

[0020] "Nutrients" refer to chemical components essential for maintaining the health and normal functioning of the human body, and include vitamins, minerals, proteins, etc.

[0021] "Ingredients" refers to the raw materials used to make a dish, such as meat, vegetables, and seafood.

[0022] A "recipe" refers to the steps and combination of ingredients required to make a particular dish, including cooking methods and tips.

[0023] "Exercise method" refers to a specific form of exercise recommended based on the user's health condition and physical condition, and includes yoga, stretching, light aerobic exercise, etc.

[0024] "Health status" refers to the user's current physical condition and medical status, including whether or not they are able to exercise and allergy information. [Brief explanation of the drawings]

[0025] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2]1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0026] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0027] First, the terms used in the following description will be explained.

[0028] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0029] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0030] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0031] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0032] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0033] [First embodiment]

[0034] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0035] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0036] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0037] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0038] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0039] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0040] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0041] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0042] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0043] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0044] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0045] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0046] This invention is a system that suggests optimal nutrients, ingredients, cooking methods, and exercise methods in response to a user's physical discomfort or skin concerns. The processing of the system program will be explained below in natural language.

[0047] System Overview

[0048] Based on the information entered by the user, the server identifies the necessary nutrients, generates optimal ingredients, recipes, and exercise methods, and provides them to the user via their device. This allows users to incorporate optimal diet and exercise that suits their physical condition and preferences, thereby improving their health and beauty.

[0049] Program processing

[0050] Accepting user input and sending data

[0051] The terminal prompts the user for the following information:

[0052] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[0053] Favorite ingredients (e.g. chicken, spinach)

[0054] Category of food you want to eat (e.g. Japanese food, Western food)

[0055] Current health condition (optional, e.g., light exercise is possible, allergies)

[0056] The terminal collects this input information, serializes it into JSON format, and sends it to the server.

[0057] Data analysis and proposals

[0058] The server receives the received user data and performs the following steps:

[0059] 1. Identify the nutrients you need based on your physical ailments and skin concerns.

[0060] Example: "Getting tired easily" → "B vitamins" and "iron"

[0061] 2. Search the database for foods that are high in the identified nutrients.

[0062] Example: "Iron" → "Spinach"

[0063] 3. Generate appropriate recipes taking into account the user's likes and dislikes and food categories.

[0064] Example: A recipe in the "Japanese food" category that uses "chicken" and "spinach" is "Chicken and spinach teriyaki."

[0065] 4. Provide cooking tips to preserve the nutrients in the ingredients in the recipe.

[0066] Example: "Cook it quickly to preserve the B vitamins."

[0067] 5. Select the optimal exercise method based on the user's health condition.

[0068] For example, if "Light exercise is possible," then "Light aerobic exercise" or "Stretching" would be appropriate.

[0069] The generated list of recipes and exercise methods is serialized in JSON format and sent to the device.

[0070] Suggestions for users

[0071] The device deserializes the information received from the server and displays the following in the user interface:

[0072] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[0073] Details of exercise method and its effects

[0074] This allows users to achieve optimal diet and exercise habits that suit their physical condition, thereby maintaining and improving their health and beauty.

[0075] Specific examples

[0076] Example: Improvement of fatigue

[0077] 1. The user enters "I get tired easily," selects "chicken" as the favorite food, and selects "Japanese food" as the food category they want to eat.

[0078] 2. The device sends this information to the server.

[0079] 3. Analyze that servers "get tired easily" and therefore need B vitamins and iron.

[0080] 4. The server identifies a Japanese recipe that uses "chicken," "Teriyaki Chicken and Spinach," and includes "cooking quickly" as a cooking tip for preserving B vitamins.

[0081] 5. The server recommends "light aerobic exercise" and "stretching."

[0082] 6. The device displays recipes and exercise instructions to the user.

[0083] The above is a specific embodiment of the present invention. This system allows users to incorporate optimal diet and exercise into their physical condition and preferences, thereby improving their health and beauty.

[0084] The processing flow will be explained below.

[0085] Step 1:

[0086] The device presents the user with an input form, in which the user enters information about physical ailments, skin concerns, favorite ingredients, preferred food categories, and current health condition.

[0087] Step 2:

[0088] The terminal serializes the input data into JSON format. Examples of user input data include:

[0089] Physical discomfort or skin problems (e.g., "tired easily," "rough skin")

[0090] Favorite ingredients (e.g., "chicken," "spinach")

[0091] Category of food you want to eat (e.g., "Japanese food," "Western food")

[0092] Current health status (e.g., "I can do light exercise" or "I have certain allergies")

[0093] Step 3:

[0094] The device sends the serialized data to the server via an HTTP POST request.

[0095] Step 4:

[0096] The server receives the HTTP request, deserializes the data from the request body, and begins parsing it.

[0097] Step 5:

[0098] The server identifies the nutrients needed based on the user's physical condition or skin concerns. For example, if the user is concerned about fatigue, it identifies B vitamins and iron as the necessary nutrients.

[0099] Step 6:

[0100] The server searches the database for foods that are rich in the specified nutrients. The search results include "chicken," which is rich in "B vitamins," and "spinach," which is rich in "iron."

[0101] Step 7:

[0102] The server generates an appropriate recipe based on the user's preferences. If the user selects "Japanese food," the server selects the Japanese recipe "Teriyaki Chicken and Spinach," which uses "chicken" and "spinach."

[0103] Step 8:

[0104] The server adds cooking tips to the recipe to prevent nutrient loss, such as "cook the chicken quickly to preserve B vitamins."

[0105] Step 9:

[0106] The server selects the optimal exercise method based on the user's health condition. For example, if "light exercise is possible," it will recommend "light aerobic exercise" or "stretching."

[0107] Step 10:

[0108] The server serializes the generated recipe and exercise method again into JSON format and sends it to the device.

[0109] Step 11:

[0110] The device deserializes the data received from the server, which includes the recipe title, ingredients list, cooking instructions, cooking tips, and exercise instructions.

[0111] Step 12:

[0112] The device displays the deserialized recipes and exercise methods on the user interface, allowing the user to check and practice the optimal diet and exercise methods for their physical condition.

[0113] The above are the specific processing steps of the present invention. This system allows users to effectively incorporate diet and exercise into their diet according to their physical condition and preferences.

[0114] Example 1

[0115] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0116] Conventional health management systems have difficulty proposing optimal ingredients, recipes, and exercise methods that suit the user's individual physical condition and preferences, resulting in the inability to obtain maximum benefits. In particular, there is a lack of recipes that include specific cooking tips to ensure that nutrients are not lost, and suggestions for exercise methods that take into account the exercise intensity according to the user's health condition, and these points need to be improved.

[0117] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0118] In this invention, the server includes means for allowing a user to input information about physical ailments, skin concerns, favorite ingredients, desired food categories, and current health condition, means for transmitting the input information to the server, means for the server to identify necessary nutrients based on the information, means for identifying ingredients rich in the nutrients, means for generating appropriate recipes based on the favorite ingredients and food categories, means for including specific cooking tips to prevent nutrient loss in recipes generated using the generative AI model, means for selecting an appropriate exercise method based on the physical ailment and health condition, means for transmitting the generated recipe and exercise method to a terminal, and means for the terminal to display the recipe and exercise method to the user. This allows users to incorporate optimal diet and exercise tailored to their physical condition and preferences, thereby improving their health and beauty.

[0119] "User" refers to an individual who uses the system to obtain optimal diet and exercise methods based on their physical ailments, skin concerns, preferred ingredients, preferred food categories, and current health status.

[0120] "Terminal" refers to a device that allows a user to input information, transmits the information to a server, and displays the recipes and exercise methods provided by the server so that the user can view them.

[0121] "Server" refers to a computer system that receives user data sent from a terminal, identifies necessary nutrients, ingredients, recipes, and exercise methods, and sends them to the terminal.

[0122] "Physical discomfort and skin problems" refers to the user's physical discomfort or skin problems, and appropriate nutrients and exercise methods are identified based on this information.

[0123] "Favorite ingredients" are ingredients that the user particularly likes to eat, and specific recipes are created based on this information.

[0124] The "category of food you want to eat" refers to the genre of food that the user likes, and includes Japanese food, Western food, Chinese food, and the like.

[0125] "Current health condition" refers to the user's physical condition and limitations, and includes information such as whether light exercise is possible or whether the user has any allergies.

[0126] "Nutrients" refers to components such as vitamins, minerals, and proteins that are necessary for improving and maintaining the user's physical condition.

[0127] "Generative AI models" refer to algorithms or programs that use artificial intelligence to generate optimal recipes or exercise methods based on information collected from users.

[0128] "Means to include specific cooking points in recipes to prevent nutrient loss" refers to a method in which the generated recipes provide specific cooking methods and precautions to maximize the nutritional value of ingredients.

[0129] "Exercise method" refers to the type and method of exercise recommended based on the user's health condition and physical condition, and includes light aerobic exercise, stretching, etc.

[0130] "Deserialization" refers to the operation of restoring serialized data (for example, JSON format) and returning it to a format that a program can process.

[0131] "Serialization" refers to the operation of converting data handled internally by a program into a standardized format (such as JSON) for communication and storage.

[0132] The present invention is a system that proposes optimal nutrients, ingredients, cooking methods, and exercise methods in response to a user's physical condition or skin concerns. Specific embodiments of this system will be described below.

[0133] Based on the information entered by the user, the server identifies the necessary nutrients and generates optimal ingredients, recipes, and exercise methods, which are then provided to the user via their device. This allows users to incorporate optimal diet and exercise methods tailored to their physical condition and preferences, thereby improving their health and beauty.

[0134] Hardware and Software Configuration

[0135] Terminal

[0136] A terminal is a device through which a user inputs information, and can include a smartphone, tablet, or PC. The terminal has a user interface and is capable of receiving input from the user and sending it to a server. Data serialization and deserialization is performed using a programming language such as Python or JavaScript®.

[0137] server

[0138] The server is a central system that receives and analyzes data sent by users and identifies appropriate nutrients, ingredients, recipes, and exercise methods. The server references a database to obtain the necessary information and uses a generative AI model to make optimal recommendations. For example, Python frameworks such as Django and Flask are used to build server-side programs.

[0139] Specific processing flow

[0140] 1. Accepting user input

[0141] The user enters the following information into the device's input screen:

[0142] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[0143] Favorite ingredients (e.g. chicken, spinach)

[0144] Category of food you want to eat (e.g. Japanese food, Western food)

[0145] Current health condition (optional, e.g., light exercise is possible, allergies)

[0146] 2. Sending and serializing data

[0147] The device serializes the entered information into JSON format and sends it to the server via an HTTP POST request. Example:

[0148] json

[0149] {

[0150] "health_issues": "tire easily",

[0151] "favorite_foods": ["chicken", "spinach"],

[0152] "cuisine_type": "Japanese food",

[0153] "current_health_status": "Light exercise possible"

[0154] }

[0155] 3. Data analysis and proposals

[0156] The server deserializes the received data and performs the following:

[0157] Identify the nutrients needed based on the user's physical condition or skin concerns. Example: "Easily tired" → "B vitamins," "iron"

[0158] Search the database for foods that are high in a specific nutrient. Example: "B vitamins" → "chicken"

[0159] Generates appropriate recipes based on the user's favorite ingredients and cooking category. Uses a generative AI model. Example: "Teriyaki Chicken and Spinach" in the "Japanese Food" category.

[0160] Provide specific cooking tips to preserve the nutrients in the ingredients in the recipe. Example: "Cook the ingredients for a short time to preserve the B vitamins."

[0161] Select appropriate exercise methods based on the user's health condition. Example: "Light aerobic exercise" or "Stretching"

[0162] 4. Submitting and Viewing Proposals

[0163] The server serializes the generated recipe and exercise list into JSON format and sends it to the device. The device deserializes the received data and displays the suggestions to the user.

[0164] Examples of concrete examples and prompts

[0165] Specific examples

[0166] 1. The user enters "I get tired easily," selects "chicken" as the favorite food, and selects "Japanese food" as the food category they want to eat.

[0167] 2. The device sends this information to the server.

[0168] 3. Analyze that servers "get tired easily" and therefore need B vitamins and iron.

[0169] 4. When the server generates a Japanese recipe for "Teriyaki Chicken and Spinach" using "chicken," it includes the cooking tip of "cook quickly" to preserve B vitamins.

[0170] 5. The server recommends "light aerobic exercise" and "stretching."

[0171] 6. The device displays recipes and exercise instructions to the user.

[0172] Prompt Sentence Examples

[0173] I want to improve my physical condition as I get tired easily. My favorite food is chicken, and I would like to eat Japanese food. Please tell me some recipes and exercise methods.

[0174] The above is an embodiment of the invention, which allows users to incorporate optimal diet and exercise habits that suit their physical condition and preferences, thereby improving their health and beauty.

[0175] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0176] Step 1:

[0177] The user enters the following information into the device's input screen:

[0178] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[0179] Favorite ingredients (e.g. chicken, spinach)

[0180] Category of food you want to eat (e.g. Japanese food, Western food)

[0181] Current health condition (optional, e.g., light exercise is possible, allergies)

[0182] Input: Information such as the user's physical condition and preferences

[0183] Output: Data entered into the terminal form

[0184] Step 2:

[0185] The device receives the input and serializes it into JSON format, for example:

[0186] json

[0187] {

[0188] "health_issues": "tire easily",

[0189] "favorite_foods": ["chicken", "spinach"],

[0190] "cuisine_type": "Japanese food",

[0191] "current_health_status": "Light exercise possible"

[0192] }

[0193] Input: User information entered into the terminal

[0194] Output: JSON format data

[0195] Step 3:

[0196] The device sends the serialized data to the server via an HTTP POST request, which transfers the data from the device to the server.

[0197] Input: User information in JSON format

[0198] Output: HTTP request sent to the server

[0199] Step 4:

[0200] The server deserializes the JSON data it receives and converts it into an internal representation, allowing programs to manipulate the data directly.

[0201] Input: JSON data sent to the server

[0202] Output: Deserialized user information

[0203] Step 5:

[0204] The server uses the deserialized data to analyze the user's physical condition and skin concerns and identify the nutrients they need. For example, "easily fatigued" can lead to "B vitamins" and "iron."

[0205] Input: Deserialized user information

[0206] Output: List of required nutrients

[0207] Step 6:

[0208] The server checks the necessary nutrients against a database and searches for foods that contain a lot of them. For example, "B vitamins" → "chicken."

[0209] Input: List of nutrients needed

[0210] Output: A list of identified ingredients

[0211] Step 7:

[0212] The server considers the user's preferred ingredients and food category and uses a generative AI model to generate an appropriate recipe. For example, a recipe using "chicken" in the "Japanese food" category, "Teriyaki Chicken and Spinach."

[0213] Input: A list of identified ingredients, and the user's ingredient and cooking category preferences

[0214] Output: The generated recipe

[0215] Step 8:

[0216] The server adds specific cooking tips to generated recipes to prevent nutrient loss, such as "cook quickly to preserve B vitamins."

[0217] Input: Generated recipe

[0218] Output: Recipe with cooking points

[0219] Step 9:

[0220] The server selects an appropriate exercise method based on the user's current health condition. For example, if "light exercise is possible," the server selects "light aerobic exercise" or "stretching."

[0221] Input: User's current health status

[0222] Output: Recommended exercise method

[0223] Step 10:

[0224] The server serializes the generated recipe and list of exercise methods into JSON format again and sends it to the device.

[0225] Input: Recipe with cooking instructions and exercise instructions

[0226] Output: Send to the terminal as JSON format data

[0227] Step 11:

[0228] The device deserializes the received JSON data and displays it in the user interface, specifically the following:

[0229] Recipe name, ingredients list, cooking instructions, cooking tips for preserving nutrients

[0230] Details of exercise method and its effects

[0231] Input: JSON data received from the server

[0232] Output: Recipe and exercise instructions displayed in the user interface

[0233] The above is the specific processing flow of the program for this system. This system allows users to incorporate optimal diet and exercise tailored to their physical condition and preferences, thereby improving their health and beauty.

[0234] (Application example 1)

[0235] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0236] Conventional health management systems require users to manually research the appropriate nutrients and exercise methods based on their physical condition and dietary preferences, which requires a significant burden of time and effort. Furthermore, the health foods and advice provided in physical stores often do not adequately address the user's individual health condition. This makes it difficult for users to easily and accurately manage their health in physical stores.

[0237] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0238] In this invention, the server includes means for allowing a user to input information about physical ailments, skin concerns, favorite ingredients, desired food categories, and current health status, means for transmitting the input information to the server, means for identifying necessary nutrients based on the information, means for identifying ingredients rich in the nutrients, means for generating appropriate recipes based on the favorite ingredients and food categories, means for selecting appropriate exercise methods based on the physical ailments and health status, means for transmitting the generated recipes and exercise methods to a terminal, means for the terminal to display the recipes and exercise methods to the user, means for suggesting ingredients and recipes containing necessary nutrients based on the information input by the user in the physical store, and means for navigating the user to maintain health based on the recipes and exercise methods provided in the physical store. This allows users to easily obtain appropriate nutrient intake methods and exercise methods tailored to their individual health status even in the physical store.

[0239] "User" refers to a person who uses the system to input information about physical ailments, skin concerns, food preferences, etc., and receives advice on health management.

[0240] "Physical discomfort and skin problems" refers to health problems such as fatigue and rough skin experienced by users.

[0241] "Favorite ingredients" refers to ingredients that the user particularly likes to consume.

[0242] The "category of food you want to eat" refers to the type of food (Japanese food, Western food, etc.) that the user particularly wants to eat.

[0243] "Current health condition" refers to the user's current physical condition, athletic ability, whether or not they have any allergies, etc.

[0244] "Server" refers to a computer system that receives and processes user input information.

[0245] "Essential nutrients" refer to specific nutritional components necessary to improve the user's physical condition or skin problems.

[0246] An "appropriate recipe" refers to a cooking method for a dish that is rich in necessary nutrients and is generated based on the user's preferences and health condition.

[0247] The "exercise method" refers to an exercise program for improving physical condition or maintaining health, selected according to the user's health condition.

[0248] "Terminal" refers to a device (such as a smartphone or tablet) that displays information entered by the user and communicates with the server.

[0249] "Brick and mortar" refers to a physical retail location or fitness facility where users can visit and receive health foods and advice.

[0250] "Navigation" refers to a guide function that helps users easily understand the information and action plans necessary for health management.

[0251] This invention is a system that suggests optimal nutrients, ingredients, cooking methods, and exercise methods according to a user's physical ailments, skin concerns, and dietary preferences.

[0252] System configuration

[0253] The system consists of a terminal that accepts information input from users, a server that processes the information, and a terminal that displays the results. The terminals can be smartphones or tablet terminals in physical stores.

[0254] Program processing

[0255] Accepting user input and sending data

[0256] Users input information such as physical ailments, skin concerns, favorite ingredients, preferred food categories, current health status, etc. This input information is serialized in JSON format by the device and sent to the server.

[0257] Data analysis and proposals

[0258] The server performs the following operations based on the received user data:

[0259] 1. Identify the nutrients you need based on your physical ailments and skin concerns.

[0260] 2. Search the database for foods that are high in the identified nutrients.

[0261] 3. Generate appropriate recipes taking into account the user's likes and dislikes and food categories.

[0262] 4. Provide cooking tips to preserve the nutrients in the ingredients in the recipe.

[0263] 5. Select the optimal exercise method based on the user's health condition.

[0264] This information is again serialized in JSON format and sent to the device.

[0265] Suggestions for users

[0266] The device deserializes the information received from the server and displays the following in its user interface:

[0267] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[0268] Details of exercise method and its effects

[0269] Specific examples

[0270] Examples based on user health status

[0271] For example, if a user inputs "I get tired easily," selects "chicken" as their favorite ingredient, and "Japanese food" as their preferred food category, the device will send this information to the server. The server will analyze the information that "I get tired easily" and determine that B vitamins and iron are necessary. It will then identify a Japanese recipe using "chicken," "Teriyaki Chicken and Spinach," and include the cooking key of "cooking quickly" to maintain B vitamins. It will then recommend "light aerobic exercise" and "stretching" to the user. Finally, the device will display the recipe and exercise instructions to the user.

[0272] Prompt Sentence Examples

[0273] Here are some examples of prompts to input to the generative AI model:

[0274] Based on the user's input of "easily tired," "chicken," and "Japanese food," please suggest ingredients that are rich in B vitamins and iron, Japanese food recipes that use these ingredients, and light aerobic exercise.

[0275] In this way, a system is provided that allows users to achieve optimal diet and exercise tailored to their physical condition and preferences, thereby maintaining and improving their health and beauty.

[0276] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0277] Step 1:

[0278] The user uses the device to input information about physical ailments, skin concerns, favorite ingredients, food categories they want to eat, and their current health condition. This input information is serialized in JSON format.

[0279] Input: physical discomfort, skin concerns, favorite ingredients, food categories you want to eat, current health condition

[0280] Output: User information in JSON format

[0281] Step 2:

[0282] The device sends the serialized user information to the server by using an HTTP POST request to send the data to the server's API endpoint.

[0283] Input: User information in JSON format

[0284] Output: Send request

[0285] Step 3:

[0286] The server receives the user information, deserializes it, and begins analyzing it. First, it uses specific rules and databases to identify necessary nutrients based on physical ailments and skin concerns.

[0287] Input: User information in JSON format

[0288] Output: Identified nutrient needs

[0289] Step 4:

[0290] The server searches the database for ingredients based on the identified required nutrients, and generates a list of ingredients that are rich in nutrients.

[0291] Input: Identified nutrient needs

[0292] Output: List of identified ingredients

[0293] Step 5:

[0294] The server takes into account the user's preferred ingredients and desired food category and generates appropriate recipes using a recipe database and filtering logic.

[0295] Input: Identified ingredients, user's food preferences and cuisine category

[0296] Output: The generated appropriate recipe

[0297] Step 6:

[0298] Adds nutrient loss prevention cooking points to server-generated recipes, which include specific cooking methods to keep ingredients nutritious.

[0299] Input: Generated recipe

[0300] Output: Recipe with cooking points added

[0301] Step 7:

[0302] The server selects the optimal exercise method based on the user's health condition. In this process, the server takes into account the user's exercise ability and limitations and proposes an appropriate exercise program.

[0303] Input: User's health status

[0304] Output: Selected exercise method

[0305] Step 8:

[0306] The server serializes the generated recipe and exercise method into JSON format and sends it back to the device using an HTTP POST request.

[0307] Input: Generated recipe, selected exercise method

[0308] Output: Recipe and exercise instructions in JSON format

[0309] Step 9:

[0310] The device deserializes the JSON formatted information received from the server and displays it on the user interface, presenting recipes and exercise methods in a visually easy-to-understand format.

[0311] Input: Received JSON format recipe and exercise instructions

[0312] Output: Recipe and exercise instructions displayed in a user interface

[0313] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0314] This invention combines a system that suggests optimal nutrients, ingredients, cooking methods, and exercise methods for a user's physical condition or skin concerns with an emotion engine that recognizes the user's emotions. The processing of the system's program is explained below in natural language.

[0315] System Overview

[0316] Based on the information entered by the user, the server identifies the necessary nutrients, generates optimal ingredients, recipes, and exercise methods, and provides them to the user via the device. Furthermore, the system recognizes the user's emotional state in real time and optimizes the suggestions based on that information. This allows users to incorporate optimal diet and exercise plans that are tailored to their physical condition, preferences, and emotions, thereby improving their health and beauty.

[0317] Program processing

[0318] Accepting user input and sending data

[0319] The terminal prompts the user for the following information:

[0320] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[0321] Favorite ingredients (e.g. chicken, spinach)

[0322] Category of food you want to eat (e.g. Japanese food, Western food)

[0323] Current health condition (optional, e.g., light exercise is possible, allergies)

[0324] Furthermore, the emotion engine recognizes emotions from the user's facial expressions and voice and sends that data to the system. The device collects the user's input information and emotion data, serializes it into JSON format, and sends it to the server.

[0325] Data analysis and proposals

[0326] The server receives the received user data and begins parsing it. It does the following:

[0327] 1. Identify the nutrients you need based on your physical condition or skin concerns. For example, if you are concerned about fatigue, you might identify B vitamins and iron as the nutrients you need.

[0328] 2. The database is searched for foods that are high in the identified nutrients. For example, "chicken" that is high in "B vitamins" and "spinach" that is high in "iron" are identified.

[0329] 3. Generate an appropriate recipe based on the user's preferences. If the user selects "Japanese food," select the Japanese recipe "Teriyaki Chicken and Spinach," which uses "chicken" and "spinach."

[0330] 4. Include cooking tips in recipes to prevent nutrient loss, such as "cook chicken quickly to preserve B vitamins."

[0331] 5. Select the optimal exercise method based on the user's health condition. For example, if "light exercise is possible," recommend "light aerobic exercise" or "stretching."

[0332] 6. Based on data from the emotion engine, the app adjusts to take into account the user's mood and emotional state. For example, it can suggest relaxing recipes or exercise methods based on tired facial expressions or tone of voice.

[0333] The generated list of recipes and exercise methods is serialized in JSON format and sent to the device.

[0334] Suggestions for users

[0335] The device deserializes the information received from the server and displays the following in the user interface:

[0336] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[0337] Details of the exercise method and its effects.

[0338] Special suggestions based on the user's emotional state (e.g., stretching techniques to relax).

[0339] Specific examples

[0340] Example: Improving fatigue and considering emotions

[0341] 1. The user enters "I get tired easily," selects "chicken" as the favorite food, and selects "Japanese food" as the food category they want to eat.

[0342] 2. The emotion engine recognizes fatigue from the user's facial expressions and voice and transmits it as data.

[0343] 3. The device sends this information to the server.

[0344] 4. Analyze that servers "get tired easily" and therefore need B vitamins and iron.

[0345] 5. The server identifies a Japanese recipe that uses "chicken," "Teriyaki Chicken and Spinach," and includes "cooking quickly" as a cooking tip for preserving B vitamins.

[0346] 6. The server recommends "light aerobic exercise" and "stretching," and further suggests exercise methods with a high relaxation effect based on the emotion engine.

[0347] 7. The device displays recipes and exercise instructions to the user.

[0348] The above is a specific embodiment of the present invention. This system allows users to incorporate optimal diet and exercise according to their physical condition, preferences, and emotions, thereby improving their health and beauty.

[0349] The processing flow will be explained below.

[0350] Step 1:

[0351] The device presents the user with an input form, in which the user inputs information about physical ailments, skin concerns, favorite ingredients, preferred food categories, and current health condition. The device also activates an emotion engine to obtain emotional data from the user's facial expressions and voice.

[0352] Step 2:

[0353] The emotion engine analyzes the user's facial expressions and voice to identify their emotional state in real time. For example, it uses a facial recognition camera and voice recognition system to detect a user's tired expression or tone of voice and record this as emotion data.

[0354] Step 3:

[0355] The device serializes the input data and parsed emotion data into JSON format, which includes:

[0356] Physical discomfort or skin problems (e.g., "tired easily," "rough skin")

[0357] Favorite ingredients (e.g., "chicken," "spinach")

[0358] Category of food you want to eat (e.g., "Japanese food," "Western food")

[0359] Current health condition (e.g., "Light exercise is possible" or "I have allergies")

[0360] Emotional data (e.g., "tired," "stressed")

[0361] Step 4:

[0362] The device sends the serialized data to the server via an HTTP POST request.

[0363] Step 5:

[0364] The server receives the HTTP request, deserializes the data from the request body, and begins parsing it.

[0365] Step 6:

[0366] The server identifies the nutrients needed based on the user's physical condition or skin concerns. For example, if the user is concerned about fatigue, it identifies B vitamins and iron as the necessary nutrients.

[0367] Step 7:

[0368] The server searches the database for foods that are rich in the specified nutrients. The search results include "chicken," which is rich in "B vitamins," and "spinach," which is rich in "iron."

[0369] Step 8:

[0370] The server generates an appropriate recipe based on the user's preferred ingredients and cooking category. For example, if the user selects "Japanese food," the server selects the Japanese recipe "Teriyaki Chicken and Spinach," which uses "chicken" and "spinach."

[0371] Step 9:

[0372] The server adds cooking instructions to the recipe to prevent loss of nutrients, such as "cook the chicken quickly to preserve the B vitamins."

[0373] Step 10:

[0374] The server selects the optimal exercise method based on the user's health condition. For example, if "light exercise is possible," it will recommend "light aerobic exercise" or "stretching."

[0375] Step 11:

[0376] The server adjusts the user's mood and emotional state based on data from the emotion engine. For example, if the user is recognized as "tired," it will suggest relaxing dishes or exercise methods (e.g., "cooking with herbal tea" or "relaxing yoga").

[0377] Step 12:

[0378] The server serializes the generated recipe and exercise method again into JSON format and sends it to the device.

[0379] Step 13:

[0380] The device deserializes the data received from the server, which includes the recipe title, ingredients list, cooking instructions, cooking tips, and exercise instructions.

[0381] Step 14:

[0382] The device displays the deserialized recipes and exercise methods on a user interface, allowing the user to check and practice the optimal diet and exercise methods tailored to their physical and emotional state.

[0383] The above are the specific processing steps of the present invention. This system allows users to effectively incorporate diet and exercise into their diet according to their physical condition, preferences, and emotions.

[0384] Example 2

[0385] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0386] While conventional health management systems can suggest dietary and exercise regimes based on a user's physical condition, skin concerns, and preferences, they have had difficulty making optimal recommendations that take into account the user's emotional state. In particular, they have been unable to provide specific responses or suggestions that reflect the user's emotions, making it difficult to improve the user experience.

[0387] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0388] In this invention, the server includes means for having the user input information about physical ailments, skin concerns, favorite ingredients, desired food categories, and current health condition, means for transmitting the input information and collected emotional data to the server, means for the server to identify necessary nutrients based on the information and emotional data, means for optimizing the recommendations based on the emotional data, means for selecting an appropriate exercise method based on the physical ailments and health condition, and means for transmitting the generated recipes and exercise methods to the terminal. This enables optimal recommendations that take into account not only the user's physical condition and preferences, but also their emotional state.

[0389] "User" refers to an individual who uses the system to input their health status, preferences, and emotional state.

[0390] A "terminal" is an electronic device that a user uses to input information and receive suggestions from the system.

[0391] The "server" is a computer system that receives and analyzes information sent by users, generates the necessary nutrients, ingredients, recipes, and exercise methods, and sends them to the terminal.

[0392] The "emotion engine" is a system that recognizes emotions from a user's facial expressions and voice in real time and generates that data.

[0393] "Nutrients" refer to ingredients such as vitamins and minerals that are necessary to improve the user's physical condition and skin problems.

[0394] "Ingredients" refers to specific ingredients of foods that are rich in nutrients.

[0395] A "recipe" refers to a cooking method that uses specific ingredients and includes cooking tips to prevent loss of nutrients.

[0396] "Exercise method" refers to physical activities recommended based on the user's physical condition and health status.

[0397] "Emotional Data" refers to information about a user's emotional state generated by an emotion engine.

[0398] "Deserialization" refers to the process of returning serialized data sent from the server to its original data format.

[0399] "Optimizing suggested content" refers to optimizing suggested recipes and exercise methods to suit the user's emotional state based on the user's emotional data.

[0400] The present invention combines a system that suggests optimal nutrients, ingredients, cooking methods, and exercise methods for a user's physical condition or skin concerns with an emotion engine that recognizes the user's emotions. The processing of the system program is described in detail below.

[0401] System Overview

[0402] Based on the information entered by the user, the server identifies the necessary nutrients, generates optimal ingredients, recipes, and exercise methods, and provides them to the user via the device. Furthermore, the system recognizes the user's emotional state in real time and optimizes the suggestions based on that information. This allows users to incorporate optimal diet and exercise plans that are tailored to their physical condition, preferences, and emotions, thereby improving their health and beauty.

[0403] Program processing

[0404] Accepting user input and sending data

[0405] The terminal prompts the user for the following information:

[0406] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[0407] Favorite ingredients (e.g. chicken, spinach)

[0408] Category of food you want to eat (e.g. Japanese food, Western food)

[0409] Current health condition (optional, e.g., light exercise is possible, allergies)

[0410] Furthermore, the emotion engine recognizes emotions from the user's facial expressions and voice and sends that data to the system. The device collects the user's input information and emotion data, serializes it into JSON format, and sends it to the server.

[0411] Data analysis and proposals

[0412] The server receives the received user data and begins parsing it. It does the following:

[0413] 1. Identify the nutrients you need based on your physical condition or skin concerns. For example, if you are concerned about fatigue, you might identify B vitamins and iron as the nutrients you need.

[0414] 2. The database is searched for foods that are high in the identified nutrients. For example, "chicken" that is high in "B vitamins" and "spinach" that is high in "iron" are identified.

[0415] 3. Generate an appropriate recipe based on the user's preferences. If the user selects "Japanese food," select the Japanese recipe "Teriyaki Chicken and Spinach," which uses "chicken" and "spinach."

[0416] 4. Include cooking tips in recipes to prevent nutrient loss, such as "cook chicken quickly to preserve B vitamins."

[0417] 5. Select the optimal exercise method based on the user's health condition. For example, if "light exercise is possible," recommend "light aerobic exercise" or "stretching."

[0418] 6. Based on data from the emotion engine, the app adjusts to take into account the user's mood and emotional state. For example, it can suggest relaxing recipes or exercise methods based on tired facial expressions or tone of voice.

[0419] The generated list of recipes and exercise methods is serialized in JSON format and sent to the device.

[0420] Suggestions for users

[0421] The device deserializes the information received from the server and displays the following in the user interface:

[0422] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[0423] Details of the exercise method and its effects.

[0424] Special suggestions based on the user's emotional state (e.g., stretching techniques to relax).

[0425] Specific examples

[0426] Example: Improving fatigue and considering emotions

[0427] 1. The user enters "I get tired easily," selects "chicken" as the favorite food, and selects "Japanese food" as the food category they want to eat.

[0428] 2. The emotion engine recognizes fatigue from the user's facial expressions and voice and generates it as data.

[0429] 3. The device serializes the user input information and emotion data into JSON format and sends it to the server.

[0430] 4. Analyze that servers "get tired easily" and therefore need B vitamins and iron.

[0431] 5. The server searches the database and identifies "chicken," which is rich in "B vitamins," and "spinach," which is rich in "iron."

[0432] 6. Since the user has selected "Japanese food," select the Japanese recipe "Teriyaki Chicken and Spinach."

[0433] 7. Add "cook quickly" to recipes as a cooking tip to preserve B vitamins.

[0434] 8. Consider the user's health condition and recommend "light aerobic exercise" and "stretching."

[0435] 9. Suggest exercise methods with a high relaxation effect based on emotional data.

[0436] 10. The server sends the generated proposal to the terminal, which displays it on the user interface.

[0437] Example prompts for generative AI models

[0438] Here are some examples of prompts for generative AI models:

[0439] User input: I get tired easily

[0440] Favorite food: Chicken

[0441] Food category: Japanese food

[0442] Health condition: Light exercise possible

[0443] Emotion engine data: Detecting fatigue from the user's facial expressions and voice

[0444] Based on this information, we suggest recipes and exercise regimes that contain optimal nutrients.

[0445] The above is an embodiment of the present invention.

[0446] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0447] Step 1: Enter your information

[0448] The user inputs information about their physical ailments, skin concerns, favorite ingredients, desired food categories, and current health condition through the device. The emotion engine analyzes the user's facial expressions and voice in real time to generate emotion data. This input information and emotion data become the raw data required for system processing.

[0449] Input: User's physical condition, favorite ingredients, emotional data

[0450] Data processing: The emotion engine analyzes the user's facial expressions and voice to generate emotion data.

[0451] Output: User input and emotion data

[0452] Step 2: Submit your information

[0453] The device serializes user input information and emotion data in JSON format and sends it to the server, allowing the server to accurately grasp the user's overall state.

[0454] Input: User input and emotion data

[0455] Data processing: Serializing information into JSON format

[0456] Output: JSON format data is sent to the server

[0457] Step 3: Analyze the data

[0458] The server analyzes the information received from the user and identifies the nutrients they need. This analysis uses algorithms and database searches. For example, if someone says they get tired easily, B vitamins and iron will be identified as necessary nutrients.

[0459] Input: User input and emotion data

[0460] Data processing: Algorithmic analysis, database search

[0461] Output: List of nutrients needed

[0462] Step 4: Find ingredients

[0463] The server searches the database to find foods that are high in the specified nutrients, such as chicken, which is rich in B vitamins, or spinach, which is rich in iron.

[0464] Input: List of nutrients needed

[0465] Data processing: Database search

[0466] Output: A list of ingredients

[0467] Step 5: Generate the recipe

[0468] The server generates an appropriate recipe based on the user's preferences and health condition. For example, if the user selects "Japanese food," it generates a recipe such as "Teriyaki chicken and spinach." This recipe also includes cooking tips to prevent the loss of nutrients.

[0469] Input: Ingredient list, user preferences, health status

[0470] Data processing: Creating recipes and adding cooking points

[0471] Output: The generated recipe

[0472] Step 6: Choose an exercise method

[0473] The server considers the user's health condition and selects an appropriate exercise method, such as recommending "light aerobic exercise" or "stretching."

[0474] Input: User's health status

[0475] Data processing: Selection of exercise method

[0476] Output: Recommended exercise method

[0477] Step 7: Optimize recommendations based on sentiment data

[0478] The server optimizes the suggestions based on the emotional data from the emotion engine. For example, if the user expresses fatigue, the server will adjust the suggestions to include recipes or exercise methods that are more relaxing.

[0479] Input: Emotion data, generated recipes and exercise methods

[0480] Data processing: Optimizing proposal content based on emotional data

[0481] Output: Optimized proposals

[0482] Step 8: Submit and view your proposal

[0483] The server serializes the optimized recipe and exercise method in JSON format and sends it to the device, which receives it and displays it in the user interface. The user can then confirm the suggestions and put them into practice.

[0484] Input: Optimized suggestions

[0485] Data processing: Serialize to JSON format

[0486] Output: Display the suggestion to the user

[0487] In this way, the system suggests optimal diet and exercise based on the user's physical condition, preferences, and emotional state.

[0488] (Application example 2)

[0489] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0490] Conventional food delivery systems and health management systems generally make suggestions based on basic information such as the user's physical condition, skin concerns, preferences, and health status. However, these systems do not take the user's emotional state into consideration, which means they are unable to make optimal suggestions when the user is emotionally tired or stressed. This has led to the issue of not being able to maximize the user's health and satisfaction.

[0491] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for having the user input information about physical ailments, skin concerns, favorite ingredients, categories of food they want to eat, and their current health condition, means for transmitting the input information to the server, means for recognizing emotions from the user's facial expressions and voice using the camera and microphone and collecting emotional data, and means for identifying necessary nutrients based on the information and emotional data. This makes it possible to suggest optimal meals and exercises that take the user's emotional state into consideration.

[0492] "User" refers to an individual user of the system.

[0493] "Physical ailments" refers to physical health problems experienced by the user, such as fatigue, pain, or weakness.

[0494] "Skin concerns" refer to issues related to the health and appearance of the user's skin, such as rough skin, dryness, acne, etc.

[0495] "Favorite ingredients" refer to foods that a user particularly likes and prefers to eat.

[0496] The "category of food you want to eat" refers to the type or genre of food that the user wants to eat.

[0497] "Current health condition" refers to the user's perceived physical condition and health status, such as allergies and the degree to which they are able to exercise.

[0498] "Camera" refers to a device for taking images and videos and acquiring data.

[0499] "Microphone" refers to a device for collecting sound and acquiring data.

[0500] "Emotion" refers to the state of mind that a user feels at a particular moment or in a particular situation, such as joy, sadness, anger, surprise, etc.

[0501] "Emotional data" refers to data that indicates the user's emotional state based on the user's facial expressions and voice information collected from a camera or microphone.

[0502] "Server" refers to a computer system that receives input information and emotional data from a user, analyzes, processes, and generates suggestions.

[0503] "Nutrients" refers to chemical components such as vitamins, minerals, and proteins that are necessary for the user to maintain their health.

[0504] "Ingredients" refer to the individual foods or ingredients used to make a meal.

[0505] A "recipe" refers to information about the steps and ingredients for making a particular dish.

[0506] An "exercise regimen" refers to a specific set of physical activities that a user undertakes to improve their health and fitness.

[0507] "Terminal" refers to a computing device, such as a smartphone or tablet, that a user uses to enter information or view suggestions.

[0508] This invention integrates an emotion engine into a system that suggests the nutrients, ingredients, cooking methods, and exercise methods needed to address a user's physical condition or skin concerns. Specifically, the system recognizes the user's emotional state in real time and makes optimal suggestions based on this. The program processing of this system is explained below in natural language.

[0509] User input acceptance and emotion recognition

[0510] Using a smartphone, users input their physical ailments, skin concerns, favorite ingredients, food categories they want to eat, and their current health condition. Using the smartphone's camera and microphone, the emotion engine recognizes the user's emotions from their facial expressions and voice.

[0511] Data transmission

[0512] The device serializes the user's input information and emotion data into JSON format and sends it to the cloud server. The transmitted data includes the following important information:

[0513] Physical discomfort and skin problems

[0514] Favorite ingredients

[0515] Food category you want to eat

[0516] Current health status

[0517] Recognized emotion data

[0518] Data analysis and proposals

[0519] The cloud server analyzes the received user data and generates proposals through the following process:

[0520] 1. Identify the nutrients needed based on your physical condition. For example, if you suffer from fatigue, B vitamins and iron may be identified.

[0521] 2. Search the database for foods that are high in the specified nutrients. For example, you can find chicken, which is rich in B vitamins, or spinach, which is rich in iron.

[0522] 3. Generate appropriate recipes based on the user's preferred ingredients and cooking category. If the Japanese food category is selected, "Teriyaki Chicken and Spinach" will be suggested.

[0523] 4. Recipes should also include specific cooking tips to prevent nutrient loss, such as cooking chicken quickly to preserve B vitamins.

[0524] 5. Choose the best exercise method based on your current health condition. If light exercise is possible, light aerobic exercise and stretching are recommended.

[0525] 6. Based on data from the emotion engine, the app adjusts to the user's mood and emotional state. For example, a tired facial expression or tone of voice can suggest relaxing recipes or exercise methods.

[0526] The proposal content generated by the above process is serialized in JSON format and sent to the device, which then deserializes it and displays it in the user interface.

[0527] Suggestions for users

[0528] The device displays the following in the user interface based on the information received from the server:

[0529] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[0530] Details of exercise method and its effects

[0531] Special suggestions based on the user's emotional state (e.g., stretching techniques to relax)

[0532] Specific examples

[0533] For example, if a user enters "I get tired easily," specifies "chicken" as their favorite ingredient, and "Japanese food" as their preferred food category:

[0534] 1. The emotion engine recognizes fatigue from the user's facial expressions and voice and transmits this as data.

[0535] 2. The device sends this information to the cloud server.

[0536] 3. The cloud server analyzes that "B vitamins and iron are necessary" and identifies "teriyaki chicken and spinach."

[0537] 4. Cooking tips to preserve B vitamins include "cooking for a short time."

[0538] 5. Light aerobic exercise and stretching are recommended, and exercise methods with a more relaxing effect are also suggested.

[0539] 6. The device displays recipes and exercise instructions to the user.

[0540] Prompt Sentence Examples

[0541] "Please enter the current physical discomfort you are experiencing."

[0542] "Choose your favorite ingredients."

[0543] Please select the category of food you would like to eat.

[0544] Please enter your current health status.

[0545] "Your emotional state can be reflected in relaxing cooking and exercise methods."

[0546] This allows users to incorporate optimal diet and exercise into their daily lives, tailored to their individual health conditions and emotions, thereby improving their health and beauty.

[0547] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0548] Step 1:

[0549] Users use their smartphone to input information about their physical ailments, skin concerns, favorite ingredients, food categories they want to eat, and their current health condition. This input information is serialized in JSON format on the device.

[0550] Step 2:

[0551] The device uses a camera and microphone to send the user's facial expressions and voice to the emotion engine in real time to recognize the user's emotional state. The emotion engine acquires the user's emotional data and serializes it in JSON format.

[0552] Step 3:

[0553] The device sends the user's input information and recognized emotion data to a cloud server. The sent data includes information on physical ailments and skin concerns, favorite ingredients, preferred food categories, current health status, and emotional state.

[0554] Step 4:

[0555] The cloud server analyzes the received data and performs the following data calculations:

[0556] Identify the nutrients you need based on your physical condition or skin concerns (for example, if you get tired easily, you should take B vitamins and iron).

[0557] Search the database for ingredients that are rich in necessary nutrients (for example, chicken, which is rich in B vitamins).

[0558] Generate suitable recipes based on your preferred ingredients and cooking categories.

[0559] Select the optimal exercise method based on your current health status and emotional data.

[0560] Step 5:

[0561] The server generates recipes and exercise data, serializes them into JSON format, and sends them to the device. The recipes also include cooking tips to prevent nutrient loss.

[0562] Step 6:

[0563] The device deserializes the information sent by the server and displays it in its user interface, specifically the following information:

[0564] Ingredient list for each recipe, cooking instructions, and cooking tips to prevent loss of nutrients

[0565] Details of the proposed exercise method and its effects

[0566] Special suggestions based on your emotional state (e.g., stretching techniques to relax)

[0567] Step 7:

[0568] The user can review the suggestions displayed on their device, select and execute them, and if necessary, generate new suggestions using additional prompts using the generative AI model.

[0569] Through these steps, users can receive diet and exercise recommendations optimized for their health and emotional state.

[0570] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0571] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0572] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0573] [Second embodiment]

[0574] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0575] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0576] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0577] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0578] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0579] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0580] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0581] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0582] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0583] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0584] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0585] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0586] This invention is a system that suggests optimal nutrients, ingredients, cooking methods, and exercise methods in response to a user's physical discomfort or skin concerns. The processing of the system program will be explained below in natural language.

[0587] System Overview

[0588] Based on the information entered by the user, the server identifies the necessary nutrients, generates optimal ingredients, recipes, and exercise methods, and provides them to the user via their device. This allows users to incorporate optimal diet and exercise that suits their physical condition and preferences, thereby improving their health and beauty.

[0589] Program processing

[0590] Accepting user input and sending data

[0591] The terminal prompts the user for the following information:

[0592] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[0593] Favorite ingredients (e.g. chicken, spinach)

[0594] Category of food you want to eat (e.g. Japanese food, Western food)

[0595] Current health condition (optional, e.g., light exercise is possible, allergies)

[0596] The terminal collects this input information, serializes it into JSON format, and sends it to the server.

[0597] Data analysis and proposals

[0598] The server receives the received user data and performs the following steps:

[0599] 1. Identify the nutrients you need based on your physical ailments and skin concerns.

[0600] Example: "Getting tired easily" → "B vitamins" and "iron"

[0601] 2. Search the database for foods that are high in the identified nutrients.

[0602] Example: "Iron" → "Spinach"

[0603] 3. Generate appropriate recipes taking into account the user's likes and dislikes and food categories.

[0604] Example: A recipe in the "Japanese food" category that uses "chicken" and "spinach" is "Chicken and spinach teriyaki."

[0605] 4. Provide cooking tips to preserve the nutrients in the ingredients in the recipe.

[0606] Example: "Cook it quickly to preserve the B vitamins."

[0607] 5. Select the optimal exercise method based on the user's health condition.

[0608] For example, if "Light exercise is possible," then "Light aerobic exercise" or "Stretching" would be appropriate.

[0609] The generated list of recipes and exercise methods is serialized in JSON format and sent to the device.

[0610] Suggestions for users

[0611] The device deserializes the information received from the server and displays the following in the user interface:

[0612] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[0613] Details of exercise method and its effects

[0614] This allows users to achieve optimal diet and exercise habits that suit their physical condition, thereby maintaining and improving their health and beauty.

[0615] Specific examples

[0616] Example: Improvement of fatigue

[0617] 1. The user enters "I get tired easily," selects "chicken" as the favorite food, and selects "Japanese food" as the food category they want to eat.

[0618] 2. The device sends this information to the server.

[0619] 3. Analyze that servers "get tired easily" and therefore need B vitamins and iron.

[0620] 4. The server identifies a Japanese recipe that uses "chicken," "Teriyaki Chicken and Spinach," and includes "cooking quickly" as a cooking tip for preserving B vitamins.

[0621] 5. The server recommends "light aerobic exercise" and "stretching."

[0622] 6. The device displays recipes and exercise instructions to the user.

[0623] The above is a specific embodiment of the present invention. This system allows users to incorporate optimal diet and exercise into their physical condition and preferences, thereby improving their health and beauty.

[0624] The processing flow will be explained below.

[0625] Step 1:

[0626] The device presents the user with an input form, in which the user enters information about physical ailments, skin concerns, favorite ingredients, preferred food categories, and current health condition.

[0627] Step 2:

[0628] The terminal serializes the input data into JSON format. Examples of user input data include:

[0629] Physical discomfort or skin problems (e.g., "tired easily," "rough skin")

[0630] Favorite ingredients (e.g., "chicken," "spinach")

[0631] Category of food you want to eat (e.g., "Japanese food," "Western food")

[0632] Current health status (e.g., "I can do light exercise" or "I have certain allergies")

[0633] Step 3:

[0634] The device sends the serialized data to the server via an HTTP POST request.

[0635] Step 4:

[0636] The server receives the HTTP request, deserializes the data from the request body, and begins parsing it.

[0637] Step 5:

[0638] The server identifies the nutrients needed based on the user's physical condition or skin concerns. For example, if the user is concerned about fatigue, it identifies B vitamins and iron as the necessary nutrients.

[0639] Step 6:

[0640] The server searches the database for foods that are rich in the specified nutrients. The search results include "chicken," which is rich in "B vitamins," and "spinach," which is rich in "iron."

[0641] Step 7:

[0642] The server generates an appropriate recipe based on the user's preferences. If the user selects "Japanese food," the server selects the Japanese recipe "Teriyaki Chicken and Spinach," which uses "chicken" and "spinach."

[0643] Step 8:

[0644] The server adds cooking tips to the recipe to prevent nutrient loss, such as "cook the chicken quickly to preserve B vitamins."

[0645] Step 9:

[0646] The server selects the optimal exercise method based on the user's health condition. For example, if "light exercise is possible," it will recommend "light aerobic exercise" or "stretching."

[0647] Step 10:

[0648] The server serializes the generated recipe and exercise method again into JSON format and sends it to the device.

[0649] Step 11:

[0650] The device deserializes the data received from the server, which includes the recipe title, ingredients list, cooking instructions, cooking tips, and exercise instructions.

[0651] Step 12:

[0652] The device displays the deserialized recipes and exercise methods on the user interface, allowing the user to check and practice the optimal diet and exercise methods for their physical condition.

[0653] The above are the specific processing steps of the present invention. This system allows users to effectively incorporate diet and exercise into their diet according to their physical condition and preferences.

[0654] Example 1

[0655] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0656] Conventional health management systems have difficulty proposing optimal ingredients, recipes, and exercise methods that suit the user's individual physical condition and preferences, resulting in the inability to obtain maximum benefits. In particular, there is a lack of recipes that include specific cooking tips to ensure that nutrients are not lost, and suggestions for exercise methods that take into account the exercise intensity according to the user's health condition, and these points need to be improved.

[0657] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0658] In this invention, the server includes means for allowing a user to input information about physical ailments, skin concerns, favorite ingredients, desired food categories, and current health condition, means for transmitting the input information to the server, means for the server to identify necessary nutrients based on the information, means for identifying ingredients rich in the nutrients, means for generating appropriate recipes based on the favorite ingredients and food categories, means for including specific cooking tips to prevent nutrient loss in recipes generated using the generative AI model, means for selecting an appropriate exercise method based on the physical ailment and health condition, means for transmitting the generated recipe and exercise method to a terminal, and means for the terminal to display the recipe and exercise method to the user. This allows users to incorporate optimal diet and exercise tailored to their physical condition and preferences, thereby improving their health and beauty.

[0659] "User" refers to an individual who uses the system to obtain optimal diet and exercise methods based on their physical ailments, skin concerns, preferred ingredients, preferred food categories, and current health status.

[0660] "Terminal" refers to a device that allows a user to input information, transmits the information to a server, and displays the recipes and exercise methods provided by the server so that the user can view them.

[0661] "Server" refers to a computer system that receives user data sent from a terminal, identifies necessary nutrients, ingredients, recipes, and exercise methods, and sends them to the terminal.

[0662] "Physical discomfort and skin problems" refers to the user's physical discomfort or skin problems, and appropriate nutrients and exercise methods are identified based on this information.

[0663] "Favorite ingredients" are ingredients that the user particularly likes to eat, and specific recipes are created based on this information.

[0664] The "category of food you want to eat" refers to the genre of food that the user likes, and includes Japanese food, Western food, Chinese food, and the like.

[0665] "Current health condition" refers to the user's physical condition and limitations, and includes information such as whether light exercise is possible or whether the user has any allergies.

[0666] "Nutrients" refers to components such as vitamins, minerals, and proteins that are necessary for improving and maintaining the user's physical condition.

[0667] "Generative AI models" refer to algorithms or programs that use artificial intelligence to generate optimal recipes or exercise methods based on information collected from users.

[0668] "Means to include specific cooking points in recipes to prevent nutrient loss" refers to a method in which the generated recipes provide specific cooking methods and precautions to maximize the nutritional value of ingredients.

[0669] "Exercise method" refers to the type and method of exercise recommended based on the user's health condition and physical condition, and includes light aerobic exercise, stretching, etc.

[0670] "Deserialization" refers to the operation of restoring serialized data (for example, JSON format) and returning it to a format that a program can process.

[0671] "Serialization" refers to the operation of converting data handled internally by a program into a standardized format (such as JSON) for communication and storage.

[0672] The present invention is a system that proposes optimal nutrients, ingredients, cooking methods, and exercise methods in response to a user's physical condition or skin concerns. Specific embodiments of this system will be described below.

[0673] Based on the information entered by the user, the server identifies the necessary nutrients and generates optimal ingredients, recipes, and exercise methods, which are then provided to the user via their device. This allows users to incorporate optimal diet and exercise methods tailored to their physical condition and preferences, thereby improving their health and beauty.

[0674] Hardware and Software Configuration

[0675] Terminal

[0676] A terminal is a device through which a user inputs information, and can be a smartphone, tablet, or PC. The terminal has a user interface and is capable of receiving input from the user and sending it to a server. Data serialization and deserialization is performed using a programming language such as Python or JavaScript.

[0677] server

[0678] The server is a central system that receives and analyzes data sent by users and identifies appropriate nutrients, ingredients, recipes, and exercise methods. The server references a database to obtain the necessary information and uses a generative AI model to make optimal recommendations. For example, Python frameworks such as Django and Flask are used to build server-side programs.

[0679] Specific processing flow

[0680] 1. Accepting user input

[0681] The user enters the following information into the device's input screen:

[0682] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[0683] Favorite ingredients (e.g. chicken, spinach)

[0684] Category of food you want to eat (e.g. Japanese food, Western food)

[0685] Current health condition (optional, e.g., light exercise is possible, allergies)

[0686] 2. Sending and serializing data

[0687] The device serializes the entered information into JSON format and sends it to the server via an HTTP POST request. Example:

[0688] json

[0689] {

[0690] "health_issues": "tire easily",

[0691] "favorite_foods": ["chicken", "spinach"],

[0692] "cuisine_type": "Japanese food",

[0693] "current_health_status": "Light exercise possible"

[0694] }

[0695] 3. Data analysis and proposals

[0696] The server deserializes the received data and performs the following:

[0697] Identify the nutrients needed based on the user's physical condition or skin concerns. Example: "Easily tired" → "B vitamins," "iron"

[0698] Search the database for foods that are high in a specific nutrient. Example: "B vitamins" → "chicken"

[0699] Generates appropriate recipes based on the user's favorite ingredients and cooking category. Uses a generative AI model. Example: "Teriyaki Chicken and Spinach" in the "Japanese Food" category.

[0700] Provide specific cooking tips to preserve the nutrients in the ingredients in the recipe. Example: "Cook the ingredients for a short time to preserve the B vitamins."

[0701] Select appropriate exercise methods based on the user's health condition. Example: "Light aerobic exercise" or "Stretching"

[0702] 4. Submitting and Viewing Proposals

[0703] The server serializes the generated recipe and exercise list into JSON format and sends it to the device. The device deserializes the received data and displays the suggestions to the user.

[0704] Examples of concrete examples and prompts

[0705] Specific examples

[0706] 1. The user enters "I get tired easily," selects "chicken" as the favorite food, and selects "Japanese food" as the food category they want to eat.

[0707] 2. The device sends this information to the server.

[0708] 3. Analyze that servers "get tired easily" and therefore need B vitamins and iron.

[0709] 4. When the server generates a Japanese recipe for "Teriyaki Chicken and Spinach" using "chicken," it includes the cooking tip of "cook quickly" to preserve B vitamins.

[0710] 5. The server recommends "light aerobic exercise" and "stretching."

[0711] 6. The device displays recipes and exercise instructions to the user.

[0712] Prompt Sentence Examples

[0713] I want to improve my physical condition as I get tired easily. My favorite food is chicken, and I would like to eat Japanese food. Please tell me some recipes and exercise methods.

[0714] The above is an embodiment of the invention, which allows users to incorporate optimal diet and exercise habits that suit their physical condition and preferences, thereby improving their health and beauty.

[0715] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0716] Step 1:

[0717] The user enters the following information into the device's input screen:

[0718] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[0719] Favorite ingredients (e.g. chicken, spinach)

[0720] Category of food you want to eat (e.g. Japanese food, Western food)

[0721] Current health condition (optional, e.g., light exercise is possible, allergies)

[0722] Input: Information such as the user's physical condition and preferences

[0723] Output: Data entered into the terminal form

[0724] Step 2:

[0725] The device receives the input and serializes it into JSON format, for example:

[0726] json

[0727] {

[0728] "health_issues": "tire easily",

[0729] "favorite_foods": ["chicken", "spinach"],

[0730] "cuisine_type": "Japanese food",

[0731] "current_health_status": "Light exercise possible"

[0732] }

[0733] Input: User information entered into the terminal

[0734] Output: JSON format data

[0735] Step 3:

[0736] The device sends the serialized data to the server via an HTTP POST request, which transfers the data from the device to the server.

[0737] Input: User information in JSON format

[0738] Output: HTTP request sent to the server

[0739] Step 4:

[0740] The server deserializes the JSON data it receives and converts it into an internal representation, allowing programs to manipulate the data directly.

[0741] Input: JSON data sent to the server

[0742] Output: Deserialized user information

[0743] Step 5:

[0744] The server uses the deserialized data to analyze the user's physical condition and skin concerns and identify the nutrients they need. For example, "easily fatigued" can lead to "B vitamins" and "iron."

[0745] Input: Deserialized user information

[0746] Output: List of required nutrients

[0747] Step 6:

[0748] The server checks the necessary nutrients against a database and searches for foods that contain a lot of them. For example, "B vitamins" → "chicken."

[0749] Input: List of nutrients needed

[0750] Output: A list of identified ingredients

[0751] Step 7:

[0752] The server considers the user's preferred ingredients and food category and uses a generative AI model to generate an appropriate recipe. For example, a recipe using "chicken" in the "Japanese food" category, "Teriyaki Chicken and Spinach."

[0753] Input: A list of identified ingredients, and the user's ingredient and cooking category preferences

[0754] Output: The generated recipe

[0755] Step 8:

[0756] The server adds specific cooking tips to generated recipes to prevent nutrient loss, such as "cook quickly to preserve B vitamins."

[0757] Input: Generated recipe

[0758] Output: Recipe with cooking points

[0759] Step 9:

[0760] The server selects an appropriate exercise method based on the user's current health condition. For example, if "light exercise is possible," the server selects "light aerobic exercise" or "stretching."

[0761] Input: User's current health status

[0762] Output: Recommended exercise method

[0763] Step 10:

[0764] The server serializes the generated recipe and list of exercise methods into JSON format again and sends it to the device.

[0765] Input: Recipe with cooking instructions and exercise instructions

[0766] Output: Send to the terminal as JSON format data

[0767] Step 11:

[0768] The device deserializes the received JSON data and displays it in the user interface, specifically the following:

[0769] Recipe name, ingredients list, cooking instructions, cooking tips for preserving nutrients

[0770] Details of exercise method and its effects

[0771] Input: JSON data received from the server

[0772] Output: Recipe and exercise instructions displayed in the user interface

[0773] The above is the specific processing flow of the program for this system. This system allows users to incorporate optimal diet and exercise tailored to their physical condition and preferences, thereby improving their health and beauty.

[0774] (Application example 1)

[0775] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0776] Conventional health management systems require users to manually research the appropriate nutrients and exercise methods based on their physical condition and dietary preferences, which requires a significant burden of time and effort. Furthermore, the health foods and advice provided in physical stores often do not adequately address the user's individual health condition. This makes it difficult for users to easily and accurately manage their health in physical stores.

[0777] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0778] In this invention, the server includes means for allowing a user to input information about physical ailments, skin concerns, favorite ingredients, desired food categories, and current health status, means for transmitting the input information to the server, means for identifying necessary nutrients based on the information, means for identifying ingredients rich in the nutrients, means for generating appropriate recipes based on the favorite ingredients and food categories, means for selecting appropriate exercise methods based on the physical ailments and health status, means for transmitting the generated recipes and exercise methods to a terminal, means for the terminal to display the recipes and exercise methods to the user, means for suggesting ingredients and recipes containing necessary nutrients based on the information input by the user in the physical store, and means for navigating the user to maintain health based on the recipes and exercise methods provided in the physical store. This allows users to easily obtain appropriate nutrient intake methods and exercise methods tailored to their individual health status even in the physical store.

[0779] "User" refers to a person who uses the system to input information about physical ailments, skin concerns, food preferences, etc., and receives advice on health management.

[0780] "Physical discomfort and skin problems" refers to health problems such as fatigue and rough skin experienced by users.

[0781] "Favorite ingredients" refers to ingredients that the user particularly likes to consume.

[0782] The "category of food you want to eat" refers to the type of food (Japanese food, Western food, etc.) that the user particularly wants to eat.

[0783] "Current health condition" refers to the user's current physical condition, athletic ability, whether or not they have any allergies, etc.

[0784] "Server" refers to a computer system that receives and processes user input information.

[0785] "Essential nutrients" refer to specific nutritional components necessary to improve the user's physical condition or skin problems.

[0786] An "appropriate recipe" refers to a cooking method for a dish that is rich in necessary nutrients and is generated based on the user's preferences and health condition.

[0787] The "exercise method" refers to an exercise program for improving physical condition or maintaining health, selected according to the user's health condition.

[0788] "Terminal" refers to a device (such as a smartphone or tablet) that displays information entered by the user and communicates with the server.

[0789] "Brick and mortar" refers to a physical retail location or fitness facility where users can visit and receive health foods and advice.

[0790] "Navigation" refers to a guide function that helps users easily understand the information and action plans necessary for health management.

[0791] This invention is a system that suggests optimal nutrients, ingredients, cooking methods, and exercise methods according to a user's physical ailments, skin concerns, and dietary preferences.

[0792] System configuration

[0793] The system consists of a terminal that accepts information input from users, a server that processes the information, and a terminal that displays the results. The terminals can be smartphones or tablet terminals in physical stores.

[0794] Program processing

[0795] Accepting user input and sending data

[0796] Users input information such as physical ailments, skin concerns, favorite ingredients, preferred food categories, current health status, etc. This input information is serialized in JSON format by the device and sent to the server.

[0797] Data analysis and proposals

[0798] The server performs the following operations based on the received user data:

[0799] 1. Identify the nutrients you need based on your physical ailments and skin concerns.

[0800] 2. Search the database for foods that are high in the identified nutrients.

[0801] 3. Generate appropriate recipes taking into account the user's likes and dislikes and food categories.

[0802] 4. Provide cooking tips to preserve the nutrients in the ingredients in the recipe.

[0803] 5. Select the optimal exercise method based on the user's health condition.

[0804] This information is again serialized in JSON format and sent to the device.

[0805] Suggestions for users

[0806] The device deserializes the information received from the server and displays the following in its user interface:

[0807] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[0808] Details of exercise method and its effects

[0809] Specific examples

[0810] Examples based on user health status

[0811] For example, if a user inputs "I get tired easily," selects "chicken" as their favorite ingredient, and "Japanese food" as their preferred food category, the device will send this information to the server. The server will analyze the information that "I get tired easily" and determine that B vitamins and iron are necessary. It will then identify a Japanese recipe using "chicken," "Teriyaki Chicken and Spinach," and include the cooking key of "cooking quickly" to maintain B vitamins. It will then recommend "light aerobic exercise" and "stretching" to the user. Finally, the device will display the recipe and exercise instructions to the user.

[0812] Prompt Sentence Examples

[0813] Here are some examples of prompts to input to the generative AI model:

[0814] Based on the user's input of "easily tired," "chicken," and "Japanese food," please suggest ingredients that are rich in B vitamins and iron, Japanese food recipes that use these ingredients, and light aerobic exercise.

[0815] In this way, a system is provided that allows users to achieve optimal diet and exercise tailored to their physical condition and preferences, thereby maintaining and improving their health and beauty.

[0816] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0817] Step 1:

[0818] The user uses the device to input information about physical ailments, skin concerns, favorite ingredients, food categories they want to eat, and their current health condition. This input information is serialized in JSON format.

[0819] Input: physical discomfort, skin concerns, favorite ingredients, food categories you want to eat, current health condition

[0820] Output: User information in JSON format

[0821] Step 2:

[0822] The device sends the serialized user information to the server by using an HTTP POST request to send the data to the server's API endpoint.

[0823] Input: User information in JSON format

[0824] Output: Send request

[0825] Step 3:

[0826] The server receives the user information, deserializes it, and begins analyzing it. First, it uses specific rules and databases to identify necessary nutrients based on physical ailments and skin concerns.

[0827] Input: User information in JSON format

[0828] Output: Identified nutrient needs

[0829] Step 4:

[0830] The server searches the database for ingredients based on the identified required nutrients, and generates a list of ingredients that are rich in nutrients.

[0831] Input: Identified nutrient needs

[0832] Output: List of identified ingredients

[0833] Step 5:

[0834] The server takes into account the user's preferred ingredients and desired food category and generates appropriate recipes using a recipe database and filtering logic.

[0835] Input: Identified ingredients, user's food preferences and cuisine category

[0836] Output: The generated appropriate recipe

[0837] Step 6:

[0838] Adds nutrient loss prevention cooking points to server-generated recipes, which include specific cooking methods to keep ingredients nutritious.

[0839] Input: Generated recipe

[0840] Output: Recipe with cooking points added

[0841] Step 7:

[0842] The server selects the optimal exercise method based on the user's health condition. In this process, the server takes into account the user's exercise ability and limitations and proposes an appropriate exercise program.

[0843] Input: User's health status

[0844] Output: Selected exercise method

[0845] Step 8:

[0846] The server serializes the generated recipe and exercise method into JSON format and sends it back to the device using an HTTP POST request.

[0847] Input: Generated recipe, selected exercise method

[0848] Output: Recipe and exercise instructions in JSON format

[0849] Step 9:

[0850] The device deserializes the JSON formatted information received from the server and displays it on the user interface, presenting recipes and exercise methods in a visually easy-to-understand format.

[0851] Input: Received JSON format recipe and exercise instructions

[0852] Output: Recipe and exercise instructions displayed in a user interface

[0853] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0854] This invention combines a system that suggests optimal nutrients, ingredients, cooking methods, and exercise methods for a user's physical condition or skin concerns with an emotion engine that recognizes the user's emotions. The processing of the system's program is explained below in natural language.

[0855] System Overview

[0856] Based on the information entered by the user, the server identifies the necessary nutrients, generates optimal ingredients, recipes, and exercise methods, and provides them to the user via the device. Furthermore, the system recognizes the user's emotional state in real time and optimizes the suggestions based on that information. This allows users to incorporate optimal diet and exercise plans that are tailored to their physical condition, preferences, and emotions, thereby improving their health and beauty.

[0857] Program processing

[0858] Accepting user input and sending data

[0859] The terminal prompts the user for the following information:

[0860] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[0861] Favorite ingredients (e.g. chicken, spinach)

[0862] Category of food you want to eat (e.g. Japanese food, Western food)

[0863] Current health condition (optional, e.g., light exercise is possible, allergies)

[0864] Furthermore, the emotion engine recognizes emotions from the user's facial expressions and voice and sends that data to the system. The device collects the user's input information and emotion data, serializes it into JSON format, and sends it to the server.

[0865] Data analysis and proposals

[0866] The server receives the received user data and begins parsing it. It does the following:

[0867] 1. Identify the nutrients you need based on your physical condition or skin concerns. For example, if you are concerned about fatigue, you might identify B vitamins and iron as the nutrients you need.

[0868] 2. The database is searched for foods that are high in the identified nutrients. For example, "chicken" that is high in "B vitamins" and "spinach" that is high in "iron" are identified.

[0869] 3. Generate an appropriate recipe based on the user's preferences. If the user selects "Japanese food," select the Japanese recipe "Teriyaki Chicken and Spinach," which uses "chicken" and "spinach."

[0870] 4. Include cooking tips in recipes to prevent nutrient loss, such as "cook chicken quickly to preserve B vitamins."

[0871] 5. Select the optimal exercise method based on the user's health condition. For example, if "light exercise is possible," recommend "light aerobic exercise" or "stretching."

[0872] 6. Based on data from the emotion engine, the app adjusts to take into account the user's mood and emotional state. For example, it can suggest relaxing recipes or exercise methods based on tired facial expressions or tone of voice.

[0873] The generated list of recipes and exercise methods is serialized in JSON format and sent to the device.

[0874] Suggestions for users

[0875] The device deserializes the information received from the server and displays the following in the user interface:

[0876] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[0877] Details of the exercise method and its effects.

[0878] Special suggestions based on the user's emotional state (e.g., stretching techniques to relax).

[0879] Specific examples

[0880] Example: Improving fatigue and considering emotions

[0881] 1. The user enters "I get tired easily," selects "chicken" as the favorite food, and selects "Japanese food" as the food category they want to eat.

[0882] 2. The emotion engine recognizes fatigue from the user's facial expressions and voice and transmits it as data.

[0883] 3. The device sends this information to the server.

[0884] 4. Analyze that servers "get tired easily" and therefore need B vitamins and iron.

[0885] 5. The server identifies a Japanese recipe that uses "chicken," "Teriyaki Chicken and Spinach," and includes "cooking quickly" as a cooking tip for preserving B vitamins.

[0886] 6. The server recommends "light aerobic exercise" and "stretching," and further suggests exercise methods with a high relaxation effect based on the emotion engine.

[0887] 7. The device displays recipes and exercise instructions to the user.

[0888] The above is a specific embodiment of the present invention. This system allows users to incorporate optimal diet and exercise according to their physical condition, preferences, and emotions, thereby improving their health and beauty.

[0889] The processing flow will be explained below.

[0890] Step 1:

[0891] The device presents the user with an input form, in which the user inputs information about physical ailments, skin concerns, favorite ingredients, preferred food categories, and current health condition. The device also activates an emotion engine to obtain emotional data from the user's facial expressions and voice.

[0892] Step 2:

[0893] The emotion engine analyzes the user's facial expressions and voice to identify their emotional state in real time. For example, it uses a facial recognition camera and voice recognition system to detect a user's tired expression or tone of voice and record this as emotion data.

[0894] Step 3:

[0895] The device serializes the input data and parsed emotion data into JSON format, which includes:

[0896] Physical discomfort or skin problems (e.g., "tired easily," "rough skin")

[0897] Favorite ingredients (e.g., "chicken," "spinach")

[0898] Category of food you want to eat (e.g., "Japanese food," "Western food")

[0899] Current health condition (e.g., "Light exercise is possible" or "I have allergies")

[0900] Emotional data (e.g., "tired," "stressed")

[0901] Step 4:

[0902] The device sends the serialized data to the server via an HTTP POST request.

[0903] Step 5:

[0904] The server receives the HTTP request, deserializes the data from the request body, and begins parsing it.

[0905] Step 6:

[0906] The server identifies the nutrients needed based on the user's physical condition or skin concerns. For example, if the user is concerned about fatigue, it identifies B vitamins and iron as the necessary nutrients.

[0907] Step 7:

[0908] The server searches the database for foods that are rich in the specified nutrients. The search results include "chicken," which is rich in "B vitamins," and "spinach," which is rich in "iron."

[0909] Step 8:

[0910] The server generates an appropriate recipe based on the user's preferred ingredients and cooking category. For example, if the user selects "Japanese food," the server selects the Japanese recipe "Teriyaki Chicken and Spinach," which uses "chicken" and "spinach."

[0911] Step 9:

[0912] The server adds cooking instructions to the recipe to prevent loss of nutrients, such as "cook the chicken quickly to preserve the B vitamins."

[0913] Step 10:

[0914] The server selects the optimal exercise method based on the user's health condition. For example, if "light exercise is possible," it will recommend "light aerobic exercise" or "stretching."

[0915] Step 11:

[0916] The server adjusts the user's mood and emotional state based on data from the emotion engine. For example, if the user is recognized as "tired," it will suggest relaxing dishes or exercise methods (e.g., "cooking with herbal tea" or "relaxing yoga").

[0917] Step 12:

[0918] The server serializes the generated recipe and exercise method again into JSON format and sends it to the device.

[0919] Step 13:

[0920] The device deserializes the data received from the server, which includes the recipe title, ingredients list, cooking instructions, cooking tips, and exercise instructions.

[0921] Step 14:

[0922] The device displays the deserialized recipes and exercise methods on a user interface, allowing the user to check and practice the optimal diet and exercise methods tailored to their physical and emotional state.

[0923] The above are the specific processing steps of the present invention. This system allows users to effectively incorporate diet and exercise into their diet according to their physical condition, preferences, and emotions.

[0924] Example 2

[0925] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0926] While conventional health management systems can suggest dietary and exercise regimes based on a user's physical condition, skin concerns, and preferences, they have had difficulty making optimal recommendations that take into account the user's emotional state. In particular, they have been unable to provide specific responses or suggestions that reflect the user's emotions, making it difficult to improve the user experience.

[0927] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0928] In this invention, the server includes means for having the user input information about physical ailments, skin concerns, favorite ingredients, desired food categories, and current health condition, means for transmitting the input information and collected emotional data to the server, means for the server to identify necessary nutrients based on the information and emotional data, means for optimizing the recommendations based on the emotional data, means for selecting an appropriate exercise method based on the physical ailments and health condition, and means for transmitting the generated recipes and exercise methods to the terminal. This enables optimal recommendations that take into account not only the user's physical condition and preferences, but also their emotional state.

[0929] "User" refers to an individual who uses the system to input their health status, preferences, and emotional state.

[0930] A "terminal" is an electronic device that a user uses to input information and receive suggestions from the system.

[0931] The "server" is a computer system that receives and analyzes information sent by users, generates the necessary nutrients, ingredients, recipes, and exercise methods, and sends them to the terminal.

[0932] The "emotion engine" is a system that recognizes emotions from a user's facial expressions and voice in real time and generates that data.

[0933] "Nutrients" refer to ingredients such as vitamins and minerals that are necessary to improve the user's physical condition and skin problems.

[0934] "Ingredients" refers to specific ingredients of foods that are rich in nutrients.

[0935] A "recipe" refers to a cooking method that uses specific ingredients and includes cooking tips to prevent loss of nutrients.

[0936] "Exercise method" refers to physical activities recommended based on the user's physical condition and health status.

[0937] "Emotional Data" refers to information about a user's emotional state generated by an emotion engine.

[0938] "Deserialization" refers to the process of returning serialized data sent from the server to its original data format.

[0939] "Optimizing suggested content" refers to optimizing suggested recipes and exercise methods to suit the user's emotional state based on the user's emotional data.

[0940] The present invention combines a system that suggests optimal nutrients, ingredients, cooking methods, and exercise methods for a user's physical condition or skin concerns with an emotion engine that recognizes the user's emotions. The processing of the system program is described in detail below.

[0941] System Overview

[0942] Based on the information entered by the user, the server identifies the necessary nutrients, generates optimal ingredients, recipes, and exercise methods, and provides them to the user via the device. Furthermore, the system recognizes the user's emotional state in real time and optimizes the suggestions based on that information. This allows users to incorporate optimal diet and exercise plans that are tailored to their physical condition, preferences, and emotions, thereby improving their health and beauty.

[0943] Program processing

[0944] Accepting user input and sending data

[0945] The terminal prompts the user for the following information:

[0946] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[0947] Favorite ingredients (e.g. chicken, spinach)

[0948] Category of food you want to eat (e.g. Japanese food, Western food)

[0949] Current health condition (optional, e.g., light exercise is possible, allergies)

[0950] Furthermore, the emotion engine recognizes emotions from the user's facial expressions and voice and sends that data to the system. The device collects the user's input information and emotion data, serializes it into JSON format, and sends it to the server.

[0951] Data analysis and proposals

[0952] The server receives the received user data and begins parsing it. It does the following:

[0953] 1. Identify the nutrients you need based on your physical condition or skin concerns. For example, if you are concerned about fatigue, you might identify B vitamins and iron as the nutrients you need.

[0954] 2. The database is searched for foods that are high in the identified nutrients. For example, "chicken" that is high in "B vitamins" and "spinach" that is high in "iron" are identified.

[0955] 3. Generate an appropriate recipe based on the user's preferences. If the user selects "Japanese food," select the Japanese recipe "Teriyaki Chicken and Spinach," which uses "chicken" and "spinach."

[0956] 4. Include cooking tips in recipes to prevent nutrient loss, such as "cook chicken quickly to preserve B vitamins."

[0957] 5. Select the optimal exercise method based on the user's health condition. For example, if "light exercise is possible," recommend "light aerobic exercise" or "stretching."

[0958] 6. Based on data from the emotion engine, the app adjusts to take into account the user's mood and emotional state. For example, it can suggest relaxing recipes or exercise methods based on tired facial expressions or tone of voice.

[0959] The generated list of recipes and exercise methods is serialized in JSON format and sent to the device.

[0960] Suggestions for users

[0961] The device deserializes the information received from the server and displays the following in the user interface:

[0962] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[0963] Details of the exercise method and its effects.

[0964] Special suggestions based on the user's emotional state (e.g., stretching techniques to relax).

[0965] Specific examples

[0966] Example: Improving fatigue and considering emotions

[0967] 1. The user enters "I get tired easily," selects "chicken" as the favorite food, and selects "Japanese food" as the food category they want to eat.

[0968] 2. The emotion engine recognizes fatigue from the user's facial expressions and voice and generates it as data.

[0969] 3. The device serializes the user input information and emotion data into JSON format and sends it to the server.

[0970] 4. Analyze that servers "get tired easily" and therefore need B vitamins and iron.

[0971] 5. The server searches the database and identifies "chicken," which is rich in "B vitamins," and "spinach," which is rich in "iron."

[0972] 6. Since the user has selected "Japanese food," select the Japanese recipe "Teriyaki Chicken and Spinach."

[0973] 7. Add "cook quickly" to recipes as a cooking tip to preserve B vitamins.

[0974] 8. Consider the user's health condition and recommend "light aerobic exercise" and "stretching."

[0975] 9. Suggest exercise methods with a high relaxation effect based on emotional data.

[0976] 10. The server sends the generated proposal to the terminal, which displays it on the user interface.

[0977] Example prompts for generative AI models

[0978] Here are some examples of prompts for generative AI models:

[0979] User input: I get tired easily

[0980] Favorite food: Chicken

[0981] Food category: Japanese food

[0982] Health condition: Light exercise possible

[0983] Emotion engine data: Detecting fatigue from the user's facial expressions and voice

[0984] Based on this information, we suggest recipes and exercise regimes that contain optimal nutrients.

[0985] The above is an embodiment of the present invention.

[0986] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0987] Step 1: Enter your information

[0988] The user inputs information about their physical ailments, skin concerns, favorite ingredients, desired food categories, and current health condition through the device. The emotion engine analyzes the user's facial expressions and voice in real time to generate emotion data. This input information and emotion data become the raw data required for system processing.

[0989] Input: User's physical condition, favorite ingredients, emotional data

[0990] Data processing: The emotion engine analyzes the user's facial expressions and voice to generate emotion data.

[0991] Output: User input and emotion data

[0992] Step 2: Submit your information

[0993] The device serializes user input information and emotion data in JSON format and sends it to the server, allowing the server to accurately grasp the user's overall state.

[0994] Input: User input and emotion data

[0995] Data processing: Serializing information into JSON format

[0996] Output: JSON format data is sent to the server

[0997] Step 3: Analyze the data

[0998] The server analyzes the information received from the user and identifies the nutrients they need. This analysis uses algorithms and database searches. For example, if someone says they get tired easily, B vitamins and iron will be identified as necessary nutrients.

[0999] Input: User input and emotion data

[1000] Data processing: Algorithmic analysis, database search

[1001] Output: List of nutrients needed

[1002] Step 4: Find ingredients

[1003] The server searches the database to find foods that are high in the specified nutrients, such as chicken, which is rich in B vitamins, or spinach, which is rich in iron.

[1004] Input: List of nutrients needed

[1005] Data processing: Database search

[1006] Output: A list of ingredients

[1007] Step 5: Generate the recipe

[1008] The server generates an appropriate recipe based on the user's preferences and health condition. For example, if the user selects "Japanese food," it generates a recipe such as "Teriyaki chicken and spinach." This recipe also includes cooking tips to prevent the loss of nutrients.

[1009] Input: Ingredient list, user preferences, health status

[1010] Data processing: Creating recipes and adding cooking points

[1011] Output: The generated recipe

[1012] Step 6: Choose an exercise method

[1013] The server considers the user's health condition and selects an appropriate exercise method, such as recommending "light aerobic exercise" or "stretching."

[1014] Input: User's health status

[1015] Data processing: Selection of exercise method

[1016] Output: Recommended exercise method

[1017] Step 7: Optimize recommendations based on sentiment data

[1018] The server optimizes the suggestions based on the emotional data from the emotion engine. For example, if the user expresses fatigue, the server will adjust the suggestions to include recipes or exercise methods that are more relaxing.

[1019] Input: Emotion data, generated recipes and exercise methods

[1020] Data processing: Optimizing proposal content based on emotional data

[1021] Output: Optimized proposals

[1022] Step 8: Submit and view your proposal

[1023] The server serializes the optimized recipe and exercise method in JSON format and sends it to the device, which receives it and displays it in the user interface. The user can then confirm the suggestions and put them into practice.

[1024] Input: Optimized suggestions

[1025] Data processing: Serialize to JSON format

[1026] Output: Display the suggestion to the user

[1027] In this way, the system suggests optimal diet and exercise based on the user's physical condition, preferences, and emotional state.

[1028] (Application example 2)

[1029] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1030] Conventional food delivery systems and health management systems generally make suggestions based on basic information such as the user's physical condition, skin concerns, preferences, and health status. However, these systems do not take the user's emotional state into consideration, which means they are unable to make optimal suggestions when the user is emotionally tired or stressed. This has led to the issue of not being able to maximize the user's health and satisfaction.

[1031] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for having the user input information about physical ailments, skin concerns, favorite ingredients, categories of food they want to eat, and their current health condition, means for transmitting the input information to the server, means for recognizing emotions from the user's facial expressions and voice using the camera and microphone and collecting emotional data, and means for identifying necessary nutrients based on the information and emotional data. This makes it possible to suggest optimal meals and exercises that take the user's emotional state into consideration.

[1032] "User" refers to an individual user of the system.

[1033] "Physical ailments" refers to physical health problems experienced by the user, such as fatigue, pain, or weakness.

[1034] "Skin concerns" refer to issues related to the health and appearance of the user's skin, such as rough skin, dryness, acne, etc.

[1035] "Favorite ingredients" refer to foods that a user particularly likes and prefers to eat.

[1036] The "category of food you want to eat" refers to the type or genre of food that the user wants to eat.

[1037] "Current health condition" refers to the user's perceived physical condition and health status, such as allergies and the degree to which they are able to exercise.

[1038] "Camera" refers to a device for taking images and videos and acquiring data.

[1039] "Microphone" refers to a device for collecting sound and acquiring data.

[1040] "Emotion" refers to the state of mind that a user feels at a particular moment or in a particular situation, such as joy, sadness, anger, surprise, etc.

[1041] "Emotional data" refers to data that indicates the user's emotional state based on the user's facial expressions and voice information collected from a camera or microphone.

[1042] "Server" refers to a computer system that receives input information and emotional data from a user, analyzes, processes, and generates suggestions.

[1043] "Nutrients" refers to chemical components such as vitamins, minerals, and proteins that are necessary for the user to maintain their health.

[1044] "Ingredients" refer to the individual foods or ingredients used to make a meal.

[1045] A "recipe" refers to information about the steps and ingredients for making a particular dish.

[1046] An "exercise regimen" refers to a specific set of physical activities that a user undertakes to improve their health and fitness.

[1047] "Terminal" refers to a computing device, such as a smartphone or tablet, that a user uses to enter information or view suggestions.

[1048] This invention integrates an emotion engine into a system that suggests the nutrients, ingredients, cooking methods, and exercise methods needed to address a user's physical condition or skin concerns. Specifically, the system recognizes the user's emotional state in real time and makes optimal suggestions based on this. The program processing of this system is explained below in natural language.

[1049] User input acceptance and emotion recognition

[1050] Using a smartphone, users input their physical ailments, skin concerns, favorite ingredients, food categories they want to eat, and their current health condition. Using the smartphone's camera and microphone, the emotion engine recognizes the user's emotions from their facial expressions and voice.

[1051] Data transmission

[1052] The device serializes the user's input information and emotion data into JSON format and sends it to the cloud server. The transmitted data includes the following important information:

[1053] Physical discomfort and skin problems

[1054] Favorite ingredients

[1055] Food category you want to eat

[1056] Current health status

[1057] Recognized emotion data

[1058] Data analysis and proposals

[1059] The cloud server analyzes the received user data and generates proposals through the following process:

[1060] 1. Identify the nutrients needed based on your physical condition. For example, if you suffer from fatigue, B vitamins and iron may be identified.

[1061] 2. Search the database for foods that are high in the specified nutrients. For example, you can find chicken, which is rich in B vitamins, or spinach, which is rich in iron.

[1062] 3. Generate appropriate recipes based on the user's preferred ingredients and cooking category. If the Japanese food category is selected, "Teriyaki Chicken and Spinach" will be suggested.

[1063] 4. Recipes should also include specific cooking tips to prevent nutrient loss, such as cooking chicken quickly to preserve B vitamins.

[1064] 5. Choose the best exercise method based on your current health condition. If light exercise is possible, light aerobic exercise and stretching are recommended.

[1065] 6. Based on data from the emotion engine, the app adjusts to the user's mood and emotional state. For example, a tired facial expression or tone of voice can suggest relaxing recipes or exercise methods.

[1066] The proposal content generated by the above process is serialized in JSON format and sent to the device, which then deserializes it and displays it in the user interface.

[1067] Suggestions for users

[1068] The device displays the following in the user interface based on the information received from the server:

[1069] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[1070] Details of exercise method and its effects

[1071] Special suggestions based on the user's emotional state (e.g., stretching techniques to relax)

[1072] Specific examples

[1073] For example, if a user enters "I get tired easily," specifies "chicken" as their favorite ingredient, and "Japanese food" as their preferred food category:

[1074] 1. The emotion engine recognizes fatigue from the user's facial expressions and voice and transmits this as data.

[1075] 2. The device sends this information to the cloud server.

[1076] 3. The cloud server analyzes that "B vitamins and iron are necessary" and identifies "teriyaki chicken and spinach."

[1077] 4. Cooking tips to preserve B vitamins include "cooking for a short time."

[1078] 5. Light aerobic exercise and stretching are recommended, and exercise methods with a more relaxing effect are also suggested.

[1079] 6. The device displays recipes and exercise instructions to the user.

[1080] Prompt Sentence Examples

[1081] "Please enter the current physical discomfort you are experiencing."

[1082] "Choose your favorite ingredients."

[1083] Please select the category of food you would like to eat.

[1084] Please enter your current health status.

[1085] "Your emotional state can be reflected in relaxing cooking and exercise methods."

[1086] This allows users to incorporate optimal diet and exercise into their daily lives, tailored to their individual health conditions and emotions, thereby improving their health and beauty.

[1087] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1088] Step 1:

[1089] Users use their smartphone to input information about their physical ailments, skin concerns, favorite ingredients, food categories they want to eat, and their current health condition. This input information is serialized in JSON format on the device.

[1090] Step 2:

[1091] The device uses a camera and microphone to send the user's facial expressions and voice to the emotion engine in real time to recognize the user's emotional state. The emotion engine acquires the user's emotional data and serializes it in JSON format.

[1092] Step 3:

[1093] The device sends the user's input information and recognized emotion data to a cloud server. The sent data includes information on physical ailments and skin concerns, favorite ingredients, preferred food categories, current health status, and emotional state.

[1094] Step 4:

[1095] The cloud server analyzes the received data and performs the following data calculations:

[1096] Identify the nutrients you need based on your physical condition or skin concerns (for example, if you get tired easily, you should take B vitamins and iron).

[1097] Search the database for ingredients that are rich in necessary nutrients (for example, chicken, which is rich in B vitamins).

[1098] Generate suitable recipes based on your preferred ingredients and cooking categories.

[1099] Select the optimal exercise method based on your current health status and emotional data.

[1100] Step 5:

[1101] The server generates recipes and exercise data, serializes them into JSON format, and sends them to the device. The recipes also include cooking tips to prevent nutrient loss.

[1102] Step 6:

[1103] The device deserializes the information sent by the server and displays it in its user interface, specifically the following information:

[1104] Ingredient list for each recipe, cooking instructions, and cooking tips to prevent loss of nutrients

[1105] Details of the proposed exercise method and its effects

[1106] Special suggestions based on your emotional state (e.g., stretching techniques to relax)

[1107] Step 7:

[1108] The user can review the suggestions displayed on their device, select and execute them, and if necessary, generate new suggestions using additional prompts using the generative AI model.

[1109] Through these steps, users can receive diet and exercise recommendations optimized for their health and emotional state.

[1110] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1111] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1112] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1113] [Third embodiment]

[1114] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1115] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1116] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1117] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1118] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1119] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1120] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1121] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1122] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1123] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1124] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1125] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1126] This invention is a system that suggests optimal nutrients, ingredients, cooking methods, and exercise methods in response to a user's physical discomfort or skin concerns. The processing of the system program will be explained below in natural language.

[1127] System Overview

[1128] Based on the information entered by the user, the server identifies the necessary nutrients, generates optimal ingredients, recipes, and exercise methods, and provides them to the user via their device. This allows users to incorporate optimal diet and exercise that suits their physical condition and preferences, thereby improving their health and beauty.

[1129] Program processing

[1130] Accepting user input and sending data

[1131] The terminal prompts the user for the following information:

[1132] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[1133] Favorite ingredients (e.g. chicken, spinach)

[1134] Category of food you want to eat (e.g. Japanese food, Western food)

[1135] Current health condition (optional, e.g., light exercise is possible, allergies)

[1136] The terminal collects this input information, serializes it into JSON format, and sends it to the server.

[1137] Data analysis and proposals

[1138] The server receives the received user data and performs the following steps:

[1139] 1. Identify the nutrients you need based on your physical ailments and skin concerns.

[1140] Example: "Getting tired easily" → "B vitamins" and "iron"

[1141] 2. Search the database for foods that are high in the identified nutrients.

[1142] Example: "Iron" → "Spinach"

[1143] 3. Generate appropriate recipes taking into account the user's likes and dislikes and food categories.

[1144] Example: A recipe in the "Japanese food" category that uses "chicken" and "spinach" is "Chicken and spinach teriyaki."

[1145] 4. Provide cooking tips to preserve the nutrients in the ingredients in the recipe.

[1146] Example: "Cook it quickly to preserve the B vitamins."

[1147] 5. Select the optimal exercise method based on the user's health condition.

[1148] For example, if "Light exercise is possible," then "Light aerobic exercise" or "Stretching" would be appropriate.

[1149] The generated list of recipes and exercise methods is serialized in JSON format and sent to the device.

[1150] Suggestions for users

[1151] The device deserializes the information received from the server and displays the following in the user interface:

[1152] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[1153] Details of exercise method and its effects

[1154] This allows users to achieve optimal diet and exercise habits that suit their physical condition, thereby maintaining and improving their health and beauty.

[1155] Specific examples

[1156] Example: Improvement of fatigue

[1157] 1. The user enters "I get tired easily," selects "chicken" as the favorite food, and selects "Japanese food" as the food category they want to eat.

[1158] 2. The device sends this information to the server.

[1159] 3. Analyze that servers "get tired easily" and therefore need B vitamins and iron.

[1160] 4. The server identifies a Japanese recipe that uses "chicken," "Teriyaki Chicken and Spinach," and includes "cooking quickly" as a cooking tip for preserving B vitamins.

[1161] 5. The server recommends "light aerobic exercise" and "stretching."

[1162] 6. The device displays recipes and exercise instructions to the user.

[1163] The above is a specific embodiment of the present invention. This system allows users to incorporate optimal diet and exercise into their physical condition and preferences, thereby improving their health and beauty.

[1164] The processing flow will be explained below.

[1165] Step 1:

[1166] The device presents the user with an input form, in which the user enters information about physical ailments, skin concerns, favorite ingredients, preferred food categories, and current health condition.

[1167] Step 2:

[1168] The terminal serializes the input data into JSON format. Examples of user input data include:

[1169] Physical discomfort or skin problems (e.g., "tired easily," "rough skin")

[1170] Favorite ingredients (e.g., "chicken," "spinach")

[1171] Category of food you want to eat (e.g., "Japanese food," "Western food")

[1172] Current health status (e.g., "I can do light exercise" or "I have certain allergies")

[1173] Step 3:

[1174] The device sends the serialized data to the server via an HTTP POST request.

[1175] Step 4:

[1176] The server receives the HTTP request, deserializes the data from the request body, and begins parsing it.

[1177] Step 5:

[1178] The server identifies the nutrients needed based on the user's physical condition or skin concerns. For example, if the user is concerned about fatigue, it identifies B vitamins and iron as the necessary nutrients.

[1179] Step 6:

[1180] The server searches the database for foods that are rich in the specified nutrients. The search results include "chicken," which is rich in "B vitamins," and "spinach," which is rich in "iron."

[1181] Step 7:

[1182] The server generates an appropriate recipe based on the user's preferences. If the user selects "Japanese food," the server selects the Japanese recipe "Teriyaki Chicken and Spinach," which uses "chicken" and "spinach."

[1183] Step 8:

[1184] The server adds cooking tips to the recipe to prevent nutrient loss, such as "cook the chicken quickly to preserve B vitamins."

[1185] Step 9:

[1186] The server selects the optimal exercise method based on the user's health condition. For example, if "light exercise is possible," it will recommend "light aerobic exercise" or "stretching."

[1187] Step 10:

[1188] The server serializes the generated recipe and exercise method again into JSON format and sends it to the device.

[1189] Step 11:

[1190] The device deserializes the data received from the server, which includes the recipe title, ingredients list, cooking instructions, cooking tips, and exercise instructions.

[1191] Step 12:

[1192] The device displays the deserialized recipes and exercise methods on the user interface, allowing the user to check and practice the optimal diet and exercise methods for their physical condition.

[1193] The above are the specific processing steps of the present invention. This system allows users to effectively incorporate diet and exercise into their diet according to their physical condition and preferences.

[1194] Example 1

[1195] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1196] Conventional health management systems have difficulty proposing optimal ingredients, recipes, and exercise methods that suit the user's individual physical condition and preferences, resulting in the inability to obtain maximum benefits. In particular, there is a lack of recipes that include specific cooking tips to ensure that nutrients are not lost, and suggestions for exercise methods that take into account the exercise intensity according to the user's health condition, and these points need to be improved.

[1197] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1198] In this invention, the server includes means for allowing a user to input information about physical ailments, skin concerns, favorite ingredients, desired food categories, and current health condition, means for transmitting the input information to the server, means for the server to identify necessary nutrients based on the information, means for identifying ingredients rich in the nutrients, means for generating appropriate recipes based on the favorite ingredients and food categories, means for including specific cooking tips to prevent nutrient loss in recipes generated using the generative AI model, means for selecting an appropriate exercise method based on the physical ailment and health condition, means for transmitting the generated recipe and exercise method to a terminal, and means for the terminal to display the recipe and exercise method to the user. This allows users to incorporate optimal diet and exercise tailored to their physical condition and preferences, thereby improving their health and beauty.

[1199] "User" refers to an individual who uses the system to obtain optimal diet and exercise methods based on their physical ailments, skin concerns, preferred ingredients, preferred food categories, and current health status.

[1200] "Terminal" refers to a device that allows a user to input information, transmits the information to a server, and displays the recipes and exercise methods provided by the server so that the user can view them.

[1201] "Server" refers to a computer system that receives user data sent from a terminal, identifies necessary nutrients, ingredients, recipes, and exercise methods, and sends them to the terminal.

[1202] "Physical discomfort and skin problems" refers to the user's physical discomfort or skin problems, and appropriate nutrients and exercise methods are identified based on this information.

[1203] "Favorite ingredients" are ingredients that the user particularly likes to eat, and specific recipes are created based on this information.

[1204] The "category of food you want to eat" refers to the genre of food that the user likes, and includes Japanese food, Western food, Chinese food, and the like.

[1205] "Current health condition" refers to the user's physical condition and limitations, and includes information such as whether light exercise is possible or whether the user has any allergies.

[1206] "Nutrients" refers to components such as vitamins, minerals, and proteins that are necessary for improving and maintaining the user's physical condition.

[1207] "Generative AI models" refer to algorithms or programs that use artificial intelligence to generate optimal recipes or exercise methods based on information collected from users.

[1208] "Means to include specific cooking points in recipes to prevent nutrient loss" refers to a method in which the generated recipes provide specific cooking methods and precautions to maximize the nutritional value of ingredients.

[1209] "Exercise method" refers to the type and method of exercise recommended based on the user's health condition and physical condition, and includes light aerobic exercise, stretching, etc.

[1210] "Deserialization" refers to the operation of restoring serialized data (for example, JSON format) and returning it to a format that a program can process.

[1211] "Serialization" refers to the operation of converting data handled internally by a program into a standardized format (such as JSON) for communication and storage.

[1212] The present invention is a system that proposes optimal nutrients, ingredients, cooking methods, and exercise methods in response to a user's physical condition or skin concerns. Specific embodiments of this system will be described below.

[1213] Based on the information entered by the user, the server identifies the necessary nutrients and generates optimal ingredients, recipes, and exercise methods, which are then provided to the user via their device. This allows users to incorporate optimal diet and exercise methods tailored to their physical condition and preferences, thereby improving their health and beauty.

[1214] Hardware and Software Configuration

[1215] Terminal

[1216] A terminal is a device through which a user inputs information, and can be a smartphone, tablet, or PC. The terminal has a user interface and is capable of receiving input from the user and sending it to a server. Data serialization and deserialization is performed using a programming language such as Python or JavaScript.

[1217] server

[1218] The server is a central system that receives and analyzes data sent by users and identifies appropriate nutrients, ingredients, recipes, and exercise methods. The server references a database to obtain the necessary information and uses a generative AI model to make optimal recommendations. For example, Python frameworks such as Django and Flask are used to build server-side programs.

[1219] Specific processing flow

[1220] 1. Accepting user input

[1221] The user enters the following information into the device's input screen:

[1222] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[1223] Favorite ingredients (e.g. chicken, spinach)

[1224] Category of food you want to eat (e.g. Japanese food, Western food)

[1225] Current health condition (optional, e.g., light exercise is possible, allergies)

[1226] 2. Sending and serializing data

[1227] The device serializes the entered information into JSON format and sends it to the server via an HTTP POST request. Example:

[1228] json

[1229] {

[1230] "health_issues": "tire easily",

[1231] "favorite_foods": ["chicken", "spinach"],

[1232] "cuisine_type": "Japanese food",

[1233] "current_health_status": "Light exercise possible"

[1234] }

[1235] 3. Data analysis and proposals

[1236] The server deserializes the received data and performs the following:

[1237] Identify the nutrients needed based on the user's physical condition or skin concerns. Example: "Easily tired" → "B vitamins," "iron"

[1238] Search the database for foods that are high in a specific nutrient. Example: "B vitamins" → "chicken"

[1239] Generates appropriate recipes based on the user's favorite ingredients and cooking category. Uses a generative AI model. Example: "Teriyaki Chicken and Spinach" in the "Japanese Food" category.

[1240] Provide specific cooking tips to preserve the nutrients in the ingredients in the recipe. Example: "Cook the ingredients for a short time to preserve the B vitamins."

[1241] Select appropriate exercise methods based on the user's health condition. Example: "Light aerobic exercise" or "Stretching"

[1242] 4. Submitting and Viewing Proposals

[1243] The server serializes the generated recipe and exercise list into JSON format and sends it to the device. The device deserializes the received data and displays the suggestions to the user.

[1244] Examples of concrete examples and prompts

[1245] Specific examples

[1246] 1. The user enters "I get tired easily," selects "chicken" as the favorite food, and selects "Japanese food" as the food category they want to eat.

[1247] 2. The device sends this information to the server.

[1248] 3. Analyze that servers "get tired easily" and therefore need B vitamins and iron.

[1249] 4. When the server generates a Japanese recipe for "Teriyaki Chicken and Spinach" using "chicken," it includes the cooking tip of "cook quickly" to preserve B vitamins.

[1250] 5. The server recommends "light aerobic exercise" and "stretching."

[1251] 6. The device displays recipes and exercise instructions to the user.

[1252] Prompt Sentence Examples

[1253] I want to improve my physical condition as I get tired easily. My favorite food is chicken, and I would like to eat Japanese food. Please tell me some recipes and exercise methods.

[1254] The above is an embodiment of the invention, which allows users to incorporate optimal diet and exercise habits that suit their physical condition and preferences, thereby improving their health and beauty.

[1255] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1256] Step 1:

[1257] The user enters the following information into the device's input screen:

[1258] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[1259] Favorite ingredients (e.g. chicken, spinach)

[1260] Category of food you want to eat (e.g. Japanese food, Western food)

[1261] Current health condition (optional, e.g., light exercise is possible, allergies)

[1262] Input: Information such as the user's physical condition and preferences

[1263] Output: Data entered into the terminal form

[1264] Step 2:

[1265] The device receives the input and serializes it into JSON format, for example:

[1266] json

[1267] {

[1268] "health_issues": "tire easily",

[1269] "favorite_foods": ["chicken", "spinach"],

[1270] "cuisine_type": "Japanese food",

[1271] "current_health_status": "Light exercise possible"

[1272] }

[1273] Input: User information entered into the terminal

[1274] Output: JSON format data

[1275] Step 3:

[1276] The device sends the serialized data to the server via an HTTP POST request, which transfers the data from the device to the server.

[1277] Input: User information in JSON format

[1278] Output: HTTP request sent to the server

[1279] Step 4:

[1280] The server deserializes the JSON data it receives and converts it into an internal representation, allowing programs to manipulate the data directly.

[1281] Input: JSON data sent to the server

[1282] Output: Deserialized user information

[1283] Step 5:

[1284] The server uses the deserialized data to analyze the user's physical condition and skin concerns and identify the nutrients they need. For example, "easily fatigued" can lead to "B vitamins" and "iron."

[1285] Input: Deserialized user information

[1286] Output: List of required nutrients

[1287] Step 6:

[1288] The server checks the necessary nutrients against a database and searches for foods that contain a lot of them. For example, "B vitamins" → "chicken."

[1289] Input: List of nutrients needed

[1290] Output: A list of identified ingredients

[1291] Step 7:

[1292] The server considers the user's preferred ingredients and food category and uses a generative AI model to generate an appropriate recipe. For example, a recipe using "chicken" in the "Japanese food" category, "Teriyaki Chicken and Spinach."

[1293] Input: A list of identified ingredients, and the user's ingredient and cooking category preferences

[1294] Output: The generated recipe

[1295] Step 8:

[1296] The server adds specific cooking tips to generated recipes to prevent nutrient loss, such as "cook quickly to preserve B vitamins."

[1297] Input: Generated recipe

[1298] Output: Recipe with cooking points

[1299] Step 9:

[1300] The server selects an appropriate exercise method based on the user's current health condition. For example, if "light exercise is possible," the server selects "light aerobic exercise" or "stretching."

[1301] Input: User's current health status

[1302] Output: Recommended exercise method

[1303] Step 10:

[1304] The server serializes the generated recipe and list of exercise methods into JSON format again and sends it to the device.

[1305] Input: Recipe with cooking instructions and exercise instructions

[1306] Output: Send to the terminal as JSON format data

[1307] Step 11:

[1308] The device deserializes the received JSON data and displays it in the user interface, specifically the following:

[1309] Recipe name, ingredients list, cooking instructions, cooking tips for preserving nutrients

[1310] Details of exercise method and its effects

[1311] Input: JSON data received from the server

[1312] Output: Recipe and exercise instructions displayed in the user interface

[1313] The above is the specific processing flow of the program for this system. This system allows users to incorporate optimal diet and exercise tailored to their physical condition and preferences, thereby improving their health and beauty.

[1314] (Application example 1)

[1315] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1316] Conventional health management systems require users to manually research the appropriate nutrients and exercise methods based on their physical condition and dietary preferences, which requires a significant burden of time and effort. Furthermore, the health foods and advice provided in physical stores often do not adequately address the user's individual health condition. This makes it difficult for users to easily and accurately manage their health in physical stores.

[1317] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1318] In this invention, the server includes means for allowing a user to input information about physical ailments, skin concerns, favorite ingredients, desired food categories, and current health status, means for transmitting the input information to the server, means for identifying necessary nutrients based on the information, means for identifying ingredients rich in the nutrients, means for generating appropriate recipes based on the favorite ingredients and food categories, means for selecting appropriate exercise methods based on the physical ailments and health status, means for transmitting the generated recipes and exercise methods to a terminal, means for the terminal to display the recipes and exercise methods to the user, means for suggesting ingredients and recipes containing necessary nutrients based on the information input by the user in the physical store, and means for navigating the user to maintain health based on the recipes and exercise methods provided in the physical store. This allows users to easily obtain appropriate nutrient intake methods and exercise methods tailored to their individual health status even in the physical store.

[1319] "User" refers to a person who uses the system to input information about physical ailments, skin concerns, food preferences, etc., and receives advice on health management.

[1320] "Physical discomfort and skin problems" refers to health problems such as fatigue and rough skin experienced by users.

[1321] "Favorite ingredients" refers to ingredients that the user particularly likes to consume.

[1322] The "category of food you want to eat" refers to the type of food (Japanese food, Western food, etc.) that the user particularly wants to eat.

[1323] "Current health condition" refers to the user's current physical condition, athletic ability, whether or not they have any allergies, etc.

[1324] "Server" refers to a computer system that receives and processes user input information.

[1325] "Essential nutrients" refer to specific nutritional components necessary to improve the user's physical condition or skin problems.

[1326] An "appropriate recipe" refers to a cooking method for a dish that is rich in necessary nutrients and is generated based on the user's preferences and health condition.

[1327] The "exercise method" refers to an exercise program for improving physical condition or maintaining health, selected according to the user's health condition.

[1328] "Terminal" refers to a device (such as a smartphone or tablet) that displays information entered by the user and communicates with the server.

[1329] "Brick and mortar" refers to a physical retail location or fitness facility where users can visit and receive health foods and advice.

[1330] "Navigation" refers to a guide function that helps users easily understand the information and action plans necessary for health management.

[1331] This invention is a system that suggests optimal nutrients, ingredients, cooking methods, and exercise methods according to a user's physical ailments, skin concerns, and dietary preferences.

[1332] System configuration

[1333] The system consists of a terminal that accepts information input from users, a server that processes the information, and a terminal that displays the results. The terminals can be smartphones or tablet terminals in physical stores.

[1334] Program processing

[1335] Accepting user input and sending data

[1336] Users input information such as physical ailments, skin concerns, favorite ingredients, preferred food categories, current health status, etc. This input information is serialized in JSON format by the device and sent to the server.

[1337] Data analysis and proposals

[1338] The server performs the following operations based on the received user data:

[1339] 1. Identify the nutrients you need based on your physical ailments and skin concerns.

[1340] 2. Search the database for foods that are high in the identified nutrients.

[1341] 3. Generate appropriate recipes taking into account the user's likes and dislikes and food categories.

[1342] 4. Provide cooking tips to preserve the nutrients in the ingredients in the recipe.

[1343] 5. Select the optimal exercise method based on the user's health condition.

[1344] This information is again serialized in JSON format and sent to the device.

[1345] Suggestions for users

[1346] The device deserializes the information received from the server and displays the following in its user interface:

[1347] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[1348] Details of exercise method and its effects

[1349] Specific examples

[1350] Examples based on user health status

[1351] For example, if a user inputs "I get tired easily," selects "chicken" as their favorite ingredient, and "Japanese food" as their preferred food category, the device will send this information to the server. The server will analyze the information that "I get tired easily" and determine that B vitamins and iron are necessary. It will then identify a Japanese recipe using "chicken," "Teriyaki Chicken and Spinach," and include the cooking key of "cooking quickly" to maintain B vitamins. It will then recommend "light aerobic exercise" and "stretching" to the user. Finally, the device will display the recipe and exercise instructions to the user.

[1352] Prompt Sentence Examples

[1353] Here are some examples of prompts to input to the generative AI model:

[1354] Based on the user's input of "easily tired," "chicken," and "Japanese food," please suggest ingredients that are rich in B vitamins and iron, Japanese food recipes that use these ingredients, and light aerobic exercise.

[1355] In this way, a system is provided that allows users to achieve optimal diet and exercise tailored to their physical condition and preferences, thereby maintaining and improving their health and beauty.

[1356] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1357] Step 1:

[1358] The user uses the device to input information about physical ailments, skin concerns, favorite ingredients, food categories they want to eat, and their current health condition. This input information is serialized in JSON format.

[1359] Input: physical discomfort, skin concerns, favorite ingredients, food categories you want to eat, current health condition

[1360] Output: User information in JSON format

[1361] Step 2:

[1362] The device sends the serialized user information to the server by using an HTTP POST request to send the data to the server's API endpoint.

[1363] Input: User information in JSON format

[1364] Output: Send request

[1365] Step 3:

[1366] The server receives the user information, deserializes it, and begins analyzing it. First, it uses specific rules and databases to identify necessary nutrients based on physical ailments and skin concerns.

[1367] Input: User information in JSON format

[1368] Output: Identified nutrient needs

[1369] Step 4:

[1370] The server searches the database for ingredients based on the identified required nutrients, and generates a list of ingredients that are rich in nutrients.

[1371] Input: Identified nutrient needs

[1372] Output: List of identified ingredients

[1373] Step 5:

[1374] The server takes into account the user's preferred ingredients and desired food category and generates appropriate recipes using a recipe database and filtering logic.

[1375] Input: Identified ingredients, user's food preferences and cuisine category

[1376] Output: The generated appropriate recipe

[1377] Step 6:

[1378] Adds nutrient loss prevention cooking points to server-generated recipes, which include specific cooking methods to keep ingredients nutritious.

[1379] Input: Generated recipe

[1380] Output: Recipe with cooking points added

[1381] Step 7:

[1382] The server selects the optimal exercise method based on the user's health condition. In this process, the server takes into account the user's exercise ability and limitations and proposes an appropriate exercise program.

[1383] Input: User's health status

[1384] Output: Selected exercise method

[1385] Step 8:

[1386] The server serializes the generated recipe and exercise method into JSON format and sends it back to the device using an HTTP POST request.

[1387] Input: Generated recipe, selected exercise method

[1388] Output: Recipe and exercise instructions in JSON format

[1389] Step 9:

[1390] The device deserializes the JSON formatted information received from the server and displays it on the user interface, presenting recipes and exercise methods in a visually easy-to-understand format.

[1391] Input: Received JSON format recipe and exercise instructions

[1392] Output: Recipe and exercise instructions displayed in a user interface

[1393] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1394] This invention combines a system that suggests optimal nutrients, ingredients, cooking methods, and exercise methods for a user's physical condition or skin concerns with an emotion engine that recognizes the user's emotions. The processing of the system's program is explained below in natural language.

[1395] System Overview

[1396] Based on the information entered by the user, the server identifies the necessary nutrients, generates optimal ingredients, recipes, and exercise methods, and provides them to the user via the device. Furthermore, the system recognizes the user's emotional state in real time and optimizes the suggestions based on that information. This allows users to incorporate optimal diet and exercise plans that are tailored to their physical condition, preferences, and emotions, thereby improving their health and beauty.

[1397] Program processing

[1398] Accepting user input and sending data

[1399] The terminal prompts the user for the following information:

[1400] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[1401] Favorite ingredients (e.g. chicken, spinach)

[1402] Category of food you want to eat (e.g. Japanese food, Western food)

[1403] Current health condition (optional, e.g., light exercise is possible, allergies)

[1404] Furthermore, the emotion engine recognizes emotions from the user's facial expressions and voice and sends that data to the system. The device collects the user's input information and emotion data, serializes it into JSON format, and sends it to the server.

[1405] Data analysis and proposals

[1406] The server receives the received user data and begins parsing it. It does the following:

[1407] 1. Identify the nutrients you need based on your physical condition or skin concerns. For example, if you are concerned about fatigue, you might identify B vitamins and iron as the nutrients you need.

[1408] 2. The database is searched for foods that are high in the identified nutrients. For example, "chicken" that is high in "B vitamins" and "spinach" that is high in "iron" are identified.

[1409] 3. Generate an appropriate recipe based on the user's preferences. If the user selects "Japanese food," select the Japanese recipe "Teriyaki Chicken and Spinach," which uses "chicken" and "spinach."

[1410] 4. Include cooking tips in recipes to prevent nutrient loss, such as "cook chicken quickly to preserve B vitamins."

[1411] 5. Select the optimal exercise method based on the user's health condition. For example, if "light exercise is possible," recommend "light aerobic exercise" or "stretching."

[1412] 6. Based on data from the emotion engine, the app adjusts to take into account the user's mood and emotional state. For example, it can suggest relaxing recipes or exercise methods based on tired facial expressions or tone of voice.

[1413] The generated list of recipes and exercise methods is serialized in JSON format and sent to the device.

[1414] Suggestions for users

[1415] The device deserializes the information received from the server and displays the following in the user interface:

[1416] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[1417] Details of the exercise method and its effects.

[1418] Special suggestions based on the user's emotional state (e.g., stretching techniques to relax).

[1419] Specific examples

[1420] Example: Improving fatigue and considering emotions

[1421] 1. The user enters "I get tired easily," selects "chicken" as the favorite food, and selects "Japanese food" as the food category they want to eat.

[1422] 2. The emotion engine recognizes fatigue from the user's facial expressions and voice and transmits it as data.

[1423] 3. The device sends this information to the server.

[1424] 4. Analyze that servers "get tired easily" and therefore need B vitamins and iron.

[1425] 5. The server identifies a Japanese recipe that uses "chicken," "Teriyaki Chicken and Spinach," and includes "cooking quickly" as a cooking tip for preserving B vitamins.

[1426] 6. The server recommends "light aerobic exercise" and "stretching," and further suggests exercise methods with a high relaxation effect based on the emotion engine.

[1427] 7. The device displays recipes and exercise instructions to the user.

[1428] The above is a specific embodiment of the present invention. This system allows users to incorporate optimal diet and exercise according to their physical condition, preferences, and emotions, thereby improving their health and beauty.

[1429] The processing flow will be explained below.

[1430] Step 1:

[1431] The device presents the user with an input form, in which the user inputs information about physical ailments, skin concerns, favorite ingredients, preferred food categories, and current health condition. The device also activates an emotion engine to obtain emotional data from the user's facial expressions and voice.

[1432] Step 2:

[1433] The emotion engine analyzes the user's facial expressions and voice to identify their emotional state in real time. For example, it uses a facial recognition camera and voice recognition system to detect a user's tired expression or tone of voice and record this as emotion data.

[1434] Step 3:

[1435] The device serializes the input data and parsed emotion data into JSON format, which includes:

[1436] Physical discomfort or skin problems (e.g., "tired easily," "rough skin")

[1437] Favorite ingredients (e.g., "chicken," "spinach")

[1438] Category of food you want to eat (e.g., "Japanese food," "Western food")

[1439] Current health condition (e.g., "Light exercise is possible" or "I have allergies")

[1440] Emotional data (e.g., "tired," "stressed")

[1441] Step 4:

[1442] The device sends the serialized data to the server via an HTTP POST request.

[1443] Step 5:

[1444] The server receives the HTTP request, deserializes the data from the request body, and begins parsing it.

[1445] Step 6:

[1446] The server identifies the nutrients needed based on the user's physical condition or skin concerns. For example, if the user is concerned about fatigue, it identifies B vitamins and iron as the necessary nutrients.

[1447] Step 7:

[1448] The server searches the database for foods that are rich in the specified nutrients. The search results include "chicken," which is rich in "B vitamins," and "spinach," which is rich in "iron."

[1449] Step 8:

[1450] The server generates an appropriate recipe based on the user's preferred ingredients and cooking category. For example, if the user selects "Japanese food," the server selects the Japanese recipe "Teriyaki Chicken and Spinach," which uses "chicken" and "spinach."

[1451] Step 9:

[1452] The server adds cooking instructions to the recipe to prevent loss of nutrients, such as "cook the chicken quickly to preserve the B vitamins."

[1453] Step 10:

[1454] The server selects the optimal exercise method based on the user's health condition. For example, if "light exercise is possible," it will recommend "light aerobic exercise" or "stretching."

[1455] Step 11:

[1456] The server adjusts the user's mood and emotional state based on data from the emotion engine. For example, if the user is recognized as "tired," it will suggest relaxing dishes or exercise methods (e.g., "cooking with herbal tea" or "relaxing yoga").

[1457] Step 12:

[1458] The server serializes the generated recipe and exercise method again into JSON format and sends it to the device.

[1459] Step 13:

[1460] The device deserializes the data received from the server, which includes the recipe title, ingredients list, cooking instructions, cooking tips, and exercise instructions.

[1461] Step 14:

[1462] The device displays the deserialized recipes and exercise methods on a user interface, allowing the user to check and practice the optimal diet and exercise methods tailored to their physical and emotional state.

[1463] The above are the specific processing steps of the present invention. This system allows users to effectively incorporate diet and exercise into their diet according to their physical condition, preferences, and emotions.

[1464] Example 2

[1465] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1466] While conventional health management systems can suggest dietary and exercise regimes based on a user's physical condition, skin concerns, and preferences, they have had difficulty making optimal recommendations that take into account the user's emotional state. In particular, they have been unable to provide specific responses or suggestions that reflect the user's emotions, making it difficult to improve the user experience.

[1467] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1468] In this invention, the server includes means for having the user input information about physical ailments, skin concerns, favorite ingredients, desired food categories, and current health condition, means for transmitting the input information and collected emotional data to the server, means for the server to identify necessary nutrients based on the information and emotional data, means for optimizing the recommendations based on the emotional data, means for selecting an appropriate exercise method based on the physical ailments and health condition, and means for transmitting the generated recipes and exercise methods to the terminal. This enables optimal recommendations that take into account not only the user's physical condition and preferences, but also their emotional state.

[1469] "User" refers to an individual who uses the system to input their health status, preferences, and emotional state.

[1470] A "terminal" is an electronic device that a user uses to input information and receive suggestions from the system.

[1471] The "server" is a computer system that receives and analyzes information sent by users, generates the necessary nutrients, ingredients, recipes, and exercise methods, and sends them to the terminal.

[1472] The "emotion engine" is a system that recognizes emotions from a user's facial expressions and voice in real time and generates that data.

[1473] "Nutrients" refer to ingredients such as vitamins and minerals that are necessary to improve the user's physical condition and skin problems.

[1474] "Ingredients" refers to specific ingredients of foods that are rich in nutrients.

[1475] A "recipe" refers to a cooking method that uses specific ingredients and includes cooking tips to prevent loss of nutrients.

[1476] "Exercise method" refers to physical activities recommended based on the user's physical condition and health status.

[1477] "Emotional Data" refers to information about a user's emotional state generated by an emotion engine.

[1478] "Deserialization" refers to the process of returning serialized data sent from the server to its original data format.

[1479] "Optimizing suggested content" refers to optimizing suggested recipes and exercise methods to suit the user's emotional state based on the user's emotional data.

[1480] The present invention combines a system that suggests optimal nutrients, ingredients, cooking methods, and exercise methods for a user's physical condition or skin concerns with an emotion engine that recognizes the user's emotions. The processing of the system program is described in detail below.

[1481] System Overview

[1482] Based on the information entered by the user, the server identifies the necessary nutrients, generates optimal ingredients, recipes, and exercise methods, and provides them to the user via the device. Furthermore, the system recognizes the user's emotional state in real time and optimizes the suggestions based on that information. This allows users to incorporate optimal diet and exercise plans that are tailored to their physical condition, preferences, and emotions, thereby improving their health and beauty.

[1483] Program processing

[1484] Accepting user input and sending data

[1485] The terminal prompts the user for the following information:

[1486] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[1487] Favorite ingredients (e.g. chicken, spinach)

[1488] Category of food you want to eat (e.g. Japanese food, Western food)

[1489] Current health condition (optional, e.g., light exercise is possible, allergies)

[1490] Furthermore, the emotion engine recognizes emotions from the user's facial expressions and voice and sends that data to the system. The device collects the user's input information and emotion data, serializes it into JSON format, and sends it to the server.

[1491] Data analysis and proposals

[1492] The server receives the received user data and begins parsing it. It does the following:

[1493] 1. Identify the nutrients you need based on your physical condition or skin concerns. For example, if you are concerned about fatigue, you might identify B vitamins and iron as the nutrients you need.

[1494] 2. The database is searched for foods that are high in the identified nutrients. For example, "chicken" that is high in "B vitamins" and "spinach" that is high in "iron" are identified.

[1495] 3. Generate an appropriate recipe based on the user's preferences. If the user selects "Japanese food," select the Japanese recipe "Teriyaki Chicken and Spinach," which uses "chicken" and "spinach."

[1496] 4. Include cooking tips in recipes to prevent nutrient loss, such as "cook chicken quickly to preserve B vitamins."

[1497] 5. Select the optimal exercise method based on the user's health condition. For example, if "light exercise is possible," recommend "light aerobic exercise" or "stretching."

[1498] 6. Based on data from the emotion engine, the app adjusts to take into account the user's mood and emotional state. For example, it can suggest relaxing recipes or exercise methods based on tired facial expressions or tone of voice.

[1499] The generated list of recipes and exercise methods is serialized in JSON format and sent to the device.

[1500] Suggestions for users

[1501] The device deserializes the information received from the server and displays the following in the user interface:

[1502] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[1503] Details of the exercise method and its effects.

[1504] Special suggestions based on the user's emotional state (e.g., stretching techniques to relax).

[1505] Specific examples

[1506] Example: Improving fatigue and considering emotions

[1507] 1. The user enters "I get tired easily," selects "chicken" as the favorite food, and selects "Japanese food" as the food category they want to eat.

[1508] 2. The emotion engine recognizes fatigue from the user's facial expressions and voice and generates it as data.

[1509] 3. The device serializes the user input information and emotion data into JSON format and sends it to the server.

[1510] 4. Analyze that servers "get tired easily" and therefore need B vitamins and iron.

[1511] 5. The server searches the database and identifies "chicken," which is rich in "B vitamins," and "spinach," which is rich in "iron."

[1512] 6. Since the user has selected "Japanese food," select the Japanese recipe "Teriyaki Chicken and Spinach."

[1513] 7. Add "cook quickly" to recipes as a cooking tip to preserve B vitamins.

[1514] 8. Consider the user's health condition and recommend "light aerobic exercise" and "stretching."

[1515] 9. Suggest exercise methods with a high relaxation effect based on emotional data.

[1516] 10. The server sends the generated proposal to the terminal, which displays it on the user interface.

[1517] Example prompts for generative AI models

[1518] Here are some examples of prompts for generative AI models:

[1519] User input: I get tired easily

[1520] Favorite food: Chicken

[1521] Food category: Japanese food

[1522] Health condition: Light exercise possible

[1523] Emotion engine data: Detecting fatigue from the user's facial expressions and voice

[1524] Based on this information, we suggest recipes and exercise regimes that contain optimal nutrients.

[1525] The above is an embodiment of the present invention.

[1526] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1527] Step 1: Enter your information

[1528] The user inputs information about their physical ailments, skin concerns, favorite ingredients, desired food categories, and current health condition through the device. The emotion engine analyzes the user's facial expressions and voice in real time to generate emotion data. This input information and emotion data become the raw data required for system processing.

[1529] Input: User's physical condition, favorite ingredients, emotional data

[1530] Data processing: The emotion engine analyzes the user's facial expressions and voice to generate emotion data.

[1531] Output: User input and emotion data

[1532] Step 2: Submit your information

[1533] The device serializes user input information and emotion data in JSON format and sends it to the server, allowing the server to accurately grasp the user's overall state.

[1534] Input: User input and emotion data

[1535] Data processing: Serializing information into JSON format

[1536] Output: JSON format data is sent to the server

[1537] Step 3: Analyze the data

[1538] The server analyzes the information received from the user and identifies the nutrients they need. This analysis uses algorithms and database searches. For example, if someone says they get tired easily, B vitamins and iron will be identified as necessary nutrients.

[1539] Input: User input and emotion data

[1540] Data processing: Algorithmic analysis, database search

[1541] Output: List of nutrients needed

[1542] Step 4: Find ingredients

[1543] The server searches the database to find foods that are high in the specified nutrients, such as chicken, which is rich in B vitamins, or spinach, which is rich in iron.

[1544] Input: List of nutrients needed

[1545] Data processing: Database search

[1546] Output: A list of ingredients

[1547] Step 5: Generate the recipe

[1548] The server generates an appropriate recipe based on the user's preferences and health condition. For example, if the user selects "Japanese food," it generates a recipe such as "Teriyaki chicken and spinach." This recipe also includes cooking tips to prevent the loss of nutrients.

[1549] Input: Ingredient list, user preferences, health status

[1550] Data processing: Creating recipes and adding cooking points

[1551] Output: The generated recipe

[1552] Step 6: Choose an exercise method

[1553] The server considers the user's health condition and selects an appropriate exercise method, such as recommending "light aerobic exercise" or "stretching."

[1554] Input: User's health status

[1555] Data processing: Selection of exercise method

[1556] Output: Recommended exercise method

[1557] Step 7: Optimize recommendations based on sentiment data

[1558] The server optimizes the suggestions based on the emotional data from the emotion engine. For example, if the user expresses fatigue, the server will adjust the suggestions to include recipes or exercise methods that are more relaxing.

[1559] Input: Emotion data, generated recipes and exercise methods

[1560] Data processing: Optimizing proposal content based on emotional data

[1561] Output: Optimized proposals

[1562] Step 8: Submit and view your proposal

[1563] The server serializes the optimized recipe and exercise method in JSON format and sends it to the device, which receives it and displays it in the user interface. The user can then confirm the suggestions and put them into practice.

[1564] Input: Optimized suggestions

[1565] Data processing: Serialize to JSON format

[1566] Output: Display the suggestion to the user

[1567] In this way, the system suggests optimal diet and exercise based on the user's physical condition, preferences, and emotional state.

[1568] (Application example 2)

[1569] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1570] Conventional food delivery systems and health management systems generally make suggestions based on basic information such as the user's physical condition, skin concerns, preferences, and health status. However, these systems do not take the user's emotional state into consideration, which means they are unable to make optimal suggestions when the user is emotionally tired or stressed. This has led to the issue of not being able to maximize the user's health and satisfaction.

[1571] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for having the user input information about physical ailments, skin concerns, favorite ingredients, categories of food they want to eat, and their current health condition, means for transmitting the input information to the server, means for recognizing emotions from the user's facial expressions and voice using the camera and microphone and collecting emotional data, and means for identifying necessary nutrients based on the information and emotional data. This makes it possible to suggest optimal meals and exercises that take the user's emotional state into consideration.

[1572] "User" refers to an individual user of the system.

[1573] "Physical ailments" refers to physical health problems experienced by the user, such as fatigue, pain, or weakness.

[1574] "Skin concerns" refer to issues related to the health and appearance of the user's skin, such as rough skin, dryness, acne, etc.

[1575] "Favorite ingredients" refer to foods that a user particularly likes and prefers to eat.

[1576] The "category of food you want to eat" refers to the type or genre of food that the user wants to eat.

[1577] "Current health condition" refers to the user's perceived physical condition and health status, such as allergies and the degree to which they are able to exercise.

[1578] "Camera" refers to a device for taking images and videos and acquiring data.

[1579] "Microphone" refers to a device for collecting sound and acquiring data.

[1580] "Emotion" refers to the state of mind that a user feels at a particular moment or in a particular situation, such as joy, sadness, anger, surprise, etc.

[1581] "Emotional data" refers to data that indicates the user's emotional state based on the user's facial expressions and voice information collected from a camera or microphone.

[1582] "Server" refers to a computer system that receives input information and emotional data from a user, analyzes, processes, and generates suggestions.

[1583] "Nutrients" refers to chemical components such as vitamins, minerals, and proteins that are necessary for the user to maintain their health.

[1584] "Ingredients" refer to the individual foods or ingredients used to make a meal.

[1585] A "recipe" refers to information about the steps and ingredients for making a particular dish.

[1586] An "exercise regimen" refers to a specific set of physical activities that a user undertakes to improve their health and fitness.

[1587] "Terminal" refers to a computing device, such as a smartphone or tablet, that a user uses to enter information or view suggestions.

[1588] This invention integrates an emotion engine into a system that suggests the nutrients, ingredients, cooking methods, and exercise methods needed to address a user's physical condition or skin concerns. Specifically, the system recognizes the user's emotional state in real time and makes optimal suggestions based on this. The program processing of this system is explained below in natural language.

[1589] User input acceptance and emotion recognition

[1590] Using a smartphone, users input their physical ailments, skin concerns, favorite ingredients, food categories they want to eat, and their current health condition. Using the smartphone's camera and microphone, the emotion engine recognizes the user's emotions from their facial expressions and voice.

[1591] Data transmission

[1592] The device serializes the user's input information and emotion data into JSON format and sends it to the cloud server. The transmitted data includes the following important information:

[1593] Physical discomfort and skin problems

[1594] Favorite ingredients

[1595] Food category you want to eat

[1596] Current health status

[1597] Recognized emotion data

[1598] Data analysis and proposals

[1599] The cloud server analyzes the received user data and generates proposals through the following process:

[1600] 1. Identify the nutrients needed based on your physical condition. For example, if you suffer from fatigue, B vitamins and iron may be identified.

[1601] 2. Search the database for foods that are high in the specified nutrients. For example, you can find chicken, which is rich in B vitamins, or spinach, which is rich in iron.

[1602] 3. Generate appropriate recipes based on the user's preferred ingredients and cooking category. If the Japanese food category is selected, "Teriyaki Chicken and Spinach" will be suggested.

[1603] 4. Recipes should also include specific cooking tips to prevent nutrient loss, such as cooking chicken quickly to preserve B vitamins.

[1604] 5. Choose the best exercise method based on your current health condition. If light exercise is possible, light aerobic exercise and stretching are recommended.

[1605] 6. Based on data from the emotion engine, the app adjusts to the user's mood and emotional state. For example, a tired facial expression or tone of voice can suggest relaxing recipes or exercise methods.

[1606] The proposal content generated by the above process is serialized in JSON format and sent to the device, which then deserializes it and displays it in the user interface.

[1607] Suggestions for users

[1608] The device displays the following in the user interface based on the information received from the server:

[1609] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[1610] Details of exercise method and its effects

[1611] Special suggestions based on the user's emotional state (e.g., stretching techniques to relax)

[1612] Specific examples

[1613] For example, if a user enters "I get tired easily," specifies "chicken" as their favorite ingredient, and "Japanese food" as their preferred food category:

[1614] 1. The emotion engine recognizes fatigue from the user's facial expressions and voice and transmits this as data.

[1615] 2. The device sends this information to the cloud server.

[1616] 3. The cloud server analyzes that "B vitamins and iron are necessary" and identifies "teriyaki chicken and spinach."

[1617] 4. Cooking tips to preserve B vitamins include "cooking for a short time."

[1618] 5. Light aerobic exercise and stretching are recommended, and exercise methods with a more relaxing effect are also suggested.

[1619] 6. The device displays recipes and exercise instructions to the user.

[1620] Prompt Sentence Examples

[1621] "Please enter the current physical discomfort you are experiencing."

[1622] "Choose your favorite ingredients."

[1623] Please select the category of food you would like to eat.

[1624] Please enter your current health status.

[1625] "Your emotional state can be reflected in relaxing cooking and exercise methods."

[1626] This allows users to incorporate optimal diet and exercise into their daily lives, tailored to their individual health conditions and emotions, thereby improving their health and beauty.

[1627] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1628] Step 1:

[1629] Users use their smartphone to input information about their physical ailments, skin concerns, favorite ingredients, food categories they want to eat, and their current health condition. This input information is serialized in JSON format on the device.

[1630] Step 2:

[1631] The device uses a camera and microphone to send the user's facial expressions and voice to the emotion engine in real time to recognize the user's emotional state. The emotion engine acquires the user's emotional data and serializes it in JSON format.

[1632] Step 3:

[1633] The device sends the user's input information and recognized emotion data to a cloud server. The sent data includes information on physical ailments and skin concerns, favorite ingredients, preferred food categories, current health status, and emotional state.

[1634] Step 4:

[1635] The cloud server analyzes the received data and performs the following data calculations:

[1636] Identify the nutrients you need based on your physical condition or skin concerns (for example, if you get tired easily, you should take B vitamins and iron).

[1637] Search the database for ingredients that are rich in necessary nutrients (for example, chicken, which is rich in B vitamins).

[1638] Generate suitable recipes based on your preferred ingredients and cooking categories.

[1639] Select the optimal exercise method based on your current health status and emotional data.

[1640] Step 5:

[1641] The server generates recipes and exercise data, serializes them into JSON format, and sends them to the device. The recipes also include cooking tips to prevent nutrient loss.

[1642] Step 6:

[1643] The device deserializes the information sent by the server and displays it in its user interface, specifically the following information:

[1644] Ingredient list for each recipe, cooking instructions, and cooking tips to prevent loss of nutrients

[1645] Details of the proposed exercise method and its effects

[1646] Special suggestions based on your emotional state (e.g., stretching techniques to relax)

[1647] Step 7:

[1648] The user can review the suggestions displayed on their device, select and execute them, and if necessary, generate new suggestions using additional prompts using the generative AI model.

[1649] Through these steps, users can receive diet and exercise recommendations optimized for their health and emotional state.

[1650] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1651] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1652] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1653] [Fourth embodiment]

[1654] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1655] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1656] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1657] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1658] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1659] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1660] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1661] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1662] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1663] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1664] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1665] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1666] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1667] This invention is a system that suggests optimal nutrients, ingredients, cooking methods, and exercise methods in response to a user's physical discomfort or skin concerns. The processing of the system program will be explained below in natural language.

[1668] System Overview

[1669] Based on the information entered by the user, the server identifies the necessary nutrients, generates optimal ingredients, recipes, and exercise methods, and provides them to the user via their device. This allows users to incorporate optimal diet and exercise that suits their physical condition and preferences, thereby improving their health and beauty.

[1670] Program processing

[1671] Accepting user input and sending data

[1672] The terminal prompts the user for the following information:

[1673] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[1674] Favorite ingredients (e.g. chicken, spinach)

[1675] Category of food you want to eat (e.g. Japanese food, Western food)

[1676] Current health condition (optional, e.g., light exercise is possible, allergies)

[1677] The terminal collects this input information, serializes it into JSON format, and sends it to the server.

[1678] Data analysis and proposals

[1679] The server receives the received user data and performs the following steps:

[1680] 1. Identify the nutrients you need based on your physical ailments and skin concerns.

[1681] Example: "Getting tired easily" → "B vitamins" and "iron"

[1682] 2. Search the database for foods that are high in the identified nutrients.

[1683] Example: "Iron" → "Spinach"

[1684] 3. Generate appropriate recipes taking into account the user's likes and dislikes and food categories.

[1685] Example: A recipe in the "Japanese food" category that uses "chicken" and "spinach" is "Chicken and spinach teriyaki."

[1686] 4. Provide cooking tips to preserve the nutrients in the ingredients in the recipe.

[1687] Example: "Cook it quickly to preserve the B vitamins."

[1688] 5. Select the optimal exercise method based on the user's health condition.

[1689] For example, if "Light exercise is possible," then "Light aerobic exercise" or "Stretching" would be appropriate.

[1690] The generated list of recipes and exercise methods is serialized in JSON format and sent to the device.

[1691] Suggestions for users

[1692] The device deserializes the information received from the server and displays the following in the user interface:

[1693] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[1694] Details of exercise method and its effects

[1695] This allows users to achieve optimal diet and exercise habits that suit their physical condition, thereby maintaining and improving their health and beauty.

[1696] Specific examples

[1697] Example: Improvement of fatigue

[1698] 1. The user enters "I get tired easily," selects "chicken" as the favorite food, and selects "Japanese food" as the food category they want to eat.

[1699] 2. The device sends this information to the server.

[1700] 3. Analyze that servers "get tired easily" and therefore need B vitamins and iron.

[1701] 4. The server identifies a Japanese recipe that uses "chicken," "Teriyaki Chicken and Spinach," and includes "cooking quickly" as a cooking tip for preserving B vitamins.

[1702] 5. The server recommends "light aerobic exercise" and "stretching."

[1703] 6. The device displays recipes and exercise instructions to the user.

[1704] The above is a specific embodiment of the present invention. This system allows users to incorporate optimal diet and exercise into their physical condition and preferences, thereby improving their health and beauty.

[1705] The processing flow will be explained below.

[1706] Step 1:

[1707] The device presents the user with an input form, in which the user enters information about physical ailments, skin concerns, favorite ingredients, preferred food categories, and current health condition.

[1708] Step 2:

[1709] The terminal serializes the input data into JSON format. Examples of user input data include:

[1710] Physical discomfort or skin problems (e.g., "tired easily," "rough skin")

[1711] Favorite ingredients (e.g., "chicken," "spinach")

[1712] Category of food you want to eat (e.g., "Japanese food," "Western food")

[1713] Current health status (e.g., "I can do light exercise" or "I have certain allergies")

[1714] Step 3:

[1715] The device sends the serialized data to the server via an HTTP POST request.

[1716] Step 4:

[1717] The server receives the HTTP request, deserializes the data from the request body, and begins parsing it.

[1718] Step 5:

[1719] The server identifies the nutrients needed based on the user's physical condition or skin concerns. For example, if the user is concerned about fatigue, it identifies B vitamins and iron as the necessary nutrients.

[1720] Step 6:

[1721] The server searches the database for foods that are rich in the specified nutrients. The search results include "chicken," which is rich in "B vitamins," and "spinach," which is rich in "iron."

[1722] Step 7:

[1723] The server generates an appropriate recipe based on the user's preferences. If the user selects "Japanese food," the server selects the Japanese recipe "Teriyaki Chicken and Spinach," which uses "chicken" and "spinach."

[1724] Step 8:

[1725] The server adds cooking tips to the recipe to prevent nutrient loss, such as "cook the chicken quickly to preserve B vitamins."

[1726] Step 9:

[1727] The server selects the optimal exercise method based on the user's health condition. For example, if "light exercise is possible," it will recommend "light aerobic exercise" or "stretching."

[1728] Step 10:

[1729] The server serializes the generated recipe and exercise method again into JSON format and sends it to the device.

[1730] Step 11:

[1731] The device deserializes the data received from the server, which includes the recipe title, ingredients list, cooking instructions, cooking tips, and exercise instructions.

[1732] Step 12:

[1733] The device displays the deserialized recipes and exercise methods on the user interface, allowing the user to check and practice the optimal diet and exercise methods for their physical condition.

[1734] The above are the specific processing steps of the present invention. This system allows users to effectively incorporate diet and exercise into their diet according to their physical condition and preferences.

[1735] Example 1

[1736] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1737] Conventional health management systems have difficulty proposing optimal ingredients, recipes, and exercise methods that suit the user's individual physical condition and preferences, resulting in the inability to obtain maximum benefits. In particular, there is a lack of recipes that include specific cooking tips to ensure that nutrients are not lost, and suggestions for exercise methods that take into account the exercise intensity according to the user's health condition, and these points need to be improved.

[1738] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1739] In this invention, the server includes means for allowing a user to input information about physical ailments, skin concerns, favorite ingredients, desired food categories, and current health condition, means for transmitting the input information to the server, means for the server to identify necessary nutrients based on the information, means for identifying ingredients rich in the nutrients, means for generating appropriate recipes based on the favorite ingredients and food categories, means for including specific cooking tips to prevent nutrient loss in recipes generated using the generative AI model, means for selecting an appropriate exercise method based on the physical ailment and health condition, means for transmitting the generated recipe and exercise method to a terminal, and means for the terminal to display the recipe and exercise method to the user. This allows users to incorporate optimal diet and exercise tailored to their physical condition and preferences, thereby improving their health and beauty.

[1740] "User" refers to an individual who uses the system to obtain optimal diet and exercise methods based on their physical ailments, skin concerns, preferred ingredients, preferred food categories, and current health status.

[1741] "Terminal" refers to a device that allows a user to input information, transmits the information to a server, and displays the recipes and exercise methods provided by the server so that the user can view them.

[1742] "Server" refers to a computer system that receives user data sent from a terminal, identifies necessary nutrients, ingredients, recipes, and exercise methods, and sends them to the terminal.

[1743] "Physical discomfort and skin problems" refers to the user's physical discomfort or skin problems, and appropriate nutrients and exercise methods are identified based on this information.

[1744] "Favorite ingredients" are ingredients that the user particularly likes to eat, and specific recipes are created based on this information.

[1745] The "category of food you want to eat" refers to the genre of food that the user likes, and includes Japanese food, Western food, Chinese food, and the like.

[1746] "Current health condition" refers to the user's physical condition and limitations, and includes information such as whether light exercise is possible or whether the user has any allergies.

[1747] "Nutrients" refers to components such as vitamins, minerals, and proteins that are necessary for improving and maintaining the user's physical condition.

[1748] "Generative AI models" refer to algorithms or programs that use artificial intelligence to generate optimal recipes or exercise methods based on information collected from users.

[1749] "Means to include specific cooking points in recipes to prevent nutrient loss" refers to a method in which the generated recipes provide specific cooking methods and precautions to maximize the nutritional value of ingredients.

[1750] "Exercise method" refers to the type and method of exercise recommended based on the user's health condition and physical condition, and includes light aerobic exercise, stretching, etc.

[1751] "Deserialization" refers to the operation of restoring serialized data (for example, JSON format) and returning it to a format that a program can process.

[1752] "Serialization" refers to the operation of converting data handled internally by a program into a standardized format (such as JSON) for communication and storage.

[1753] The present invention is a system that proposes optimal nutrients, ingredients, cooking methods, and exercise methods in response to a user's physical condition or skin concerns. Specific embodiments of this system will be described below.

[1754] Based on the information entered by the user, the server identifies the necessary nutrients and generates optimal ingredients, recipes, and exercise methods, which are then provided to the user via their device. This allows users to incorporate optimal diet and exercise methods tailored to their physical condition and preferences, thereby improving their health and beauty.

[1755] Hardware and Software Configuration

[1756] Terminal

[1757] A terminal is a device through which a user inputs information, and can be a smartphone, tablet, or PC. The terminal has a user interface and is capable of receiving input from the user and sending it to a server. Data serialization and deserialization is performed using a programming language such as Python or JavaScript.

[1758] server

[1759] The server is a central system that receives and analyzes data sent by users and identifies appropriate nutrients, ingredients, recipes, and exercise methods. The server references a database to obtain the necessary information and uses a generative AI model to make optimal recommendations. For example, Python frameworks such as Django and Flask are used to build server-side programs.

[1760] Specific processing flow

[1761] 1. Accepting user input

[1762] The user enters the following information into the device's input screen:

[1763] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[1764] Favorite ingredients (e.g. chicken, spinach)

[1765] Category of food you want to eat (e.g. Japanese food, Western food)

[1766] Current health condition (optional, e.g., light exercise is possible, allergies)

[1767] 2. Sending and serializing data

[1768] The device serializes the entered information into JSON format and sends it to the server via an HTTP POST request. Example:

[1769] json

[1770] {

[1771] "health_issues": "tire easily",

[1772] "favorite_foods": ["chicken", "spinach"],

[1773] "cuisine_type": "Japanese food",

[1774] "current_health_status": "Light exercise possible"

[1775] }

[1776] 3. Data analysis and proposals

[1777] The server deserializes the received data and performs the following:

[1778] Identify the nutrients needed based on the user's physical condition or skin concerns. Example: "Easily tired" → "B vitamins," "iron"

[1779] Search the database for foods that are high in a specific nutrient. Example: "B vitamins" → "chicken"

[1780] Generates appropriate recipes based on the user's favorite ingredients and cooking category. Uses a generative AI model. Example: "Teriyaki Chicken and Spinach" in the "Japanese Food" category.

[1781] Provide specific cooking tips to preserve the nutrients in the ingredients in the recipe. Example: "Cook the ingredients for a short time to preserve the B vitamins."

[1782] Select appropriate exercise methods based on the user's health condition. Example: "Light aerobic exercise" or "Stretching"

[1783] 4. Submitting and Viewing Proposals

[1784] The server serializes the generated recipe and exercise list into JSON format and sends it to the device. The device deserializes the received data and displays the suggestions to the user.

[1785] Examples of concrete examples and prompts

[1786] Specific examples

[1787] 1. The user enters "I get tired easily," selects "chicken" as the favorite food, and selects "Japanese food" as the food category they want to eat.

[1788] 2. The device sends this information to the server.

[1789] 3. Analyze that servers "get tired easily" and therefore need B vitamins and iron.

[1790] 4. When the server generates a Japanese recipe for "Teriyaki Chicken and Spinach" using "chicken," it includes the cooking tip of "cook quickly" to preserve B vitamins.

[1791] 5. The server recommends "light aerobic exercise" and "stretching."

[1792] 6. The device displays recipes and exercise instructions to the user.

[1793] Prompt Sentence Examples

[1794] I want to improve my physical condition as I get tired easily. My favorite food is chicken, and I would like to eat Japanese food. Please tell me some recipes and exercise methods.

[1795] The above is an embodiment of the invention, which allows users to incorporate optimal diet and exercise habits that suit their physical condition and preferences, thereby improving their health and beauty.

[1796] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1797] Step 1:

[1798] The user enters the following information into the device's input screen:

[1799] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[1800] Favorite ingredients (e.g. chicken, spinach)

[1801] Category of food you want to eat (e.g. Japanese food, Western food)

[1802] Current health condition (optional, e.g., light exercise is possible, allergies)

[1803] Input: Information such as the user's physical condition and preferences

[1804] Output: Data entered into the terminal form

[1805] Step 2:

[1806] The device receives the input and serializes it into JSON format, for example:

[1807] json

[1808] {

[1809] "health_issues": "tire easily",

[1810] "favorite_foods": ["chicken", "spinach"],

[1811] "cuisine_type": "Japanese food",

[1812] "current_health_status": "Light exercise possible"

[1813] }

[1814] Input: User information entered into the terminal

[1815] Output: JSON format data

[1816] Step 3:

[1817] The device sends the serialized data to the server via an HTTP POST request, which transfers the data from the device to the server.

[1818] Input: User information in JSON format

[1819] Output: HTTP request sent to the server

[1820] Step 4:

[1821] The server deserializes the JSON data it receives and converts it into an internal representation, allowing programs to manipulate the data directly.

[1822] Input: JSON data sent to the server

[1823] Output: Deserialized user information

[1824] Step 5:

[1825] The server uses the deserialized data to analyze the user's physical condition and skin concerns and identify the nutrients they need. For example, "easily fatigued" can lead to "B vitamins" and "iron."

[1826] Input: Deserialized user information

[1827] Output: List of required nutrients

[1828] Step 6:

[1829] The server checks the necessary nutrients against a database and searches for foods that contain a lot of them. For example, "B vitamins" → "chicken."

[1830] Input: List of nutrients needed

[1831] Output: A list of identified ingredients

[1832] Step 7:

[1833] The server considers the user's preferred ingredients and food category and uses a generative AI model to generate an appropriate recipe. For example, a recipe using "chicken" in the "Japanese food" category, "Teriyaki Chicken and Spinach."

[1834] Input: A list of identified ingredients, and the user's ingredient and cooking category preferences

[1835] Output: The generated recipe

[1836] Step 8:

[1837] The server adds specific cooking tips to generated recipes to prevent nutrient loss, such as "cook quickly to preserve B vitamins."

[1838] Input: Generated recipe

[1839] Output: Recipe with cooking points

[1840] Step 9:

[1841] The server selects an appropriate exercise method based on the user's current health condition. For example, if "light exercise is possible," the server selects "light aerobic exercise" or "stretching."

[1842] Input: User's current health status

[1843] Output: Recommended exercise method

[1844] Step 10:

[1845] The server serializes the generated recipe and list of exercise methods into JSON format again and sends it to the device.

[1846] Input: Recipe with cooking instructions and exercise instructions

[1847] Output: Send to the terminal as JSON format data

[1848] Step 11:

[1849] The device deserializes the received JSON data and displays it in the user interface, specifically the following:

[1850] Recipe name, ingredients list, cooking instructions, cooking tips for preserving nutrients

[1851] Details of exercise method and its effects

[1852] Input: JSON data received from the server

[1853] Output: Recipe and exercise instructions displayed in the user interface

[1854] The above is the specific processing flow of the program for this system. This system allows users to incorporate optimal diet and exercise tailored to their physical condition and preferences, thereby improving their health and beauty.

[1855] (Application example 1)

[1856] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1857] Conventional health management systems require users to manually research the appropriate nutrients and exercise methods based on their physical condition and dietary preferences, which requires a significant burden of time and effort. Furthermore, the health foods and advice provided in physical stores often do not adequately address the user's individual health condition. This makes it difficult for users to easily and accurately manage their health in physical stores.

[1858] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1859] In this invention, the server includes means for allowing a user to input information about physical ailments, skin concerns, favorite ingredients, desired food categories, and current health status, means for transmitting the input information to the server, means for identifying necessary nutrients based on the information, means for identifying ingredients rich in the nutrients, means for generating appropriate recipes based on the favorite ingredients and food categories, means for selecting appropriate exercise methods based on the physical ailments and health status, means for transmitting the generated recipes and exercise methods to a terminal, means for the terminal to display the recipes and exercise methods to the user, means for suggesting ingredients and recipes containing necessary nutrients based on the information input by the user in the physical store, and means for navigating the user to maintain health based on the recipes and exercise methods provided in the physical store. This allows users to easily obtain appropriate nutrient intake methods and exercise methods tailored to their individual health status even in the physical store.

[1860] "User" refers to a person who uses the system to input information about physical ailments, skin concerns, food preferences, etc., and receives advice on health management.

[1861] "Physical discomfort and skin problems" refers to health problems such as fatigue and rough skin experienced by users.

[1862] "Favorite ingredients" refers to ingredients that the user particularly likes to consume.

[1863] The "category of food you want to eat" refers to the type of food (Japanese food, Western food, etc.) that the user particularly wants to eat.

[1864] "Current health condition" refers to the user's current physical condition, athletic ability, whether or not they have any allergies, etc.

[1865] "Server" refers to a computer system that receives and processes user input information.

[1866] "Essential nutrients" refer to specific nutritional components necessary to improve the user's physical condition or skin problems.

[1867] An "appropriate recipe" refers to a cooking method for a dish that is rich in necessary nutrients and is generated based on the user's preferences and health condition.

[1868] The "exercise method" refers to an exercise program for improving physical condition or maintaining health, selected according to the user's health condition.

[1869] "Terminal" refers to a device (such as a smartphone or tablet) that displays information entered by the user and communicates with the server.

[1870] "Brick and mortar" refers to a physical retail location or fitness facility where users can visit and receive health foods and advice.

[1871] "Navigation" refers to a guide function that helps users easily understand the information and action plans necessary for health management.

[1872] This invention is a system that suggests optimal nutrients, ingredients, cooking methods, and exercise methods according to a user's physical ailments, skin concerns, and dietary preferences.

[1873] System configuration

[1874] The system consists of a terminal that accepts information input from users, a server that processes the information, and a terminal that displays the results. The terminals can be smartphones or tablet terminals in physical stores.

[1875] Program processing

[1876] Accepting user input and sending data

[1877] Users input information such as physical ailments, skin concerns, favorite ingredients, preferred food categories, current health status, etc. This input information is serialized in JSON format by the device and sent to the server.

[1878] Data analysis and proposals

[1879] The server performs the following operations based on the received user data:

[1880] 1. Identify the nutrients you need based on your physical ailments and skin concerns.

[1881] 2. Search the database for foods that are high in the identified nutrients.

[1882] 3. Generate appropriate recipes taking into account the user's likes and dislikes and food categories.

[1883] 4. Provide cooking tips to preserve the nutrients in the ingredients in the recipe.

[1884] 5. Select the optimal exercise method based on the user's health condition.

[1885] This information is again serialized in JSON format and sent to the device.

[1886] Suggestions for users

[1887] The device deserializes the information received from the server and displays the following in its user interface:

[1888] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[1889] Details of exercise method and its effects

[1890] Specific examples

[1891] Examples based on user health status

[1892] For example, if a user inputs "I get tired easily," selects "chicken" as their favorite ingredient, and "Japanese food" as their preferred food category, the device will send this information to the server. The server will analyze the information that "I get tired easily" and determine that B vitamins and iron are necessary. It will then identify a Japanese recipe using "chicken," "Teriyaki Chicken and Spinach," and include the cooking key of "cooking quickly" to maintain B vitamins. It will then recommend "light aerobic exercise" and "stretching" to the user. Finally, the device will display the recipe and exercise instructions to the user.

[1893] Prompt Sentence Examples

[1894] Here are some examples of prompts to input to the generative AI model:

[1895] Based on the user's input of "easily tired," "chicken," and "Japanese food," please suggest ingredients that are rich in B vitamins and iron, Japanese food recipes that use these ingredients, and light aerobic exercise.

[1896] In this way, a system is provided that allows users to achieve optimal diet and exercise tailored to their physical condition and preferences, thereby maintaining and improving their health and beauty.

[1897] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1898] Step 1:

[1899] The user uses the device to input information about physical ailments, skin concerns, favorite ingredients, food categories they want to eat, and their current health condition. This input information is serialized in JSON format.

[1900] Input: physical discomfort, skin concerns, favorite ingredients, food categories you want to eat, current health condition

[1901] Output: User information in JSON format

[1902] Step 2:

[1903] The device sends the serialized user information to the server by using an HTTP POST request to send the data to the server's API endpoint.

[1904] Input: User information in JSON format

[1905] Output: Send request

[1906] Step 3:

[1907] The server receives the user information, deserializes it, and begins analyzing it. First, it uses specific rules and databases to identify necessary nutrients based on physical ailments and skin concerns.

[1908] Input: User information in JSON format

[1909] Output: Identified nutrient needs

[1910] Step 4:

[1911] The server searches the database for ingredients based on the identified required nutrients, and generates a list of ingredients that are rich in nutrients.

[1912] Input: Identified nutrient needs

[1913] Output: List of identified ingredients

[1914] Step 5:

[1915] The server takes into account the user's preferred ingredients and desired food category and generates appropriate recipes using a recipe database and filtering logic.

[1916] Input: Identified ingredients, user's food preferences and cuisine category

[1917] Output: The generated appropriate recipe

[1918] Step 6:

[1919] Adds nutrient loss prevention cooking points to server-generated recipes, which include specific cooking methods to keep ingredients nutritious.

[1920] Input: Generated recipe

[1921] Output: Recipe with cooking points added

[1922] Step 7:

[1923] The server selects the optimal exercise method based on the user's health condition. In this process, the server takes into account the user's exercise ability and limitations and proposes an appropriate exercise program.

[1924] Input: User's health status

[1925] Output: Selected exercise method

[1926] Step 8:

[1927] The server serializes the generated recipe and exercise method into JSON format and sends it back to the device using an HTTP POST request.

[1928] Input: Generated recipe, selected exercise method

[1929] Output: Recipe and exercise instructions in JSON format

[1930] Step 9:

[1931] The device deserializes the JSON formatted information received from the server and displays it on the user interface, presenting recipes and exercise methods in a visually easy-to-understand format.

[1932] Input: Received JSON format recipe and exercise instructions

[1933] Output: Recipe and exercise instructions displayed in a user interface

[1934] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1935] This invention combines a system that suggests optimal nutrients, ingredients, cooking methods, and exercise methods for a user's physical condition or skin concerns with an emotion engine that recognizes the user's emotions. The processing of the system's program is explained below in natural language.

[1936] System Overview

[1937] Based on the information entered by the user, the server identifies the necessary nutrients, generates optimal ingredients, recipes, and exercise methods, and provides them to the user via the device. Furthermore, the system recognizes the user's emotional state in real time and optimizes the suggestions based on that information. This allows users to incorporate optimal diet and exercise plans that are tailored to their physical condition, preferences, and emotions, thereby improving their health and beauty.

[1938] Program processing

[1939] Accepting user input and sending data

[1940] The terminal prompts the user for the following information:

[1941] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[1942] Favorite ingredients (e.g. chicken, spinach)

[1943] Category of food you want to eat (e.g. Japanese food, Western food)

[1944] Current health condition (optional, e.g., light exercise is possible, allergies)

[1945] Furthermore, the emotion engine recognizes emotions from the user's facial expressions and voice and sends that data to the system. The device collects the user's input information and emotion data, serializes it into JSON format, and sends it to the server.

[1946] Data analysis and proposals

[1947] The server receives the received user data and begins parsing it. It does the following:

[1948] 1. Identify the nutrients you need based on your physical condition or skin concerns. For example, if you are concerned about fatigue, you might identify B vitamins and iron as the nutrients you need.

[1949] 2. The database is searched for foods that are high in the identified nutrients. For example, "chicken" that is high in "B vitamins" and "spinach" that is high in "iron" are identified.

[1950] 3. Generate an appropriate recipe based on the user's preferences. If the user selects "Japanese food," select the Japanese recipe "Teriyaki Chicken and Spinach," which uses "chicken" and "spinach."

[1951] 4. Include cooking tips in recipes to prevent nutrient loss, such as "cook chicken quickly to preserve B vitamins."

[1952] 5. Select the optimal exercise method based on the user's health condition. For example, if "light exercise is possible," recommend "light aerobic exercise" or "stretching."

[1953] 6. Based on data from the emotion engine, the app adjusts to take into account the user's mood and emotional state. For example, it can suggest relaxing recipes or exercise methods based on tired facial expressions or tone of voice.

[1954] The generated list of recipes and exercise methods is serialized in JSON format and sent to the device.

[1955] Suggestions for users

[1956] The device deserializes the information received from the server and displays the following in the user interface:

[1957] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[1958] Details of the exercise method and its effects.

[1959] Special suggestions based on the user's emotional state (e.g., stretching techniques to relax).

[1960] Specific examples

[1961] Example: Improving fatigue and considering emotions

[1962] 1. The user enters "I get tired easily," selects "chicken" as the favorite food, and selects "Japanese food" as the food category they want to eat.

[1963] 2. The emotion engine recognizes fatigue from the user's facial expressions and voice and transmits it as data.

[1964] 3. The device sends this information to the server.

[1965] 4. Analyze that servers "get tired easily" and therefore need B vitamins and iron.

[1966] 5. The server identifies a Japanese recipe that uses "chicken," "Teriyaki Chicken and Spinach," and includes "cooking quickly" as a cooking tip for preserving B vitamins.

[1967] 6. The server recommends "light aerobic exercise" and "stretching," and further suggests exercise methods with a high relaxation effect based on the emotion engine.

[1968] 7. The device displays recipes and exercise instructions to the user.

[1969] The above is a specific embodiment of the present invention. This system allows users to incorporate optimal diet and exercise according to their physical condition, preferences, and emotions, thereby improving their health and beauty.

[1970] The processing flow will be explained below.

[1971] Step 1:

[1972] The device presents the user with an input form, in which the user inputs information about physical ailments, skin concerns, favorite ingredients, preferred food categories, and current health condition. The device also activates an emotion engine to obtain emotional data from the user's facial expressions and voice.

[1973] Step 2:

[1974] The emotion engine analyzes the user's facial expressions and voice to identify their emotional state in real time. For example, it uses a facial recognition camera and voice recognition system to detect a user's tired expression or tone of voice and record this as emotion data.

[1975] Step 3:

[1976] The device serializes the input data and parsed emotion data into JSON format, which includes:

[1977] Physical discomfort or skin problems (e.g., "tired easily," "rough skin")

[1978] Favorite ingredients (e.g., "chicken," "spinach")

[1979] Category of food you want to eat (e.g., "Japanese food," "Western food")

[1980] Current health condition (e.g., "Light exercise is possible" or "I have allergies")

[1981] Emotional data (e.g., "tired," "stressed")

[1982] Step 4:

[1983] The device sends the serialized data to the server via an HTTP POST request.

[1984] Step 5:

[1985] The server receives the HTTP request, deserializes the data from the request body, and begins parsing it.

[1986] Step 6:

[1987] The server identifies the nutrients needed based on the user's physical condition or skin concerns. For example, if the user is concerned about fatigue, it identifies B vitamins and iron as the necessary nutrients.

[1988] Step 7:

[1989] The server searches the database for foods that are rich in the specified nutrients. The search results include "chicken," which is rich in "B vitamins," and "spinach," which is rich in "iron."

[1990] Step 8:

[1991] The server generates an appropriate recipe based on the user's preferred ingredients and cooking category. For example, if the user selects "Japanese food," the server selects the Japanese recipe "Teriyaki Chicken and Spinach," which uses "chicken" and "spinach."

[1992] Step 9:

[1993] The server adds cooking instructions to the recipe to prevent loss of nutrients, such as "cook the chicken quickly to preserve the B vitamins."

[1994] Step 10:

[1995] The server selects the optimal exercise method based on the user's health condition. For example, if "light exercise is possible," it will recommend "light aerobic exercise" or "stretching."

[1996] Step 11:

[1997] The server adjusts the user's mood and emotional state based on data from the emotion engine. For example, if the user is recognized as "tired," it will suggest relaxing dishes or exercise methods (e.g., "cooking with herbal tea" or "relaxing yoga").

[1998] Step 12:

[1999] The server serializes the generated recipe and exercise method again into JSON format and sends it to the device.

[2000] Step 13:

[2001] The device deserializes the data received from the server, which includes the recipe title, ingredients list, cooking instructions, cooking tips, and exercise instructions.

[2002] Step 14:

[2003] The device displays the deserialized recipes and exercise methods on a user interface, allowing the user to check and practice the optimal diet and exercise methods tailored to their physical and emotional state.

[2004] The above are the specific processing steps of the present invention. This system allows users to effectively incorporate diet and exercise into their diet according to their physical condition, preferences, and emotions.

[2005] Example 2

[2006] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2007] While conventional health management systems can suggest dietary and exercise regimes based on a user's physical condition, skin concerns, and preferences, they have had difficulty making optimal recommendations that take into account the user's emotional state. In particular, they have been unable to provide specific responses or suggestions that reflect the user's emotions, making it difficult to improve the user experience.

[2008] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2009] In this invention, the server includes means for having the user input information about physical ailments, skin concerns, favorite ingredients, desired food categories, and current health condition, means for transmitting the input information and collected emotional data to the server, means for the server to identify necessary nutrients based on the information and emotional data, means for optimizing the recommendations based on the emotional data, means for selecting an appropriate exercise method based on the physical ailments and health condition, and means for transmitting the generated recipes and exercise methods to the terminal. This enables optimal recommendations that take into account not only the user's physical condition and preferences, but also their emotional state.

[2010] "User" refers to an individual who uses the system to input their health status, preferences, and emotional state.

[2011] A "terminal" is an electronic device that a user uses to input information and receive suggestions from the system.

[2012] The "server" is a computer system that receives and analyzes information sent by users, generates the necessary nutrients, ingredients, recipes, and exercise methods, and sends them to the terminal.

[2013] The "emotion engine" is a system that recognizes emotions from a user's facial expressions and voice in real time and generates that data.

[2014] "Nutrients" refer to ingredients such as vitamins and minerals that are necessary to improve the user's physical condition and skin problems.

[2015] "Ingredients" refers to specific ingredients of foods that are rich in nutrients.

[2016] A "recipe" refers to a cooking method that uses specific ingredients and includes cooking tips to prevent loss of nutrients.

[2017] "Exercise method" refers to physical activities recommended based on the user's physical condition and health status.

[2018] "Emotional Data" refers to information about a user's emotional state generated by an emotion engine.

[2019] "Deserialization" refers to the process of returning serialized data sent from the server to its original data format.

[2020] "Optimizing suggested content" refers to optimizing suggested recipes and exercise methods to suit the user's emotional state based on the user's emotional data.

[2021] The present invention combines a system that suggests optimal nutrients, ingredients, cooking methods, and exercise methods for a user's physical condition or skin concerns with an emotion engine that recognizes the user's emotions. The processing of the system program is described in detail below.

[2022] System Overview

[2023] Based on the information entered by the user, the server identifies the necessary nutrients, generates optimal ingredients, recipes, and exercise methods, and provides them to the user via the device. Furthermore, the system recognizes the user's emotional state in real time and optimizes the suggestions based on that information. This allows users to incorporate optimal diet and exercise plans that are tailored to their physical condition, preferences, and emotions, thereby improving their health and beauty.

[2024] Program processing

[2025] Accepting user input and sending data

[2026] The terminal prompts the user for the following information:

[2027] Physical discomfort and skin problems (e.g., fatigue, rough skin)

[2028] Favorite ingredients (e.g. chicken, spinach)

[2029] Category of food you want to eat (e.g. Japanese food, Western food)

[2030] Current health condition (optional, e.g., light exercise is possible, allergies)

[2031] Furthermore, the emotion engine recognizes emotions from the user's facial expressions and voice and sends that data to the system. The device collects the user's input information and emotion data, serializes it into JSON format, and sends it to the server.

[2032] Data analysis and proposals

[2033] The server receives the received user data and begins parsing it. It does the following:

[2034] 1. Identify the nutrients you need based on your physical condition or skin concerns. For example, if you are concerned about fatigue, you might identify B vitamins and iron as the nutrients you need.

[2035] 2. The database is searched for foods that are high in the identified nutrients. For example, "chicken" that is high in "B vitamins" and "spinach" that is high in "iron" are identified.

[2036] 3. Generate an appropriate recipe based on the user's preferences. If the user selects "Japanese food," select the Japanese recipe "Teriyaki Chicken and Spinach," which uses "chicken" and "spinach."

[2037] 4. Include cooking tips in recipes to prevent nutrient loss, such as "cook chicken quickly to preserve B vitamins."

[2038] 5. Select the optimal exercise method based on the user's health condition. For example, if "light exercise is possible," recommend "light aerobic exercise" or "stretching."

[2039] 6. Based on data from the emotion engine, the app adjusts to take into account the user's mood and emotional state. For example, it can suggest relaxing recipes or exercise methods based on tired facial expressions or tone of voice.

[2040] The generated list of recipes and exercise methods is serialized in JSON format and sent to the device.

[2041] Suggestions for users

[2042] The device deserializes the information received from the server and displays the following in the user interface:

[2043] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[2044] Details of the exercise method and its effects.

[2045] Special suggestions based on the user's emotional state (e.g., stretching techniques to relax).

[2046] Specific examples

[2047] Example: Improving fatigue and considering emotions

[2048] 1. The user enters "I get tired easily," selects "chicken" as the favorite food, and selects "Japanese food" as the food category they want to eat.

[2049] 2. The emotion engine recognizes fatigue from the user's facial expressions and voice and generates it as data.

[2050] 3. The device serializes the user input information and emotion data into JSON format and sends it to the server.

[2051] 4. Analyze that servers "get tired easily" and therefore need B vitamins and iron.

[2052] 5. The server searches the database and identifies "chicken," which is rich in "B vitamins," and "spinach," which is rich in "iron."

[2053] 6. Since the user has selected "Japanese food," select the Japanese recipe "Teriyaki Chicken and Spinach."

[2054] 7. Add "cook quickly" to recipes as a cooking tip to preserve B vitamins.

[2055] 8. Consider the user's health condition and recommend "light aerobic exercise" and "stretching."

[2056] 9. Suggest exercise methods with a high relaxation effect based on emotional data.

[2057] 10. The server sends the generated proposal to the terminal, which displays it on the user interface.

[2058] Example prompts for generative AI models

[2059] Here are some examples of prompts for generative AI models:

[2060] User input: I get tired easily

[2061] Favorite food: Chicken

[2062] Food category: Japanese food

[2063] Health condition: Light exercise possible

[2064] Emotion engine data: Detecting fatigue from the user's facial expressions and voice

[2065] Based on this information, we suggest recipes and exercise regimes that contain optimal nutrients.

[2066] The above is an embodiment of the present invention.

[2067] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2068] Step 1: Enter your information

[2069] The user inputs information about their physical ailments, skin concerns, favorite ingredients, desired food categories, and current health condition through the device. The emotion engine analyzes the user's facial expressions and voice in real time to generate emotion data. This input information and emotion data become the raw data required for system processing.

[2070] Input: User's physical condition, favorite ingredients, emotional data

[2071] Data processing: The emotion engine analyzes the user's facial expressions and voice to generate emotion data.

[2072] Output: User input and emotion data

[2073] Step 2: Submit your information

[2074] The device serializes user input information and emotion data in JSON format and sends it to the server, allowing the server to accurately grasp the user's overall state.

[2075] Input: User input and emotion data

[2076] Data processing: Serializing information into JSON format

[2077] Output: JSON format data is sent to the server

[2078] Step 3: Analyze the data

[2079] The server analyzes the information received from the user and identifies the nutrients they need. This analysis uses algorithms and database searches. For example, if someone says they get tired easily, B vitamins and iron will be identified as necessary nutrients.

[2080] Input: User input and emotion data

[2081] Data processing: Algorithmic analysis, database search

[2082] Output: List of nutrients needed

[2083] Step 4: Find ingredients

[2084] The server searches the database to find foods that are high in the specified nutrients, such as chicken, which is rich in B vitamins, or spinach, which is rich in iron.

[2085] Input: List of nutrients needed

[2086] Data processing: Database search

[2087] Output: A list of ingredients

[2088] Step 5: Generate the recipe

[2089] The server generates an appropriate recipe based on the user's preferences and health condition. For example, if the user selects "Japanese food," it generates a recipe such as "Teriyaki chicken and spinach." This recipe also includes cooking tips to prevent the loss of nutrients.

[2090] Input: Ingredient list, user preferences, health status

[2091] Data processing: Creating recipes and adding cooking points

[2092] Output: The generated recipe

[2093] Step 6: Choose an exercise method

[2094] The server considers the user's health condition and selects an appropriate exercise method, such as recommending "light aerobic exercise" or "stretching."

[2095] Input: User's health status

[2096] Data processing: Selection of exercise method

[2097] Output: Recommended exercise method

[2098] Step 7: Optimize recommendations based on sentiment data

[2099] The server optimizes the suggestions based on the emotional data from the emotion engine. For example, if the user expresses fatigue, the server will adjust the suggestions to include recipes or exercise methods that are more relaxing.

[2100] Input: Emotion data, generated recipes and exercise methods

[2101] Data processing: Optimizing proposal content based on emotional data

[2102] Output: Optimized proposals

[2103] Step 8: Submit and view your proposal

[2104] The server serializes the optimized recipe and exercise method in JSON format and sends it to the device, which receives it and displays it in the user interface. The user can then confirm the suggestions and put them into practice.

[2105] Input: Optimized suggestions

[2106] Data processing: Serialize to JSON format

[2107] Output: Display the suggestion to the user

[2108] In this way, the system suggests optimal diet and exercise based on the user's physical condition, preferences, and emotional state.

[2109] (Application example 2)

[2110] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2111] Conventional food delivery systems and health management systems generally make suggestions based on basic information such as the user's physical condition, skin concerns, preferences, and health status. However, these systems do not take the user's emotional state into consideration, which means they are unable to make optimal suggestions when the user is emotionally tired or stressed. This has led to the issue of not being able to maximize the user's health and satisfaction.

[2112] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for having the user input information about physical ailments, skin concerns, favorite ingredients, categories of food they want to eat, and their current health condition, means for transmitting the input information to the server, means for recognizing emotions from the user's facial expressions and voice using the camera and microphone and collecting emotional data, and means for identifying necessary nutrients based on the information and emotional data. This makes it possible to suggest optimal meals and exercises that take the user's emotional state into consideration.

[2113] "User" refers to an individual user of the system.

[2114] "Physical ailments" refers to physical health problems experienced by the user, such as fatigue, pain, or weakness.

[2115] "Skin concerns" refer to issues related to the health and appearance of the user's skin, such as rough skin, dryness, acne, etc.

[2116] "Favorite ingredients" refer to foods that a user particularly likes and prefers to eat.

[2117] The "category of food you want to eat" refers to the type or genre of food that the user wants to eat.

[2118] "Current health condition" refers to the user's perceived physical condition and health status, such as allergies and the degree to which they are able to exercise.

[2119] "Camera" refers to a device for taking images and videos and acquiring data.

[2120] "Microphone" refers to a device for collecting sound and acquiring data.

[2121] "Emotion" refers to the state of mind that a user feels at a particular moment or in a particular situation, such as joy, sadness, anger, surprise, etc.

[2122] "Emotional data" refers to data that indicates the user's emotional state based on the user's facial expressions and voice information collected from a camera or microphone.

[2123] "Server" refers to a computer system that receives input information and emotional data from a user, analyzes, processes, and generates suggestions.

[2124] "Nutrients" refers to chemical components such as vitamins, minerals, and proteins that are necessary for the user to maintain their health.

[2125] "Ingredients" refer to the individual foods or ingredients used to make a meal.

[2126] A "recipe" refers to information about the steps and ingredients for making a particular dish.

[2127] An "exercise regimen" refers to a specific set of physical activities that a user undertakes to improve their health and fitness.

[2128] "Terminal" refers to a computing device, such as a smartphone or tablet, that a user uses to enter information or view suggestions.

[2129] This invention integrates an emotion engine into a system that suggests the nutrients, ingredients, cooking methods, and exercise methods needed to address a user's physical condition or skin concerns. Specifically, the system recognizes the user's emotional state in real time and makes optimal suggestions based on this. The program processing of this system is explained below in natural language.

[2130] User input acceptance and emotion recognition

[2131] Using a smartphone, users input their physical ailments, skin concerns, favorite ingredients, food categories they want to eat, and their current health condition. Using the smartphone's camera and microphone, the emotion engine recognizes the user's emotions from their facial expressions and voice.

[2132] Data transmission

[2133] The device serializes the user's input information and emotion data into JSON format and sends it to the cloud server. The transmitted data includes the following important information:

[2134] Physical discomfort and skin problems

[2135] Favorite ingredients

[2136] Food category you want to eat

[2137] Current health status

[2138] Recognized emotion data

[2139] Data analysis and proposals

[2140] The cloud server analyzes the received user data and generates proposals through the following process:

[2141] 1. Identify the nutrients needed based on your physical condition. For example, if you suffer from fatigue, B vitamins and iron may be identified.

[2142] 2. Search the database for foods that are high in the specified nutrients. For example, you can find chicken, which is rich in B vitamins, or spinach, which is rich in iron.

[2143] 3. Generate appropriate recipes based on the user's preferred ingredients and cooking category. If the Japanese food category is selected, "Teriyaki Chicken and Spinach" will be suggested.

[2144] 4. Recipes should also include specific cooking tips to prevent nutrient loss, such as cooking chicken quickly to preserve B vitamins.

[2145] 5. Choose the best exercise method based on your current health condition. If light exercise is possible, light aerobic exercise and stretching are recommended.

[2146] 6. Based on data from the emotion engine, the app adjusts to the user's mood and emotional state. For example, a tired facial expression or tone of voice can suggest relaxing recipes or exercise methods.

[2147] The proposal content generated by the above process is serialized in JSON format and sent to the device, which then deserializes it and displays it in the user interface.

[2148] Suggestions for users

[2149] The device displays the following in the user interface based on the information received from the server:

[2150] Each recipe includes an ingredient list, cooking instructions, and specific cooking tips to ensure nutrients are not lost during cooking.

[2151] Details of exercise method and its effects

[2152] Special suggestions based on the user's emotional state (e.g., stretching techniques to relax)

[2153] Specific examples

[2154] For example, if a user enters "I get tired easily," specifies "chicken" as their favorite ingredient, and "Japanese food" as their preferred food category:

[2155] 1. The emotion engine recognizes fatigue from the user's facial expressions and voice and transmits this as data.

[2156] 2. The device sends this information to the cloud server.

[2157] 3. The cloud server analyzes that "B vitamins and iron are necessary" and identifies "teriyaki chicken and spinach."

[2158] 4. Cooking tips to preserve B vitamins include "cooking for a short time."

[2159] 5. Light aerobic exercise and stretching are recommended, and exercise methods with a more relaxing effect are also suggested.

[2160] 6. The device displays recipes and exercise instructions to the user.

[2161] Prompt Sentence Examples

[2162] "Please enter the current physical discomfort you are experiencing."

[2163] "Choose your favorite ingredients."

[2164] Please select the category of food you would like to eat.

[2165] Please enter your current health status.

[2166] "Your emotional state can be reflected in relaxing cooking and exercise methods."

[2167] This allows users to incorporate optimal diet and exercise into their daily lives, tailored to their individual health conditions and emotions, thereby improving their health and beauty.

[2168] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2169] Step 1:

[2170] Users use their smartphone to input information about their physical ailments, skin concerns, favorite ingredients, food categories they want to eat, and their current health condition. This input information is serialized in JSON format on the device.

[2171] Step 2:

[2172] The device uses a camera and microphone to send the user's facial expressions and voice to the emotion engine in real time to recognize the user's emotional state. The emotion engine acquires the user's emotional data and serializes it in JSON format.

[2173] Step 3:

[2174] The device sends the user's input information and recognized emotion data to a cloud server. The sent data includes information on physical ailments and skin concerns, favorite ingredients, preferred food categories, current health status, and emotional state.

[2175] Step 4:

[2176] The cloud server analyzes the received data and performs the following data calculations:

[2177] Identify the nutrients you need based on your physical condition or skin concerns (for example, if you get tired easily, you should take B vitamins and iron).

[2178] Search the database for ingredients that are rich in necessary nutrients (for example, chicken, which is rich in B vitamins).

[2179] Generate suitable recipes based on your preferred ingredients and cooking categories.

[2180] Select the optimal exercise method based on your current health status and emotional data.

[2181] Step 5:

[2182] The server generates recipes and exercise data, serializes them into JSON format, and sends them to the device. The recipes also include cooking tips to prevent nutrient loss.

[2183] Step 6:

[2184] The device deserializes the information sent by the server and displays it in its user interface, specifically the following information:

[2185] Ingredient list for each recipe, cooking instructions, and cooking tips to prevent loss of nutrients

[2186] Details of the proposed exercise method and its effects

[2187] Special suggestions based on your emotional state (e.g., stretching techniques to relax)

[2188] Step 7:

[2189] The user can review the suggestions displayed on their device, select and execute them, and if necessary, generate new suggestions using additional prompts using the generative AI model.

[2190] Through these steps, users can receive diet and exercise recommendations optimized for their health and emotional state.

[2191] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2192] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2193] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2194] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2195] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2196] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2197] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2198] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2199] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2200] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2201] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2202] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2203] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2204] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2205] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2206] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2207] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2208] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2209] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2210] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2211] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2212] The following is further disclosed regarding the above embodiment.

[2213] (Claim 1)

[2214] A means for users to input information about their physical ailments, skin concerns, favorite ingredients, food categories they want to eat, and their current health condition;

[2215] means for transmitting the input information to a server;

[2216] means for the server to identify necessary nutrients based on the information;

[2217] A means for identifying food ingredients that are rich in the nutrients;

[2218] means for generating suitable recipes based on the preferred ingredients and cooking categories;

[2219] A means for selecting an appropriate...

Claims

1. A means for users to input information about their physical ailments, skin concerns, favorite ingredients, food categories they want to eat, and their current health condition; means for transmitting the input information to a server; means for the server to identify necessary nutrients based on the information; A means for identifying food ingredients that are rich in the nutrients; means for generating suitable recipes based on the preferred ingredients and cooking categories; A means for selecting an appropriate exercise method based on the physical condition and health state; means for transmitting the generated recipe and exercise method to a terminal; The system includes means for the terminal to display the recipe and exercise method to a user.

2. 2. The system according to claim 1, wherein the recipe generating means generates a recipe including cooking points that prevent loss of nutrients.

3. 2. The system according to claim 1, wherein the exercise method selection means sets an exercise intensity taking into consideration the user's current health condition.

Images