system

The system addresses the challenge of providing personalized health management by securely collecting and analyzing health and emotional data to generate and update tailored health improvement programs, enhancing user well-being through continuous adaptation.

JP2026069046APending Publication Date: 2026-04-23SOFTBANK GROUP CORP
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
SOFTBANK GROUP CORP
Filing Date
2024-10-11
Publication Date
2026-04-23

AI Technical Summary

Technical Problem

Existing health management systems struggle to provide personalized health improvement measures tailored to individual lifestyles and emotional states, and there is a lack of efficient means to collect, analyze, and securely transmit health and emotional data for continuous program improvement.

Method used

A system that collects health and emotional data from users via smartphones or wearable devices, encrypts and transmits it securely to a server, integrates it with an external database, and uses a generative AI model to generate customized health improvement programs, which are continuously updated based on user feedback.

Benefits of technology

Enables the delivery of personalized health improvement programs that adapt to individual health conditions and emotional states, ensuring data security and continuous improvement based on user feedback.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026069046000001_ABST
    Figure 2026069046000001_ABST
Patent Text Reader

Abstract

We provide the system. [Solution] Input means for collecting health data, A means of transmitting collected health data via a communication network, A means of receiving transmitted health data and integrating it with an external information database, A means for generating a health improvement program based on integrated health data, A transmission means for individually sending the generated health improvement programs, A system that includes this.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of the chatbot's character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In modern society, it is complex to find optimal health improvement measures based on individual lifestyles, and there is a problem that it is difficult to perform health management that fully meets the different needs of each individual. In addition, the information related to health is huge, and it is not easy for individual users to efficiently obtain reliable information and apply it. Therefore, there is a demand for providing a highly accurate health management program tailored to individual health conditions and life patterns.

Means for Solving the Problems

[0005] This invention includes means for collecting data from users using input means for collecting health data and transmitting the data to a server via a communication network. Furthermore, it includes generation means on the server that integrates the transmitted health data with an external information database to generate a health improvement program optimized for each user. The generated programs are individually transmitted and provided to the users. This allows users to easily implement improvement measures best suited to their lifestyle, improving the accuracy and efficiency of health management. In addition, tracking means are provided to collect user feedback and incorporate it into the next program, enabling continuous improvement of the program.

[0006] "Health data" refers to physiological data and information related to daily life, such as diet, exercise, sleep, heart rate, and stress levels, for individual users.

[0007] "Input means" refers to a device or application that allows users to input or automatically record health data via a smartphone or wearable device.

[0008] A "communication network" refers to the infrastructure used to send and receive data between devices via the internet or specific protocols.

[0009] A "server" refers to a computer system located at a central location that stores and processes collected data.

[0010] An "external information database" refers to a database that stores and makes accessible general information related to health and nutrition.

[0011] "Generation means" refers to algorithms and related software used to analyze integrated health data and create optimal health improvement programs for users.

[0012] "Transmission means" refers to a system or protocol for transferring a generated program from a server to a user's terminal.

[0013] "Tracking means" refers to a function that collects user feedback and uses it to adjust the next health improvement program. [Brief explanation of the drawing]

[0014] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13]It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when combined with an emotion engine. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when combined with an emotion engine.

Embodiments for Carrying Out the Invention

[0015] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be one arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be one type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0018] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0019] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0020] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0022] [First Embodiment]

[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0035] As an embodiment of the present invention, a system is provided that collects individual health data and provides a health improvement program optimized for the user.

[0036] First, users input or automatically record health data such as diet, exercise, sleep, and heart rate using their smartphones or wearable devices. This data is then aggregated through an application on the smartphone.

[0037] Next, the device transmits encrypted health data to the server via the communication network. This communication is conducted with security in mind and with a strong emphasis on protecting privacy.

[0038] The server integrates the received health data into an existing external information database, creating data that reflects the latest health information and guidelines. This database includes general information on dietary balance, fitness programs, and stress management techniques.

[0039] Furthermore, the server uses integrated data to activate a generation mechanism and create a customized health improvement program tailored to the user's current situation and goals. This program provides specific details such as meal suggestions, exercise plans, and relaxation techniques.

[0040] The server then sends the generated program to each user's smartphone and displays it in a user-friendly format within the application. Users can use this information to adjust their daily activities and work towards improving their health.

[0041] To measure the program's effectiveness, the terminal continuously collects user data and receives user feedback. The server uses this feedback to update the program and provide more effective health improvement measures. This feedback loop makes it possible to continuously support the user's health and well-being.

[0042] For example, if a user wants to lose weight, the program analyzes their current eating patterns and activity level and provides meal suggestions to appropriately reduce calorie intake while maintaining nutritional balance. It also suggests specific exercises to promote efficient fat burning and introduces relaxation techniques to reduce stress. In this way, users are supported in effectively working towards their individual health goals.

[0043] The following describes the processing flow.

[0044] Step 1:

[0045] Users can input health data such as diet, exercise, sleep, and heart rate using their smartphones or wearable devices, or have this data automatically recorded by sensors built into the devices. This allows for the collection of everyday health information.

[0046] Step 2:

[0047] The device encrypts the collected health data at regular intervals and transmits it to the server via the communication network. This encryption process ensures data security and protects privacy.

[0048] Step 3:

[0049] The server stores the received health data in a database and integrates it with external information databases. Here, it incorporates the latest health guidelines, nutrition information, and fitness data to ensure data integrity.

[0050] Step 4:

[0051] The server activates a generation mechanism to analyze the integrated data and generates a customized health improvement program based on the user's health status and goals. This program includes specific meal suggestions, exercise plans, and relaxation methods.

[0052] Step 5:

[0053] The server sends the generated health improvement programs to each user's terminal individually. The programs are formatted in a user-friendly format and notified to the user through the application.

[0054] Step 6:

[0055] Users review the programs provided through their devices and implement them in their daily lives. This includes reviewing their diet and practicing recommended exercises.

[0056] Step 7:

[0057] The device collects user feedback and post-implementation health data again and sends it to the server. This feedback is used to evaluate the program's effectiveness and make necessary adjustments.

[0058] Step 8:

[0059] The server analyzes user feedback and newly collected data, incorporating it into the next health improvement program. This allows the program to continuously evolve and support users' health and well-being.

[0060] (Example 1)

[0061] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0062] In today's world, where the need for health management is increasing, providing personalized health improvement measures is crucial. Traditional systems have struggled to deliver individualized health improvement programs quickly and effectively, and have also faced difficulties in continuously improving them based on user feedback.

[0063] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0064] In this invention, the server includes data input means at a terminal for collecting personal health information, means for encrypting the collected information and transmitting it over a communication network, and means for receiving the transmitted information and integrating it with an external knowledge base. This enables the rapid provision of personalized health improvement programs and continuous improvement that reflects user feedback.

[0065] "Information about an individual's health" refers to data that indicates an individual's health status related to their daily life, such as diet, exercise, sleep, and heart rate.

[0066] "Data input means on a terminal" refers to interfaces or functions on smartphones and wearable devices for manually or automatically inputting health-related data.

[0067] A "communication network" is an infrastructure for electronically sending and receiving data, and is a network that can use encryption technology to ensure privacy and security.

[0068] A "server" is a computing system that receives, processes, and analyzes health data from users, and is a device that has the functionality to perform integrated processing with external databases.

[0069] An "external knowledge base" is a database containing general health information and guidelines, and is an information system that is regularly updated to reflect the latest health information.

[0070] A "generative AI model" is an artificial intelligence technology used to analyze a user's health data and automatically generate personalized health improvement programs.

[0071] "Continuous tracking" refers to a function that continuously collects user health status and feedback and incorporates it into health improvement programs.

[0072] This invention relates to a system that collects user health data and provides individually customized health improvement programs. The system's main components are a terminal, a server, and a generative AI model.

[0073] First, the terminal is a smartphone or wearable device, and users input health information through these devices. Specifically, the terminal collects health data such as diet, exercise, sleep, and heart rate, and a dedicated application has the function of organizing and aggregating this data. In terms of hardware, a typical smartphone and a compatible wearable device are used.

[0074] Next, the device encrypts the collected health data in real time and sends it to the server via the communication network. Secure technologies such as the SSL / TLS protocol are used for this communication.

[0075] The server integrates received health data with an external knowledge base and performs analysis that reflects the latest health information. The integrated data is then analyzed in detail by a generative AI model to generate a customized health improvement program tailored to the user's health condition. This generative AI model is updated to optimize the program's effectiveness by taking into account continuous feedback from the user.

[0076] As a concrete example, suppose a user wants to lose weight. The system analyzes the user's current diet and exercise level, and uses an AI model to generate and provide meal suggestions that maintain nutritional balance while reducing calories, as well as an exercise plan aimed at burning fat.

[0077] An example of a prompt for a generative AI model might be: "Please suggest a health improvement program. The user wants to lose weight, and their current eating patterns and exercise level are as follows..."

[0078] This system allows users to easily check personalized health maintenance strategies on their smartphones and incorporate them into their daily lives.

[0079] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0080] Step 1:

[0081] Users input or record health data using smartphones or wearable devices. Input data includes photos of meals, exercise time, sleep duration, and heart rate. This data is instantly compiled by a dedicated application. Specifically, users can manually enter data into input forms within the app, or data is automatically collected and synchronized from the device. The compiled health data is temporarily stored on the device as output.

[0082] Step 2:

[0083] The terminal encrypts the aggregated health data and sends it to the server via the communication network. The input is the aggregated data stored on the terminal, and the output is the encrypted transmitted data. Specifically, the terminal encrypts the data using the SSL / TLS protocol and securely sends it to the server.

[0084] Step 3:

[0085] The server processes the received data and integrates it with an external knowledge base. The input is encrypted health data, and the external knowledge base includes the latest health guidelines and nutritional information. This data is integrated and output as an analyzable dataset. Specifically, the process involves data cleansing and standardization to create the dataset for analysis.

[0086] Step 4:

[0087] The server uses a generative AI model to analyze health data and generate individually customized health improvement programs. The input consists of an integrated dataset and the generative AI model. The AI ​​analyzes the data and generates a program optimized for the user as output. Specifically, it performs algorithmic data analysis and proposes concrete improvement measures such as meal plans and exercise schedules.

[0088] Step 5:

[0089] The server sends the generated health improvement program to the user's device and displays it in a format that the user can review within a dedicated application. The input is a program generated by AI, and the output is data sent to the smartphone. Specifically, it utilizes a notification system to present the program to the user as a daily schedule.

[0090] Step 6:

[0091] The device continuously collects user feedback and additional health data and sends it to the server. Inputs include user feedback and new health data, while output is encrypted transmission data based on this input. Specifically, the app has a function that asks for user feedback in the form of a survey, and this data is periodically sent to the server.

[0092] Step 7:

[0093] The server analyzes the collected feedback and updates the health improvement program as needed. This allows for more effective suggestions for the user. Inputs include user feedback data and current program information, while output is the updated health program. Specifically, the program is re-evaluated and adjusted based on the feedback analysis.

[0094] (Application Example 1)

[0095] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0096] In modern times, maintaining and improving individual health is a crucial issue for many people, but general health programs are often uniform and do not meet individual needs. Furthermore, there is a lack of an environment where appropriate health information and proposed programs can be immediately implemented. Therefore, there is a need for a system that delivers personalized health improvement strategies and related information.

[0097] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0098] In this invention, the server includes an input device means for collecting health data, a device means for receiving transmitted health data and integrating it with an external information storage, and a device means for generating and associating personalized content using a generative AI model. This enables the timely delivery of customized health improvement plans and content to individual users, and facilitates the formation of healthy lifestyle habits based on them.

[0099] "Health data" refers to information about individual users, such as their diet, exercise, sleep, and heart rate, and is used to analyze their health status and develop improvement plans.

[0100] An "input device" is a device used by a user to input or automatically record health data, and examples include smartphones and wearable devices.

[0101] A "communication channel" refers to a network used to securely transmit data, and includes the internet and mobile networks.

[0102] An "external information repository" refers to a database where general health-related information is stored, including health guidelines, dietary information, and exercise program information.

[0103] A "generation device" refers to a processor or software that generates individualized health improvement plans for users based on integrated health data.

[0104] A "transmission device" refers to a system for distributing generated health improvement programs to individual users, and a smartphone application falls under this category.

[0105] A "generative AI model" refers to an algorithm that uses artificial intelligence to analyze health-related data and generate individually optimized content.

[0106] "Personalized content" refers to information, programs, and suggestions that are individually tailored based on each user's health status and preferences.

[0107] The system for carrying out this invention operates in a network environment including users, terminals, and servers. Users acquire and input health data using input devices such as smartphones or smart glasses. This utilizes sensors and dedicated applications built into the devices. This data includes information on diet, exercise, sleep, heart rate, etc.

[0108] The device transmits this health data to the server in real time via a communication channel. The data is encrypted during transmission to protect privacy. The server integrates the received health data with an external data storage system and comprehensively analyzes the user's health status. Software such as Python and machine learning libraries (TENSORFLOW®, PyTorch) are used for this analysis.

[0109] Using a generative AI model, the server generates a personalized health improvement plan for each user. This plan includes customized meal suggestions, exercise plans, and relaxation techniques. Appropriate content is then selected and sent to the user's device. This content is individually tailored based on the user's preferences and health information.

[0110] For example, if a user is determined to be inactive, an exercise video suitable for that user will be selected and provided. Furthermore, an example of a prompt message for the generating AI model could be: "The user sleeps less than 7 hours on average and exercises less than 2 hours per week. Please recommend a fitness video suitable for this user."

[0111] In this way, a system is configured in which the server and terminal cooperate to propose dynamic and appropriate health improvement measures to individual users and provide an environment in which they can be implemented.

[0112] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0113] Step 1:

[0114] Users input or automatically record health data using applications installed on their smartphones or smart glasses. Data such as diet, exercise, sleep, and heart rate are used as input. This data is temporarily stored on the device, and the sensor data is formatted as part of the data processing. The output is appropriately formatted health data.

[0115] Step 2:

[0116] The device transmits the collected health data to the server via a communication channel. The data is encrypted for security purposes during this process. The input is formatted health data, and the output is an encrypted data stream. Specifically, the HTTPS protocol is used to securely transmit the data to the server.

[0117] Step 3:

[0118] The server decrypts the received health data and integrates it with an external data repository. The input is an encrypted data stream, and the output is integrated data. Specifically, a database management system is used to integrate general information and user data from the external repository.

[0119] Step 4:

[0120] The server runs a generative AI model based on integrated data. The input is integrated data, and the output is a personalized health improvement plan. In this process, Python and machine learning libraries are used to perform data analysis and plan generation.

[0121] Step 5:

[0122] The generated health improvement plan is sent to the user's terminal by the server. The input is the health improvement plan, and the output is the content displayed on the user's terminal. This involves prompting the generating AI model. Specific examples include fitness videos and recipe videos.

[0123] Step 6:

[0124] Users review a health improvement plan provided through an application on their device and adjust their daily lives accordingly. The input is the health improvement plan, and the output is user feedback data. This feedback is entered on the device and used to update the plan in the next update.

[0125] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0126] As an embodiment of the present invention, a system is provided that combines and analyzes individual health data and emotional information to provide a health improvement program optimized for the user.

[0127] Users input or automatically record their daily health data (such as diet, exercise, and sleep) using smartphones or wearable devices. Furthermore, they can use applications equipped with an emotion engine function to record their emotions and moods for the day through voice input, text input, or facial expression emotion analysis.

[0128] The device encrypts this health and emotional data and transmits it to the server over the communication network. The encryption process is crucial to protect the confidentiality of the data.

[0129] The server stores the received data in a database and integrates it with an external information database. The database contains the latest health information, guidelines, and emotion-based influencing factors. For example, it considers the impact of specific emotions on dietary choices and exercise patterns.

[0130] The server activates a production mechanism that analyzes integrated health data and emotional information to generate a customized health improvement program based on the individual's condition and goals. This program includes dietary suggestions, exercise plans, and stress management methods tailored to the user's emotional state.

[0131] The generated programs are sent individually from the server to the user's terminal and displayed in an easy-to-understand format within the application. Users can then adjust and improve their lifestyle based on the provided programs.

[0132] For example, if a user tends to experience high levels of stress, the program will suggest foods that promote a comfortable mood, as well as exercises and meditation to help them relax. Furthermore, the emotion engine detects changes in the user's emotions and adjusts health-related advice in real time.

[0133] The device records user feedback and daily emotional changes and sends them to a server. This allows the server to adjust the program based on the feedback, providing more effective health improvement support. In this way, the program, which integrates emotional and health information, aims to continuously improve the user's overall health and well-being.

[0134] The following describes the processing flow.

[0135] Step 1:

[0136] Users input health data such as diet, exercise, and sleep using smartphones or wearable devices. They also utilize an emotion engine to record their emotions for the day through text input, voice input, or camera.

[0137] Step 2:

[0138] The device encrypts the collected health data and emotional information and transmits it to the server via the communication network. This transmission process uses state-of-the-art encryption technology to protect user privacy.

[0139] Step 3:

[0140] The server stores the received data in a database and integrates it with external information databases. This integration ensures that the latest health information and emotional state are reflected in individual health data, thus guaranteeing data consistency.

[0141] Step 4:

[0142] The server activates generation mechanisms to analyze health data and emotional information, and generates an optimized health improvement program based on the user's emotional and health status. This program includes dietary suggestions, exercise plans, and stress reduction methods tailored to the user's emotional state.

[0143] Step 5:

[0144] The server customizes the generated health improvement program for each user and sends it to their device. The program is visually represented within the app and provided in a format that users can easily understand and execute.

[0145] Step 6:

[0146] Users review the provided programs and implement them in their daily lives. For example, they might exercise to reduce stress, adjust their diet, and improve their health habits according to their emotional state.

[0147] Step 7:

[0148] In addition to continuously collecting health data, the device also records user feedback and emotional changes. This data is then sent back to the server.

[0149] Step 8:

[0150] The server analyzes user feedback and new emotional data, incorporating it into the next health improvement program. This program adjustment allows for a better balance between the user's health and emotions.

[0151] (Example 2)

[0152] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0153] Programs for improving individual health should take into account individual health conditions and emotional changes, rather than relying on general information. However, conventional systems lacked sufficient means to effectively collect, analyze, and reflect individual health and emotional data, making it difficult to provide optimized health programs. Furthermore, mechanisms for securely transmitting data in a properly encrypted form were not established.

[0154] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0155] In this invention, the server includes input means for collecting health status data and emotional information from a personal device, means for encrypting the collected health status data and emotional information and transmitting it via a communication network, and generation means using a generation model for generating a personalized health improvement program based on the integrated data. This makes it possible to securely generate and provide an optimized health improvement program based on the user's individual health status and emotions.

[0156] "Health status data" refers to information about an individual's physical activity and condition, such as diet, exercise, and sleep, and serves as an indicator of health in daily life.

[0157] "Emotional information" refers to information about an individual's emotions and mood, representing their mental state obtained through voice input, text input, and facial expression analysis.

[0158] "Input means" refers to devices or applications for collecting health status data and emotional information, which users can use to record information in digital format.

[0159] "Encryption" is a technology that protects the confidentiality of data by transforming it using a specific algorithm and preventing unauthorized access.

[0160] A "communication network" is the infrastructure used to transmit data from a terminal to a server, and includes digital communication technologies such as the internet and mobile networks.

[0161] "Transmission means" refers to the equipment or software used to transmit collected data to other components, and is responsible for managing the transmission and reception of data.

[0162] A "generative model" refers to an algorithm or artificial intelligence technology used to create health improvement programs, which analyzes input data to provide the optimal output.

[0163] "Generative means" refer to processes and technologies for creating new value based on data, and are particularly used to build health improvement programs.

[0164] A "health improvement program" is a set of action plans proposed to improve an individual's health, and includes elements of diet, exercise, and stress management.

[0165] This invention is a system that collects individual health status and emotional information and provides an optimized health improvement program based on this information. Specifically, it uses an input device, a terminal, and a server to collect, transmit, and analyze data.

[0166] Users collect health and emotional data using smartphones and wearable devices. These devices include, for example, fitness trackers that monitor heart rate and smartphone applications that can take photos of meals. Emotional information is captured through voice input, text input, or software that analyzes facial expressions.

[0167] The terminal temporarily stores the data entered by the user and encrypts it using encryption technologies such as AES. The encrypted data is then transmitted to the server via a communication network such as the internet. This process ensures that the data is transmitted securely and protected from unauthorized access.

[0168] The server decodes the received data and stores it in its database. Furthermore, it acquires the latest data from external health sources and integrates it with its own database. This includes the latest dietary guidelines and exercise programs, which are then used in conjunction with individual user data. The server analyzes the integrated data using a generative AI model to generate health improvement programs based on the user's individual health status. For example, a prompt such as "30-year-old female, high stress, insufficient exercise" might be input into the AI ​​model. As a result, the user would be provided with dietary and exercise suggestions to reduce stress.

[0169] The generated health improvement program is sent from the server to each user's terminal and displayed on the application in a visually easy-to-understand format. Users can adjust their daily routines according to the provided program and discover improvements. For example, if a user is experiencing high levels of stress, the system may suggest foods and exercises that promote relaxation.

[0170] This system allows users to receive more personalized guidance tailored to their health condition and emotions, thereby contributing to improved health and well-being.

[0171] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0172] Step 1:

[0173] Users input or automatically record health data and emotional information using smartphones or wearable devices. The primary inputs at this stage are diet, exercise, sleep data, and emotional information. This includes exercise data obtained from device sensors, diet information from image analysis, or emotional text or voice input using an emotion engine. The output is the accumulation of this input data.

[0174] Step 2:

[0175] The device aggregates the collected data into a single dataset and encrypts it using encryption algorithms such as AES. The input for this encryption is health data and emotional information provided by the user, and the output is an encrypted data file. Specifically, the device ensures the data is securely encrypted and prepared for transmission.

[0176] Step 3:

[0177] Encrypted data is sent from the terminal, and the server receives and decrypts it. The input is encrypted data received via a secure communication channel, and the output is decrypted, accurate health and emotional data. Specifically, the integrity of the received data is checked, and once successfully decrypted, it is prepared for the next integration step.

[0178] Step 4:

[0179] The server stores the decoded data in its own database and further integrates it with external information databases. The input consists of the decoded data and the latest external health information, and the output is a new, integrated database. Specifically, the server performs data matching and updates, laying the groundwork for analysis based on individual health conditions.

[0180] Step 5:

[0181] The server generates personalized health improvement programs using a generative AI model based on integrated data. The input to this generation process is integrated data, and by using appropriate prompt statements, the output is a health improvement program optimized for each individual user. For example, information such as "30-year-old female, high stress, insufficient exercise time" is input to the model in the prompt statement, and the generation result is obtained.

[0182] Step 6:

[0183] The server sends the generated program to the user's terminal, which displays it visually in the application. The input is the generated program data, and the output is the program content presented to the user. Specifically, the server arranges the program layout and presents it in a format that is easy for the user to understand.

[0184] Step 7:

[0185] Users try the provided program and re-enter feedback on the results and daily emotional changes into the app. The input consists of user feedback and daily data changes, while the output is this feedback information. Specifically, users are required to update their daily logs and accumulate foundational data for long-term health improvement.

[0186] (Application Example 2)

[0187] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0188] In modern living environments, people are required to maintain their health and manage their emotions, but there is a lack of effective means to comprehensively improve both individual health conditions and emotions. In particular, the lack of appropriate advice and product recommendations at the local level hinders health improvement. Therefore, there is a need for the development of a reliable system that provides users with real-time, customized health improvement programs.

[0189] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0190] In this invention, the server includes information acquisition means for acquiring health data, input means for acquiring emotional information, and means for transferring the acquired health data and emotional information via a communication network. This makes it possible to generate individually customized health improvement plans for users and support their health improvement in real time through product selection and service use within stores.

[0191] "Health data" refers to information about an individual user's habits, such as diet, exercise, and sleep.

[0192] "Emotional information" refers to information about a user's daily emotions and moods, obtained through voice input, text input, or facial expression analysis.

[0193] "Information acquisition means" refers to the hardware or software system used to acquire health data from users.

[0194] "Input means" refers to a device or application used to obtain emotional information from a user.

[0195] A "communication network" refers to the network infrastructure used to transfer data from a terminal to a server.

[0196] "Transfer method" refers to a system that has the function of transmitting acquired health data and emotional information to a server via a communication network.

[0197] An "external information storage device" refers to a database that stores the latest guidelines and information related to health.

[0198] "Generation means" refers to a program or system that performs processing to create an optimal health improvement plan for the user based on health data and emotional information.

[0199] "Means of delivery" refers to a mechanism for displaying or notifying users of the generated health improvement plan.

[0200] "Presentation methods" refer to systems and devices that support the communication of product and service information within a store to users.

[0201] To implement the invention, the following system configuration is conceivable: The user uses a smartphone or smart glasses to input health data and emotional information. This device has an application installed for collecting health data, which automatically or manually records information such as diet, exercise, and sleep. Emotional information is acquired using voice input, text input, or a facial expression emotion analysis function.

[0202] The acquired health data and emotional information are encrypted on the device and then transmitted to the server via the communication network. A secure protocol is used for this communication. The server integrates the received data with an external data storage device and generates a customized health improvement plan based on the health data and emotional information. This plan includes stress management, diet, and exercise recommendations.

[0203] The generated plan is provided to the user's device and notified visually or audibly. In-store, users can use their device to scan QR codes (registered trademarks) within the store to obtain product and service information and link it to their health improvement plan. For example, when a user purchases a relaxing herbal tea or a supplement containing specific vitamins, the system can suggest the most suitable products.

[0204] Furthermore, user feedback is continuously collected and sent to the server, contributing to improving the accuracy of health improvement plans. The generative AI model responds to changes in emotional information in real time and makes suggestions for health improvements.

[0205] An example of a prompt message might be, "I'm under a lot of stress. What foods would you recommend?" This allows the system to provide specific, personalized advice in real time.

[0206] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0207] Step 1:

[0208] Users input health data and emotional information using their devices. Health data includes information such as diet, exercise, and sleep, while emotional information is obtained through voice input, text input, or facial expression analysis. The input data is converted to a standard format by the application.

[0209] Step 2:

[0210] The device encrypts the acquired health and emotional information and transmits it to the server via the communication network. Encryption is performed to protect the confidentiality of the data, and the data is sent to the network only after the recipient has been verified by the communication protocol.

[0211] Step 3:

[0212] The server stores the received data in a database and integrates it with information from external storage devices. The database contains the latest health information and historical sentiment data trends, and the data is efficiently integrated using SQL queries.

[0213] Step 4:

[0214] The server applies a generative AI model using integrated health data and emotional information to create an optimal health improvement plan for the user. Through data analysis, the generative AI model determines personalized dietary suggestions and stress management methods for each user.

[0215] Step 5:

[0216] The server sends the generated health improvement plan to the user's device. The plan is communicated to the user visually or audibly, prompting them to take appropriate action. Specific product information is also displayed in conjunction with the in-store system.

[0217] Step 6:

[0218] Users select products in the store and enter feedback via a terminal. This feedback is used by the system to improve the accuracy of health improvement plans.

[0219] Step 7:

[0220] The server accumulates new feedback data and integrates it into subsequent health improvement plans. This allows the program to continuously optimize user health management. Natural language processing techniques are used to analyze the feedback.

[0221] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0222] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0223] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0224] [Second Embodiment]

[0225] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0226] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0227] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0228] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0229] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0230] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0231] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0232] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0233] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0234] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0235] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0236] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0237] As an embodiment of the present invention, a system is provided that collects individual health data and provides a health improvement program optimized for the user.

[0238] First, users input or automatically record health data such as diet, exercise, sleep, and heart rate using their smartphones or wearable devices. This data is then aggregated through an application on the smartphone.

[0239] Next, the device transmits encrypted health data to the server via the communication network. This communication is conducted with security in mind and with a strong emphasis on protecting privacy.

[0240] The server integrates the received health data into an existing external information database, creating data that reflects the latest health information and guidelines. This database includes general information on dietary balance, fitness programs, and stress management techniques.

[0241] Furthermore, the server uses integrated data to activate a generation mechanism and create a customized health improvement program tailored to the user's current situation and goals. This program provides specific details such as meal suggestions, exercise plans, and relaxation techniques.

[0242] The server then sends the generated program to each user's smartphone and displays it in a user-friendly format within the application. Users can use this information to adjust their daily activities and work towards improving their health.

[0243] To measure the program's effectiveness, the terminal continuously collects user data and receives user feedback. The server uses this feedback to update the program and provide more effective health improvement measures. This feedback loop makes it possible to continuously support the user's health and well-being.

[0244] For example, if a user wants to lose weight, the program analyzes their current eating patterns and activity level and provides meal suggestions to appropriately reduce calorie intake while maintaining nutritional balance. It also suggests specific exercises to promote efficient fat burning and introduces relaxation techniques to reduce stress. In this way, users are supported in effectively working towards their individual health goals.

[0245] The following describes the processing flow.

[0246] Step 1:

[0247] Users can input health data such as diet, exercise, sleep, and heart rate using their smartphones or wearable devices, or have this data automatically recorded by sensors built into the devices. This allows for the collection of everyday health information.

[0248] Step 2:

[0249] The device encrypts the collected health data at regular intervals and transmits it to the server via the communication network. This encryption process ensures data security and protects privacy.

[0250] Step 3:

[0251] The server stores the received health data in a database and integrates it with external information databases. Here, it incorporates the latest health guidelines, nutrition information, and fitness data to ensure data integrity.

[0252] Step 4:

[0253] The server activates a generation mechanism to analyze the integrated data and generates a customized health improvement program based on the user's health status and goals. This program includes specific meal suggestions, exercise plans, and relaxation methods.

[0254] Step 5:

[0255] The server sends the generated health improvement programs to each user's terminal individually. The programs are formatted in a user-friendly format and notified to the user through the application.

[0256] Step 6:

[0257] Users review the programs provided through their devices and implement them in their daily lives. This includes reviewing their diet and practicing recommended exercises.

[0258] Step 7:

[0259] The device collects user feedback and post-implementation health data again and sends it to the server. This feedback is used to evaluate the program's effectiveness and make necessary adjustments.

[0260] Step 8:

[0261] The server analyzes user feedback and newly collected data, incorporating it into the next health improvement program. This allows the program to continuously evolve and support users' health and well-being.

[0262] (Example 1)

[0263] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0264] In today's world, where the need for health management is increasing, providing personalized health improvement measures is crucial. Traditional systems have struggled to deliver individualized health improvement programs quickly and effectively, and have also faced difficulties in continuously improving them based on user feedback.

[0265] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0266] In this invention, the server includes data input means at a terminal for collecting personal health information, means for encrypting the collected information and transmitting it over a communication network, and means for receiving the transmitted information and integrating it with an external knowledge base. This enables the rapid provision of personalized health improvement programs and continuous improvement that reflects user feedback.

[0267] "Information about an individual's health" refers to data that indicates an individual's health status related to their daily life, such as diet, exercise, sleep, and heart rate.

[0268] "Data input means on a terminal" refers to interfaces or functions on smartphones and wearable devices for manually or automatically inputting health-related data.

[0269] A "communication network" is an infrastructure for electronically sending and receiving data, and is a network that can use encryption technology to ensure privacy and security.

[0270] A "server" is a computing system that receives, processes, and analyzes health data from users, and is a device that has the functionality to perform integrated processing with external databases.

[0271] An "external knowledge base" is a database containing general health information and guidelines, and is an information system that is regularly updated to reflect the latest health information.

[0272] A "generative AI model" is an artificial intelligence technology used to analyze a user's health data and automatically generate personalized health improvement programs.

[0273] "Continuous tracking" refers to a function that continuously collects user health status and feedback and incorporates it into health improvement programs.

[0274] This invention relates to a system that collects user health data and provides individually customized health improvement programs. The system's main components are a terminal, a server, and a generative AI model.

[0275] First, the terminal is a smartphone or wearable device, and users input health information through these devices. Specifically, the terminal collects health data such as diet, exercise, sleep, and heart rate, and a dedicated application has the function of organizing and aggregating this data. In terms of hardware, a typical smartphone and a compatible wearable device are used.

[0276] Next, the device encrypts the collected health data in real time and sends it to the server via the communication network. Secure technologies such as the SSL / TLS protocol are used for this communication.

[0277] The server integrates received health data with an external knowledge base and performs analysis that reflects the latest health information. The integrated data is then analyzed in detail by a generative AI model to generate a customized health improvement program tailored to the user's health condition. This generative AI model is updated to optimize the program's effectiveness by taking into account continuous feedback from the user.

[0278] As a concrete example, suppose a user wants to lose weight. The system analyzes the user's current diet and exercise level, and uses an AI model to generate and provide meal suggestions that maintain nutritional balance while reducing calories, as well as an exercise plan aimed at burning fat.

[0279] An example of a prompt for a generative AI model might be: "Please suggest a health improvement program. The user wants to lose weight, and their current eating patterns and exercise level are as follows..."

[0280] This system allows users to easily check personalized health maintenance strategies on their smartphones and incorporate them into their daily lives.

[0281] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0282] Step 1:

[0283] The user utilizes a smartphone or a wearable device to input or record health data. The input data includes photos of meals, exercise time, sleep time, heart rate, etc. These data are immediately aggregated by a dedicated application. As specific operations, the user manually enters the data into the input form within the application, or the data is collected in a form automatically synchronized from the device. As output, the aggregated health data is temporarily stored in the terminal.

[0284] Step 2:

[0285] The terminal encrypts the aggregated health data and transmits it to the server via a communication network. The input is the aggregated data stored in the terminal, and the output is the encrypted transmitted data. As a specific operation, a process is performed where the terminal encrypts the data using the SSL / TLS protocol and securely transmits it to the server.

[0286] Step 3:

[0287] The server performs a process of integrating the received data with an external knowledge base. The input is the encrypted and received health data, and the external knowledge base includes the latest health guidelines and nutritional information. These are integrated and output as an analyzable dataset. As specific operations, data cleaning and standardization are performed to form a dataset for analysis.

[0288] Step 4:

[0289] The server uses a generative AI model to analyze health data and generate individually customized health improvement programs. The input consists of an integrated dataset and the generative AI model. The AI ​​analyzes the data and generates a program optimized for the user as output. Specifically, it performs algorithmic data analysis and proposes concrete improvement measures such as meal plans and exercise schedules.

[0290] Step 5:

[0291] The server sends the generated health improvement program to the user's device and displays it in a format that the user can review within a dedicated application. The input is a program generated by AI, and the output is data sent to the smartphone. Specifically, it utilizes a notification system to present the program to the user as a daily schedule.

[0292] Step 6:

[0293] The device continuously collects user feedback and additional health data and sends it to the server. Inputs include user feedback and new health data, while output is encrypted transmission data based on this input. Specifically, the app has a function that asks for user feedback in the form of a survey, and this data is periodically sent to the server.

[0294] Step 7:

[0295] The server analyzes the collected feedback and updates the health improvement program as needed. This allows for more effective suggestions for the user. Inputs include user feedback data and current program information, while output is the updated health program. Specifically, the program is re-evaluated and adjusted based on the feedback analysis.

[0296] (Application Example 1)

[0297] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0298] In modern times, maintaining and improving individual health is a crucial issue for many people, but general health programs are often uniform and do not meet individual needs. Furthermore, there is a lack of an environment where appropriate health information and proposed programs can be immediately implemented. Therefore, there is a need for a system that delivers personalized health improvement strategies and related information.

[0299] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0300] In this invention, the server includes an input device means for collecting health data, a device means for receiving transmitted health data and integrating it with an external information storage, and a device means for generating and associating personalized content using a generative AI model. This enables the timely delivery of customized health improvement plans and content to individual users, and facilitates the formation of healthy lifestyle habits based on them.

[0301] "Health data" refers to information about individual users, such as their diet, exercise, sleep, and heart rate, and is used to analyze their health status and develop improvement plans.

[0302] An "input device" is a device used by a user to input or automatically record health data, and examples include smartphones and wearable devices.

[0303] A "communication channel" refers to a network used to securely transmit data, and includes the internet and mobile networks.

[0304] An "external information repository" refers to a database where general health-related information is stored, including health guidelines, dietary information, and exercise program information.

[0305] The "generation device" refers to a processor or software that generates an individualized health improvement plan based on integrated health data.

[0306] The "transmission device" refers to a system for delivering the generated health improvement program to individual users, and a smartphone app falls under this category.

[0307] The "generation AI model" refers to an algorithm that analyzes health-related data by artificial intelligence and generates individually optimized content.

[0308] "Personalized content" refers to information, programs, and suggestions that are individually adjusted based on each user's health status and preferences.

[0309] The system for implementing this invention operates in a network environment including users, terminals, and servers. Users use input devices such as smartphones and smart glasses to obtain and input health data. Sensors and dedicated applications installed on the devices are used for this. This data includes diet, exercise, sleep, heart rate, etc.

[0310] The terminal transmits this health data to the server in real time via a communication channel. The data during transmission is encrypted to protect privacy. The server integrates the received health data with an external information repository and comprehensively analyzes the user's health status. At this time, software such as Python and machine learning libraries (TensorFlow, PyTorch) is used for the analysis.

[0311] Using the generation AI model, the server generates the most suitable health improvement plan for each user. This improvement plan includes customized diet suggestions, exercise plans, and relaxation techniques. Then, appropriate content is selected and transmitted to the user's terminal. This content is individually adjusted based on the user's preferences and health information.

[0312] For example, if a user is determined to be inactive, an exercise video suitable for that user will be selected and provided. Furthermore, an example of a prompt message for the generating AI model could be: "The user sleeps less than 7 hours on average and exercises less than 2 hours per week. Please recommend a fitness video suitable for this user."

[0313] In this way, a system is configured in which the server and terminal cooperate to propose dynamic and appropriate health improvement measures to individual users and provide an environment in which they can be implemented.

[0314] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0315] Step 1:

[0316] Users input or automatically record health data using applications installed on their smartphones or smart glasses. Data such as diet, exercise, sleep, and heart rate are used as input. This data is temporarily stored on the device, and the sensor data is formatted as part of the data processing. The output is appropriately formatted health data.

[0317] Step 2:

[0318] The device transmits the collected health data to the server via a communication channel. The data is encrypted for security purposes during this process. The input is formatted health data, and the output is an encrypted data stream. Specifically, the HTTPS protocol is used to securely transmit the data to the server.

[0319] Step 3:

[0320] The server decrypts the received health data and integrates it with an external data repository. The input is an encrypted data stream, and the output is integrated data. Specifically, a database management system is used to integrate general information and user data from the external repository.

[0321] Step 4:

[0322] The server runs a generative AI model based on integrated data. The input is integrated data, and the output is a personalized health improvement plan. In this process, Python and machine learning libraries are used to perform data analysis and plan generation.

[0323] Step 5:

[0324] The generated health improvement plan is sent to the user's terminal by the server. The input is the health improvement plan, and the output is the content displayed on the user's terminal. This involves prompting the generating AI model. Specific examples include fitness videos and recipe videos.

[0325] Step 6:

[0326] Users review a health improvement plan provided through an application on their device and adjust their daily lives accordingly. The input is the health improvement plan, and the output is user feedback data. This feedback is entered on the device and used to update the plan in the next update.

[0327] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0328] As an embodiment of the present invention, a system is provided that combines and analyzes individual health data and emotional information to provide a health improvement program optimized for the user.

[0329] Users input or automatically record their daily health data (such as diet, exercise, and sleep) using smartphones or wearable devices. Furthermore, they can use applications equipped with an emotion engine function to record their emotions and moods for the day through voice input, text input, or facial expression emotion analysis.

[0330] The device encrypts this health and emotional data and transmits it to the server over the communication network. The encryption process is crucial to protect the confidentiality of the data.

[0331] The server stores the received data in a database and integrates it with an external information database. The database contains the latest health information, guidelines, and emotion-based influencing factors. For example, it considers the impact of specific emotions on dietary choices and exercise patterns.

[0332] The server activates a production mechanism that analyzes integrated health data and emotional information to generate a customized health improvement program based on the individual's condition and goals. This program includes dietary suggestions, exercise plans, and stress management methods tailored to the user's emotional state.

[0333] The generated programs are sent individually from the server to the user's terminal and displayed in an easy-to-understand format within the application. Users can then adjust and improve their lifestyle based on the provided programs.

[0334] For example, if a user tends to experience high levels of stress, the program will suggest foods that promote a comfortable mood, as well as exercises and meditation to help them relax. Furthermore, the emotion engine detects changes in the user's emotions and adjusts health-related advice in real time.

[0335] The device records user feedback and daily emotional changes and sends them to a server. This allows the server to adjust the program based on the feedback, providing more effective health improvement support. In this way, the program, which integrates emotional and health information, aims to continuously improve the user's overall health and well-being.

[0336] The following describes the processing flow.

[0337] Step 1:

[0338] Users input health data such as diet, exercise, and sleep using smartphones or wearable devices. They also utilize an emotion engine to record their emotions for the day through text input, voice input, or camera.

[0339] Step 2:

[0340] The device encrypts the collected health data and emotional information and transmits it to the server via the communication network. This transmission process uses state-of-the-art encryption technology to protect user privacy.

[0341] Step 3:

[0342] The server stores the received data in a database and integrates it with external information databases. This integration ensures that the latest health information and emotional state are reflected in individual health data, thus guaranteeing data consistency.

[0343] Step 4:

[0344] The server activates generation mechanisms to analyze health data and emotional information, and generates an optimized health improvement program based on the user's emotional and health status. This program includes dietary suggestions, exercise plans, and stress reduction methods tailored to the user's emotional state.

[0345] Step 5:

[0346] The server customizes the generated health improvement program for each user and sends it to their device. The program is visually represented within the app and provided in a format that users can easily understand and execute.

[0347] Step 6:

[0348] Users review the provided programs and implement them in their daily lives. For example, they might exercise to reduce stress, adjust their diet, and improve their health habits according to their emotional state.

[0349] Step 7:

[0350] In addition to continuously collecting health data, the device also records user feedback and emotional changes. This data is then sent back to the server.

[0351] Step 8:

[0352] The server analyzes user feedback and new emotional data, incorporating it into the next health improvement program. This program adjustment allows for a better balance between the user's health and emotions.

[0353] (Example 2)

[0354] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0355] Programs for improving individual health should take into account individual health conditions and emotional changes, rather than relying on general information. However, conventional systems lacked sufficient means to effectively collect, analyze, and reflect individual health and emotional data, making it difficult to provide optimized health programs. Furthermore, mechanisms for securely transmitting data in a properly encrypted form were not established.

[0356] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0357] In this invention, the server includes input means for collecting health status data and emotional information from a personal device, means for encrypting the collected health status data and emotional information and transmitting it via a communication network, and generation means using a generation model for generating a personalized health improvement program based on the integrated data. This makes it possible to securely generate and provide an optimized health improvement program based on the user's individual health status and emotions.

[0358] "Health status data" refers to information about an individual's physical activity and condition, such as diet, exercise, and sleep, and serves as an indicator of health in daily life.

[0359] "Emotional information" refers to information about an individual's emotions and mood, representing their mental state obtained through voice input, text input, and facial expression analysis.

[0360] "Input means" refers to devices or applications for collecting health status data and emotional information, which users can use to record information in digital format.

[0361] "Encryption" is a technology that protects the confidentiality of data by transforming it using a specific algorithm and preventing unauthorized access.

[0362] A "communication network" is the infrastructure used to transmit data from a terminal to a server, and includes digital communication technologies such as the internet and mobile networks.

[0363] "Transmission means" refers to the equipment or software used to transmit collected data to other components, and is responsible for managing the transmission and reception of data.

[0364] A "generative model" refers to an algorithm or artificial intelligence technology used to create health improvement programs, which analyzes input data to provide the optimal output.

[0365] "Generative means" refer to processes and technologies for creating new value based on data, and are particularly used to build health improvement programs.

[0366] A "health improvement program" is a set of action plans proposed to improve an individual's health, and includes elements of diet, exercise, and stress management.

[0367] This invention is a system that collects individual health status and emotional information and provides an optimized health improvement program based on this information. Specifically, it uses an input device, a terminal, and a server to collect, transmit, and analyze data.

[0368] Users collect health and emotional data using smartphones and wearable devices. These devices include, for example, fitness trackers that monitor heart rate and smartphone applications that can take photos of meals. Emotional information is captured through voice input, text input, or software that analyzes facial expressions.

[0369] The terminal temporarily stores the data entered by the user and encrypts it using encryption technologies such as AES. The encrypted data is then transmitted to the server via a communication network such as the internet. This process ensures that the data is transmitted securely and protected from unauthorized access.

[0370] The server decodes the received data and stores it in its database. Furthermore, it acquires the latest data from external health sources and integrates it with its own database. This includes the latest dietary guidelines and exercise programs, which are then used in conjunction with individual user data. The server analyzes the integrated data using a generative AI model to generate health improvement programs based on the user's individual health status. For example, a prompt such as "30-year-old female, high stress, insufficient exercise" might be input into the AI ​​model. As a result, the user would be provided with dietary and exercise suggestions to reduce stress.

[0371] The generated health improvement program is sent from the server to each user's terminal and displayed on the application in a visually easy-to-understand format. Users can adjust their daily routines according to the provided program and discover improvements. For example, if a user is experiencing high levels of stress, the system may suggest foods and exercises that promote relaxation.

[0372] This system allows users to receive more personalized guidance tailored to their health condition and emotions, thereby contributing to improved health and well-being.

[0373] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0374] Step 1:

[0375] Users input or automatically record health data and emotional information using smartphones or wearable devices. The primary inputs at this stage are diet, exercise, sleep data, and emotional information. This includes exercise data obtained from device sensors, diet information from image analysis, or emotional text or voice input using an emotion engine. The output is the accumulation of this input data.

[0376] Step 2:

[0377] The device aggregates the collected data into a single dataset and encrypts it using encryption algorithms such as AES. The input for this encryption is health data and emotional information provided by the user, and the output is an encrypted data file. Specifically, the device ensures the data is securely encrypted and prepared for transmission.

[0378] Step 3:

[0379] Encrypted data is sent from the terminal, and the server receives and decrypts it. The input is encrypted data received via a secure communication channel, and the output is decrypted, accurate health and emotional data. Specifically, the integrity of the received data is checked, and once successfully decrypted, it is prepared for the next integration step.

[0380] Step 4:

[0381] The server stores the decoded data in its own database and further integrates it with external information databases. The input consists of the decoded data and the latest external health information, and the output is a new, integrated database. Specifically, the server performs data matching and updates, laying the groundwork for analysis based on individual health conditions.

[0382] Step 5:

[0383] The server generates personalized health improvement programs using a generative AI model based on integrated data. The input to this generation process is integrated data, and by using appropriate prompt statements, the output is a health improvement program optimized for each individual user. For example, information such as "30-year-old female, high stress, insufficient exercise time" is input to the model in the prompt statement, and the generation result is obtained.

[0384] Step 6:

[0385] The server sends the generated program to the user's terminal, which displays it visually in the application. The input is the generated program data, and the output is the program content presented to the user. Specifically, the server arranges the program layout and presents it in a format that is easy for the user to understand.

[0386] Step 7:

[0387] Users try the provided program and re-enter feedback on the results and daily emotional changes into the app. The input consists of user feedback and daily data changes, while the output is this feedback information. Specifically, users are required to update their daily logs and accumulate foundational data for long-term health improvement.

[0388] (Application Example 2)

[0389] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0390] In modern living environments, people are required to maintain their health and manage their emotions, but there is a lack of effective means to comprehensively improve both individual health conditions and emotions. In particular, the lack of appropriate advice and product recommendations at the local level hinders health improvement. Therefore, there is a need for the development of a reliable system that provides users with real-time, customized health improvement programs.

[0391] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0392] In this invention, the server includes information acquisition means for acquiring health data, input means for acquiring emotional information, and means for transferring the acquired health data and emotional information via a communication network. This makes it possible to generate individually customized health improvement plans for users and support their health improvement in real time through product selection and service use within stores.

[0393] "Health data" refers to information about an individual user's habits, such as diet, exercise, and sleep.

[0394] "Emotional information" refers to information about a user's daily emotions and moods, obtained through voice input, text input, or facial expression analysis.

[0395] "Information acquisition means" refers to the hardware or software system used to acquire health data from users.

[0396] "Input means" refers to a device or application used to obtain emotional information from a user.

[0397] A "communication network" refers to the network infrastructure used to transfer data from a terminal to a server.

[0398] "Transfer method" refers to a system that has the function of transmitting acquired health data and emotional information to a server via a communication network.

[0399] An "external information storage device" refers to a database that stores the latest guidelines and information related to health.

[0400] "Generation means" refers to a program or system that performs processing to create an optimal health improvement plan for the user based on health data and emotional information.

[0401] "Means of delivery" refers to a mechanism for displaying or notifying users of the generated health improvement plan.

[0402] "Presentation methods" refer to systems and devices that support the communication of product and service information within a store to users.

[0403] To implement the invention, the following system configuration is conceivable: The user uses a smartphone or smart glasses to input health data and emotional information. This device has an application installed for collecting health data, which automatically or manually records information such as diet, exercise, and sleep. Emotional information is acquired using voice input, text input, or a facial expression emotion analysis function.

[0404] The acquired health data and emotional information are encrypted on the device and then transmitted to the server via the communication network. A secure protocol is used for this communication. The server integrates the received data with an external data storage device and generates a customized health improvement plan based on the health data and emotional information. This plan includes stress management, diet, and exercise recommendations.

[0405] The generated plan is provided to the user's device and notified visually or audibly. In-store, users can use their device to scan QR codes within the store to obtain product and service information and link it to their health improvement plan. For example, when a user purchases a relaxing herbal tea or a supplement containing specific vitamins, the system can suggest the most suitable products.

[0406] Furthermore, user feedback is continuously collected and sent to the server, contributing to improving the accuracy of health improvement plans. The generative AI model responds to changes in emotional information in real time and makes suggestions for health improvements.

[0407] An example of a prompt message might be, "I'm under a lot of stress. What foods would you recommend?" This allows the system to provide specific, personalized advice in real time.

[0408] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0409] Step 1:

[0410] Users input health data and emotional information using their devices. Health data includes information such as diet, exercise, and sleep, while emotional information is obtained through voice input, text input, or facial expression analysis. The input data is converted to a standard format by the application.

[0411] Step 2:

[0412] The device encrypts the acquired health and emotional information and transmits it to the server via the communication network. Encryption is performed to protect the confidentiality of the data, and the data is sent to the network only after the recipient has been verified by the communication protocol.

[0413] Step 3:

[0414] The server stores the received data in a database and integrates it with information from external storage devices. The database contains the latest health information and historical sentiment data trends, and the data is efficiently integrated using SQL queries.

[0415] Step 4:

[0416] The server applies a generative AI model using integrated health data and emotional information to create an optimal health improvement plan for the user. Through data analysis, the generative AI model determines personalized dietary suggestions and stress management methods for each user.

[0417] Step 5:

[0418] The server sends the generated health improvement plan to the user's device. The plan is communicated to the user visually or audibly, prompting them to take appropriate action. Specific product information is also displayed in conjunction with the in-store system.

[0419] Step 6:

[0420] Users select products in the store and enter feedback via a terminal. This feedback is used by the system to improve the accuracy of health improvement plans.

[0421] Step 7:

[0422] The server accumulates new feedback data and integrates it into subsequent health improvement plans. This allows the program to continuously optimize user health management. Natural language processing techniques are used to analyze the feedback.

[0423] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0424] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0425] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0426] [Third Embodiment]

[0427] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0428] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0429] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0430] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0431] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0432] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0433] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0434] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0435] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0436] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0437] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0438] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0439] As an embodiment of the present invention, a system is provided that collects individual health data and provides a health improvement program optimized for the user.

[0440] First, users input or automatically record health data such as diet, exercise, sleep, and heart rate using their smartphones or wearable devices. This data is then aggregated through an application on the smartphone.

[0441] Next, the device transmits encrypted health data to the server via the communication network. This communication is conducted with security in mind and with a strong emphasis on protecting privacy.

[0442] The server integrates the received health data into an existing external information database, creating data that reflects the latest health information and guidelines. This database includes general information on dietary balance, fitness programs, and stress management techniques.

[0443] Furthermore, the server uses integrated data to activate a generation mechanism and create a customized health improvement program tailored to the user's current situation and goals. This program provides specific details such as meal suggestions, exercise plans, and relaxation techniques.

[0444] The server then sends the generated program to each user's smartphone and displays it in a user-friendly format within the application. Users can use this information to adjust their daily activities and work towards improving their health.

[0445] To measure the program's effectiveness, the terminal continuously collects user data and receives user feedback. The server uses this feedback to update the program and provide more effective health improvement measures. This feedback loop makes it possible to continuously support the user's health and well-being.

[0446] For example, if a user wants to lose weight, the program analyzes their current eating patterns and activity level and provides meal suggestions to appropriately reduce calorie intake while maintaining nutritional balance. It also suggests specific exercises to promote efficient fat burning and introduces relaxation techniques to reduce stress. In this way, users are supported in effectively working towards their individual health goals.

[0447] The following describes the processing flow.

[0448] Step 1:

[0449] Users can input health data such as diet, exercise, sleep, and heart rate using their smartphones or wearable devices, or have this data automatically recorded by sensors built into the devices. This allows for the collection of everyday health information.

[0450] Step 2:

[0451] The device encrypts the collected health data at regular intervals and transmits it to the server via the communication network. This encryption process ensures data security and protects privacy.

[0452] Step 3:

[0453] The server stores the received health data in a database and integrates it with external information databases. Here, it incorporates the latest health guidelines, nutrition information, and fitness data to ensure data integrity.

[0454] Step 4:

[0455] The server activates a generation mechanism to analyze the integrated data and generates a customized health improvement program based on the user's health status and goals. This program includes specific meal suggestions, exercise plans, and relaxation methods.

[0456] Step 5:

[0457] The server sends the generated health improvement programs to each user's terminal individually. The programs are formatted in a user-friendly format and notified to the user through the application.

[0458] Step 6:

[0459] Users review the programs provided through their devices and implement them in their daily lives. This includes reviewing their diet and practicing recommended exercises.

[0460] Step 7:

[0461] The device collects user feedback and post-implementation health data again and sends it to the server. This feedback is used to evaluate the program's effectiveness and make necessary adjustments.

[0462] Step 8:

[0463] The server analyzes user feedback and newly collected data, incorporating it into the next health improvement program. This allows the program to continuously evolve and support users' health and well-being.

[0464] (Example 1)

[0465] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0466] In today's world, where the need for health management is increasing, providing personalized health improvement measures is crucial. Traditional systems have struggled to deliver individualized health improvement programs quickly and effectively, and have also faced difficulties in continuously improving them based on user feedback.

[0467] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0468] In this invention, the server includes data input means at a terminal for collecting personal health information, means for encrypting the collected information and transmitting it over a communication network, and means for receiving the transmitted information and integrating it with an external knowledge base. This enables the rapid provision of personalized health improvement programs and continuous improvement that reflects user feedback.

[0469] "Information about an individual's health" refers to data that indicates an individual's health status related to their daily life, such as diet, exercise, sleep, and heart rate.

[0470] "Data input means on a terminal" refers to interfaces or functions on smartphones and wearable devices for manually or automatically inputting health-related data.

[0471] A "communication network" is an infrastructure for electronically sending and receiving data, and is a network that can use encryption technology to ensure privacy and security.

[0472] A "server" is a computing system that receives, processes, and analyzes health data from users, and is a device that has the functionality to perform integrated processing with external databases.

[0473] An "external knowledge base" is a database containing general health information and guidelines, and is an information system that is regularly updated to reflect the latest health information.

[0474] A "generative AI model" is an artificial intelligence technology used to analyze a user's health data and automatically generate personalized health improvement programs.

[0475] "Continuous tracking" refers to a function that continuously collects user health status and feedback and incorporates it into health improvement programs.

[0476] This invention relates to a system that collects user health data and provides individually customized health improvement programs. The system's main components are a terminal, a server, and a generative AI model.

[0477] First, the terminal is a smartphone or wearable device, and users input health information through these devices. Specifically, the terminal collects health data such as diet, exercise, sleep, and heart rate, and a dedicated application has the function of organizing and aggregating this data. In terms of hardware, a typical smartphone and a compatible wearable device are used.

[0478] Next, the device encrypts the collected health data in real time and sends it to the server via the communication network. Secure technologies such as the SSL / TLS protocol are used for this communication.

[0479] The server integrates received health data with an external knowledge base and performs analysis that reflects the latest health information. The integrated data is then analyzed in detail by a generative AI model to generate a customized health improvement program tailored to the user's health condition. This generative AI model is updated to optimize the program's effectiveness by taking into account continuous feedback from the user.

[0480] As a concrete example, suppose a user wants to lose weight. The system analyzes the user's current diet and exercise level, and uses an AI model to generate and provide meal suggestions that maintain nutritional balance while reducing calories, as well as an exercise plan aimed at burning fat.

[0481] An example of a prompt for a generative AI model might be: "Please suggest a health improvement program. The user wants to lose weight, and their current eating patterns and exercise level are as follows..."

[0482] This system allows users to easily check personalized health maintenance strategies on their smartphones and incorporate them into their daily lives.

[0483] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0484] Step 1:

[0485] Users input or record health data using smartphones or wearable devices. Input data includes photos of meals, exercise time, sleep duration, and heart rate. This data is instantly compiled by a dedicated application. Specifically, users can manually enter data into input forms within the app, or data is automatically collected and synchronized from the device. The compiled health data is temporarily stored on the device as output.

[0486] Step 2:

[0487] The terminal encrypts the aggregated health data and sends it to the server via the communication network. The input is the aggregated data stored on the terminal, and the output is the encrypted transmitted data. Specifically, the terminal encrypts the data using the SSL / TLS protocol and securely sends it to the server.

[0488] Step 3:

[0489] The server processes the received data and integrates it with an external knowledge base. The input is encrypted health data, and the external knowledge base includes the latest health guidelines and nutritional information. This data is integrated and output as an analyzable dataset. Specifically, the process involves data cleansing and standardization to create the dataset for analysis.

[0490] Step 4:

[0491] The server uses a generative AI model to analyze health data and generate individually customized health improvement programs. The input consists of an integrated dataset and the generative AI model. The AI ​​analyzes the data and generates a program optimized for the user as output. Specifically, it performs algorithmic data analysis and proposes concrete improvement measures such as meal plans and exercise schedules.

[0492] Step 5:

[0493] The server sends the generated health improvement program to the user's device and displays it in a format that the user can review within a dedicated application. The input is a program generated by AI, and the output is data sent to the smartphone. Specifically, it utilizes a notification system to present the program to the user as a daily schedule.

[0494] Step 6:

[0495] The device continuously collects user feedback and additional health data and sends it to the server. Inputs include user feedback and new health data, while output is encrypted transmission data based on this input. Specifically, the app has a function that asks for user feedback in the form of a survey, and this data is periodically sent to the server.

[0496] Step 7:

[0497] The server analyzes the collected feedback and updates the health improvement program as needed. This allows for more effective suggestions for the user. Inputs include user feedback data and current program information, while output is the updated health program. Specifically, the program is re-evaluated and adjusted based on the feedback analysis.

[0498] (Application Example 1)

[0499] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0500] In modern times, maintaining and improving individual health is a crucial issue for many people, but general health programs are often uniform and do not meet individual needs. Furthermore, there is a lack of an environment where appropriate health information and proposed programs can be immediately implemented. Therefore, there is a need for a system that delivers personalized health improvement strategies and related information.

[0501] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0502] In this invention, the server includes an input device means for collecting health data, a device means for receiving transmitted health data and integrating it with an external information storage, and a device means for generating and associating personalized content using a generative AI model. This enables the timely delivery of customized health improvement plans and content to individual users, and facilitates the formation of healthy lifestyle habits based on them.

[0503] "Health data" refers to information about individual users, such as their diet, exercise, sleep, and heart rate, and is used to analyze their health status and develop improvement plans.

[0504] An "input device" is a device used by a user to input or automatically record health data, and examples include smartphones and wearable devices.

[0505] A "communication channel" refers to a network used to securely transmit data, and includes the internet and mobile networks.

[0506] An "external information repository" refers to a database where general health-related information is stored, including health guidelines, dietary information, and exercise program information.

[0507] A "generation device" refers to a processor or software that generates individualized health improvement plans for users based on integrated health data.

[0508] A "transmission device" refers to a system for distributing generated health improvement programs to individual users, and a smartphone application falls under this category.

[0509] A "generative AI model" refers to an algorithm that uses artificial intelligence to analyze health-related data and generate individually optimized content.

[0510] "Personalized content" refers to information, programs, and suggestions that are individually tailored based on each user's health status and preferences.

[0511] The system for carrying out this invention operates in a network environment including users, terminals, and servers. Users acquire and input health data using input devices such as smartphones or smart glasses. This utilizes sensors and dedicated applications built into the devices. This data includes information on diet, exercise, sleep, heart rate, etc.

[0512] The device transmits this health data to the server in real time via a communication channel. The data is encrypted during transmission to protect privacy. The server integrates the received health data with an external data storage system and comprehensively analyzes the user's health status. Software such as Python and machine learning libraries (TensorFlow, PyTorch) are used for this analysis.

[0513] Using a generative AI model, the server generates a personalized health improvement plan for each user. This plan includes customized meal suggestions, exercise plans, and relaxation techniques. Appropriate content is then selected and sent to the user's device. This content is individually tailored based on the user's preferences and health information.

[0514] For example, if a user is determined to be inactive, an exercise video suitable for that user will be selected and provided. Furthermore, an example of a prompt message for the generating AI model could be: "The user sleeps less than 7 hours on average and exercises less than 2 hours per week. Please recommend a fitness video suitable for this user."

[0515] In this way, a system is configured in which the server and terminal cooperate to propose dynamic and appropriate health improvement measures to individual users and provide an environment in which they can be implemented.

[0516] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0517] Step 1:

[0518] Users input or automatically record health data using applications installed on their smartphones or smart glasses. Data such as diet, exercise, sleep, and heart rate are used as input. This data is temporarily stored on the device, and the sensor data is formatted as part of the data processing. The output is appropriately formatted health data.

[0519] Step 2:

[0520] The device transmits the collected health data to the server via a communication channel. The data is encrypted for security purposes during this process. The input is formatted health data, and the output is an encrypted data stream. Specifically, the HTTPS protocol is used to securely transmit the data to the server.

[0521] Step 3:

[0522] The server decrypts the received health data and integrates it with an external data repository. The input is an encrypted data stream, and the output is integrated data. Specifically, a database management system is used to integrate general information and user data from the external repository.

[0523] Step 4:

[0524] The server runs a generative AI model based on integrated data. The input is integrated data, and the output is a personalized health improvement plan. In this process, Python and machine learning libraries are used to perform data analysis and plan generation.

[0525] Step 5:

[0526] The generated health improvement plan is sent to the user's terminal by the server. The input is the health improvement plan, and the output is the content displayed on the user's terminal. This involves prompting the generating AI model. Specific examples include fitness videos and recipe videos.

[0527] Step 6:

[0528] Users review a health improvement plan provided through an application on their device and adjust their daily lives accordingly. The input is the health improvement plan, and the output is user feedback data. This feedback is entered on the device and used to update the plan in the next update.

[0529] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0530] As an embodiment of the present invention, a system is provided that combines and analyzes individual health data and emotional information to provide a health improvement program optimized for the user.

[0531] Users input or automatically record their daily health data (such as diet, exercise, and sleep) using smartphones or wearable devices. Furthermore, they can use applications equipped with an emotion engine function to record their emotions and moods for the day through voice input, text input, or facial expression emotion analysis.

[0532] The device encrypts this health and emotional data and transmits it to the server over the communication network. The encryption process is crucial to protect the confidentiality of the data.

[0533] The server stores the received data in a database and integrates it with an external information database. The database contains the latest health information, guidelines, and emotion-based influencing factors. For example, it considers the impact of specific emotions on dietary choices and exercise patterns.

[0534] The server activates a production mechanism that analyzes integrated health data and emotional information to generate a customized health improvement program based on the individual's condition and goals. This program includes dietary suggestions, exercise plans, and stress management methods tailored to the user's emotional state.

[0535] The generated programs are sent individually from the server to the user's terminal and displayed in an easy-to-understand format within the application. Users can then adjust and improve their lifestyle based on the provided programs.

[0536] For example, if a user tends to experience high levels of stress, the program will suggest foods that promote a comfortable mood, as well as exercises and meditation to help them relax. Furthermore, the emotion engine detects changes in the user's emotions and adjusts health-related advice in real time.

[0537] The device records user feedback and daily emotional changes and sends them to a server. This allows the server to adjust the program based on the feedback, providing more effective health improvement support. In this way, the program, which integrates emotional and health information, aims to continuously improve the user's overall health and well-being.

[0538] The following describes the processing flow.

[0539] Step 1:

[0540] Users input health data such as diet, exercise, and sleep using smartphones or wearable devices. They also utilize an emotion engine to record their emotions for the day through text input, voice input, or camera.

[0541] Step 2:

[0542] The device encrypts the collected health data and emotional information and transmits it to the server via the communication network. This transmission process uses state-of-the-art encryption technology to protect user privacy.

[0543] Step 3:

[0544] The server stores the received data in a database and integrates it with external information databases. This integration ensures that the latest health information and emotional state are reflected in individual health data, thus guaranteeing data consistency.

[0545] Step 4:

[0546] The server activates generation mechanisms to analyze health data and emotional information, and generates an optimized health improvement program based on the user's emotional and health status. This program includes dietary suggestions, exercise plans, and stress reduction methods tailored to the user's emotional state.

[0547] Step 5:

[0548] The server customizes the generated health improvement program for each user and sends it to their device. The program is visually represented within the app and provided in a format that users can easily understand and execute.

[0549] Step 6:

[0550] Users review the provided programs and implement them in their daily lives. For example, they might exercise to reduce stress, adjust their diet, and improve their health habits according to their emotional state.

[0551] Step 7:

[0552] In addition to continuously collecting health data, the device also records user feedback and emotional changes. This data is then sent back to the server.

[0553] Step 8:

[0554] The server analyzes user feedback and new emotional data, incorporating it into the next health improvement program. This program adjustment allows for a better balance between the user's health and emotions.

[0555] (Example 2)

[0556] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0557] Programs for improving individual health should take into account individual health conditions and emotional changes, rather than relying on general information. However, conventional systems lacked sufficient means to effectively collect, analyze, and reflect individual health and emotional data, making it difficult to provide optimized health programs. Furthermore, mechanisms for securely transmitting data in a properly encrypted form were not established.

[0558] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0559] In this invention, the server includes input means for collecting health status data and emotional information from a personal device, means for encrypting the collected health status data and emotional information and transmitting it via a communication network, and generation means using a generation model for generating a personalized health improvement program based on the integrated data. This makes it possible to securely generate and provide an optimized health improvement program based on the user's individual health status and emotions.

[0560] "Health status data" refers to information about an individual's physical activity and condition, such as diet, exercise, and sleep, and serves as an indicator of health in daily life.

[0561] "Emotional information" refers to information about an individual's emotions and mood, representing their mental state obtained through voice input, text input, and facial expression analysis.

[0562] "Input means" refers to devices or applications for collecting health status data and emotional information, which users can use to record information in digital format.

[0563] "Encryption" is a technology that protects the confidentiality of data by transforming it using a specific algorithm and preventing unauthorized access.

[0564] A "communication network" is the infrastructure used to transmit data from a terminal to a server, and includes digital communication technologies such as the internet and mobile networks.

[0565] "Transmission means" refers to the equipment or software used to transmit collected data to other components, and is responsible for managing the transmission and reception of data.

[0566] A "generative model" refers to an algorithm or artificial intelligence technology used to create health improvement programs, which analyzes input data to provide the optimal output.

[0567] "Generative means" refer to processes and technologies for creating new value based on data, and are particularly used to build health improvement programs.

[0568] A "health improvement program" is a set of action plans proposed to improve an individual's health, and includes elements of diet, exercise, and stress management.

[0569] This invention is a system that collects individual health status and emotional information and provides an optimized health improvement program based on this information. Specifically, it uses an input device, a terminal, and a server to collect, transmit, and analyze data.

[0570] Users collect health and emotional data using smartphones and wearable devices. These devices include, for example, fitness trackers that monitor heart rate and smartphone applications that can take photos of meals. Emotional information is captured through voice input, text input, or software that analyzes facial expressions.

[0571] The terminal temporarily stores the data entered by the user and encrypts it using encryption technologies such as AES. The encrypted data is then transmitted to the server via a communication network such as the internet. This process ensures that the data is transmitted securely and protected from unauthorized access.

[0572] The server decodes the received data and stores it in its database. Furthermore, it acquires the latest data from external health sources and integrates it with its own database. This includes the latest dietary guidelines and exercise programs, which are then used in conjunction with individual user data. The server analyzes the integrated data using a generative AI model to generate health improvement programs based on the user's individual health status. For example, a prompt such as "30-year-old female, high stress, insufficient exercise" might be input into the AI ​​model. As a result, the user would be provided with dietary and exercise suggestions to reduce stress.

[0573] The generated health improvement program is sent from the server to each user's terminal and displayed on the application in a visually easy-to-understand format. Users can adjust their daily routines according to the provided program and discover improvements. For example, if a user is experiencing high levels of stress, the system may suggest foods and exercises that promote relaxation.

[0574] This system allows users to receive more personalized guidance tailored to their health condition and emotions, thereby contributing to improved health and well-being.

[0575] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0576] Step 1:

[0577] Users input or automatically record health data and emotional information using smartphones or wearable devices. The primary inputs at this stage are diet, exercise, sleep data, and emotional information. This includes exercise data obtained from device sensors, diet information from image analysis, or emotional text or voice input using an emotion engine. The output is the accumulation of this input data.

[0578] Step 2:

[0579] The device aggregates the collected data into a single dataset and encrypts it using encryption algorithms such as AES. The input for this encryption is health data and emotional information provided by the user, and the output is an encrypted data file. Specifically, the device ensures the data is securely encrypted and prepared for transmission.

[0580] Step 3:

[0581] Encrypted data is sent from the terminal, and the server receives and decrypts it. The input is encrypted data received via a secure communication channel, and the output is decrypted, accurate health and emotional data. Specifically, the integrity of the received data is checked, and once successfully decrypted, it is prepared for the next integration step.

[0582] Step 4:

[0583] The server stores the decoded data in its own database and further integrates it with external information databases. The input consists of the decoded data and the latest external health information, and the output is a new, integrated database. Specifically, the server performs data matching and updates, laying the groundwork for analysis based on individual health conditions.

[0584] Step 5:

[0585] The server generates personalized health improvement programs using a generative AI model based on integrated data. The input to this generation process is integrated data, and by using appropriate prompt statements, the output is a health improvement program optimized for each individual user. For example, information such as "30-year-old female, high stress, insufficient exercise time" is input to the model in the prompt statement, and the generation result is obtained.

[0586] Step 6:

[0587] The server sends the generated program to the user's terminal, which displays it visually in the application. The input is the generated program data, and the output is the program content presented to the user. Specifically, the server arranges the program layout and presents it in a format that is easy for the user to understand.

[0588] Step 7:

[0589] Users try the provided program and re-enter feedback on the results and daily emotional changes into the app. The input consists of user feedback and daily data changes, while the output is this feedback information. Specifically, users are required to update their daily logs and accumulate foundational data for long-term health improvement.

[0590] (Application Example 2)

[0591] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0592] In modern living environments, people are required to maintain their health and manage their emotions, but there is a lack of effective means to comprehensively improve both individual health conditions and emotions. In particular, the lack of appropriate advice and product recommendations at the local level hinders health improvement. Therefore, there is a need for the development of a reliable system that provides users with real-time, customized health improvement programs.

[0593] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0594] In this invention, the server includes information acquisition means for acquiring health data, input means for acquiring emotional information, and means for transferring the acquired health data and emotional information via a communication network. This makes it possible to generate individually customized health improvement plans for users and support their health improvement in real time through product selection and service use within stores.

[0595] "Health data" refers to information about an individual user's habits, such as diet, exercise, and sleep.

[0596] "Emotional information" refers to information about a user's daily emotions and moods, obtained through voice input, text input, or facial expression analysis.

[0597] "Information acquisition means" refers to the hardware or software system used to acquire health data from users.

[0598] "Input means" refers to a device or application used to obtain emotional information from a user.

[0599] A "communication network" refers to the network infrastructure used to transfer data from a terminal to a server.

[0600] "Transfer method" refers to a system that has the function of transmitting acquired health data and emotional information to a server via a communication network.

[0601] An "external information storage device" refers to a database that stores the latest guidelines and information related to health.

[0602] "Generation means" refers to a program or system that performs processing to create an optimal health improvement plan for the user based on health data and emotional information.

[0603] "Means of delivery" refers to a mechanism for displaying or notifying users of the generated health improvement plan.

[0604] "Presentation methods" refer to systems and devices that support the communication of product and service information within a store to users.

[0605] To implement the invention, the following system configuration is conceivable: The user uses a smartphone or smart glasses to input health data and emotional information. This device has an application installed for collecting health data, which automatically or manually records information such as diet, exercise, and sleep. Emotional information is acquired using voice input, text input, or a facial expression emotion analysis function.

[0606] The acquired health data and emotional information are encrypted on the device and then transmitted to the server via the communication network. A secure protocol is used for this communication. The server integrates the received data with an external data storage device and generates a customized health improvement plan based on the health data and emotional information. This plan includes stress management, diet, and exercise recommendations.

[0607] The generated plan is provided to the user's device and notified visually or audibly. In-store, users can use their device to scan QR codes within the store to obtain product and service information and link it to their health improvement plan. For example, when a user purchases a relaxing herbal tea or a supplement containing specific vitamins, the system can suggest the most suitable products.

[0608] Furthermore, user feedback is continuously collected and sent to the server, contributing to improving the accuracy of health improvement plans. The generative AI model responds to changes in emotional information in real time and makes suggestions for health improvements.

[0609] An example of a prompt message might be, "I'm under a lot of stress. What foods would you recommend?" This allows the system to provide specific, personalized advice in real time.

[0610] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0611] Step 1:

[0612] Users input health data and emotional information using their devices. Health data includes information such as diet, exercise, and sleep, while emotional information is obtained through voice input, text input, or facial expression analysis. The input data is converted to a standard format by the application.

[0613] Step 2:

[0614] The device encrypts the acquired health and emotional information and transmits it to the server via the communication network. Encryption is performed to protect the confidentiality of the data, and the data is sent to the network only after the recipient has been verified by the communication protocol.

[0615] Step 3:

[0616] The server stores the received data in a database and integrates it with information from external storage devices. The database contains the latest health information and historical sentiment data trends, and the data is efficiently integrated using SQL queries.

[0617] Step 4:

[0618] The server applies a generative AI model using integrated health data and emotional information to create an optimal health improvement plan for the user. Through data analysis, the generative AI model determines personalized dietary suggestions and stress management methods for each user.

[0619] Step 5:

[0620] The server sends the generated health improvement plan to the user's device. The plan is communicated to the user visually or audibly, prompting them to take appropriate action. Specific product information is also displayed in conjunction with the in-store system.

[0621] Step 6:

[0622] Users select products in the store and enter feedback via a terminal. This feedback is used by the system to improve the accuracy of health improvement plans.

[0623] Step 7:

[0624] The server accumulates new feedback data and integrates it into subsequent health improvement plans. This allows the program to continuously optimize user health management. Natural language processing techniques are used to analyze the feedback.

[0625] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0626] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0627] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0628] [Fourth Embodiment]

[0629] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0630] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0631] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0632] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0633] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0634] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0635] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0636] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0637] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0638] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0639] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0640] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0641] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0642] As an embodiment of the present invention, a system is provided that collects individual health data and provides a health improvement program optimized for the user.

[0643] First, users input or automatically record health data such as diet, exercise, sleep, and heart rate using their smartphones or wearable devices. This data is then aggregated through an application on the smartphone.

[0644] Next, the device transmits encrypted health data to the server via the communication network. This communication is conducted with security in mind and with a strong emphasis on protecting privacy.

[0645] The server integrates the received health data into an existing external information database, creating data that reflects the latest health information and guidelines. This database includes general information on dietary balance, fitness programs, and stress management techniques.

[0646] Furthermore, the server uses integrated data to activate a generation mechanism and create a customized health improvement program tailored to the user's current situation and goals. This program provides specific details such as meal suggestions, exercise plans, and relaxation techniques.

[0647] The server then sends the generated program to each user's smartphone and displays it in a user-friendly format within the application. Users can use this information to adjust their daily activities and work towards improving their health.

[0648] To measure the program's effectiveness, the terminal continuously collects user data and receives user feedback. The server uses this feedback to update the program and provide more effective health improvement measures. This feedback loop makes it possible to continuously support the user's health and well-being.

[0649] For example, if a user wants to lose weight, the program analyzes their current eating patterns and activity level and provides meal suggestions to appropriately reduce calorie intake while maintaining nutritional balance. It also suggests specific exercises to promote efficient fat burning and introduces relaxation techniques to reduce stress. In this way, users are supported in effectively working towards their individual health goals.

[0650] The following describes the processing flow.

[0651] Step 1:

[0652] Users can input health data such as diet, exercise, sleep, and heart rate using their smartphones or wearable devices, or have this data automatically recorded by sensors built into the devices. This allows for the collection of everyday health information.

[0653] Step 2:

[0654] The device encrypts the collected health data at regular intervals and transmits it to the server via the communication network. This encryption process ensures data security and protects privacy.

[0655] Step 3:

[0656] The server stores the received health data in a database and integrates it with external information databases. Here, it incorporates the latest health guidelines, nutrition information, and fitness data to ensure data integrity.

[0657] Step 4:

[0658] The server activates a generation mechanism to analyze the integrated data and generates a customized health improvement program based on the user's health status and goals. This program includes specific meal suggestions, exercise plans, and relaxation methods.

[0659] Step 5:

[0660] The server sends the generated health improvement programs to each user's terminal individually. The programs are formatted in a user-friendly format and notified to the user through the application.

[0661] Step 6:

[0662] Users review the programs provided through their devices and implement them in their daily lives. This includes reviewing their diet and practicing recommended exercises.

[0663] Step 7:

[0664] The device collects user feedback and post-implementation health data again and sends it to the server. This feedback is used to evaluate the program's effectiveness and make necessary adjustments.

[0665] Step 8:

[0666] The server analyzes user feedback and newly collected data, incorporating it into the next health improvement program. This allows the program to continuously evolve and support users' health and well-being.

[0667] (Example 1)

[0668] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0669] In today's world, where the need for health management is increasing, providing personalized health improvement measures is crucial. Traditional systems have struggled to deliver individualized health improvement programs quickly and effectively, and have also faced difficulties in continuously improving them based on user feedback.

[0670] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0671] In this invention, the server includes data input means at a terminal for collecting personal health information, means for encrypting the collected information and transmitting it over a communication network, and means for receiving the transmitted information and integrating it with an external knowledge base. This enables the rapid provision of personalized health improvement programs and continuous improvement that reflects user feedback.

[0672] "Information about an individual's health" refers to data that indicates an individual's health status related to their daily life, such as diet, exercise, sleep, and heart rate.

[0673] "Data input means on a terminal" refers to interfaces or functions on smartphones and wearable devices for manually or automatically inputting health-related data.

[0674] A "communication network" is an infrastructure for electronically sending and receiving data, and is a network that can use encryption technology to ensure privacy and security.

[0675] A "server" is a computing system that receives, processes, and analyzes health data from users, and is a device that has the functionality to perform integrated processing with external databases.

[0676] An "external knowledge base" is a database containing general health information and guidelines, and is an information system that is regularly updated to reflect the latest health information.

[0677] A "generative AI model" is an artificial intelligence technology used to analyze a user's health data and automatically generate personalized health improvement programs.

[0678] "Continuous tracking" refers to a function that continuously collects user health status and feedback and incorporates it into health improvement programs.

[0679] This invention relates to a system that collects user health data and provides individually customized health improvement programs. The system's main components are a terminal, a server, and a generative AI model.

[0680] First, the terminal is a smartphone or wearable device, and users input health information through these devices. Specifically, the terminal collects health data such as diet, exercise, sleep, and heart rate, and a dedicated application has the function of organizing and aggregating this data. In terms of hardware, a typical smartphone and a compatible wearable device are used.

[0681] Next, the device encrypts the collected health data in real time and sends it to the server via the communication network. Secure technologies such as the SSL / TLS protocol are used for this communication.

[0682] The server integrates received health data with an external knowledge base and performs analysis that reflects the latest health information. The integrated data is then analyzed in detail by a generative AI model to generate a customized health improvement program tailored to the user's health condition. This generative AI model is updated to optimize the program's effectiveness by taking into account continuous feedback from the user.

[0683] As a concrete example, suppose a user wants to lose weight. The system analyzes the user's current diet and exercise level, and uses an AI model to generate and provide meal suggestions that maintain nutritional balance while reducing calories, as well as an exercise plan aimed at burning fat.

[0684] An example of a prompt for a generative AI model might be: "Please suggest a health improvement program. The user wants to lose weight, and their current eating patterns and exercise level are as follows..."

[0685] This system allows users to easily check personalized health maintenance strategies on their smartphones and incorporate them into their daily lives.

[0686] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0687] Step 1:

[0688] Users input or record health data using smartphones or wearable devices. Input data includes photos of meals, exercise time, sleep duration, and heart rate. This data is instantly compiled by a dedicated application. Specifically, users can manually enter data into input forms within the app, or data is automatically collected and synchronized from the device. The compiled health data is temporarily stored on the device as output.

[0689] Step 2:

[0690] The terminal encrypts the aggregated health data and sends it to the server via the communication network. The input is the aggregated data stored on the terminal, and the output is the encrypted transmitted data. Specifically, the terminal encrypts the data using the SSL / TLS protocol and securely sends it to the server.

[0691] Step 3:

[0692] The server processes the received data and integrates it with an external knowledge base. The input is encrypted health data, and the external knowledge base includes the latest health guidelines and nutritional information. This data is integrated and output as an analyzable dataset. Specifically, the process involves data cleansing and standardization to create the dataset for analysis.

[0693] Step 4:

[0694] The server uses a generative AI model to analyze health data and generate individually customized health improvement programs. The input consists of an integrated dataset and the generative AI model. The AI ​​analyzes the data and generates a program optimized for the user as output. Specifically, it performs algorithmic data analysis and proposes concrete improvement measures such as meal plans and exercise schedules.

[0695] Step 5:

[0696] The server sends the generated health improvement program to the user's device and displays it in a format that the user can review within a dedicated application. The input is a program generated by AI, and the output is data sent to the smartphone. Specifically, it utilizes a notification system to present the program to the user as a daily schedule.

[0697] Step 6:

[0698] The device continuously collects user feedback and additional health data and sends it to the server. Inputs include user feedback and new health data, while output is encrypted transmission data based on this input. Specifically, the app has a function that asks for user feedback in the form of a survey, and this data is periodically sent to the server.

[0699] Step 7:

[0700] The server analyzes the collected feedback and updates the health improvement program as needed. This allows for more effective suggestions for the user. Inputs include user feedback data and current program information, while output is the updated health program. Specifically, the program is re-evaluated and adjusted based on the feedback analysis.

[0701] (Application Example 1)

[0702] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0703] In modern times, maintaining and improving individual health is a crucial issue for many people, but general health programs are often uniform and do not meet individual needs. Furthermore, there is a lack of an environment where appropriate health information and proposed programs can be immediately implemented. Therefore, there is a need for a system that delivers personalized health improvement strategies and related information.

[0704] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0705] In this invention, the server includes an input device means for collecting health data, a device means for receiving transmitted health data and integrating it with an external information storage, and a device means for generating and associating personalized content using a generative AI model. This enables the timely delivery of customized health improvement plans and content to individual users, and facilitates the formation of healthy lifestyle habits based on them.

[0706] "Health data" refers to information about individual users, such as their diet, exercise, sleep, and heart rate, and is used to analyze their health status and develop improvement plans.

[0707] An "input device" is a device used by a user to input or automatically record health data, and examples include smartphones and wearable devices.

[0708] A "communication channel" refers to a network used to securely transmit data, and includes the internet and mobile networks.

[0709] An "external information repository" refers to a database where general health-related information is stored, including health guidelines, dietary information, and exercise program information.

[0710] A "generation device" refers to a processor or software that generates individualized health improvement plans for users based on integrated health data.

[0711] A "transmission device" refers to a system for distributing generated health improvement programs to individual users, and a smartphone application falls under this category.

[0712] A "generative AI model" refers to an algorithm that uses artificial intelligence to analyze health-related data and generate individually optimized content.

[0713] "Personalized content" refers to information, programs, and suggestions that are individually tailored based on each user's health status and preferences.

[0714] The system for carrying out this invention operates in a network environment including users, terminals, and servers. Users acquire and input health data using input devices such as smartphones or smart glasses. This utilizes sensors and dedicated applications built into the devices. This data includes information on diet, exercise, sleep, heart rate, etc.

[0715] The device transmits this health data to the server in real time via a communication channel. The data is encrypted during transmission to protect privacy. The server integrates the received health data with an external data storage system and comprehensively analyzes the user's health status. Software such as Python and machine learning libraries (TensorFlow, PyTorch) are used for this analysis.

[0716] Using a generative AI model, the server generates a personalized health improvement plan for each user. This plan includes customized meal suggestions, exercise plans, and relaxation techniques. Appropriate content is then selected and sent to the user's device. This content is individually tailored based on the user's preferences and health information.

[0717] For example, if a user is determined to be inactive, an exercise video suitable for that user will be selected and provided. Furthermore, an example of a prompt message for the generating AI model could be: "The user sleeps less than 7 hours on average and exercises less than 2 hours per week. Please recommend a fitness video suitable for this user."

[0718] In this way, a system is configured in which the server and terminal cooperate to propose dynamic and appropriate health improvement measures to individual users and provide an environment in which they can be implemented.

[0719] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0720] Step 1:

[0721] Users input or automatically record health data using applications installed on their smartphones or smart glasses. Data such as diet, exercise, sleep, and heart rate are used as input. This data is temporarily stored on the device, and the sensor data is formatted as part of the data processing. The output is appropriately formatted health data.

[0722] Step 2:

[0723] The device transmits the collected health data to the server via a communication channel. The data is encrypted for security purposes during this process. The input is formatted health data, and the output is an encrypted data stream. Specifically, the HTTPS protocol is used to securely transmit the data to the server.

[0724] Step 3:

[0725] The server decrypts the received health data and integrates it with an external data repository. The input is an encrypted data stream, and the output is integrated data. Specifically, a database management system is used to integrate general information and user data from the external repository.

[0726] Step 4:

[0727] The server runs a generative AI model based on integrated data. The input is integrated data, and the output is a personalized health improvement plan. In this process, Python and machine learning libraries are used to perform data analysis and plan generation.

[0728] Step 5:

[0729] The generated health improvement plan is sent to the user's terminal by the server. The input is the health improvement plan, and the output is the content displayed on the user's terminal. This involves prompting the generating AI model. Specific examples include fitness videos and recipe videos.

[0730] Step 6:

[0731] Users review a health improvement plan provided through an application on their device and adjust their daily lives accordingly. The input is the health improvement plan, and the output is user feedback data. This feedback is entered on the device and used to update the plan in the next update.

[0732] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0733] As an embodiment of the present invention, a system is provided that combines and analyzes individual health data and emotional information to provide a health improvement program optimized for the user.

[0734] Users input or automatically record their daily health data (such as diet, exercise, and sleep) using smartphones or wearable devices. Furthermore, they can use applications equipped with an emotion engine function to record their emotions and moods for the day through voice input, text input, or facial expression emotion analysis.

[0735] The device encrypts this health and emotional data and transmits it to the server over the communication network. The encryption process is crucial to protect the confidentiality of the data.

[0736] The server stores the received data in a database and integrates it with an external information database. The database contains the latest health information, guidelines, and emotion-based influencing factors. For example, it considers the impact of specific emotions on dietary choices and exercise patterns.

[0737] The server activates a production mechanism that analyzes integrated health data and emotional information to generate a customized health improvement program based on the individual's condition and goals. This program includes dietary suggestions, exercise plans, and stress management methods tailored to the user's emotional state.

[0738] The generated programs are sent individually from the server to the user's terminal and displayed in an easy-to-understand format within the application. Users can then adjust and improve their lifestyle based on the provided programs.

[0739] For example, if a user tends to experience high levels of stress, the program will suggest foods that promote a comfortable mood, as well as exercises and meditation to help them relax. Furthermore, the emotion engine detects changes in the user's emotions and adjusts health-related advice in real time.

[0740] The device records user feedback and daily emotional changes and sends them to a server. This allows the server to adjust the program based on the feedback, providing more effective health improvement support. In this way, the program, which integrates emotional and health information, aims to continuously improve the user's overall health and well-being.

[0741] The following describes the processing flow.

[0742] Step 1:

[0743] Users input health data such as diet, exercise, and sleep using smartphones or wearable devices. They also utilize an emotion engine to record their emotions for the day through text input, voice input, or camera.

[0744] Step 2:

[0745] The device encrypts the collected health data and emotional information and transmits it to the server via the communication network. This transmission process uses state-of-the-art encryption technology to protect user privacy.

[0746] Step 3:

[0747] The server stores the received data in a database and integrates it with external information databases. This integration ensures that the latest health information and emotional state are reflected in individual health data, thus guaranteeing data consistency.

[0748] Step 4:

[0749] The server activates generation mechanisms to analyze health data and emotional information, and generates an optimized health improvement program based on the user's emotional and health status. This program includes dietary suggestions, exercise plans, and stress reduction methods tailored to the user's emotional state.

[0750] Step 5:

[0751] The server customizes the generated health improvement program for each user and sends it to their device. The program is visually represented within the app and provided in a format that users can easily understand and execute.

[0752] Step 6:

[0753] Users review the provided programs and implement them in their daily lives. For example, they might exercise to reduce stress, adjust their diet, and improve their health habits according to their emotional state.

[0754] Step 7:

[0755] In addition to continuously collecting health data, the device also records user feedback and emotional changes. This data is then sent back to the server.

[0756] Step 8:

[0757] The server analyzes user feedback and new emotional data, incorporating it into the next health improvement program. This program adjustment allows for a better balance between the user's health and emotions.

[0758] (Example 2)

[0759] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0760] Programs for improving individual health should take into account individual health conditions and emotional changes, rather than relying on general information. However, conventional systems lacked sufficient means to effectively collect, analyze, and reflect individual health and emotional data, making it difficult to provide optimized health programs. Furthermore, mechanisms for securely transmitting data in a properly encrypted form were not established.

[0761] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0762] In this invention, the server includes input means for collecting health status data and emotional information from a personal device, means for encrypting the collected health status data and emotional information and transmitting it via a communication network, and generation means using a generation model for generating a personalized health improvement program based on the integrated data. This makes it possible to securely generate and provide an optimized health improvement program based on the user's individual health status and emotions.

[0763] "Health status data" refers to information about an individual's physical activity and condition, such as diet, exercise, and sleep, and serves as an indicator of health in daily life.

[0764] "Emotional information" refers to information about an individual's emotions and mood, representing their mental state obtained through voice input, text input, and facial expression analysis.

[0765] "Input means" refers to devices or applications for collecting health status data and emotional information, which users can use to record information in digital format.

[0766] "Encryption" is a technology that protects the confidentiality of data by transforming it using a specific algorithm and preventing unauthorized access.

[0767] A "communication network" is the infrastructure used to transmit data from a terminal to a server, and includes digital communication technologies such as the internet and mobile networks.

[0768] "Transmission means" refers to the equipment or software used to transmit collected data to other components, and is responsible for managing the transmission and reception of data.

[0769] A "generative model" refers to an algorithm or artificial intelligence technology used to create health improvement programs, which analyzes input data to provide the optimal output.

[0770] "Generative means" refer to processes and technologies for creating new value based on data, and are particularly used to build health improvement programs.

[0771] A "health improvement program" is a set of action plans proposed to improve an individual's health, and includes elements of diet, exercise, and stress management.

[0772] This invention is a system that collects individual health status and emotional information and provides an optimized health improvement program based on this information. Specifically, it uses an input device, a terminal, and a server to collect, transmit, and analyze data.

[0773] Users collect health and emotional data using smartphones and wearable devices. These devices include, for example, fitness trackers that monitor heart rate and smartphone applications that can take photos of meals. Emotional information is captured through voice input, text input, or software that analyzes facial expressions.

[0774] The terminal temporarily stores the data entered by the user and encrypts it using encryption technologies such as AES. The encrypted data is then transmitted to the server via a communication network such as the internet. This process ensures that the data is transmitted securely and protected from unauthorized access.

[0775] The server decodes the received data and stores it in its database. Furthermore, it acquires the latest data from external health sources and integrates it with its own database. This includes the latest dietary guidelines and exercise programs, which are then used in conjunction with individual user data. The server analyzes the integrated data using a generative AI model to generate health improvement programs based on the user's individual health status. For example, a prompt such as "30-year-old female, high stress, insufficient exercise" might be input into the AI ​​model. As a result, the user would be provided with dietary and exercise suggestions to reduce stress.

[0776] The generated health improvement program is sent from the server to each user's terminal and displayed on the application in a visually easy-to-understand format. Users can adjust their daily routines according to the provided program and discover improvements. For example, if a user is experiencing high levels of stress, the system may suggest foods and exercises that promote relaxation.

[0777] This system allows users to receive more personalized guidance tailored to their health condition and emotions, thereby contributing to improved health and well-being.

[0778] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0779] Step 1:

[0780] Users input or automatically record health data and emotional information using smartphones or wearable devices. The primary inputs at this stage are diet, exercise, sleep data, and emotional information. This includes exercise data obtained from device sensors, diet information from image analysis, or emotional text or voice input using an emotion engine. The output is the accumulation of this input data.

[0781] Step 2:

[0782] The device aggregates the collected data into a single dataset and encrypts it using encryption algorithms such as AES. The input for this encryption is health data and emotional information provided by the user, and the output is an encrypted data file. Specifically, the device ensures the data is securely encrypted and prepared for transmission.

[0783] Step 3:

[0784] Encrypted data is sent from the terminal, and the server receives and decrypts it. The input is encrypted data received via a secure communication channel, and the output is decrypted, accurate health and emotional data. Specifically, the integrity of the received data is checked, and once successfully decrypted, it is prepared for the next integration step.

[0785] Step 4:

[0786] The server stores the decoded data in its own database and further integrates it with external information databases. The input consists of the decoded data and the latest external health information, and the output is a new, integrated database. Specifically, the server performs data matching and updates, laying the groundwork for analysis based on individual health conditions.

[0787] Step 5:

[0788] The server generates personalized health improvement programs using a generative AI model based on integrated data. The input to this generation process is integrated data, and by using appropriate prompt statements, the output is a health improvement program optimized for each individual user. For example, information such as "30-year-old female, high stress, insufficient exercise time" is input to the model in the prompt statement, and the generation result is obtained.

[0789] Step 6:

[0790] The server sends the generated program to the user's terminal, which displays it visually in the application. The input is the generated program data, and the output is the program content presented to the user. Specifically, the server arranges the program layout and presents it in a format that is easy for the user to understand.

[0791] Step 7:

[0792] Users try the provided program and re-enter feedback on the results and daily emotional changes into the app. The input consists of user feedback and daily data changes, while the output is this feedback information. Specifically, users are required to update their daily logs and accumulate foundational data for long-term health improvement.

[0793] (Application Example 2)

[0794] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0795] In modern living environments, people are required to maintain their health and manage their emotions, but there is a lack of effective means to comprehensively improve both individual health conditions and emotions. In particular, the lack of appropriate advice and product recommendations at the local level hinders health improvement. Therefore, there is a need for the development of a reliable system that provides users with real-time, customized health improvement programs.

[0796] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0797] In this invention, the server includes information acquisition means for acquiring health data, input means for acquiring emotional information, and means for transferring the acquired health data and emotional information via a communication network. This makes it possible to generate individually customized health improvement plans for users and support their health improvement in real time through product selection and service use within stores.

[0798] "Health data" refers to information about an individual user's habits, such as diet, exercise, and sleep.

[0799] "Emotional information" refers to information about a user's daily emotions and moods, obtained through voice input, text input, or facial expression analysis.

[0800] "Information acquisition means" refers to the hardware or software system used to acquire health data from users.

[0801] "Input means" refers to a device or application used to obtain emotional information from a user.

[0802] A "communication network" refers to the network infrastructure used to transfer data from a terminal to a server.

[0803] "Transfer method" refers to a system that has the function of transmitting acquired health data and emotional information to a server via a communication network.

[0804] An "external information storage device" refers to a database that stores the latest guidelines and information related to health.

[0805] "Generation means" refers to a program or system that performs processing to create an optimal health improvement plan for the user based on health data and emotional information.

[0806] "Means of delivery" refers to a mechanism for displaying or notifying users of the generated health improvement plan.

[0807] "Presentation methods" refer to systems and devices that support the communication of product and service information within a store to users.

[0808] To implement the invention, the following system configuration is conceivable: The user uses a smartphone or smart glasses to input health data and emotional information. This device has an application installed for collecting health data, which automatically or manually records information such as diet, exercise, and sleep. Emotional information is acquired using voice input, text input, or a facial expression emotion analysis function.

[0809] The acquired health data and emotional information are encrypted on the device and then transmitted to the server via the communication network. A secure protocol is used for this communication. The server integrates the received data with an external data storage device and generates a customized health improvement plan based on the health data and emotional information. This plan includes stress management, diet, and exercise recommendations.

[0810] The generated plan is provided to the user's device and notified visually or audibly. In-store, users can use their device to scan QR codes within the store to obtain product and service information and link it to their health improvement plan. For example, when a user purchases a relaxing herbal tea or a supplement containing specific vitamins, the system can suggest the most suitable products.

[0811] Furthermore, user feedback is continuously collected and sent to the server, contributing to improving the accuracy of health improvement plans. The generative AI model responds to changes in emotional information in real time and makes suggestions for health improvements.

[0812] An example of a prompt message might be, "I'm under a lot of stress. What foods would you recommend?" This allows the system to provide specific, personalized advice in real time.

[0813] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0814] Step 1:

[0815] Users input health data and emotional information using their devices. Health data includes information such as diet, exercise, and sleep, while emotional information is obtained through voice input, text input, or facial expression analysis. The input data is converted to a standard format by the application.

[0816] Step 2:

[0817] The device encrypts the acquired health and emotional information and transmits it to the server via the communication network. Encryption is performed to protect the confidentiality of the data, and the data is sent to the network only after the recipient has been verified by the communication protocol.

[0818] Step 3:

[0819] The server stores the received data in a database and integrates it with information from external storage devices. The database contains the latest health information and historical sentiment data trends, and the data is efficiently integrated using SQL queries.

[0820] Step 4:

[0821] The server applies a generative AI model using integrated health data and emotional information to create an optimal health improvement plan for the user. Through data analysis, the generative AI model determines personalized dietary suggestions and stress management methods for each user.

[0822] Step 5:

[0823] The server sends the generated health improvement plan to the user's device. The plan is communicated to the user visually or audibly, prompting them to take appropriate action. Specific product information is also displayed in conjunction with the in-store system.

[0824] Step 6:

[0825] Users select products in the store and enter feedback via a terminal. This feedback is used by the system to improve the accuracy of health improvement plans.

[0826] Step 7:

[0827] The server accumulates new feedback data and integrates it into subsequent health improvement plans. This allows the program to continuously optimize user health management. Natural language processing techniques are used to analyze the feedback.

[0828] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0829] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0830] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0831] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0832] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0833] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0834] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0835] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0836] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0837] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0838] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0839] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0840] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0841] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0842] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0843] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0844] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0845] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0846] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0847] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0848] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[0849] The following is further disclosed regarding the embodiments described above.

[0850] (Claim 1)

[0851] Input means for collecting health data,

[0852] A means of transmitting collected health data via a communication network,

[0853] A means of receiving transmitted health data and integrating it with an external information database,

[0854] A means for generating a health improvement program based on integrated health data,

[0855] A transmission means for individually sending the generated health improvement programs,

[0856] A system that includes this.

[0857] (Claim 2)

[0858] A tracking means for collecting user feedback and incorporating it into the next health improvement program, according to claim 1.

[0859] (Claim 3)

[0860] The system according to claim 1, which periodically acquires general health-related information from an external information database and updates the database.

[0861] "Example 1"

[0862] (Claim 1)

[0863] A data input means in a terminal for collecting personal health information,

[0864] A means for encrypting the collected information and transmitting it to a server via a communication network,

[0865] A means for receiving the transmitted information and integrating it with an external knowledge base,

[0866] A generation method using a generative AI model that generates a health improvement plan based on integrated information,

[0867] A means of individually sending and displaying the generated health improvement plan on a terminal,

[0868] A system that includes this.

[0869] (Claim 2)

[0870] The system according to claim 1, which provides a means for collecting user feedback and continuously tracking it to incorporate it into the next health improvement plan.

[0871] (Claim 3)

[0872] The system according to claim 1, comprising means for periodically acquiring general health information from an external knowledge base and updating the database.

[0873] "Application Example 1"

[0874] (Claim 1)

[0875] An input device means for collecting health data,

[0876] A device and means for transmitting collected health data via a communication channel,

[0877] A device means for receiving transmitted health data and integrating it with an external information storage system,

[0878] A generation device means for generating a health improvement plan based on integrated health data,

[0879] A transmitting device means for individually transmitting the generated health improvement plans,

[0880] A device that automatically selects and delivers appropriate content based on the user's health data,

[0881] A device and means for generating and associating personalized content using a generative AI model,

[0882] A system that includes this.

[0883] (Claim 2)

[0884] A tracking device for collecting user feedback and incorporating it into the next health improvement plan, according to claim 1.

[0885] (Claim 3)

[0886] A system according to claim 1, which periodically acquires general health-related information from an external information storage and updates the database.

[0887] "Example 2 of combining an emotion engine"

[0888] (Claim 1)

[0889] An input means for collecting health status data and emotional information from a personal device,

[0890] A means of encrypting collected health status data and emotional information and transmitting it via a communication network,

[0891] A means of receiving transmitted data and integrating it with data from other sources,

[0892] A generation method using a generative model for generating personalized health improvement programs based on integrated data,

[0893] A transmission means that sends the generated program to each user terminal and displays it,

[0894] A system that includes this.

[0895] (Claim 2)

[0896] The system according to claim 1, which collects pre-feedback from users and incorporates it into the next health improvement program through tracking means for continuously adjusting the program.

[0897] (Claim 3)

[0898] The system according to claim 1, a means for periodically obtaining health-related information from data of other sources and updating a database.

[0899] "Application example 2 when combining with an emotional engine"

[0900] (Claim 1)

[0901] Information acquisition methods for obtaining health data,

[0902] An input method for acquiring emotional information,

[0903] A means for transferring acquired health data and emotional information via a communication network,

[0904] A means for receiving transferred health data and emotional information and integrating it with an external information storage device,

[0905] A generation means for generating a health improvement plan based on integrated health data and emotional information,

[0906] A means of providing the generated health improvement plan individually,

[0907] A means of providing users with content linked to product and service information within the store,

[0908] A system that includes this.

[0909] (Claim 2)

[0910] A tracking means for collecting user feedback and incorporating it into the next health improvement plan, according to claim 1.

[0911] (Claim 3)

[0912] The system according to claim 1, which periodically acquires general health-related information from an external information storage device and updates a database. [Explanation of Symbols]

[0913] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. Input means for collecting health data, A means of transmitting collected health data via a communication network, A means of receiving transmitted health data and integrating it with an external information database, A means for generating a health improvement program based on integrated health data, A transmission means for individually sending the generated health improvement programs, A system that includes this.

2. A tracking means for collecting user feedback and incorporating it into the next health improvement program, according to claim 1.

3. The system according to claim 1, which periodically acquires general health-related information from an external information database and updates the database.

Citation Information

Patent Citations

  • Persona chatbot control method and system

    JP2022180282A