System

Abstract

A system is provided.SOLUTION: A system comprising: means for creating and updating a profile of a user; means for recording and analyzing routines of the user's daily life; and means for sending instructions to a terminal to adjust a home environment based on the user's routines and preferences.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern society, people's lives are becoming increasingly busy, and there is a need to adjust the environment to suit individual lifestyles. There is also an increasing need to ensure the safety and health of the elderly. Conventional smart home systems struggle to meet these diverse needs, and are not adequately customized to meet the needs of individual users. This reduces user comfort and convenience, limiting the effectiveness of smart home systems. [Means for solving the problem]

[0005] The present invention provides a system including a means for creating and updating a user's profile, a means for recording and analyzing the user's daily routine, and a means for sending instructions to a terminal to adjust the home environment based on the user's routine and preferences. Furthermore, by adding a means for monitoring and storing the user's health data, a means for responding to emergencies based on the health data, and a means for controlling temperature, lighting, music, and home appliances in adjusting the home environment, the system can be customized to meet various user needs, providing a more comfortable and safe living environment.

[0006] "User" refers to an individual who uses the system.

[0007] A "profile" refers to a collection of data that records a user's personal information, preferences, habits, etc.

[0008] "Routine" refers to repeated actions and time periods in a user's daily life.

[0009] "Recording" refers to collecting and storing specific information.

[0010] "Analyzing" refers to analyzing recorded data to find patterns and trends.

[0011] "Home environment" refers to physical environmental factors within the home, such as temperature, lighting, music, and appliances.

[0012] "Adjust" refers to adapting or changing a particular setting or condition.

[0013] "Sending instructions" refers to issuing a command to perform a specific action or setting.

[0014] "Terminal" refers to a device connected to the system to perform a specific function.

[0015] "Health Data" refers to information relating to a User's health condition.

[0016] "Monitoring" refers to the continuous observation of conditions and collection of data.

[0017] "Emergency response" refers to the measures and responses that are taken promptly when an abnormality or emergency occurs.

[0018] "Temperature" refers to the state of heat in a space.

[0019] "Lighting" refers to the lighting of a room with light from a light source.

[0020] "Music" refers to media played for the enjoyment of a combination of sounds.

[0021] "Home appliance" refers to an electrically operated device used in the home. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0023] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0024] First, the terms used in the following description will be explained.

[0025] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0026] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0027] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0028] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0029] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0030] [First embodiment]

[0031] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0032] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0033] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0034] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0035] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0036] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0037] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0038] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0039] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0040] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0041] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0042] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0043] The present invention relates to a system including a means for creating and updating a user's profile, a means for recording and analyzing the user's daily routine, and a means for transmitting instructions to a terminal for adjusting the home environment based on the user's routine and preferences. Specific embodiments are described below.

[0044] 1. Creating and updating your user profile

[0045] The server creates a new user profile when a user registers with the system. The user profile includes the user's personal information, environmental settings (e.g., temperature preferences, lighting brightness), and health data (e.g., heart rate, blood pressure). When the user enters or updates this information through the application, the server stores the information in a database. For example, if the user specifies "set room temperature to 22°C," the server reflects this information in the profile and stores it in the database.

[0046] 2. Recording and analyzing daily routines

[0047] The server records the user's daily activities. This is the process of collecting activities at specific times (e.g., waking up, going to bed, eating, etc.). If the user "wakes up at 06:00," that information is sent to the server and recorded as the user's routine. The server analyzes the data collected over a certain period of time to identify the user's lifestyle patterns. For example, if the server registers a tendency to wake up at 6:00 every morning, it will save the user's "average wake-up time as 06:00" in the profile.

[0048] 3. Adjusting the home environment

[0049] The server generates appropriate instructions for adjusting the home environment based on the user's profile and daily routine. For example, if the user wakes up at 6:00, the server will send instructions to the device to adjust the room temperature to 22°C, gradually brighten the lights, and play the user's favorite music when they wake up. This creates an optimal environment for the user when they wake up.

[0050] 4. Health Management and Emergency Response

[0051] The server monitors the user's health data (e.g., heart rate, blood pressure) and takes emergency action if it detects any abnormalities. For example, if the user's heart rate becomes abnormally high, the server sends an emergency alert to the device, prompting appropriate action. This ensures the safety of elderly users and those with health risks.

[0052] Specific examples

[0053] When the user goes to bed at 10 p.m., the server sends instructions to the device to gradually dim the lights and play relaxing music.

[0054] When the user wakes up at 6 a.m., the server gradually brightens the lights and plays their favorite music to wake them up.

[0055] Users measure their blood pressure periodically and enter the data into the application, which records this information and alerts them if any abnormal readings are detected.

[0056] As a result, the present invention provides customized services according to the individual needs of users, realizing a more comfortable and safe home environment.

[0057] The processing flow will be explained below.

[0058] Creating and updating user profiles

[0059] Step 1:

[0060] When a user registers with the system, they enter basic information (such as name, age, and gender) through the application. After completing this information entry, it is sent to the server.

[0061] Step 2:

[0062] The server uses the submitted information to create a new user profile, which includes initial environmental settings (temperature, lighting, music, etc.) and health data.

[0063] Step 3:

[0064] When a user updates their preferences or health data through the application, the new information is sent to the server, for example, specifying "set room temperature to 22°C."

[0065] Step 4:

[0066] The server then updates the user profile with the received information and stores it in the database, ensuring that the latest information is available the next time the user accesses the site.

[0067] Recording and analyzing daily routines

[0068] Step 1:

[0069] When a user performs a specific activity, the information (e.g., the time of waking up, going to bed, etc.) is sent to the server through the application. For example, "Waking up at 06:00" is recorded.

[0070] Step 2:

[0071] The server records the transmitted activity information in a log along with the date, and this log data is managed for each user.

[0072] Step 3:

[0073] The server analyzes the log data every certain period (e.g., one week, one month, etc.) and extracts daily routine patterns, including wake-up time, bedtime, meal times, etc.

[0074] Step 4:

[0075] The server then integrates the analysis results into the user profile and stores it as average wake-up and bedtime times, which serve as the basis for subsequent environmental adjustments.

[0076] Adjusting the home environment

[0077] Step 1:

[0078] The server determines the timing of home environment adjustments based on the analysis of the user profile and routine. For example, if a wake-up routine is registered for 6:00 a.m., the adjustments will be made at that time.

[0079] Step 2:

[0080] The server generates specific instructions to adjust the home environment (e.g., set the temperature to 22°C, brighten the lights, play music).

[0081] Step 3:

[0082] The server generates and sends instructions to devices, such as smart thermostats, smart lighting systems, and music playback devices.

[0083] Step 4:

[0084] The device then carries out the instructions it receives: for example, a smart thermostat sets the temperature to 22°C, a smart lighting system adjusts the brightness to a specified level, or a music playback device plays a specified playlist.

[0085] Health Management and Emergency Response

[0086] Step 1:

[0087] The user periodically enters health data (e.g., heart rate, blood pressure) into the application, and this information is sent to the server.

[0088] Step 2:

[0089] The server records the received health data in a profile and monitors for outliers and trends, for example, if your heart rate is consistently elevated, it will record that data.

[0090] Step 3:

[0091] If an abnormal value is detected, the server generates an emergency alert and sends corresponding instructions to the device. For example, if the heart rate reaches a dangerous level, the server sends an alert along with a notification to contacts.

[0092] Step 4:

[0093] Your device will receive emergency alerts and respond by sounding an alarm, flashing a light, or automatically sending a notification to your emergency contacts, allowing for early response.

[0094] Example 1

[0095] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0096] In today's home environment, it is difficult to provide customized services that meet the individual needs and preferences of users. In addition, health data monitoring and emergency response may be delayed, making it difficult to ensure safety, especially for elderly users and those with health risks.

[0097] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0098] In this invention, the server includes server means for creating and updating a user's profile, server means for recording the user's daily routine, data analysis means for analyzing the recorded daily routine data and identifying the user's routine, server means for transmitting instructions to the terminal for adjusting the home environment based on the user's profile and daily routine, and terminal means for receiving instructions from the terminal and adjusting the home environment in accordance with the instructions. This makes it possible to provide an optimal home environment that meets the individual needs of the user, as well as to monitor health data and respond quickly to emergencies.

[0099] A "user profile" is a collection of data about a user, including the user's personal information, preferences, health data, etc.

[0100] The "server means" is a server device that has the functions of receiving, storing, analyzing, and generating instructions on data.

[0101] The "terminal means" is a device that receives instructions sent from the server and executes operations in accordance with those instructions.

[0102] The "data analysis means" is a means having the function of analyzing the recorded data of daily life and identifying the user's life patterns and routines.

[0103] "Daily life routine" means a user's daily activity patterns and schedules (e.g., wake-up time, bedtime, meal times, etc.).

[0104] The "home environment" includes the temperature, lighting, music, and the state of home appliances in the user's living environment.

[0105] "Health data" refers to data that indicates the user's health condition, such as heart rate and blood pressure.

[0106] "Abnormal value" means a value in a user's health data that deviates from the normal range.

[0107] "Emergency response" refers to the process of quickly issuing an alert and taking appropriate measures when abnormal values ​​are detected.

[0108] The present invention is a system that creates and updates a user's profile, records and analyzes daily routines, and adjusts the home environment according to the user's needs.

[0109] First, the creation and updating of user profiles is done by the server. When a user logs in or registers to the application, the server receives the user's personal information (e.g., name, age, contact details, etc.) and stores it in a database. For example, database management is done using MySQL. When the user enters their environmental settings (e.g., preferred temperature, lighting brightness), the server reflects this in the profile and stores it in the database. Health data (e.g., heart rate, blood pressure) is also entered and stored in the same way.

[0110] Next, daily routines are recorded either by the user entering them into the application or automatically through a measurement device such as a smartwatch. The server receives this data and records it in a database along with date and time information. For data analysis, Python and Pandas are used to analyze the recorded daily data and identify the user's lifestyle patterns. For example, routine information such as "wake up at 6:00 every day" is added to the profile and saved in the database.

[0111] When adjusting the home environment, the server generates appropriate environmental adjustment instructions based on the user's profile and daily routine. For example, if the user has the habit of waking up at 6:00, the server sends instructions to the device such as "set the room temperature to 22°C," "gradually brighten the lights," and "play your favorite music when you wake up." This is done using Node.js and the MQTT protocol. The device receives these instructions and actually adjusts the environment. For example, a smart thermostat is used to adjust the temperature, and smart lights are used to adjust the lighting.

[0112] Finally, regarding health data monitoring and response, the server monitors the user's health data in real time and takes emergency action if an abnormality is detected. This includes sending alerts to emergency contacts using Twilio and sending "emergency response instructions" to the device. This ensures the safety of elderly users and those with health risks.

[0113] Examples:

[0114] When the user goes to bed at 10 p.m., the server sends instructions to the device to gradually dim the lights and play relaxing music.

[0115] When the user wakes up at 6am, the server gradually brightens the lights and plays their favorite music to wake them up.

[0116] Users measure their blood pressure periodically and enter the data into the application, which records this information and alerts them if any abnormal readings are detected.

[0117] Example prompts to input to a generative AI model:

[0118] "For a user who wakes up at 6am every day, please explain the flow to set the room temperature to 22°C, gradually increase the brightness of the lights, and play their favorite music to coincide with their wake-up time."

[0119] As described above, the present invention provides customized services according to the individual needs of users, thereby realizing a more comfortable and safe home environment.

[0120] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0121] Step 1:

[0122] A user logs in or signs up for the app.

[0123] Specific operation: The user launches the app, clicks the "New Registration" button, and enters their name, age, and contact information.

[0124] Input: Personal information entered by the user (e.g., name, age, contact details).

[0125] Output: The user's personal information record that the server stores in the database.

[0126] Step 2:

[0127] The server receives the user's personal information and stores it in a database.

[0128] Specific operation: The server uses MySQL to record the received personal information in a database.

[0129] Input: Personal information entered by the user.

[0130] Output: The user's personal information record stored in the database.

[0131] Step 3:

[0132] The user uses the application to enter environmental settings (e.g., temperature preference, lighting brightness).

[0133] Specific operation: The user enters something like "Set room temperature to 22°C" on the "Settings" screen and presses the save button.

[0134] Input: Preference information entered by the user.

[0135] Output: A preference record that the server stores in the database.

[0136] Step 4:

[0137] The server receives the configuration information and updates the user profile.

[0138] What happens: The server adds the preference information to the profile and saves it in the database.

[0139] Input: Preference information entered by the user.

[0140] Output: The updated user profile record.

[0141] Step 5:

[0142] The user uses the application to input daily routines (e.g., waking up, going to bed, eating).

[0143] Specific operation: The user enters "Wake up at 06:00" in the app and presses the save button.

[0144] Input: Daily life routine information entered by the user.

[0145] Output: Routine data that the server stores in the database.

[0146] Step 6:

[0147] The server receives data on daily life and records it in a database along with date and time information.

[0148] Specific operation: The server saves the routine data in a database with a timestamp.

[0149] Input: Routine data entered by the user.

[0150] Output: Timestamped routine data stored in a database.

[0151] Step 7:

[0152] The server collects routine data over a period of time and performs data analysis.

[0153] What happens: The server uses Python and Pandas to analyze the data and identify patterns such as "average wake-up time is 06:00."

[0154] Input: Routine data for a period of time extracted from a database.

[0155] Output: User's life patterns as an analysis result.

[0156] Step 8:

[0157] The server reflects the analysis results in the user profile and stores them in a database.

[0158] Specific operation: The server adds the analysis results to the profile and stores it in the database.

[0159] Input: Data analysis results.

[0160] Output: The updated user profile.

[0161] Step 9:

[0162] The server generates instructions for adjusting the home environment based on the user's profile and lifestyle patterns.

[0163] Specific operation: The server generates instructions such as "set the room temperature to 22°C at 6:00" and "gradually brighten the lights."

[0164] Input: User profile and lifestyle pattern data.

[0165] Output: Generated home environment adjustment instructions.

[0166] Step 10:

[0167] The server transmits a home environment adjustment instruction to the terminal.

[0168] Specific operation: The server sends instructions to the terminal using the MQTT protocol.

[0169] Input: Generated home environment adjustment instructions.

[0170] Output: Adjustment instructions sent to the terminal.

[0171] Step 11:

[0172] The terminal receives instructions from the server and executes the instructions.

[0173] Specific operation: The device controls smart thermostats and smart lights to adjust the environment.

[0174] Input: Adjustment instructions from the server.

[0175] Output: The environmental adjustments performed.

[0176] Step 12:

[0177] The user periodically inputs or transmits health data (heart rate, blood pressure, etc.) from a measurement device.

[0178] Specific actions: The user enters blood pressure into the application, and the smartwatch transmits the data.

[0179] Input: User's health data.

[0180] Output: Health data records that the server stores in a database.

[0181] Step 13:

[0182] The server monitors health data and takes emergency action if abnormal values ​​are detected.

[0183] What it does: The server monitors health data in real time, and if it detects any abnormal values, it uses Twilio to send an alert to emergency contacts and send appropriate instructions to the device.

[0184] Input: Health data captured in real time.

[0185] Output: Alerts and instructions on how to respond in the event of an abnormality.

[0186] Through these steps, customized services can be provided according to the individual needs of the user, realizing a more comfortable and safe home environment.

[0187] (Application example 1)

[0188] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0189] Conventional home environment control systems struggle to adjust the environment appropriately based on individual user preferences and daily routines. They also lack the ability to respond quickly in emergencies or monitor users' health data. Furthermore, food delivery services lack personalization and do not provide services based on individual mealtimes or food preferences.

[0190] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0191] In this invention, the server includes means for creating and updating a user's profile, means for recording and analyzing the user's daily routine, means for sending instructions to the terminal for adjusting the home environment based on the user's routine and preferences, and means for utilizing the user's behavioral data to provide personalized services, thereby enabling the optimal adjustment of the home environment according to the user's individual needs and preferences, rapid response in emergencies, and provision of food delivery services based on meal times and preferences.

[0192] A "user profile" is detailed information describing a particular user, including information such as personal preferences, lifestyle habits, and health status.

[0193] "Daily routine" refers to the pattern of activities and behavior that a user regularly performs.

[0194] "Adjusting the home environment" refers to controlling the indoor temperature, lighting, music, home appliances, etc. to improve the user's comfort and convenience.

[0195] A "terminal" is a communication device used by a user, such as a smartphone, tablet, or smart device.

[0196] A "database" is a storage device for storing and managing a user's profile and daily routine.

[0197] "Personalized service provision" means providing services that are customized based on the specific needs and preferences of each individual user.

[0198] "Behavioral data" refers to data about a user's activities and preferences, including a history of specific behaviors.

[0199] The "food delivery function" is a service that delivers appropriate meals based on the user's meal preferences and time.

[0200] "Emergency response" refers to measures to issue prompt warnings and notifications when an abnormality occurs in the user's health condition.

[0201] "Meal suggestions" refers to suggesting optimal meal menus based on the user's past data and preferences.

[0202] This invention relates to a system including means for creating and updating a user's profile, means for recording and analyzing the user's daily routine, and means for sending instructions to a terminal for adjusting the home environment based on the user's routine and preferences, and further includes means for utilizing the user's behavioral data to provide personalized services.

[0203] Creating and updating user profiles

[0204] The server creates a new user profile when a user registers with the system, which includes personal information, preferences, dietary preferences, allergy information, and past order history. When a user enters or updates this information through the smartphone app, the server stores this information in a database.

[0205] Recording and analyzing daily routines

[0206] The server records the user's daily activities sent from the smartphone app. The server collects the user's activities at specific times (e.g., waking up, eating, going to bed, etc.) and stores them in a database. The server analyzes the collected data over a period of time to identify the user's lifestyle patterns and eating routines.

[0207] Personalized Food Delivery

[0208] The server will then suggest appropriate meals based on the user's profile and daily routine. For example, if the user specifies in their profile that they would like to have breakfast at 6:00, the server will send a food delivery notification to their smartphone at that time. The notification will say something like, "Your personalized breakfast will be delivered soon."

[0209] Health Management and Emergency Response

[0210] The server monitors health data (e.g., heart rate, blood pressure) obtained from the smartphone app. If an abnormality is detected, the server sends an emergency alert to the device and notifies pre-defined contacts.

[0211] Hardware and software used

[0212] Hardware: Smartphones, communication infrastructure, servers

[0213] Software: SQLite database, Python script, notification sending module

[0214] Specific examples

[0215] For example, if User A is a vegetarian and has a habit of eating dinner at 6:00 PM every day, the server will send a notification to the user's smartphone at 5:45 PM every day, saying, "Your vegetarian dinner will be delivered soon." If User A experiences any abnormalities in their heart rate, the server will immediately send an emergency notification to prompt the user to take appropriate action.

[0216] Example prompts for generative AI models

[0217] "User A is a vegetarian and wants to eat dinner at 6 PM every day. Create a profile for User A and create a program to send personalized notifications at their preferred times. Also, add the ability to send emergency alerts.

[0218] Meal routine: Dinner at 6pm

[0219] Food preference: Vegetarian

[0220] Allergy information: None

[0221] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0222] Step 1:

[0223] When a user creates an account through a smartphone app, the server generates a new user profile. The data entered by the user, such as personal information, preferences, dietary preferences, and allergy information, is sent to the server. The server stores the data in an SQLite database. This process creates a user profile and prepares the basic data required for subsequent processing.

[0224] Step 2:

[0225] The server receives behavioral data sent from the smartphone app to record the user's daily routine. For example, the user sends information to the server about when they wake up, eat, and go to bed at specific times. The server then stores this data in a database and analyzes their lifestyle patterns over a period of time. This process clarifies the user's routine and provides the basis for providing appropriate services.

[0226] Step 3:

[0227] The server generates instructions for personalized home environment and food delivery services based on the analyzed user's daily routine and profile. For example, if the user tends to wake up at 6 a.m., the server generates instructions for sending notifications at that time. This process ensures that notifications and services are provided at the optimal time for the user.

[0228] Step 4:

[0229] The server sends instructions to the terminal to adjust the home environment. For example, it issues instructions to set the room temperature or lighting brightness as desired by the user. This instruction is transmitted from the terminal to smart devices in the home, which actually adjust the home environment. This process improves the user's comfort.

[0230] Step 5:

[0231] The server receives and monitors the user's health data from the smartphone app. Data such as heart rate and blood pressure is periodically sent to the server. The server analyzes the received data and sends an emergency alert to the device if an abnormality is detected. This process ensures the user's safety.

[0232] Step 6:

[0233] The server processes the notification of personalized meal suggestions according to the user's mealtime. For example, if the user has a habit of eating dinner at 6:00 p.m., the server generates instructions to automatically send a notification at 5:45 p.m. The notification includes a message such as "Your personalized dinner will arrive soon." This process allows the user to receive information at the appropriate time.

[0234] Step 7:

[0235] The server performs the procedures to execute the food delivery service. Based on the user's profile and routine, it suggests available menu items and sends notifications. If the user accepts the meal suggestion, the notification confirms the order and instructs the delivery to be prepared. This process results in a food delivery that meets the user's needs.

[0236] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0237] The present invention relates to a system including a means for creating and updating a user's profile, a means for recording and analyzing the user's daily routine, and a means for sending instructions to a terminal to adjust the home environment based on the user's routine and preferences. The present invention also includes a means for monitoring and storing the user's health data, a means for responding to emergencies based on the health data, and a means for controlling temperature, lighting, music, and home appliances in adjusting the home environment. Additionally, by combining this with an emotion engine that recognizes the user's emotions, the system realizes optimization of the home environment based on the user's emotions.

[0238] 1. Creating and updating your user profile

[0239] The server creates a new user profile when a user registers with the system. The user profile includes the user's personal information, environmental settings (e.g., temperature preferences, lighting brightness), and health data (e.g., heart rate, blood pressure). When the user enters or updates this information through the application, the server stores the information in a database. For example, if the user specifies "set room temperature to 22°C," the server reflects this information in the profile and stores it in the database.

[0240] 2. Recording and analyzing daily routines

[0241] The server records the user's daily activities. This is the process of collecting activities at specific times (e.g., waking up, going to bed, etc.). If the user "wakes up at 06:00," that information is sent to the server and recorded as the user's routine. The server analyzes the data collected over a certain period of time to identify the user's lifestyle patterns. For example, if the server registers a tendency to wake up at 6:00 every morning, it will save the user's "average wake-up time as 06:00" in the profile.

[0242] 3. Adjusting the home environment

[0243] The server generates instructions for adjusting the home environment based on the user's profile and daily routine. When the user's emotion engine recognizes their emotion, it integrates that information into the user's profile for further personalization. For example, if the user wakes up at 6:00, the server will send instructions to the device to adjust the room temperature to 22°C, gradually brighten the lights, and play their favorite music when they wake up. This creates an optimal environment for the user's wake-up time.

[0244] 4. Health Management and Emergency Response

[0245] The server monitors the user's health data (e.g., heart rate, blood pressure) and takes emergency action if it detects any abnormalities. For example, if the user's heart rate becomes abnormally high, the server sends an emergency alert to the device, prompting appropriate action. This ensures the safety of elderly users and those with health risks.

[0246] 5. Emotion Recognition and Home Environment Optimization

[0247] The server uses an emotion engine to recognize the user's emotions and adjusts the home environment based on those emotions. For example, if the emotion engine recognizes that the user is feeling stressed, the server will send instructions to the device, such as "play relaxing music," "change the lighting to a softer color," and "set the temperature to a comfortable range." This reduces the user's stress and provides a relaxing environment.

[0248] Specific examples

[0249] When the user goes to bed at 10 p.m., the server sends instructions to the device to gradually dim the lights and play relaxing music.

[0250] When the user wakes up at 6 a.m., the server gradually brightens the lights and plays their favorite music to wake them up.

[0251] Users measure their blood pressure periodically and enter the data into the application, which records this information and alerts them if any abnormal readings are detected.

[0252] If the server detects that the user is feeling stressed, it sends instructions to the device to adjust the appropriate environmental settings (e.g., temperature, lighting, music) to create a relaxing environment.

[0253] As a result, the present invention provides customized services according to the individual needs of users, realizing a more comfortable and safe home environment.

[0254] The processing flow will be explained below.

[0255] Creating and updating user profiles

[0256] Step 1:

[0257] When a user registers with the system, they enter basic information (such as name, age, and gender) through the application. After completing this information entry, it is sent to the server.

[0258] Step 2:

[0259] The server uses the submitted information to create a new user profile, which includes initial environmental settings (temperature, lighting, music, etc.) and health data.

[0260] Step 3:

[0261] When a user updates their preferences or health data through the application, the new information is sent to the server, for example, specifying "set room temperature to 22°C."

[0262] Step 4:

[0263] The server then updates the user profile with the received information and stores it in the database, ensuring that the latest information is available the next time the user accesses the site.

[0264] Recording and analyzing daily routines

[0265] Step 1:

[0266] When a user performs a specific activity, the information (e.g., the time of waking up, going to bed, etc.) is sent to the server through the application. For example, "Waking up at 06:00" is recorded.

[0267] Step 2:

[0268] The server records the transmitted activity information in a log along with the date, and this log data is managed for each user.

[0269] Step 3:

[0270] The server analyzes the log data every certain period (e.g., one week, one month, etc.) and extracts daily routine patterns, including wake-up time, bedtime, meal times, etc.

[0271] Step 4:

[0272] The server then integrates the analysis results into the user profile and stores it as average wake-up and bedtime times, which serve as the basis for subsequent environmental adjustments.

[0273] Adjusting the home environment

[0274] Step 1:

[0275] The server determines the timing of home environment adjustments based on the analysis of the user profile and routine. For example, if a wake-up routine is registered for 6:00 a.m., the adjustments will be made at that time.

[0276] Step 2:

[0277] The server generates specific instructions to adjust the home environment (e.g., set the temperature to 22°C, brighten the lights, play music).

[0278] Step 3:

[0279] The server generates and sends instructions to devices, such as smart thermostats, smart lighting systems, and music playback devices.

[0280] Step 4:

[0281] The device then carries out the instructions it receives: for example, a smart thermostat sets the temperature to 22°C, a smart lighting system adjusts the brightness to a specified level, or a music playback device plays a specified playlist.

[0282] Health Management and Emergency Response

[0283] Step 1:

[0284] The user periodically enters health data (e.g., heart rate, blood pressure) into the application, and this information is sent to the server.

[0285] Step 2:

[0286] The server records the received health data in a profile and monitors for outliers and trends, for example, if your heart rate is consistently elevated, it will record that data.

[0287] Step 3:

[0288] If an abnormal value is detected, the server generates an emergency alert and sends corresponding instructions to the device. For example, if the heart rate reaches a dangerous level, the server sends an alert along with a notification to contacts.

[0289] Step 4:

[0290] Your device will receive emergency alerts and respond by sounding an alarm, flashing a light, or automatically sending a notification to your emergency contacts, allowing for early response.

[0291] Emotion recognition and home environment optimization

[0292] Step 1:

[0293] The emotions experienced by the user during daily activities are transmitted to the server through the application, which includes voice input and facial expression recognition using the camera.

[0294] Step 2:

[0295] The server uses an emotion engine to analyze the received information and determine the user's emotional state, such as "stressed" or "relaxed."

[0296] Step 3:

[0297] Based on the determined emotional state, the server generates instructions to adjust the home environment, such as "play relaxing music," "change the lighting to a softer color," or "set the temperature to a comfortable range."

[0298] Step 4:

[0299] The server sends the generated instructions to the terminal and adjusts the environment.

[0300] Step 5:

[0301] The device adjusts the home environment based on the received instructions: for example, a music playback device plays relaxing music, a smart lighting system changes the lighting to softer colors, and a smart thermostat sets the temperature optimally.

[0302] As a result, the present invention provides customized services according to the individual needs of users, realizing a more comfortable and safe home environment.

[0303] Example 2

[0304] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0305] Conventional home environment control systems have been unable to fully meet the individual needs of users, particularly in providing a comfortable environment that reflects the user's emotional and health status in real time. Furthermore, they lack the functionality to provide emergency response based on specific daily routines and health data. As a result, it has been difficult for users to achieve a more personalized and secure home environment.

[0306] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0307] In this invention, the server includes means for creating and updating a user profile, means for recording and analyzing the user's daily routine, means for transmitting instructions to the terminal to adjust the home environment based on the user's routine and preferences, and means for recognizing the user's emotions using an emotion engine and transmitting instructions to the terminal to adjust the home environment based on the emotions. This enables the home environment to be adjusted with high precision based on the user's individual needs and emotional state, providing a comfortable and safe living environment.

[0308] A "profile" is a data set that contains a user's personal information, preferences, and health data.

[0309] "Daily routine" refers to the activities and patterns of behavior that a user engages in at a given time.

[0310] An "emotion engine" is a software or hardware component that analyzes information such as a user's facial expressions and voice to identify their emotional state.

[0311] "Terminal" refers to a device that receives and carries out instructions to adjust the home environment.

[0312] "Health data" refers to data including biometric information such as the user's heart rate, blood pressure, and body temperature.

[0313] "Emergency response" refers to taking appropriate action when an abnormality is detected based on health data.

[0314] "Home environment adjustment" refers to optimizing temperature, lighting, music and appliance settings based on the user's profile, routine and emotional state.

[0315] A "database" is a collection of information for storing user profiles and health data.

[0316] The present invention relates to a system including means for creating and updating a user's profile, means for recording and analyzing daily routines, means for transmitting instructions to a terminal for adjusting the home environment based on the user's routines and preferences, and means for recognizing the user's emotions using an emotion engine and transmitting instructions to the terminal for adjusting the home environment based on the emotions.

[0317] The server first creates a new profile when a user registers with the system. The profile includes the user's personal information, environmental settings (e.g., temperature preferences, lighting brightness), and health data (e.g., heart rate, blood pressure). When the user enters or updates this information through the smartphone app, the server stores the information in a database.

[0318] The device monitors the user's daily routine activities at specific times and sends the data to the server for recording and analysis. For example, if the user wakes up at 6:00 every morning, the information is sent to the server via the device. The server analyzes the data collected over a period of time and identifies the user's lifestyle patterns.

[0319] The server then references the user's profile and daily routine to generate instructions for adjusting the home environment. When the user's emotion engine recognizes their emotions, that information is integrated into the profile for further personalization. For example, if a user wakes up at 6:00, the server might send instructions to the device such as "set the room temperature to 22°C," "gradually increase the brightness of the lights," and "play their favorite music when they wake up." This creates an optimal environment for the user's wake-up time.

[0320] Furthermore, the server continuously monitors the user's health data and has the ability to take emergency action if it detects any abnormalities. For example, if the heart rate becomes abnormally high, the server will send an emergency alert to the device, prompting appropriate action. In the future, this could also contribute to ensuring the safety of elderly users and those with health risks.

[0321] To recognize a user's emotions, the device uses a camera and microphone to analyze facial expressions and tone of voice, and the emotion engine analyzes that data to identify the user's emotional state. For example, if the user is feeling stressed, the server will send instructions to the device, such as "play relaxing music," "change the lighting to a soft color," and "set the temperature to a comfortable range," to provide a relaxing environment for the user.

[0322] Specific examples

[0323] When the user goes to bed at 10 p.m., the server sends instructions to the device to "gradually dim the lights and play relaxing music."

[0324] When the user wakes up at 6am, the server gradually brightens the lights and plays their preferred music.

[0325] Users measure their blood pressure periodically and enter the data into the application, which records this information and alerts them if any abnormal readings are detected.

[0326] If the emotion engine recognizes that the user is feeling stressed, the server will send instructions to the device, such as "play relaxing music," "change the lighting to a soft color," and "set the temperature to a comfortable range," to create a relaxing environment.

[0327] Prompt Sentence Examples

[0328] "For a user who wakes up at 6am every morning, create a program that sends the following instructions to the device when the user wakes up: set the room temperature to 22°C, gradually increase the brightness of the lights, and play their favorite music."

[0329] "Describe a system that, when the emotion engine recognizes that the user is stressed, sends instructions to the device to play relaxing music, change the lighting to a softer color, and set the temperature to a comfortable range."

[0330] In this way, the present invention realizes highly accurate optimization of the home environment in response to the user's individual needs and real-time conditions.

[0331] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0332] Step 1: Register and create your profile

[0333] Users register with the system through a smartphone app. The app presents the necessary information (such as name, age, gender, health information, and preferences) in a form, which the user then enters and submits.

[0334] Input: User personal information, preferences, and health data

[0335] Data processing: Convert the input data into a profile format

[0336] Output: The completed profile is generated.

[0337] Step 2: Save the profile

[0338] The server stores the received user data in a database. For example, if a user specifies "set the room temperature to 22°C," this is reflected in the profile.

[0339] Input: User personal information, preferences, and health data

[0340] Data processing: Converting data into database format

[0341] Output: Profiles stored in a database

[0342] Step 3: Record your daily routine

[0343] The device monitors the user's activity at a specific time and sends that information to the server. For example, if the user wakes up at 6:00, that information is sent.

[0344] Input: User activity data (e.g., wake-up time, bedtime)

[0345] Data processing: Record activity data in chronological order

[0346] Output: Recorded activity data is stored on the server.

[0347] Step 4: Analyzing routine data

[0348] The server analyzes the daily routine data collected over a period of time to identify the user's lifestyle patterns, for example, a tendency to wake up at 6am every morning.

[0349] Input: Recorded routine data

[0350] Data processing: Pattern analysis using data analysis algorithms

[0351] Output: Data that identifies the user's daily patterns

[0352] Step 5: Generate instructions for adjusting the home environment

[0353] The server generates environmental adjustment instructions based on the user's profile and daily routine. For example, when waking up at 6:00, instructions such as "set the room temperature to 22°C," "gradually increase the brightness of the lights," and "play your favorite music when you wake up" are generated.

[0354] Input: User profile data, routine data

[0355] Data processing: Generate configuration instructions based on instruction generation algorithms

[0356] Output: Specific instructions for the environment settings

[0357] Step 6: Sending environmental adjustment instructions

[0358] The server sends the generated instructions to the terminal, which receives them and performs specific operations on each device in the home.

[0359] Input: Environment setting instruction data

[0360] Data processing: Converts instruction data into a format that can be applied to each device

[0361] Output: Control instructions sent to each device

[0362] Step 7: Monitoring your health data

[0363] The device continuously monitors the user's health data. For example, a smartwatch measures heart rate and blood pressure and sends the data to a server.

[0364] Input: Health data such as heart rate, blood pressure, etc.

[0365] Data processing: data filtering and format conversion

[0366] Output: Health data sent to the server

[0367] Step 8: Health data analysis and emergency response

[0368] The server analyzes health data in real time and takes emergency action if an abnormal value is detected. For example, if the heart rate is abnormally high, an emergency alert will be sent to the device.

[0369] Input: Collected health data

[0370] Data processing: Data analysis using anomaly detection algorithms

[0371] Output: Anomaly detection results and emergency alerts

[0372] Step 9: Collect emotion data

[0373] The device analyzes the user's facial expressions and voice, and the emotion engine sends the data to the server, which determines the user's emotional state.

[0374] Input: facial expression data, voice data

[0375] Data processing: Analysis using emotion recognition algorithms

[0376] Output: Emotion analysis results

[0377] Step 10: Generate and send emotion-based environmental adjustment instructions

[0378] The server generates instructions for adjusting the environment based on the data from the emotion engine and sends them to the terminal, which then adjusts the home environment based on the user's emotions.

[0379] Input: Sentiment analysis result data

[0380] Data processing: Generating environmental instructions according to emotional states

[0381] Output: Sends environmental indication data to the terminal

[0382] (Application example 2)

[0383] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0384] The present invention relates to a system that comprehensively manages a user's daily routine, emotions, and health status to create an optimal home environment for the user. Conventional systems often manage individual elements (e.g., temperature and lighting) independently, making it difficult to fully consider the user's overall health management and emotional comfort. This has led to a need to ensure safety and comfort, especially for elderly users and users with health risks. Furthermore, optimizing the home environment based on the user's emotions is important for reducing stress and creating an environment for relaxation, but no system has existed that comprehensively manages these factors.

[0385] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0386] In this invention, the server includes means for creating and updating a user's profile, means for recording and analyzing the user's daily routine, means for sending instructions to the terminal to adjust the home environment based on the user's routine and preferences, means for recognizing the user's emotions and adjusting the home environment based on the emotions, and means for monitoring the user's health data and taking emergency measures when an abnormality is detected. This makes it possible to adjust and manage the home environment in an integrated manner based on the user's routine, emotions, and health data, and provide the user with a safe and comfortable living environment.

[0387] A "profile" is a database entry that contains detailed information about a user, such as their personal information, preferences, health data, and so on.

[0388] "Routine" refers to a regular pattern of activities or behaviors in a user's daily life.

[0389] "Emotion recognition" is a technology that detects the user's emotional state and responds appropriately based on that.

[0390] "Emergency response" refers to taking appropriate measures immediately when an abnormality is detected in a user's health data.

[0391] "Smart devices" is a general term for devices that can connect to the Internet and are equipped with multifunctional sensors and computing capabilities.

[0392] "Home environment adjustment" refers to the act of controlling temperature, lighting, music, and home appliances to provide a comfortable home environment for users.

[0393] A "generative AI model" is an artificial intelligence technique that generates appropriate output based on specific input data (such as a prompt).

[0394] A "prompt" is text data that is input into a generative AI model, and based on this, the model generates an appropriate output.

[0395] This invention relates to a system that manages a user's profile and adjusts the home environment based on daily routines, emotional state, and health data. The system has the following main functions:

[0396] 1. Creating and updating your user profile

[0397] The server creates a new profile when a user registers with the system. The profile includes personal information, environmental settings (e.g., temperature preferences and lighting settings), and health data (e.g., heart rate and blood pressure). When a user enters or updates this information through the application, the server stores the information in a database.

[0398] example:

[0399] If a user wants to set the room temperature to 22°C, this information is reflected in the profile and stored in the database.

[0400] 2. Recording and analyzing daily routines

[0401] The server records the user's daily activities. This is the process of collecting activities at specific times (e.g., waking up, going to bed, etc.). If the user performs an activity at a specific time (e.g., waking up at 06:00), the information is sent to the server and recorded as the user's routine. The server analyzes the data collected over a period of time to identify the user's lifestyle patterns.

[0402] example:

[0403] If a user tends to wake up at 6:00 every morning, the server will store "average wake-up time 06:00" in their profile.

[0404] 3. Adjusting the home environment

[0405] The server generates instructions for adjusting the home environment based on the user's profile and daily routine. When the user's emotion engine recognizes emotions, it integrates this information into the user's profile for further personalization.

[0406] example:

[0407] If the user wakes up at 6:00, the server will send instructions to the device to match that time, such as "set the room temperature to 22°C," "gradually brighten the lights," and "play your favorite music when you wake up." This creates the optimal environment for the user when they wake up.

[0408] 4. Health Management and Emergency Response

[0409] The server monitors the user's health data (e.g., heart rate and blood pressure) and takes emergency action if it detects any abnormalities, ensuring the safety of elderly users and those with health risks.

[0410] example:

[0411] If the user's heart rate becomes abnormally high, the server will send an emergency alert to the device, prompting them to take appropriate action.

[0412] 5. Emotion Recognition and Home Environment Optimization

[0413] The server uses an emotion engine to recognize the user's emotions and adjusts the home environment based on the emotions.

[0414] example:

[0415] When the emotion engine recognizes that the user is feeling stressed, the server sends instructions to the device, such as "play relaxing music," "change the lighting to a softer color," and "set the temperature to a comfortable range." This reduces the user's stress and provides a relaxing environment.

[0416] Hardware and software used

[0417] Smart Device: A device that can connect to the Internet and has multiple sensor and computing capabilities (e.g., smartphone, smart glasses).

[0418] Server: A server that manages user profiles, analyzes data, monitors health data, etc.

[0419] Generative AI model: An artificial intelligence model that recognizes user emotions and generates appropriate output based on prompts (text data).

[0420] Examples of concrete examples and prompts

[0421] Examples:

[0422] When the user goes to bed at 10 p.m., the server sends instructions to the device to gradually dim the lights and play relaxing music.

[0423] The server also gradually brightens the lights and plays the user's favorite music to wake them up at 6:00 a.m., when the user wakes up.

[0424] Example prompt sentence:

[0425] The user puts on the smart glasses and sends the instruction "Dim the lights in the living room in 5 minutes and play relaxing music" to the system.

[0426] As a result, the present invention provides customized services according to the individual needs of users, realizing a more comfortable and safe home environment.

[0427] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0428] Step 1:

[0429] Creating and updating user profiles

[0430] The server receives input from the user and creates a new profile. Specifically, the user enters personal information, environmental settings, and health data via a smartphone or smart glasses, and the server stores this in a database. Inputs include temperature preferences, lighting settings, heart rate, blood pressure, etc. The server analyzes this data and stores it in the database in an appropriate format.

[0431] (input)

[0432] Your personal information, preferences, and health data

[0433] (output)

[0434] User profiles stored in a database

[0435] Step 2:

[0436] Recording and analyzing daily routines

[0437] The server continuously monitors and records the user's daily activities. Specifically, the server receives data such as wake-up and bedtime sent from the smart device and stores it in a database. The server analyzes the data collected over a certain period of time to identify the user's lifestyle patterns. For example, if a user tends to wake up at 6:00 a.m. every morning, it records that time as the "average wake-up time."

[0438] (input)

[0439] Daily activity data such as wake-up time and bedtime

[0440] (output)

[0441] Life patterns stored in a database

[0442] Step 3:

[0443] Adjusting the home environment

[0444] The server generates instructions for adjusting the home environment based on the user's profile and daily routine. Specifically, the server analyzes the profile data and lifestyle patterns to determine optimal environmental conditions such as lighting, temperature, and music settings. This information is sent to the device, and the home environment is automatically adjusted.

[0445] (input)

[0446] User profile, lifestyle pattern data

[0447] (output)

[0448] Home environment adjustment instructions sent to the device

[0449] Step 4:

[0450] Emotion recognition and home environment optimization

[0451] The server uses a generative AI model to recognize the user's emotions. Specifically, it analyzes emotional data such as voice and facial expressions sent from the smart device to identify the user's emotional state (e.g., stress). Based on the emotional state, the server generates instructions to optimize the home environment. For example, if the user is feeling stressed, the server sends instructions to the device to play relaxing music and change the lighting to a softer color.

[0452] (input)

[0453] Emotional data such as voice and facial expressions

[0454] (output)

[0455] Emotion-based environmental adjustment instructions sent to the device

[0456] Step 5:

[0457] Health Management and Emergency Response

[0458] The server monitors the user's health data in real time, receiving heart rate and blood pressure data sent from the smart device and generating an emergency alert if an abnormal value is detected. For example, if the heart rate is abnormally high, the server sends an emergency alert to the device, prompting the user to take appropriate action.

[0459] (input)

[0460] Heart rate and blood pressure data

[0461] (output)

[0462] Emergency alert generation and transmission

[0463] Step 6:

[0464] Generate and send prompt statements

[0465] The server uses the generative AI model to generate appropriate prompts when adjusting the home environment or responding to emergencies, thereby providing users with easy-to-understand instructions and warnings. Specifically, the prompts are generated and displayed on the smart device screen.

[0466] (input)

[0467] Home environment adjustment instruction data, emergency alert data

[0468] (output)

[0469] Prompt text displayed on smart devices

[0470] This allows the system to provide the optimal home environment according to the user's situation, ensuring the user's safety and comfort.

[0471] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0472] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0473] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0474] [Second embodiment]

[0475] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0476] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0477] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0478] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0479] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0480] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0481] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0482] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0483] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0484] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0485] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0486] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0487] The present invention relates to a system including a means for creating and updating a user's profile, a means for recording and analyzing the user's daily routine, and a means for transmitting instructions to a terminal for adjusting the home environment based on the user's routine and preferences. Specific embodiments are described below.

[0488] 1. Creating and updating your user profile

[0489] The server creates a new user profile when a user registers with the system. The user profile includes the user's personal information, environmental settings (e.g., temperature preferences, lighting brightness), and health data (e.g., heart rate, blood pressure). When the user enters or updates this information through the application, the server stores the information in a database. For example, if the user specifies "set room temperature to 22°C," the server reflects this information in the profile and stores it in the database.

[0490] 2. Recording and analyzing daily routines

[0491] The server records the user's daily activities. This is the process of collecting activities at specific times (e.g., waking up, going to bed, eating, etc.). If the user "wakes up at 06:00," that information is sent to the server and recorded as the user's routine. The server analyzes the data collected over a certain period of time to identify the user's lifestyle patterns. For example, if the server registers a tendency to wake up at 6:00 every morning, it will save the user's "average wake-up time as 06:00" in the profile.

[0492] 3. Adjusting the home environment

[0493] The server generates appropriate instructions for adjusting the home environment based on the user's profile and daily routine. For example, if the user wakes up at 6:00, the server will send instructions to the device to adjust the room temperature to 22°C, gradually brighten the lights, and play the user's favorite music when they wake up. This creates an optimal environment for the user when they wake up.

[0494] 4. Health Management and Emergency Response

[0495] The server monitors the user's health data (e.g., heart rate, blood pressure) and takes emergency action if it detects any abnormalities. For example, if the user's heart rate becomes abnormally high, the server sends an emergency alert to the device, prompting appropriate action. This ensures the safety of elderly users and those with health risks.

[0496] Specific examples

[0497] When the user goes to bed at 10 p.m., the server sends instructions to the device to gradually dim the lights and play relaxing music.

[0498] When the user wakes up at 6 a.m., the server gradually brightens the lights and plays their favorite music to wake them up.

[0499] Users measure their blood pressure periodically and enter the data into the application, which records this information and alerts them if any abnormal readings are detected.

[0500] As a result, the present invention provides customized services according to the individual needs of users, realizing a more comfortable and safe home environment.

[0501] The processing flow will be explained below.

[0502] Creating and updating user profiles

[0503] Step 1:

[0504] When a user registers with the system, they enter basic information (such as name, age, and gender) through the application. After completing this information entry, it is sent to the server.

[0505] Step 2:

[0506] The server uses the submitted information to create a new user profile, which includes initial environmental settings (temperature, lighting, music, etc.) and health data.

[0507] Step 3:

[0508] When a user updates their preferences or health data through the application, the new information is sent to the server, for example, specifying "set room temperature to 22°C."

[0509] Step 4:

[0510] The server then updates the user profile with the received information and stores it in the database, ensuring that the latest information is available the next time the user accesses the site.

[0511] Recording and analyzing daily routines

[0512] Step 1:

[0513] When a user performs a specific activity, the information (e.g., the time of waking up, going to bed, etc.) is sent to the server through the application. For example, "Waking up at 06:00" is recorded.

[0514] Step 2:

[0515] The server records the transmitted activity information in a log along with the date, and this log data is managed for each user.

[0516] Step 3:

[0517] The server analyzes the log data every certain period (e.g., one week, one month, etc.) and extracts daily routine patterns, including wake-up time, bedtime, meal times, etc.

[0518] Step 4:

[0519] The server then integrates the analysis results into the user profile and stores it as average wake-up and bedtime times, which serve as the basis for subsequent environmental adjustments.

[0520] Adjusting the home environment

[0521] Step 1:

[0522] The server determines the timing of home environment adjustments based on the analysis of the user profile and routine. For example, if a wake-up routine is registered for 6:00 a.m., the adjustments will be made at that time.

[0523] Step 2:

[0524] The server generates specific instructions to adjust the home environment (e.g., set the temperature to 22°C, brighten the lights, play music).

[0525] Step 3:

[0526] The server generates and sends instructions to devices, such as smart thermostats, smart lighting systems, and music playback devices.

[0527] Step 4:

[0528] The device then carries out the instructions it receives: for example, a smart thermostat sets the temperature to 22°C, a smart lighting system adjusts the brightness to a specified level, or a music playback device plays a specified playlist.

[0529] Health Management and Emergency Response

[0530] Step 1:

[0531] The user periodically enters health data (e.g., heart rate, blood pressure) into the application, and this information is sent to the server.

[0532] Step 2:

[0533] The server records the received health data in a profile and monitors for outliers and trends, for example, if your heart rate is consistently elevated, it will record that data.

[0534] Step 3:

[0535] If an abnormal value is detected, the server generates an emergency alert and sends corresponding instructions to the device. For example, if the heart rate reaches a dangerous level, the server sends an alert along with a notification to contacts.

[0536] Step 4:

[0537] Your device will receive emergency alerts and respond by sounding an alarm, flashing a light, or automatically sending a notification to your emergency contacts, allowing for early response.

[0538] Example 1

[0539] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0540] In today's home environment, it is difficult to provide customized services that meet the individual needs and preferences of users. In addition, health data monitoring and emergency response may be delayed, making it difficult to ensure safety, especially for elderly users and those with health risks.

[0541] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0542] In this invention, the server includes server means for creating and updating a user's profile, server means for recording the user's daily routine, data analysis means for analyzing the recorded daily routine data and identifying the user's routine, server means for transmitting instructions to the terminal for adjusting the home environment based on the user's profile and daily routine, and terminal means for receiving instructions from the terminal and adjusting the home environment in accordance with the instructions. This makes it possible to provide an optimal home environment that meets the individual needs of the user, as well as to monitor health data and respond quickly to emergencies.

[0543] A "user profile" is a collection of data about a user, including the user's personal information, preferences, health data, etc.

[0544] The "server means" is a server device that has the functions of receiving, storing, analyzing, and generating instructions on data.

[0545] The "terminal means" is a device that receives instructions sent from the server and executes operations in accordance with those instructions.

[0546] The "data analysis means" is a means having the function of analyzing the recorded data of daily life and identifying the user's life patterns and routines.

[0547] "Daily life routine" means a user's daily activity patterns and schedules (e.g., wake-up time, bedtime, meal times, etc.).

[0548] The "home environment" includes the temperature, lighting, music, and the state of home appliances in the user's living environment.

[0549] "Health data" refers to data that indicates the user's health condition, such as heart rate and blood pressure.

[0550] "Abnormal value" means a value in a user's health data that deviates from the normal range.

[0551] "Emergency response" refers to the process of quickly issuing an alert and taking appropriate measures when abnormal values ​​are detected.

[0552] The present invention is a system that creates and updates a user's profile, records and analyzes daily routines, and adjusts the home environment according to the user's needs.

[0553] First, the creation and updating of user profiles is done by the server. When a user logs in or registers to the application, the server receives the user's personal information (e.g., name, age, contact details, etc.) and stores it in a database. For example, database management is done using MySQL. When the user enters their environmental settings (e.g., preferred temperature, lighting brightness), the server reflects this in the profile and stores it in the database. Health data (e.g., heart rate, blood pressure) is also entered and stored in the same way.

[0554] Next, daily routines are recorded either by the user entering them into the application or automatically through a measurement device such as a smartwatch. The server receives this data and records it in a database along with date and time information. For data analysis, Python and Pandas are used to analyze the recorded daily data and identify the user's lifestyle patterns. For example, routine information such as "wake up at 6:00 every day" is added to the profile and saved in the database.

[0555] When adjusting the home environment, the server generates appropriate environmental adjustment instructions based on the user's profile and daily routine. For example, if the user has the habit of waking up at 6:00, the server sends instructions to the device such as "set the room temperature to 22°C," "gradually brighten the lights," and "play your favorite music when you wake up." This is done using Node.js and the MQTT protocol. The device receives these instructions and actually adjusts the environment. For example, a smart thermostat is used to adjust the temperature, and smart lights are used to adjust the lighting.

[0556] Finally, regarding health data monitoring and response, the server monitors the user's health data in real time and takes emergency action if an abnormality is detected. This includes sending alerts to emergency contacts using Twilio and sending "emergency response instructions" to the device. This ensures the safety of elderly users and those with health risks.

[0557] Examples:

[0558] When the user goes to bed at 10 p.m., the server sends instructions to the device to gradually dim the lights and play relaxing music.

[0559] When the user wakes up at 6am, the server gradually brightens the lights and plays their favorite music to wake them up.

[0560] Users measure their blood pressure periodically and enter the data into the application, which records this information and alerts them if any abnormal readings are detected.

[0561] Example prompts to input to a generative AI model:

[0562] "For a user who wakes up at 6am every day, please explain the flow to set the room temperature to 22°C, gradually increase the brightness of the lights, and play their favorite music to coincide with their wake-up time."

[0563] As described above, the present invention provides customized services according to the individual needs of users, thereby realizing a more comfortable and safe home environment.

[0564] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0565] Step 1:

[0566] A user logs in or signs up for the app.

[0567] Specific operation: The user launches the app, clicks the "New Registration" button, and enters their name, age, and contact information.

[0568] Input: Personal information entered by the user (e.g., name, age, contact details).

[0569] Output: The user's personal information record that the server stores in the database.

[0570] Step 2:

[0571] The server receives the user's personal information and stores it in a database.

[0572] Specific operation: The server uses MySQL to record the received personal information in a database.

[0573] Input: Personal information entered by the user.

[0574] Output: The user's personal information record stored in the database.

[0575] Step 3:

[0576] The user uses the application to enter environmental settings (e.g., temperature preference, lighting brightness).

[0577] Specific operation: The user enters something like "Set room temperature to 22°C" on the "Settings" screen and presses the save button.

[0578] Input: Preference information entered by the user.

[0579] Output: A preference record that the server stores in the database.

[0580] Step 4:

[0581] The server receives the configuration information and updates the user profile.

[0582] What happens: The server adds the preference information to the profile and saves it in the database.

[0583] Input: Preference information entered by the user.

[0584] Output: The updated user profile record.

[0585] Step 5:

[0586] The user uses the application to input daily routines (e.g., waking up, going to bed, eating).

[0587] Specific operation: The user enters "Wake up at 06:00" in the app and presses the save button.

[0588] Input: Daily life routine information entered by the user.

[0589] Output: Routine data that the server stores in the database.

[0590] Step 6:

[0591] The server receives data on daily life and records it in a database along with date and time information.

[0592] Specific operation: The server saves the routine data in a database with a timestamp.

[0593] Input: Routine data entered by the user.

[0594] Output: Timestamped routine data stored in a database.

[0595] Step 7:

[0596] The server collects routine data over a period of time and performs data analysis.

[0597] What happens: The server uses Python and Pandas to analyze the data and identify patterns such as "average wake-up time is 06:00."

[0598] Input: Routine data for a period of time extracted from a database.

[0599] Output: User's life patterns as an analysis result.

[0600] Step 8:

[0601] The server reflects the analysis results in the user profile and stores them in a database.

[0602] Specific operation: The server adds the analysis results to the profile and stores it in the database.

[0603] Input: Data analysis results.

[0604] Output: The updated user profile.

[0605] Step 9:

[0606] The server generates instructions for adjusting the home environment based on the user's profile and lifestyle patterns.

[0607] Specific operation: The server generates instructions such as "set the room temperature to 22°C at 6:00" and "gradually brighten the lights."

[0608] Input: User profile and lifestyle pattern data.

[0609] Output: Generated home environment adjustment instructions.

[0610] Step 10:

[0611] The server transmits a home environment adjustment instruction to the terminal.

[0612] Specific operation: The server sends instructions to the terminal using the MQTT protocol.

[0613] Input: Generated home environment adjustment instructions.

[0614] Output: Adjustment instructions sent to the terminal.

[0615] Step 11:

[0616] The terminal receives instructions from the server and executes the instructions.

[0617] Specific operation: The device controls smart thermostats and smart lights to adjust the environment.

[0618] Input: Adjustment instructions from the server.

[0619] Output: The environmental adjustments performed.

[0620] Step 12:

[0621] The user periodically inputs or transmits health data (heart rate, blood pressure, etc.) from a measurement device.

[0622] Specific actions: The user enters blood pressure into the application, and the smartwatch transmits the data.

[0623] Input: User's health data.

[0624] Output: Health data records that the server stores in a database.

[0625] Step 13:

[0626] The server monitors health data and takes emergency action if abnormal values ​​are detected.

[0627] What it does: The server monitors health data in real time, and if it detects any abnormal values, it uses Twilio to send an alert to emergency contacts and send appropriate instructions to the device.

[0628] Input: Health data captured in real time.

[0629] Output: Alerts and instructions on how to respond in the event of an abnormality.

[0630] Through these steps, customized services can be provided according to the individual needs of the user, realizing a more comfortable and safe home environment.

[0631] (Application example 1)

[0632] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0633] Conventional home environment control systems struggle to adjust the environment appropriately based on individual user preferences and daily routines. They also lack the ability to respond quickly in emergencies or monitor users' health data. Furthermore, food delivery services lack personalization and do not provide services based on individual mealtimes or food preferences.

[0634] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0635] In this invention, the server includes means for creating and updating a user's profile, means for recording and analyzing the user's daily routine, means for sending instructions to the terminal for adjusting the home environment based on the user's routine and preferences, and means for utilizing the user's behavioral data to provide personalized services, thereby enabling the optimal adjustment of the home environment according to the user's individual needs and preferences, rapid response in emergencies, and provision of food delivery services based on meal times and preferences.

[0636] A "user profile" is detailed information describing a particular user, including information such as personal preferences, lifestyle habits, and health status.

[0637] "Daily routine" refers to the pattern of activities and behavior that a user regularly performs.

[0638] "Adjusting the home environment" refers to controlling the indoor temperature, lighting, music, home appliances, etc. to improve the user's comfort and convenience.

[0639] A "terminal" is a communication device used by a user, such as a smartphone, tablet, or smart device.

[0640] A "database" is a storage device for storing and managing a user's profile and daily routine.

[0641] "Personalized service provision" means providing services that are customized based on the specific needs and preferences of each individual user.

[0642] "Behavioral data" refers to data about a user's activities and preferences, including a history of specific behaviors.

[0643] The "food delivery function" is a service that delivers appropriate meals based on the user's meal preferences and time.

[0644] "Emergency response" refers to measures to issue prompt warnings and notifications when an abnormality occurs in the user's health condition.

[0645] "Meal suggestions" refers to suggesting optimal meal menus based on the user's past data and preferences.

[0646] This invention relates to a system including means for creating and updating a user's profile, means for recording and analyzing the user's daily routine, and means for sending instructions to a terminal for adjusting the home environment based on the user's routine and preferences, and further includes means for utilizing the user's behavioral data to provide personalized services.

[0647] Creating and updating user profiles

[0648] The server creates a new user profile when a user registers with the system, which includes personal information, preferences, dietary preferences, allergy information, and past order history. When a user enters or updates this information through the smartphone app, the server stores this information in a database.

[0649] Recording and analyzing daily routines

[0650] The server records the user's daily activities sent from the smartphone app. The server collects the user's activities at specific times (e.g., waking up, eating, going to bed, etc.) and stores them in a database. The server analyzes the collected data over a period of time to identify the user's lifestyle patterns and eating routines.

[0651] Personalized Food Delivery

[0652] The server will then suggest appropriate meals based on the user's profile and daily routine. For example, if the user specifies in their profile that they would like to have breakfast at 6:00, the server will send a food delivery notification to their smartphone at that time. The notification will say something like, "Your personalized breakfast will be delivered soon."

[0653] Health Management and Emergency Response

[0654] The server monitors health data (e.g., heart rate, blood pressure) obtained from the smartphone app. If an abnormality is detected, the server sends an emergency alert to the device and notifies pre-defined contacts.

[0655] Hardware and software used

[0656] Hardware: Smartphones, communication infrastructure, servers

[0657] Software: SQLite database, Python script, notification sending module

[0658] Specific examples

[0659] For example, if User A is a vegetarian and has a habit of eating dinner at 6:00 PM every day, the server will send a notification to the user's smartphone at 5:45 PM every day, saying, "Your vegetarian dinner will be delivered soon." If User A experiences any abnormalities in their heart rate, the server will immediately send an emergency notification to prompt the user to take appropriate action.

[0660] Example prompts for generative AI models

[0661] "User A is a vegetarian and wants to eat dinner at 6 PM every day. Create a profile for User A and create a program to send personalized notifications at their preferred times. Also, add the ability to send emergency alerts.

[0662] Meal routine: Dinner at 6pm

[0663] Food preference: Vegetarian

[0664] Allergy information: None

[0665] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0666] Step 1:

[0667] When a user creates an account through a smartphone app, the server generates a new user profile. The data entered by the user, such as personal information, preferences, dietary preferences, and allergy information, is sent to the server. The server stores the data in an SQLite database. This process creates a user profile and prepares the basic data required for subsequent processing.

[0668] Step 2:

[0669] The server receives behavioral data sent from the smartphone app to record the user's daily routine. For example, the user sends information to the server about when they wake up, eat, and go to bed at specific times. The server then stores this data in a database and analyzes their lifestyle patterns over a period of time. This process clarifies the user's routine and provides the basis for providing appropriate services.

[0670] Step 3:

[0671] The server generates instructions for personalized home environment and food delivery services based on the analyzed user's daily routine and profile. For example, if the user tends to wake up at 6 a.m., the server generates instructions for sending notifications at that time. This process ensures that notifications and services are provided at the optimal time for the user.

[0672] Step 4:

[0673] The server sends instructions to the terminal to adjust the home environment. For example, it issues instructions to set the room temperature or lighting brightness as desired by the user. This instruction is transmitted from the terminal to smart devices in the home, which actually adjust the home environment. This process improves the user's comfort.

[0674] Step 5:

[0675] The server receives and monitors the user's health data from the smartphone app. Data such as heart rate and blood pressure is periodically sent to the server. The server analyzes the received data and sends an emergency alert to the device if an abnormality is detected. This process ensures the user's safety.

[0676] Step 6:

[0677] The server processes the notification of personalized meal suggestions according to the user's mealtime. For example, if the user has a habit of eating dinner at 6:00 p.m., the server generates instructions to automatically send a notification at 5:45 p.m. The notification includes a message such as "Your personalized dinner will arrive soon." This process allows the user to receive information at the appropriate time.

[0678] Step 7:

[0679] The server performs the procedures to execute the food delivery service. Based on the user's profile and routine, it suggests available menu items and sends notifications. If the user accepts the meal suggestion, the notification confirms the order and instructs the delivery to be prepared. This process results in a food delivery that meets the user's needs.

[0680] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0681] The present invention relates to a system including a means for creating and updating a user's profile, a means for recording and analyzing the user's daily routine, and a means for sending instructions to a terminal to adjust the home environment based on the user's routine and preferences. The present invention also includes a means for monitoring and storing the user's health data, a means for responding to emergencies based on the health data, and a means for controlling temperature, lighting, music, and home appliances in adjusting the home environment. Additionally, by combining this with an emotion engine that recognizes the user's emotions, the system realizes optimization of the home environment based on the user's emotions.

[0682] 1. Creating and updating your user profile

[0683] The server creates a new user profile when a user registers with the system. The user profile includes the user's personal information, environmental settings (e.g., temperature preferences, lighting brightness), and health data (e.g., heart rate, blood pressure). When the user enters or updates this information through the application, the server stores the information in a database. For example, if the user specifies "set room temperature to 22°C," the server reflects this information in the profile and stores it in the database.

[0684] 2. Recording and analyzing daily routines

[0685] The server records the user's daily activities. This is the process of collecting activities at specific times (e.g., waking up, going to bed, etc.). If the user "wakes up at 06:00," that information is sent to the server and recorded as the user's routine. The server analyzes the data collected over a certain period of time to identify the user's lifestyle patterns. For example, if the server registers a tendency to wake up at 6:00 every morning, it will save the user's "average wake-up time as 06:00" in the profile.

[0686] 3. Adjusting the home environment

[0687] The server generates instructions for adjusting the home environment based on the user's profile and daily routine. When the user's emotion engine recognizes their emotion, it integrates that information into the user's profile for further personalization. For example, if the user wakes up at 6:00, the server will send instructions to the device to adjust the room temperature to 22°C, gradually brighten the lights, and play their favorite music when they wake up. This creates an optimal environment for the user's wake-up time.

[0688] 4. Health Management and Emergency Response

[0689] The server monitors the user's health data (e.g., heart rate, blood pressure) and takes emergency action if it detects any abnormalities. For example, if the user's heart rate becomes abnormally high, the server sends an emergency alert to the device, prompting appropriate action. This ensures the safety of elderly users and those with health risks.

[0690] 5. Emotion Recognition and Home Environment Optimization

[0691] The server uses an emotion engine to recognize the user's emotions and adjusts the home environment based on those emotions. For example, if the emotion engine recognizes that the user is feeling stressed, the server will send instructions to the device, such as "play relaxing music," "change the lighting to a softer color," and "set the temperature to a comfortable range." This reduces the user's stress and provides a relaxing environment.

[0692] Specific examples

[0693] When the user goes to bed at 10 p.m., the server sends instructions to the device to gradually dim the lights and play relaxing music.

[0694] When the user wakes up at 6 a.m., the server gradually brightens the lights and plays their favorite music to wake them up.

[0695] Users measure their blood pressure periodically and enter the data into the application, which records this information and alerts them if any abnormal readings are detected.

[0696] If the server detects that the user is feeling stressed, it sends instructions to the device to adjust the appropriate environmental settings (e.g., temperature, lighting, music) to create a relaxing environment.

[0697] As a result, the present invention provides customized services according to the individual needs of users, realizing a more comfortable and safe home environment.

[0698] The processing flow will be explained below.

[0699] Creating and updating user profiles

[0700] Step 1:

[0701] When a user registers with the system, they enter basic information (such as name, age, and gender) through the application. After completing this information entry, it is sent to the server.

[0702] Step 2:

[0703] The server uses the submitted information to create a new user profile, which includes initial environmental settings (temperature, lighting, music, etc.) and health data.

[0704] Step 3:

[0705] When a user updates their preferences or health data through the application, the new information is sent to the server, for example, specifying "set room temperature to 22°C."

[0706] Step 4:

[0707] The server then updates the user profile with the received information and stores it in the database, ensuring that the latest information is available the next time the user accesses the site.

[0708] Recording and analyzing daily routines

[0709] Step 1:

[0710] When a user performs a specific activity, the information (e.g., the time of waking up, going to bed, etc.) is sent to the server through the application. For example, "Waking up at 06:00" is recorded.

[0711] Step 2:

[0712] The server records the transmitted activity information in a log along with the date, and this log data is managed for each user.

[0713] Step 3:

[0714] The server analyzes the log data every certain period (e.g., one week, one month, etc.) and extracts daily routine patterns, including wake-up time, bedtime, meal times, etc.

[0715] Step 4:

[0716] The server then integrates the analysis results into the user profile and stores it as average wake-up and bedtime times, which serve as the basis for subsequent environmental adjustments.

[0717] Adjusting the home environment

[0718] Step 1:

[0719] The server determines the timing of home environment adjustments based on the analysis of the user profile and routine. For example, if a wake-up routine is registered for 6:00 a.m., the adjustments will be made at that time.

[0720] Step 2:

[0721] The server generates specific instructions to adjust the home environment (e.g., set the temperature to 22°C, brighten the lights, play music).

[0722] Step 3:

[0723] The server generates and sends instructions to devices, such as smart thermostats, smart lighting systems, and music playback devices.

[0724] Step 4:

[0725] The device then carries out the instructions it receives: for example, a smart thermostat sets the temperature to 22°C, a smart lighting system adjusts the brightness to a specified level, or a music playback device plays a specified playlist.

[0726] Health Management and Emergency Response

[0727] Step 1:

[0728] The user periodically enters health data (e.g., heart rate, blood pressure) into the application, and this information is sent to the server.

[0729] Step 2:

[0730] The server records the received health data in a profile and monitors for outliers and trends, for example, if your heart rate is consistently elevated, it will record that data.

[0731] Step 3:

[0732] If an abnormal value is detected, the server generates an emergency alert and sends corresponding instructions to the device. For example, if the heart rate reaches a dangerous level, the server sends an alert along with a notification to contacts.

[0733] Step 4:

[0734] Your device will receive emergency alerts and respond by sounding an alarm, flashing a light, or automatically sending a notification to your emergency contacts, allowing for early response.

[0735] Emotion recognition and home environment optimization

[0736] Step 1:

[0737] The emotions experienced by the user during daily activities are transmitted to the server through the application, which includes voice input and facial expression recognition using the camera.

[0738] Step 2:

[0739] The server uses an emotion engine to analyze the received information and determine the user's emotional state, such as "stressed" or "relaxed."

[0740] Step 3:

[0741] Based on the determined emotional state, the server generates instructions to adjust the home environment, such as "play relaxing music," "change the lighting to a softer color," or "set the temperature to a comfortable range."

[0742] Step 4:

[0743] The server sends the generated instructions to the terminal and adjusts the environment.

[0744] Step 5:

[0745] The device adjusts the home environment based on the received instructions: for example, a music playback device plays relaxing music, a smart lighting system changes the lighting to softer colors, and a smart thermostat sets the temperature optimally.

[0746] As a result, the present invention provides customized services according to the individual needs of users, realizing a more comfortable and safe home environment.

[0747] Example 2

[0748] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0749] Conventional home environment control systems have been unable to fully meet the individual needs of users, particularly in providing a comfortable environment that reflects the user's emotional and health status in real time. Furthermore, they lack the functionality to provide emergency response based on specific daily routines and health data. As a result, it has been difficult for users to achieve a more personalized and secure home environment.

[0750] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0751] In this invention, the server includes means for creating and updating a user profile, means for recording and analyzing the user's daily routine, means for transmitting instructions to the terminal to adjust the home environment based on the user's routine and preferences, and means for recognizing the user's emotions using an emotion engine and transmitting instructions to the terminal to adjust the home environment based on the emotions. This enables the home environment to be adjusted with high precision based on the user's individual needs and emotional state, providing a comfortable and safe living environment.

[0752] A "profile" is a data set that contains a user's personal information, preferences, and health data.

[0753] "Daily routine" refers to the activities and patterns of behavior that a user engages in at a given time.

[0754] An "emotion engine" is a software or hardware component that analyzes information such as a user's facial expressions and voice to identify their emotional state.

[0755] "Terminal" refers to a device that receives and carries out instructions to adjust the home environment.

[0756] "Health data" refers to data including biometric information such as the user's heart rate, blood pressure, and body temperature.

[0757] "Emergency response" refers to taking appropriate action when an abnormality is detected based on health data.

[0758] "Home environment adjustment" refers to optimizing temperature, lighting, music and appliance settings based on the user's profile, routine and emotional state.

[0759] A "database" is a collection of information for storing user profiles and health data.

[0760] The present invention relates to a system including means for creating and updating a user's profile, means for recording and analyzing daily routines, means for transmitting instructions to a terminal for adjusting the home environment based on the user's routines and preferences, and means for recognizing the user's emotions using an emotion engine and transmitting instructions to the terminal for adjusting the home environment based on the emotions.

[0761] The server first creates a new profile when a user registers with the system. The profile includes the user's personal information, environmental settings (e.g., temperature preferences, lighting brightness), and health data (e.g., heart rate, blood pressure). When the user enters or updates this information through the smartphone app, the server stores the information in a database.

[0762] The device monitors the user's daily routine activities at specific times and sends the data to the server for recording and analysis. For example, if the user wakes up at 6:00 every morning, the information is sent to the server via the device. The server analyzes the data collected over a period of time and identifies the user's lifestyle patterns.

[0763] The server then references the user's profile and daily routine to generate instructions for adjusting the home environment. When the user's emotion engine recognizes their emotions, that information is integrated into the profile for further personalization. For example, if a user wakes up at 6:00, the server might send instructions to the device such as "set the room temperature to 22°C," "gradually increase the brightness of the lights," and "play their favorite music when they wake up." This creates an optimal environment for the user's wake-up time.

[0764] Furthermore, the server continuously monitors the user's health data and has the ability to take emergency action if it detects any abnormalities. For example, if the heart rate becomes abnormally high, the server will send an emergency alert to the device, prompting appropriate action. In the future, this could also contribute to ensuring the safety of elderly users and those with health risks.

[0765] To recognize a user's emotions, the device uses a camera and microphone to analyze facial expressions and tone of voice, and the emotion engine analyzes that data to identify the user's emotional state. For example, if the user is feeling stressed, the server will send instructions to the device, such as "play relaxing music," "change the lighting to a soft color," and "set the temperature to a comfortable range," to provide a relaxing environment for the user.

[0766] Specific examples

[0767] When the user goes to bed at 10 p.m., the server sends instructions to the device to "gradually dim the lights and play relaxing music."

[0768] When the user wakes up at 6am, the server gradually brightens the lights and plays their preferred music.

[0769] Users measure their blood pressure periodically and enter the data into the application, which records this information and alerts them if any abnormal readings are detected.

[0770] If the emotion engine recognizes that the user is feeling stressed, the server will send instructions to the device, such as "play relaxing music," "change the lighting to a soft color," and "set the temperature to a comfortable range," to create a relaxing environment.

[0771] Prompt Sentence Examples

[0772] "For a user who wakes up at 6am every morning, create a program that sends the following instructions to the device when the user wakes up: set the room temperature to 22°C, gradually increase the brightness of the lights, and play their favorite music."

[0773] "Describe a system that, when the emotion engine recognizes that the user is stressed, sends instructions to the device to play relaxing music, change the lighting to a softer color, and set the temperature to a comfortable range."

[0774] In this way, the present invention realizes highly accurate optimization of the home environment in response to the user's individual needs and real-time conditions.

[0775] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0776] Step 1: Register and create your profile

[0777] Users register with the system through a smartphone app. The app presents the necessary information (such as name, age, gender, health information, and preferences) in a form, which the user then enters and submits.

[0778] Input: User personal information, preferences, and health data

[0779] Data processing: Convert the input data into a profile format

[0780] Output: The completed profile is generated.

[0781] Step 2: Save the profile

[0782] The server stores the received user data in a database. For example, if a user specifies "set the room temperature to 22°C," this is reflected in the profile.

[0783] Input: User personal information, preferences, and health data

[0784] Data processing: Converting data into database format

[0785] Output: Profiles stored in a database

[0786] Step 3: Record your daily routine

[0787] The device monitors the user's activity at a specific time and sends that information to the server. For example, if the user wakes up at 6:00, that information is sent.

[0788] Input: User activity data (e.g., wake-up time, bedtime)

[0789] Data processing: Record activity data in chronological order

[0790] Output: Recorded activity data is stored on the server.

[0791] Step 4: Analyzing routine data

[0792] The server analyzes the daily routine data collected over a period of time to identify the user's lifestyle patterns, for example, a tendency to wake up at 6am every morning.

[0793] Input: Recorded routine data

[0794] Data processing: Pattern analysis using data analysis algorithms

[0795] Output: Data that identifies the user's daily patterns

[0796] Step 5: Generate instructions for adjusting the home environment

[0797] The server generates environmental adjustment instructions based on the user's profile and daily routine. For example, when waking up at 6:00, instructions such as "set the room temperature to 22°C," "gradually increase the brightness of the lights," and "play your favorite music when you wake up" are generated.

[0798] Input: User profile data, routine data

[0799] Data processing: Generate configuration instructions based on instruction generation algorithms

[0800] Output: Specific instructions for the environment settings

[0801] Step 6: Sending environmental adjustment instructions

[0802] The server sends the generated instructions to the terminal, which receives them and performs specific operations on each device in the home.

[0803] Input: Environment setting instruction data

[0804] Data processing: Converts instruction data into a format that can be applied to each device

[0805] Output: Control instructions sent to each device

[0806] Step 7: Monitoring your health data

[0807] The device continuously monitors the user's health data. For example, a smartwatch measures heart rate and blood pressure and sends the data to a server.

[0808] Input: Health data such as heart rate, blood pressure, etc.

[0809] Data processing: data filtering and format conversion

[0810] Output: Health data sent to the server

[0811] Step 8: Health data analysis and emergency response

[0812] The server analyzes health data in real time and takes emergency action if an abnormal value is detected. For example, if the heart rate is abnormally high, an emergency alert will be sent to the device.

[0813] Input: Collected health data

[0814] Data processing: Data analysis using anomaly detection algorithms

[0815] Output: Anomaly detection results and emergency alerts

[0816] Step 9: Collect emotion data

[0817] The device analyzes the user's facial expressions and voice, and the emotion engine sends the data to the server, which determines the user's emotional state.

[0818] Input: facial expression data, voice data

[0819] Data processing: Analysis using emotion recognition algorithms

[0820] Output: Emotion analysis results

[0821] Step 10: Generate and send emotion-based environmental adjustment instructions

[0822] The server generates instructions for adjusting the environment based on the data from the emotion engine and sends them to the terminal, which then adjusts the home environment based on the user's emotions.

[0823] Input: Sentiment analysis result data

[0824] Data processing: Generating environmental instructions according to emotional states

[0825] Output: Sends environmental indication data to the terminal

[0826] (Application example 2)

[0827] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0828] The present invention relates to a system that comprehensively manages a user's daily routine, emotions, and health status to create an optimal home environment for the user. Conventional systems often manage individual elements (e.g., temperature and lighting) independently, making it difficult to fully consider the user's overall health management and emotional comfort. This has led to a need to ensure safety and comfort, especially for elderly users and users with health risks. Furthermore, optimizing the home environment based on the user's emotions is important for reducing stress and creating an environment for relaxation, but no system has existed that comprehensively manages these factors.

[0829] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0830] In this invention, the server includes means for creating and updating a user's profile, means for recording and analyzing the user's daily routine, means for sending instructions to the terminal to adjust the home environment based on the user's routine and preferences, means for recognizing the user's emotions and adjusting the home environment based on the emotions, and means for monitoring the user's health data and taking emergency measures when an abnormality is detected. This makes it possible to adjust and manage the home environment in an integrated manner based on the user's routine, emotions, and health data, and provide the user with a safe and comfortable living environment.

[0831] A "profile" is a database entry that contains detailed information about a user, such as their personal information, preferences, health data, and so on.

[0832] "Routine" refers to a regular pattern of activities or behaviors in a user's daily life.

[0833] "Emotion recognition" is a technology that detects the user's emotional state and responds appropriately based on that.

[0834] "Emergency response" refers to taking appropriate measures immediately when an abnormality is detected in a user's health data.

[0835] "Smart devices" is a general term for devices that can connect to the Internet and are equipped with multifunctional sensors and computing capabilities.

[0836] "Home environment adjustment" refers to the act of controlling temperature, lighting, music, and home appliances to provide a comfortable home environment for users.

[0837] A "generative AI model" is an artificial intelligence technique that generates appropriate output based on specific input data (such as a prompt).

[0838] A "prompt" is text data that is input into a generative AI model, and based on this, the model generates an appropriate output.

[0839] This invention relates to a system that manages a user's profile and adjusts the home environment based on daily routines, emotional state, and health data. The system has the following main functions:

[0840] 1. Creating and updating your user profile

[0841] The server creates a new profile when a user registers with the system. The profile includes personal information, environmental settings (e.g., temperature preferences and lighting settings), and health data (e.g., heart rate and blood pressure). When a user enters or updates this information through the application, the server stores the information in a database.

[0842] example:

[0843] If a user wants to set the room temperature to 22°C, this information is reflected in the profile and stored in the database.

[0844] 2. Recording and analyzing daily routines

[0845] The server records the user's daily activities. This is the process of collecting activities at specific times (e.g., waking up, going to bed, etc.). If the user performs an activity at a specific time (e.g., waking up at 06:00), the information is sent to the server and recorded as the user's routine. The server analyzes the data collected over a period of time to identify the user's lifestyle patterns.

[0846] example:

[0847] If a user tends to wake up at 6:00 every morning, the server will store "average wake-up time 06:00" in their profile.

[0848] 3. Adjusting the home environment

[0849] The server generates instructions for adjusting the home environment based on the user's profile and daily routine. When the user's emotion engine recognizes emotions, it integrates this information into the user's profile for further personalization.

[0850] example:

[0851] If the user wakes up at 6:00, the server will send instructions to the device to match that time, such as "set the room temperature to 22°C," "gradually brighten the lights," and "play your favorite music when you wake up." This creates the optimal environment for the user when they wake up.

[0852] 4. Health Management and Emergency Response

[0853] The server monitors the user's health data (e.g., heart rate and blood pressure) and takes emergency action if it detects any abnormalities, ensuring the safety of elderly users and those with health risks.

[0854] example:

[0855] If the user's heart rate becomes abnormally high, the server will send an emergency alert to the device, prompting them to take appropriate action.

[0856] 5. Emotion Recognition and Home Environment Optimization

[0857] The server uses an emotion engine to recognize the user's emotions and adjusts the home environment based on the emotions.

[0858] example:

[0859] When the emotion engine recognizes that the user is feeling stressed, the server sends instructions to the device, such as "play relaxing music," "change the lighting to a softer color," and "set the temperature to a comfortable range." This reduces the user's stress and provides a relaxing environment.

[0860] Hardware and software used

[0861] Smart Device: A device that can connect to the Internet and has multiple sensor and computing capabilities (e.g., smartphone, smart glasses).

[0862] Server: A server that manages user profiles, analyzes data, monitors health data, etc.

[0863] Generative AI model: An artificial intelligence model that recognizes user emotions and generates appropriate output based on prompts (text data).

[0864] Examples of concrete examples and prompts

[0865] Examples:

[0866] When the user goes to bed at 10 p.m., the server sends instructions to the device to gradually dim the lights and play relaxing music.

[0867] The server also gradually brightens the lights and plays the user's favorite music to wake them up at 6:00 a.m., when the user wakes up.

[0868] Example prompt sentence:

[0869] The user puts on the smart glasses and sends the instruction "Dim the lights in the living room in 5 minutes and play relaxing music" to the system.

[0870] As a result, the present invention provides customized services according to the individual needs of users, realizing a more comfortable and safe home environment.

[0871] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0872] Step 1:

[0873] Creating and updating user profiles

[0874] The server receives input from the user and creates a new profile. Specifically, the user enters personal information, environmental settings, and health data via a smartphone or smart glasses, and the server stores this in a database. Inputs include temperature preferences, lighting settings, heart rate, blood pressure, etc. The server analyzes this data and stores it in the database in an appropriate format.

[0875] (input)

[0876] Your personal information, preferences, and health data

[0877] (output)

[0878] User profiles stored in a database

[0879] Step 2:

[0880] Recording and analyzing daily routines

[0881] The server continuously monitors and records the user's daily activities. Specifically, the server receives data such as wake-up and bedtime sent from the smart device and stores it in a database. The server analyzes the data collected over a certain period of time to identify the user's lifestyle patterns. For example, if a user tends to wake up at 6:00 a.m. every morning, it records that time as the "average wake-up time."

[0882] (input)

[0883] Daily activity data such as wake-up time and bedtime

[0884] (output)

[0885] Life patterns stored in a database

[0886] Step 3:

[0887] Adjusting the home environment

[0888] The server generates instructions for adjusting the home environment based on the user's profile and daily routine. Specifically, the server analyzes the profile data and lifestyle patterns to determine optimal environmental conditions such as lighting, temperature, and music settings. This information is sent to the device, and the home environment is automatically adjusted.

[0889] (input)

[0890] User profile, lifestyle pattern data

[0891] (output)

[0892] Home environment adjustment instructions sent to the device

[0893] Step 4:

[0894] Emotion recognition and home environment optimization

[0895] The server uses a generative AI model to recognize the user's emotions. Specifically, it analyzes emotional data such as voice and facial expressions sent from the smart device to identify the user's emotional state (e.g., stress). Based on the emotional state, the server generates instructions to optimize the home environment. For example, if the user is feeling stressed, the server sends instructions to the device to play relaxing music and change the lighting to a softer color.

[0896] (input)

[0897] Emotional data such as voice and facial expressions

[0898] (output)

[0899] Emotion-based environmental adjustment instructions sent to the device

[0900] Step 5:

[0901] Health Management and Emergency Response

[0902] The server monitors the user's health data in real time, receiving heart rate and blood pressure data sent from the smart device and generating an emergency alert if an abnormal value is detected. For example, if the heart rate is abnormally high, the server sends an emergency alert to the device, prompting the user to take appropriate action.

[0903] (input)

[0904] Heart rate and blood pressure data

[0905] (output)

[0906] Emergency alert generation and transmission

[0907] Step 6:

[0908] Generate and send prompt statements

[0909] The server uses the generative AI model to generate appropriate prompts when adjusting the home environment or responding to emergencies, thereby providing users with easy-to-understand instructions and warnings. Specifically, the prompts are generated and displayed on the smart device screen.

[0910] (input)

[0911] Home environment adjustment instruction data, emergency alert data

[0912] (output)

[0913] Prompt text displayed on smart devices

[0914] This allows the system to provide the optimal home environment according to the user's situation, ensuring the user's safety and comfort.

[0915] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0916] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0917] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0918] [Third embodiment]

[0919] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0920] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0921] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0922] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0923] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0924] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0925] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0926] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0927] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0928] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0929] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0930] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0931] The present invention relates to a system including a means for creating and updating a user's profile, a means for recording and analyzing the user's daily routine, and a means for transmitting instructions to a terminal for adjusting the home environment based on the user's routine and preferences. Specific embodiments are described below.

[0932] 1. Creating and updating your user profile

[0933] The server creates a new user profile when a user registers with the system. The user profile includes the user's personal information, environmental settings (e.g., temperature preferences, lighting brightness), and health data (e.g., heart rate, blood pressure). When the user enters or updates this information through the application, the server stores the information in a database. For example, if the user specifies "set room temperature to 22°C," the server reflects this information in the profile and stores it in the database.

[0934] 2. Recording and analyzing daily routines

[0935] The server records the user's daily activities. This is the process of collecting activities at specific times (e.g., waking up, going to bed, eating, etc.). If the user "wakes up at 06:00," that information is sent to the server and recorded as the user's routine. The server analyzes the data collected over a certain period of time to identify the user's lifestyle patterns. For example, if the server registers a tendency to wake up at 6:00 every morning, it will save the user's "average wake-up time as 06:00" in the profile.

[0936] 3. Adjusting the home environment

[0937] The server generates appropriate instructions for adjusting the home environment based on the user's profile and daily routine. For example, if the user wakes up at 6:00, the server will send instructions to the device to adjust the room temperature to 22°C, gradually brighten the lights, and play the user's favorite music when they wake up. This creates an optimal environment for the user when they wake up.

[0938] 4. Health Management and Emergency Response

[0939] The server monitors the user's health data (e.g., heart rate, blood pressure) and takes emergency action if it detects any abnormalities. For example, if the user's heart rate becomes abnormally high, the server sends an emergency alert to the device, prompting appropriate action. This ensures the safety of elderly users and those with health risks.

[0940] Specific examples

[0941] When the user goes to bed at 10 p.m., the server sends instructions to the device to gradually dim the lights and play relaxing music.

[0942] When the user wakes up at 6 a.m., the server gradually brightens the lights and plays their favorite music to wake them up.

[0943] Users measure their blood pressure periodically and enter the data into the application, which records this information and alerts them if any abnormal readings are detected.

[0944] As a result, the present invention provides customized services according to the individual needs of users, realizing a more comfortable and safe home environment.

[0945] The processing flow will be explained below.

[0946] Creating and updating user profiles

[0947] Step 1:

[0948] When a user registers with the system, they enter basic information (such as name, age, and gender) through the application. After completing this information entry, it is sent to the server.

[0949] Step 2:

[0950] The server uses the submitted information to create a new user profile, which includes initial environmental settings (temperature, lighting, music, etc.) and health data.

[0951] Step 3:

[0952] When a user updates their preferences or health data through the application, the new information is sent to the server, for example, specifying "set room temperature to 22°C."

[0953] Step 4:

[0954] The server then updates the user profile with the received information and stores it in the database, ensuring that the latest information is available the next time the user accesses the site.

[0955] Recording and analyzing daily routines

[0956] Step 1:

[0957] When a user performs a specific activity, the information (e.g., the time of waking up, going to bed, etc.) is sent to the server through the application. For example, "Waking up at 06:00" is recorded.

[0958] Step 2:

[0959] The server records the transmitted activity information in a log along with the date, and this log data is managed for each user.

[0960] Step 3:

[0961] The server analyzes the log data every certain period (e.g., one week, one month, etc.) and extracts daily routine patterns, including wake-up time, bedtime, meal times, etc.

[0962] Step 4:

[0963] The server then integrates the analysis results into the user profile and stores it as average wake-up and bedtime times, which serve as the basis for subsequent environmental adjustments.

[0964] Adjusting the home environment

[0965] Step 1:

[0966] The server determines the timing of home environment adjustments based on the analysis of the user profile and routine. For example, if a wake-up routine is registered for 6:00 a.m., the adjustments will be made at that time.

[0967] Step 2:

[0968] The server generates specific instructions to adjust the home environment (e.g., set the temperature to 22°C, brighten the lights, play music).

[0969] Step 3:

[0970] The server generates and sends instructions to devices, such as smart thermostats, smart lighting systems, and music playback devices.

[0971] Step 4:

[0972] The device then carries out the instructions it receives: for example, a smart thermostat sets the temperature to 22°C, a smart lighting system adjusts the brightness to a specified level, or a music playback device plays a specified playlist.

[0973] Health Management and Emergency Response

[0974] Step 1:

[0975] The user periodically enters health data (e.g., heart rate, blood pressure) into the application, and this information is sent to the server.

[0976] Step 2:

[0977] The server records the received health data in a profile and monitors for outliers and trends, for example, if your heart rate is consistently elevated, it will record that data.

[0978] Step 3:

[0979] If an abnormal value is detected, the server generates an emergency alert and sends corresponding instructions to the device. For example, if the heart rate reaches a dangerous level, the server sends an alert along with a notification to contacts.

[0980] Step 4:

[0981] Your device will receive emergency alerts and respond by sounding an alarm, flashing a light, or automatically sending a notification to your emergency contacts, allowing for early response.

[0982] Example 1

[0983] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0984] In today's home environment, it is difficult to provide customized services that meet the individual needs and preferences of users. In addition, health data monitoring and emergency response may be delayed, making it difficult to ensure safety, especially for elderly users and those with health risks.

[0985] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0986] In this invention, the server includes server means for creating and updating a user's profile, server means for recording the user's daily routine, data analysis means for analyzing the recorded daily routine data and identifying the user's routine, server means for transmitting instructions to the terminal for adjusting the home environment based on the user's profile and daily routine, and terminal means for receiving instructions from the terminal and adjusting the home environment in accordance with the instructions. This makes it possible to provide an optimal home environment that meets the individual needs of the user, as well as to monitor health data and respond quickly to emergencies.

[0987] A "user profile" is a collection of data about a user, including the user's personal information, preferences, health data, etc.

[0988] The "server means" is a server device that has the functions of receiving, storing, analyzing, and generating instructions on data.

[0989] The "terminal means" is a device that receives instructions sent from the server and executes operations in accordance with those instructions.

[0990] The "data analysis means" is a means having the function of analyzing the recorded data of daily life and identifying the user's life patterns and routines.

[0991] "Daily life routine" means a user's daily activity patterns and schedules (e.g., wake-up time, bedtime, meal times, etc.).

[0992] The "home environment" includes the temperature, lighting, music, and the state of home appliances in the user's living environment.

[0993] "Health data" refers to data that indicates the user's health condition, such as heart rate and blood pressure.

[0994] "Abnormal value" means a value in a user's health data that deviates from the normal range.

[0995] "Emergency response" refers to the process of quickly issuing an alert and taking appropriate measures when abnormal values ​​are detected.

[0996] The present invention is a system that creates and updates a user's profile, records and analyzes daily routines, and adjusts the home environment according to the user's needs.

[0997] First, the creation and updating of user profiles is done by the server. When a user logs in or registers to the application, the server receives the user's personal information (e.g., name, age, contact details, etc.) and stores it in a database. For example, database management is done using MySQL. When the user enters their environmental settings (e.g., preferred temperature, lighting brightness), the server reflects this in the profile and stores it in the database. Health data (e.g., heart rate, blood pressure) is also entered and stored in the same way.

[0998] Next, daily routines are recorded either by the user entering them into the application or automatically through a measurement device such as a smartwatch. The server receives this data and records it in a database along with date and time information. For data analysis, Python and Pandas are used to analyze the recorded daily data and identify the user's lifestyle patterns. For example, routine information such as "wake up at 6:00 every day" is added to the profile and saved in the database.

[0999] When adjusting the home environment, the server generates appropriate environmental adjustment instructions based on the user's profile and daily routine. For example, if the user has the habit of waking up at 6:00, the server sends instructions to the device such as "set the room temperature to 22°C," "gradually brighten the lights," and "play your favorite music when you wake up." This is done using Node.js and the MQTT protocol. The device receives these instructions and actually adjusts the environment. For example, a smart thermostat is used to adjust the temperature, and smart lights are used to adjust the lighting.

[1000] Finally, regarding health data monitoring and response, the server monitors the user's health data in real time and takes emergency action if an abnormality is detected. This includes sending alerts to emergency contacts using Twilio and sending "emergency response instructions" to the device. This ensures the safety of elderly users and those with health risks.

[1001] Examples:

[1002] When the user goes to bed at 10 p.m., the server sends instructions to the device to gradually dim the lights and play relaxing music.

[1003] When the user wakes up at 6am, the server gradually brightens the lights and plays their favorite music to wake them up.

[1004] Users measure their blood pressure periodically and enter the data into the application, which records this information and alerts them if any abnormal readings are detected.

[1005] Example prompts to input to a generative AI model:

[1006] "For a user who wakes up at 6am every day, please explain the flow to set the room temperature to 22°C, gradually increase the brightness of the lights, and play their favorite music to coincide with their wake-up time."

[1007] As described above, the present invention provides customized services according to the individual needs of users, thereby realizing a more comfortable and safe home environment.

[1008] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1009] Step 1:

[1010] A user logs in or signs up for the app.

[1011] Specific operation: The user launches the app, clicks the "New Registration" button, and enters their name, age, and contact information.

[1012] Input: Personal information entered by the user (e.g., name, age, contact details).

[1013] Output: The user's personal information record that the server stores in the database.

[1014] Step 2:

[1015] The server receives the user's personal information and stores it in a database.

[1016] Specific operation: The server uses MySQL to record the received personal information in a database.

[1017] Input: Personal information entered by the user.

[1018] Output: The user's personal information record stored in the database.

[1019] Step 3:

[1020] The user uses the application to enter environmental settings (e.g., temperature preference, lighting brightness).

[1021] Specific operation: The user enters something like "Set room temperature to 22°C" on the "Settings" screen and presses the save button.

[1022] Input: Preference information entered by the user.

[1023] Output: A preference record that the server stores in the database.

[1024] Step 4:

[1025] The server receives the configuration information and updates the user profile.

[1026] What happens: The server adds the preference information to the profile and saves it in the database.

[1027] Input: Preference information entered by the user.

[1028] Output: The updated user profile record.

[1029] Step 5:

[1030] The user uses the application to input daily routines (e.g., waking up, going to bed, eating).

[1031] Specific operation: The user enters "Wake up at 06:00" in the app and presses the save button.

[1032] Input: Daily life routine information entered by the user.

[1033] Output: Routine data that the server stores in the database.

[1034] Step 6:

[1035] The server receives data on daily life and records it in a database along with date and time information.

[1036] Specific operation: The server saves the routine data in a database with a timestamp.

[1037] Input: Routine data entered by the user.

[1038] Output: Timestamped routine data stored in a database.

[1039] Step 7:

[1040] The server collects routine data over a period of time and performs data analysis.

[1041] What happens: The server uses Python and Pandas to analyze the data and identify patterns such as "average wake-up time is 06:00."

[1042] Input: Routine data for a period of time extracted from a database.

[1043] Output: User's life patterns as an analysis result.

[1044] Step 8:

[1045] The server reflects the analysis results in the user profile and stores them in a database.

[1046] Specific operation: The server adds the analysis results to the profile and stores it in the database.

[1047] Input: Data analysis results.

[1048] Output: The updated user profile.

[1049] Step 9:

[1050] The server generates instructions for adjusting the home environment based on the user's profile and lifestyle patterns.

[1051] Specific operation: The server generates instructions such as "set the room temperature to 22°C at 6:00" and "gradually brighten the lights."

[1052] Input: User profile and lifestyle pattern data.

[1053] Output: Generated home environment adjustment instructions.

[1054] Step 10:

[1055] The server transmits a home environment adjustment instruction to the terminal.

[1056] Specific operation: The server sends instructions to the terminal using the MQTT protocol.

[1057] Input: Generated home environment adjustment instructions.

[1058] Output: Adjustment instructions sent to the terminal.

[1059] Step 11:

[1060] The terminal receives instructions from the server and executes the instructions.

[1061] Specific operation: The device controls smart thermostats and smart lights to adjust the environment.

[1062] Input: Adjustment instructions from the server.

[1063] Output: The environmental adjustments performed.

[1064] Step 12:

[1065] The user periodically inputs or transmits health data (heart rate, blood pressure, etc.) from a measurement device.

[1066] Specific actions: The user enters blood pressure into the application, and the smartwatch transmits the data.

[1067] Input: User's health data.

[1068] Output: Health data records that the server stores in a database.

[1069] Step 13:

[1070] The server monitors health data and takes emergency action if abnormal values ​​are detected.

[1071] What it does: The server monitors health data in real time, and if it detects any abnormal values, it uses Twilio to send an alert to emergency contacts and send appropriate instructions to the device.

[1072] Input: Health data captured in real time.

[1073] Output: Alerts and instructions on how to respond in the event of an abnormality.

[1074] Through these steps, customized services can be provided according to the individual needs of the user, realizing a more comfortable and safe home environment.

[1075] (Application example 1)

[1076] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1077] Conventional home environment control systems struggle to adjust the environment appropriately based on individual user preferences and daily routines. They also lack the ability to respond quickly in emergencies or monitor users' health data. Furthermore, food delivery services lack personalization and do not provide services based on individual mealtimes or food preferences.

[1078] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1079] In this invention, the server includes means for creating and updating a user's profile, means for recording and analyzing the user's daily routine, means for sending instructions to the terminal for adjusting the home environment based on the user's routine and preferences, and means for utilizing the user's behavioral data to provide personalized services, thereby enabling the optimal adjustment of the home environment according to the user's individual needs and preferences, rapid response in emergencies, and provision of food delivery services based on meal times and preferences.

[1080] A "user profile" is detailed information describing a particular user, including information such as personal preferences, lifestyle habits, and health status.

[1081] "Daily routine" refers to the pattern of activities and behavior that a user regularly performs.

[1082] "Adjusting the home environment" refers to controlling the indoor temperature, lighting, music, home appliances, etc. to improve the user's comfort and convenience.

[1083] A "terminal" is a communication device used by a user, such as a smartphone, tablet, or smart device.

[1084] A "database" is a storage device for storing and managing a user's profile and daily routine.

[1085] "Personalized service provision" means providing services that are customized based on the specific needs and preferences of each individual user.

[1086] "Behavioral data" refers to data about a user's activities and preferences, including a history of specific behaviors.

[1087] The "food delivery function" is a service that delivers appropriate meals based on the user's meal preferences and time.

[1088] "Emergency response" refers to measures to issue prompt warnings and notifications when an abnormality occurs in the user's health condition.

[1089] "Meal suggestions" refers to suggesting optimal meal menus based on the user's past data and preferences.

[1090] This invention relates to a system including means for creating and updating a user's profile, means for recording and analyzing the user's daily routine, and means for sending instructions to a terminal for adjusting the home environment based on the user's routine and preferences, and further includes means for utilizing the user's behavioral data to provide personalized services.

[1091] Creating and updating user profiles

[1092] The server creates a new user profile when a user registers with the system, which includes personal information, preferences, dietary preferences, allergy information, and past order history. When a user enters or updates this information through the smartphone app, the server stores this information in a database.

[1093] Recording and analyzing daily routines

[1094] The server records the user's daily activities sent from the smartphone app. The server collects the user's activities at specific times (e.g., waking up, eating, going to bed, etc.) and stores them in a database. The server analyzes the collected data over a period of time to identify the user's lifestyle patterns and eating routines.

[1095] Personalized Food Delivery

[1096] The server will then suggest appropriate meals based on the user's profile and daily routine. For example, if the user specifies in their profile that they would like to have breakfast at 6:00, the server will send a food delivery notification to their smartphone at that time. The notification will say something like, "Your personalized breakfast will be delivered soon."

[1097] Health Management and Emergency Response

[1098] The server monitors health data (e.g., heart rate, blood pressure) obtained from the smartphone app. If an abnormality is detected, the server sends an emergency alert to the device and notifies pre-defined contacts.

[1099] Hardware and software used

[1100] Hardware: Smartphones, communication infrastructure, servers

[1101] Software: SQLite database, Python script, notification sending module

[1102] Specific examples

[1103] For example, if User A is a vegetarian and has a habit of eating dinner at 6:00 PM every day, the server will send a notification to the user's smartphone at 5:45 PM every day, saying, "Your vegetarian dinner will be delivered soon." If User A experiences any abnormalities in their heart rate, the server will immediately send an emergency notification to prompt the user to take appropriate action.

[1104] Example prompts for generative AI models

[1105] "User A is a vegetarian and wants to eat dinner at 6 PM every day. Create a profile for User A and create a program to send personalized notifications at their preferred times. Also, add the ability to send emergency alerts.

[1106] Meal routine: Dinner at 6pm

[1107] Food preference: Vegetarian

[1108] Allergy information: None

[1109] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1110] Step 1:

[1111] When a user creates an account through a smartphone app, the server generates a new user profile. The data entered by the user, such as personal information, preferences, dietary preferences, and allergy information, is sent to the server. The server stores the data in an SQLite database. This process creates a user profile and prepares the basic data required for subsequent processing.

[1112] Step 2:

[1113] The server receives behavioral data sent from the smartphone app to record the user's daily routine. For example, the user sends information to the server about when they wake up, eat, and go to bed at specific times. The server then stores this data in a database and analyzes their lifestyle patterns over a period of time. This process clarifies the user's routine and provides the basis for providing appropriate services.

[1114] Step 3:

[1115] The server generates instructions for personalized home environment and food delivery services based on the analyzed user's daily routine and profile. For example, if the user tends to wake up at 6 a.m., the server generates instructions for sending notifications at that time. This process ensures that notifications and services are provided at the optimal time for the user.

[1116] Step 4:

[1117] The server sends instructions to the terminal to adjust the home environment. For example, it issues instructions to set the room temperature or lighting brightness as desired by the user. This instruction is transmitted from the terminal to smart devices in the home, which actually adjust the home environment. This process improves the user's comfort.

[1118] Step 5:

[1119] The server receives and monitors the user's health data from the smartphone app. Data such as heart rate and blood pressure is periodically sent to the server. The server analyzes the received data and sends an emergency alert to the device if an abnormality is detected. This process ensures the user's safety.

[1120] Step 6:

[1121] The server processes the notification of personalized meal suggestions according to the user's mealtime. For example, if the user has a habit of eating dinner at 6:00 p.m., the server generates instructions to automatically send a notification at 5:45 p.m. The notification includes a message such as "Your personalized dinner will arrive soon." This process allows the user to receive information at the appropriate time.

[1122] Step 7:

[1123] The server performs the procedures to execute the food delivery service. Based on the user's profile and routine, it suggests available menu items and sends notifications. If the user accepts the meal suggestion, the notification confirms the order and instructs the delivery to be prepared. This process results in a food delivery that meets the user's needs.

[1124] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1125] The present invention relates to a system including a means for creating and updating a user's profile, a means for recording and analyzing the user's daily routine, and a means for sending instructions to a terminal to adjust the home environment based on the user's routine and preferences. The present invention also includes a means for monitoring and storing the user's health data, a means for responding to emergencies based on the health data, and a means for controlling temperature, lighting, music, and home appliances in adjusting the home environment. Additionally, by combining this with an emotion engine that recognizes the user's emotions, the system realizes optimization of the home environment based on the user's emotions.

[1126] 1. Creating and updating your user profile

[1127] The server creates a new user profile when a user registers with the system. The user profile includes the user's personal information, environmental settings (e.g., temperature preferences, lighting brightness), and health data (e.g., heart rate, blood pressure). When the user enters or updates this information through the application, the server stores the information in a database. For example, if the user specifies "set room temperature to 22°C," the server reflects this information in the profile and stores it in the database.

[1128] 2. Recording and analyzing daily routines

[1129] The server records the user's daily activities. This is the process of collecting activities at specific times (e.g., waking up, going to bed, etc.). If the user "wakes up at 06:00," that information is sent to the server and recorded as the user's routine. The server analyzes the data collected over a certain period of time to identify the user's lifestyle patterns. For example, if the server registers a tendency to wake up at 6:00 every morning, it will save the user's "average wake-up time as 06:00" in the profile.

[1130] 3. Adjusting the home environment

[1131] The server generates instructions for adjusting the home environment based on the user's profile and daily routine. When the user's emotion engine recognizes their emotion, it integrates that information into the user's profile for further personalization. For example, if the user wakes up at 6:00, the server will send instructions to the device to adjust the room temperature to 22°C, gradually brighten the lights, and play their favorite music when they wake up. This creates an optimal environment for the user's wake-up time.

[1132] 4. Health Management and Emergency Response

[1133] The server monitors the user's health data (e.g., heart rate, blood pressure) and takes emergency action if it detects any abnormalities. For example, if the user's heart rate becomes abnormally high, the server sends an emergency alert to the device, prompting appropriate action. This ensures the safety of elderly users and those with health risks.

[1134] 5. Emotion Recognition and Home Environment Optimization

[1135] The server uses an emotion engine to recognize the user's emotions and adjusts the home environment based on those emotions. For example, if the emotion engine recognizes that the user is feeling stressed, the server will send instructions to the device, such as "play relaxing music," "change the lighting to a softer color," and "set the temperature to a comfortable range." This reduces the user's stress and provides a relaxing environment.

[1136] Specific examples

[1137] When the user goes to bed at 10 p.m., the server sends instructions to the device to gradually dim the lights and play relaxing music.

[1138] When the user wakes up at 6 a.m., the server gradually brightens the lights and plays their favorite music to wake them up.

[1139] Users measure their blood pressure periodically and enter the data into the application, which records this information and alerts them if any abnormal readings are detected.

[1140] If the server detects that the user is feeling stressed, it sends instructions to the device to adjust the appropriate environmental settings (e.g., temperature, lighting, music) to create a relaxing environment.

[1141] As a result, the present invention provides customized services according to the individual needs of users, realizing a more comfortable and safe home environment.

[1142] The processing flow will be explained below.

[1143] Creating and updating user profiles

[1144] Step 1:

[1145] When a user registers with the system, they enter basic information (such as name, age, and gender) through the application. After completing this information entry, it is sent to the server.

[1146] Step 2:

[1147] The server uses the submitted information to create a new user profile, which includes initial environmental settings (temperature, lighting, music, etc.) and health data.

[1148] Step 3:

[1149] When a user updates their preferences or health data through the application, the new information is sent to the server, for example, specifying "set room temperature to 22°C."

[1150] Step 4:

[1151] The server then updates the user profile with the received information and stores it in the database, ensuring that the latest information is available the next time the user accesses the site.

[1152] Recording and analyzing daily routines

[1153] Step 1:

[1154] When a user performs a specific activity, the information (e.g., the time of waking up, going to bed, etc.) is sent to the server through the application. For example, "Waking up at 06:00" is recorded.

[1155] Step 2:

[1156] The server records the transmitted activity information in a log along with the date, and this log data is managed for each user.

[1157] Step 3:

[1158] The server analyzes the log data every certain period (e.g., one week, one month, etc.) and extracts daily routine patterns, including wake-up time, bedtime, meal times, etc.

[1159] Step 4:

[1160] The server then integrates the analysis results into the user profile and stores it as average wake-up and bedtime times, which serve as the basis for subsequent environmental adjustments.

[1161] Adjusting the home environment

[1162] Step 1:

[1163] The server determines the timing of home environment adjustments based on the analysis of the user profile and routine. For example, if a wake-up routine is registered for 6:00 a.m., the adjustments will be made at that time.

[1164] Step 2:

[1165] The server generates specific instructions to adjust the home environment (e.g., set the temperature to 22°C, brighten the lights, play music).

[1166] Step 3:

[1167] The server generates and sends instructions to devices, such as smart thermostats, smart lighting systems, and music playback devices.

[1168] Step 4:

[1169] The device then carries out the instructions it receives: for example, a smart thermostat sets the temperature to 22°C, a smart lighting system adjusts the brightness to a specified level, or a music playback device plays a specified playlist.

[1170] Health Management and Emergency Response

[1171] Step 1:

[1172] The user periodically enters health data (e.g., heart rate, blood pressure) into the application, and this information is sent to the server.

[1173] Step 2:

[1174] The server records the received health data in a profile and monitors for outliers and trends, for example, if your heart rate is consistently elevated, it will record that data.

[1175] Step 3:

[1176] If an abnormal value is detected, the server generates an emergency alert and sends corresponding instructions to the device. For example, if the heart rate reaches a dangerous level, the server sends an alert along with a notification to contacts.

[1177] Step 4:

[1178] Your device will receive emergency alerts and respond by sounding an alarm, flashing a light, or automatically sending a notification to your emergency contacts, allowing for early response.

[1179] Emotion recognition and home environment optimization

[1180] Step 1:

[1181] The emotions experienced by the user during daily activities are transmitted to the server through the application, which includes voice input and facial expression recognition using the camera.

[1182] Step 2:

[1183] The server uses an emotion engine to analyze the received information and determine the user's emotional state, such as "stressed" or "relaxed."

[1184] Step 3:

[1185] Based on the determined emotional state, the server generates instructions to adjust the home environment, such as "play relaxing music," "change the lighting to a softer color," or "set the temperature to a comfortable range."

[1186] Step 4:

[1187] The server sends the generated instructions to the terminal and adjusts the environment.

[1188] Step 5:

[1189] The device adjusts the home environment based on the received instructions: for example, a music playback device plays relaxing music, a smart lighting system changes the lighting to softer colors, and a smart thermostat sets the temperature optimally.

[1190] As a result, the present invention provides customized services according to the individual needs of users, realizing a more comfortable and safe home environment.

[1191] Example 2

[1192] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1193] Conventional home environment control systems have been unable to fully meet the individual needs of users, particularly in providing a comfortable environment that reflects the user's emotional and health status in real time. Furthermore, they lack the functionality to provide emergency response based on specific daily routines and health data. As a result, it has been difficult for users to achieve a more personalized and secure home environment.

[1194] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1195] In this invention, the server includes means for creating and updating a user profile, means for recording and analyzing the user's daily routine, means for transmitting instructions to the terminal to adjust the home environment based on the user's routine and preferences, and means for recognizing the user's emotions using an emotion engine and transmitting instructions to the terminal to adjust the home environment based on the emotions. This enables the home environment to be adjusted with high precision based on the user's individual needs and emotional state, providing a comfortable and safe living environment.

[1196] A "profile" is a data set that contains a user's personal information, preferences, and health data.

[1197] "Daily routine" refers to the activities and patterns of behavior that a user engages in at a given time.

[1198] An "emotion engine" is a software or hardware component that analyzes information such as a user's facial expressions and voice to identify their emotional state.

[1199] "Terminal" refers to a device that receives and carries out instructions to adjust the home environment.

[1200] "Health data" refers to data including biometric information such as the user's heart rate, blood pressure, and body temperature.

[1201] "Emergency response" refers to taking appropriate action when an abnormality is detected based on health data.

[1202] "Home environment adjustment" refers to optimizing temperature, lighting, music and appliance settings based on the user's profile, routine and emotional state.

[1203] A "database" is a collection of information for storing user profiles and health data.

[1204] The present invention relates to a system including means for creating and updating a user's profile, means for recording and analyzing daily routines, means for transmitting instructions to a terminal for adjusting the home environment based on the user's routines and preferences, and means for recognizing the user's emotions using an emotion engine and transmitting instructions to the terminal for adjusting the home environment based on the emotions.

[1205] The server first creates a new profile when a user registers with the system. The profile includes the user's personal information, environmental settings (e.g., temperature preferences, lighting brightness), and health data (e.g., heart rate, blood pressure). When the user enters or updates this information through the smartphone app, the server stores the information in a database.

[1206] The device monitors the user's daily routine activities at specific times and sends the data to the server for recording and analysis. For example, if the user wakes up at 6:00 every morning, the information is sent to the server via the device. The server analyzes the data collected over a period of time and identifies the user's lifestyle patterns.

[1207] The server then references the user's profile and daily routine to generate instructions for adjusting the home environment. When the user's emotion engine recognizes their emotions, that information is integrated into the profile for further personalization. For example, if a user wakes up at 6:00, the server might send instructions to the device such as "set the room temperature to 22°C," "gradually increase the brightness of the lights," and "play their favorite music when they wake up." This creates an optimal environment for the user's wake-up time.

[1208] Furthermore, the server continuously monitors the user's health data and has the ability to take emergency action if it detects any abnormalities. For example, if the heart rate becomes abnormally high, the server will send an emergency alert to the device, prompting appropriate action. In the future, this could also contribute to ensuring the safety of elderly users and those with health risks.

[1209] To recognize a user's emotions, the device uses a camera and microphone to analyze facial expressions and tone of voice, and the emotion engine analyzes that data to identify the user's emotional state. For example, if the user is feeling stressed, the server will send instructions to the device, such as "play relaxing music," "change the lighting to a soft color," and "set the temperature to a comfortable range," to provide a relaxing environment for the user.

[1210] Specific examples

[1211] When the user goes to bed at 10 p.m., the server sends instructions to the device to "gradually dim the lights and play relaxing music."

[1212] When the user wakes up at 6am, the server gradually brightens the lights and plays their preferred music.

[1213] Users measure their blood pressure periodically and enter the data into the application, which records this information and alerts them if any abnormal readings are detected.

[1214] If the emotion engine recognizes that the user is feeling stressed, the server will send instructions to the device, such as "play relaxing music," "change the lighting to a soft color," and "set the temperature to a comfortable range," to create a relaxing environment.

[1215] Prompt Sentence Examples

[1216] "For a user who wakes up at 6am every morning, create a program that sends the following instructions to the device when the user wakes up: set the room temperature to 22°C, gradually increase the brightness of the lights, and play their favorite music."

[1217] "Describe a system that, when the emotion engine recognizes that the user is stressed, sends instructions to the device to play relaxing music, change the lighting to a softer color, and set the temperature to a comfortable range."

[1218] In this way, the present invention realizes highly accurate optimization of the home environment in response to the user's individual needs and real-time conditions.

[1219] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1220] Step 1: Register and create your profile

[1221] Users register with the system through a smartphone app. The app presents the necessary information (such as name, age, gender, health information, and preferences) in a form, which the user then enters and submits.

[1222] Input: User personal information, preferences, and health data

[1223] Data processing: Convert the input data into a profile format

[1224] Output: The completed profile is generated.

[1225] Step 2: Save the profile

[1226] The server stores the received user data in a database. For example, if a user specifies "set the room temperature to 22°C," this is reflected in the profile.

[1227] Input: User personal information, preferences, and health data

[1228] Data processing: Converting data into database format

[1229] Output: Profiles stored in a database

[1230] Step 3: Record your daily routine

[1231] The device monitors the user's activity at a specific time and sends that information to the server. For example, if the user wakes up at 6:00, that information is sent.

[1232] Input: User activity data (e.g., wake-up time, bedtime)

[1233] Data processing: Record activity data in chronological order

[1234] Output: Recorded activity data is stored on the server.

[1235] Step 4: Analyzing routine data

[1236] The server analyzes the daily routine data collected over a period of time to identify the user's lifestyle patterns, for example, a tendency to wake up at 6am every morning.

[1237] Input: Recorded routine data

[1238] Data processing: Pattern analysis using data analysis algorithms

[1239] Output: Data that identifies the user's daily patterns

[1240] Step 5: Generate instructions for adjusting the home environment

[1241] The server generates environmental adjustment instructions based on the user's profile and daily routine. For example, when waking up at 6:00, instructions such as "set the room temperature to 22°C," "gradually increase the brightness of the lights," and "play your favorite music when you wake up" are generated.

[1242] Input: User profile data, routine data

[1243] Data processing: Generate configuration instructions based on instruction generation algorithms

[1244] Output: Specific instructions for the environment settings

[1245] Step 6: Sending environmental adjustment instructions

[1246] The server sends the generated instructions to the terminal, which receives them and performs specific operations on each device in the home.

[1247] Input: Environment setting instruction data

[1248] Data processing: Converts instruction data into a format that can be applied to each device

[1249] Output: Control instructions sent to each device

[1250] Step 7: Monitoring your health data

[1251] The device continuously monitors the user's health data. For example, a smartwatch measures heart rate and blood pressure and sends the data to a server.

[1252] Input: Health data such as heart rate, blood pressure, etc.

[1253] Data processing: data filtering and format conversion

[1254] Output: Health data sent to the server

[1255] Step 8: Health data analysis and emergency response

[1256] The server analyzes health data in real time and takes emergency action if an abnormal value is detected. For example, if the heart rate is abnormally high, an emergency alert will be sent to the device.

[1257] Input: Collected health data

[1258] Data processing: Data analysis using anomaly detection algorithms

[1259] Output: Anomaly detection results and emergency alerts

[1260] Step 9: Collect emotion data

[1261] The device analyzes the user's facial expressions and voice, and the emotion engine sends the data to the server, which determines the user's emotional state.

[1262] Input: facial expression data, voice data

[1263] Data processing: Analysis using emotion recognition algorithms

[1264] Output: Emotion analysis results

[1265] Step 10: Generate and send emotion-based environmental adjustment instructions

[1266] The server generates instructions for adjusting the environment based on the data from the emotion engine and sends them to the terminal, which then adjusts the home environment based on the user's emotions.

[1267] Input: Sentiment analysis result data

[1268] Data processing: Generating environmental instructions according to emotional states

[1269] Output: Sends environmental indication data to the terminal

[1270] (Application example 2)

[1271] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1272] The present invention relates to a system that comprehensively manages a user's daily routine, emotions, and health status to create an optimal home environment for the user. Conventional systems often manage individual elements (e.g., temperature and lighting) independently, making it difficult to fully consider the user's overall health management and emotional comfort. This has led to a need to ensure safety and comfort, especially for elderly users and users with health risks. Furthermore, optimizing the home environment based on the user's emotions is important for reducing stress and creating an environment for relaxation, but no system has existed that comprehensively manages these factors.

[1273] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1274] In this invention, the server includes means for creating and updating a user's profile, means for recording and analyzing the user's daily routine, means for sending instructions to the terminal to adjust the home environment based on the user's routine and preferences, means for recognizing the user's emotions and adjusting the home environment based on the emotions, and means for monitoring the user's health data and taking emergency measures when an abnormality is detected. This makes it possible to adjust and manage the home environment in an integrated manner based on the user's routine, emotions, and health data, and provide the user with a safe and comfortable living environment.

[1275] A "profile" is a database entry that contains detailed information about a user, such as their personal information, preferences, health data, and so on.

[1276] "Routine" refers to a regular pattern of activities or behaviors in a user's daily life.

[1277] "Emotion recognition" is a technology that detects the user's emotional state and responds appropriately based on that.

[1278] "Emergency response" refers to taking appropriate measures immediately when an abnormality is detected in a user's health data.

[1279] "Smart devices" is a general term for devices that can connect to the Internet and are equipped with multifunctional sensors and computing capabilities.

[1280] "Home environment adjustment" refers to the act of controlling temperature, lighting, music, and home appliances to provide a comfortable home environment for users.

[1281] A "generative AI model" is an artificial intelligence technique that generates appropriate output based on specific input data (such as a prompt).

[1282] A "prompt" is text data that is input into a generative AI model, and based on this, the model generates an appropriate output.

[1283] This invention relates to a system that manages a user's profile and adjusts the home environment based on daily routines, emotional state, and health data. The system has the following main functions:

[1284] 1. Creating and updating your user profile

[1285] The server creates a new profile when a user registers with the system. The profile includes personal information, environmental settings (e.g., temperature preferences and lighting settings), and health data (e.g., heart rate and blood pressure). When a user enters or updates this information through the application, the server stores the information in a database.

[1286] example:

[1287] If a user wants to set the room temperature to 22°C, this information is reflected in the profile and stored in the database.

[1288] 2. Recording and analyzing daily routines

[1289] The server records the user's daily activities. This is the process of collecting activities at specific times (e.g., waking up, going to bed, etc.). If the user performs an activity at a specific time (e.g., waking up at 06:00), the information is sent to the server and recorded as the user's routine. The server analyzes the data collected over a period of time to identify the user's lifestyle patterns.

[1290] example:

[1291] If a user tends to wake up at 6:00 every morning, the server will store "average wake-up time 06:00" in their profile.

[1292] 3. Adjusting the home environment

[1293] The server generates instructions for adjusting the home environment based on the user's profile and daily routine. When the user's emotion engine recognizes emotions, it integrates this information into the user's profile for further personalization.

[1294] example:

[1295] If the user wakes up at 6:00, the server will send instructions to the device to match that time, such as "set the room temperature to 22°C," "gradually brighten the lights," and "play your favorite music when you wake up." This creates the optimal environment for the user when they wake up.

[1296] 4. Health Management and Emergency Response

[1297] The server monitors the user's health data (e.g., heart rate and blood pressure) and takes emergency action if it detects any abnormalities, ensuring the safety of elderly users and those with health risks.

[1298] example:

[1299] If the user's heart rate becomes abnormally high, the server will send an emergency alert to the device, prompting them to take appropriate action.

[1300] 5. Emotion Recognition and Home Environment Optimization

[1301] The server uses an emotion engine to recognize the user's emotions and adjusts the home environment based on the emotions.

[1302] example:

[1303] When the emotion engine recognizes that the user is feeling stressed, the server sends instructions to the device, such as "play relaxing music," "change the lighting to a softer color," and "set the temperature to a comfortable range." This reduces the user's stress and provides a relaxing environment.

[1304] Hardware and software used

[1305] Smart Device: A device that can connect to the Internet and has multiple sensor and computing capabilities (e.g., smartphone, smart glasses).

[1306] Server: A server that manages user profiles, analyzes data, monitors health data, etc.

[1307] Generative AI model: An artificial intelligence model that recognizes user emotions and generates appropriate output based on prompts (text data).

[1308] Examples of concrete examples and prompts

[1309] Examples:

[1310] When the user goes to bed at 10 p.m., the server sends instructions to the device to gradually dim the lights and play relaxing music.

[1311] The server also gradually brightens the lights and plays the user's favorite music to wake them up at 6:00 a.m., when the user wakes up.

[1312] Example prompt sentence:

[1313] The user puts on the smart glasses and sends the instruction "Dim the lights in the living room in 5 minutes and play relaxing music" to the system.

[1314] As a result, the present invention provides customized services according to the individual needs of users, realizing a more comfortable and safe home environment.

[1315] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1316] Step 1:

[1317] Creating and updating user profiles

[1318] The server receives input from the user and creates a new profile. Specifically, the user enters personal information, environmental settings, and health data via a smartphone or smart glasses, and the server stores this in a database. Inputs include temperature preferences, lighting settings, heart rate, blood pressure, etc. The server analyzes this data and stores it in the database in an appropriate format.

[1319] (input)

[1320] Your personal information, preferences, and health data

[1321] (output)

[1322] User profiles stored in a database

[1323] Step 2:

[1324] Recording and analyzing daily routines

[1325] The server continuously monitors and records the user's daily activities. Specifically, the server receives data such as wake-up and bedtime sent from the smart device and stores it in a database. The server analyzes the data collected over a certain period of time to identify the user's lifestyle patterns. For example, if a user tends to wake up at 6:00 a.m. every morning, it records that time as the "average wake-up time."

[1326] (input)

[1327] Daily activity data such as wake-up time and bedtime

[1328] (output)

[1329] Life patterns stored in a database

[1330] Step 3:

[1331] Adjusting the home environment

[1332] The server generates instructions for adjusting the home environment based on the user's profile and daily routine. Specifically, the server analyzes the profile data and lifestyle patterns to determine optimal environmental conditions such as lighting, temperature, and music settings. This information is sent to the device, and the home environment is automatically adjusted.

[1333] (input)

[1334] User profile, lifestyle pattern data

[1335] (output)

[1336] Home environment adjustment instructions sent to the device

[1337] Step 4:

[1338] Emotion recognition and home environment optimization

[1339] The server uses a generative AI model to recognize the user's emotions. Specifically, it analyzes emotional data such as voice and facial expressions sent from the smart device to identify the user's emotional state (e.g., stress). Based on the emotional state, the server generates instructions to optimize the home environment. For example, if the user is feeling stressed, the server sends instructions to the device to play relaxing music and change the lighting to a softer color.

[1340] (input)

[1341] Emotional data such as voice and facial expressions

[1342] (output)

[1343] Emotion-based environmental adjustment instructions sent to the device

[1344] Step 5:

[1345] Health Management and Emergency Response

[1346] The server monitors the user's health data in real time, receiving heart rate and blood pressure data sent from the smart device and generating an emergency alert if an abnormal value is detected. For example, if the heart rate is abnormally high, the server sends an emergency alert to the device, prompting the user to take appropriate action.

[1347] (input)

[1348] Heart rate and blood pressure data

[1349] (output)

[1350] Emergency alert generation and transmission

[1351] Step 6:

[1352] Generate and send prompt statements

[1353] The server uses the generative AI model to generate appropriate prompts when adjusting the home environment or responding to emergencies, thereby providing users with easy-to-understand instructions and warnings. Specifically, the prompts are generated and displayed on the smart device screen.

[1354] (input)

[1355] Home environment adjustment instruction data, emergency alert data

[1356] (output)

[1357] Prompt text displayed on smart devices

[1358] This allows the system to provide the optimal home environment according to the user's situation, ensuring the user's safety and comfort.

[1359] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1360] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1361] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1362] [Fourth embodiment]

[1363] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1364] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1365] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1366] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1367] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1368] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1369] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1370] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1371] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1372] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1373] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1374] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1375] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1376] The present invention relates to a system including a means for creating and updating a user's profile, a means for recording and analyzing the user's daily routine, and a means for transmitting instructions to a terminal for adjusting the home environment based on the user's routine and preferences. Specific embodiments are described below.

[1377] 1. Creating and updating your user profile

[1378] The server creates a new user profile when a user registers with the system. The user profile includes the user's personal information, environmental settings (e.g., temperature preferences, lighting brightness), and health data (e.g., heart rate, blood pressure). When the user enters or updates this information through the application, the server stores the information in a database. For example, if the user specifies "set room temperature to 22°C," the server reflects this information in the profile and stores it in the database.

[1379] 2. Recording and analyzing daily routines

[1380] The server records the user's daily activities. This is the process of collecting activities at specific times (e.g., waking up, going to bed, eating, etc.). If the user "wakes up at 06:00," that information is sent to the server and recorded as the user's routine. The server analyzes the data collected over a certain period of time to identify the user's lifestyle patterns. For example, if the server registers a tendency to wake up at 6:00 every morning, it will save the user's "average wake-up time as 06:00" in the profile.

[1381] 3. Adjusting the home environment

[1382] The server generates appropriate instructions for adjusting the home environment based on the user's profile and daily routine. For example, if the user wakes up at 6:00, the server will send instructions to the device to adjust the room temperature to 22°C, gradually brighten the lights, and play the user's favorite music when they wake up. This creates an optimal environment for the user when they wake up.

[1383] 4. Health Management and Emergency Response

[1384] The server monitors the user's health data (e.g., heart rate, blood pressure) and takes emergency action if it detects any abnormalities. For example, if the user's heart rate becomes abnormally high, the server sends an emergency alert to the device, prompting appropriate action. This ensures the safety of elderly users and those with health risks.

[1385] Specific examples

[1386] When the user goes to bed at 10 p.m., the server sends instructions to the device to gradually dim the lights and play relaxing music.

[1387] When the user wakes up at 6 a.m., the server gradually brightens the lights and plays their favorite music to wake them up.

[1388] Users measure their blood pressure periodically and enter the data into the application, which records this information and alerts them if any abnormal readings are detected.

[1389] As a result, the present invention provides customized services according to the individual needs of users, realizing a more comfortable and safe home environment.

[1390] The processing flow will be explained below.

[1391] Creating and updating user profiles

[1392] Step 1:

[1393] When a user registers with the system, they enter basic information (such as name, age, and gender) through the application. After completing this information entry, it is sent to the server.

[1394] Step 2:

[1395] The server uses the submitted information to create a new user profile, which includes initial environmental settings (temperature, lighting, music, etc.) and health data.

[1396] Step 3:

[1397] When a user updates their preferences or health data through the application, the new information is sent to the server, for example, specifying "set room temperature to 22°C."

[1398] Step 4:

[1399] The server then updates the user profile with the received information and stores it in the database, ensuring that the latest information is available the next time the user accesses the site.

[1400] Recording and analyzing daily routines

[1401] Step 1:

[1402] When a user performs a specific activity, the information (e.g., the time of waking up, going to bed, etc.) is sent to the server through the application. For example, "Waking up at 06:00" is recorded.

[1403] Step 2:

[1404] The server records the transmitted activity information in a log along with the date, and this log data is managed for each user.

[1405] Step 3:

[1406] The server analyzes the log data every certain period (e.g., one week, one month, etc.) and extracts daily routine patterns, including wake-up time, bedtime, meal times, etc.

[1407] Step 4:

[1408] The server then integrates the analysis results into the user profile and stores it as average wake-up and bedtime times, which serve as the basis for subsequent environmental adjustments.

[1409] Adjusting the home environment

[1410] Step 1:

[1411] The server determines the timing of home environment adjustments based on the analysis of the user profile and routine. For example, if a wake-up routine is registered for 6:00 a.m., the adjustments will be made at that time.

[1412] Step 2:

[1413] The server generates specific instructions to adjust the home environment (e.g., set the temperature to 22°C, brighten the lights, play music).

[1414] Step 3:

[1415] The server generates and sends instructions to devices, such as smart thermostats, smart lighting systems, and music playback devices.

[1416] Step 4:

[1417] The device then carries out the instructions it receives: for example, a smart thermostat sets the temperature to 22°C, a smart lighting system adjusts the brightness to a specified level, or a music playback device plays a specified playlist.

[1418] Health Management and Emergency Response

[1419] Step 1:

[1420] The user periodically enters health data (e.g., heart rate, blood pressure) into the application, and this information is sent to the server.

[1421] Step 2:

[1422] The server records the received health data in a profile and monitors for outliers and trends, for example, if your heart rate is consistently elevated, it will record that data.

[1423] Step 3:

[1424] If an abnormal value is detected, the server generates an emergency alert and sends corresponding instructions to the device. For example, if the heart rate reaches a dangerous level, the server sends an alert along with a notification to contacts.

[1425] Step 4:

[1426] Your device will receive emergency alerts and respond by sounding an alarm, flashing a light, or automatically sending a notification to your emergency contacts, allowing for early response.

[1427] Example 1

[1428] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1429] In today's home environment, it is difficult to provide customized services that meet the individual needs and preferences of users. In addition, health data monitoring and emergency response may be delayed, making it difficult to ensure safety, especially for elderly users and those with health risks.

[1430] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1431] In this invention, the server includes server means for creating and updating a user's profile, server means for recording the user's daily routine, data analysis means for analyzing the recorded daily routine data and identifying the user's routine, server means for transmitting instructions to the terminal for adjusting the home environment based on the user's profile and daily routine, and terminal means for receiving instructions from the terminal and adjusting the home environment in accordance with the instructions. This makes it possible to provide an optimal home environment that meets the individual needs of the user, as well as to monitor health data and respond quickly to emergencies.

[1432] A "user profile" is a collection of data about a user, including the user's personal information, preferences, health data, etc.

[1433] The "server means" is a server device that has the functions of receiving, storing, analyzing, and generating instructions on data.

[1434] The "terminal means" is a device that receives instructions sent from the server and executes operations in accordance with those instructions.

[1435] The "data analysis means" is a means having the function of analyzing the recorded data of daily life and identifying the user's life patterns and routines.

[1436] "Daily life routine" means a user's daily activity patterns and schedules (e.g., wake-up time, bedtime, meal times, etc.).

[1437] The "home environment" includes the temperature, lighting, music, and the state of home appliances in the user's living environment.

[1438] "Health data" refers to data that indicates the user's health condition, such as heart rate and blood pressure.

[1439] "Abnormal value" means a value in a user's health data that deviates from the normal range.

[1440] "Emergency response" refers to the process of quickly issuing an alert and taking appropriate measures when abnormal values ​​are detected.

[1441] The present invention is a system that creates and updates a user's profile, records and analyzes daily routines, and adjusts the home environment according to the user's needs.

[1442] First, the creation and updating of user profiles is done by the server. When a user logs in or registers to the application, the server receives the user's personal information (e.g., name, age, contact details, etc.) and stores it in a database. For example, database management is done using MySQL. When the user enters their environmental settings (e.g., preferred temperature, lighting brightness), the server reflects this in the profile and stores it in the database. Health data (e.g., heart rate, blood pressure) is also entered and stored in the same way.

[1443] Next, daily routines are recorded either by the user entering them into the application or automatically through a measurement device such as a smartwatch. The server receives this data and records it in a database along with date and time information. For data analysis, Python and Pandas are used to analyze the recorded daily data and identify the user's lifestyle patterns. For example, routine information such as "wake up at 6:00 every day" is added to the profile and saved in the database.

[1444] When adjusting the home environment, the server generates appropriate environmental adjustment instructions based on the user's profile and daily routine. For example, if the user has the habit of waking up at 6:00, the server sends instructions to the device such as "set the room temperature to 22°C," "gradually brighten the lights," and "play your favorite music when you wake up." This is done using Node.js and the MQTT protocol. The device receives these instructions and actually adjusts the environment. For example, a smart thermostat is used to adjust the temperature, and smart lights are used to adjust the lighting.

[1445] Finally, regarding health data monitoring and response, the server monitors the user's health data in real time and takes emergency action if an abnormality is detected. This includes sending alerts to emergency contacts using Twilio and sending "emergency response instructions" to the device. This ensures the safety of elderly users and those with health risks.

[1446] Examples:

[1447] When the user goes to bed at 10 p.m., the server sends instructions to the device to gradually dim the lights and play relaxing music.

[1448] When the user wakes up at 6am, the server gradually brightens the lights and plays their favorite music to wake them up.

[1449] Users measure their blood pressure periodically and enter the data into the application, which records this information and alerts them if any abnormal readings are detected.

[1450] Example prompts to input to a generative AI model:

[1451] "For a user who wakes up at 6am every day, please explain the flow to set the room temperature to 22°C, gradually increase the brightness of the lights, and play their favorite music to coincide with their wake-up time."

[1452] As described above, the present invention provides customized services according to the individual needs of users, thereby realizing a more comfortable and safe home environment.

[1453] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1454] Step 1:

[1455] A user logs in or signs up for the app.

[1456] Specific operation: The user launches the app, clicks the "New Registration" button, and enters their name, age, and contact information.

[1457] Input: Personal information entered by the user (e.g., name, age, contact details).

[1458] Output: The user's personal information record that the server stores in the database.

[1459] Step 2:

[1460] The server receives the user's personal information and stores it in a database.

[1461] Specific operation: The server uses MySQL to record the received personal information in a database.

[1462] Input: Personal information entered by the user.

[1463] Output: The user's personal information record stored in the database.

[1464] Step 3:

[1465] The user uses the application to enter environmental settings (e.g., temperature preference, lighting brightness).

[1466] Specific operation: The user enters something like "Set room temperature to 22°C" on the "Settings" screen and presses the save button.

[1467] Input: Preference information entered by the user.

[1468] Output: A preference record that the server stores in the database.

[1469] Step 4:

[1470] The server receives the configuration information and updates the user profile.

[1471] What happens: The server adds the preference information to the profile and saves it in the database.

[1472] Input: Preference information entered by the user.

[1473] Output: The updated user profile record.

[1474] Step 5:

[1475] The user uses the application to input daily routines (e.g., waking up, going to bed, eating).

[1476] Specific operation: The user enters "Wake up at 06:00" in the app and presses the save button.

[1477] Input: Daily life routine information entered by the user.

[1478] Output: Routine data that the server stores in the database.

[1479] Step 6:

[1480] The server receives data on daily life and records it in a database along with date and time information.

[1481] Specific operation: The server saves the routine data in a database with a timestamp.

[1482] Input: Routine data entered by the user.

[1483] Output: Timestamped routine data stored in a database.

[1484] Step 7:

[1485] The server collects routine data over a period of time and performs data analysis.

[1486] What happens: The server uses Python and Pandas to analyze the data and identify patterns such as "average wake-up time is 06:00."

[1487] Input: Routine data for a period of time extracted from a database.

[1488] Output: User's life patterns as an analysis result.

[1489] Step 8:

[1490] The server reflects the analysis results in the user profile and stores them in a database.

[1491] Specific operation: The server adds the analysis results to the profile and stores it in the database.

[1492] Input: Data analysis results.

[1493] Output: The updated user profile.

[1494] Step 9:

[1495] The server generates instructions for adjusting the home environment based on the user's profile and lifestyle patterns.

[1496] Specific operation: The server generates instructions such as "set the room temperature to 22°C at 6:00" and "gradually brighten the lights."

[1497] Input: User profile and lifestyle pattern data.

[1498] Output: Generated home environment adjustment instructions.

[1499] Step 10:

[1500] The server transmits a home environment adjustment instruction to the terminal.

[1501] Specific operation: The server sends instructions to the terminal using the MQTT protocol.

[1502] Input: Generated home environment adjustment instructions.

[1503] Output: Adjustment instructions sent to the terminal.

[1504] Step 11:

[1505] The terminal receives instructions from the server and executes the instructions.

[1506] Specific operation: The device controls smart thermostats and smart lights to adjust the environment.

[1507] Input: Adjustment instructions from the server.

[1508] Output: The environmental adjustments performed.

[1509] Step 12:

[1510] The user periodically inputs or transmits health data (heart rate, blood pressure, etc.) from a measurement device.

[1511] Specific actions: The user enters blood pressure into the application, and the smartwatch transmits the data.

[1512] Input: User's health data.

[1513] Output: Health data records that the server stores in a database.

[1514] Step 13:

[1515] The server monitors health data and takes emergency action if abnormal values ​​are detected.

[1516] What it does: The server monitors health data in real time, and if it detects any abnormal values, it uses Twilio to send an alert to emergency contacts and send appropriate instructions to the device.

[1517] Input: Health data captured in real time.

[1518] Output: Alerts and instructions on how to respond in the event of an abnormality.

[1519] Through these steps, customized services can be provided according to the individual needs of the user, realizing a more comfortable and safe home environment.

[1520] (Application example 1)

[1521] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1522] Conventional home environment control systems struggle to adjust the environment appropriately based on individual user preferences and daily routines. They also lack the ability to respond quickly in emergencies or monitor users' health data. Furthermore, food delivery services lack personalization and do not provide services based on individual mealtimes or food preferences.

[1523] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1524] In this invention, the server includes means for creating and updating a user's profile, means for recording and analyzing the user's daily routine, means for sending instructions to the terminal for adjusting the home environment based on the user's routine and preferences, and means for utilizing the user's behavioral data to provide personalized services, thereby enabling the optimal adjustment of the home environment according to the user's individual needs and preferences, rapid response in emergencies, and provision of food delivery services based on meal times and preferences.

[1525] A "user profile" is detailed information describing a particular user, including information such as personal preferences, lifestyle habits, and health status.

[1526] "Daily routine" refers to the pattern of activities and behavior that a user regularly performs.

[1527] "Adjusting the home environment" refers to controlling the indoor temperature, lighting, music, home appliances, etc. to improve the user's comfort and convenience.

[1528] A "terminal" is a communication device used by a user, such as a smartphone, tablet, or smart device.

[1529] A "database" is a storage device for storing and managing a user's profile and daily routine.

[1530] "Personalized service provision" means providing services that are customized based on the specific needs and preferences of each individual user.

[1531] "Behavioral data" refers to data about a user's activities and preferences, including a history of specific behaviors.

[1532] The "food delivery function" is a service that delivers appropriate meals based on the user's meal preferences and time.

[1533] "Emergency response" refers to measures to issue prompt warnings and notifications when an abnormality occurs in the user's health condition.

[1534] "Meal suggestions" refers to suggesting optimal meal menus based on the user's past data and preferences.

[1535] This invention relates to a system including means for creating and updating a user's profile, means for recording and analyzing the user's daily routine, and means for sending instructions to a terminal for adjusting the home environment based on the user's routine and preferences, and further includes means for utilizing the user's behavioral data to provide personalized services.

[1536] Creating and updating user profiles

[1537] The server creates a new user profile when a user registers with the system, which includes personal information, preferences, dietary preferences, allergy information, and past order history. When a user enters or updates this information through the smartphone app, the server stores this information in a database.

[1538] Recording and analyzing daily routines

[1539] The server records the user's daily activities sent from the smartphone app. The server collects the user's activities at specific times (e.g., waking up, eating, going to bed, etc.) and stores them in a database. The server analyzes the collected data over a period of time to identify the user's lifestyle patterns and eating routines.

[1540] Personalized Food Delivery

[1541] The server will then suggest appropriate meals based on the user's profile and daily routine. For example, if the user specifies in their profile that they would like to have breakfast at 6:00, the server will send a food delivery notification to their smartphone at that time. The notification will say something like, "Your personalized breakfast will be delivered soon."

[1542] Health Management and Emergency Response

[1543] The server monitors health data (e.g., heart rate, blood pressure) obtained from the smartphone app. If an abnormality is detected, the server sends an emergency alert to the device and notifies pre-defined contacts.

[1544] Hardware and software used

[1545] Hardware: Smartphones, communication infrastructure, servers

[1546] Software: SQLite database, Python script, notification sending module

[1547] Specific examples

[1548] For example, if User A is a vegetarian and has a habit of eating dinner at 6:00 PM every day, the server will send a notification to the user's smartphone at 5:45 PM every day, saying, "Your vegetarian dinner will be delivered soon." If User A experiences any abnormalities in their heart rate, the server will immediately send an emergency notification to prompt the user to take appropriate action.

[1549] Example prompts for generative AI models

[1550] "User A is a vegetarian and wants to eat dinner at 6 PM every day. Create a profile for User A and create a program to send personalized notifications at their preferred times. Also, add the ability to send emergency alerts.

[1551] Meal routine: Dinner at 6pm

[1552] Food preference: Vegetarian

[1553] Allergy information: None

[1554] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1555] Step 1:

[1556] When a user creates an account through a smartphone app, the server generates a new user profile. The data entered by the user, such as personal information, preferences, dietary preferences, and allergy information, is sent to the server. The server stores the data in an SQLite database. This process creates a user profile and prepares the basic data required for subsequent processing.

[1557] Step 2:

[1558] The server receives behavioral data sent from the smartphone app to record the user's daily routine. For example, the user sends information to the server about when they wake up, eat, and go to bed at specific times. The server then stores this data in a database and analyzes their lifestyle patterns over a period of time. This process clarifies the user's routine and provides the basis for providing appropriate services.

[1559] Step 3:

[1560] The server generates instructions for personalized home environment and food delivery services based on the analyzed user's daily routine and profile. For example, if the user tends to wake up at 6 a.m., the server generates instructions for sending notifications at that time. This process ensures that notifications and services are provided at the optimal time for the user.

[1561] Step 4:

[1562] The server sends instructions to the terminal to adjust the home environment. For example, it issues instructions to set the room temperature or lighting brightness as desired by the user. This instruction is transmitted from the terminal to smart devices in the home, which actually adjust the home environment. This process improves the user's comfort.

[1563] Step 5:

[1564] The server receives and monitors the user's health data from the smartphone app. Data such as heart rate and blood pressure is periodically sent to the server. The server analyzes the received data and sends an emergency alert to the device if an abnormality is detected. This process ensures the user's safety.

[1565] Step 6:

[1566] The server processes the notification of personalized meal suggestions according to the user's mealtime. For example, if the user has a habit of eating dinner at 6:00 p.m., the server generates instructions to automatically send a notification at 5:45 p.m. The notification includes a message such as "Your personalized dinner will arrive soon." This process allows the user to receive information at the appropriate time.

[1567] Step 7:

[1568] The server performs the procedures to execute the food delivery service. Based on the user's profile and routine, it suggests available menu items and sends notifications. If the user accepts the meal suggestion, the notification confirms the order and instructs the delivery to be prepared. This process results in a food delivery that meets the user's needs.

[1569] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1570] The present invention relates to a system including a means for creating and updating a user's profile, a means for recording and analyzing the user's daily routine, and a means for sending instructions to a terminal to adjust the home environment based on the user's routine and preferences. The present invention also includes a means for monitoring and storing the user's health data, a means for responding to emergencies based on the health data, and a means for controlling temperature, lighting, music, and home appliances in adjusting the home environment. Additionally, by combining this with an emotion engine that recognizes the user's emotions, the system realizes optimization of the home environment based on the user's emotions.

[1571] 1. Creating and updating your user profile

[1572] The server creates a new user profile when a user registers with the system. The user profile includes the user's personal information, environmental settings (e.g., temperature preferences, lighting brightness), and health data (e.g., heart rate, blood pressure). When the user enters or updates this information through the application, the server stores the information in a database. For example, if the user specifies "set room temperature to 22°C," the server reflects this information in the profile and stores it in the database.

[1573] 2. Recording and analyzing daily routines

[1574] The server records the user's daily activities. This is the process of collecting activities at specific times (e.g., waking up, going to bed, etc.). If the user "wakes up at 06:00," that information is sent to the server and recorded as the user's routine. The server analyzes the data collected over a certain period of time to identify the user's lifestyle patterns. For example, if the server registers a tendency to wake up at 6:00 every morning, it will save the user's "average wake-up time as 06:00" in the profile.

[1575] 3. Adjusting the home environment

[1576] The server generates instructions for adjusting the home environment based on the user's profile and daily routine. When the user's emotion engine recognizes their emotion, it integrates that information into the user's profile for further personalization. For example, if the user wakes up at 6:00, the server will send instructions to the device to adjust the room temperature to 22°C, gradually brighten the lights, and play their favorite music when they wake up. This creates an optimal environment for the user's wake-up time.

[1577] 4. Health Management and Emergency Response

[1578] The server monitors the user's health data (e.g., heart rate, blood pressure) and takes emergency action if it detects any abnormalities. For example, if the user's heart rate becomes abnormally high, the server sends an emergency alert to the device, prompting appropriate action. This ensures the safety of elderly users and those with health risks.

[1579] 5. Emotion Recognition and Home Environment Optimization

[1580] The server uses an emotion engine to recognize the user's emotions and adjusts the home environment based on those emotions. For example, if the emotion engine recognizes that the user is feeling stressed, the server will send instructions to the device, such as "play relaxing music," "change the lighting to a softer color," and "set the temperature to a comfortable range." This reduces the user's stress and provides a relaxing environment.

[1581] Specific examples

[1582] When the user goes to bed at 10 p.m., the server sends instructions to the device to gradually dim the lights and play relaxing music.

[1583] When the user wakes up at 6 a.m., the server gradually brightens the lights and plays their favorite music to wake them up.

[1584] Users measure their blood pressure periodically and enter the data into the application, which records this information and alerts them if any abnormal readings are detected.

[1585] If the server detects that the user is feeling stressed, it sends instructions to the device to adjust the appropriate environmental settings (e.g., temperature, lighting, music) to create a relaxing environment.

[1586] As a result, the present invention provides customized services according to the individual needs of users, realizing a more comfortable and safe home environment.

[1587] The processing flow will be explained below.

[1588] Creating and updating user profiles

[1589] Step 1:

[1590] When a user registers with the system, they enter basic information (such as name, age, and gender) through the application. After completing this information entry, it is sent to the server.

[1591] Step 2:

[1592] The server uses the submitted information to create a new user profile, which includes initial environmental settings (temperature, lighting, music, etc.) and health data.

[1593] Step 3:

[1594] When a user updates their preferences or health data through the application, the new information is sent to the server, for example, specifying "set room temperature to 22°C."

[1595] Step 4:

[1596] The server then updates the user profile with the received information and stores it in the database, ensuring that the latest information is available the next time the user accesses the site.

[1597] Recording and analyzing daily routines

[1598] Step 1:

[1599] When a user performs a specific activity, the information (e.g., the time of waking up, going to bed, etc.) is sent to the server through the application. For example, "Waking up at 06:00" is recorded.

[1600] Step 2:

[1601] The server records the transmitted activity information in a log along with the date, and this log data is managed for each user.

[1602] Step 3:

[1603] The server analyzes the log data every certain period (e.g., one week, one month, etc.) and extracts daily routine patterns, including wake-up time, bedtime, meal times, etc.

[1604] Step 4:

[1605] The server then integrates the analysis results into the user profile and stores it as average wake-up and bedtime times, which serve as the basis for subsequent environmental adjustments.

[1606] Adjusting the home environment

[1607] Step 1:

[1608] The server determines the timing of home environment adjustments based on the analysis of the user profile and routine. For example, if a wake-up routine is registered for 6:00 a.m., the adjustments will be made at that time.

[1609] Step 2:

[1610] The server generates specific instructions to adjust the home environment (e.g., set the temperature to 22°C, brighten the lights, play music).

[1611] Step 3:

[1612] The server generates and sends instructions to devices, such as smart thermostats, smart lighting systems, and music playback devices.

[1613] Step 4:

[1614] The device then carries out the instructions it receives: for example, a smart thermostat sets the temperature to 22°C, a smart lighting system adjusts the brightness to a specified level, or a music playback device plays a specified playlist.

[1615] Health Management and Emergency Response

[1616] Step 1:

[1617] The user periodically enters health data (e.g., heart rate, blood pressure) into the application, and this information is sent to the server.

[1618] Step 2:

[1619] The server records the received health data in a profile and monitors for outliers and trends, for example, if your heart rate is consistently elevated, it will record that data.

[1620] Step 3:

[1621] If an abnormal value is detected, the server generates an emergency alert and sends corresponding instructions to the device. For example, if the heart rate reaches a dangerous level, the server sends an alert along with a notification to contacts.

[1622] Step 4:

[1623] Your device will receive emergency alerts and respond by sounding an alarm, flashing a light, or automatically sending a notification to your emergency contacts, allowing for early response.

[1624] Emotion recognition and home environment optimization

[1625] Step 1:

[1626] The emotions experienced by the user during daily activities are transmitted to the server through the application, which includes voice input and facial expression recognition using the camera.

[1627] Step 2:

[1628] The server uses an emotion engine to analyze the received information and determine the user's emotional state, such as "stressed" or "relaxed."

[1629] Step 3:

[1630] Based on the determined emotional state, the server generates instructions to adjust the home environment, such as "play relaxing music," "change the lighting to a softer color," or "set the temperature to a comfortable range."

[1631] Step 4:

[1632] The server sends the generated instructions to the terminal and adjusts the environment.

[1633] Step 5:

[1634] The device adjusts the home environment based on the received instructions: for example, a music playback device plays relaxing music, a smart lighting system changes the lighting to softer colors, and a smart thermostat sets the temperature optimally.

[1635] As a result, the present invention provides customized services according to the individual needs of users, realizing a more comfortable and safe home environment.

[1636] Example 2

[1637] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1638] Conventional home environment control systems have been unable to fully meet the individual needs of users, particularly in providing a comfortable environment that reflects the user's emotional and health status in real time. Furthermore, they lack the functionality to provide emergency response based on specific daily routines and health data. As a result, it has been difficult for users to achieve a more personalized and secure home environment.

[1639] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1640] In this invention, the server includes means for creating and updating a user profile, means for recording and analyzing the user's daily routine, means for transmitting instructions to the terminal to adjust the home environment based on the user's routine and preferences, and means for recognizing the user's emotions using an emotion engine and transmitting instructions to the terminal to adjust the home environment based on the emotions. This enables the home environment to be adjusted with high precision based on the user's individual needs and emotional state, providing a comfortable and safe living environment.

[1641] A "profile" is a data set that contains a user's personal information, preferences, and health data.

[1642] "Daily routine" refers to the activities and patterns of behavior that a user engages in at a given time.

[1643] An "emotion engine" is a software or hardware component that analyzes information such as a user's facial expressions and voice to identify their emotional state.

[1644] "Terminal" refers to a device that receives and carries out instructions to adjust the home environment.

[1645] "Health data" refers to data including biometric information such as the user's heart rate, blood pressure, and body temperature.

[1646] "Emergency response" refers to taking appropriate action when an abnormality is detected based on health data.

[1647] "Home environment adjustment" refers to optimizing temperature, lighting, music and appliance settings based on the user's profile, routine and emotional state.

[1648] A "database" is a collection of information for storing user profiles and health data.

[1649] The present invention relates to a system including means for creating and updating a user's profile, means for recording and analyzing daily routines, means for transmitting instructions to a terminal for adjusting the home environment based on the user's routines and preferences, and means for recognizing the user's emotions using an emotion engine and transmitting instructions to the terminal for adjusting the home environment based on the emotions.

[1650] The server first creates a new profile when a user registers with the system. The profile includes the user's personal information, environmental settings (e.g., temperature preferences, lighting brightness), and health data (e.g., heart rate, blood pressure). When the user enters or updates this information through the smartphone app, the server stores the information in a database.

[1651] The device monitors the user's daily routine activities at specific times and sends the data to the server for recording and analysis. For example, if the user wakes up at 6:00 every morning, the information is sent to the server via the device. The server analyzes the data collected over a period of time and identifies the user's lifestyle patterns.

[1652] The server then references the user's profile and daily routine to generate instructions for adjusting the home environment. When the user's emotion engine recognizes their emotions, that information is integrated into the profile for further personalization. For example, if a user wakes up at 6:00, the server might send instructions to the device such as "set the room temperature to 22°C," "gradually increase the brightness of the lights," and "play their favorite music when they wake up." This creates an optimal environment for the user's wake-up time.

[1653] Furthermore, the server continuously monitors the user's health data and has the ability to take emergency action if it detects any abnormalities. For example, if the heart rate becomes abnormally high, the server will send an emergency alert to the device, prompting appropriate action. In the future, this could also contribute to ensuring the safety of elderly users and those with health risks.

[1654] To recognize a user's emotions, the device uses a camera and microphone to analyze facial expressions and tone of voice, and the emotion engine analyzes that data to identify the user's emotional state. For example, if the user is feeling stressed, the server will send instructions to the device, such as "play relaxing music," "change the lighting to a soft color," and "set the temperature to a comfortable range," to provide a relaxing environment for the user.

[1655] Specific examples

[1656] When the user goes to bed at 10 p.m., the server sends instructions to the device to "gradually dim the lights and play relaxing music."

[1657] When the user wakes up at 6am, the server gradually brightens the lights and plays their preferred music.

[1658] Users measure their blood pressure periodically and enter the data into the application, which records this information and alerts them if any abnormal readings are detected.

[1659] If the emotion engine recognizes that the user is feeling stressed, the server will send instructions to the device, such as "play relaxing music," "change the lighting to a soft color," and "set the temperature to a comfortable range," to create a relaxing environment.

[1660] Prompt Sentence Examples

[1661] "For a user who wakes up at 6am every morning, create a program that sends the following instructions to the device when the user wakes up: set the room temperature to 22°C, gradually increase the brightness of the lights, and play their favorite music."

[1662] "Describe a system that, when the emotion engine recognizes that the user is stressed, sends instructions to the device to play relaxing music, change the lighting to a softer color, and set the temperature to a comfortable range."

[1663] In this way, the present invention realizes highly accurate optimization of the home environment in response to the user's individual needs and real-time conditions.

[1664] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1665] Step 1: Register and create your profile

[1666] Users register with the system through a smartphone app. The app presents the necessary information (such as name, age, gender, health information, and preferences) in a form, which the user then enters and submits.

[1667] Input: User personal information, preferences, and health data

[1668] Data processing: Convert the input data into a profile format

[1669] Output: The completed profile is generated.

[1670] Step 2: Save the profile

[1671] The server stores the received user data in a database. For example, if a user specifies "set the room temperature to 22°C," this is reflected in the profile.

[1672] Input: User personal information, preferences, and health data

[1673] Data processing: Converting data into database format

[1674] Output: Profiles stored in a database

[1675] Step 3: Record your daily routine

[1676] The device monitors the user's activity at a specific time and sends that information to the server. For example, if the user wakes up at 6:00, that information is sent.

[1677] Input: User activity data (e.g., wake-up time, bedtime)

[1678] Data processing: Record activity data in chronological order

[1679] Output: Recorded activity data is stored on the server.

[1680] Step 4: Analyzing routine data

[1681] The server analyzes the daily routine data collected over a period of time to identify the user's lifestyle patterns, for example, a tendency to wake up at 6am every morning.

[1682] Input: Recorded routine data

[1683] Data processing: Pattern analysis using data analysis algorithms

[1684] Output: Data that identifies the user's daily patterns

[1685] Step 5: Generate instructions for adjusting the home environment

[1686] The server generates environmental adjustment instructions based on the user's profile and daily routine. For example, when waking up at 6:00, instructions such as "set the room temperature to 22°C," "gradually increase the brightness of the lights," and "play your favorite music when you wake up" are generated.

[1687] Input: User profile data, routine data

[1688] Data processing: Generate configuration instructions based on instruction generation algorithms

[1689] Output: Specific instructions for the environment settings

[1690] Step 6: Sending environmental adjustment instructions

[1691] The server sends the generated instructions to the terminal, which receives them and performs specific operations on each device in the home.

[1692] Input: Environment setting instruction data

[1693] Data processing: Converts instruction data into a format that can be applied to each device

[1694] Output: Control instructions sent to each device

[1695] Step 7: Monitoring your health data

[1696] The device continuously monitors the user's health data. For example, a smartwatch measures heart rate and blood pressure and sends the data to a server.

[1697] Input: Health data such as heart rate, blood pressure, etc.

[1698] Data processing: data filtering and format conversion

[1699] Output: Health data sent to the server

[1700] Step 8: Health data analysis and emergency response

[1701] The server analyzes health data in real time and takes emergency action if an abnormal value is detected. For example, if the heart rate is abnormally high, an emergency alert will be sent to the device.

[1702] Input: Collected health data

[1703] Data processing: Data analysis using anomaly detection algorithms

[1704] Output: Anomaly detection results and emergency alerts

[1705] Step 9: Collect emotion data

[1706] The device analyzes the user's facial expressions and voice, and the emotion engine sends the data to the server, which determines the user's emotional state.

[1707] Input: facial expression data, voice data

[1708] Data processing: Analysis using emotion recognition algorithms

[1709] Output: Emotion analysis results

[1710] Step 10: Generate and send emotion-based environmental adjustment instructions

[1711] The server generates instructions for adjusting the environment based on the data from the emotion engine and sends them to the terminal, which then adjusts the home environment based on the user's emotions.

[1712] Input: Sentiment analysis result data

[1713] Data processing: Generating environmental instructions according to emotional states

[1714] Output: Sends environmental indication data to the terminal

[1715] (Application example 2)

[1716] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1717] The present invention relates to a system that comprehensively manages a user's daily routine, emotions, and health status to create an optimal home environment for the user. Conventional systems often manage individual elements (e.g., temperature and lighting) independently, making it difficult to fully consider the user's overall health management and emotional comfort. This has led to a need to ensure safety and comfort, especially for elderly users and users with health risks. Furthermore, optimizing the home environment based on the user's emotions is important for reducing stress and creating an environment for relaxation, but no system has existed that comprehensively manages these factors.

[1718] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1719] In this invention, the server includes means for creating and updating a user's profile, means for recording and analyzing the user's daily routine, means for sending instructions to the terminal to adjust the home environment based on the user's routine and preferences, means for recognizing the user's emotions and adjusting the home environment based on the emotions, and means for monitoring the user's health data and taking emergency measures when an abnormality is detected. This makes it possible to adjust and manage the home environment in an integrated manner based on the user's routine, emotions, and health data, and provide the user with a safe and comfortable living environment.

[1720] A "profile" is a database entry that contains detailed information about a user, such as their personal information, preferences, health data, and so on.

[1721] "Routine" refers to a regular pattern of activities or behaviors in a user's daily life.

[1722] "Emotion recognition" is a technology that detects the user's emotional state and responds appropriately based on that.

[1723] "Emergency response" refers to taking appropriate measures immediately when an abnormality is detected in a user's health data.

[1724] "Smart devices" is a general term for devices that can connect to the Internet and are equipped with multifunctional sensors and computing capabilities.

[1725] "Home environment adjustment" refers to the act of controlling temperature, lighting, music, and home appliances to provide a comfortable home environment for users.

[1726] A "generative AI model" is an artificial intelligence technique that generates appropriate output based on specific input data (such as a prompt).

[1727] A "prompt" is text data that is input into a generative AI model, and based on this, the model generates an appropriate output.

[1728] This invention relates to a system that manages a user's profile and adjusts the home environment based on daily routines, emotional state, and health data. The system has the following main functions:

[1729] 1. Creating and updating your user profile

[1730] The server creates a new profile when a user registers with the system. The profile includes personal information, environmental settings (e.g., temperature preferences and lighting settings), and health data (e.g., heart rate and blood pressure). When a user enters or updates this information through the application, the server stores the information in a database.

[1731] example:

[1732] If a user wants to set the room temperature to 22°C, this information is reflected in the profile and stored in the database.

[1733] 2. Recording and analyzing daily routines

[1734] The server records the user's daily activities. This is the process of collecting activities at specific times (e.g., waking up, going to bed, etc.). If the user performs an activity at a specific time (e.g., waking up at 06:00), the information is sent to the server and recorded as the user's routine. The server analyzes the data collected over a period of time to identify the user's lifestyle patterns.

[1735] example:

[1736] If a user tends to wake up at 6:00 every morning, the server will store "average wake-up time 06:00" in their profile.

[1737] 3. Adjusting the home environment

[1738] The server generates instructions for adjusting the home environment based on the user's profile and daily routine. When the user's emotion engine recognizes emotions, it integrates this information into the user's profile for further personalization.

[1739] example:

[1740] If the user wakes up at 6:00, the server will send instructions to the device to match that time, such as "set the room temperature to 22°C," "gradually brighten the lights," and "play your favorite music when you wake up." This creates the optimal environment for the user when they wake up.

[1741] 4. Health Management and Emergency Response

[1742] The server monitors the user's health data (e.g., heart rate and blood pressure) and takes emergency action if it detects any abnormalities, ensuring the safety of elderly users and those with health risks.

[1743] example:

[1744] If the user's heart rate becomes abnormally high, the server will send an emergency alert to the device, prompting them to take appropriate action.

[1745] 5. Emotion Recognition and Home Environment Optimization

[1746] The server uses an emotion engine to recognize the user's emotions and adjusts the home environment based on the emotions.

[1747] example:

[1748] When the emotion engine recognizes that the user is feeling stressed, the server sends instructions to the device, such as "play relaxing music," "change the lighting to a softer color," and "set the temperature to a comfortable range." This reduces the user's stress and provides a relaxing environment.

[1749] Hardware and software used

[1750] Smart Device: A device that can connect to the Internet and has multiple sensor and computing capabilities (e.g., smartphone, smart glasses).

[1751] Server: A server that manages user profiles, analyzes data, monitors health data, etc.

[1752] Generative AI model: An artificial intelligence model that recognizes user emotions and generates appropriate output based on prompts (text data).

[1753] Examples of concrete examples and prompts

[1754] Examples:

[1755] When the user goes to bed at 10 p.m., the server sends instructions to the device to gradually dim the lights and play relaxing music.

[1756] The server also gradually brightens the lights and plays the user's favorite music to wake them up at 6:00 a.m., when the user wakes up.

[1757] Example prompt sentence:

[1758] The user puts on the smart glasses and sends the instruction "Dim the lights in the living room in 5 minutes and play relaxing music" to the system.

[1759] As a result, the present invention provides customized services according to the individual needs of users, realizing a more comfortable and safe home environment.

[1760] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1761] Step 1:

[1762] Creating and updating user profiles

[1763] The server receives input from the user and creates a new profile. Specifically, the user enters personal information, environmental settings, and health data via a smartphone or smart glasses, and the server stores this in a database. Inputs include temperature preferences, lighting settings, heart rate, blood pressure, etc. The server analyzes this data and stores it in the database in an appropriate format.

[1764] (input)

[1765] Your personal information, preferences, and health data

[1766] (output)

[1767] User profiles stored in a database

[1768] Step 2:

[1769] Recording and analyzing daily routines

[1770] The server continuously monitors and records the user's daily activities. Specifically, the server receives data such as wake-up and bedtime sent from the smart device and stores it in a database. The server analyzes the data collected over a certain period of time to identify the user's lifestyle patterns. For example, if a user tends to wake up at 6:00 a.m. every morning, it records that time as the "average wake-up time."

[1771] (input)

[1772] Daily activity data such as wake-up time and bedtime

[1773] (output)

[1774] Life patterns stored in a database

[1775] Step 3:

[1776] Adjusting the home environment

[1777] The server generates instructions for adjusting the home environment based on the user's profile and daily routine. Specifically, the server analyzes the profile data and lifestyle patterns to determine optimal environmental conditions such as lighting, temperature, and music settings. This information is sent to the device, and the home environment is automatically adjusted.

[1778] (input)

[1779] User profile, lifestyle pattern data

[1780] (output)

[1781] Home environment adjustment instructions sent to the device

[1782] Step 4:

[1783] Emotion recognition and home environment optimization

[1784] The server uses a generative AI model to recognize the user's emotions. Specifically, it analyzes emotional data such as voice and facial expressions sent from the smart device to identify the user's emotional state (e.g., stress). Based on the emotional state, the server generates instructions to optimize the home environment. For example, if the user is feeling stressed, the server sends instructions to the device to play relaxing music and change the lighting to a softer color.

[1785] (input)

[1786] Emotional data such as voice and facial expressions

[1787] (output)

[1788] Emotion-based environmental adjustment instructions sent to the device

[1789] Step 5:

[1790] Health Management and Emergency Response

[1791] The server monitors the user's health data in real time, receiving heart rate and blood pressure data sent from the smart device and generating an emergency alert if an abnormal value is detected. For example, if the heart rate is abnormally high, the server sends an emergency alert to the device, prompting the user to take appropriate action.

[1792] (input)

[1793] Heart rate and blood pressure data

[1794] (output)

[1795] Emergency alert generation and transmission

[1796] Step 6:

[1797] Generate and send prompt statements

[1798] The server uses the generative AI model to generate appropriate prompts when adjusting the home environment or responding to emergencies, thereby providing users with easy-to-understand instructions and warnings. Specifically, the prompts are generated and displayed on the smart device screen.

[1799] (input)

[1800] Home environment adjustment instruction data, emergency alert data

[1801] (output)

[1802] Prompt text displayed on smart devices

[1803] This allows the system to provide the optimal home environment according to the user's situation, ensuring the user's safety and comfort.

[1804] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1805] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1806] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1807] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1808] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1809] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1810] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1811] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1812] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1813] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1814] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1815] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1816] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1817] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1818] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1819] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1820] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1821] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1822] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1823] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1824] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1825] The following is further disclosed regarding the above embodiment.

[1826] (Claim 1)

[1827] A means for creating and updating user profiles;

[1828] a means for recording and analyzing the user's daily routine;

[1829] means for transmitting instructions to the terminal to adjust the home environment based on the user's routines and preferences;

[1830] A system including:

[1831] (Claim 2)

[1832] a means for monitoring and storing user health data;

[1833] A means of responding to emergencies based on health data; and

[1834] The system of claim 1 further comprising:

[1835] (Claim 3)

[1836] A means for controlling the temperature, lighting, music, and appliances in regulating the home environment;

[1837] The system of claim 1 further comprising:

[1838] "Example 1"

[1839] (Claim 1)

[1840] server means for creating and updating user profiles;

[1841] server means for recording the daily routine of a user;

[1842] a data analysis means for analyzing the recorded daily life data and identifying the user's routine;

[1843] server means for transmitting instructions to the terminal for adjusting the home environment based on the user's profile and daily routine;

[1844] terminal means for receiving instructions from the terminal and adjusting the home environment in accordance with the instructions;

[1845] A system including:

[1846] (Claim 2)

[1847] means for monitoring and storing user health data;

[1848] A means for detecting abnormal values ​​based on health data and taking emergency measures;

[1849] The system of claim 1 further comprising:

[1850] (Claim 3)

[1851] Means for controlling temperature, lighting, music, and household appliances in regulating the home environment;

[1852] The system of claim 1 further comprising:

[1853] "Application Example 1"

[1854] (Claim 1)

[1855] A means for creating and updating user profiles;

[1856] a means for recording and analyzing the user's daily routine;

[1857] means for transmitting instructions to the terminal to adjust the home environment based on the user's routines and preferences;

[1858] A means of utilizing user behavior data to provide personalized services;

[1859] A system including:

[1860] (Claim 2)

[1861] a means for monitoring and storing user health data;

[1862] A means of responding to emergencies based on health data; and

[1863] A means for providing a food delivery function for providing appropriate services based on the user's mealtimes and preferences;

[1864] means for sending notifications to user contacts in the event of an emergency;

[1865] The system of claim 1 further comprising:

[1866] (Claim 3)

[1867] A means for controlling the temperature, lighting, music, and appliances in regulating the home environment;

[1868] a means for providing personalized mealtime meal suggestions;

[1869] The system of claim 1 further comprising:

[1870] "Example 2: Combining Emotion Engines"

[1871] (Claim 1)

[1872] A means for creating and updating user profiles;

[1873] a means for recording and analyzing the user's daily routine;

[1874] means for transmitting instructions to the terminal to adjust the home environment based on the user's routines and preferences;

[1875] means for recognizing a user's emotion using an emotion engine and transmitting to the terminal an instruction to adjust the home environment based on the emotion;

[1876] A system including:

[1877] (Claim 2)

[1878] a means for monitoring and storing user health data;

[1879] A means of responding to emergencies based on health data; and

[1880] The system of claim 1 further comprising:

[1881] (Claim 3)

[1882] A means for controlling the temperature, lighting, music, and appliances in regulating the home environment;

[1883] The system of claim 1 further comprising:

[1884] "Application example 2 when combining emotion engines"

[1885] (Claim 1)

[1886] A means for creating and updating user profiles;

[1887] a means for recording and analyzing the user's daily routine;

[1888] means for transmitting instructions to the terminal to adjust the home environment based on the user's routines and preferences;

[1889] means for recognizing a user's emotion and adjusting the home environment based on the emotion;

[1890] A means for monitoring the user's health data and taking emergency action if an abnormality is detected;

[1891] A system including:

[1892] (Claim 2)

[1893] Using a smart device, the system records the user's daily routine and emotional state,

[1894] A means of automatically adjusting the home environment;

[1895] Recognize user emotions using generative AI models,

[1896] Detects abnormal values ​​based on input health data,

[1897] Includes the means to implement appropriate responses

[1898] 10. The system of claim 1.

[1899] (Claim 3)

[1900] A means for controlling the temperature, lighting, music, and appliances in regulating the home environment;

[1901] means for generating and sending prompt sentences;

[1902] 10. The system of claim 1, comprising: [Explanation of symbols]

[1903] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a means for creating and updating a user profile; a means for recording and analyzing the user's daily routine; means for transmitting instructions to the terminal to adjust the home environment based on the user's routines and preferences; A system including:

2. a means for monitoring and storing user health data; A means of responding to emergencies based on health data; and The system of claim 1 further comprising:

3. A means for controlling the temperature, lighting, music, and appliances in regulating the home environment; The system of claim 1 further comprising:

Images