system

Abstract

Provide a system. A means for a user in a remote location to input health and safety information using a smart device; means for transmitting the input information to a central server; A means for analyzing the information received by the central server and notifying the registered contacts; A means for the notified contact to receive a notification; means for acquiring information on room temperature in the house to be displayed on the smart device; A means for operating a home temperature control device according to instructions from the smart device; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern society, it is becoming increasingly common for family members to live far apart. In such circumstances, it is extremely important to regularly check on the health and safety of elderly family members and those in need of health care, and to stay in contact with them. However, using conventional methods, it is difficult to share this information appropriately and quickly. It is also technically difficult to adjust the home environment, especially the room temperature, from a remote location. A new system is needed to solve these issues. [Means for solving the problem]

[0005] The present invention relates to a system that allows users in remote locations to input information about their health and safety using a smart device and send it to a central server. This system has a function in which the central server receives and analyzes the input information and notifies registered contacts. Furthermore, the smart device can acquire information about the room temperature in the home and operate the home's temperature control device from a remote location. Specifically, this system is realized by the following means.

[0006] A means for users to input information about their health and safety using a smart device.

[0007] means for transmitting said information to a central server;

[0008] A means for analyzing the information received by the central server and notifying registered contacts.

[0009] The means by which notified contacts receive notifications.

[0010] A means of getting home temperature information displayed on a smart device.

[0011] A way to control your home's thermostat with instructions from your smart device.

[0012] This allows family members to check on each other's health and safety even when they are far apart, and to properly manage their home environment.

[0013] A "user" is an individual who operates a smart device and inputs information about their health and safety from a remote location.

[0014] A "smart device" is an electronic device such as a portable device or tablet that allows users to input information about their health and safety, and obtain and operate information about the room temperature at home.

[0015] "Central Server" means the computer system that receives and analyzes user input and sends necessary notifications.

[0016] "Health and safety information" refers to data about health and living conditions that users input via their smart devices.

[0017] "Registered contacts" refers to contact information for family members and related parties who are set to receive notifications sent by the user.

[0018] "Room temperature information" refers to indoor temperature data obtained from a temperature sensor installed in your home.

[0019] "Temperature control equipment" refers to mechanical devices used to adjust the room temperature in one's home, specifically equipment such as thermostats and air conditioners.

[0020] "Notification" refers to information about a person's health and safety that is sent from a central server to registered contacts.

[0021] A "remote location" is a geographic location away from where the user lives.

[0022] A "database" is a data management system that stores information about users' health and safety within a central server.

[0023] "Analysis" refers to the process by which the central server analyzes the received user information and generates appropriate notifications.

[0024] "Operation" refers to the user issuing instructions through a smart device and the temperature control device operating based on those instructions. [Brief explanation of the drawings]

[0025] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0026] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0027] First, the terms used in the following description will be explained.

[0028] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0029] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0030] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0031] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0032] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0033] [First embodiment]

[0034] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0035] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0036] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0037] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0038] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0039] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0040] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0041] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0042] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0043] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0044] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0045] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0046] The present invention provides a system that allows users in remote locations to input information about their health and safety using a smart device and send it to a central server. The central server receives and analyzes the input information and sends notifications to registered contacts. Furthermore, the smart device can obtain information about the home's room temperature and remotely control the home's temperature control equipment.

[0047] System Embodiments

[0048] 1. Entering and notifying health and safety information:

[0049] The user inputs information about their health and safety into the device: The user uses a smart device (e.g., a smartphone or tablet) and opens a dedicated application, where they input information about their health and safety (e.g., "I have a headache today").

[0050] The device sends the information to the server: When the user completes the input and presses the send button, the smart device sends this information to the central server.

[0051] The server receives and analyzes the information and sends notifications: The server stores the received information in a database, analyzes it, and then sends notifications to family members and registered contacts as needed. Notifications can be sent via email, push notification, or SMS.

[0052] 2. Room temperature information acquisition and remote operation:

[0053] The home device measures the room temperature and sends it to the server: The IoT temperature sensor installed in the home periodically measures the current room temperature, and the measured data is sent to the central server via the home device.

[0054] The server receives the temperature data and sends it to the user's device: The server receives the temperature data and sends it to the user's smart device in real time. The user can check the current room temperature using a dedicated application on their smart device.

[0055] The user inputs the desired room temperature and sends it from the device to the server: The user inputs the desired room temperature using the application and sends it. This data is sent to the server.

[0056] The server sends instructions to the home device to adjust the temperature: Based on the desired room temperature data received, the server sends temperature control instructions to the home device. The home device follows these instructions and operates the temperature control device (e.g., thermostat or air conditioner) to adjust the temperature to the specified level.

[0057] Specific examples

[0058] Example 1: Specific example of health check

[0059] A user enters their physical condition into a device: An 80-year-old woman enters "I have a headache today" into a smart device application and presses the send button.

[0060] Device sends information to server: Smart devices send this information to a central server.

[0061] The server receives the information and sends a notification: The server receives this information and stores it in a database. The server analyzes it and sends a notification to the necessary contacts (for example, the woman's son). The son receives this notification on his smartphone and can immediately check on his mother's status.

[0062] Example 2: Room temperature control

[0063] A home device measures the temperature and sends it to the server: The IoT temperature sensor in your home measures the current room temperature and sends it to the server.

[0064] The user inputs the desired room temperature and sends it from the device: A man in his 50s is on a business trip and uses his smart device to check the current room temperature in the living room (for example, 28°C) and inputs that it should be set to 24°C.

[0065] The server receives the information and sends instructions to the home device: The server receives this data and sends instructions to the home device to set the temperature to 24°C.

[0066] Home devices adjust the temperature: Your home device controls the thermostat and air conditioner, adjusting the temperature in your living room to 24°C.

[0067] This system allows users to remotely manage the health and safety of their family members and maintain a comfortable home environment, which is extremely useful for elderly people and those with family members who need health care.

[0068] The processing flow will be explained below.

[0069] Input and notification of health and safety information

[0070] Processing Steps:

[0071] Step 1:

[0072] A user enters information about their health and safety into a smart device. For example, they open an application, enter "I have a headache today," and press the send button.

[0073] Step 2:

[0074] The device sends the entered health and safety information to the central server via a POST request. The request data is in JSON format and is structured as follows: { "user_id": 123, "status": "I have a headache today"}.

[0075] Step 3:

[0076] The server receives the POST request and stores this information in a database, for example in a "users_status" table.

[0077] Step 4:

[0078] The server analyzes the information stored in the database and determines whether a notification is necessary. Specifically, it determines that a notification is necessary if the importance is high based on the content of "status."

[0079] Step 5:

[0080] The server creates the notification content and sends it to the registered contacts (such as family members' email addresses or push notification device IDs). For example, an SMTP server is used for email, and FCM is used for push notifications.

[0081] Step 6:

[0082] The notification arrives on the family member's device. The notification service on the device runs and displays the message "Notification from Mom: I have a headache today" to the user.

[0083] Acquisition of room temperature information and remote operation

[0084] Processing Steps:

[0085] Step 1:

[0086] The device at home measures the current room temperature from a temperature sensor, which acquires temperature data every minute, for example.

[0087] Step 2:

[0088] The temperature data acquired by the home device is sent to the central server via a POST request in the format "{ "room_id": 1, "temperature": 28.5, "timestamp": "2023-10-01T12:00:00Z"}".

[0089] Step 3:

[0090] The server receives the POST request and saves the temperature information in the database, in the "room_temperatures" table.

[0091] Step 4:

[0092] The user's device sends a GET request to the server for the current temperature information. The request is sent in the format " / api / temperature / latest?room_id=1", for example.

[0093] Step 5:

[0094] The server receives a GET request, retrieves the latest temperature data from the database, and returns the data in the response format: { "room_id": 1, "temperature": 28.5, "timestamp": "2023-10-01T12:00:00Z"}.

[0095] Step 6:

[0096] The user's device receives the response from the server and displays the current room temperature in the application. For example, "The current temperature in the living room is 28.5°C" is displayed in a visible area for the user.

[0097] Remote room temperature control

[0098] Processing Steps:

[0099] Step 1:

[0100] The user enters the desired room temperature (for example, 24°C) into the smart device application and presses the send button.

[0101] Step 2:

[0102] The device sends the desired room temperature data to the central server via a POST request in the format "{ "room_id": 1, "desired_temperature": 24}".

[0103] Step 3:

[0104] The server receives the POST request and saves the desired temperature information to the database in the "desired_temperatures" table.

[0105] Step 4:

[0106] The server sends temperature adjustment instructions to the home device using the MQTT or HTTP protocol. The instructions are sent in the format "{ "command": "set_temperature", "value": 24}".

[0107] Step 5:

[0108] The home device receives the instruction and executes a command to the temperature control device (e.g., thermostat or air conditioner) to set the desired temperature (24°C).

[0109] Step 6:

[0110] The home thermostat will follow instructions and adjust the room temperature to 24°C. The temperature will be changed and maintained until the specified temperature is reached.

[0111] Example 1

[0112] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0113] In today's world, people with elderly family members or those who require health management need to monitor their family members' health and safety, as well as their home environment, even from remote locations. However, current systems make it difficult to efficiently input information, provide notifications, and adjust temperatures, and there are particular challenges in real-time information transmission and environmental adjustment. Furthermore, there is a lack of a way for users to remotely set their desired room temperature and have it reflected in a timely manner, making it difficult to fully meet the needs of users in remote locations.

[0114] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0115] In this invention, the server includes a means for transmitting health and safety information to a central server, a means for the central server to analyze the received information and notify registered contacts, and a means for storing the input information in a database and sending notifications based on the analysis results. This allows users to quickly send and receive information about their health and safety, even if they are in a remote location, and to provide necessary notifications in real time.

[0116] In addition, the server includes a means for transmitting room temperature information to the central server, a means for inputting and transmitting a desired room temperature, and a means for transmitting instructions to the temperature control device, so that the user can check the room temperature in their home even from a remote location and adjust the temperature appropriately. In this way, the present invention provides a system that allows the user to appropriately manage the health and safety of their family members even when they are in a remote location, and maintain a comfortable home environment.

[0117] "Physical condition and safety information" is information indicating the user's own health condition and safety status.

[0118] "Smart device" refers to a digital device that is internet-enabled and allows users to input and transmit information.

[0119] "Central Server" means a computer system that receives, stores, analyzes entered information, and sends notifications as needed.

[0120] "Notification destination" refers to a contact point registered to receive important information such as the user's health and safety.

[0121] "Room temperature information" is data relating to the temperature inside the home, and is information that the user can check.

[0122] "Thermostat" refers to a device for regulating the temperature in a home based on a set temperature.

[0123] A "database" is a system for organizing and storing received information.

[0124] "Analysis" refers to the process of processing received information according to specific criteria or algorithms to derive a result.

[0125] "Real-time transmission" refers to information being transmitted nearly simultaneously, meaning that delays are minimized.

[0126] An "instruction" refers to a command to perform a specific action or operation.

[0127] Entering and notifying health and safety information

[0128] This system allows users in remote locations to use their smart devices to input information about their health and safety, which is then sent to a central server. Smart devices are smartphones or tablets, and a dedicated application is installed on them. Users launch the application and input their health and safety information. For example, they might say, "I have a headache today." Once they have finished entering information, they press the send button.

[0129] The terminal (smart device) sends this information to the central server using an HTTPS request. The central server stores the received information in a database (e.g., MySQL®). The stored information includes the user ID, timestamp, and input content.

[0130] The server analyzes the received information based on a pre-defined algorithm and sends notifications to the appropriate contacts based on the results. These notifications can be sent via email, push notification, or SMS. For example, SMS can be sent using the Python SMPP library. The notified contacts can receive the notification on their smart devices and view its contents.

[0131] For example, an 80-year-old female user can type, "I have a headache today," and her son can receive a notification and check on his mother's condition.

[0132] Acquisition of room temperature information and remote operation

[0133] This system can also remotely obtain information about the room temperature in the home and operate the thermostat. An IoT temperature sensor (e.g., DHT22 sensor) is installed in the home and periodically measures the current room temperature. The measured data is sent to a central server by a home device (e.g., Raspberry Pi) using an HTTPS request.

[0134] The server then sends the received temperature data to the user's smart device in real time, for example by sending a push notification using Firebase Cloud Messaging. The user can then check the current room temperature using a dedicated application.

[0135] When a user wants to set a desired room temperature, they input and send the desired room temperature (for example, 24°C) using a dedicated application. The device then sends this desired temperature data to a central server. The server receives the desired temperature data and sends instructions to adjust the temperature to the device at home. The device at home then operates the thermostat or air conditioner based on these instructions, adjusting the room temperature to the specified level. For example, an infrared remote control signal for an air conditioner could be sent from a Raspberry Pi.

[0136] As a specific example, a man in his 50s on a business trip can check the current room temperature (for example, 28°C) and input and set the desired room temperature (24°C), thereby adjusting the temperature of his living room at home to a comfortable level.

[0137] Examples of prompt statements

[0138] "You have devised a system that allows an 80-year-old mother to use a smart device to input information about her poor health and notify her family of that information. Please generate a description of this system using the user, device, and server as subjects. As a concrete example, please include a scene where the mother inputs, 'I have a headache today,' and her son receives a notification."

[0139] In this way, this system allows users in remote locations to quickly send and receive information about their family's health and safety, provide necessary notifications in real time, and easily adjust the temperature environment in their home. This system is also very useful for households with elderly family members or those who need health care.

[0140] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0141] Entering and notifying health and safety information

[0142] Step 1:

[0143] The user launches a dedicated application on their smart device and inputs information about their health and safety. Specifically, they enter information such as "I have a headache today" into a text box and press the send button.

[0144] Input: Health and safety information entered by the user

[0145] Output: Information temporarily stored in the smart device application

[0146] Step 2:

[0147] The terminal (smart device) sends the input information to the central server using an HTTPS request, including the user ID, timestamp, and input content.

[0148] Input: User-entered health and safety information, user ID, timestamp

[0149] Output: Information sent to the central server

[0150] Step 3:

[0151] The server stores the received information in a database (e.g. MySQL). The stored information includes the user ID, timestamp, and input content. Before storing, the data is formatted and checked for errors.

[0152] Input: Information sent to a central server

[0153] Output: Information stored in the database

[0154] Step 4:

[0155] The server analyzes the information stored in the database, using pre-defined rules and algorithms.

[0156] Input: Information stored in a database

[0157] Output: Analysis results (list of people to be notified)

[0158] Step 5:

[0159] The server then sends notifications to registered contacts based on the analysis results. These notifications can be sent via email, push notification, or SMS. For example, SMS can be sent using the Python SMPP library.

[0160] Input: Analysis results (list of people to be notified)

[0161] Output: Notifications sent to notified contacts

[0162] Step 6:

[0163] The contact receives the notification on their smart device and checks the details. For example, a family member who receives the notification can check the details on their smartphone.

[0164] Input: Notification sent from the server

[0165] Output: Notification content displayed to the notified contact

[0166] Acquisition of room temperature information and remote operation

[0167] Step 1:

[0168] An IoT temperature sensor (e.g., DHT22 sensor) installed in your home periodically (e.g., every 15 minutes) measures the current room temperature.

[0169] Input: Current room temperature

[0170] Output: Measured temperature data

[0171] Step 2:

[0172] A home device (e.g., Raspberry Pi) sends temperature data obtained from an IoT temperature sensor to a central server using an HTTPS request.

[0173] Input: Measured temperature data

[0174] Output: Temperature data sent to a central server

[0175] Step 3:

[0176] The server stores the received temperature data in a database and sends it to the user's smart device in real time using Firebase Cloud Messaging.

[0177] Input: Temperature data sent to a central server

[0178] Output: Temperature data sent to the user's smart device

[0179] Step 4:

[0180] The user checks the current room temperature using a dedicated application on the smart device and inputs the desired room temperature (for example, 24°C).

[0181] Input: Current room temperature, desired room temperature

[0182] Output: Desired room temperature data temporarily saved in the smart device

[0183] Step 5:

[0184] When the user presses the send button, the smart device sends the desired room temperature data to the central server.

[0185] Input: Desired room temperature data

[0186] Output: Desired room temperature data sent to the central server

[0187] Step 6:

[0188] The server receives the desired room temperature data and sends it to the home device using the MQTT protocol.

[0189] Input: Desired room temperature data sent to the central server

[0190] Output: Temperature control instructions sent to the home device

[0191] Step 7:

[0192] Based on the instructions received by the home device, the thermostat or air conditioner is operated to adjust the room temperature to the specified level. For example, the Raspberry Pi sends an infrared remote control signal to the air conditioner.

[0193] Input: Temperature control instructions sent to your home device

[0194] Output: Room temperature regulated

[0195] (Application example 1)

[0196] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0197] Today's families are often geographically dispersed, making it difficult to regularly check on the health and safety of elderly or vulnerable family members. Furthermore, there are limited means to efficiently monitor and manage home security and environmental controls (such as room temperature control) from a remote location. This creates a need for a comprehensive system to maintain a safe and comfortable living environment for families.

[0198] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0199] In this invention, the server includes a means for a user in a remote location to input health and safety information using a smart device, a means for transmitting the input information to a central server, a means for the central server to analyze the received information and notify registered contacts, a means for acquiring home room temperature information and operating home temperature control devices according to instructions from the smart device, a means for linking with a security sensor to monitor the home security status, and a means for immediately sending a notification if an abnormality occurs. This makes it possible to comprehensively monitor and manage the health and safety of users, the home environment, and the security status even from a remote location.

[0200] "Remote users" refers to people who are geographically distant from the home or facility where the service is provided.

[0201] "Smart devices" refers to portable electronic devices that can connect to the Internet, such as smartphones, tablets, and smartwatches.

[0202] "Health and safety information" refers to information about the user's health condition and current situation, such as "I have a headache" or "I'm safe."

[0203] "Central Server" means a central control device or system for receiving, analyzing, storing User-entered information, and sending notifications as necessary.

[0204] "Security sensors" refer to various sensors used to monitor security within the home, such as door and window opening / closing sensors, motion detection sensors, smoke detectors, and carbon monoxide detectors.

[0205] "Temperature control equipment" refers to devices used to regulate indoor temperatures, such as air conditioners, thermostats, and heaters.

[0206] "Notification" refers to the means of information transmission that allows users to send information about their health and safety to a central server and, if necessary, communicate the analysis results to family members or registered contacts.

[0207] "Room temperature information" refers to data about the current temperature inside your home, which is important for keeping your home comfortable and safe.

[0208] "Monitoring" refers to constantly watching over a specific environment or situation using security sensors, etc.

[0209] An "anomaly" is an event or situation that is outside the normal or expected range, and when this occurs, a notification is sent to users and relevant parties.

[0210] This invention is a system in which users in remote locations use smart devices to input information about their health and safety, which is then sent to a central server. The central server receives and analyzes the input information, and sends notifications to registered contacts. The system also has the ability to obtain home room temperature information on the smart device and remotely control the home's temperature control equipment. Furthermore, this system also has the ability to monitor the home's security status and send immediate notifications if an abnormality occurs.

[0211] 1. System Configuration

[0212] Hardware Configuration

[0213] Smart devices: smartphones, tablets, smartwatches

[0214] Central server: High-performance cloud server (e.g., AWS (registered trademark), Google (registered trademark) Cloud)

[0215] Security sensors and devices: door and window opening and closing sensors, motion detection sensors, smoke detectors, carbon monoxide detectors

[0216] Temperature control devices: air conditioners, thermostats

[0217] Software Configuration

[0218] Server application: Developed in Python with Django or Flask framework

[0219] Database: PostgreSQL

[0220] Real-time database and notification system: Firebase, MQTT protocol

[0221] Smart Device Applications: Swift for iOS, Kotlin for ANDROID

[0222] 2. System Functions

[0223] Entering and notifying health and safety information

[0224] Users enter their health and safety information into a dedicated app on their smart device. The information is immediately sent to the Firebase real-time database and retrieved by a central server. The server analyzes the information and sends notifications to family members and registered contacts as needed. These notifications are sent in real time using Firebase Cloud Messaging (FCM).

[0225] Acquisition of room temperature information and remote operation

[0226] IoT temperature sensors installed in homes periodically measure the room temperature and transmit the data to a central server via the MQTT protocol. When users input their desired room temperature via their smart devices, that information is also sent to the central server. Based on this information, the central server issues instructions to the home's thermostat to adjust the temperature to the desired level.

[0227] Security status monitoring

[0228] Multiple security sensors and devices monitor the home for abnormalities, and if an abnormality is detected, it is immediately notified to a central server. The server collects the abnormality information and sends notifications to family members and registered contacts based on the analysis results. This allows users to understand the security status of their home in real time.

[0229] 3. Usage example

[0230] Usage example 1: Health check and notification

[0231] An 80-year-old woman types "I have a headache today" into an application on her smart device and presses the send button. The smart device sends this information to a central server, which analyzes the information and sends a notification to the woman's son. The son receives the notification on his smartphone and can immediately check on his mother's condition.

[0232] Example prompt sentence:

[0233] In an application where an 80-year-old woman enters information such as "I'm not feeling well" and sends a notification, please create a program that implements a system that links with the Firebase database and sends notifications to registered family members in real time.

[0234] Usage example 2: Room temperature adjustment

[0235] While on a business trip, a man in his 50s uses a smart device to check the current room temperature in his living room (e.g., 28°C) and inputs the setting to 24°C. The server receives this data and sends instructions to the thermostat in his home, adjusting the temperature in the living room to 24°C.

[0236] Example prompt sentence:

[0237] To design an IoT device integration application that remotely obtains temperature sensor data and allows the user to set the room temperature as desired, create a program to send and receive data using the MQTT protocol.

[0238] Use Case 3: Security Monitoring

[0239] While the user is away from home, the door sensor detects any unauthorized opening or closing and immediately sends a notification to a central server. The server analyzes this information and notifies family members or security companies of any abnormalities. Users can then check the real-time security status on their smart devices.

[0240] The above is a detailed description of a specific embodiment of the invention. This system allows users to comprehensively monitor and manage the health and safety of their family members, the home environment, and security from a remote location.

[0241] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0242] Step 1:

[0243] The user enters information about their health and safety using a smart device. The user opens the application, enters their health and safety information, and presses the send button. The input is saved in text format in the application.

[0244] Input: User's health and safety information

[0245] Output: Text data containing health and safety information

[0246] Action: Enter text on the smart device screen and press the send button.

[0247] Step 2:

[0248] The device sends the entered health and safety information to a central server, and the data entered in the application is sent to the Firebase real-time database.

[0249] Input: Text data of health and safety information

[0250] Output: Health and safety information stored in the database

[0251] How it works: Smart devices send data over the internet to Firebase.

[0252] Step 3:

[0253] The server retrieves health and safety information from the database and performs analysis. The server pulls data from the Firebase real-time database and performs analysis using a Python script.

[0254] Input: Health and safety information stored in the database

[0255] Output: Analysis result (e.g., "There is a serious health risk")

[0256] How it works: The server retrieves data via the API and performs analysis.

[0257] Step 4:

[0258] The server then sends notifications to registered contacts as needed based on the analysis results, and sends push notifications to family and friends via Firebase Cloud Messaging (FCM).

[0259] Input: Analysis results

[0260] Output: Notification message

[0261] Operation: The server calls the notification sending API and sends a push notification.

[0262] Step 5:

[0263] An IoT temperature sensor in your home measures the current room temperature and periodically sends the data to a central server. The temperature sensor sends the data using the MQTT protocol.

[0264] Input: Measured room temperature data

[0265] Output: Room temperature data sent to a central server

[0266] How it works: The temperature sensor sends data to the server using the MQTT protocol.

[0267] Step 6:

[0268] The server receives the room temperature data in real time and sends it to the user's smart device. The user opens the application and checks the current room temperature.

[0269] Input: Room temperature data

[0270] Output: Room temperature information displayed on a smart device

[0271] How it works: The server retrieves data and sends it to the smart device via API.

[0272] Step 7:

[0273] The user enters the desired room temperature into the application and sends it to the central server. The user enters the desired temperature on the application's "Set Temperature" screen and presses the send button.

[0274] Input: User's desired room temperature

[0275] Output: Desired room temperature data sent to the central server

[0276] Operation: A user enters a value on the application screen and presses a button to send the value to the server.

[0277] Step 8:

[0278] The server issues instructions to the home thermostat based on the desired room temperature data. The server assembles instructions for the desired thermostat and sends them using the MQTT protocol.

[0279] Input: Desired room temperature data

[0280] Output: Adjustment command sent to temperature control device

[0281] How it works: The server generates adjustment commands and sends them using the MQTT protocol.

[0282] Step 9:

[0283] The temperature control device adjusts the room temperature according to instructions from the server. Based on the received command, the temperature control device adjusts the room temperature to the desired value.

[0284] Input: Adjust command

[0285] Output: Room temperature regulated

[0286] How it works: The temperature control device adjusts the temperature as instructed.

[0287] Step 10:

[0288] If a security sensor detects an anomaly, it sends a notification to a central server. The sensor triggers an anomaly detection and sends the data to the server via MQTT protocol.

[0289] Input: Anomaly data detected by security sensors

[0290] Output: Anomaly notification sent to the central server

[0291] What it does: A security sensor detects an anomaly and transmits data.

[0292] Step 11:

[0293] The server receives the anomaly data and sends notifications to registered contacts based on the analysis results. The server sends push notifications in real time using Firebase Cloud Messaging.

[0294] Input: Abnormal data

[0295] Output: Error notification message

[0296] How it works: The server analyzes the anomaly data and sends a notification.

[0297] In this way, the system of the present invention receives a variety of input data and automatically processes and notifies based on that data, thereby realizing a system that is extremely convenient for users.

[0298] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0299] This invention is a system that incorporates a function that allows users in remote locations to input information about their health and safety using a smart device, and then analyzes the user's emotions using an emotion engine. This system transmits the input information and emotion information to a central server, which then sends notifications to registered contacts based on the information received and analyzed by the central server. It can also obtain information about the room temperature in the home on the smart device and remotely control the home's temperature control equipment.

[0300] System Embodiments

[0301] 1. Input of health and safety information and emotion analysis:

[0302] The user inputs information about their health and safety into the terminal: The user uses a smart device (e.g., a smartphone or tablet) to open a dedicated application and input information about their health and safety (e.g., "I have a headache today"). The user's facial expressions and voice are also captured through the smart device's camera and microphone.

[0303] Emotion engine analyzes user emotions: The emotion engine built into the smart device analyzes captured facial and voice data to identify the user's emotions (e.g., fatigue, sadness, joy).

[0304] 2. Information and emotional data transmission and notification:

[0305] The device sends information and emotional data to the server: When the user completes the input and presses the send button, the smart device sends information about their physical condition and safety, as well as the emotional data identified by the emotion engine, to the central server.

[0306] The server receives the information and emotion data, analyzes it, and sends notifications: The server stores the received data in a database and analyzes it. As a result, it adjusts and sends notifications to family members and registered contacts as needed. Notifications are sent via email, push notification, or SMS.

[0307] 3. Room temperature information acquisition and remote operation:

[0308] A home device measures the room temperature and sends it to a server: An IoT temperature sensor installed in the home periodically measures the current room temperature and sends the data to a central server via the home device.

[0309] The server receives the temperature data and sends it to the user's device: The server receives the temperature data and sends it to the user's smart device in real time, allowing the user to check the current room temperature using a dedicated application.

[0310] The user inputs the desired room temperature and sends it from the terminal to the server: The user inputs the desired room temperature (e.g., 24°C) using the application and sends it. This data is sent to the server.

[0311] The server sends instructions to the home device to adjust the temperature: Based on the desired room temperature data received, the server sends temperature control instructions to the home device. The home device follows these instructions and operates the temperature control device (e.g., thermostat or air conditioner) to adjust the temperature to the specified level.

[0312] Specific examples

[0313] Example 1: Specific example of health check and emotion analysis

[0314] The user enters their physical condition into the device: An 80-year-old woman enters "I have a headache today" into a smart device application and presses the send button. Facial expressions and voice are also captured via the camera and microphone.

[0315] Emotion engine analyzes emotions: The emotion engine built into the smart device analyzes the user's facial expressions and voice to detect "fatigue."

[0316] Terminal transmits information and emotional data: The smart device transmits physical condition information and emotional data indicating "fatigue" to a central server.

[0317] The server receives the information and sends a notification: The server receives the information and stores it in a database. It analyzes it and sends a message to the appropriate contact (for example, the woman's son) saying, "Notification from Mom: I have a headache today (emotion: fatigue)." The son receives this notification on his smartphone and can immediately check his mother's condition and consider what action is necessary.

[0318] Example 2: Room temperature control

[0319] A home device measures the temperature and sends it to the server: The IoT temperature sensor in your home measures the current room temperature and sends it to the central server.

[0320] The user inputs the desired room temperature and sends it from the device: A man in his 50s uses a smart device while on a business trip to check the current room temperature in the living room (for example, 28°C) and inputs that it should be set to 24°C.

[0321] The server receives the information and sends instructions to the home device: The server receives this data and sends instructions to the home device to set the temperature to 24°C.

[0322] Home devices adjust the temperature: Your home device controls the thermostat and air conditioner, adjusting the temperature in your living room to 24°C.

[0323] This system allows users to monitor the health and safety of their family members, even when they are in a remote location, and maintain a comfortable home environment. This invention is extremely useful for elderly people and those with family members who need health care.

[0324] The processing flow will be explained below.

[0325] Input of health and safety information, emotion analysis, and notifications

[0326] Processing Steps:

[0327] Step 1:

[0328] A user enters information about their health and safety into a smart device. For example, they open an application, type "I have a headache today," and press the send button. The smart device's camera and microphone capture the user's facial expressions and voice.

[0329] Step 2:

[0330] The device's on-board emotion engine analyzes the captured facial expression and voice data, for example, by using facial recognition technology and voice feature extraction to identify the user's emotions (e.g., fatigue, sadness, joy).

[0331] Step 3:

[0332] The device sends the entered health and safety information and analyzed emotion data to the central server via a POST request. For example, the request data is structured as follows: { "user_id": 123, "status": "I have a headache today", "emotion": "Fatigue"}.

[0333] Step 4:

[0334] The server receives the POST request and stores this information in a database, for example in the "users_status" and "users_emotions" tables.

[0335] Step 5:

[0336] The server analyzes the health and safety information and emotional data to determine whether a notification is necessary. Specifically, based on the content of "status" and "emotion," it determines that a notification is necessary if the importance is high.

[0337] Step 6:

[0338] The server creates the notification content and sends it to the registered contacts (for example, family members' email addresses or push notification device IDs). For example, an SMTP server is used for email, and FCM is used for push notifications. The notification content includes specific information such as "Notification from Mom: I have a headache today (emotion: fatigue)."

[0339] Step 7:

[0340] The notification arrives on the family member's device. The notification service on the device runs and displays the message "Notification from Mom: I have a headache today (emotion: fatigue)" to the family user.

[0341] Acquisition of room temperature information and remote operation

[0342] Processing Steps:

[0343] Step 1:

[0344] The device at home measures the current room temperature from a temperature sensor, which acquires temperature data every minute, for example.

[0345] Step 2:

[0346] The temperature data acquired by the home device is sent to the central server via a POST request. The request data is sent in the format of { "room_id": 1, "temperature": 28.5, "timestamp": "2023-10-01T12:00:00Z"}, for example.

[0347] Step 3:

[0348] The server receives the POST request and saves the temperature information in the database, in the "room_temperatures" table.

[0349] Step 4:

[0350] The user's device sends a GET request to the server for the current temperature information. The request is sent in the format " / api / temperature / latest?room_id=1", for example.

[0351] Step 5:

[0352] The server receives a GET request, retrieves the latest temperature data from the database, and returns the data in the response format: { "room_id": 1, "temperature": 28.5, "timestamp": "2023-10-01T12:00:00Z"}.

[0353] Step 6:

[0354] The user's device receives the response from the server and displays the current room temperature in the application. For example, "The current temperature in the living room is 28.5°C" is displayed in a visible area for the user.

[0355] Remote room temperature control

[0356] Processing Steps:

[0357] Step 1:

[0358] The user enters the desired room temperature (for example, 24°C) into the smart device application and presses the send button.

[0359] Step 2:

[0360] The device sends the desired room temperature data to the central server via a POST request. For example, the request data is sent in the format "{ "room_id": 1, "desired_temperature": 24}".

[0361] Step 3:

[0362] The server receives the POST request and saves the desired temperature information to the database in the "desired_temperatures" table.

[0363] Step 4:

[0364] The server sends temperature control instructions to the home device using MQTT or HTTP protocol. For example, the message format is "{ "command": "set_temperature", "value": 24}".

[0365] Step 5:

[0366] The home device receives the instruction and executes a command to the temperature control device (e.g., thermostat or air conditioner) to set the desired temperature (24°C).

[0367] Step 6:

[0368] The home thermostat will follow instructions and adjust the room temperature to 24°C. The temperature will be changed and maintained until the specified temperature is reached.

[0369] Example 2

[0370] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0371] Conventional systems lack the means for remote users to easily adjust the temperature in their homes or efficiently notify family members of their health and safety. Furthermore, they lack the ability to analyze a user's emotional state and notify appropriate contacts, which can delay response in emergencies or when special care is needed. This is particularly a serious problem for elderly people and those with fluctuating health conditions.

[0372] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0373] In this invention, the server includes a means for a user in a remote location to input information about their physical condition and safety using an information terminal, a means for an emotion analysis engine built into the information terminal to analyze the user's emotions, and a means for transmitting the input information and analyzed emotion data to the central server. This allows the physical and emotional states of family members to be monitored in real time and prompt responses to be taken as needed. Furthermore, by including a means for acquiring the home's room temperature information displayed on the information terminal and operating the home's temperature control device according to the user's instructions, comfortable room temperature control can be achieved even from a remote location.

[0374] "Remote location" refers to a state in which a user is located geographically away from home.

[0375] "Information terminal" refers to a smartphone, tablet, or other portable electronic device.

[0376] "Input means" refers to the method by which a user inputs information about his or her own health condition and safety through an information terminal.

[0377] An "emotion analysis engine" refers to software or hardware that analyzes a user's facial expressions and voice data to identify their emotional state.

[0378] "Central server" refers to a server system that has the function of storing and analyzing received data and sending notifications as necessary.

[0379] "Notification means" refers to the method by which the central server sends information to registered contacts based on the analysis results.

[0380] "Registered Contacts" means any person or entity designated by a User and authorized to receive emergency or special notices.

[0381] "Room temperature information" refers to temperature data measured by a detection sensor inside your home.

[0382] "Detection sensor" refers to a device installed in a home to measure room temperature.

[0383] "Temperature control devices" refers to devices such as air conditioners and thermostats used to regulate the temperature inside a home.

[0384] "Database" refers to a system for systematically storing and managing received information within a central server.

[0385] MODE FOR CARRYING OUT THE INVENTION

[0386] The present invention is a system in which a user in a remote location uses an information terminal to input information about their own physical condition and safety, and then analyzes the user's emotions using an emotion analysis engine. This system has the function of transmitting the information input by the user and analyzed emotion data to a central server, which then analyzes the received data and sends a notification to registered contacts. It is also possible to obtain information about the room temperature at home and operate the home's temperature control device from a remote location.

[0387] 1. Input of health and safety information and emotion analysis

[0388] A user opens a dedicated application on their smartphone or tablet and enters information about their physical condition and safety. For example, the user might enter "I have a headache today" and press the send button. At this time, the smart device's camera and microphone are used to capture the user's facial expressions and voice. The built-in emotion analysis engine analyzes the captured facial and voice data and identifies the user's emotions (e.g., fatigue, sadness, joy).

[0389] 2. Transmission and notification of information and emotional data

[0390] The device sends the user's input information along with the analyzed emotion data to a central server, which stores this data in a database and analyzes it using a data analysis module. Based on the results, it determines the necessary action to take and sends notifications to family members and registered contacts via email, push notification, or SMS.

[0391] 3. Acquisition of room temperature information and remote operation

[0392] An IoT temperature sensor installed in the home measures the current room temperature and sends that data to the home's gateway device. The gateway device sends this information to a central server, which then sends the received data to the user's information terminal. The user uses a dedicated application to check the current room temperature in real time and input their desired room temperature. The input desired room temperature data is sent to the server, which then uses this data to send instructions to the home's thermostat, adjusting the temperature to the specified level.

[0393] Specific examples

[0394] Example 1: Specific example of health check and emotion analysis

[0395] The user inputs their physical condition: An 80-year-old woman inputs "I have a headache today" into a smart device application and sends it. Her facial expressions and voice are also captured via the camera and microphone.

[0396] Emotion engine analyzes emotions: The emotion engine built into the smart device analyzes the user's facial expressions and voice to detect "fatigue."

[0397] Terminal transmits information and emotional data: The smart device transmits physical condition information and emotional data indicating "fatigue" to a central server.

[0398] Server receives information and sends notification: The server receives the information and stores it in a database. It analyzes it and automatically generates and sends an email to the necessary contact (for example, the son) saying, "Notification from Mom: I have a headache today (emotion: fatigue)." The son receives this notification on his smartphone, can check his mother's situation, and consider how to respond.

[0399] Example 2: Room temperature control

[0400] A home device measures the temperature and sends it to the server: The IoT temperature sensor measures the current room temperature and sends it to the central server.

[0401] The user inputs the desired room temperature and sends it from the device to the server: A man in his 50s uses a smart device while on a business trip to check the current room temperature in the living room (for example, 28°C), inputs the temperature to be set to 24°C, and sends it.

[0402] The server receives the information and sends instructions to the home device: The server receives this data and sends instructions to the home device to set the temperature to 24°C.

[0403] Home devices adjust the temperature: Your home device controls the thermostat and air conditioner, adjusting the temperature in your living room to 24°C.

[0404] Prompt Sentence Examples

[0405] "An 80-year-old woman enters her physical condition information into an application on her smart device, and the emotion data is analyzed by an emotion engine and sent to a server."

[0406] "Remotely control your home's temperature control device using room temperature data measured by an IoT temperature sensor."

[0407] This system allows users to monitor their family's health, safety, and emotions from a distance, and maintain a comfortable temperature in their home.

[0408] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0409] Step 1:

[0410] The user inputs information about their health and safety.

[0411] (Input) Use a smartphone or tablet to enter information about your physical condition and safety (e.g., "I have a headache today") into a dedicated application.

[0412] (Specific behavior) A user enters information into a text field within the application and presses the send button, while simultaneously capturing facial expressions and voice using the smart device's camera and microphone.

[0413] Step 2:

[0414] The sentiment analysis engine analyzes the user's sentiment.

[0415] (Input) Facial expression and voice data captured through the smart device's camera and microphone.

[0416] (Specific operation) The emotion analysis engine analyzes captured facial features, voice tone, and content, and uses machine learning models to identify emotions (e.g., fatigue, sadness, joy).

[0417] (Output) Identified emotion data.

[0418] Step 3:

[0419] The device transmits information and emotion data to the server.

[0420] (Input) User-entered health and safety information, and analyzed emotional data.

[0421] (Specific operation) The smart device packs this data into packets, encrypts them using the HTTPS protocol, and sends them to a central server.

[0422] (Output) Securely transmitted health and safety information and emotional data.

[0423] Step 4:

[0424] The server receives the information and emotion data, analyzes it, and sends a notification.

[0425] (Input) Health and safety information and emotional data sent from the device.

[0426] (Specific operation) The central server stores the received data in a database, and the data analysis module compares it with past data to check for abnormalities. Based on the analysis results, appropriate notifications are automatically generated to registered contacts as needed.

[0427] (Output) An email, push notification, or SMS containing the notification content.

[0428] Step 5:

[0429] The device at home measures the room temperature and sends the value to the server.

[0430] (Input) Room temperature data from an IoT temperature sensor installed in the home.

[0431] (Specific operation) The temperature sensor measures the current room temperature every 5 minutes and sends the data to the home gateway device via Bluetooth, which then sends the data to the central server via Wi-Fi.

[0432] (Output) Room temperature data sent to the central server.

[0433] Step 6:

[0434] The server receives the temperature data and transmits it to the user's terminal.

[0435] (Input) Room temperature data sent from the home gateway device.

[0436] (Specific operation) The central server stores the received temperature data in a database and, upon request from the user, sends the latest room temperature data to a dedicated application via push notification.

[0437] (Output) Real-time room temperature data displayed on the user's smart device.

[0438] Step 7:

[0439] The user inputs the desired room temperature and sends it from the terminal to the server.

[0440] (Input) Enter the desired room temperature (e.g., 24°C) into the dedicated application on your smart device.

[0441] (Specific operation) The user opens the application, checks the current room temperature, enters the desired temperature, and presses the send button.

[0442] (Output) Desired temperature data sent to the central server.

[0443] Step 8:

[0444] The server sends instructions to a device at home to adjust the temperature.

[0445] (Input) Desired temperature data sent by the user.

[0446] (Specific operation) The server analyzes the desired room temperature data and sends instructions to the home's temperature control devices (e.g., air conditioner, thermostat).

[0447] (Output) The thermostat in your home will receive the instruction and adjust to the specified temperature.

[0448] In this way, through the specific processing steps, users can remotely manage their health and safety information and adjust the temperature in their homes.

[0449] (Application example 2)

[0450] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0451] The present invention relates to a system that allows a remote user to input information about their health and safety using a smart device, and then analyzes their emotions using an emotion engine. Conventional systems only allow users to input information about their health and safety, without analyzing the underlying emotions. This makes it difficult to respond quickly when an emergency truly requires it. While the system can also provide information about room temperature control, this is limited. The present invention aims to enable a more prompt and appropriate response by comprehensively analyzing a series of information and notifying family members and related parties.

[0452] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a remote user to input health and safety information using a smart device, a means for transmitting the input information to a central server, and a means for the central server to analyze the received information and notify registered contacts. This enables the user's health and emotions to be grasped in real time, even when the user is in a remote location, and appropriate responses can be taken. Furthermore, the means for analyzing the user's facial expressions and voice using an emotion engine to identify emotions, a means for acquiring home room temperature information displayed on the smart device, a means for operating home temperature control devices in accordance with instructions from the smart device, and a means for the central server to adjust notification content based on the analyzed emotion information enable the central server to adjust notification content according to the user's emotional state. As a result, family members and other related parties can know the user's true condition and quickly take appropriate measures based on that information.

[0453] "User" refers to a person who uses a smart device to input information about their health and safety and is the subject of emotion analysis.

[0454] A "smart device" is an electronic device that allows users to input information about their health and safety and performs emotion analysis using an emotion engine, and includes smartphones and tablets.

[0455] "Emotion engine" refers to software or hardware for analyzing a user's facial expressions and voice and identifying the user's emotions.

[0456] An "expression" is a facial expression of a user, which is captured using the camera of the smart device.

[0457] "Audio" refers to the vocal signal emitted by the user and captured using the microphone of the smart device.

[0458] The "central server" is a computer system that receives and analyzes health and safety information and emotional data sent from smart devices, adjusts the content of notifications, and sends them to contacts.

[0459] "Registered contacts" refers to people who have contact information for family members and related parties who are pre-set to be notified of the user's health condition and safety information.

[0460] "Notifications" are communications sent to registered contacts based on information analyzed by the central server.

[0461] "Room temperature information" refers to the current room temperature data measured by a temperature sensor installed in your home and displayed on your smart device.

[0462] "Temperature control devices" are devices used to adjust the temperature inside a home, including thermostats and air conditioners.

[0463] The system for implementing this invention allows a user in a remote location to input information about their physical condition and safety using a smart device, and then analyzes the user's emotions using an emotion engine to send appropriate notifications to family members and related parties. The user can also remotely control their home temperature control device.

[0464] System Configuration

[0465] The system consists of the following main components:

[0466] 1. Smart Devices

[0467] Hardware: Smartphones, tablets

[0468] Software: Data entry application, sentiment analysis engine

[0469] 2. Central Server

[0470] Hardware: Cloud servers or data centers

[0471] Software: Data analysis module, notification function

[0472] 3. Home sensors and devices

[0473] Temperature sensors, thermostats, air conditioners

[0474] Specific Embodiments

[0475] 1. Input of health and safety information and emotion analysis

[0476] The user enters health and safety information into the device:

[0477] Users use their smart device to open a dedicated application and enter information about their health and safety.

[0478] Example: An 80-year-old woman types "I have a headache today" into the application and presses the send button. Her facial expressions and voice are also captured via the camera and microphone.

[0479] Emotion engine analyzes emotions:

[0480] An emotion engine built into the smart device analyzes captured facial and voice data to identify the user's emotions.

[0481] Example: An emotion engine analyzes facial expressions and voice to detect "fatigue."

[0482] 2. Transmission and notification of information and emotional data

[0483] The device sends information and emotion data to the server:

[0484] When the user completes the input and presses the send button, the smart device sends information about their physical condition, safety, and emotional data to a central server.

[0485] The server receives the information and emotion data, analyzes it, and sends a notification:

[0486] The server stores the received data in a database, analyzes it, and then adjusts and sends notifications to family members and other relevant parties as needed. Notifications can be sent via email, push notification, or SMS.

[0487] Example: The server receives the information and sends the message to the woman's son, "Notification from Mom: I have a headache today (emotion: fatigue)." The son receives this notification on his smartphone, can immediately check his mother's situation, and consider what action is necessary.

[0488] 3. Acquisition of room temperature information and remote operation

[0489] The device at home measures the room temperature and sends it to the server:

[0490] IoT temperature sensors installed in the home measure the current room temperature and send it to a central server.

[0491] Example: A temperature sensor measures 28°C and sends it to the server.

[0492] The server receives the temperature data and sends it to the user's device:

[0493] The server receives the temperature data and sends it to the user's smart device in real time, allowing the user to check the current room temperature using a dedicated application.

[0494] The user inputs the desired room temperature and sends it from the terminal to the server:

[0495] The user inputs the desired room temperature (e.g., 24°C) using the application and submits it. This data is sent to the server.

[0496] Example: A man in his 50s uses a smart device while on a business trip to check the current room temperature in the living room (for example, 28°C) and inputs the setting to 24°C.

[0497] The server sends instructions to the home device to adjust the temperature:

[0498] The server then sends temperature control instructions to the home device based on the desired room temperature data it receives. The home device then operates the temperature control devices (thermostat and air conditioner) according to these instructions and adjusts the temperature to the specified level.

[0499] Prompt Sentence Examples

[0500] The mother would enter her physical condition into a smartphone app, which would then analyze her emotions using a camera and microphone, and the analysis results would be sent to a server. The server would then develop an application that would send notifications to registered contacts based on the analysis results.

[0501] As described above, by incorporating an emotion analysis engine, the present invention accurately grasps the specific state of the user and provides important information for appropriate response. Furthermore, environmental information such as room temperature can be managed remotely, improving the quality of life of the user.

[0502] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0503] Step 1:

[0504] The user launches a dedicated application on their smart device and inputs information about their health and safety. The input data includes text information such as "I have a headache today." The input health and safety information is temporarily saved within the application.

[0505] input:

[0506] User's health and safety information (text format)

[0507] output:

[0508] Temporarily saved health and safety information

[0509] Specific operation:

[0510] The user opens the application on their smart device, types "I have a headache today," and presses the send button.

[0511] Step 2:

[0512] The smart device uses a camera and microphone to capture the user's facial expressions and voice, which then become input data for analysis by the emotion engine.

[0513] input:

[0514] Camera capture (facial image), microphone capture (audio data)

[0515] output:

[0516] Captured facial and voice data

[0517] Specific operation:

[0518] The smart device activates the camera, takes a picture of the user's face, and records audio with the microphone.

[0519] Step 3:

[0520] An emotion engine built into the smart device analyzes the captured facial and voice data to identify the user's emotions, including feelings such as "fatigue" and "sadness."

[0521] input:

[0522] Facial expression image data, voice data

[0523] output:

[0524] Identified emotion data (e.g., "fatigue")

[0525] Specific operation:

[0526] The emotion engine inputs facial expression images and performs image analysis to identify the emotion "fatigue." It then analyzes the voice data and similarly identifies the emotion "fatigue."

[0527] Step 4:

[0528] The smart device sends the entered health and safety information and analyzed emotion data to a central server, which requires an internet connection.

[0529] input:

[0530] Temporarily stored health and safety information, analyzed emotional data

[0531] output:

[0532] Data sent from smart devices to a central server

[0533] Specific operation:

[0534] When the data transmission button is pressed from the smart device to the server, health and safety information and emotional data are sent to the central server.

[0535] Step 5:

[0536] The central server analyzes the received health and safety information and emotional data, adjusts the notification content as necessary, and notifies registered contacts.

[0537] input:

[0538] Health and safety information and emotional data sent to a central server

[0539] output:

[0540] Notification content (e.g., "Notification from Mom: I have a headache today (emotion: fatigue)")

[0541] Specific operation:

[0542] The server generates notification content based on the received data and sends it to registered contacts via email, SMS, or other means.

[0543] Step 6:

[0544] Temperature sensors in your home measure the current room temperature and send that data to a central server, which updates the measurements periodically.

[0545] input:

[0546] Room temperature sensor data

[0547] output:

[0548] Room temperature data sent to a central server

[0549] Specific operation:

[0550] The temperature sensor measures the current room temperature and transmits the data to a server over the internet.

[0551] Step 7:

[0552] The central server receives room temperature data and sends it to a smart device, allowing users to check the room temperature remotely using a dedicated application.

[0553] input:

[0554] Room temperature data sent to a central server

[0555] output:

[0556] Room temperature information displayed on a smart device

[0557] Specific operation:

[0558] The app on the smart device receives room temperature data from the server and displays the current room temperature.

[0559] Step 8:

[0560] The user inputs the desired room temperature into the smart device application and the data is sent to the central server. The desired room temperature information becomes the input data.

[0561] input:

[0562] Desired room temperature entered by the user (e.g. 24°C)

[0563] output:

[0564] Desired room temperature data is sent to a central server

[0565] Specific operation:

[0566] The user sets the desired room temperature in the application and presses the send button.

[0567] Step 9:

[0568] Based on the desired room temperature data received by the central server, it sends temperature adjustment instructions to a device at home, and operates the thermostat or air conditioner to adjust to the specified temperature.

[0569] input:

[0570] Desired room temperature data

[0571] output:

[0572] Instructions sent to temperature control equipment

[0573] Specific operation:

[0574] Based on the desired room temperature received by the server, it sends an instruction to set the home thermostat to 24°C, and the air conditioner operates to adjust the room temperature.

[0575] This series of steps will create a system that allows users to comprehensively manage their physical condition, emotions, home temperature, and other aspects of their lives, even from a remote location.

[0576] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0577] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0578] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0579] [Second embodiment]

[0580] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0581] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0582] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0583] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0584] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0585] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0586] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0587] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0588] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0589] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0590] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0591] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0592] The present invention provides a system that allows users in remote locations to input information about their health and safety using a smart device and send it to a central server. The central server receives and analyzes the input information and sends notifications to registered contacts. Furthermore, the smart device can obtain information about the home's room temperature and remotely control the home's temperature control equipment.

[0593] System Embodiments

[0594] 1. Entering and notifying health and safety information:

[0595] The user inputs information about their health and safety into the device: The user uses a smart device (e.g., a smartphone or tablet) and opens a dedicated application, where they input information about their health and safety (e.g., "I have a headache today").

[0596] The device sends the information to the server: When the user completes the input and presses the send button, the smart device sends this information to the central server.

[0597] The server receives and analyzes the information and sends notifications: The server stores the received information in a database, analyzes it, and then sends notifications to family members and registered contacts as needed. Notifications can be sent via email, push notification, or SMS.

[0598] 2. Room temperature information acquisition and remote operation:

[0599] The home device measures the room temperature and sends it to the server: The IoT temperature sensor installed in the home periodically measures the current room temperature, and the measured data is sent to the central server via the home device.

[0600] The server receives the temperature data and sends it to the user's device: The server receives the temperature data and sends it to the user's smart device in real time. The user can check the current room temperature using a dedicated application on their smart device.

[0601] The user inputs the desired room temperature and sends it from the device to the server: The user inputs the desired room temperature using the application and sends it. This data is sent to the server.

[0602] The server sends instructions to the home device to adjust the temperature: Based on the desired room temperature data received, the server sends temperature control instructions to the home device. The home device follows these instructions and operates the temperature control device (e.g., thermostat or air conditioner) to adjust the temperature to the specified level.

[0603] Specific examples

[0604] Example 1: Specific example of health check

[0605] A user enters their physical condition into a device: An 80-year-old woman enters "I have a headache today" into a smart device application and presses the send button.

[0606] Device sends information to server: Smart devices send this information to a central server.

[0607] The server receives the information and sends a notification: The server receives this information and stores it in a database. The server analyzes it and sends a notification to the necessary contacts (for example, the woman's son). The son receives this notification on his smartphone and can immediately check on his mother's status.

[0608] Example 2: Room temperature control

[0609] A home device measures the temperature and sends it to the server: The IoT temperature sensor in your home measures the current room temperature and sends it to the server.

[0610] The user inputs the desired room temperature and sends it from the device: A man in his 50s is on a business trip and uses his smart device to check the current room temperature in the living room (for example, 28°C) and inputs that it should be set to 24°C.

[0611] The server receives the information and sends instructions to the home device: The server receives this data and sends instructions to the home device to set the temperature to 24°C.

[0612] Home devices adjust the temperature: Your home device controls the thermostat and air conditioner, adjusting the temperature in your living room to 24°C.

[0613] This system allows users to remotely manage the health and safety of their family members and maintain a comfortable home environment, which is extremely useful for elderly people and those with family members who need health care.

[0614] The processing flow will be explained below.

[0615] Input and notification of health and safety information

[0616] Processing Steps:

[0617] Step 1:

[0618] A user enters information about their health and safety into a smart device. For example, they open an application, enter "I have a headache today," and press the send button.

[0619] Step 2:

[0620] The device sends the entered health and safety information to the central server via a POST request. The request data is in JSON format and is structured as follows: { "user_id": 123, "status": "I have a headache today"}.

[0621] Step 3:

[0622] The server receives the POST request and stores this information in a database, for example in a "users_status" table.

[0623] Step 4:

[0624] The server analyzes the information stored in the database and determines whether a notification is necessary. Specifically, it determines that a notification is necessary if the importance is high based on the content of "status."

[0625] Step 5:

[0626] The server creates the notification content and sends it to the registered contacts (such as family members' email addresses or push notification device IDs). For example, an SMTP server is used for email, and FCM is used for push notifications.

[0627] Step 6:

[0628] The notification arrives on the family member's device. The notification service on the device runs and displays the message "Notification from Mom: I have a headache today" to the user.

[0629] Acquisition of room temperature information and remote operation

[0630] Processing Steps:

[0631] Step 1:

[0632] The device at home measures the current room temperature from a temperature sensor, which acquires temperature data every minute, for example.

[0633] Step 2:

[0634] The temperature data acquired by the home device is sent to the central server via a POST request in the format "{ "room_id": 1, "temperature": 28.5, "timestamp": "2023-10-01T12:00:00Z"}".

[0635] Step 3:

[0636] The server receives the POST request and saves the temperature information in the database, in the "room_temperatures" table.

[0637] Step 4:

[0638] The user's device sends a GET request to the server for the current temperature information. The request is sent in the format " / api / temperature / latest?room_id=1", for example.

[0639] Step 5:

[0640] The server receives a GET request, retrieves the latest temperature data from the database, and returns the data in the response format: { "room_id": 1, "temperature": 28.5, "timestamp": "2023-10-01T12:00:00Z"}.

[0641] Step 6:

[0642] The user's device receives the response from the server and displays the current room temperature in the application. For example, "The current temperature in the living room is 28.5°C" is displayed in a visible area for the user.

[0643] Remote room temperature control

[0644] Processing Steps:

[0645] Step 1:

[0646] The user enters the desired room temperature (for example, 24°C) into the smart device application and presses the send button.

[0647] Step 2:

[0648] The device sends the desired room temperature data to the central server via a POST request in the format "{ "room_id": 1, "desired_temperature": 24}".

[0649] Step 3:

[0650] The server receives the POST request and saves the desired temperature information to the database in the "desired_temperatures" table.

[0651] Step 4:

[0652] The server sends temperature adjustment instructions to the home device using the MQTT or HTTP protocol. The instructions are sent in the format "{ "command": "set_temperature", "value": 24}".

[0653] Step 5:

[0654] The home device receives the instruction and executes a command to the temperature control device (e.g., thermostat or air conditioner) to set the desired temperature (24°C).

[0655] Step 6:

[0656] The home thermostat will follow instructions and adjust the room temperature to 24°C. The temperature will be changed and maintained until the specified temperature is reached.

[0657] Example 1

[0658] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0659] In today's world, people with elderly family members or those who require health management need to monitor their family members' health and safety, as well as their home environment, even from remote locations. However, current systems make it difficult to efficiently input information, provide notifications, and adjust temperatures, and there are particular challenges in real-time information transmission and environmental adjustment. Furthermore, there is a lack of a way for users to remotely set their desired room temperature and have it reflected in a timely manner, making it difficult to fully meet the needs of users in remote locations.

[0660] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0661] In this invention, the server includes a means for transmitting health and safety information to a central server, a means for the central server to analyze the received information and notify registered contacts, and a means for storing the input information in a database and sending notifications based on the analysis results. This allows users to quickly send and receive information about their health and safety, even if they are in a remote location, and to provide necessary notifications in real time.

[0662] In addition, the server includes a means for transmitting room temperature information to the central server, a means for inputting and transmitting a desired room temperature, and a means for transmitting instructions to the temperature control device, so that the user can check the room temperature in their home even from a remote location and adjust the temperature appropriately. In this way, the present invention provides a system that allows the user to appropriately manage the health and safety of their family members even when they are in a remote location, and maintain a comfortable home environment.

[0663] "Physical condition and safety information" is information indicating the user's own health condition and safety status.

[0664] "Smart device" refers to a digital device that is internet-enabled and allows users to input and transmit information.

[0665] "Central Server" means a computer system that receives, stores, analyzes entered information, and sends notifications as needed.

[0666] "Notification destination" refers to a contact point registered to receive important information such as the user's health and safety.

[0667] "Room temperature information" is data relating to the temperature inside the home, and is information that the user can check.

[0668] "Thermostat" refers to a device for regulating the temperature in a home based on a set temperature.

[0669] A "database" is a system for organizing and storing received information.

[0670] "Analysis" refers to the process of processing received information according to specific criteria or algorithms to derive a result.

[0671] "Real-time transmission" refers to information being transmitted nearly simultaneously, meaning that delays are minimized.

[0672] An "instruction" refers to a command to perform a specific action or operation.

[0673] Entering and notifying health and safety information

[0674] This system allows users in remote locations to use their smart devices to input information about their health and safety, which is then sent to a central server. Smart devices are smartphones or tablets, and a dedicated application is installed on them. Users launch the application and input their health and safety information. For example, they might say, "I have a headache today." Once they have finished entering information, they press the send button.

[0675] The terminal (smart device) sends this information to a central server using an HTTPS request, which then stores the received information in a database (e.g., MySQL). The stored information includes the user ID, timestamp, and input content.

[0676] The server analyzes the received information based on a pre-defined algorithm and sends notifications to the appropriate contacts based on the results. These notifications can be sent via email, push notification, or SMS. For example, SMS can be sent using the Python SMPP library. The notified contacts can receive the notification on their smart devices and view its contents.

[0677] For example, an 80-year-old female user can type, "I have a headache today," and her son can receive a notification and check on his mother's condition.

[0678] Acquisition of room temperature information and remote operation

[0679] This system can also remotely obtain information about the room temperature in the home and operate the thermostat. An IoT temperature sensor (e.g., DHT22 sensor) is installed in the home and periodically measures the current room temperature. The measured data is sent to a central server by a home device (e.g., Raspberry Pi) using an HTTPS request.

[0680] The server then sends the received temperature data to the user's smart device in real time, for example by sending a push notification using Firebase Cloud Messaging. The user can then check the current room temperature using a dedicated application.

[0681] When a user wants to set a desired room temperature, they input and send the desired room temperature (for example, 24°C) using a dedicated application. The device then sends this desired temperature data to a central server. The server receives the desired temperature data and sends instructions to adjust the temperature to the device at home. The device at home then operates the thermostat or air conditioner based on these instructions, adjusting the room temperature to the specified level. For example, an infrared remote control signal for an air conditioner could be sent from a Raspberry Pi.

[0682] As a specific example, a man in his 50s on a business trip can check the current room temperature (for example, 28°C) and input and set the desired room temperature (24°C), thereby adjusting the temperature of his living room at home to a comfortable level.

[0683] Examples of prompt statements

[0684] "You have devised a system that allows an 80-year-old mother to use a smart device to input information about her poor health and notify her family of that information. Please generate a description of this system using the user, device, and server as subjects. As a concrete example, please include a scene where the mother inputs, 'I have a headache today,' and her son receives a notification."

[0685] In this way, this system allows users in remote locations to quickly send and receive information about their family's health and safety, provide necessary notifications in real time, and easily adjust the temperature environment in their home. This system is also very useful for households with elderly family members or those who need health care.

[0686] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0687] Entering and notifying health and safety information

[0688] Step 1:

[0689] The user launches a dedicated application on their smart device and inputs information about their health and safety. Specifically, they enter information such as "I have a headache today" into a text box and press the send button.

[0690] Input: Health and safety information entered by the user

[0691] Output: Information temporarily stored in the smart device application

[0692] Step 2:

[0693] The terminal (smart device) sends the input information to the central server using an HTTPS request, including the user ID, timestamp, and input content.

[0694] Input: User-entered health and safety information, user ID, timestamp

[0695] Output: Information sent to the central server

[0696] Step 3:

[0697] The server stores the received information in a database (e.g. MySQL). The stored information includes the user ID, timestamp, and input content. Before storing, the data is formatted and checked for errors.

[0698] Input: Information sent to a central server

[0699] Output: Information stored in the database

[0700] Step 4:

[0701] The server analyzes the information stored in the database, using pre-defined rules and algorithms.

[0702] Input: Information stored in a database

[0703] Output: Analysis results (list of people to be notified)

[0704] Step 5:

[0705] The server then sends notifications to registered contacts based on the analysis results. These notifications can be sent via email, push notification, or SMS. For example, SMS can be sent using the Python SMPP library.

[0706] Input: Analysis results (list of people to be notified)

[0707] Output: Notifications sent to notified contacts

[0708] Step 6:

[0709] The contact receives the notification on their smart device and checks the details. For example, a family member who receives the notification can check the details on their smartphone.

[0710] Input: Notification sent from the server

[0711] Output: Notification content displayed to the notified contact

[0712] Acquisition of room temperature information and remote operation

[0713] Step 1:

[0714] An IoT temperature sensor (e.g., DHT22 sensor) installed in your home periodically (e.g., every 15 minutes) measures the current room temperature.

[0715] Input: Current room temperature

[0716] Output: Measured temperature data

[0717] Step 2:

[0718] A home device (e.g., Raspberry Pi) sends temperature data obtained from an IoT temperature sensor to a central server using an HTTPS request.

[0719] Input: Measured temperature data

[0720] Output: Temperature data sent to a central server

[0721] Step 3:

[0722] The server stores the received temperature data in a database and sends it to the user's smart device in real time using Firebase Cloud Messaging.

[0723] Input: Temperature data sent to a central server

[0724] Output: Temperature data sent to the user's smart device

[0725] Step 4:

[0726] The user checks the current room temperature using a dedicated application on the smart device and inputs the desired room temperature (for example, 24°C).

[0727] Input: Current room temperature, desired room temperature

[0728] Output: Desired room temperature data temporarily saved in the smart device

[0729] Step 5:

[0730] When the user presses the send button, the smart device sends the desired room temperature data to the central server.

[0731] Input: Desired room temperature data

[0732] Output: Desired room temperature data sent to the central server

[0733] Step 6:

[0734] The server receives the desired room temperature data and sends it to the home device using the MQTT protocol.

[0735] Input: Desired room temperature data sent to the central server

[0736] Output: Temperature control instructions sent to the home device

[0737] Step 7:

[0738] Based on the instructions received by the home device, the thermostat or air conditioner is operated to adjust the room temperature to the specified level. For example, the Raspberry Pi sends an infrared remote control signal to the air conditioner.

[0739] Input: Temperature control instructions sent to your home device

[0740] Output: Room temperature regulated

[0741] (Application example 1)

[0742] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0743] Today's families are often geographically dispersed, making it difficult to regularly check on the health and safety of elderly or vulnerable family members. Furthermore, there are limited means to efficiently monitor and manage home security and environmental controls (such as room temperature control) from a remote location. This creates a need for a comprehensive system to maintain a safe and comfortable living environment for families.

[0744] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0745] In this invention, the server includes a means for a user in a remote location to input health and safety information using a smart device, a means for transmitting the input information to a central server, a means for the central server to analyze the received information and notify registered contacts, a means for acquiring home room temperature information and operating home temperature control devices according to instructions from the smart device, a means for linking with a security sensor to monitor the home security status, and a means for immediately sending a notification if an abnormality occurs. This makes it possible to comprehensively monitor and manage the health and safety of users, the home environment, and the security status even from a remote location.

[0746] "Remote users" refers to people who are geographically distant from the home or facility where the service is provided.

[0747] "Smart devices" refers to portable electronic devices that can connect to the Internet, such as smartphones, tablets, and smartwatches.

[0748] "Health and safety information" refers to information about the user's health condition and current situation, such as "I have a headache" or "I'm safe."

[0749] "Central Server" means a central control device or system for receiving, analyzing, storing User-entered information, and sending notifications as necessary.

[0750] "Security sensors" refer to various sensors used to monitor security within the home, such as door and window opening / closing sensors, motion detection sensors, smoke detectors, and carbon monoxide detectors.

[0751] "Temperature control equipment" refers to devices used to regulate indoor temperatures, such as air conditioners, thermostats, and heaters.

[0752] "Notification" refers to the means of information transmission that allows users to send information about their health and safety to a central server and, if necessary, communicate the analysis results to family members or registered contacts.

[0753] "Room temperature information" refers to data about the current temperature inside your home, which is important for keeping your home comfortable and safe.

[0754] "Monitoring" refers to constantly watching over a specific environment or situation using security sensors, etc.

[0755] An "anomaly" is an event or situation that is outside the normal or expected range, and when this occurs, a notification is sent to users and relevant parties.

[0756] This invention is a system in which users in remote locations use smart devices to input information about their health and safety, which is then sent to a central server. The central server receives and analyzes the input information, and sends notifications to registered contacts. The system also has the ability to obtain home room temperature information on the smart device and remotely control the home's temperature control equipment. Furthermore, this system also has the ability to monitor the home's security status and send immediate notifications if an abnormality occurs.

[0757] 1. System Configuration

[0758] Hardware Configuration

[0759] Smart devices: smartphones, tablets, smartwatches

[0760] Central server: High-performance cloud server (e.g., AWS, Google Cloud)

[0761] Security sensors and devices: door and window opening and closing sensors, motion detection sensors, smoke detectors, carbon monoxide detectors

[0762] Temperature control devices: air conditioners, thermostats

[0763] Software Configuration

[0764] Server application: Developed in Python with Django or Flask framework

[0765] Database: PostgreSQL

[0766] Real-time database and notification system: Firebase, MQTT protocol

[0767] Smart Device Applications: Swift for iOS, Kotlin for Android

[0768] 2. System Functions

[0769] Entering and notifying health and safety information

[0770] Users enter their health and safety information into a dedicated app on their smart device. The information is immediately sent to the Firebase real-time database and retrieved by a central server. The server analyzes the information and sends notifications to family members and registered contacts as needed. These notifications are sent in real time using Firebase Cloud Messaging (FCM).

[0771] Acquisition of room temperature information and remote operation

[0772] IoT temperature sensors installed in homes periodically measure the room temperature and transmit the data to a central server via the MQTT protocol. When users input their desired room temperature via their smart devices, that information is also sent to the central server. Based on this information, the central server issues instructions to the home's thermostat to adjust the temperature to the desired level.

[0773] Security status monitoring

[0774] Multiple security sensors and devices monitor the home for abnormalities, and if an abnormality is detected, it is immediately notified to a central server. The server collects the abnormality information and sends notifications to family members and registered contacts based on the analysis results. This allows users to understand the security status of their home in real time.

[0775] 3. Usage example

[0776] Usage example 1: Health check and notification

[0777] An 80-year-old woman types "I have a headache today" into an application on her smart device and presses the send button. The smart device sends this information to a central server, which analyzes the information and sends a notification to the woman's son. The son receives the notification on his smartphone and can immediately check on his mother's condition.

[0778] Example prompt sentence:

[0779] In an application where an 80-year-old woman enters information such as "I'm not feeling well" and sends a notification, please create a program that implements a system that links with the Firebase database and sends notifications to registered family members in real time.

[0780] Usage example 2: Room temperature adjustment

[0781] While on a business trip, a man in his 50s uses a smart device to check the current room temperature in his living room (e.g., 28°C) and inputs the setting to 24°C. The server receives this data and sends instructions to the thermostat in his home, adjusting the temperature in the living room to 24°C.

[0782] Example prompt sentence:

[0783] To design an IoT device integration application that remotely obtains temperature sensor data and allows the user to set the room temperature as desired, create a program to send and receive data using the MQTT protocol.

[0784] Use Case 3: Security Monitoring

[0785] While the user is away from home, the door sensor detects any unauthorized opening or closing and immediately sends a notification to a central server. The server analyzes this information and notifies family members or security companies of any abnormalities. Users can then check the real-time security status on their smart devices.

[0786] The above is a detailed description of a specific embodiment of the invention. This system allows users to comprehensively monitor and manage the health and safety of their family members, the home environment, and security from a remote location.

[0787] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0788] Step 1:

[0789] The user enters information about their health and safety using a smart device. The user opens the application, enters their health and safety information, and presses the send button. The input is saved in text format in the application.

[0790] Input: User's health and safety information

[0791] Output: Text data containing health and safety information

[0792] Action: Enter text on the smart device screen and press the send button.

[0793] Step 2:

[0794] The device sends the entered health and safety information to a central server, and the data entered in the application is sent to the Firebase real-time database.

[0795] Input: Text data of health and safety information

[0796] Output: Health and safety information stored in the database

[0797] How it works: Smart devices send data over the internet to Firebase.

[0798] Step 3:

[0799] The server retrieves health and safety information from the database and performs analysis. The server pulls data from the Firebase real-time database and performs analysis using a Python script.

[0800] Input: Health and safety information stored in the database

[0801] Output: Analysis result (e.g., "There is a serious health risk")

[0802] How it works: The server retrieves data via the API and performs analysis.

[0803] Step 4:

[0804] The server then sends notifications to registered contacts as needed based on the analysis results, and sends push notifications to family and friends via Firebase Cloud Messaging (FCM).

[0805] Input: Analysis results

[0806] Output: Notification message

[0807] Operation: The server calls the notification sending API and sends a push notification.

[0808] Step 5:

[0809] An IoT temperature sensor in your home measures the current room temperature and periodically sends the data to a central server. The temperature sensor sends the data using the MQTT protocol.

[0810] Input: Measured room temperature data

[0811] Output: Room temperature data sent to a central server

[0812] How it works: The temperature sensor sends data to the server using the MQTT protocol.

[0813] Step 6:

[0814] The server receives the room temperature data in real time and sends it to the user's smart device. The user opens the application and checks the current room temperature.

[0815] Input: Room temperature data

[0816] Output: Room temperature information displayed on a smart device

[0817] How it works: The server retrieves data and sends it to the smart device via API.

[0818] Step 7:

[0819] The user enters the desired room temperature into the application and sends it to the central server. The user enters the desired temperature on the application's "Set Temperature" screen and presses the send button.

[0820] Input: User's desired room temperature

[0821] Output: Desired room temperature data sent to the central server

[0822] Operation: A user enters a value on the application screen and presses a button to send the value to the server.

[0823] Step 8:

[0824] The server issues instructions to the home thermostat based on the desired room temperature data. The server assembles instructions for the desired thermostat and sends them using the MQTT protocol.

[0825] Input: Desired room temperature data

[0826] Output: Adjustment command sent to temperature control device

[0827] How it works: The server generates adjustment commands and sends them using the MQTT protocol.

[0828] Step 9:

[0829] The temperature control device adjusts the room temperature according to instructions from the server. Based on the received command, the temperature control device adjusts the room temperature to the desired value.

[0830] Input: Adjust command

[0831] Output: Room temperature regulated

[0832] How it works: The temperature control device adjusts the temperature as instructed.

[0833] Step 10:

[0834] If a security sensor detects an anomaly, it sends a notification to a central server. The sensor triggers an anomaly detection and sends the data to the server via MQTT protocol.

[0835] Input: Anomaly data detected by security sensors

[0836] Output: Anomaly notification sent to the central server

[0837] What it does: A security sensor detects an anomaly and transmits data.

[0838] Step 11:

[0839] The server receives the anomaly data and sends notifications to registered contacts based on the analysis results. The server sends push notifications in real time using Firebase Cloud Messaging.

[0840] Input: Abnormal data

[0841] Output: Error notification message

[0842] How it works: The server analyzes the anomaly data and sends a notification.

[0843] In this way, the system of the present invention receives a variety of input data and automatically processes and notifies based on that data, thereby realizing a system that is extremely convenient for users.

[0844] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0845] This invention is a system that incorporates a function that allows users in remote locations to input information about their health and safety using a smart device, and then analyzes the user's emotions using an emotion engine. This system transmits the input information and emotion information to a central server, which then sends notifications to registered contacts based on the information received and analyzed by the central server. It can also obtain information about the room temperature in the home on the smart device and remotely control the home's temperature control equipment.

[0846] System Embodiments

[0847] 1. Input of health and safety information and emotion analysis:

[0848] The user inputs information about their health and safety into the terminal: The user uses a smart device (e.g., a smartphone or tablet) to open a dedicated application and input information about their health and safety (e.g., "I have a headache today"). The user's facial expressions and voice are also captured through the smart device's camera and microphone.

[0849] Emotion engine analyzes user emotions: The emotion engine built into the smart device analyzes captured facial and voice data to identify the user's emotions (e.g., fatigue, sadness, joy).

[0850] 2. Information and emotional data transmission and notification:

[0851] The device sends information and emotional data to the server: When the user completes the input and presses the send button, the smart device sends information about their physical condition and safety, as well as the emotional data identified by the emotion engine, to the central server.

[0852] The server receives the information and emotion data, analyzes it, and sends notifications: The server stores the received data in a database and analyzes it. As a result, it adjusts and sends notifications to family members and registered contacts as needed. Notifications are sent via email, push notification, or SMS.

[0853] 3. Room temperature information acquisition and remote operation:

[0854] A home device measures the room temperature and sends it to a server: An IoT temperature sensor installed in the home periodically measures the current room temperature and sends the data to a central server via the home device.

[0855] The server receives the temperature data and sends it to the user's device: The server receives the temperature data and sends it to the user's smart device in real time, allowing the user to check the current room temperature using a dedicated application.

[0856] The user inputs the desired room temperature and sends it from the terminal to the server: The user inputs the desired room temperature (e.g., 24°C) using the application and sends it. This data is sent to the server.

[0857] The server sends instructions to the home device to adjust the temperature: Based on the desired room temperature data received, the server sends temperature control instructions to the home device. The home device follows these instructions and operates the temperature control device (e.g., thermostat or air conditioner) to adjust the temperature to the specified level.

[0858] Specific examples

[0859] Example 1: Specific example of health check and emotion analysis

[0860] The user enters their physical condition into the device: An 80-year-old woman enters "I have a headache today" into a smart device application and presses the send button. Facial expressions and voice are also captured via the camera and microphone.

[0861] Emotion engine analyzes emotions: The emotion engine built into the smart device analyzes the user's facial expressions and voice to detect "fatigue."

[0862] Terminal transmits information and emotional data: The smart device transmits physical condition information and emotional data indicating "fatigue" to a central server.

[0863] The server receives the information and sends a notification: The server receives the information and stores it in a database. It analyzes it and sends a message to the appropriate contact (for example, the woman's son) saying, "Notification from Mom: I have a headache today (emotion: fatigue)." The son receives this notification on his smartphone and can immediately check his mother's condition and consider what action is necessary.

[0864] Example 2: Room temperature control

[0865] A home device measures the temperature and sends it to the server: The IoT temperature sensor in your home measures the current room temperature and sends it to the central server.

[0866] The user inputs the desired room temperature and sends it from the device: A man in his 50s uses a smart device while on a business trip to check the current room temperature in the living room (for example, 28°C) and inputs that it should be set to 24°C.

[0867] The server receives the information and sends instructions to the home device: The server receives this data and sends instructions to the home device to set the temperature to 24°C.

[0868] Home devices adjust the temperature: Your home device controls the thermostat and air conditioner, adjusting the temperature in your living room to 24°C.

[0869] This system allows users to monitor the health and safety of their family members, even when they are in a remote location, and maintain a comfortable home environment. This invention is extremely useful for elderly people and those with family members who need health care.

[0870] The processing flow will be explained below.

[0871] Input of health and safety information, emotion analysis, and notifications

[0872] Processing Steps:

[0873] Step 1:

[0874] A user enters information about their health and safety into a smart device. For example, they open an application, type "I have a headache today," and press the send button. The smart device's camera and microphone capture the user's facial expressions and voice.

[0875] Step 2:

[0876] The device's on-board emotion engine analyzes the captured facial expression and voice data, for example, by using facial recognition technology and voice feature extraction to identify the user's emotions (e.g., fatigue, sadness, joy).

[0877] Step 3:

[0878] The device sends the entered health and safety information and analyzed emotion data to the central server via a POST request. For example, the request data is structured as follows: { "user_id": 123, "status": "I have a headache today", "emotion": "Fatigue"}.

[0879] Step 4:

[0880] The server receives the POST request and stores this information in a database, for example in the "users_status" and "users_emotions" tables.

[0881] Step 5:

[0882] The server analyzes the health and safety information and emotional data to determine whether a notification is necessary. Specifically, based on the content of "status" and "emotion," it determines that a notification is necessary if the importance is high.

[0883] Step 6:

[0884] The server creates the notification content and sends it to the registered contacts (for example, family members' email addresses or push notification device IDs). For example, an SMTP server is used for email, and FCM is used for push notifications. The notification content includes specific information such as "Notification from Mom: I have a headache today (emotion: fatigue)."

[0885] Step 7:

[0886] The notification arrives on the family member's device. The notification service on the device runs and displays the message "Notification from Mom: I have a headache today (emotion: fatigue)" to the family user.

[0887] Acquisition of room temperature information and remote operation

[0888] Processing Steps:

[0889] Step 1:

[0890] The device at home measures the current room temperature from a temperature sensor, which acquires temperature data every minute, for example.

[0891] Step 2:

[0892] The temperature data acquired by the home device is sent to the central server via a POST request. The request data is sent in the format of { "room_id": 1, "temperature": 28.5, "timestamp": "2023-10-01T12:00:00Z"}, for example.

[0893] Step 3:

[0894] The server receives the POST request and saves the temperature information in the database, in the "room_temperatures" table.

[0895] Step 4:

[0896] The user's device sends a GET request to the server for the current temperature information. The request is sent in the format " / api / temperature / latest?room_id=1", for example.

[0897] Step 5:

[0898] The server receives a GET request, retrieves the latest temperature data from the database, and returns the data in the response format: { "room_id": 1, "temperature": 28.5, "timestamp": "2023-10-01T12:00:00Z"}.

[0899] Step 6:

[0900] The user's device receives the response from the server and displays the current room temperature in the application. For example, "The current temperature in the living room is 28.5°C" is displayed in a visible area for the user.

[0901] Remote room temperature control

[0902] Processing Steps:

[0903] Step 1:

[0904] The user enters the desired room temperature (for example, 24°C) into the smart device application and presses the send button.

[0905] Step 2:

[0906] The device sends the desired room temperature data to the central server via a POST request. For example, the request data is sent in the format "{ "room_id": 1, "desired_temperature": 24}".

[0907] Step 3:

[0908] The server receives the POST request and saves the desired temperature information to the database in the "desired_temperatures" table.

[0909] Step 4:

[0910] The server sends temperature control instructions to the home device using MQTT or HTTP protocol. For example, the message format is "{ "command": "set_temperature", "value": 24}".

[0911] Step 5:

[0912] The home device receives the instruction and executes a command to the temperature control device (e.g., thermostat or air conditioner) to set the desired temperature (24°C).

[0913] Step 6:

[0914] The home thermostat will follow instructions and adjust the room temperature to 24°C. The temperature will be changed and maintained until the specified temperature is reached.

[0915] Example 2

[0916] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0917] Conventional systems lack the means for remote users to easily adjust the temperature in their homes or efficiently notify family members of their health and safety. Furthermore, they lack the ability to analyze a user's emotional state and notify appropriate contacts, which can delay response in emergencies or when special care is needed. This is particularly a serious problem for elderly people and those with fluctuating health conditions.

[0918] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0919] In this invention, the server includes a means for a user in a remote location to input information about their physical condition and safety using an information terminal, a means for an emotion analysis engine built into the information terminal to analyze the user's emotions, and a means for transmitting the input information and analyzed emotion data to the central server. This allows the physical and emotional states of family members to be monitored in real time and prompt responses to be taken as needed. Furthermore, by including a means for acquiring the home's room temperature information displayed on the information terminal and operating the home's temperature control device according to the user's instructions, comfortable room temperature control can be achieved even from a remote location.

[0920] "Remote location" refers to a state in which a user is located geographically away from home.

[0921] "Information terminal" refers to a smartphone, tablet, or other portable electronic device.

[0922] "Input means" refers to the method by which a user inputs information about his or her own health condition and safety through an information terminal.

[0923] An "emotion analysis engine" refers to software or hardware that analyzes a user's facial expressions and voice data to identify their emotional state.

[0924] "Central server" refers to a server system that has the function of storing and analyzing received data and sending notifications as necessary.

[0925] "Notification means" refers to the method by which the central server sends information to registered contacts based on the analysis results.

[0926] "Registered Contacts" means any person or entity designated by a User and authorized to receive emergency or special notices.

[0927] "Room temperature information" refers to temperature data measured by a detection sensor inside your home.

[0928] "Detection sensor" refers to a device installed in a home to measure room temperature.

[0929] "Temperature control devices" refers to devices such as air conditioners and thermostats used to regulate the temperature inside a home.

[0930] "Database" refers to a system for systematically storing and managing received information within a central server.

[0931] MODE FOR CARRYING OUT THE INVENTION

[0932] The present invention is a system in which a user in a remote location uses an information terminal to input information about their own physical condition and safety, and then analyzes the user's emotions using an emotion analysis engine. This system has the function of transmitting the information input by the user and analyzed emotion data to a central server, which then analyzes the received data and sends a notification to registered contacts. It is also possible to obtain information about the room temperature at home and operate the home's temperature control device from a remote location.

[0933] 1. Input of health and safety information and emotion analysis

[0934] A user opens a dedicated application on their smartphone or tablet and enters information about their physical condition and safety. For example, the user might enter "I have a headache today" and press the send button. At this time, the smart device's camera and microphone are used to capture the user's facial expressions and voice. The built-in emotion analysis engine analyzes the captured facial and voice data and identifies the user's emotions (e.g., fatigue, sadness, joy).

[0935] 2. Transmission and notification of information and emotional data

[0936] The device sends the user's input information along with the analyzed emotion data to a central server, which stores this data in a database and analyzes it using a data analysis module. Based on the results, it determines the necessary action to take and sends notifications to family members and registered contacts via email, push notification, or SMS.

[0937] 3. Acquisition of room temperature information and remote operation

[0938] An IoT temperature sensor installed in the home measures the current room temperature and sends that data to the home's gateway device. The gateway device sends this information to a central server, which then sends the received data to the user's information terminal. The user uses a dedicated application to check the current room temperature in real time and input their desired room temperature. The input desired room temperature data is sent to the server, which then uses this data to send instructions to the home's thermostat, adjusting the temperature to the specified level.

[0939] Specific examples

[0940] Example 1: Specific example of health check and emotion analysis

[0941] The user inputs their physical condition: An 80-year-old woman inputs "I have a headache today" into a smart device application and sends it. Her facial expressions and voice are also captured via the camera and microphone.

[0942] Emotion engine analyzes emotions: The emotion engine built into the smart device analyzes the user's facial expressions and voice to detect "fatigue."

[0943] Terminal transmits information and emotional data: The smart device transmits physical condition information and emotional data indicating "fatigue" to a central server.

[0944] Server receives information and sends notification: The server receives the information and stores it in a database. It analyzes it and automatically generates and sends an email to the necessary contact (for example, the son) saying, "Notification from Mom: I have a headache today (emotion: fatigue)." The son receives this notification on his smartphone, can check his mother's situation, and consider how to respond.

[0945] Example 2: Room temperature control

[0946] A home device measures the temperature and sends it to the server: The IoT temperature sensor measures the current room temperature and sends it to the central server.

[0947] The user inputs the desired room temperature and sends it from the device to the server: A man in his 50s uses a smart device while on a business trip to check the current room temperature in the living room (for example, 28°C), inputs the temperature to be set to 24°C, and sends it.

[0948] The server receives the information and sends instructions to the home device: The server receives this data and sends instructions to the home device to set the temperature to 24°C.

[0949] Home devices adjust the temperature: Your home device controls the thermostat and air conditioner, adjusting the temperature in your living room to 24°C.

[0950] Prompt Sentence Examples

[0951] "An 80-year-old woman enters her physical condition information into an application on her smart device, and the emotion data is analyzed by an emotion engine and sent to a server."

[0952] "Remotely control your home's temperature control device using room temperature data measured by an IoT temperature sensor."

[0953] This system allows users to monitor their family's health, safety, and emotions from a distance, and maintain a comfortable temperature in their home.

[0954] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0955] Step 1:

[0956] The user inputs information about their health and safety.

[0957] (Input) Use a smartphone or tablet to enter information about your physical condition and safety (e.g., "I have a headache today") into a dedicated application.

[0958] (Specific behavior) A user enters information into a text field within the application and presses the send button, while simultaneously capturing facial expressions and voice using the smart device's camera and microphone.

[0959] Step 2:

[0960] The sentiment analysis engine analyzes the user's sentiment.

[0961] (Input) Facial expression and voice data captured through the smart device's camera and microphone.

[0962] (Specific operation) The emotion analysis engine analyzes captured facial features, voice tone, and content, and uses machine learning models to identify emotions (e.g., fatigue, sadness, joy).

[0963] (Output) Identified emotion data.

[0964] Step 3:

[0965] The device transmits information and emotion data to the server.

[0966] (Input) User-entered health and safety information, and analyzed emotional data.

[0967] (Specific operation) The smart device packs this data into packets, encrypts them using the HTTPS protocol, and sends them to a central server.

[0968] (Output) Securely transmitted health and safety information and emotional data.

[0969] Step 4:

[0970] The server receives the information and emotion data, analyzes it, and sends a notification.

[0971] (Input) Health and safety information and emotional data sent from the device.

[0972] (Specific operation) The central server stores the received data in a database, and the data analysis module compares it with past data to check for abnormalities. Based on the analysis results, appropriate notifications are automatically generated to registered contacts as needed.

[0973] (Output) An email, push notification, or SMS containing the notification content.

[0974] Step 5:

[0975] The device at home measures the room temperature and sends the value to the server.

[0976] (Input) Room temperature data from an IoT temperature sensor installed in the home.

[0977] (Specific operation) The temperature sensor measures the current room temperature every 5 minutes and sends the data to the home gateway device via Bluetooth, which then sends the data to the central server via Wi-Fi.

[0978] (Output) Room temperature data sent to the central server.

[0979] Step 6:

[0980] The server receives the temperature data and transmits it to the user's terminal.

[0981] (Input) Room temperature data sent from the home gateway device.

[0982] (Specific operation) The central server stores the received temperature data in a database and, upon request from the user, sends the latest room temperature data to a dedicated application via push notification.

[0983] (Output) Real-time room temperature data displayed on the user's smart device.

[0984] Step 7:

[0985] The user inputs the desired room temperature and sends it from the terminal to the server.

[0986] (Input) Enter the desired room temperature (e.g., 24°C) into the dedicated application on your smart device.

[0987] (Specific operation) The user opens the application, checks the current room temperature, enters the desired temperature, and presses the send button.

[0988] (Output) Desired temperature data sent to the central server.

[0989] Step 8:

[0990] The server sends instructions to a device at home to adjust the temperature.

[0991] (Input) Desired temperature data sent by the user.

[0992] (Specific operation) The server analyzes the desired room temperature data and sends instructions to the home's temperature control devices (e.g., air conditioner, thermostat).

[0993] (Output) The thermostat in your home will receive the instruction and adjust to the specified temperature.

[0994] In this way, through the specific processing steps, users can remotely manage their health and safety information and adjust the temperature in their homes.

[0995] (Application example 2)

[0996] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0997] The present invention relates to a system that allows a remote user to input information about their health and safety using a smart device, and then analyzes their emotions using an emotion engine. Conventional systems only allow users to input information about their health and safety, without analyzing the underlying emotions. This makes it difficult to respond quickly when an emergency truly requires it. While the system can also provide information about room temperature control, this is limited. The present invention aims to enable a more prompt and appropriate response by comprehensively analyzing a series of information and notifying family members and related parties.

[0998] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a remote user to input health and safety information using a smart device, a means for transmitting the input information to a central server, and a means for the central server to analyze the received information and notify registered contacts. This enables the user's health and emotions to be grasped in real time, even when the user is in a remote location, and appropriate responses can be taken. Furthermore, the means for analyzing the user's facial expressions and voice using an emotion engine to identify emotions, a means for acquiring home room temperature information displayed on the smart device, a means for operating home temperature control devices in accordance with instructions from the smart device, and a means for the central server to adjust notification content based on the analyzed emotion information enable the central server to adjust notification content according to the user's emotional state. As a result, family members and other related parties can know the user's true condition and quickly take appropriate measures based on that information.

[0999] "User" refers to a person who uses a smart device to input information about their health and safety and is the subject of emotion analysis.

[1000] A "smart device" is an electronic device that allows users to input information about their health and safety and performs emotion analysis using an emotion engine, and includes smartphones and tablets.

[1001] "Emotion engine" refers to software or hardware for analyzing a user's facial expressions and voice and identifying the user's emotions.

[1002] An "expression" is a facial expression of a user, which is captured using the camera of the smart device.

[1003] "Audio" refers to the vocal signal emitted by the user and captured using the microphone of the smart device.

[1004] The "central server" is a computer system that receives and analyzes health and safety information and emotional data sent from smart devices, adjusts the content of notifications, and sends them to contacts.

[1005] "Registered contacts" refers to people who have contact information for family members and related parties who are pre-set to be notified of the user's health condition and safety information.

[1006] "Notifications" are communications sent to registered contacts based on information analyzed by the central server.

[1007] "Room temperature information" refers to the current room temperature data measured by a temperature sensor installed in your home and displayed on your smart device.

[1008] "Temperature control devices" are devices used to adjust the temperature inside a home, including thermostats and air conditioners.

[1009] The system for implementing this invention allows a user in a remote location to input information about their physical condition and safety using a smart device, and then analyzes the user's emotions using an emotion engine to send appropriate notifications to family members and related parties. The user can also remotely control their home temperature control device.

[1010] System Configuration

[1011] The system consists of the following main components:

[1012] 1. Smart Devices

[1013] Hardware: Smartphones, tablets

[1014] Software: Data entry application, sentiment analysis engine

[1015] 2. Central Server

[1016] Hardware: Cloud servers or data centers

[1017] Software: Data analysis module, notification function

[1018] 3. Home sensors and devices

[1019] Temperature sensors, thermostats, air conditioners

[1020] Specific Embodiments

[1021] 1. Input of health and safety information and emotion analysis

[1022] The user enters health and safety information into the device:

[1023] Users use their smart device to open a dedicated application and enter information about their health and safety.

[1024] Example: An 80-year-old woman types "I have a headache today" into the application and presses the send button. Her facial expressions and voice are also captured via the camera and microphone.

[1025] Emotion engine analyzes emotions:

[1026] An emotion engine built into the smart device analyzes captured facial and voice data to identify the user's emotions.

[1027] Example: An emotion engine analyzes facial expressions and voice to detect "fatigue."

[1028] 2. Transmission and notification of information and emotional data

[1029] The device sends information and emotion data to the server:

[1030] When the user completes the input and presses the send button, the smart device sends information about their physical condition, safety, and emotional data to a central server.

[1031] The server receives the information and emotion data, analyzes it, and sends a notification:

[1032] The server stores the received data in a database, analyzes it, and then adjusts and sends notifications to family members and other relevant parties as needed. Notifications can be sent via email, push notification, or SMS.

[1033] Example: The server receives the information and sends the message to the woman's son, "Notification from Mom: I have a headache today (emotion: fatigue)." The son receives this notification on his smartphone, can immediately check his mother's situation, and consider what action is necessary.

[1034] 3. Acquisition of room temperature information and remote operation

[1035] The device at home measures the room temperature and sends it to the server:

[1036] IoT temperature sensors installed in the home measure the current room temperature and send it to a central server.

[1037] Example: A temperature sensor measures 28°C and sends it to the server.

[1038] The server receives the temperature data and sends it to the user's device:

[1039] The server receives the temperature data and sends it to the user's smart device in real time, allowing the user to check the current room temperature using a dedicated application.

[1040] The user inputs the desired room temperature and sends it from the terminal to the server:

[1041] The user inputs the desired room temperature (e.g., 24°C) using the application and submits it. This data is sent to the server.

[1042] Example: A man in his 50s uses a smart device while on a business trip to check the current room temperature in the living room (for example, 28°C) and inputs the setting to 24°C.

[1043] The server sends instructions to the home device to adjust the temperature:

[1044] The server then sends temperature control instructions to the home device based on the desired room temperature data it receives. The home device then operates the temperature control devices (thermostat and air conditioner) according to these instructions and adjusts the temperature to the specified level.

[1045] Prompt Sentence Examples

[1046] The mother would enter her physical condition into a smartphone app, which would then analyze her emotions using a camera and microphone, and the analysis results would be sent to a server. The server would then develop an application that would send notifications to registered contacts based on the analysis results.

[1047] As described above, by incorporating an emotion analysis engine, the present invention accurately grasps the specific state of the user and provides important information for appropriate response. Furthermore, environmental information such as room temperature can be managed remotely, improving the quality of life of the user.

[1048] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1049] Step 1:

[1050] The user launches a dedicated application on their smart device and inputs information about their health and safety. The input data includes text information such as "I have a headache today." The input health and safety information is temporarily saved within the application.

[1051] input:

[1052] User's health and safety information (text format)

[1053] output:

[1054] Temporarily saved health and safety information

[1055] Specific operation:

[1056] The user opens the application on their smart device, types "I have a headache today," and presses the send button.

[1057] Step 2:

[1058] The smart device uses a camera and microphone to capture the user's facial expressions and voice, which then become input data for analysis by the emotion engine.

[1059] input:

[1060] Camera capture (facial image), microphone capture (audio data)

[1061] output:

[1062] Captured facial and voice data

[1063] Specific operation:

[1064] The smart device activates the camera, takes a picture of the user's face, and records audio with the microphone.

[1065] Step 3:

[1066] An emotion engine built into the smart device analyzes the captured facial and voice data to identify the user's emotions, including feelings such as "fatigue" and "sadness."

[1067] input:

[1068] Facial expression image data, voice data

[1069] output:

[1070] Identified emotion data (e.g., "fatigue")

[1071] Specific operation:

[1072] The emotion engine inputs facial expression images and performs image analysis to identify the emotion "fatigue." It then analyzes the voice data and similarly identifies the emotion "fatigue."

[1073] Step 4:

[1074] The smart device sends the entered health and safety information and analyzed emotion data to a central server, which requires an internet connection.

[1075] input:

[1076] Temporarily stored health and safety information, analyzed emotional data

[1077] output:

[1078] Data sent from smart devices to a central server

[1079] Specific operation:

[1080] When the data transmission button is pressed from the smart device to the server, health and safety information and emotional data are sent to the central server.

[1081] Step 5:

[1082] The central server analyzes the received health and safety information and emotional data, adjusts the notification content as necessary, and notifies registered contacts.

[1083] input:

[1084] Health and safety information and emotional data sent to a central server

[1085] output:

[1086] Notification content (e.g., "Notification from Mom: I have a headache today (emotion: fatigue)")

[1087] Specific operation:

[1088] The server generates notification content based on the received data and sends it to registered contacts via email, SMS, or other means.

[1089] Step 6:

[1090] Temperature sensors in your home measure the current room temperature and send that data to a central server, which updates the measurements periodically.

[1091] input:

[1092] Room temperature sensor data

[1093] output:

[1094] Room temperature data sent to a central server

[1095] Specific operation:

[1096] The temperature sensor measures the current room temperature and transmits the data to a server over the internet.

[1097] Step 7:

[1098] The central server receives room temperature data and sends it to a smart device, allowing users to check the room temperature remotely using a dedicated application.

[1099] input:

[1100] Room temperature data sent to a central server

[1101] output:

[1102] Room temperature information displayed on a smart device

[1103] Specific operation:

[1104] The app on the smart device receives room temperature data from the server and displays the current room temperature.

[1105] Step 8:

[1106] The user inputs the desired room temperature into the smart device application and the data is sent to the central server. The desired room temperature information becomes the input data.

[1107] input:

[1108] Desired room temperature entered by the user (e.g. 24°C)

[1109] output:

[1110] Desired room temperature data is sent to a central server

[1111] Specific operation:

[1112] The user sets the desired room temperature in the application and presses the send button.

[1113] Step 9:

[1114] Based on the desired room temperature data received by the central server, it sends temperature adjustment instructions to a device at home, and operates the thermostat or air conditioner to adjust to the specified temperature.

[1115] input:

[1116] Desired room temperature data

[1117] output:

[1118] Instructions sent to temperature control equipment

[1119] Specific operation:

[1120] Based on the desired room temperature received by the server, it sends an instruction to set the home thermostat to 24°C, and the air conditioner operates to adjust the room temperature.

[1121] This series of steps will create a system that allows users to comprehensively manage their physical condition, emotions, home temperature, and other aspects of their lives, even from a remote location.

[1122] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1123] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1124] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1125] [Third embodiment]

[1126] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1127] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1128] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1129] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1130] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1131] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1132] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1133] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1134] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1135] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1136] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1137] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1138] The present invention provides a system that allows users in remote locations to input information about their health and safety using a smart device and send it to a central server. The central server receives and analyzes the input information and sends notifications to registered contacts. Furthermore, the smart device can obtain information about the home's room temperature and remotely control the home's temperature control equipment.

[1139] System Embodiments

[1140] 1. Entering and notifying health and safety information:

[1141] The user inputs information about their health and safety into the device: The user uses a smart device (e.g., a smartphone or tablet) and opens a dedicated application, where they input information about their health and safety (e.g., "I have a headache today").

[1142] The device sends the information to the server: When the user completes the input and presses the send button, the smart device sends this information to the central server.

[1143] The server receives and analyzes the information and sends notifications: The server stores the received information in a database, analyzes it, and then sends notifications to family members and registered contacts as needed. Notifications can be sent via email, push notification, or SMS.

[1144] 2. Room temperature information acquisition and remote operation:

[1145] The home device measures the room temperature and sends it to the server: The IoT temperature sensor installed in the home periodically measures the current room temperature, and the measured data is sent to the central server via the home device.

[1146] The server receives the temperature data and sends it to the user's device: The server receives the temperature data and sends it to the user's smart device in real time. The user can check the current room temperature using a dedicated application on their smart device.

[1147] The user inputs the desired room temperature and sends it from the device to the server: The user inputs the desired room temperature using the application and sends it. This data is sent to the server.

[1148] The server sends instructions to the home device to adjust the temperature: Based on the desired room temperature data received, the server sends temperature control instructions to the home device. The home device follows these instructions and operates the temperature control device (e.g., thermostat or air conditioner) to adjust the temperature to the specified level.

[1149] Specific examples

[1150] Example 1: Specific example of health check

[1151] A user enters their physical condition into a device: An 80-year-old woman enters "I have a headache today" into a smart device application and presses the send button.

[1152] Device sends information to server: Smart devices send this information to a central server.

[1153] The server receives the information and sends a notification: The server receives this information and stores it in a database. The server analyzes it and sends a notification to the necessary contacts (for example, the woman's son). The son receives this notification on his smartphone and can immediately check on his mother's status.

[1154] Example 2: Room temperature control

[1155] A home device measures the temperature and sends it to the server: The IoT temperature sensor in your home measures the current room temperature and sends it to the server.

[1156] The user inputs the desired room temperature and sends it from the device: A man in his 50s is on a business trip and uses his smart device to check the current room temperature in the living room (for example, 28°C) and inputs that it should be set to 24°C.

[1157] The server receives the information and sends instructions to the home device: The server receives this data and sends instructions to the home device to set the temperature to 24°C.

[1158] Home devices adjust the temperature: Your home device controls the thermostat and air conditioner, adjusting the temperature in your living room to 24°C.

[1159] This system allows users to remotely manage the health and safety of their family members and maintain a comfortable home environment, which is extremely useful for elderly people and those with family members who need health care.

[1160] The processing flow will be explained below.

[1161] Input and notification of health and safety information

[1162] Processing Steps:

[1163] Step 1:

[1164] A user enters information about their health and safety into a smart device. For example, they open an application, enter "I have a headache today," and press the send button.

[1165] Step 2:

[1166] The device sends the entered health and safety information to the central server via a POST request. The request data is in JSON format and is structured as follows: { "user_id": 123, "status": "I have a headache today"}.

[1167] Step 3:

[1168] The server receives the POST request and stores this information in a database, for example in a "users_status" table.

[1169] Step 4:

[1170] The server analyzes the information stored in the database and determines whether a notification is necessary. Specifically, it determines that a notification is necessary if the importance is high based on the content of "status."

[1171] Step 5:

[1172] The server creates the notification content and sends it to the registered contacts (such as family members' email addresses or push notification device IDs). For example, an SMTP server is used for email, and FCM is used for push notifications.

[1173] Step 6:

[1174] The notification arrives on the family member's device. The notification service on the device runs and displays the message "Notification from Mom: I have a headache today" to the user.

[1175] Acquisition of room temperature information and remote operation

[1176] Processing Steps:

[1177] Step 1:

[1178] The device at home measures the current room temperature from a temperature sensor, which acquires temperature data every minute, for example.

[1179] Step 2:

[1180] The temperature data acquired by the home device is sent to the central server via a POST request in the format "{ "room_id": 1, "temperature": 28.5, "timestamp": "2023-10-01T12:00:00Z"}".

[1181] Step 3:

[1182] The server receives the POST request and saves the temperature information in the database, in the "room_temperatures" table.

[1183] Step 4:

[1184] The user's device sends a GET request to the server for the current temperature information. The request is sent in the format " / api / temperature / latest?room_id=1", for example.

[1185] Step 5:

[1186] The server receives a GET request, retrieves the latest temperature data from the database, and returns the data in the response format: { "room_id": 1, "temperature": 28.5, "timestamp": "2023-10-01T12:00:00Z"}.

[1187] Step 6:

[1188] The user's device receives the response from the server and displays the current room temperature in the application. For example, "The current temperature in the living room is 28.5°C" is displayed in a visible area for the user.

[1189] Remote room temperature control

[1190] Processing Steps:

[1191] Step 1:

[1192] The user enters the desired room temperature (for example, 24°C) into the smart device application and presses the send button.

[1193] Step 2:

[1194] The device sends the desired room temperature data to the central server via a POST request in the format "{ "room_id": 1, "desired_temperature": 24}".

[1195] Step 3:

[1196] The server receives the POST request and saves the desired temperature information to the database in the "desired_temperatures" table.

[1197] Step 4:

[1198] The server sends temperature adjustment instructions to the home device using the MQTT or HTTP protocol. The instructions are sent in the format "{ "command": "set_temperature", "value": 24}".

[1199] Step 5:

[1200] The home device receives the instruction and executes a command to the temperature control device (e.g., thermostat or air conditioner) to set the desired temperature (24°C).

[1201] Step 6:

[1202] The home thermostat will follow instructions and adjust the room temperature to 24°C. The temperature will be changed and maintained until the specified temperature is reached.

[1203] Example 1

[1204] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1205] In today's world, people with elderly family members or those who require health management need to monitor their family members' health and safety, as well as their home environment, even from remote locations. However, current systems make it difficult to efficiently input information, provide notifications, and adjust temperatures, and there are particular challenges in real-time information transmission and environmental adjustment. Furthermore, there is a lack of a way for users to remotely set their desired room temperature and have it reflected in a timely manner, making it difficult to fully meet the needs of users in remote locations.

[1206] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1207] In this invention, the server includes a means for transmitting health and safety information to a central server, a means for the central server to analyze the received information and notify registered contacts, and a means for storing the input information in a database and sending notifications based on the analysis results. This allows users to quickly send and receive information about their health and safety, even if they are in a remote location, and to provide necessary notifications in real time.

[1208] In addition, the server includes a means for transmitting room temperature information to the central server, a means for inputting and transmitting a desired room temperature, and a means for transmitting instructions to the temperature control device, so that the user can check the room temperature in their home even from a remote location and adjust the temperature appropriately. In this way, the present invention provides a system that allows the user to appropriately manage the health and safety of their family members even when they are in a remote location, and maintain a comfortable home environment.

[1209] "Physical condition and safety information" is information indicating the user's own health condition and safety status.

[1210] "Smart device" refers to a digital device that is internet-enabled and allows users to input and transmit information.

[1211] "Central Server" means a computer system that receives, stores, analyzes entered information, and sends notifications as needed.

[1212] "Notification destination" refers to a contact point registered to receive important information such as the user's health and safety.

[1213] "Room temperature information" is data relating to the temperature inside the home, and is information that the user can check.

[1214] "Thermostat" refers to a device for regulating the temperature in a home based on a set temperature.

[1215] A "database" is a system for organizing and storing received information.

[1216] "Analysis" refers to the process of processing received information according to specific criteria or algorithms to derive a result.

[1217] "Real-time transmission" refers to information being transmitted nearly simultaneously, meaning that delays are minimized.

[1218] An "instruction" refers to a command to perform a specific action or operation.

[1219] Entering and notifying health and safety information

[1220] This system allows users in remote locations to use their smart devices to input information about their health and safety, which is then sent to a central server. Smart devices are smartphones or tablets, and a dedicated application is installed on them. Users launch the application and input their health and safety information. For example, they might say, "I have a headache today." Once they have finished entering information, they press the send button.

[1221] The terminal (smart device) sends this information to a central server using an HTTPS request, which then stores the received information in a database (e.g., MySQL). The stored information includes the user ID, timestamp, and input content.

[1222] The server analyzes the received information based on a pre-defined algorithm and sends notifications to the appropriate contacts based on the results. These notifications can be sent via email, push notification, or SMS. For example, SMS can be sent using the Python SMPP library. The notified contacts can receive the notification on their smart devices and view its contents.

[1223] For example, an 80-year-old female user can type, "I have a headache today," and her son can receive a notification and check on his mother's condition.

[1224] Acquisition of room temperature information and remote operation

[1225] This system can also remotely obtain information about the room temperature in the home and operate the thermostat. An IoT temperature sensor (e.g., DHT22 sensor) is installed in the home and periodically measures the current room temperature. The measured data is sent to a central server by a home device (e.g., Raspberry Pi) using an HTTPS request.

[1226] The server then sends the received temperature data to the user's smart device in real time, for example by sending a push notification using Firebase Cloud Messaging. The user can then check the current room temperature using a dedicated application.

[1227] When a user wants to set a desired room temperature, they input and send the desired room temperature (for example, 24°C) using a dedicated application. The device then sends this desired temperature data to a central server. The server receives the desired temperature data and sends instructions to adjust the temperature to the device at home. The device at home then operates the thermostat or air conditioner based on these instructions, adjusting the room temperature to the specified level. For example, an infrared remote control signal for an air conditioner could be sent from a Raspberry Pi.

[1228] As a specific example, a man in his 50s on a business trip can check the current room temperature (for example, 28°C) and input and set the desired room temperature (24°C), thereby adjusting the temperature of his living room at home to a comfortable level.

[1229] Examples of prompt statements

[1230] "You have devised a system that allows an 80-year-old mother to use a smart device to input information about her poor health and notify her family of that information. Please generate a description of this system using the user, device, and server as subjects. As a concrete example, please include a scene where the mother inputs, 'I have a headache today,' and her son receives a notification."

[1231] In this way, this system allows users in remote locations to quickly send and receive information about their family's health and safety, provide necessary notifications in real time, and easily adjust the temperature environment in their home. This system is also very useful for households with elderly family members or those who need health care.

[1232] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1233] Entering and notifying health and safety information

[1234] Step 1:

[1235] The user launches a dedicated application on their smart device and inputs information about their health and safety. Specifically, they enter information such as "I have a headache today" into a text box and press the send button.

[1236] Input: Health and safety information entered by the user

[1237] Output: Information temporarily stored in the smart device application

[1238] Step 2:

[1239] The terminal (smart device) sends the input information to the central server using an HTTPS request, including the user ID, timestamp, and input content.

[1240] Input: User-entered health and safety information, user ID, timestamp

[1241] Output: Information sent to the central server

[1242] Step 3:

[1243] The server stores the received information in a database (e.g. MySQL). The stored information includes the user ID, timestamp, and input content. Before storing, the data is formatted and checked for errors.

[1244] Input: Information sent to a central server

[1245] Output: Information stored in the database

[1246] Step 4:

[1247] The server analyzes the information stored in the database, using pre-defined rules and algorithms.

[1248] Input: Information stored in a database

[1249] Output: Analysis results (list of people to be notified)

[1250] Step 5:

[1251] The server then sends notifications to registered contacts based on the analysis results. These notifications can be sent via email, push notification, or SMS. For example, SMS can be sent using the Python SMPP library.

[1252] Input: Analysis results (list of people to be notified)

[1253] Output: Notifications sent to notified contacts

[1254] Step 6:

[1255] The contact receives the notification on their smart device and checks the details. For example, a family member who receives the notification can check the details on their smartphone.

[1256] Input: Notification sent from the server

[1257] Output: Notification content displayed to the notified contact

[1258] Acquisition of room temperature information and remote operation

[1259] Step 1:

[1260] An IoT temperature sensor (e.g., DHT22 sensor) installed in your home periodically (e.g., every 15 minutes) measures the current room temperature.

[1261] Input: Current room temperature

[1262] Output: Measured temperature data

[1263] Step 2:

[1264] A home device (e.g., Raspberry Pi) sends temperature data obtained from an IoT temperature sensor to a central server using an HTTPS request.

[1265] Input: Measured temperature data

[1266] Output: Temperature data sent to a central server

[1267] Step 3:

[1268] The server stores the received temperature data in a database and sends it to the user's smart device in real time using Firebase Cloud Messaging.

[1269] Input: Temperature data sent to a central server

[1270] Output: Temperature data sent to the user's smart device

[1271] Step 4:

[1272] The user checks the current room temperature using a dedicated application on the smart device and inputs the desired room temperature (for example, 24°C).

[1273] Input: Current room temperature, desired room temperature

[1274] Output: Desired room temperature data temporarily saved in the smart device

[1275] Step 5:

[1276] When the user presses the send button, the smart device sends the desired room temperature data to the central server.

[1277] Input: Desired room temperature data

[1278] Output: Desired room temperature data sent to the central server

[1279] Step 6:

[1280] The server receives the desired room temperature data and sends it to the home device using the MQTT protocol.

[1281] Input: Desired room temperature data sent to the central server

[1282] Output: Temperature control instructions sent to the home device

[1283] Step 7:

[1284] Based on the instructions received by the home device, the thermostat or air conditioner is operated to adjust the room temperature to the specified level. For example, the Raspberry Pi sends an infrared remote control signal to the air conditioner.

[1285] Input: Temperature control instructions sent to your home device

[1286] Output: Room temperature regulated

[1287] (Application example 1)

[1288] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1289] Today's families are often geographically dispersed, making it difficult to regularly check on the health and safety of elderly or vulnerable family members. Furthermore, there are limited means to efficiently monitor and manage home security and environmental controls (such as room temperature control) from a remote location. This creates a need for a comprehensive system to maintain a safe and comfortable living environment for families.

[1290] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1291] In this invention, the server includes a means for a user in a remote location to input health and safety information using a smart device, a means for transmitting the input information to a central server, a means for the central server to analyze the received information and notify registered contacts, a means for acquiring home room temperature information and operating home temperature control devices according to instructions from the smart device, a means for linking with a security sensor to monitor the home security status, and a means for immediately sending a notification if an abnormality occurs. This makes it possible to comprehensively monitor and manage the health and safety of users, the home environment, and the security status even from a remote location.

[1292] "Remote users" refers to people who are geographically distant from the home or facility where the service is provided.

[1293] "Smart devices" refers to portable electronic devices that can connect to the Internet, such as smartphones, tablets, and smartwatches.

[1294] "Health and safety information" refers to information about the user's health condition and current situation, such as "I have a headache" or "I'm safe."

[1295] "Central Server" means a central control device or system for receiving, analyzing, storing User-entered information, and sending notifications as necessary.

[1296] "Security sensors" refer to various sensors used to monitor security within the home, such as door and window opening / closing sensors, motion detection sensors, smoke detectors, and carbon monoxide detectors.

[1297] "Temperature control equipment" refers to devices used to regulate indoor temperatures, such as air conditioners, thermostats, and heaters.

[1298] "Notification" refers to the means of information transmission that allows users to send information about their health and safety to a central server and, if necessary, communicate the analysis results to family members or registered contacts.

[1299] "Room temperature information" refers to data about the current temperature inside your home, which is important for keeping your home comfortable and safe.

[1300] "Monitoring" refers to constantly watching over a specific environment or situation using security sensors, etc.

[1301] An "anomaly" is an event or situation that is outside the normal or expected range, and when this occurs, a notification is sent to users and relevant parties.

[1302] This invention is a system in which users in remote locations use smart devices to input information about their health and safety, which is then sent to a central server. The central server receives and analyzes the input information, and sends notifications to registered contacts. The system also has the ability to obtain home room temperature information on the smart device and remotely control the home's temperature control equipment. Furthermore, this system also has the ability to monitor the home's security status and send immediate notifications if an abnormality occurs.

[1303] 1. System Configuration

[1304] Hardware Configuration

[1305] Smart devices: smartphones, tablets, smartwatches

[1306] Central server: High-performance cloud server (e.g., AWS, Google Cloud)

[1307] Security sensors and devices: door and window opening and closing sensors, motion detection sensors, smoke detectors, carbon monoxide detectors

[1308] Temperature control devices: air conditioners, thermostats

[1309] Software Configuration

[1310] Server application: Developed in Python with Django or Flask framework

[1311] Database: PostgreSQL

[1312] Real-time database and notification system: Firebase, MQTT protocol

[1313] Smart Device Applications: Swift for iOS, Kotlin for Android

[1314] 2. System Functions

[1315] Entering and notifying health and safety information

[1316] Users enter their health and safety information into a dedicated app on their smart device. The information is immediately sent to the Firebase real-time database and retrieved by a central server. The server analyzes the information and sends notifications to family members and registered contacts as needed. These notifications are sent in real time using Firebase Cloud Messaging (FCM).

[1317] Acquisition of room temperature information and remote operation

[1318] IoT temperature sensors installed in homes periodically measure the room temperature and transmit the data to a central server via the MQTT protocol. When users input their desired room temperature via their smart devices, that information is also sent to the central server. Based on this information, the central server issues instructions to the home's thermostat to adjust the temperature to the desired level.

[1319] Security status monitoring

[1320] Multiple security sensors and devices monitor the home for abnormalities, and if an abnormality is detected, it is immediately notified to a central server. The server collects the abnormality information and sends notifications to family members and registered contacts based on the analysis results. This allows users to understand the security status of their home in real time.

[1321] 3. Usage example

[1322] Usage example 1: Health check and notification

[1323] An 80-year-old woman types "I have a headache today" into an application on her smart device and presses the send button. The smart device sends this information to a central server, which analyzes the information and sends a notification to the woman's son. The son receives the notification on his smartphone and can immediately check on his mother's condition.

[1324] Example prompt sentence:

[1325] In an application where an 80-year-old woman enters information such as "I'm not feeling well" and sends a notification, please create a program that implements a system that links with the Firebase database and sends notifications to registered family members in real time.

[1326] Usage example 2: Room temperature adjustment

[1327] While on a business trip, a man in his 50s uses a smart device to check the current room temperature in his living room (e.g., 28°C) and inputs the setting to 24°C. The server receives this data and sends instructions to the thermostat in his home, adjusting the temperature in the living room to 24°C.

[1328] Example prompt sentence:

[1329] To design an IoT device integration application that remotely obtains temperature sensor data and allows the user to set the room temperature as desired, create a program to send and receive data using the MQTT protocol.

[1330] Use Case 3: Security Monitoring

[1331] While the user is away from home, the door sensor detects any unauthorized opening or closing and immediately sends a notification to a central server. The server analyzes this information and notifies family members or security companies of any abnormalities. Users can then check the real-time security status on their smart devices.

[1332] The above is a detailed description of a specific embodiment of the invention. This system allows users to comprehensively monitor and manage the health and safety of their family members, the home environment, and security from a remote location.

[1333] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1334] Step 1:

[1335] The user enters information about their health and safety using a smart device. The user opens the application, enters their health and safety information, and presses the send button. The input is saved in text format in the application.

[1336] Input: User's health and safety information

[1337] Output: Text data containing health and safety information

[1338] Action: Enter text on the smart device screen and press the send button.

[1339] Step 2:

[1340] The device sends the entered health and safety information to a central server, and the data entered in the application is sent to the Firebase real-time database.

[1341] Input: Text data of health and safety information

[1342] Output: Health and safety information stored in the database

[1343] How it works: Smart devices send data over the internet to Firebase.

[1344] Step 3:

[1345] The server retrieves health and safety information from the database and performs analysis. The server pulls data from the Firebase real-time database and performs analysis using a Python script.

[1346] Input: Health and safety information stored in the database

[1347] Output: Analysis result (e.g., "There is a serious health risk")

[1348] How it works: The server retrieves data via the API and performs analysis.

[1349] Step 4:

[1350] The server then sends notifications to registered contacts as needed based on the analysis results, and sends push notifications to family and friends via Firebase Cloud Messaging (FCM).

[1351] Input: Analysis results

[1352] Output: Notification message

[1353] Operation: The server calls the notification sending API and sends a push notification.

[1354] Step 5:

[1355] An IoT temperature sensor in your home measures the current room temperature and periodically sends the data to a central server. The temperature sensor sends the data using the MQTT protocol.

[1356] Input: Measured room temperature data

[1357] Output: Room temperature data sent to a central server

[1358] How it works: The temperature sensor sends data to the server using the MQTT protocol.

[1359] Step 6:

[1360] The server receives the room temperature data in real time and sends it to the user's smart device. The user opens the application and checks the current room temperature.

[1361] Input: Room temperature data

[1362] Output: Room temperature information displayed on a smart device

[1363] How it works: The server retrieves data and sends it to the smart device via API.

[1364] Step 7:

[1365] The user enters the desired room temperature into the application and sends it to the central server. The user enters the desired temperature on the application's "Set Temperature" screen and presses the send button.

[1366] Input: User's desired room temperature

[1367] Output: Desired room temperature data sent to the central server

[1368] Operation: A user enters a value on the application screen and presses a button to send the value to the server.

[1369] Step 8:

[1370] The server issues instructions to the home thermostat based on the desired room temperature data. The server assembles instructions for the desired thermostat and sends them using the MQTT protocol.

[1371] Input: Desired room temperature data

[1372] Output: Adjustment command sent to temperature control device

[1373] How it works: The server generates adjustment commands and sends them using the MQTT protocol.

[1374] Step 9:

[1375] The temperature control device adjusts the room temperature according to instructions from the server. Based on the received command, the temperature control device adjusts the room temperature to the desired value.

[1376] Input: Adjust command

[1377] Output: Room temperature regulated

[1378] How it works: The temperature control device adjusts the temperature as instructed.

[1379] Step 10:

[1380] If a security sensor detects an anomaly, it sends a notification to a central server. The sensor triggers an anomaly detection and sends the data to the server via MQTT protocol.

[1381] Input: Anomaly data detected by security sensors

[1382] Output: Anomaly notification sent to the central server

[1383] What it does: A security sensor detects an anomaly and transmits data.

[1384] Step 11:

[1385] The server receives the anomaly data and sends notifications to registered contacts based on the analysis results. The server sends push notifications in real time using Firebase Cloud Messaging.

[1386] Input: Abnormal data

[1387] Output: Error notification message

[1388] How it works: The server analyzes the anomaly data and sends a notification.

[1389] In this way, the system of the present invention receives a variety of input data and automatically processes and notifies based on that data, thereby realizing a system that is extremely convenient for users.

[1390] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1391] This invention is a system that incorporates a function that allows users in remote locations to input information about their health and safety using a smart device, and then analyzes the user's emotions using an emotion engine. This system transmits the input information and emotion information to a central server, which then sends notifications to registered contacts based on the information received and analyzed by the central server. It can also obtain information about the room temperature in the home on the smart device and remotely control the home's temperature control equipment.

[1392] System Embodiments

[1393] 1. Input of health and safety information and emotion analysis:

[1394] The user inputs information about their health and safety into the terminal: The user uses a smart device (e.g., a smartphone or tablet) to open a dedicated application and input information about their health and safety (e.g., "I have a headache today"). The user's facial expressions and voice are also captured through the smart device's camera and microphone.

[1395] Emotion engine analyzes user emotions: The emotion engine built into the smart device analyzes captured facial and voice data to identify the user's emotions (e.g., fatigue, sadness, joy).

[1396] 2. Information and emotional data transmission and notification:

[1397] The device sends information and emotional data to the server: When the user completes the input and presses the send button, the smart device sends information about their physical condition and safety, as well as the emotional data identified by the emotion engine, to the central server.

[1398] The server receives the information and emotion data, analyzes it, and sends notifications: The server stores the received data in a database and analyzes it. As a result, it adjusts and sends notifications to family members and registered contacts as needed. Notifications are sent via email, push notification, or SMS.

[1399] 3. Room temperature information acquisition and remote operation:

[1400] A home device measures the room temperature and sends it to a server: An IoT temperature sensor installed in the home periodically measures the current room temperature and sends the data to a central server via the home device.

[1401] The server receives the temperature data and sends it to the user's device: The server receives the temperature data and sends it to the user's smart device in real time, allowing the user to check the current room temperature using a dedicated application.

[1402] The user inputs the desired room temperature and sends it from the terminal to the server: The user inputs the desired room temperature (e.g., 24°C) using the application and sends it. This data is sent to the server.

[1403] The server sends instructions to the home device to adjust the temperature: Based on the desired room temperature data received, the server sends temperature control instructions to the home device. The home device follows these instructions and operates the temperature control device (e.g., thermostat or air conditioner) to adjust the temperature to the specified level.

[1404] Specific examples

[1405] Example 1: Specific example of health check and emotion analysis

[1406] The user enters their physical condition into the device: An 80-year-old woman enters "I have a headache today" into a smart device application and presses the send button. Facial expressions and voice are also captured via the camera and microphone.

[1407] Emotion engine analyzes emotions: The emotion engine built into the smart device analyzes the user's facial expressions and voice to detect "fatigue."

[1408] Terminal transmits information and emotional data: The smart device transmits physical condition information and emotional data indicating "fatigue" to a central server.

[1409] The server receives the information and sends a notification: The server receives the information and stores it in a database. It analyzes it and sends a message to the appropriate contact (for example, the woman's son) saying, "Notification from Mom: I have a headache today (emotion: fatigue)." The son receives this notification on his smartphone and can immediately check his mother's condition and consider what action is necessary.

[1410] Example 2: Room temperature control

[1411] A home device measures the temperature and sends it to the server: The IoT temperature sensor in your home measures the current room temperature and sends it to the central server.

[1412] The user inputs the desired room temperature and sends it from the device: A man in his 50s uses a smart device while on a business trip to check the current room temperature in the living room (for example, 28°C) and inputs that it should be set to 24°C.

[1413] The server receives the information and sends instructions to the home device: The server receives this data and sends instructions to the home device to set the temperature to 24°C.

[1414] Home devices adjust the temperature: Your home device controls the thermostat and air conditioner, adjusting the temperature in your living room to 24°C.

[1415] This system allows users to monitor the health and safety of their family members, even when they are in a remote location, and maintain a comfortable home environment. This invention is extremely useful for elderly people and those with family members who need health care.

[1416] The processing flow will be explained below.

[1417] Input of health and safety information, emotion analysis, and notifications

[1418] Processing Steps:

[1419] Step 1:

[1420] A user enters information about their health and safety into a smart device. For example, they open an application, type "I have a headache today," and press the send button. The smart device's camera and microphone capture the user's facial expressions and voice.

[1421] Step 2:

[1422] The device's on-board emotion engine analyzes the captured facial expression and voice data, for example, by using facial recognition technology and voice feature extraction to identify the user's emotions (e.g., fatigue, sadness, joy).

[1423] Step 3:

[1424] The device sends the entered health and safety information and analyzed emotion data to the central server via a POST request. For example, the request data is structured as follows: { "user_id": 123, "status": "I have a headache today", "emotion": "Fatigue"}.

[1425] Step 4:

[1426] The server receives the POST request and stores this information in a database, for example in the "users_status" and "users_emotions" tables.

[1427] Step 5:

[1428] The server analyzes the health and safety information and emotional data to determine whether a notification is necessary. Specifically, based on the content of "status" and "emotion," it determines that a notification is necessary if the importance is high.

[1429] Step 6:

[1430] The server creates the notification content and sends it to the registered contacts (for example, family members' email addresses or push notification device IDs). For example, an SMTP server is used for email, and FCM is used for push notifications. The notification content includes specific information such as "Notification from Mom: I have a headache today (emotion: fatigue)."

[1431] Step 7:

[1432] The notification arrives on the family member's device. The notification service on the device runs and displays the message "Notification from Mom: I have a headache today (emotion: fatigue)" to the family user.

[1433] Acquisition of room temperature information and remote operation

[1434] Processing Steps:

[1435] Step 1:

[1436] The device at home measures the current room temperature from a temperature sensor, which acquires temperature data every minute, for example.

[1437] Step 2:

[1438] The temperature data acquired by the home device is sent to the central server via a POST request. The request data is sent in the format of { "room_id": 1, "temperature": 28.5, "timestamp": "2023-10-01T12:00:00Z"}, for example.

[1439] Step 3:

[1440] The server receives the POST request and saves the temperature information in the database, in the "room_temperatures" table.

[1441] Step 4:

[1442] The user's device sends a GET request to the server for the current temperature information. The request is sent in the format " / api / temperature / latest?room_id=1", for example.

[1443] Step 5:

[1444] The server receives a GET request, retrieves the latest temperature data from the database, and returns the data in the response format: { "room_id": 1, "temperature": 28.5, "timestamp": "2023-10-01T12:00:00Z"}.

[1445] Step 6:

[1446] The user's device receives the response from the server and displays the current room temperature in the application. For example, "The current temperature in the living room is 28.5°C" is displayed in a visible area for the user.

[1447] Remote room temperature control

[1448] Processing Steps:

[1449] Step 1:

[1450] The user enters the desired room temperature (for example, 24°C) into the smart device application and presses the send button.

[1451] Step 2:

[1452] The device sends the desired room temperature data to the central server via a POST request. For example, the request data is sent in the format "{ "room_id": 1, "desired_temperature": 24}".

[1453] Step 3:

[1454] The server receives the POST request and saves the desired temperature information to the database in the "desired_temperatures" table.

[1455] Step 4:

[1456] The server sends temperature control instructions to the home device using MQTT or HTTP protocol. For example, the message format is "{ "command": "set_temperature", "value": 24}".

[1457] Step 5:

[1458] The home device receives the instruction and executes a command to the temperature control device (e.g., thermostat or air conditioner) to set the desired temperature (24°C).

[1459] Step 6:

[1460] The home thermostat will follow instructions and adjust the room temperature to 24°C. The temperature will be changed and maintained until the specified temperature is reached.

[1461] Example 2

[1462] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1463] Conventional systems lack the means for remote users to easily adjust the temperature in their homes or efficiently notify family members of their health and safety. Furthermore, they lack the ability to analyze a user's emotional state and notify appropriate contacts, which can delay response in emergencies or when special care is needed. This is particularly a serious problem for elderly people and those with fluctuating health conditions.

[1464] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1465] In this invention, the server includes a means for a user in a remote location to input information about their physical condition and safety using an information terminal, a means for an emotion analysis engine built into the information terminal to analyze the user's emotions, and a means for transmitting the input information and analyzed emotion data to the central server. This allows the physical and emotional states of family members to be monitored in real time and prompt responses to be taken as needed. Furthermore, by including a means for acquiring the home's room temperature information displayed on the information terminal and operating the home's temperature control device according to the user's instructions, comfortable room temperature control can be achieved even from a remote location.

[1466] "Remote location" refers to a state in which a user is located geographically away from home.

[1467] "Information terminal" refers to a smartphone, tablet, or other portable electronic device.

[1468] "Input means" refers to the method by which a user inputs information about his or her own health condition and safety through an information terminal.

[1469] An "emotion analysis engine" refers to software or hardware that analyzes a user's facial expressions and voice data to identify their emotional state.

[1470] "Central server" refers to a server system that has the function of storing and analyzing received data and sending notifications as necessary.

[1471] "Notification means" refers to the method by which the central server sends information to registered contacts based on the analysis results.

[1472] "Registered Contacts" means any person or entity designated by a User and authorized to receive emergency or special notices.

[1473] "Room temperature information" refers to temperature data measured by a detection sensor inside your home.

[1474] "Detection sensor" refers to a device installed in a home to measure room temperature.

[1475] "Temperature control devices" refers to devices such as air conditioners and thermostats used to regulate the temperature inside a home.

[1476] "Database" refers to a system for systematically storing and managing received information within a central server.

[1477] MODE FOR CARRYING OUT THE INVENTION

[1478] The present invention is a system in which a user in a remote location uses an information terminal to input information about their own physical condition and safety, and then analyzes the user's emotions using an emotion analysis engine. This system has the function of transmitting the information input by the user and analyzed emotion data to a central server, which then analyzes the received data and sends a notification to registered contacts. It is also possible to obtain information about the room temperature at home and operate the home's temperature control device from a remote location.

[1479] 1. Input of health and safety information and emotion analysis

[1480] A user opens a dedicated application on their smartphone or tablet and enters information about their physical condition and safety. For example, the user might enter "I have a headache today" and press the send button. At this time, the smart device's camera and microphone are used to capture the user's facial expressions and voice. The built-in emotion analysis engine analyzes the captured facial and voice data and identifies the user's emotions (e.g., fatigue, sadness, joy).

[1481] 2. Transmission and notification of information and emotional data

[1482] The device sends the user's input information along with the analyzed emotion data to a central server, which stores this data in a database and analyzes it using a data analysis module. Based on the results, it determines the necessary action to take and sends notifications to family members and registered contacts via email, push notification, or SMS.

[1483] 3. Acquisition of room temperature information and remote operation

[1484] An IoT temperature sensor installed in the home measures the current room temperature and sends that data to the home's gateway device. The gateway device sends this information to a central server, which then sends the received data to the user's information terminal. The user uses a dedicated application to check the current room temperature in real time and input their desired room temperature. The input desired room temperature data is sent to the server, which then uses this data to send instructions to the home's thermostat, adjusting the temperature to the specified level.

[1485] Specific examples

[1486] Example 1: Specific example of health check and emotion analysis

[1487] The user inputs their physical condition: An 80-year-old woman inputs "I have a headache today" into a smart device application and sends it. Her facial expressions and voice are also captured via the camera and microphone.

[1488] Emotion engine analyzes emotions: The emotion engine built into the smart device analyzes the user's facial expressions and voice to detect "fatigue."

[1489] Terminal transmits information and emotional data: The smart device transmits physical condition information and emotional data indicating "fatigue" to a central server.

[1490] Server receives information and sends notification: The server receives the information and stores it in a database. It analyzes it and automatically generates and sends an email to the necessary contact (for example, the son) saying, "Notification from Mom: I have a headache today (emotion: fatigue)." The son receives this notification on his smartphone, can check his mother's situation, and consider how to respond.

[1491] Example 2: Room temperature control

[1492] A home device measures the temperature and sends it to the server: The IoT temperature sensor measures the current room temperature and sends it to the central server.

[1493] The user inputs the desired room temperature and sends it from the device to the server: A man in his 50s uses a smart device while on a business trip to check the current room temperature in the living room (for example, 28°C), inputs the temperature to be set to 24°C, and sends it.

[1494] The server receives the information and sends instructions to the home device: The server receives this data and sends instructions to the home device to set the temperature to 24°C.

[1495] Home devices adjust the temperature: Your home device controls the thermostat and air conditioner, adjusting the temperature in your living room to 24°C.

[1496] Prompt Sentence Examples

[1497] "An 80-year-old woman enters her physical condition information into an application on her smart device, and the emotion data is analyzed by an emotion engine and sent to a server."

[1498] "Remotely control your home's temperature control device using room temperature data measured by an IoT temperature sensor."

[1499] This system allows users to monitor their family's health, safety, and emotions from a distance, and maintain a comfortable temperature in their home.

[1500] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1501] Step 1:

[1502] The user inputs information about their health and safety.

[1503] (Input) Use a smartphone or tablet to enter information about your physical condition and safety (e.g., "I have a headache today") into a dedicated application.

[1504] (Specific behavior) A user enters information into a text field within the application and presses the send button, while simultaneously capturing facial expressions and voice using the smart device's camera and microphone.

[1505] Step 2:

[1506] The sentiment analysis engine analyzes the user's sentiment.

[1507] (Input) Facial expression and voice data captured through the smart device's camera and microphone.

[1508] (Specific operation) The emotion analysis engine analyzes captured facial features, voice tone, and content, and uses machine learning models to identify emotions (e.g., fatigue, sadness, joy).

[1509] (Output) Identified emotion data.

[1510] Step 3:

[1511] The device transmits information and emotion data to the server.

[1512] (Input) User-entered health and safety information, and analyzed emotional data.

[1513] (Specific operation) The smart device packs this data into packets, encrypts them using the HTTPS protocol, and sends them to a central server.

[1514] (Output) Securely transmitted health and safety information and emotional data.

[1515] Step 4:

[1516] The server receives the information and emotion data, analyzes it, and sends a notification.

[1517] (Input) Health and safety information and emotional data sent from the device.

[1518] (Specific operation) The central server stores the received data in a database, and the data analysis module compares it with past data to check for abnormalities. Based on the analysis results, appropriate notifications are automatically generated to registered contacts as needed.

[1519] (Output) An email, push notification, or SMS containing the notification content.

[1520] Step 5:

[1521] The device at home measures the room temperature and sends the value to the server.

[1522] (Input) Room temperature data from an IoT temperature sensor installed in the home.

[1523] (Specific operation) The temperature sensor measures the current room temperature every 5 minutes and sends the data to the home gateway device via Bluetooth, which then sends the data to the central server via Wi-Fi.

[1524] (Output) Room temperature data sent to the central server.

[1525] Step 6:

[1526] The server receives the temperature data and transmits it to the user's terminal.

[1527] (Input) Room temperature data sent from the home gateway device.

[1528] (Specific operation) The central server stores the received temperature data in a database and, upon request from the user, sends the latest room temperature data to a dedicated application via push notification.

[1529] (Output) Real-time room temperature data displayed on the user's smart device.

[1530] Step 7:

[1531] The user inputs the desired room temperature and sends it from the terminal to the server.

[1532] (Input) Enter the desired room temperature (e.g., 24°C) into the dedicated application on your smart device.

[1533] (Specific operation) The user opens the application, checks the current room temperature, enters the desired temperature, and presses the send button.

[1534] (Output) Desired temperature data sent to the central server.

[1535] Step 8:

[1536] The server sends instructions to a device at home to adjust the temperature.

[1537] (Input) Desired temperature data sent by the user.

[1538] (Specific operation) The server analyzes the desired room temperature data and sends instructions to the home's temperature control devices (e.g., air conditioner, thermostat).

[1539] (Output) The thermostat in your home will receive the instruction and adjust to the specified temperature.

[1540] In this way, through the specific processing steps, users can remotely manage their health and safety information and adjust the temperature in their homes.

[1541] (Application example 2)

[1542] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1543] The present invention relates to a system that allows a remote user to input information about their health and safety using a smart device, and then analyzes their emotions using an emotion engine. Conventional systems only allow users to input information about their health and safety, without analyzing the underlying emotions. This makes it difficult to respond quickly when an emergency truly requires it. While the system can also provide information about room temperature control, this is limited. The present invention aims to enable a more prompt and appropriate response by comprehensively analyzing a series of information and notifying family members and related parties.

[1544] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for a remote user to input health and safety information using a smart device, a means for transmitting the input information to a central server, and a means for the central server to analyze the received information and notify registered contacts. This enables the user's health and emotions to be grasped in real time, even when the user is in a remote location, and appropriate responses can be taken. Furthermore, the means for analyzing the user's facial expressions and voice using an emotion engine to identify emotions, a means for acquiring home room temperature information displayed on the smart device, a means for operating home temperature control devices in accordance with instructions from the smart device, and a means for the central server to adjust notification content based on the analyzed emotion information enable the central server to adjust notification content according to the user's emotional state. As a result, family members and other related parties can know the user's true condition and quickly take appropriate measures based on that information.

[1545] "User" refers to a person who uses a smart device to input information about their health and safety and is the subject of emotion analysis.

[1546] A "smart device" is an electronic device that allows users to input information about their health and safety and performs emotion analysis using an emotion engine, and includes smartphones and tablets.

[1547] "Emotion engine" refers to software or hardware for analyzing a user's facial expressions and voice and identifying the user's emotions.

[1548] An "expression" is a facial expression of a user, which is captured using the camera of the smart device.

[1549] "Audio" refers to the vocal signal emitted by the user and captured using the microphone of the smart device.

[1550] The "central server" is a computer system that receives and analyzes health and safety information and emotional data sent from smart devices, adjusts the content of notifications, and sends them to contacts.

[1551] "Registered contacts" refers to people who have contact information for family members and related parties who are pre-set to be notified of the user's health condition and safety information.

[1552] "Notifications" are communications sent to registered contacts based on information analyzed by the central server.

[1553] "Room temperature information" refers to the current room temperature data measured by a temperature sensor installed in your home and displayed on your smart device.

[1554] "Temperature control devices" are devices used to adjust the temperature inside a home, including thermostats and air conditioners.

[1555] The system for implementing this invention allows a user in a remote location to input information about their physical condition and safety using a smart device, and then analyzes the user's emotions using an emotion engine to send appropriate notifications to family members and related parties. The user can also remotely control their home temperature control device.

[1556] System Configuration

[1557] The system consists of the following main components:

[1558] 1. Smart Devices

[1559] Hardware: Smartphones, tablets

[1560] Software: Data entry application, sentiment analysis engine

[1561] 2. Central Server

[1562] Hardware: Cloud servers or data centers

[1563] Software: Data analysis module, notification function

[1564] 3. Home sensors and devices

[1565] Temperature sensors, thermostats, air conditioners

[1566] Specific Embodiments

[1567] 1. Input of health and safety information and emotion analysis

[1568] The user enters health and safety information into the device:

[1569] Users use their smart device to open a dedicated application and enter information about their health and safety.

[1570] Example: An 80-year-old woman types "I have a headache today" into the application and presses the send button. Her facial expressions and voice are also captured via the camera and microphone.

[1571] Emotion engine analyzes emotions:

[1572] An emotion engine built into the smart device analyzes captured facial and voice data to identify the user's emotions.

[1573] Example: An emotion engine analyzes facial expressions and voice to detect "fatigue."

[1574] 2. Transmission and notification of information and emotional data

[1575] The device sends information and emotion data to the server:

[1576] When the user completes the input and presses the send button, the smart device sends information about their physical condition, safety, and emotional data to a central server.

[1577] The server receives the information and emotion data, analyzes it, and sends a notification:

[1578] The server stores the received data in a database, analyzes it, and then adjusts and sends notifications to family members and other relevant parties as needed. Notifications can be sent via email, push notification, or SMS.

[1579] Example: The server receives the information and sends the message to the woman's son, "Notification from Mom: I have a headache today (emotion: fatigue)." The son receives this notification on his smartphone, can immediately check his mother's situation, and consider what action is necessary.

[1580] 3. Acquisition of room temperature information and remote operation

[1581] The device at home measures the room temperature and sends it to the server:

[1582] IoT temperature sensors installed in the home measure the current room temperature and send it to a central server.

[1583] Example: A temperature sensor measures 28°C and sends it to the server.

[1584] The server receives the temperature data and sends it to the user's device:

[1585] The server receives the temperature data and sends it to the user's smart device in real time, allowing the user to check the current room temperature using a dedicated application.

[1586] The user inputs the desired room temperature and sends it from the terminal to the server:

[1587] The user inputs the desired room temperature (e.g., 24°C) using the application and submits it. This data is sent to the server.

[1588] Example: A man in his 50s uses a smart device while on a business trip to check the current room temperature in the living room (for example, 28°C) and inputs the setting to 24°C.

[1589] The server sends instructions to the home device to adjust the temperature:

[1590] The server then sends temperature control instructions to the home device based on the desired room temperature data it receives. The home device then operates the temperature control devices (thermostat and air conditioner) according to these instructions and adjusts the temperature to the specified level.

[1591] Prompt Sentence Examples

[1592] The mother would enter her physical condition into a smartphone app, which would then analyze her emotions using a camera and microphone, and the analysis results would be sent to a server. The server would then develop an application that would send notifications to registered contacts based on the analysis results.

[1593] As described above, by incorporating an emotion analysis engine, the present invention accurately grasps the specific state of the user and provides important information for appropriate response. Furthermore, environmental information such as room temperature can be managed remotely, improving the quality of life of the user.

[1594] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1595] Step 1:

[1596] The user launches a dedicated application on their smart device and inputs information about their health and safety. The input data includes text information such as "I have a headache today." The input health and safety information is temporarily saved within the application.

[1597] input:

[1598] User's health and safety information (text format)

[1599] output:

[1600] Temporarily saved health and safety information

[1601] Specific operation:

[1602] The user opens the application on their smart device, types "I have a headache today," and presses the send button.

[1603] Step 2:

[1604] The smart device uses a camera and microphone to capture the user's facial expressions and voice, which then become input data for analysis by the emotion engine.

[1605] input:

[1606] Camera capture (facial image), microphone capture (audio data)

[1607] output:

[1608] Captured facial and voice data

[1609] Specific operation:

[1610] The smart device activates the camera, takes a picture of the user's face, and records audio with the microphone.

[1611] Step 3:

[1612] An emotion engine built into the smart device analyzes the captured facial and voice data to identify the user's emotions, including feelings such as "fatigue" and "sadness."

[1613] input:

[1614] Facial expression image data, voice data

[1615] output:

[1616] Identified emotion data (e.g., "fatigue")

[1617] Specific operation:

[1618] The emotion engine inputs facial expression images and performs image analysis to identify the emotion "fatigue." It then analyzes the voice data and similarly identifies the emotion "fatigue."

[1619] Step 4:

[1620] The smart device sends the entered health and safety information and analyzed emotion data to a central server, which requires an internet connection.

[1621] input:

[1622] Temporarily stored health and safety information, analyzed emotional data

[1623] output:

[1624] Data sent from smart devices to a central server

[1625] Specific operation:

[1626] When the data transmission button is pressed from the smart device to the server, health and safety information and emotional data are sent to the central server.

[1627] Step 5:

[1628] The central server analyzes the received health and safety information and emotional data, adjusts the notification content as necessary, and notifies registered contacts.

[1629] input:

[1630] Health and safety information and emotional data sent to a central server

[1631] output:

[1632] Notification content (e.g., "Notification from Mom: I have a headache today (emotion: fatigue)")

[1633] Specific operation:

[1634] The server generates notification content based on the received data and sends it to registered contacts via email, SMS, or other means.

[1635] Step 6:

[1636] Temperature sensors in your home measure the current room temperature and send that data to a central server, which updates the measurements periodically.

[1637] input:

[1638] Room temperature sensor data

[1639] output:

[1640] Room temperature data sent to a central server

[1641] Specific operation:

[1642] The temperature sensor measures the current room temperature and transmits the data to a server over the internet.

[1643] Step 7:

[1644] The central server receives room temperature data and sends it to a smart device, allowing users to check the room temperature remotely using a dedicated application.

[1645] input:

[1646] Room temperature data sent to a central server

[1647] output:

[1648] Room temperature information displayed on a smart device

[1649] Specific operation:

[1650] The app on the smart device receives room temperature data from the server and displays the current room temperature.

[1651] Step 8:

[1652] The user inputs the desired room temperature into the smart device application and the data is sent to the central server. The desired room temperature information becomes the input data.

[1653] input:

[1654] Desired room temperature entered by the user (e.g. 24°C)

[1655] output:

[1656] Desired room temperature data is sent to a central server

[1657] Specific operation:

[1658] The user sets the desired room temperature in the application and presses the send button.

[1659] Step 9:

[1660] Based on the desired room temperature data received by the central server, it sends temperature adjustment instructions to a device at home, and operates the thermostat or air conditioner to adjust to the specified temperature.

[1661] input:

[1662] Desired room temperature data

[1663] output:

[1664] Instructions sent to temperature control equipment

[1665] Specific operation:

[1666] Based on the desired room temperature received by the server, it sends an instruction to set the home thermostat to 24°C, and the air conditioner operates to adjust the room temperature.

[1667] This series of steps will create a system that allows users to comprehensively manage their physical condition, emotions, home temperature, and other aspects of their lives, even from a remote location.

[1668] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1669] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1670] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1671] [Fourth embodiment]

[1672] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1673] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1674] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1675] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1676] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1677] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1678] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1679] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1680] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1681] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1682] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1683] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1684] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1685] The present invention provides a system that allows users in remote locations to input information about their health and safety using a smart device and send it to a central server. The central server receives and analyzes the input information and sends notifications to registered contacts. Furthermore, the smart device can obtain information about the home's room temperature and remotely control the home's temperature control equipment.

[1686] System Embodiments

[1687] 1. Entering and notifying health and safety information:

[1688] The user inputs information about their health and safety into the device: The user uses a smart device (e.g., a smartphone or tablet) and opens a dedicated application, where they input information about their health and safety (e.g., "I have a headache today").

[1689] The device sends the information to the server: When the user completes the input and presses the send button, the smart device sends this information to the central server.

[1690] The server receives and analyzes the information and sends notifications: The server stores the received information in a database, analyzes it, and then sends notifications to family members and registered contacts as needed. Notifications can be sent via email, push notification, or SMS.

[1691] 2. Room temperature information acquisition and remote operation:

[1692] The home device measures the room temperature and sends it to the server: The IoT temperature sensor installed in the home periodically measures the current room temperature, and the measured data is sent to the central server via the home device.

[1693] The server receives the temperature data and sends it to the user's device: The server receives the temperature data and sends it to the user's smart device in real time. The user can check the current room temperature using a dedicated application on their smart device.

[1694] The user inputs the desired room temperature and sends it from the device to the server: The user inputs the desired room temperature using the application and sends it. This data is sent to the server.

[1695] The server sends instructions to the home device to adjust the temperature: Based on the desired room temperature data received, the server sends temperature control instructions to the home device. The home device follows these instructions and operates the temperature control device (e.g., thermostat or air conditioner) to adjust the temperature to the specified level.

[1696] Specific examples

[1697] Example 1: Specific example of health check

[1698] A user enters their physical condition into a device: An 80-year-old woman enters "I have a headache today" into a smart device application and presses the send button.

[1699] Device sends information to server: Smart devices send this information to a central server.

[1700] The server receives the information and sends a notification: The server receives this information and stores it in a database. The server analyzes it and sends a notification to the necessary contacts (for example, the woman's son). The son receives this notification on his smartphone and can immediately check on his mother's status.

[1701] Example 2: Room temperature control

[1702] A home device measures the temperature and sends it to the server: The IoT temperature sensor in your home measures the current room temperature and sends it to the server.

[1703] The user inputs the desired room temperature and sends it from the device: A man in his 50s is on a business trip and uses his smart device to check the current room temperature in the living room (for example, 28°C) and inputs that it should be set to 24°C.

[1704] The server receives the information and sends instructions to the home device: The server receives this data and sends instructions to the home device to set the temperature to 24°C.

[1705] Home devices adjust the temperature: Your home device controls the thermostat and air conditioner, adjusting the temperature in your living room to 24°C.

[1706] This system allows users to remotely manage the health and safety of their family members and maintain a comfortable home environment, which is extremely useful for elderly people and those with family members who need health care.

[1707] The processing flow will be explained below.

[1708] Input and notification of health and safety information

[1709] Processing Steps:

[1710] Step 1:

[1711] A user enters information about their health and safety into a smart device. For example, they open an application, enter "I have a headache today," and press the send button.

[1712] Step 2:

[1713] The device sends the entered health and safety information to the central server via a POST request. The request data is in JSON format and is structured as follows: { "user_id": 123, "status": "I have a headache today"}.

[1714] Step 3:

[1715] The server receives the POST request and stores this information in a database, for example in a "users_status" table.

[1716] Step 4:

[1717] The server analyzes the information stored in the database and determines whether a notification is necessary. Specifically, it determines that a notification is necessary if the importance is high based on the content of "status."

[1718] Step 5:

[1719] The server creates the notification content and sends it to the registered contacts (such as family members' email addresses or push notification device IDs). For example, an SMTP server is used for email, and FCM is used for push notifications.

[1720] Step 6:

[1721] The notification arrives on the family member's device. The notification service on the device runs and displays the message "Notification from Mom: I have a headache today" to the user.

[1722] Acquisition of room temperature information and remote operation

[1723] Processing Steps:

[1724] Step 1:

[1725] The device at home measures the current room temperature from a temperature sensor, which acquires temperature data every minute, for example.

[1726] Step 2:

[1727] The temperature data acquired by the home device is sent to the central server via a POST request in the format "{ "room_id": 1, "temperature": 28.5, "timestamp": "2023-10-01T12:00:00Z"}".

[1728] Step 3:

[1729] The server receives the POST request and saves the temperature information in the database, in the "room_temperatures" table.

[1730] Step 4:

[1731] The user's device sends a GET request to the server for the current temperature information. The request is sent in the format " / api / temperature / latest?room_id=1", for example.

[1732] Step 5:

[1733] The server receives a GET request, retrieves the latest temperature data from the database, and returns the data in the response format: { "room_id": 1, "temperature": 28.5, "timestamp": "2023-10-01T12:00:00Z"}.

[1734] Step 6:

[1735] The user's device receives the response from the server and displays the current room temperature in the application. For example, "The current temperature in the living room is 28.5°C" is displayed in a visible area for the user.

[1736] Remote room temperature control

[1737] Processing Steps:

[1738] Step 1:

[1739] The user enters the desired room temperature (for example, 24°C) into the smart device application and presses the send button.

[1740] Step 2:

[1741] The device sends the desired room temperature data to the central server via a POST request in the format "{ "room_id": 1, "desired_temperature": 24}".

[1742] Step 3:

[1743] The server receives the POST request and saves the desired temperature information to the database in the "desired_temperatures" table.

[1744] Step 4:

[1745] The server sends temperature adjustment instructions to the home device using the MQTT or HTTP protocol. The instructions are sent in the format "{ "command": "set_temperature", "value": 24}".

[1746] Step 5:

[1747] The home device receives the instruction and executes a command to the temperature control device (e.g., thermostat or air conditioner) to set the desired temperature (24°C).

[1748] Step 6:

[1749] The home thermostat will follow instructions and adjust the room temperature to 24°C. The temperature will be changed and maintained until the specified temperature is reached.

[1750] Example 1

[1751] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1752] In today's world, people with elderly family members or those who require health management need to monitor their family members' health and safety, as well as their home environment, even from remote locations. However, current systems make it difficult to efficiently input information, provide notifications, and adjust temperatures, and there are particular challenges in real-time information transmission and environmental adjustment. Furthermore, there is a lack of a way for users to remotely set their desired room temperature and have it reflected in a timely manner, making it difficult to fully meet the needs of users in remote locations.

[1753] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1754] In this invention, the server includes a means for transmitting health and safety information to a central server, a means for the central server to analyze the received information and notify registered contacts, and a means for storing the input information in a database and sending notifications based on the analysis results. This allows users to quickly send and receive information about their health and safety, even if they are in a remote location, and to provide necessary notifications in real time.

[1755] In addition, the server includes a means for transmitting room temperature information to the central server, a means for inputting and transmitting a desired room temperature, and a means for transmitting instructions to the temperature control device, so that the user can check the room temperature in their home even from a remote location and adjust the temperature appropriately. In this way, the present invention provides a system that allows the user to appropriately manage the health and safety of their family members even when they are in a remote location, and maintain a comfortable home environment.

[1756] "Physical condition and safety information" is information indicating the user's own health condition and safety status.

[1757] "Smart device" refers to a digital device that is internet-enabled and allows users to input and transmit information.

[1758] "Central Server" means a computer system that receives, stores, analyzes entered information, and sends notifications as needed.

[1759] "Notification destination" refers to a contact point registered to receive important information such as the user's health and safety.

[1760] "Room temperature information" is data relating to the temperature inside the home, and is information that the user can check.

[1761] "Thermostat" refers to a device for regulating the temperature in a home based on a set temperature.

[1762] A "database" is a system for organizing and storing received information.

[1763] "Analysis" refers to the process of processing received information according to specific criteria or algorithms to derive a result.

[1764] "Real-time transmission" refers to information being transmitted nearly simultaneously, meaning that delays are minimized.

[1765] An "instruction" refers to a command to perform a specific action or operation.

[1766] Entering and notifying health and safety information

[1767] This system allows users in remote locations to use their smart devices to input information about their health and safety, which is then sent to a central server. Smart devices are smartphones or tablets, and a dedicated application is installed on them. Users launch the application and input their health and safety information. For example, they might say, "I have a headache today." Once they have finished entering information, they press the send button.

[1768] The terminal (smart device) sends this information to a central server using an HTTPS request, which then stores the received information in a database (e.g., MySQL). The stored information includes the user ID, timestamp, and input content.

[1769] The server analyzes the received information based on a pre-defined algorithm and sends notifications to the appropriate contacts based on the results. These notifications can be sent via email, push notification, or SMS. For example, SMS can be sent using the Python SMPP library. The notified contacts can receive the notification on their smart devices and view its contents.

[1770] For example, an 80-year-old female user can type, "I have a headache today," and her son can receive a notification and check on his mother's condition.

[1771] Acquisition of room temperature information and remote operation

[1772] This system can also remotely obtain information about the room temperature in the home and operate the thermostat. An IoT temperature sensor (e.g., DHT22 sensor) is installed in the home and periodically measures the current room temperature. The measured data is sent to a central server by a home device (e.g., Raspberry Pi) using an HTTPS request.

[1773] The server then sends the received temperature data to the user's smart device in real time, for example by sending a push notification using Firebase Cloud Messaging. The user can then check the current room temperature using a dedicated application.

[1774] When a user wants to set a desired room temperature, they input and send the desired room temperature (for example, 24°C) using a dedicated application. The device then sends this desired temperature data to a central server. The server receives the desired temperature data and sends instructions to adjust the temperature to the device at home. The device at home then operates the thermostat or air conditioner based on these instructions, adjusting the room temperature to the specified level. For example, an infrared remote control signal for an air conditioner could be sent from a Raspberry Pi.

[1775] As a specific example, a man in his 50s on a business trip can check the current room temperature (for example, 28°C) and input and set the desired room temperature (24°C), thereby adjusting the temperature of his living room at home to a comfortable level.

[1776] Examples of prompt statements

[1777] "You have devised a system that allows an 80-year-old mother to use a smart device to input information about her poor health and notify her family of that information. Please generate a description of this system using the user, device, and server as subjects. As a concrete example, please include a scene where the mother inputs, 'I have a headache today,' and her son receives a notification."

[1778] In this way, this system allows users in remote locations to quickly send and receive information about their family's health and safety, provide necessary notifications in real time, and easily adjust the temperature environment in their home. This system is also very useful for households with elderly family members or those who need health care.

[1779] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1780] Entering and notifying health and safety information

[1781] Step 1:

[1782] The user launches a dedicated application on their smart device and inputs information about their health and safety. Specifically, they enter information such as "I have a headache today" into a text box and press the send button.

[1783] Input: Health and safety information entered by the user

[1784] Output: Information temporarily stored in the smart device application

[1785] Step 2:

[1786] The terminal (smart device) sends the input information to the central server using an HTTPS request, including the user ID, timestamp, and input content.

[1787] Input: User-entered health and safety information, user ID, timestamp

[1788] Output: Information sent to the central server

[1789] Step 3:

[1790] The server stores the received information in a database (e.g. MySQL). The stored information includes the user ID, timestamp, and input content. Before storing, the data is formatted and checked for errors.

[1791] Input: Information sent to a central server

[1792] Output: Information stored in the database

[1793] Step 4:

[1794] The server analyzes the information stored in the database, using pre-defined rules and algorithms.

[1795] Input: Information stored in a database

[1796] Output: Analysis results (list of people to be notified)

[1797] Step 5:

[1798] The server then sends notifications to registered contacts based on the analysis results. These notifications can be sent via email, push notification, or SMS. For example, SMS can be sent using the Python SMPP library.

[1799] Input: Analysis results (list of people to be notified)

[1800] Output: Notifications sent to notified contacts

[1801] Step 6:

[1802] The contact receives the notification on their smart device and checks the details. For example, a family member who receives the notification can check the details on their smartphone.

[1803] Input: Notification sent from the server

[1804] Output: Notification content displayed to the notified contact

[1805] Acquisition of room temperature information and remote operation

[1806] Step 1:

[1807] An IoT temperature sensor (e.g., DHT22 sensor) installed in your home periodically (e.g., every 15 minutes) measures the current room temperature.

[1808] Input: Current room temperature

[1809] Output: Measured temperature data

[1810] Step 2:

[1811] A home device (e.g., Raspberry Pi) sends temperature data obtained from an IoT temperature sensor to a central server using an HTTPS request.

[1812] Input: Measured temperature data

[1813] Output: Temperature data sent to a central server

[1814] Step 3:

[1815] The server stores the received temperature data in a database and sends it to the user's smart device in real time using Firebase Cloud Messaging.

[1816] Input: Temperature data sent to a central server

[1817] Output: Temperature data sent to the user's smart device

[1818] Step 4:

[1819] The user checks the current room temperature using a dedicated application on the smart device and inputs the desired room temperature (for example, 24°C).

[1820] Input: Current room temperature, desired room temperature

[1821] Output: Desired room temperature data temporarily saved in the smart device

[1822] Step 5:

[1823] When the user presses the send button, the smart device sends the desired room temperature data to the central server.

[1824] Input: Desired room temperature data

[1825] Output: Desired room temperature data sent to the central server

[1826] Step 6:

[1827] The server receives the desired room temperature data and sends it to the home device using the MQTT protocol.

[1828] Input: Desired room temperature data sent to the central server

[1829] Output: Temperature control instructions sent to the home device

[1830] Step 7:

[1831] Based on the instructions received by the home device, the thermostat or air conditioner is operated to adjust the room temperature to the specified level. For example, the Raspberry Pi sends an infrared remote control signal to the air conditioner.

[1832] Input: Temperature control instructions sent to your home device

[1833] Output: Room temperature regulated

[1834] (Application example 1)

[1835] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1836] Today's families are often geographically dispersed, making it difficult to regularly check on the health and safety of elderly or vulnerable family members. Furthermore, there are limited means to efficiently monitor and manage home security and environmental controls (such as room temperature control) from a remote location. This creates a need for a comprehensive system to maintain a safe and comfortable living environment for families.

[1837] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1838] In this invention, the server includes a means for a user in a remote location to input health and safety information using a smart device, a means for transmitting the input information to a central server, a means for the central server to analyze the received information and notify registered contacts, a means for acquiring home room temperature information and operating home temperature control devices according to instructions from the smart device, a means for linking with a security sensor to monitor the home security status, and a means for immediately sending a notification if an abnormality occurs. This makes it possible to comprehensively monitor and manage the health and safety of users, the home environment, and the security status even from a remote location.

[1839] "Remote users" refers to people who are geographically distant from the home or facility where the service is provided.

[1840] "Smart devices" refers to portable electronic devices that can connect to the Internet, such as smartphones, tablets, and smartwatches.

[1841] "Health and safety information" refers to information about the user's health condition and current situation, such as "I have a headache" or "I'm safe."

[1842] "Central Server" means a central control device or system for receiving, analyzing, storing User-entered information, and sending notifications as necessary.

[1843] "Security sensors" refer to various sensors used to monitor security within the home, such as door and window opening / closing sensors, motion detection sensors, smoke detectors, and carbon monoxide detectors.

[1844] "Temperature control equipment" refers to devices used to regulate indoor temperatures, such as air conditioners, thermostats, and heaters.

[1845] "Notification" refers to the means of information transmission that allows users to send information about their health and safety to a central server and, if necessary, communicate the analysis results to family members or registered contacts.

[1846] "Room temperature information" refers to data about the current temperature inside your home, which is important for keeping your home comfortable and safe.

[1847] "Monitoring" refers to constantly watching over a specific environment or situation using security sensors, etc.

[1848] An "anomaly" is an event or situation that is outside the normal or expected range, and when this occurs, a notification is sent to users and relevant parties.

[1849] This invention is a system in which users in remote locations use smart devices to input information about their health and safety, which is then sent to a central server. The central server receives and analyzes the input information, and sends notifications to registered contacts. The system also has the ability to obtain home room temperature information on the smart device and remotely control the home's temperature control equipment. Furthermore, this system also has the ability to monitor the home's security status and send immediate notifications if an abnormality occurs.

[1850] 1. System Configuration

[1851] Hardware Configuration

[1852] Smart devices: smartphones, tablets, smartwatches

[1853] Central server: High-performance cloud server (e.g., AWS, Google Cloud)

[1854] Security sensors and devices: door and window opening and closing sensors, motion detection sensors, smoke detectors, carbon monoxide detectors

[1855] Temperature control devices: air conditioners, thermostats

[1856] Software Configuration

[1857] Server application: Developed in Python with Django or Flask framework

[1858] Database: PostgreSQL

[1859] Real-time database and notification system: Firebase, MQTT protocol

[1860] Smart Device Applications: Swift for iOS, Kotlin for Android

[1861] 2. System Functions

[1862] Entering and notifying health and safety information

[1863] Users enter their health and safety information into a dedicated app on their smart device. The information is immediately sent to the Firebase real-time database and retrieved by a central server. The server analyzes the information and sends notifications to family members and registered contacts as needed. These notifications are sent in real time using Firebase Cloud Messaging (FCM).

[1864] Acquisition of room temperature information and remote operation

[1865] IoT temperature sensors installed in homes periodically measure the room temperature and transmit the data to a central server via the MQTT protocol. When users input their desired room temperature via their smart devices, that information is also sent to the central server. Based on this information, the central server issues instructions to the home's thermostat to adjust the temperature to the desired level.

[1866] Security status monitoring

[1867] Multiple security sensors and devices monitor the home for abnormalities, and if an abnormality is detected, it is immediately notified to a central server. The server collects the abnormality information and sends notifications to family members and registered contacts based on the analysis results. This allows users to understand the security status of their home in real time.

[1868] 3. Usage example

[1869] Usage example 1: Health check and notification

[1870] An 80-year-old woman types "I have a headache today" into an application on her smart device and presses the send button. The smart device sends this information to a central server, which analyzes the information and sends a notification to the woman's son. The son receives the notification on his smartphone and can immediately check on his mother's condition.

[1871] Example prompt sentence:

[1872] In an application where an 80-year-old woman enters information such as "I'm not feeling well" and sends a notification, please create a program that implements a system that links with the Firebase database and sends notifications to registered family members in real time.

[1873] Usage example 2: Room temperature adjustment

[1874] While on a business trip, a man in his 50s uses a smart device to check the current room temperature in his living room (e.g., 28°C) and inputs the setting to 24°C. The server receives this data and sends instructions to the thermostat in his home, adjusting the temperature in the living room to 24°C.

[1875] Example prompt sentence:

[1876] To design an IoT device integration application that remotely obtains temperature sensor data and allows the user to set the room temperature as desired, create a program to send and receive data using the MQTT protocol.

[1877] Use Case 3: Security Monitoring

[1878] While the user is away from home, the door sensor detects any unauthorized opening or closing and immediately sends a notification to a central server. The server analyzes this information and notifies family members or security companies of any abnormalities. Users can then check the real-time security status on their smart devices.

[1879] The above is a detailed description of a specific embodiment of the invention. This system allows users to comprehensively monitor and manage the health and safety of their family members, the home environment, and security from a remote location.

[1880] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1881] Step 1:

[1882] The user enters information about their health and safety using a smart device. The user opens the application, enters their health and safety information, and presses the send button. The input is saved in text format in the application.

[1883] Input: User's health and safety information

[1884] Output: Text data containing health and safety information

[1885] Action: Enter text on the smart device screen and press the send button.

[1886] Step 2:

[1887] The device sends the entered health and safety information to a central server, and the data entered in the application is sent to the Firebase real-time database.

[1888] Input: Text data of health and safety information

[1889] Output: Health and safety information stored in the database

[1890] How it works: Smart devices send data over the internet to Firebase.

[1891] Step 3:

[1892] The server retrieves health and safety information from the database and performs analysis. The server pulls data from the Firebase real-time database and performs analysis using a Python script.

[1893] Input: Health and safety information stored in the database

[1894] Output: Analysis result (e.g., "There is a serious health risk")

[1895] How it works: The server retrieves data via the API and performs analysis.

[1896] Step 4:

[1897] The server then sends notifications to registered contacts as needed based on the analysis results, and sends push notifications to family and friends via Firebase Cloud Messaging (FCM).

[1898] Input: Analysis results

[1899] Output: Notification message

[1900] Operation: The server calls the notification sending API and sends a push notification.

[1901] Step 5:

[1902] An IoT temperature sensor in your home measures the current room temperature and periodically sends the data to a central server. The temperature sensor sends the data using the MQTT protocol.

[1903] Input: Measured room temperature data

[1904] Output: Room temperature data sent to a central server

[1905] How it works: The temperature sensor sends data to the server using the MQTT protocol.

[1906] Step 6:

[1907] The server receives the room temperature data in real time and sends it to the user's smart device. The user opens the application and checks the current room temperature.

[1908] Input: Room temperature data

[1909] Output: Room temperature information displayed on a smart device

[1910] How it works: The server retrieves data and sends it to the smart device via API.

[1911] Step 7:

[1912] The user enters the desired room temperature into the application and sends it to the central server. The user enters the desired temperature on the application's "Set Temperature" screen and presses the send button.

[1913] Input: User's desired room temperature

[1914] Output: Desired room temperature data sent to the central server

[1915] Operation: A user enters a value on the application screen and presses a button to send the value to the server.

[1916] Step 8:

[1917] The server issues instructions to the home thermostat based on the desired room temperature data. The server assembles instructions for the desired thermostat and sends them using the MQTT protocol.

[1918] Input: Desired room temperature data

[1919] Output: Adjustment command sent to temperature control device

[1920] How it works: The server generates adjustment commands and sends them using the MQTT protocol.

[1921] Step 9:

[1922] The temperature control device adjusts the room temperature according to instructions from the server. Based on the received command, the temperature control device adjusts the room temperature to the desired value.

[1923] Input: Adjust command

[1924] Output: Room temperature regulated

[1925] How it works: The temperature control device adjusts the temperature as instructed.

[1926] Step 10:

[1927] If a security sensor detects an anomaly, it sends a notification to a central server. The sensor triggers an anomaly detection and sends the data to the server via MQTT protocol.

[1928] Input: Anomaly data detected by security sensors

[1929] Output: Anomaly notification sent to the central server

[1930] What it does: A security sensor detects an anomaly and transmits data.

[1931] Step 11:

[1932] The server receives the anomaly data and sends notifications to registered contacts based on the analysis results. The server sends push notifications in real time using Firebase Cloud Messaging.

[1933] Input: Abnormal data

[1934] Output: Error notification message

[1935] How it works: The server analyzes the anomaly data and sends a notification.

[1936] In this way, the system of the present invention receives a variety of input data and automatically processes and notifies based on that data, thereby realizing a system that is extremely convenient for users.

[1937] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1938] This invention is a system that incorporates a function that allows users in remote locations to input information about their health and safety using a smart device, and then analyzes the user's emotions using an emotion engine. This system transmits the input information and emotion information to a central server, which then sends notifications to registered contacts based on the information received and analyzed by the central server. It can also obtain information about the room temperature in the home on the smart device and remotely control the home's temperature control equipment.

[1939] System Embodiments

[1940] 1. Input of health and safety information and emotion analysis:

[1941] The user inputs information about their health and safety into the terminal: The user uses a smart device (e.g., a smartphone or tablet) to open a dedicated application and input information about their health and safety (e.g., "I have a headache today"). The user's facial expressions and voice are also captured through the smart device's camera and microphone.

[1942] Emotion engine analyzes user emotions: The emotion engine built into the smart device analyzes captured facial and voice data to identify the user's emotions (e.g., fatigue, sadness, joy).

[1943] 2. Information and emotional data transmission and notification:

[1944] The device sends information and emotional data to the server: When the user completes the input and presses the send button, the smart device sends information about their physical condition and safety, as well as the emotional data identified by the emotion engine, to the central server.

[1945] The server receives the information and emotion data, analyzes it, and sends notifications: The server stores the received data in a database and analyzes it. As a result, it adjusts and sends notifications to family members and registered contacts as needed. Notifications are sent via email, push notification, or SMS.

[1946] 3. Room temperature information acquisition and remote operation:

[1947] A home device measures the room temperature and sends it to a server: An IoT temperature sensor installed in the home periodically measures the current room temperature and sends the data to a central server via the home device.

[1948] The server receives the temperature data and sends it to the user's device: The server receives the temperature data and sends it to the user's smart device in real time, allowing the user to check the current room temperature using a dedicated application.

[1949] The user inputs the desired room temperature and sends it from the terminal to the server: The user inputs the desired room temperature (e.g., 24°C) using the application and sends it. This data is sent to the server.

[1950] The server sends instructions to the home device to adjust the temperature: Based on the desired room temperature data received, the server sends temperature control instructions to the home device. The home device follows these instructions and operates the temperature control device (e.g., thermostat or air conditioner) to adjust the temperature to the specified level.

[1951] Specific examples

[1952] Example 1: Specific example of health check and emotion analysis

[1953] The user enters their physical condition into the device: An 80-year-old woman enters "I have a headache today" into a smart device application and presses the send button. Facial expressions and voice are also captured via the camera and microphone.

[1954] Emotion engine analyzes emotions: The emotion engine built into the smart device analyzes the user's facial expressions and voice to detect "fatigue."

[1955] Terminal transmits information and emotional data: The smart device transmits physical condition information and emotional data indicating "fatigue" to a central server.

[1956] The server receives the information and sends a notification: The server receives the information and stores it in a database. It analyzes it and sends a message to the appropriate contact (for example, the woman's son) saying, "Notification from Mom: I have a headache today (emotion: fatigue)." The son receives this notification on his smartphone and can immediately check his mother's condition and consider what action is necessary.

[1957] Example 2: Room temperature control

[1958] A home device measures the temperature and sends it to the server: The IoT temperature sensor in your home measures the current room temperature and sends it to the central server.

[1959] The user inputs the desired room temperature and sends it from the device: A man in his 50s uses a smart device while on a business trip to check the current room temperature in the living room (for example, 28°C) and inputs that it should be set to 24°C.

[1960] The server receives the information and sends instructions to the home device: The server receives this data and sends instructions to the home device to set the temperature to 24°C.

[1961] Home devices adjust the temperature: Your home device controls the thermostat and air conditioner, adjusting the temperature in your living room to 24°C.

[1962] This system allows users to monitor the health and safety of their family members, even when they are in a remote location, and maintain a comfortable home environment. This invention is extremely useful for elderly people and those with family members who need health care.

[1963] The processing flow will be explained below.

[1964] Input of health and safety information, emotion analysis, and notifications

[1965] Processing Steps:

[1966] Step 1:

[1967] A user enters information about their health and safety into a smart device. For example, they open an application, type "I have a headache today," and press the send button. The smart device's camera and microphone capture the user's facial expressions and voice.

[1968] Step 2:

[1969] The device's on-board emotion engine analyzes the captured facial expression and voice data, for example, by using facial recognition technology and voice feature extraction to identify the user's emotions (e.g., fatigue, sadness, joy).

[1970] Step 3:

[1971] The device sends the entered health and safety information and analyzed emotion data to the central server via a POST request. For example, the request data is structured as follows: { "user_id": 123, "status": "I have a headache today", "emotion": "Fatigue"}.

[1972] Step 4:

[1973] The server receives the POST request and stores this information in a database, for example in the "users_status" and "users_emotions" tables.

[1974] Step 5:

[1975] The server analyzes the health and safety information and emotional data to determine whether a notification is necessary. Specifically, based on the content of "status" and "emotion," it determines that a notification is necessary if the importance is high.

[1976] Step 6:

[1977] The server creates the notification content and sends it to the registered contacts (for example, family members' email addresses or push notification device IDs). For example, an SMTP server is used for email, and FCM is used for push notifications. The notification content includes specific information such as "Notification from Mom: I have a headache today (emotion: fatigue)."

[1978] Step 7:

[1979] The notification arrives on the family member's device. The notification service on the device runs and displays the message "Notification from Mom: I have a headache today (emotion: fatigue)" to the family user.

[1980] Acquisition of room temperature information and remote operation

[1981] Processing Steps:

[1982] Step 1:

[1983] The device at home measures the current room temperature from a temperature sensor, which acquires temperature data every minute, for example.

[1984] Step 2:

[1985] The temperature data acquired by the home device is sent to the central server via a POST request. The request data is sent in the format of { "room_id": 1, "temperature": 28.5, "timestamp": "2023-10-01T12:00:00Z"}, for example.

[1986] Step 3:

[1987] The server receives the POST request and saves the temperature information in the database, in the "room_temperatures" table.

[1988] Step 4:

[1989] The user's device sends a GET request to the server for the current temperature information. The request is sent in the format " / api / temperature / latest?room_id=1", for example.

[1990] Step 5:

[1991] The server receives a GET request, retrieves the latest temperature data from the database, and returns the data in the response format: { "room_id": 1, "temperature": 28.5, "timestamp": "2023-10-01T12:00:00Z"}.

[1992] Step 6:

[1993] The user's device receives the response from the server and displays the current room temperature in the application. For example, "The current temperature in the living room is 28.5°C" is displayed in a visible area for the user.

[1994] Remote room temperature control

[1995] Processing Steps:

[1996] Step 1:

[1997] The user enters the desired room temperature (for example, 24°C) into the smart device application and presses the send button.

[1998] Step 2:

[1999] The device sends the desired room temperature data to the central server via a POST request. For example, the request data is sent in the format "{ "room_id": 1, "desired_temperature": 24}".

[2000] Step 3:

[2001] The server receives the POST request and saves the desired temperature information to the database in the "desired_temperatures" table.

[2002] Step 4:

[2003] The server sends temperature control instructions to the home device using MQTT or HTTP protocol. For example, the message format is "{ "command": "set_temperature", "value": 24}".

[2004] Step 5:

[2005] The home device receives the instruction and executes a command to the temperature control device (e.g., thermostat or air conditioner) to set the desired temperature (24°C).

[2006] Step 6:

[2007] The home thermostat will follow instructions and adjust the room temperature to 24°C. The temperature will be changed and maintained until the specified temperature is reached.

[2008] Example 2

[2009] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2010] Conventional systems lack the means for remote users to easily adjust the temperature in their homes or efficiently notify family members of their health and safety. Furthermore, they lack the ability to analyze a user's emotional state and notify appropriate contacts, which can delay response in emergencies or when special care is needed. This is particularly a serious problem for elderly people and those with fluctuating health conditions.

[2011] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2012] In this invention, the server includes a means for a user in a remote location to input information about their physical condition and safety using an information terminal, a means for an emotion analysis engine built into the information terminal to analyze the user's emotions, and a means for transmitting the input information and analyzed emotion data to the central server. This allows the physical and emotional states of family members to be monitored in real time and prompt responses to be taken as needed. Furthermore, by including a means for acquiring the home's room temperature information displayed on the information terminal and operating the home's temperature control device according to the user's instructions, comfortable room temperature control can be achieved even from a remote location.

[2013] "Remote location" refers to a state in which a user is located geographically away from home.

[2014] "Information terminal" refers to a smartphone, tablet, or other portable electronic device.

[2015] "Input means" refers to the method by which a user inputs information about his or her own health condition and safety through an information terminal.

[2016] An "emotion analysis engine" refers to software or hardware that analyzes a user's facial expressions and voice data to identify their emotional state.

[2017] "Central server" refers to a server system that has the function of storing and analyzing received data and sending notifications as necessary.

[2018] "Notification means" refers to the method by which the central server sends information to registered contacts based on the analysis results.

[2019] "Registered Contacts" means any person or entity designated by a User and authorized to receive emergency or special notices.

[2020] "Room temperature information" refers to temperature data measured by a detection sensor inside your home.

[2021] "Detection sensor" refers to a device installed in a home to measure room temperature.

[2022] "Temperature control devices" refers to devices such as air conditioners and thermostats used to regulate the temperature inside a home.

[2023] "Database" refers to a system for systematically storing and managing received information within a central server.

[2024] MODE FOR CARRYING OUT THE INVENTION

[2025] The present invention is a system in which a user in a remote location uses an information terminal to input information about their own physical condition and safety, and then analyzes the user's emotions using an emotion analysis engine. This system has the function of transmitting the information input by the user and analyzed emotion data to a central server, which then analyzes the received data and sends a notification to registered contacts. It is also possible to obtain information about the room temperature at home and operate the home's temperature control device from a remote location.

[2026] 1. Input of health and safety information and emotion analysis

[2027] A user opens a dedicated application on their smartphone or tablet and enters information about their physical condition and safety. For example, the user might enter "I have a headache today" and press the send button. At this time, the smart device's camera and microphone are used to capture the user's facial expressions and voice. The built-in emotion analysis engine analyzes the captured facial and voice data and identifies the user's emotions (e.g., fatigue, sadness, joy).

[2028] 2. Transmission and notification of information and emotional data

[2029] The device sends the user's input information along with the analyzed emotion data to a central server, which stores this data in a database and analyzes it using a data analysis module. Based on the results, it determines the necessary action to take and sends notifications to family members and registered contacts via email, push notification, or SMS.

[2030] 3. Acquisition of room temperature information and remote operation

[2031] An IoT temperature sensor installed in the home measures the current room temperature and sends that data to the home's gateway device. The gateway device sends this information to a central server, which then sends the received data to the user's information terminal. The user uses a dedicated application to check the current room temperature in real time and input their desired room temperature. The input desired room temperature data is sent to the server, which then uses this data to send instructions to the home's thermostat, adjusting the temperature to the specified level.

[2032] Specific examples

[2033] Example 1: Specific example of health check and emotion analysis

[2034] The user inputs their physical condition: An 80-year-old woman inputs "I have a headache today" into a smart device application and sends it. Her facial expressions and voice are also captured via the camera and microphone.

[2035] Emotion engine analyzes emotions: The emotion engine built into the smart device analyzes the user's facial expressions and voice to detect "fatigue."

[2036] Terminal transmits information and emotional data: The smart device transmits physical condition information and emotional data indicating "fatigue" to a central server.

[2037] Server receives information and sends notification: The server receives the information and stores it in a database. It analyzes it and automatically generates and sends an email to the necessary contact (for example, the son) saying, "Notification from Mom: I have a headache today (emotion: fatigue)." The son receives this notification on his smartphone, can check his mother's situation, and consider how to respond.

[2038] Example 2: Room temperature control

[2039] A home device measures the temperature and sends it to the server: The IoT temperature sensor measures the current room temperature and sends it to the central server.

[2040] The user inputs the desired room temperature and sen...

Claims

1. A means for a user in a remote location to input health and safety information using a smart device; means for transmitting the input information to a central server; A means for analyzing the information received by the central server and notifying the registered contacts; A means for the notified contact to receive a notification; means for acquiring information on room temperature in the house to be displayed on the smart device; A means for operating a home temperature control device according to instructions from the smart device; A system including:

2. The system according to claim 1, wherein the health and safety information is stored in a database by a central server based on information input by the user.

3. The system of claim 1 , wherein the room temperature information is measured by a temperature sensor installed in the home and periodically transmitted to a central server.

Images