system

Abstract

We provide the system. [Solution] Information gathering means for acquiring data from multiple electronic devices in a home environment, A computational means for performing analysis to optimize energy consumption based on acquired data, A communication method that notifies the user of an optimized energy plan based on the analysis results, A control means that controls multiple electronic devices based on a plan approved by the user, A system that includes this.

Description

【Technical Field】 【0001】 The technology of the present disclosure relates to a system. 【Background Art】 【0002】 Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. 【Prior Art Documents】 【Patent Documents】 【0003】 【Patent Document 1】 Japanese Unexamined Patent Application Publication No. 2022-180282 【Summary of the Invention】 【Problems to be Solved by the Invention】 【0004】 There are problems such as waste of energy consumption by individually operating a plurality of electronic devices installed in a home, concerns about safety due to insufficient security measures, and a decrease in convenience due to a lack of proposals for entertainment that suits the user's preferences. These problems are caused by the lack of an integrated management mechanism, so an integrated solution for providing an efficient, safe, and comfortable home environment is required. 【Means for Solving the Problems】 【0005】 To address the above issues, the present invention provides an information gathering means for acquiring data from multiple electronic devices in the home environment, and a computing means for performing analysis to optimize energy consumption based on the acquired data. Furthermore, it realizes a system that includes a communication means for notifying the user of an optimized energy plan based on the analysis results, and a control means for controlling multiple electronic devices based on the plan approved by the user. In addition, by using an anomaly detection means for collecting data from security devices in real time and detecting anomalies, and a means for receiving commands from the user and managing security, the safety of the home is also improved. Moreover, the quality of life is enhanced by analyzing entertainment content based on the user's past viewing data and making suggestions according to the user's preferences. 【0006】 An "information gathering device" is a device that has the function of acquiring necessary data from multiple electronic devices within a household. 【0007】 "Calculation means" refers to a device or program that performs analysis to optimize energy consumption based on acquired data. 【0008】 A "communication device" is a device that has the function of notifying the user of analysis results and other information. 【0009】 A "control device" is a device that has the function of controlling multiple electronic devices based on a plan approved by the user. 【0010】 An "anomaly detection method" is a device that analyzes data from security devices to detect suspicious activity or anomalies. 【0011】 A "security management device" is a device that has the function of executing user commands in order to take appropriate measures against detected anomalies. 【0012】 A "content suggestion tool" is a device that analyzes a user's past viewing data and suggests entertainment content tailored to their interests. 【0013】 A "playback device" is a device that has the function of playing entertainment content selected by the user. [Brief explanation of the drawing] 【0014】 [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14]It is a sequence diagram showing the processing flow of a data processing system in Application Example 2 when a sentiment engine is combined. 【Embodiments for Carrying Out the Invention】 【0015】 Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings. 【0016】 First, the terms used in the following description will be explained. 【0017】 In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like. 【0018】 In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor. 【0019】 In the following embodiments, a numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like. 【0020】 In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark). 【0021】 In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or." 【0022】 [First Embodiment] 【0023】 Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment. 【0024】 As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server. 【0025】 The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). 【0026】 The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52. 【0027】 The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input. 【0028】 The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor. 【0029】 Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54. 【0030】 Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14. 【0031】 As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30. 【0032】 The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. 【0033】 In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48. 【0034】 Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal". 【0035】 This invention is a system for the integrated management of smart devices within a home environment, and consists of three elements: a server, terminals, and users. 【0036】 First, the server periodically collects energy usage data from various electronic devices in the home (e.g., refrigerator, air conditioner, heater, lighting, etc.). Based on this data, the server analyzes the usage patterns of each device and calculates an optimal energy consumption schedule. Furthermore, based on the analysis results, the server generates a plan to optimize energy consumption and notifies the user. 【0037】 As a concrete example, the server suggests to the user that "raising the air conditioner's temperature setting by 1°C during peak afternoon hours can save 20% of energy." The user can review this suggestion on a smartphone app and approve or change it as needed. 【0038】 Next, the server receives data in real time from home security devices, such as surveillance cameras and door sensors, and monitors for any anomalies. If an anomaly is detected, the server immediately notifies the user. Upon receiving the notification, the user can view the security footage through a smartphone app and, if necessary, send commands to the device. For example, if suspicious activity is detected, the user can send a command to the device to remotely lock the door. 【0039】 Furthermore, the server analyzes the user's entertainment content preferences and suggests content to watch next based on their individual viewing history. The suggested content is displayed on the device, such as a TV or streaming device, and the user can start watching immediately after selecting it. 【0040】 Thus, the present invention aims to provide users with a safe, efficient, and comfortable home environment by seamlessly optimizing home energy management, security, and entertainment. 【0041】 The following describes the processing flow. 【0042】 Step 1: 【0043】 The server acquires energy usage data from various electronic devices installed in the home, including smart meters and direct device communication. The acquired data is sorted chronologically and recorded in a database. 【0044】 Step 2: 【0045】 The server analyzes the collected energy usage data to identify usage patterns. This analysis uses AI algorithms to understand consumption trends by device and time of day. After patterns are extracted, potential energy saving opportunities are identified. 【0046】 Step 3: 【0047】 The server generates an optimal energy management plan based on the analysis results. This includes suggestions to reduce device operation during specific time periods and adjustments to temperature settings. The generated plan is then communicated to the user. 【0048】 Step 4: 【0049】 The user reviews the energy management plan received from the server using a smartphone app. After reviewing the plan, the user can approve it or make any necessary adjustments. The user's selection is then returned to the server. 【0050】 Step 5: 【0051】 The terminal sends control instructions to each electronic device based on the energy plan approved by the user. Specifically, it adjusts the temperature setting of the air conditioner and controls the on / off of lights at specific times. 【0052】 Step 6: 【0053】 The server receives data from security devices in real time and applies anomaly detection algorithms to monitor for suspicious activity. If an anomaly is detected, the server immediately notifies the user. 【0054】 Step 7: 【0055】 The user receives a security alert from the server and reviews the provided data and video. If necessary, the user can decide on remote action and send commands to their terminal, such as locking a door. 【0056】 Step 8: 【0057】 The server analyzes the user's entertainment viewing history and suggests content for the next viewer. This suggestion is displayed on the user's device, depending on the terminal. 【0058】 Step 9: 【0059】 The user selects the content they want to watch from the suggested options. Once the selection is complete, the device automatically begins playing the selected content. 【0060】 (Example 1) 【0061】 Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal." 【0062】 In modern home environments, efficient management of various electrical appliances is required, but challenges remain in areas such as information gathering and analysis, and ensuring confidentiality. In particular, optimizing energy consumption, and enhancing security and safety are essential. Traditional methods often involve individual management, making efficient integrated management difficult. Therefore, there is a need for technology that integrates these elements to efficiently and safely manage the home environment. 【0063】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means. 【0064】 In this invention, the server includes information gathering means for acquiring information from multiple electrical appliances in the home environment, calculation means for performing analysis to optimize energy consumption based on the acquired information, and communication means for transmitting the optimized energy plan to the user based on the analysis results. This enables efficient energy management of electrical appliances in the home and enhances safety. 【0065】 "Information gathering means" refers to a system or device for acquiring usage data from multiple electrical appliances within a home environment. 【0066】 A "computational means" is a system or algorithm for analyzing acquired information and deriving an appropriate energy consumption pattern based on that analysis. 【0067】 "Communication means" refers to a system or technology for transmitting analysis results to users and notifying them of their energy plan. 【0068】 A "control device" is a system or device for operating multiple electrical machines based on a plan approved by the user. 【0069】 An "anomaly identification means" is a system or technology for monitoring data from security devices in real time and identifying abnormal behavior or situations. 【0070】 "Safety management means" refers to a system or process for notifying users of the results obtained by anomaly identification means and, if necessary, giving instructions or performing operations on electrical machinery. 【0071】 A "content suggestion system" is a system that analyzes a user's past viewing information and suggests entertainment content they should watch next. 【0072】 "Playback means" refers to a system or device for visually or audibly reproducing entertainment content selected by the user. 【0073】 In one embodiment of the present invention, a system is provided for the integrated management of various electrical appliances in a home environment. This system consists of three elements: a server, a terminal, and a user. 【0074】 The server analyzes data collected from various electrical appliances in the home. Specifically, energy consumption data acquired by IoT sensors is sent to the server using communication methods such as Wi-Fi and Bluetooth. The server stores this data in a cloud database and analyzes device usage patterns using machine learning algorithms. Here, common machine learning tools are used for the analysis. Furthermore, the server generates an optimal energy plan based on the analysis results and sends suggestions to the user via a notification system. 【0075】 For example, the server might suggest, "Raising the air conditioner's temperature by 1°C during peak afternoon hours could save 20% energy." Users can review, approve, or adjust these suggestions via their smartphones. The smartphone app provides a user interface and assists with reviewing and approving energy plans. 【0076】 Furthermore, the server collects data in real time from home security devices and monitors for anomalies. If an anomaly is detected, it immediately notifies the user. The user receives the notification using their smartphone and can send control commands to the device as needed. For example, if abnormal activity is detected, the user can send a command to the device to remotely lock the door. 【0077】 In the entertainment field, servers analyze a user's viewing history and suggest content to watch next. This suggested content is displayed on the user's device via a TV or streaming device, allowing them to start watching immediately. 【0078】 For example, you can use text such as "Please tell me how to collect and optimize power consumption data for each device in my home" as an input prompt for the generating AI model. 【0079】 In this way, this system enables integrated management to improve the efficiency and safety of the home environment. 【0080】 The flow of the specific processing in Example 1 will be explained using Figure 11. 【0081】 Step 1: 【0082】 The server collects energy consumption data from each electrical appliance in the home. IoT sensors attached to each device transmit energy consumption information at that time via Wi-Fi or Bluetooth. Inputs include device identification information and energy consumption, which are integrated and stored in a cloud database. Outputs include energy consumption data for each device and the date. 【0083】 Step 2: 【0084】 The server analyzes the collected energy consumption data. Specifically, it processes information in a cloud database using scripts such as Python to extract usage patterns and peak consumption times for each device. Machine learning algorithms are applied to this analysis to detect abnormal usage patterns and generate data for optimization. Stored energy consumption data is used as input, and the output provides usage patterns for each device and optimization suggestions. 【0085】 Step 3: 【0086】 The server generates a plan to optimize energy consumption based on the analysis results. In this process, a generation AI model is used to devise a convenient and efficient energy usage method for the user. The input is the analysis results of usage patterns, and the output is an energy plan proposed to the user. 【0087】 Step 4: 【0088】 The server notifies the user of the generated energy plan. It uses a cloud messaging service to send information to a smartphone app. For example, a suggestion such as, "Raising the air conditioner temperature by 1°C during peak afternoon hours can reduce energy consumption by 20%," might be sent. The input is the generated energy plan, and the output is the notification sent to the user's smartphone. 【0089】 Step 5: 【0090】 Users review proposals using a smartphone app and approve or modify them. This operation is performed through the app's interface, and plans approved by the user are implemented in the next step. The input is the energy plan notification from the server, and the output is the user's decision. 【0091】 Step 6: 【0092】 The server receives information in real time from home security devices and monitors for anomalies. It applies anomaly detection algorithms to identify suspicious behavior and movements. The input is real-time information from security devices, and the output is the anomaly detection result. 【0093】 Step 7: 【0094】 If an anomaly is detected, the server sends a notification to the user. After the user confirms the notification, they send a control command to their device via a smartphone app. For example, they can remotely lock a door. The input is the anomaly notification from the server, and the output is the control command sent to the device. 【0095】 Step 8: 【0096】 The server analyzes the user's entertainment viewing history and suggests content to watch next. This uses data on previously viewed content and genres, and predicts similar content through machine learning. The input is the user's viewing history, and the output is the suggested content. 【0097】 In this way, each step works in coordination to achieve efficient management and improved safety of electrical appliances in the home. 【0098】 (Application Example 1) 【0099】 Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal." 【0100】 In modern homes and man-made buildings, multiple electronic devices are scattered and function independently, resulting in separate optimizations of energy consumption, safety assurance, and the provision of information and entertainment. This leads to inefficiency overall and low user convenience. Furthermore, the complex management required tends to increase the burden on members of society. To solve these problems, a system is needed that can manage each device in an integrated and efficient manner. 【0101】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. 【0102】 In this invention, the server includes information gathering means, computing means, communication means, and control means. This makes it possible to integrally manage multiple electronic devices in a home environment or an entire artificial building, optimize energy consumption, ensure security, and seamlessly provide information and entertainment. 【0103】 "Home environment" refers to the living space within an individual residence or apartment building, as well as all the equipment installed within it. 【0104】 "Artificial structures" refer to buildings and facilities designed for human life and activities, which are structures that stand in contrast to the natural environment. 【0105】 "Members of society" refers to people who live in a particular region or environment, or to the individual people who make up that community. 【0106】 "Electronic device" refers to a device or equipment that operates using electrical or electronic means, or a system composed of such devices or equipment. 【0107】 "Information gathering means" refers to the processes, technical means, and devices used to acquire data. 【0108】 "Computational means" refers to the processes, algorithms, and devices used to analyze data and derive results. 【0109】 "Communication methods" refer to the processes, technologies, and devices used to transmit and share information. 【0110】 "Control means" refers to processes, technologies, and devices used to manage and adjust the operation and state of a system or equipment. 【0111】 To implement this invention, a system is needed to centrally manage multiple electronic devices placed in a home environment or artificial building. This system consists of three elements: a server, a terminal, and a user. 【0112】 The server periodically acquires data such as energy consumption from various electronic devices within homes and buildings. To achieve this, sensors are installed in each device, and this data is aggregated on the server via an IoT network. The server uses this data to analyze energy consumption patterns using real-time data analysis tools such as Apache® Kafka, and calculates an optimal consumption schedule. The analysis results are then notified to members of society using cloud services such as Google® Cloud and AWS®. Users who receive the notification can then approve the proposed plan using their own devices. 【0113】 The terminal controls related electronic devices based on user instructions. For example, remote control is possible using a smartphone or smart home hub. It not only optimizes energy consumption according to the situation but also performs real-time safety management, promptly notifying the user if an anomaly is detected. This function is used, for example, for home security management using surveillance cameras and door sensors. 【0114】 Furthermore, this system can also be applied to providing information and entertainment. The server analyzes the user's preferences based on their past viewing data and suggests the most suitable information and entertainment. This process utilizes a generative AI model to suggest content based on viewing history. This allows members of society to efficiently enjoy entertainment. 【0115】 As a concrete example, consider a scenario where a large amount of electricity is consumed temporarily on a hot summer day. In this case, the system coordinates with other households to adjust energy consumption and optimizes air conditioner usage based on the proposed plan. This can reduce peak electricity consumption. 【0116】 An example of a prompt message is, "Please tell me how to optimize energy use this summer. Please provide specific suggestions, including peak air conditioning temperature settings." 【0117】 The flow of a specific process in Application Example 1 will be explained using Figure 12. 【0118】 Step 1: 【0119】 The server acquires energy usage data from sensors in various electronic devices within homes and buildings. This input data is collected via an IoT network and stored in a database. Here, data preprocessing is performed, including noise reduction and missing value imputation. 【0120】 Step 2: 【0121】 The server performs real-time data analysis based on the acquired energy usage data. Using Apache Kafka, it processes the data as a stream and analyzes the energy consumption patterns of each device. This identifies consumption peaks and wasteful usage, resulting in the output of foundational data for optimization. 【0122】 Step 3: 【0123】 Based on the analysis results, the server uses Google Cloud's AI tools to calculate the optimal energy consumption schedule through a generative AI model. This calculation combines historical data with predictive algorithms to output an efficient consumption plan. 【0124】 Step 4: 【0125】 The server notifies members of society of an energy consumption optimization plan. This output data is sent to the user's smartphone as a push notification. The notification includes specific suggestions, such as "raise the air conditioner temperature by 1°C during the afternoon peak hours." 【0126】 Step 5: 【0127】 The user uses their device to review the notification and approve it or change settings as needed. Based on the user's input, the device sends data back to the server, and the approved plan is saved. 【0128】 Step 6: 【0129】 Based on an approved plan, the device controls each electronic device via a smart home hub. For example, it optimizes energy consumption by automatically changing the temperature settings of an air conditioner. 【0130】 Step 7: 【0131】 To ensure users can enjoy entertainment with peace of mind, the server uses an AI model based on past viewing data to suggest content. Examples of prompts include "How can I optimize my energy usage this summer?", suggesting the most suitable information and entertainment for the user. 【0132】 Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions. 【0133】 This invention provides a system that integrates and controls smart devices within the home, and further recognizes and adapts to the user's emotions to provide services. The system mainly consists of a server, terminals, an emotion engine, and the user. 【0134】 First, the server periodically acquires energy usage data from multiple electronic devices within the home. Based on this data, the server uses AI algorithms to perform analysis to optimize energy consumption. For example, it can analyze the home's consumption patterns and propose a device operation plan that avoids peak power times. 【0135】 The emotion engine analyzes the user's facial expressions and voice to recognize their emotions. This allows the server to understand the user's current emotional state. Based on this information, the server designs and notifies the user of an energy plan that it believes will be most acceptable to them. For example, if the user is relaxed, it will offer more detailed suggestions; if they appear to be in a hurry, it will offer concise and direct suggestions. 【0136】 Furthermore, the server acquires information from various security devices in real time and responds flexibly based on the user's emotions when an anomaly is detected. If the user is in a panic state when an anomaly occurs, the server will notify them of more stable and rapid countermeasures. If the user is at ease, it will provide normal notifications and, if necessary, take control through the terminal based on appropriate instructions. 【0137】 Furthermore, the server utilizes the emotion engine to suggest entertainment content. It can analyze the user's emotional state and recommend the most suitable entertainment content. For example, if the user is stressed, it will suggest relaxing content, and if they are feeling energetic, it will suggest dynamic content such as action movies. 【0138】 As described above, the system of the present invention aims to improve home life in a more convenient, comfortable, safe, and efficient way by providing flexible and adaptive services that respond to the user's emotional state. 【0139】 The following describes the processing flow. 【0140】 Step 1: 【0141】 The server acquires energy usage data directly from multiple electronic devices installed in the home, or via sensors. This data is stored in a database along with a timestamp, as it forms the basis for subsequent energy consumption optimization. 【0142】 Step 2: 【0143】 The server uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes the user's facial expressions and voice input to identify emotions such as whether the user is relaxed or stressed. 【0144】 Step 3: 【0145】 Based on the energy data acquired in Step 1, the server uses an AI algorithm to generate an optimized energy consumption plan. At this time, it adjusts how the plan is proposed, taking into account the user's emotional state as determined by the emotion engine. For example, it provides detailed information when the user is relaxed and offers concise suggestions when the user is stressed. 【0146】 Step 4: 【0147】 Users review energy consumption plan suggestions sent from the server via a smartphone app. Based on suggestions optimized to the user's preferences, users can approve or modify the plan. 【0148】 Step 5: 【0149】 The terminal controls each electronic device based on a plan approved by the user. Specifically, it automatically adjusts the temperature settings of air conditioners and manages the lighting schedule to achieve efficient energy use. 【0150】 Step 6: 【0151】 The server receives data from security devices in real time and applies anomaly detection algorithms to monitor suspicious activity. If an anomaly is detected, the server adjusts the content and method of notification based on the user's emotional response. For example, it might send a message emphasizing reassurance or immediately provide detailed instructions. 【0152】 Step 7: 【0153】 Users review security notifications sent from the server and respond quickly as needed. With the assistance of an emotion engine, users are encouraged to respond calmly and can send commands directly from their smartphones to their devices to control the security status within their homes. 【0154】 Step 8: 【0155】 The server analyzes the user's entertainment viewing history and current emotional state to suggest the most suitable content. This suggestion is tailored to the user's mood; for example, it might recommend calming movies if the user is relaxed, or action films if they are feeling active. 【0156】 Step 9: 【0157】 The user selects and plays the suggested content on their device. The device automatically starts playing the selected content, providing the user with a comfortable and personalized entertainment experience. 【0158】 (Example 2) 【0159】 Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal." 【0160】 In modern homes, a wide variety of electrical devices are connected to the internet, creating a demand for efficient energy management. However, conventional systems often provide uniform responses without considering the user's emotional state, making satisfactory personalization difficult. Furthermore, while flexible responses tailored to individual situations and emotions are required in terms of security, current systems do not adequately meet this need. In addition, selecting optimal content based on the user's emotions is a challenge in entertainment offerings. 【0161】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. 【0162】 In this invention, the server includes data collection means for acquiring energy usage data from multiple electrical devices in the home environment, emotion recognition means for recognizing the user's emotional state using an emotion engine, and computation means for performing analysis to optimize energy consumption based on the acquired energy data and emotional state data. This enables efficient power consumption within the home and the provision of adaptive services that respond to the user's emotions. 【0163】 "Energy usage data" refers to information about the amount of energy consumed and usage patterns of multiple electrical devices. 【0164】 An "emotion engine" refers to a function or system that analyzes information such as a user's facial expressions and voice to identify their current emotional state. 【0165】 "Data acquisition means" refers to methods and devices for acquiring necessary data from multiple electrical devices. 【0166】 "Emotion recognition means" refers to methods and devices used to understand a user's emotional state. 【0167】 "Computational means" refers to the technologies and processes used to perform necessary analyses and calculations based on collected data. 【0168】 "Communication methods" refer to methods and devices for conveying analysis results and proposed content to users. 【0169】 "Control means" refers to methods or devices for managing electrical equipment based on instructions from the user. 【0170】 "Anomaly detection means" refers to methods and devices for analyzing data provided by security devices to identify the occurrence of anomalies. 【0171】 "Security management measures" refer to functions and systems that notify users in the event of an anomaly and control electrical devices as necessary. 【0172】 "Content suggestion means" refers to methods and devices for selecting and recommending entertainment content based on past viewing data and emotional states. 【0173】 "Playback means" refers to methods or devices for displaying or playing content selected by the user. 【0174】 This invention is a system that centrally manages multiple electrical devices in the home and optimizes the living environment according to the user's emotional state. The system mainly consists of a server, terminals, an emotion engine, and the user. 【0175】 The server collects energy usage data from multiple electrical devices. This includes smart meters and device sensors that track power consumption. The server integrates this collected data and uses AI algorithms to analyze it and optimize energy consumption. Specifically, it creates power optimization plans based on past consumption patterns. 【0176】 For example, the server can suggest operating the washing machine at times when electricity rates are high during the day. 【0177】 The device uses its camera and microphone to transmit the user's facial expressions and voice to the emotion engine. The emotion engine identifies the user's emotions and sends that information to the server. Based on this, the server selects and notifies the user of the most suitable energy plan and entertainment content. 【0178】 For example, when a user is relaxing, the system might suggest relaxing music along with detailed power-saving tips. 【0179】 Furthermore, the server can monitor data from security devices in real time and provide flexible responses based on emotional states. 【0180】 Examples of prompts include, "Please explain how to optimize the power consumption of smart devices in your home," and "Please tell me about an algorithm that suggests entertainment based on the user's emotions." 【0181】 This invention is expected to make home life more comfortable and energy-efficient. 【0182】 The flow of the specific processing in Example 2 will be explained using Figure 13. 【0183】 Step 1: 【0184】 The server collects energy usage data from each electrical appliance installed in the home. This data includes the amount of electricity each device consumes at any given time. The server records this data in a database in real time and stores it as baseline data for analyzing energy usage patterns. 【0185】 Step 2: 【0186】 The device uses camera and microphone sensors to capture the user's facial expressions and voice as input in order to understand the user's emotional state. The emotion engine analyzes this data and sends the detected emotional state (e.g., relaxed, stressed, focused) to the server. The server stores this information in an emotion database and uses it in the next step. 【0187】 Step 3: 【0188】 The server uses an AI algorithm to perform data calculations to optimize energy consumption, taking the energy usage data collected in Step 1 and the user's emotional state obtained in Step 2 as input. This allows it to output an optimal energy plan, such as suggestions for peak shifting based on energy usage patterns or suggestions for temperature adjustments based on the user's emotional state. 【0189】 Step 4: 【0190】 The server notifies the user of the optimal energy plan obtained in step 3 via communication. The notification includes specific energy-saving methods and suggestions for when to turn devices on and off. The user can review this on their device screen and approve or modify the plan. 【0191】 Step 5: 【0192】 The server automatically controls each electrical appliance in the home based on the user's approved plan. For example, it adjusts the air conditioner's temperature setting to match the user's relaxation state. It also sets the start times for washing machines and dishwashers based on the proposed power usage time. 【0193】 Step 6: 【0194】 The server monitors real-time data from security devices as input and outputs flexible response measures tailored to the emotional state if an anomaly occurs. In the event of an anomaly, the user is notified of the situation and prompt action is taken as needed. 【0195】 Step 7: 【0196】 The server utilizes a generative AI model to suggest entertainment content based on the user's emotional state and past viewing history. It receives emotional state and history data as input, and the AI ​​outputs a content plan recommending relaxing music and videos, which is then provided to the user. 【0197】 (Application Example 2) 【0198】 Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal". 【0199】 In modern home environments, it is common for multiple information devices to be introduced and controlled individually, but this leads to wasted energy and inefficiencies between devices. Furthermore, while flexible responses that respond to users' emotions are required, current systems have difficulty accurately understanding users' emotional states and controlling devices accordingly. As a result, home life is not always comfortable, and security concerns remain. 【0200】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. 【0201】 In this invention, the server includes information gathering means for acquiring data from multiple information devices in the home environment, processing means for performing analysis to optimize energy consumption based on the acquired data, and emotion adaptation means for recognizing the user's emotional state and providing appropriate information and controlling devices based on the acquired emotion data. As a result, not only is energy consumption in the home optimized, but device management tailored to each user's emotions becomes possible, realizing a more comfortable and safe living environment. 【0202】 An "information gathering device" is a device that has the function of acquiring data on usage status and condition from multiple information devices within the home environment. 【0203】 A "processing device" is a device that analyzes acquired data and performs calculations and decisions to optimize energy consumption. 【0204】 A "transmission means" is a device that has a communication function to notify users of an optimized energy plan. 【0205】 "Operating means" refers to a device that has the function of controlling multiple information devices based on a plan approved by the user. 【0206】 An "emotional adaptation device" is a device that analyzes the user's facial expressions and voice, recognizes their emotional state, and provides appropriate information or operates equipment based on that recognition. 【0207】 An "anomaly detection means" is a device that collects data from monitoring equipment in real time and has the function of automatically detecting abnormal situations. 【0208】 A "safety management device" is a device that has the function of notifying users of detected abnormal situations, receiving necessary instructions, and controlling multiple information devices. 【0209】 A "psychological response device" is a device that, in abnormal situations, considers the user's psychological state using emotional adaptation tools and provides appropriate countermeasures. 【0210】 A "content suggestion device" is a device that analyzes a user's past usage data and suggests entertainment content based on the results. 【0211】 A "sentiment analysis device" is a device that analyzes the emotional state of a user and has the function of selecting the most appropriate content based on that analysis. 【0212】 A "playback device" is a device that has the function of playing back content selected by the user in an optimal environment within the home. 【0213】 This invention is a system for realizing integrated control of multiple information devices within a home environment. Specific embodiments thereof are described below. 【0214】 The server is configured using a Raspberry Pi and connects to multiple information devices via a home network. As a means of information gathering, the server has the functionality to acquire usage status and energy data from each information device via a smart home appliance API. Furthermore, as a means of emotional adaptation, it uses an emotion recognition algorithm combining OpenCV and TENSORFLOW® to analyze the user's facial expressions and voice data. 【0215】 The devices used are smartphones and tablets, and they connect via Bluetooth or Wi-Fi to receive notifications from the server. The means of communication include notifying users of analyzed, optimized energy plans and content suggestions based on their emotions. 【0216】 Users control information devices and approve energy plans through their terminals. Emotional adaptation mechanisms provide appropriate information and services based on the user's current emotional state. For example, when a user is relaxed, they can review and approve the details of the energy plan proposed by the system. Furthermore, data from monitoring devices allows anomaly detection mechanisms to monitor the home's security status in real time, and if an anomaly occurs, security management mechanisms respond quickly. Psychological adaptation mechanisms provide notifications that take into account the user's emotions during anomalies. 【0217】 For example, if a user is spending a holiday afternoon in their living room and their smile is detected, a prompt message will be generated stating, "The user's current emotional state is relaxed. Recommended content is healing music." Based on this information, the system can select appropriate content and play it through the home speakers. 【0218】 The flow of a specific process in Application Example 2 will be explained using Figure 14. 【0219】 Step 1: 【0220】 The server acquires energy data from information devices installed in the home using data collection methods. The input data is the usage status of each information device, and the output is integrated energy consumption data. By collecting this data, a foundation is formed for understanding energy consumption patterns within the home. 【0221】 Step 2: 【0222】 The server uses OpenCV and TensorFlow to analyze user facial expressions and audio data input from the camera and microphone using emotion-adaptive mechanisms. The input is the user's raw audio and video data, and the output is data indicating the user's emotional state. This analysis allows for real-time understanding of the user's current emotional state. 【0223】 Step 3: 【0224】 The server uses the energy data obtained in Step 1 and the emotion data obtained in Step 2 to generate a prompt sentence using a generative AI model. The input is the collected energy data and the user's emotion state data, and the output is the prompt sentence. This prompt sentence is used to organize the information necessary for proposing a service. 【0225】 Step 4: 【0226】 The server performs analysis to optimize energy consumption and transmits the optimized energy plan to the terminal using a communication method. The input is combined energy data, and the output is the optimized energy plan. This calculation enables efficient energy use that avoids peak times. 【0227】 Step 5: 【0228】 The terminal receives an optimized energy plan from the server and notifies the user. The input is the energy plan obtained from the server, and the output is the screen displaying the information. This allows the user to check their energy plan to see where they can reduce their energy consumption. 【0229】 Step 6: 【0230】 The user sends approval or modification of the notified energy plan to the server via their terminal. The input is data about the plan selected by the user, and the output is feedback to the server. This allows for the optimization of energy consumption with the user's permission. 【0231】 Step 7: 【0232】 The server uses emotion adaptation tools to select appropriate entertainment content based on the emotional state acquired in step 2, following the instructions in the prompt message, and then activates the playback tool to play it on the terminal. The input consists of the prompt message and content selection criteria, and the output is entertainment optimized for the user. This allows the user to experience content that best matches their current emotions. 【0233】 The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data. 【0234】 Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. 【0235】 In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14. 【0236】 [Second Embodiment] 【0237】 Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment. 【0238】 As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server. 【0239】 The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). 【0240】 The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52. 【0241】 The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46. 【0242】 Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision). 【0243】 Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner. 【0244】 Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56. 【0245】 The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30. 【0246】 The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. 【0247】 In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48. 【0248】 Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal". 【0249】 This invention is a system for the integrated management of smart devices within a home environment, and consists of three elements: a server, terminals, and users. 【0250】 First, the server periodically collects energy usage data from various electronic devices in the home (e.g., refrigerator, air conditioner, heater, lighting, etc.). Based on this data, the server analyzes the usage patterns of each device and calculates an optimal energy consumption schedule. Furthermore, based on the analysis results, the server generates a plan to optimize energy consumption and notifies the user. 【0251】 As a concrete example, the server suggests to the user that "raising the air conditioner's temperature setting by 1°C during peak afternoon hours can save 20% of energy." The user can review this suggestion on a smartphone app and approve or change it as needed. 【0252】 Next, the server receives data in real time from home security devices, such as surveillance cameras and door sensors, and monitors for any anomalies. If an anomaly is detected, the server immediately notifies the user. Upon receiving the notification, the user can view the security footage through a smartphone app and, if necessary, send commands to the device. For example, if suspicious activity is detected, the user can send a command to the device to remotely lock the door. 【0253】 Furthermore, the server analyzes the user's entertainment content preferences and suggests content to watch next based on their individual viewing history. The suggested content is displayed on the device, such as a TV or streaming device, and the user can start watching immediately after selecting it. 【0254】 Thus, the present invention aims to provide users with a safe, efficient, and comfortable home environment by seamlessly optimizing home energy management, security, and entertainment. 【0255】 The following describes the processing flow. 【0256】 Step 1: 【0257】 The server acquires energy usage data from various electronic devices installed in the home, including smart meters and direct device communication. The acquired data is sorted chronologically and recorded in a database. 【0258】 Step 2: 【0259】 The server analyzes the collected energy usage data to identify usage patterns. This analysis uses AI algorithms to understand consumption trends by device and time of day. After patterns are extracted, potential energy saving opportunities are identified. 【0260】 Step 3: 【0261】 The server generates an optimal energy management plan based on the analysis results. This includes suggestions to reduce device operation during specific time periods and adjustments to temperature settings. The generated plan is then communicated to the user. 【0262】 Step 4: 【0263】 The user reviews the energy management plan received from the server using a smartphone app. After reviewing the plan, the user can approve it or make any necessary adjustments. The user's selection is then returned to the server. 【0264】 Step 5: 【0265】 The terminal sends control instructions to each electronic device based on the energy plan approved by the user. Specifically, it adjusts the temperature setting of the air conditioner and controls the on / off of lights at specific times. 【0266】 Step 6: 【0267】 The server receives data from security devices in real time and applies anomaly detection algorithms to monitor for suspicious activity. If an anomaly is detected, the server immediately notifies the user. 【0268】 Step 7: 【0269】 The user receives a security alert from the server and reviews the provided data and video. If necessary, the user can decide on remote action and send commands to their terminal, such as locking a door. 【0270】 Step 8: 【0271】 The server analyzes the user's entertainment viewing history and suggests content for the next viewer. This suggestion is displayed on the user's device, depending on the terminal. 【0272】 Step 9: 【0273】 The user selects the content they want to watch from the suggested options. Once the selection is complete, the device automatically begins playing the selected content. 【0274】 (Example 1) 【0275】 Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal." 【0276】 In modern home environments, efficient management of various electrical appliances is required, but challenges remain in areas such as information gathering and analysis, and ensuring confidentiality. In particular, optimizing energy consumption, and enhancing security and safety are essential. Traditional methods often involve individual management, making efficient integrated management difficult. Therefore, there is a need for technology that integrates these elements to efficiently and safely manage the home environment. 【0277】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means. 【0278】 In this invention, the server includes an information collection means for acquiring information from a plurality of electrical and mechanical devices in the home environment, a computing means for performing an analysis to optimize energy consumption based on the acquired information, and a communication means for transmitting an optimized energy plan to the user based on the analysis results. Thereby, efficient energy management of electrical and mechanical devices in the home and enhanced safety can be achieved. 【0279】 The "information collection means" is a system or device for acquiring usage-related data from a plurality of electrical and mechanical devices in the home environment. 【0280】 The "computing means" is a system or algorithm for analyzing the acquired information and deriving an appropriate energy consumption pattern based thereon. 【0281】 The "communication means" is a system or technology for transmitting the analysis results to the user and notifying the energy plan. 【0282】 The "control means" is a system or device for operating a plurality of electrical and mechanical devices based on a plan approved by the user. 【0283】 The "abnormality identification means" is a system or technology for monitoring data from a security device in real time and identifying abnormal operations and situations. 【0284】 The "security management means" is a system or process for notifying the user of the results by the abnormality identification means and giving instructions and operations to the electrical and mechanical devices as necessary. 【0285】 The "content proposal means" is a system for analyzing the user's past viewing information and proposing entertainment content to be viewed next. 【0286】 The "reproduction means" is a system or device for visually or acoustically reproducing the entertainment content selected by the user. 【0287】 In one embodiment of the present invention, a system is provided for the integrated management of various electrical appliances in a home environment. This system consists of three elements: a server, a terminal, and a user. 【0288】 The server analyzes data collected from various electrical appliances in the home. Specifically, energy consumption data acquired by IoT sensors is sent to the server using communication methods such as Wi-Fi and Bluetooth. The server stores this data in a cloud database and analyzes device usage patterns using machine learning algorithms. Here, common machine learning tools are used for the analysis. Furthermore, the server generates an optimal energy plan based on the analysis results and sends suggestions to the user via a notification system. 【0289】 For example, the server might suggest, "Raising the air conditioner's temperature by 1°C during peak afternoon hours could save 20% energy." Users can review, approve, or adjust these suggestions via their smartphones. The smartphone app provides a user interface and assists with reviewing and approving energy plans. 【0290】 Furthermore, the server collects data in real time from home security devices and monitors for anomalies. If an anomaly is detected, it immediately notifies the user. The user receives the notification using their smartphone and can send control commands to the device as needed. For example, if abnormal activity is detected, the user can send a command to the device to remotely lock the door. 【0291】 In the entertainment field, servers analyze a user's viewing history and suggest content to watch next. This suggested content is displayed on the user's device via a TV or streaming device, allowing them to start watching immediately. 【0292】 For example, you can use text such as "Please tell me how to collect and optimize power consumption data for each device in my home" as an input prompt for the generating AI model. 【0293】 In this way, this system enables integrated management to improve the efficiency and safety of the home environment. 【0294】 The flow of the specific processing in Example 1 will be explained using Figure 11. 【0295】 Step 1: 【0296】 The server collects energy consumption data from each electrical appliance in the home. IoT sensors attached to each device transmit energy consumption information at that time via Wi-Fi or Bluetooth. Inputs include device identification information and energy consumption, which are integrated and stored in a cloud database. Outputs include energy consumption data for each device and the date. 【0297】 Step 2: 【0298】 The server analyzes the collected energy consumption data. Specifically, it processes information in a cloud database using scripts such as Python to extract usage patterns and peak consumption times for each device. Machine learning algorithms are applied to this analysis to detect abnormal usage patterns and generate data for optimization. Stored energy consumption data is used as input, and the output provides usage patterns for each device and optimization suggestions. 【0299】 Step 3: 【0300】 Based on the analysis results, the server generates a plan to optimize energy consumption. In this process, a generative AI model is utilized to devise convenient and efficient energy usage methods for the user. As input, the analysis results of the usage patterns are employed, and as output, an energy plan proposed to the user is created. 【0301】 Step 4: 【0302】 The server notifies the user of the generated energy plan. As a communication means, a cloud messaging service is used to send information to the smartphone app. As a specific example, a proposal such as "Raising the air conditioner temperature by 1°C during the afternoon peak hours can reduce energy consumption by 20%" is sent. The input is the generated energy plan, and the output is the notification to the user's smartphone. 【0303】 Step 5: 【0304】 The user uses the smartphone app to check the proposal and approves or modifies it. This operation is performed through the interface on the app, and the plan approved by the user is executed in the next step. The input is the energy plan notification from the server, and the output is the user's decision. 【0305】 Step 6: 【0306】 The server receives real-time information from the home security devices and monitors for abnormalities. An anomaly detection algorithm is applied to identify suspicious behaviors and movements. The input is the real-time information from the security devices, and the output is the detection result of abnormalities. 【0307】 Step 7: 【0308】 When an abnormality is detected, the server sends a notification to the user. After the user checks the notification, a control command is sent to the terminal through the smartphone app. For example, an operation to remotely lock the door can be performed. The input is the abnormality notification from the server, and the output is the control command to the terminal. 【0309】 Step 8: 【0310】 The server analyzes the user's entertainment viewing history and suggests content to watch next. This uses data on previously viewed content and genres, and predicts similar content through machine learning. The input is the user's viewing history, and the output is the suggested content. 【0311】 In this way, each step works in coordination to achieve efficient management and improved safety of electrical appliances in the home. 【0312】 (Application Example 1) 【0313】 Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal." 【0314】 In modern homes and man-made buildings, multiple electronic devices are scattered and function independently, resulting in separate optimizations of energy consumption, safety assurance, and the provision of information and entertainment. This leads to inefficiency overall and low user convenience. Furthermore, the complex management required tends to increase the burden on members of society. To solve these problems, a system is needed that can manage each device in an integrated and efficient manner. 【0315】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. 【0316】 In this invention, the server includes information gathering means, computing means, communication means, and control means. This makes it possible to integrally manage multiple electronic devices in a home environment or an entire artificial building, optimize energy consumption, ensure security, and seamlessly provide information and entertainment. 【0317】 "Home environment" refers to the living space within an individual residence or apartment building, as well as all the equipment installed within it. 【0318】 "Artificial structures" refer to buildings and facilities designed for human life and activities, which are structures that stand in contrast to the natural environment. 【0319】 "Members of society" refers to people who live in a particular region or environment, or to the individual people who make up that community. 【0320】 "Electronic device" refers to a device or equipment that operates using electrical or electronic means, or a system composed of such devices or equipment. 【0321】 "Information gathering means" refers to the processes, technical means, and devices used to acquire data. 【0322】 "Computational means" refers to the processes, algorithms, and devices used to analyze data and derive results. 【0323】 "Communication methods" refer to the processes, technologies, and devices used to transmit and share information. 【0324】 "Control means" refers to processes, technologies, and devices used to manage and adjust the operation and state of a system or equipment. 【0325】 To implement this invention, a system is needed to centrally manage multiple electronic devices placed in a home environment or artificial building. This system consists of three elements: a server, a terminal, and a user. 【0326】 The server periodically acquires data such as energy consumption from various electronic devices within homes and buildings. To achieve this, sensors are installed in each device, and this data is aggregated on the server via an IoT network. The server uses this data to analyze energy consumption patterns using real-time data analysis tools such as Apache Kafka, and calculates an optimal consumption schedule. The analysis results are then notified to members of society using cloud services such as Google Cloud and AWS. Users who receive the notification can then approve the proposed plan using their own devices. 【0327】 The terminal controls related electronic devices based on user instructions. For example, remote control is possible using a smartphone or smart home hub. It not only optimizes energy consumption according to the situation but also performs real-time safety management, promptly notifying the user if an anomaly is detected. This function is used, for example, for home security management using surveillance cameras and door sensors. 【0328】 Furthermore, this system can also be applied to providing information and entertainment. The server analyzes the user's preferences based on their past viewing data and suggests the most suitable information and entertainment. This process utilizes a generative AI model to suggest content based on viewing history. This allows members of society to efficiently enjoy entertainment. 【0329】 As a concrete example, consider a scenario where a large amount of electricity is consumed temporarily on a hot summer day. In this case, the system coordinates with other households to adjust energy consumption and optimizes air conditioner usage based on the proposed plan. This can reduce peak electricity consumption. 【0330】 An example of a prompt message is, "Please tell me how to optimize energy use this summer. Please provide specific suggestions, including peak air conditioning temperature settings." 【0331】 The flow of a specific process in Application Example 1 will be explained using Figure 12. 【0332】 Step 1: 【0333】 The server acquires energy usage data from sensors in various electronic devices within homes and buildings. This input data is collected via an IoT network and stored in a database. Here, data preprocessing is performed, including noise reduction and missing value imputation. 【0334】 Step 2: 【0335】 The server performs real-time data analysis based on the acquired energy usage data. Using Apache Kafka, it processes the data as a stream and analyzes the energy consumption patterns of each device. This identifies consumption peaks and wasteful usage, resulting in the output of foundational data for optimization. 【0336】 Step 3: 【0337】 Based on the analysis results, the server uses Google Cloud's AI tools to calculate the optimal energy consumption schedule through a generative AI model. This calculation combines historical data with predictive algorithms to output an efficient consumption plan. 【0338】 Step 4: 【0339】 The server notifies members of society of an energy consumption optimization plan. This output data is sent to the user's smartphone as a push notification. The notification includes specific suggestions, such as "raise the air conditioner temperature by 1°C during the afternoon peak hours." 【0340】 Step 5: 【0341】 The user uses their device to review the notification and approve it or change settings as needed. Based on the user's input, the device sends data back to the server, and the approved plan is saved. 【0342】 Step 6: 【0343】 Based on an approved plan, the device controls each electronic device via a smart home hub. For example, it optimizes energy consumption by automatically changing the temperature settings of an air conditioner. 【0344】 Step 7: 【0345】 To ensure users can enjoy entertainment with peace of mind, the server uses an AI model based on past viewing data to suggest content. Examples of prompts include "How can I optimize my energy usage this summer?", suggesting the most suitable information and entertainment for the user. 【0346】 Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions. 【0347】 This invention provides a system that integrates and controls smart devices within the home, and further recognizes and adapts to the user's emotions to provide services. The system mainly consists of a server, terminals, an emotion engine, and the user. 【0348】 First, the server periodically acquires energy usage data from multiple electronic devices within the home. Based on this data, the server uses AI algorithms to perform analysis to optimize energy consumption. For example, it can analyze the home's consumption patterns and propose a device operation plan that avoids peak power times. 【0349】 The emotion engine analyzes the user's facial expressions and voice to recognize their emotions. This allows the server to understand the user's current emotional state. Based on this information, the server designs and notifies the user of an energy plan that it believes will be most acceptable to them. For example, if the user is relaxed, it will offer more detailed suggestions; if they appear to be in a hurry, it will offer concise and direct suggestions. 【0350】 Furthermore, the server acquires information from various security devices in real time and responds flexibly based on the user's emotions when an anomaly is detected. If the user is in a panic state when an anomaly occurs, the server will notify them of more stable and rapid countermeasures. If the user is at ease, it will provide normal notifications and, if necessary, take control through the terminal based on appropriate instructions. 【0351】 Furthermore, the server utilizes the emotion engine to suggest entertainment content. It can analyze the user's emotional state and recommend the most suitable entertainment content. For example, if the user is stressed, it will suggest relaxing content, and if they are feeling energetic, it will suggest dynamic content such as action movies. 【0352】 As described above, the system of the present invention aims to improve home life in a more convenient, comfortable, safe, and efficient way by providing flexible and adaptive services that respond to the user's emotional state. 【0353】 The following describes the processing flow. 【0354】 Step 1: 【0355】 The server acquires energy usage data directly from multiple electronic devices installed in the home, or via sensors. This data is stored in a database along with a timestamp, as it forms the basis for subsequent energy consumption optimization. 【0356】 Step 2: 【0357】 The server uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes the user's facial expressions and voice input to identify emotions such as whether the user is relaxed or stressed. 【0358】 Step 3: 【0359】 Based on the energy data acquired in Step 1, the server uses an AI algorithm to generate an optimized energy consumption plan. At this time, it adjusts how the plan is proposed, taking into account the user's emotional state as determined by the emotion engine. For example, it provides detailed information when the user is relaxed and offers concise suggestions when the user is stressed. 【0360】 Step 4: 【0361】 Users review energy consumption plan suggestions sent from the server via a smartphone app. Based on suggestions optimized to the user's preferences, users can approve or modify the plan. 【0362】 Step 5: 【0363】 The terminal controls each electronic device based on a plan approved by the user. Specifically, it automatically adjusts the temperature settings of air conditioners and manages the lighting schedule to achieve efficient energy use. 【0364】 Step 6: 【0365】 The server receives data from security devices in real time and applies anomaly detection algorithms to monitor suspicious activity. If an anomaly is detected, the server adjusts the content and method of notification based on the user's emotional response. For example, it might send a message emphasizing reassurance or immediately provide detailed instructions. 【0366】 Step 7: 【0367】 Users review security notifications sent from the server and respond quickly as needed. With the assistance of an emotion engine, users are encouraged to respond calmly and can send commands directly from their smartphones to their devices to control the security status within their homes. 【0368】 Step 8: 【0369】 The server analyzes the user's entertainment viewing history and current emotional state to suggest the most suitable content. This suggestion is tailored to the user's mood; for example, it might recommend calming movies if the user is relaxed, or action films if they are feeling active. 【0370】 Step 9: 【0371】 The user selects and plays the suggested content on their device. The device automatically starts playing the selected content, providing the user with a comfortable and personalized entertainment experience. 【0372】 (Example 2) 【0373】 Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal". 【0374】 In modern homes, a wide variety of electrical devices are connected to the internet, creating a demand for efficient energy management. However, conventional systems often provide uniform responses without considering the user's emotional state, making satisfactory personalization difficult. Furthermore, while flexible responses tailored to individual situations and emotions are required in terms of security, current systems do not adequately meet this need. In addition, selecting optimal content based on the user's emotions is a challenge in entertainment offerings. 【0375】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. 【0376】 In this invention, the server includes data collection means for acquiring energy usage data from multiple electrical devices in the home environment, emotion recognition means for recognizing the user's emotional state using an emotion engine, and computation means for performing analysis to optimize energy consumption based on the acquired energy data and emotional state data. This enables efficient power consumption within the home and the provision of adaptive services that respond to the user's emotions. 【0377】 "Energy usage data" refers to information about the amount of energy consumed and usage patterns of multiple electrical devices. 【0378】 An "emotion engine" refers to a function or system that analyzes information such as a user's facial expressions and voice to identify their current emotional state. 【0379】 "Data acquisition means" refers to methods and devices for acquiring necessary data from multiple electrical devices. 【0380】 "Emotion recognition means" refers to methods and devices used to understand a user's emotional state. 【0381】 "Computational means" refers to the technologies and processes used to perform necessary analyses and calculations based on collected data. 【0382】 "Communication methods" refer to methods and devices for conveying analysis results and proposed content to users. 【0383】 "Control means" refers to methods or devices for managing electrical equipment based on instructions from the user. 【0384】 "Anomaly detection means" refers to methods and devices for analyzing data provided by security devices to identify the occurrence of anomalies. 【0385】 "Security management measures" refer to functions and systems that notify users in the event of an anomaly and control electrical devices as necessary. 【0386】 "Content suggestion means" refers to methods and devices for selecting and recommending entertainment content based on past viewing data and emotional states. 【0387】 "Playback means" refers to methods or devices for displaying or playing content selected by the user. 【0388】 This invention is a system that centrally manages multiple electrical devices in the home and optimizes the living environment according to the user's emotional state. The system mainly consists of a server, terminals, an emotion engine, and the user. 【0389】 The server collects energy usage data from multiple electrical devices. This includes smart meters and device sensors that track power consumption. The server integrates this collected data and uses AI algorithms to analyze it and optimize energy consumption. Specifically, it creates power optimization plans based on past consumption patterns. 【0390】 For example, the server can suggest operating the washing machine at times when electricity rates are high during the day. 【0391】 The device uses its camera and microphone to transmit the user's facial expressions and voice to the emotion engine. The emotion engine identifies the user's emotions and sends that information to the server. Based on this, the server selects and notifies the user of the most suitable energy plan and entertainment content. 【0392】 For example, when a user is relaxing, the system might suggest relaxing music along with detailed power-saving tips. 【0393】 Furthermore, the server can monitor data from security devices in real time and provide flexible responses based on emotional states. 【0394】 Examples of prompts include, "Please explain how to optimize the power consumption of smart devices in your home," and "Please tell me about an algorithm that suggests entertainment based on the user's emotions." 【0395】 This invention is expected to make home life more comfortable and energy-efficient. 【0396】 The flow of the specific processing in Example 2 will be explained using Figure 13. 【0397】 Step 1: 【0398】 The server collects energy usage data from each electrical appliance installed in the home. This data includes the amount of electricity each device consumes at any given time. The server records this data in a database in real time and stores it as baseline data for analyzing energy usage patterns. 【0399】 Step 2: 【0400】 The device uses camera and microphone sensors to capture the user's facial expressions and voice as input in order to understand the user's emotional state. The emotion engine analyzes this data and sends the detected emotional state (e.g., relaxed, stressed, focused) to the server. The server stores this information in an emotion database and uses it in the next step. 【0401】 Step 3: 【0402】 The server uses an AI algorithm to perform data calculations to optimize energy consumption, taking the energy usage data collected in Step 1 and the user's emotional state obtained in Step 2 as input. This allows it to output an optimal energy plan, such as suggestions for peak shifting based on energy usage patterns or suggestions for temperature adjustments based on the user's emotional state. 【0403】 Step 4: 【0404】 The server notifies the user of the optimal energy plan obtained in step 3 via communication. The notification includes specific energy-saving methods and suggestions for when to turn devices on and off. The user can review this on their device screen and approve or modify the plan. 【0405】 Step 5: 【0406】 The server automatically controls each electrical appliance in the home based on the user's approved plan. For example, it adjusts the air conditioner's temperature setting to match the user's relaxation state. It also sets the start times for washing machines and dishwashers based on the proposed power usage time. 【0407】 Step 6: 【0408】 The server monitors real-time data from security devices as input and outputs flexible response measures tailored to the emotional state if an anomaly occurs. In the event of an anomaly, the user is notified of the situation and prompt action is taken as needed. 【0409】 Step 7: 【0410】 The server utilizes a generative AI model to suggest entertainment content based on the user's emotional state and past viewing history. It receives emotional state and history data as input, and the AI ​​outputs a content plan recommending relaxing music and videos, which is then provided to the user. 【0411】 (Application Example 2) 【0412】 Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal." 【0413】 In modern home environments, it is common for multiple information devices to be introduced and controlled individually, but this leads to wasted energy and inefficiencies between devices. Furthermore, while flexible responses that respond to users' emotions are required, current systems have difficulty accurately understanding users' emotional states and controlling devices accordingly. As a result, home life is not always comfortable, and security concerns remain. 【0414】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. 【0415】 In this invention, the server includes information gathering means for acquiring data from multiple information devices in the home environment, processing means for performing analysis to optimize energy consumption based on the acquired data, and emotion adaptation means for recognizing the user's emotional state and providing appropriate information and controlling devices based on the acquired emotion data. As a result, not only is energy consumption in the home optimized, but device management tailored to each user's emotions becomes possible, realizing a more comfortable and safe living environment. 【0416】 An "information gathering device" is a device that has the function of acquiring data on usage status and condition from multiple information devices within the home environment. 【0417】 A "processing device" is a device that analyzes acquired data and performs calculations and decisions to optimize energy consumption. 【0418】 A "transmission means" is a device that has a communication function to notify users of an optimized energy plan. 【0419】 "Operating means" refers to a device that has the function of controlling multiple information devices based on a plan approved by the user. 【0420】 An "emotional adaptation device" is a device that analyzes the user's facial expressions and voice, recognizes their emotional state, and provides appropriate information or operates equipment based on that recognition. 【0421】 An "anomaly detection means" is a device that collects data from monitoring equipment in real time and has the function of automatically detecting abnormal situations. 【0422】 A "safety management device" is a device that has the function of notifying users of detected abnormal situations, receiving necessary instructions, and controlling multiple information devices. 【0423】 A "psychological response device" is a device that, in abnormal situations, considers the user's psychological state using emotional adaptation tools and provides appropriate countermeasures. 【0424】 A "content suggestion device" is a device that analyzes a user's past usage data and suggests entertainment content based on the results. 【0425】 A "sentiment analysis device" is a device that analyzes the emotional state of a user and has the function of selecting the most appropriate content based on that analysis. 【0426】 A "playback device" is a device that has the function of playing back content selected by the user in an optimal environment within the home. 【0427】 This invention is a system for realizing integrated control of multiple information devices within a home environment. Specific embodiments thereof are described below. 【0428】 The server is configured using a Raspberry Pi and connects to multiple information devices via a home network. As a means of information gathering, the server has the functionality to acquire usage status and energy data from each information device via a smart home appliance API. Furthermore, as a means of emotional adaptation, it uses an emotion recognition algorithm combining OpenCV and TensorFlow to analyze the user's facial expressions and voice data. 【0429】 The devices used are smartphones and tablets, and they connect via Bluetooth or Wi-Fi to receive notifications from the server. The means of communication include notifying users of analyzed, optimized energy plans and content suggestions based on their emotions. 【0430】 Users control information devices and approve energy plans through their terminals. Emotional adaptation mechanisms provide appropriate information and services based on the user's current emotional state. For example, when a user is relaxed, they can review and approve the details of the energy plan proposed by the system. Furthermore, data from monitoring devices allows anomaly detection mechanisms to monitor the home's security status in real time, and if an anomaly occurs, security management mechanisms respond quickly. Psychological adaptation mechanisms provide notifications that take into account the user's emotions during anomalies. 【0431】 For example, if a user is spending a holiday afternoon in their living room and their smile is detected, a prompt message will be generated stating, "The user's current emotional state is relaxed. Recommended content is healing music." Based on this information, the system can select appropriate content and play it through the home speakers. 【0432】 The flow of a specific process in Application Example 2 will be explained using Figure 14. 【0433】 Step 1: 【0434】 The server acquires energy data from information devices installed in the home using data collection methods. The input data is the usage status of each information device, and the output is integrated energy consumption data. By collecting this data, a foundation is formed for understanding energy consumption patterns within the home. 【0435】 Step 2: 【0436】 The server uses OpenCV and TensorFlow to analyze user facial expressions and audio data input from the camera and microphone using emotion-adaptive mechanisms. The input is the user's raw audio and video data, and the output is data indicating the user's emotional state. This analysis allows for real-time understanding of the user's current emotional state. 【0437】 Step 3: 【0438】 The server uses the energy data obtained in Step 1 and the emotion data obtained in Step 2 to generate a prompt sentence using a generative AI model. The input is the collected energy data and the user's emotion state data, and the output is the prompt sentence. This prompt sentence is used to organize the information necessary for proposing a service. 【0439】 Step 4: 【0440】 The server performs analysis to optimize energy consumption and transmits the optimized energy plan to the terminal using a communication method. The input is combined energy data, and the output is the optimized energy plan. This calculation enables efficient energy use that avoids peak times. 【0441】 Step 5: 【0442】 The terminal receives an optimized energy plan from the server and notifies the user. The input is the energy plan obtained from the server, and the output is the screen displaying the information. This allows the user to check their energy plan to see where they can reduce their energy consumption. 【0443】 Step 6: 【0444】 The user sends approval or modification of the notified energy plan to the server via their terminal. The input is data about the plan selected by the user, and the output is feedback to the server. This allows for the optimization of energy consumption with the user's permission. 【0445】 Step 7: 【0446】 The server uses emotion adaptation tools to select appropriate entertainment content based on the emotional state acquired in step 2, following the instructions in the prompt message, and then activates the playback tool to play it on the terminal. The input consists of the prompt message and content selection criteria, and the output is entertainment optimized for the user. This allows the user to experience content that best matches their current emotions. 【0447】 The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data. 【0448】 Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. 【0449】 In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214. 【0450】 [Third Embodiment] 【0451】 Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment. 【0452】 As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server. 【0453】 The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). 【0454】 The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52. 【0455】 The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46. 【0456】 Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision). 【0457】 Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner. 【0458】 Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56. 【0459】 The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30. 【0460】 The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. 【0461】 In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48. 【0462】 Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal". 【0463】 This invention is a system for the integrated management of smart devices within a home environment, and consists of three elements: a server, terminals, and users. 【0464】 First, the server periodically collects energy usage data from various electronic devices in the home (e.g., refrigerator, air conditioner, heater, lighting, etc.). Based on this data, the server analyzes the usage patterns of each device and calculates an optimal energy consumption schedule. Furthermore, based on the analysis results, the server generates a plan to optimize energy consumption and notifies the user. 【0465】 As a concrete example, the server suggests to the user that "raising the air conditioner's temperature setting by 1°C during peak afternoon hours can save 20% of energy." The user can review this suggestion on a smartphone app and approve or change it as needed. 【0466】 Next, the server receives data in real time from home security devices, such as surveillance cameras and door sensors, and monitors for any anomalies. If an anomaly is detected, the server immediately notifies the user. Upon receiving the notification, the user can view the security footage through a smartphone app and, if necessary, send commands to the device. For example, if suspicious activity is detected, the user can send a command to the device to remotely lock the door. 【0467】 Furthermore, the server analyzes the user's entertainment content preferences and suggests content to watch next based on their individual viewing history. The suggested content is displayed on the device, such as a TV or streaming device, and the user can start watching immediately after selecting it. 【0468】 Thus, the present invention aims to provide users with a safe, efficient, and comfortable home environment by seamlessly optimizing home energy management, security, and entertainment. 【0469】 The following describes the processing flow. 【0470】 Step 1: 【0471】 The server acquires energy usage data from various electronic devices installed in the home, including smart meters and direct device communication. The acquired data is sorted chronologically and recorded in a database. 【0472】 Step 2: 【0473】 The server analyzes the collected energy usage data to identify usage patterns. This analysis uses AI algorithms to understand consumption trends by device and time of day. After patterns are extracted, potential energy saving opportunities are identified. 【0474】 Step 3: 【0475】 The server generates an optimal energy management plan based on the analysis results. This includes suggestions to reduce device operation during specific time periods and adjustments to temperature settings. The generated plan is then communicated to the user. 【0476】 Step 4: 【0477】 The user reviews the energy management plan received from the server using a smartphone app. After reviewing the plan, the user can approve it or make any necessary adjustments. The user's selection is then returned to the server. 【0478】 Step 5: 【0479】 The terminal sends control instructions to each electronic device based on the energy plan approved by the user. Specifically, it adjusts the temperature setting of the air conditioner and controls the on / off of lights at specific times. 【0480】 Step 6: 【0481】 The server receives data from security devices in real time and applies anomaly detection algorithms to monitor for suspicious activity. If an anomaly is detected, the server immediately notifies the user. 【0482】 Step 7: 【0483】 The user receives a security alert from the server and reviews the provided data and video. If necessary, the user can decide on remote action and send commands to their terminal, such as locking a door. 【0484】 Step 8: 【0485】 The server analyzes the user's entertainment viewing history and suggests content for the next viewer. This suggestion is displayed on the user's device, depending on the terminal. 【0486】 Step 9: 【0487】 The user selects the content they want to watch from the suggested options. Once the selection is complete, the device automatically begins playing the selected content. 【0488】 (Example 1) 【0489】 Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal." 【0490】 In modern home environments, efficient management of various electrical appliances is required, but challenges remain in areas such as information gathering and analysis, and ensuring confidentiality. In particular, optimizing energy consumption, and enhancing security and safety are essential. Traditional methods often involve individual management, making efficient integrated management difficult. Therefore, there is a need for technology that integrates these elements to efficiently and safely manage the home environment. 【0491】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means. 【0492】 In this invention, the server includes information gathering means for acquiring information from multiple electrical appliances in the home environment, calculation means for performing analysis to optimize energy consumption based on the acquired information, and communication means for transmitting the optimized energy plan to the user based on the analysis results. This enables efficient energy management of electrical appliances in the home and enhances safety. 【0493】 "Information gathering means" refers to a system or device for acquiring usage data from multiple electrical appliances within a home environment. 【0494】 A "computational means" is a system or algorithm for analyzing acquired information and deriving an appropriate energy consumption pattern based on that analysis. 【0495】 "Communication means" refers to a system or technology for transmitting analysis results to users and notifying them of their energy plan. 【0496】 A "control device" is a system or device for operating multiple electrical machines based on a plan approved by the user. 【0497】 An "anomaly identification means" is a system or technology for monitoring data from security devices in real time and identifying abnormal behavior or situations. 【0498】 "Safety management means" refers to a system or process for notifying users of the results obtained by anomaly identification means and, if necessary, giving instructions or performing operations on electrical machinery. 【0499】 A "content suggestion system" is a system that analyzes a user's past viewing information and suggests entertainment content they should watch next. 【0500】 "Playback means" refers to a system or device for visually or audibly reproducing entertainment content selected by the user. 【0501】 In one embodiment of the present invention, a system is provided for the integrated management of various electrical appliances in a home environment. This system consists of three elements: a server, a terminal, and a user. 【0502】 The server analyzes data collected from various electrical appliances in the home. Specifically, energy consumption data acquired by IoT sensors is sent to the server using communication methods such as Wi-Fi and Bluetooth. The server stores this data in a cloud database and analyzes device usage patterns using machine learning algorithms. Here, common machine learning tools are used for the analysis. Furthermore, the server generates an optimal energy plan based on the analysis results and sends suggestions to the user via a notification system. 【0503】 For example, the server might suggest, "Raising the air conditioner's temperature by 1°C during peak afternoon hours could save 20% energy." Users can review, approve, or adjust these suggestions via their smartphones. The smartphone app provides a user interface and assists with reviewing and approving energy plans. 【0504】 Furthermore, the server collects data in real time from home security devices and monitors for anomalies. If an anomaly is detected, it immediately notifies the user. The user receives the notification using their smartphone and can send control commands to the device as needed. For example, if abnormal activity is detected, the user can send a command to the device to remotely lock the door. 【0505】 In the entertainment field, servers analyze a user's viewing history and suggest content to watch next. This suggested content is displayed on the user's device via a TV or streaming device, allowing them to start watching immediately. 【0506】 For example, you can use text such as "Please tell me how to collect and optimize power consumption data for each device in my home" as an input prompt for the generating AI model. 【0507】 In this way, this system enables integrated management to improve the efficiency and safety of the home environment. 【0508】 The flow of the specific processing in Example 1 will be explained using Figure 11. 【0509】 Step 1: 【0510】 The server collects energy consumption data from each electrical appliance in the home. IoT sensors attached to each device transmit energy consumption information at that time via Wi-Fi or Bluetooth. Inputs include device identification information and energy consumption, which are integrated and stored in a cloud database. Outputs include energy consumption data for each device and the date. 【0511】 Step 2: 【0512】 The server analyzes the collected energy consumption data. Specifically, it processes information in a cloud database using scripts such as Python to extract usage patterns and peak consumption times for each device. Machine learning algorithms are applied to this analysis to detect abnormal usage patterns and generate data for optimization. Stored energy consumption data is used as input, and the output provides usage patterns for each device and optimization suggestions. 【0513】 Step 3: 【0514】 The server generates a plan to optimize energy consumption based on the analysis results. In this process, a generation AI model is used to devise a convenient and efficient energy usage method for the user. The input is the analysis results of usage patterns, and the output is an energy plan proposed to the user. 【0515】 Step 4: 【0516】 The server notifies the user of the generated energy plan. It uses a cloud messaging service to send information to a smartphone app. For example, a suggestion such as, "Raising the air conditioner temperature by 1°C during peak afternoon hours can reduce energy consumption by 20%," might be sent. The input is the generated energy plan, and the output is the notification sent to the user's smartphone. 【0517】 Step 5: 【0518】 Users review proposals using a smartphone app and approve or modify them. This operation is performed through the app's interface, and plans approved by the user are implemented in the next step. The input is the energy plan notification from the server, and the output is the user's decision. 【0519】 Step 6: 【0520】 The server receives information in real time from home security devices and monitors for anomalies. It applies anomaly detection algorithms to identify suspicious behavior and movements. The input is real-time information from security devices, and the output is the anomaly detection result. 【0521】 Step 7: 【0522】 If an anomaly is detected, the server sends a notification to the user. After the user confirms the notification, they send a control command to their device via a smartphone app. For example, they can remotely lock a door. The input is the anomaly notification from the server, and the output is the control command sent to the device. 【0523】 Step 8: 【0524】 The server analyzes the user's entertainment viewing history and suggests content to watch next. This uses data on previously viewed content and genres, and predicts similar content through machine learning. The input is the user's viewing history, and the output is the suggested content. 【0525】 In this way, each step works in coordination to achieve efficient management and improved safety of electrical appliances in the home. 【0526】 (Application Example 1) 【0527】 Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal." 【0528】 In modern homes and man-made buildings, multiple electronic devices are scattered and function independently, resulting in separate optimizations of energy consumption, safety assurance, and the provision of information and entertainment. This leads to inefficiency overall and low user convenience. Furthermore, the complex management required tends to increase the burden on members of society. To solve these problems, a system is needed that can manage each device in an integrated and efficient manner. 【0529】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. 【0530】 In this invention, the server includes information gathering means, computing means, communication means, and control means. This makes it possible to integrally manage multiple electronic devices in a home environment or an entire artificial building, optimize energy consumption, ensure security, and seamlessly provide information and entertainment. 【0531】 "Home environment" refers to the living space within an individual residence or apartment building, as well as all the equipment installed within it. 【0532】 "Artificial structures" refer to buildings and facilities designed for human life and activities, which are structures that stand in contrast to the natural environment. 【0533】 "Members of society" refers to people who live in a particular region or environment, or to the individual people who make up that community. 【0534】 "Electronic device" refers to a device or equipment that operates using electrical or electronic means, or a system composed of such devices or equipment. 【0535】 "Information gathering means" refers to the processes, technical means, and devices used to acquire data. 【0536】 "Computational means" refers to the processes, algorithms, and devices used to analyze data and derive results. 【0537】 "Communication methods" refer to the processes, technologies, and devices used to transmit and share information. 【0538】 "Control means" refers to processes, technologies, and devices used to manage and adjust the operation and state of a system or equipment. 【0539】 To implement this invention, a system is needed to centrally manage multiple electronic devices placed in a home environment or artificial building. This system consists of three elements: a server, a terminal, and a user. 【0540】 The server periodically acquires data such as energy consumption from various electronic devices within homes and buildings. To achieve this, sensors are installed in each device, and this data is aggregated on the server via an IoT network. The server uses this data to analyze energy consumption patterns using real-time data analysis tools such as Apache Kafka, and calculates an optimal consumption schedule. The analysis results are then notified to members of society using cloud services such as Google Cloud and AWS. Users who receive the notification can then approve the proposed plan using their own devices. 【0541】 The terminal controls related electronic devices based on user instructions. For example, remote control is possible using a smartphone or smart home hub. It not only optimizes energy consumption according to the situation but also performs real-time safety management, promptly notifying the user if an anomaly is detected. This function is used, for example, for home security management using surveillance cameras and door sensors. 【0542】 Furthermore, this system can also be applied to providing information and entertainment. The server analyzes the user's preferences based on their past viewing data and suggests the most suitable information and entertainment. This process utilizes a generative AI model to suggest content based on viewing history. This allows members of society to efficiently enjoy entertainment. 【0543】 As a concrete example, consider a scenario where a large amount of electricity is consumed temporarily on a hot summer day. In this case, the system coordinates with other households to adjust energy consumption and optimizes air conditioner usage based on the proposed plan. This can reduce peak electricity consumption. 【0544】 An example of a prompt message is, "Please tell me how to optimize energy use this summer. Please provide specific suggestions, including peak air conditioning temperature settings." 【0545】 The flow of a specific process in Application Example 1 will be explained using Figure 12. 【0546】 Step 1: 【0547】 The server acquires energy usage data from sensors in various electronic devices within homes and buildings. This input data is collected via an IoT network and stored in a database. Here, data preprocessing is performed, including noise reduction and missing value imputation. 【0548】 Step 2: 【0549】 The server performs real-time data analysis based on the acquired energy usage data. Using Apache Kafka, it processes the data as a stream and analyzes the energy consumption patterns of each device. This identifies consumption peaks and wasteful usage, resulting in the output of foundational data for optimization. 【0550】 Step 3: 【0551】 Based on the analysis results, the server uses Google Cloud's AI tools to calculate the optimal energy consumption schedule through a generative AI model. This calculation combines historical data with predictive algorithms to output an efficient consumption plan. 【0552】 Step 4: 【0553】 The server notifies members of society of an energy consumption optimization plan. This output data is sent to the user's smartphone as a push notification. The notification includes specific suggestions, such as "raise the air conditioner temperature by 1°C during the afternoon peak hours." 【0554】 Step 5: 【0555】 The user uses their device to review the notification and approve it or change settings as needed. Based on the user's input, the device sends data back to the server, and the approved plan is saved. 【0556】 Step 6: 【0557】 Based on an approved plan, the device controls each electronic device via a smart home hub. For example, it optimizes energy consumption by automatically changing the temperature settings of an air conditioner. 【0558】 Step 7: 【0559】 To ensure users can enjoy entertainment with peace of mind, the server uses an AI model based on past viewing data to suggest content. Examples of prompts include "How can I optimize my energy usage this summer?", suggesting the most suitable information and entertainment for the user. 【0560】 Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions. 【0561】 This invention provides a system that integrates and controls smart devices within the home, and further recognizes and adapts to the user's emotions to provide services. The system mainly consists of a server, terminals, an emotion engine, and the user. 【0562】 First, the server periodically acquires energy usage data from multiple electronic devices within the home. Based on this data, the server uses AI algorithms to perform analysis to optimize energy consumption. For example, it can analyze the home's consumption patterns and propose a device operation plan that avoids peak power times. 【0563】 The emotion engine analyzes the user's facial expressions and voice to recognize their emotions. This allows the server to understand the user's current emotional state. Based on this information, the server designs and notifies the user of an energy plan that it believes will be most acceptable to them. For example, if the user is relaxed, it will offer more detailed suggestions; if they appear to be in a hurry, it will offer concise and direct suggestions. 【0564】 Furthermore, the server acquires information from various security devices in real time and responds flexibly based on the user's emotions when an anomaly is detected. If the user is in a panic state when an anomaly occurs, the server will notify them of more stable and rapid countermeasures. If the user is at ease, it will provide normal notifications and, if necessary, take control through the terminal based on appropriate instructions. 【0565】 Furthermore, the server utilizes the emotion engine to suggest entertainment content. It can analyze the user's emotional state and recommend the most suitable entertainment content. For example, if the user is stressed, it will suggest relaxing content, and if they are feeling energetic, it will suggest dynamic content such as action movies. 【0566】 As described above, the system of the present invention aims to improve home life in a more convenient, comfortable, safe, and efficient way by providing flexible and adaptive services that respond to the user's emotional state. 【0567】 The following describes the processing flow. 【0568】 Step 1: 【0569】 The server acquires energy usage data directly from multiple electronic devices installed in the home, or via sensors. This data is stored in a database along with a timestamp, as it forms the basis for subsequent energy consumption optimization. 【0570】 Step 2: 【0571】 The server uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes the user's facial expressions and voice input to identify emotions such as whether the user is relaxed or stressed. 【0572】 Step 3: 【0573】 Based on the energy data acquired in Step 1, the server uses an AI algorithm to generate an optimized energy consumption plan. At this time, it adjusts how the plan is proposed, taking into account the user's emotional state as determined by the emotion engine. For example, it provides detailed information when the user is relaxed and offers concise suggestions when the user is stressed. 【0574】 Step 4: 【0575】 Users review energy consumption plan suggestions sent from the server via a smartphone app. Based on suggestions optimized to the user's preferences, users can approve or modify the plan. 【0576】 Step 5: 【0577】 The terminal controls each electronic device based on a plan approved by the user. Specifically, it automatically adjusts the temperature settings of air conditioners and manages the lighting schedule to achieve efficient energy use. 【0578】 Step 6: 【0579】 The server receives data from security devices in real time and applies anomaly detection algorithms to monitor suspicious activity. If an anomaly is detected, the server adjusts the content and method of notification based on the user's emotional response. For example, it might send a message emphasizing reassurance or immediately provide detailed instructions. 【0580】 Step 7: 【0581】 Users review security notifications sent from the server and respond quickly as needed. With the assistance of an emotion engine, users are encouraged to respond calmly and can send commands directly from their smartphones to their devices to control the security status within their homes. 【0582】 Step 8: 【0583】 The server analyzes the user's entertainment viewing history and current emotional state to suggest the most suitable content. This suggestion is tailored to the user's mood; for example, it might recommend calming movies if the user is relaxed, or action films if they are feeling active. 【0584】 Step 9: 【0585】 The user selects and plays the suggested content on their device. The device automatically starts playing the selected content, providing the user with a comfortable and personalized entertainment experience. 【0586】 (Example 2) 【0587】 Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal." 【0588】 In modern homes, a wide variety of electrical devices are connected to the internet, creating a demand for efficient energy management. However, conventional systems often provide uniform responses without considering the user's emotional state, making satisfactory personalization difficult. Furthermore, while flexible responses tailored to individual situations and emotions are required in terms of security, current systems do not adequately meet this need. In addition, selecting optimal content based on the user's emotions is a challenge in entertainment offerings. 【0589】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. 【0590】 In this invention, the server includes data collection means for acquiring energy usage data from multiple electrical devices in the home environment, emotion recognition means for recognizing the user's emotional state using an emotion engine, and computation means for performing analysis to optimize energy consumption based on the acquired energy data and emotional state data. This enables efficient power consumption within the home and the provision of adaptive services that respond to the user's emotions. 【0591】 "Energy usage data" refers to information about the amount of energy consumed and usage patterns of multiple electrical devices. 【0592】 An "emotion engine" refers to a function or system that analyzes information such as a user's facial expressions and voice to identify their current emotional state. 【0593】 "Data acquisition means" refers to methods and devices for acquiring necessary data from multiple electrical devices. 【0594】 "Emotion recognition means" refers to methods and devices used to understand a user's emotional state. 【0595】 "Computational means" refers to the technologies and processes used to perform necessary analyses and calculations based on collected data. 【0596】 "Communication methods" refer to methods and devices for conveying analysis results and proposed content to users. 【0597】 "Control means" refers to methods or devices for managing electrical equipment based on instructions from the user. 【0598】 "Anomaly detection means" refers to methods and devices for analyzing data provided by security devices to identify the occurrence of anomalies. 【0599】 "Security management measures" refer to functions and systems that notify users in the event of an anomaly and control electrical devices as necessary. 【0600】 "Content suggestion means" refers to methods and devices for selecting and recommending entertainment content based on past viewing data and emotional states. 【0601】 "Playback means" refers to methods or devices for displaying or playing content selected by the user. 【0602】 This invention is a system that centrally manages multiple electrical devices in the home and optimizes the living environment according to the user's emotional state. The system mainly consists of a server, terminals, an emotion engine, and the user. 【0603】 The server collects energy usage data from multiple electrical devices. This includes smart meters and device sensors that track power consumption. The server integrates this collected data and uses AI algorithms to analyze it and optimize energy consumption. Specifically, it creates power optimization plans based on past consumption patterns. 【0604】 For example, the server can suggest operating the washing machine at times when electricity rates are high during the day. 【0605】 The device uses its camera and microphone to transmit the user's facial expressions and voice to the emotion engine. The emotion engine identifies the user's emotions and sends that information to the server. Based on this, the server selects and notifies the user of the most suitable energy plan and entertainment content. 【0606】 For example, when a user is relaxing, the system might suggest relaxing music along with detailed power-saving tips. 【0607】 Furthermore, the server can monitor data from security devices in real time and provide flexible responses based on emotional states. 【0608】 Examples of prompts include, "Please explain how to optimize the power consumption of smart devices in your home," and "Please tell me about an algorithm that suggests entertainment based on the user's emotions." 【0609】 This invention is expected to make home life more comfortable and energy-efficient. 【0610】 The flow of the specific processing in Example 2 will be explained using Figure 13. 【0611】 Step 1: 【0612】 The server collects energy usage data from each electrical appliance installed in the home. This data includes the amount of electricity each device consumes at any given time. The server records this data in a database in real time and stores it as baseline data for analyzing energy usage patterns. 【0613】 Step 2: 【0614】 The device uses camera and microphone sensors to capture the user's facial expressions and voice as input in order to understand the user's emotional state. The emotion engine analyzes this data and sends the detected emotional state (e.g., relaxed, stressed, focused) to the server. The server stores this information in an emotion database and uses it in the next step. 【0615】 Step 3: 【0616】 The server uses an AI algorithm to perform data calculations to optimize energy consumption, taking the energy usage data collected in Step 1 and the user's emotional state obtained in Step 2 as input. This allows it to output an optimal energy plan, such as suggestions for peak shifting based on energy usage patterns or suggestions for temperature adjustments based on the user's emotional state. 【0617】 Step 4: 【0618】 The server notifies the user of the optimal energy plan obtained in step 3 via communication. The notification includes specific energy-saving methods and suggestions for when to turn devices on and off. The user can review this on their device screen and approve or modify the plan. 【0619】 Step 5: 【0620】 The server automatically controls each electrical appliance in the home based on the user's approved plan. For example, it adjusts the air conditioner's temperature setting to match the user's relaxation state. It also sets the start times for washing machines and dishwashers based on the proposed power usage time. 【0621】 Step 6: 【0622】 The server monitors real-time data from security devices as input and outputs flexible response measures tailored to the emotional state if an anomaly occurs. In the event of an anomaly, the user is notified of the situation and prompt action is taken as needed. 【0623】 Step 7: 【0624】 The server utilizes a generative AI model to suggest entertainment content based on the user's emotional state and past viewing history. It receives emotional state and history data as input, and the AI ​​outputs a content plan recommending relaxing music and videos, which is then provided to the user. 【0625】 (Application Example 2) 【0626】 Next, we will explain Application Example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal." 【0627】 In modern home environments, it is common for multiple information devices to be introduced and controlled individually, but this leads to wasted energy and inefficiencies between devices. Furthermore, while flexible responses that respond to users' emotions are required, current systems have difficulty accurately understanding users' emotional states and controlling devices accordingly. As a result, home life is not always comfortable, and security concerns remain. 【0628】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. 【0629】 In this invention, the server includes information gathering means for acquiring data from multiple information devices in the home environment, processing means for performing analysis to optimize energy consumption based on the acquired data, and emotion adaptation means for recognizing the user's emotional state and providing appropriate information and controlling devices based on the acquired emotion data. As a result, not only is energy consumption in the home optimized, but device management tailored to each user's emotions becomes possible, realizing a more comfortable and safe living environment. 【0630】 An "information gathering device" is a device that has the function of acquiring data on usage status and condition from multiple information devices within the home environment. 【0631】 A "processing device" is a device that analyzes acquired data and performs calculations and decisions to optimize energy consumption. 【0632】 A "transmission means" is a device that has a communication function to notify users of an optimized energy plan. 【0633】 "Operating means" refers to a device that has the function of controlling multiple information devices based on a plan approved by the user. 【0634】 An "emotional adaptation device" is a device that analyzes the user's facial expressions and voice, recognizes their emotional state, and provides appropriate information or operates equipment based on that recognition. 【0635】 An "anomaly detection means" is a device that collects data from monitoring equipment in real time and has the function of automatically detecting abnormal situations. 【0636】 A "safety management device" is a device that has the function of notifying users of detected abnormal situations, receiving necessary instructions, and controlling multiple information devices. 【0637】 A "psychological response device" is a device that, in abnormal situations, considers the user's psychological state using emotional adaptation tools and provides appropriate countermeasures. 【0638】 A "content suggestion device" is a device that analyzes a user's past usage data and suggests entertainment content based on the results. 【0639】 A "sentiment analysis device" is a device that analyzes the emotional state of a user and has the function of selecting the most appropriate content based on that analysis. 【0640】 A "playback device" is a device that has the function of playing back content selected by the user in an optimal environment within the home. 【0641】 This invention is a system for realizing integrated control of multiple information devices within a home environment. Specific embodiments thereof are described below. 【0642】 The server is configured using a Raspberry Pi and connects to multiple information devices via a home network. As a means of information gathering, the server has the functionality to acquire usage status and energy data from each information device via a smart home appliance API. Furthermore, as a means of emotional adaptation, it uses an emotion recognition algorithm combining OpenCV and TensorFlow to analyze the user's facial expressions and voice data. 【0643】 The devices used are smartphones and tablets, and they connect via Bluetooth or Wi-Fi to receive notifications from the server. The means of communication include notifying users of analyzed, optimized energy plans and content suggestions based on their emotions. 【0644】 Users control information devices and approve energy plans through their terminals. Emotional adaptation mechanisms provide appropriate information and services based on the user's current emotional state. For example, when a user is relaxed, they can review and approve the details of the energy plan proposed by the system. Furthermore, data from monitoring devices allows anomaly detection mechanisms to monitor the home's security status in real time, and if an anomaly occurs, security management mechanisms respond quickly. Psychological adaptation mechanisms provide notifications that take into account the user's emotions during anomalies. 【0645】 For example, if a user is spending a holiday afternoon in their living room and their smile is detected, a prompt message will be generated stating, "The user's current emotional state is relaxed. Recommended content is healing music." Based on this information, the system can select appropriate content and play it through the home speakers. 【0646】 The flow of a specific process in Application Example 2 will be explained using Figure 14. 【0647】 Step 1: 【0648】 The server acquires energy data from information devices installed in the home using data collection methods. The input data is the usage status of each information device, and the output is integrated energy consumption data. By collecting this data, a foundation is formed for understanding energy consumption patterns within the home. 【0649】 Step 2: 【0650】 The server uses OpenCV and TensorFlow to analyze user facial expressions and audio data input from the camera and microphone using emotion-adaptive mechanisms. The input is the user's raw audio and video data, and the output is data indicating the user's emotional state. This analysis allows for real-time understanding of the user's current emotional state. 【0651】 Step 3: 【0652】 The server uses the energy data obtained in Step 1 and the emotion data obtained in Step 2 to generate a prompt sentence using a generative AI model. The input is the collected energy data and the user's emotion state data, and the output is the prompt sentence. This prompt sentence is used to organize the information necessary for proposing a service. 【0653】 Step 4: 【0654】 The server performs analysis to optimize energy consumption and transmits the optimized energy plan to the terminal using a communication method. The input is combined energy data, and the output is the optimized energy plan. This calculation enables efficient energy use that avoids peak times. 【0655】 Step 5: 【0656】 The terminal receives an optimized energy plan from the server and notifies the user. The input is the energy plan obtained from the server, and the output is the screen displaying the information. This allows the user to check their energy plan to see where they can reduce their energy consumption. 【0657】 Step 6: 【0658】 The user sends approval or modification of the notified energy plan to the server via their terminal. The input is data about the plan selected by the user, and the output is feedback to the server. This allows for the optimization of energy consumption with the user's permission. 【0659】 Step 7: 【0660】 The server uses emotion adaptation tools to select appropriate entertainment content based on the emotional state acquired in step 2, following the instructions in the prompt message, and then activates the playback tool to play it on the terminal. The input consists of the prompt message and content selection criteria, and the output is entertainment optimized for the user. This allows the user to experience content that best matches their current emotions. 【0661】 The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data. 【0662】 Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. 【0663】 In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314. 【0664】 [Fourth Embodiment] 【0665】 Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment. 【0666】 As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server. 【0667】 The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). 【0668】 The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52. 【0669】 The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46. 【0670】 Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision). 【0671】 Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner. 【0672】 The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes. 【0673】 Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56. 【0674】 The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30. 【0675】 The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. 【0676】 In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48. 【0677】 Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0678】 This invention is a system for the integrated management of smart devices within a home environment, and consists of three elements: a server, terminals, and users. 【0679】 First, the server periodically collects energy usage data from various electronic devices in the home (e.g., refrigerator, air conditioner, heater, lighting, etc.). Based on this data, the server analyzes the usage patterns of each device and calculates an optimal energy consumption schedule. Furthermore, based on the analysis results, the server generates a plan to optimize energy consumption and notifies the user. 【0680】 As a concrete example, the server suggests to the user that "raising the air conditioner's temperature setting by 1°C during peak afternoon hours can save 20% of energy." The user can review this suggestion on a smartphone app and approve or change it as needed. 【0681】 Next, the server receives data in real time from home security devices, such as surveillance cameras and door sensors, and monitors for any anomalies. If an anomaly is detected, the server immediately notifies the user. Upon receiving the notification, the user can view the security footage through a smartphone app and, if necessary, send commands to the device. For example, if suspicious activity is detected, the user can send a command to the device to remotely lock the door. 【0682】 Furthermore, the server analyzes the user's entertainment content preferences and suggests content to watch next based on their individual viewing history. The suggested content is displayed on the device, such as a TV or streaming device, and the user can start watching immediately after selecting it. 【0683】 Thus, the present invention aims to provide users with a safe, efficient, and comfortable home environment by seamlessly optimizing home energy management, security, and entertainment. 【0684】 The following describes the processing flow. 【0685】 Step 1: 【0686】 The server acquires energy usage data from various electronic devices installed in the home, including smart meters and direct device communication. The acquired data is sorted chronologically and recorded in a database. 【0687】 Step 2: 【0688】 The server analyzes the collected energy usage data to identify usage patterns. This analysis uses AI algorithms to understand consumption trends by device and time of day. After patterns are extracted, potential energy saving opportunities are identified. 【0689】 Step 3: 【0690】 The server generates an optimal energy management plan based on the analysis results. This includes suggestions to reduce device operation during specific time periods and adjustments to temperature settings. The generated plan is then communicated to the user. 【0691】 Step 4: 【0692】 The user reviews the energy management plan received from the server using a smartphone app. After reviewing the plan, the user can approve it or make any necessary adjustments. The user's selection is then returned to the server. 【0693】 Step 5: 【0694】 The terminal sends control instructions to each electronic device based on the energy plan approved by the user. Specifically, it adjusts the temperature setting of the air conditioner and controls the on / off of lights at specific times. 【0695】 Step 6: 【0696】 The server receives data from security devices in real time and applies anomaly detection algorithms to monitor for suspicious activity. If an anomaly is detected, the server immediately notifies the user. 【0697】 Step 7: 【0698】 The user receives a security alert from the server and reviews the provided data and video. If necessary, the user can decide on remote action and send commands to their terminal, such as locking a door. 【0699】 Step 8: 【0700】 The server analyzes the user's entertainment viewing history and suggests content for the next viewer. This suggestion is displayed on the user's device, depending on the terminal. 【0701】 Step 9: 【0702】 The user selects the content they want to watch from the suggested options. Once the selection is complete, the device automatically begins playing the selected content. 【0703】 (Example 1) 【0704】 Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0705】 In modern home environments, efficient management of various electrical appliances is required, but challenges remain in areas such as information gathering and analysis, and ensuring confidentiality. In particular, optimizing energy consumption, and enhancing security and safety are essential. Traditional methods often involve individual management, making efficient integrated management difficult. Therefore, there is a need for technology that integrates these elements to efficiently and safely manage the home environment. 【0706】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means. 【0707】 In this invention, the server includes information gathering means for acquiring information from multiple electrical appliances in the home environment, calculation means for performing analysis to optimize energy consumption based on the acquired information, and communication means for transmitting the optimized energy plan to the user based on the analysis results. This enables efficient energy management of electrical appliances in the home and enhances safety. 【0708】 "Information gathering means" refers to a system or device for acquiring usage data from multiple electrical appliances within a home environment. 【0709】 A "computational means" is a system or algorithm for analyzing acquired information and deriving an appropriate energy consumption pattern based on that analysis. 【0710】 "Communication means" refers to a system or technology for transmitting analysis results to users and notifying them of their energy plan. 【0711】 A "control device" is a system or device for operating multiple electrical machines based on a plan approved by the user. 【0712】 An "anomaly identification means" is a system or technology for monitoring data from security devices in real time and identifying abnormal behavior or situations. 【0713】 "Safety management means" refers to a system or process for notifying users of the results obtained by anomaly identification means and, if necessary, giving instructions or performing operations on electrical machinery. 【0714】 A "content suggestion system" is a system that analyzes a user's past viewing information and suggests entertainment content they should watch next. 【0715】 "Playback means" refers to a system or device for visually or audibly reproducing entertainment content selected by the user. 【0716】 In one embodiment of the present invention, a system is provided for the integrated management of various electrical appliances in a home environment. This system consists of three elements: a server, a terminal, and a user. 【0717】 The server analyzes data collected from various electrical appliances in the home. Specifically, energy consumption data acquired by IoT sensors is sent to the server using communication methods such as Wi-Fi and Bluetooth. The server stores this data in a cloud database and analyzes device usage patterns using machine learning algorithms. Here, common machine learning tools are used for the analysis. Furthermore, the server generates an optimal energy plan based on the analysis results and sends suggestions to the user via a notification system. 【0718】 For example, the server might suggest, "Raising the air conditioner's temperature by 1°C during peak afternoon hours could save 20% energy." Users can review, approve, or adjust these suggestions via their smartphones. The smartphone app provides a user interface and assists with reviewing and approving energy plans. 【0719】 Furthermore, the server collects data in real time from home security devices and monitors for anomalies. If an anomaly is detected, it immediately notifies the user. The user receives the notification using their smartphone and can send control commands to the device as needed. For example, if abnormal activity is detected, the user can send a command to the device to remotely lock the door. 【0720】 In the entertainment field, servers analyze a user's viewing history and suggest content to watch next. This suggested content is displayed on the user's device via a TV or streaming device, allowing them to start watching immediately. 【0721】 For example, you can use text such as "Please tell me how to collect and optimize power consumption data for each device in my home" as an input prompt for the generating AI model. 【0722】 In this way, this system enables integrated management to improve the efficiency and safety of the home environment. 【0723】 The flow of the specific processing in Example 1 will be explained using Figure 11. 【0724】 Step 1: 【0725】 The server collects energy consumption data from each electrical appliance in the home. IoT sensors attached to each device transmit energy consumption information at that time via Wi-Fi or Bluetooth. Inputs include device identification information and energy consumption, which are integrated and stored in a cloud database. Outputs include energy consumption data for each device and the date. 【0726】 Step 2: 【0727】 The server analyzes the collected energy consumption data. Specifically, it processes information in a cloud database using scripts such as Python to extract usage patterns and peak consumption times for each device. Machine learning algorithms are applied to this analysis to detect abnormal usage patterns and generate data for optimization. Stored energy consumption data is used as input, and the output provides usage patterns for each device and optimization suggestions. 【0728】 Step 3: 【0729】 The server generates a plan to optimize energy consumption based on the analysis results. In this process, a generation AI model is used to devise a convenient and efficient energy usage method for the user. The input is the analysis results of usage patterns, and the output is an energy plan proposed to the user. 【0730】 Step 4: 【0731】 The server notifies the user of the generated energy plan. It uses a cloud messaging service to send information to a smartphone app. For example, a suggestion such as, "Raising the air conditioner temperature by 1°C during peak afternoon hours can reduce energy consumption by 20%," might be sent. The input is the generated energy plan, and the output is the notification sent to the user's smartphone. 【0732】 Step 5: 【0733】 Users review proposals using a smartphone app and approve or modify them. This operation is performed through the app's interface, and plans approved by the user are implemented in the next step. The input is the energy plan notification from the server, and the output is the user's decision. 【0734】 Step 6: 【0735】 The server receives information in real time from home security devices and monitors for anomalies. It applies anomaly detection algorithms to identify suspicious behavior and movements. The input is real-time information from security devices, and the output is the anomaly detection result. 【0736】 Step 7: 【0737】 If an anomaly is detected, the server sends a notification to the user. After the user confirms the notification, they send a control command to their device via a smartphone app. For example, they can remotely lock a door. The input is the anomaly notification from the server, and the output is the control command sent to the device. 【0738】 Step 8: 【0739】 The server analyzes the user's entertainment viewing history and suggests content to watch next. This uses data on previously viewed content and genres, and predicts similar content through machine learning. The input is the user's viewing history, and the output is the suggested content. 【0740】 In this way, each step works in coordination to achieve efficient management and improved safety of electrical appliances in the home. 【0741】 (Application Example 1) 【0742】 Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0743】 In modern homes and man-made buildings, multiple electronic devices are scattered and function independently, resulting in separate optimizations of energy consumption, safety assurance, and the provision of information and entertainment. This leads to inefficiency overall and low user convenience. Furthermore, the complex management required tends to increase the burden on members of society. To solve these problems, a system is needed that can manage each device in an integrated and efficient manner. 【0744】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. 【0745】 In this invention, the server includes information gathering means, computing means, communication means, and control means. This makes it possible to integrally manage multiple electronic devices in a home environment or an entire artificial building, optimize energy consumption, ensure security, and seamlessly provide information and entertainment. 【0746】 "Home environment" refers to the living space within an individual residence or apartment building, as well as all the equipment installed within it. 【0747】 "Artificial structures" refer to buildings and facilities designed for human life and activities, which are structures that stand in contrast to the natural environment. 【0748】 "Members of society" refers to people who live in a particular region or environment, or to the individual people who make up that community. 【0749】 "Electronic device" refers to a device or equipment that operates using electrical or electronic means, or a system composed of such devices or equipment. 【0750】 "Information gathering means" refers to the processes, technical means, and devices used to acquire data. 【0751】 "Computational means" refers to the processes, algorithms, and devices used to analyze data and derive results. 【0752】 "Communication methods" refer to the processes, technologies, and devices used to transmit and share information. 【0753】 "Control means" refers to processes, technologies, and devices used to manage and adjust the operation and state of a system or equipment. 【0754】 To implement this invention, a system is needed to centrally manage multiple electronic devices placed in a home environment or artificial building. This system consists of three elements: a server, a terminal, and a user. 【0755】 The server periodically acquires data such as energy consumption from various electronic devices within homes and buildings. To achieve this, sensors are installed in each device, and this data is aggregated on the server via an IoT network. The server uses this data to analyze energy consumption patterns using real-time data analysis tools such as Apache Kafka, and calculates an optimal consumption schedule. The analysis results are then notified to members of society using cloud services such as Google Cloud and AWS. Users who receive the notification can then approve the proposed plan using their own devices. 【0756】 The terminal controls related electronic devices based on user instructions. For example, remote control is possible using a smartphone or smart home hub. It not only optimizes energy consumption according to the situation but also performs real-time safety management, promptly notifying the user if an anomaly is detected. This function is used, for example, for home security management using surveillance cameras and door sensors. 【0757】 Furthermore, this system can also be applied to providing information and entertainment. The server analyzes the user's preferences based on their past viewing data and suggests the most suitable information and entertainment. This process utilizes a generative AI model to suggest content based on viewing history. This allows members of society to efficiently enjoy entertainment. 【0758】 As a concrete example, consider a scenario where a large amount of electricity is consumed temporarily on a hot summer day. In this case, the system coordinates with other households to adjust energy consumption and optimizes air conditioner usage based on the proposed plan. This can reduce peak electricity consumption. 【0759】 An example of a prompt message is, "Please tell me how to optimize energy use this summer. Please provide specific suggestions, including peak air conditioning temperature settings." 【0760】 The flow of a specific process in Application Example 1 will be explained using Figure 12. 【0761】 Step 1: 【0762】 The server acquires energy usage data from sensors in various electronic devices within homes and buildings. This input data is collected via an IoT network and stored in a database. Here, data preprocessing is performed, including noise reduction and missing value imputation. 【0763】 Step 2: 【0764】 The server performs real-time data analysis based on the acquired energy usage data. Using Apache Kafka, it processes the data as a stream and analyzes the energy consumption patterns of each device. This identifies consumption peaks and wasteful usage, resulting in the output of foundational data for optimization. 【0765】 Step 3: 【0766】 Based on the analysis results, the server uses Google Cloud's AI tools to calculate the optimal energy consumption schedule through a generative AI model. This calculation combines historical data with predictive algorithms to output an efficient consumption plan. 【0767】 Step 4: 【0768】 The server notifies members of society of an energy consumption optimization plan. This output data is sent to the user's smartphone as a push notification. The notification includes specific suggestions, such as "raise the air conditioner temperature by 1°C during the afternoon peak hours." 【0769】 Step 5: 【0770】 The user uses their device to review the notification and approve it or change settings as needed. Based on the user's input, the device sends data back to the server, and the approved plan is saved. 【0771】 Step 6: 【0772】 Based on an approved plan, the device controls each electronic device via a smart home hub. For example, it optimizes energy consumption by automatically changing the temperature settings of an air conditioner. 【0773】 Step 7: 【0774】 To ensure users can enjoy entertainment with peace of mind, the server uses an AI model based on past viewing data to suggest content. Examples of prompts include "How can I optimize my energy usage this summer?", suggesting the most suitable information and entertainment for the user. 【0775】 Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions. 【0776】 This invention provides a system that integrates and controls smart devices within the home, and further recognizes and adapts to the user's emotions to provide services. The system mainly consists of a server, terminals, an emotion engine, and the user. 【0777】 First, the server periodically acquires energy usage data from multiple electronic devices within the home. Based on this data, the server uses AI algorithms to perform analysis to optimize energy consumption. For example, it can analyze the home's consumption patterns and propose a device operation plan that avoids peak power times. 【0778】 The emotion engine analyzes the user's facial expressions and voice to recognize their emotions. This allows the server to understand the user's current emotional state. Based on this information, the server designs and notifies the user of an energy plan that it believes will be most acceptable to them. For example, if the user is relaxed, it will offer more detailed suggestions; if they appear to be in a hurry, it will offer concise and direct suggestions. 【0779】 Furthermore, the server acquires information from various security devices in real time and responds flexibly based on the user's emotions when an anomaly is detected. If the user is in a panic state when an anomaly occurs, the server will notify them of more stable and rapid countermeasures. If the user is at ease, it will provide normal notifications and, if necessary, take control through the terminal based on appropriate instructions. 【0780】 Furthermore, the server utilizes the emotion engine to suggest entertainment content. It can analyze the user's emotional state and recommend the most suitable entertainment content. For example, if the user is stressed, it will suggest relaxing content, and if they are feeling energetic, it will suggest dynamic content such as action movies. 【0781】 As described above, the system of the present invention aims to improve home life in a more convenient, comfortable, safe, and efficient way by providing flexible and adaptive services that respond to the user's emotional state. 【0782】 The following describes the processing flow. 【0783】 Step 1: 【0784】 The server acquires energy usage data directly from multiple electronic devices installed in the home, or via sensors. This data is stored in a database along with a timestamp, as it forms the basis for subsequent energy consumption optimization. 【0785】 Step 2: 【0786】 The server uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes the user's facial expressions and voice input to identify emotions such as whether the user is relaxed or stressed. 【0787】 Step 3: 【0788】 Based on the energy data acquired in Step 1, the server uses an AI algorithm to generate an optimized energy consumption plan. At this time, it adjusts how the plan is proposed, taking into account the user's emotional state as determined by the emotion engine. For example, it provides detailed information when the user is relaxed and offers concise suggestions when the user is stressed. 【0789】 Step 4: 【0790】 Users review energy consumption plan suggestions sent from the server via a smartphone app. Based on suggestions optimized to the user's preferences, users can approve or modify the plan. 【0791】 Step 5: 【0792】 The terminal controls each electronic device based on a plan approved by the user. Specifically, it automatically adjusts the temperature settings of air conditioners and manages the lighting schedule to achieve efficient energy use. 【0793】 Step 6: 【0794】 The server receives data from security devices in real time and applies anomaly detection algorithms to monitor suspicious activity. If an anomaly is detected, the server adjusts the content and method of notification based on the user's emotional response. For example, it might send a message emphasizing reassurance or immediately provide detailed instructions. 【0795】 Step 7: 【0796】 Users review security notifications sent from the server and respond quickly as needed. With the assistance of an emotion engine, users are encouraged to respond calmly and can send commands directly from their smartphones to their devices to control the security status within their homes. 【0797】 Step 8: 【0798】 The server analyzes the user's entertainment viewing history and current emotional state to suggest the most suitable content. This suggestion is tailored to the user's mood; for example, it might recommend calming movies if the user is relaxed, or action films if they are feeling active. 【0799】 Step 9: 【0800】 The user selects and plays the suggested content on their device. The device automatically starts playing the selected content, providing the user with a comfortable and personalized entertainment experience. 【0801】 (Example 2) 【0802】 Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0803】 In modern homes, a wide variety of electrical devices are connected to the internet, creating a demand for efficient energy management. However, conventional systems often provide uniform responses without considering the user's emotional state, making satisfactory personalization difficult. Furthermore, while flexible responses tailored to individual situations and emotions are required in terms of security, current systems do not adequately meet this need. In addition, selecting optimal content based on the user's emotions is a challenge in entertainment offerings. 【0804】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. 【0805】 In this invention, the server includes data collection means for acquiring energy usage data from multiple electrical devices in the home environment, emotion recognition means for recognizing the user's emotional state using an emotion engine, and computation means for performing analysis to optimize energy consumption based on the acquired energy data and emotional state data. This enables efficient power consumption within the home and the provision of adaptive services that respond to the user's emotions. 【0806】 "Energy usage data" refers to information about the amount of energy consumed and usage patterns of multiple electrical devices. 【0807】 An "emotion engine" refers to a function or system that analyzes information such as a user's facial expressions and voice to identify their current emotional state. 【0808】 "Data acquisition means" refers to methods and devices for acquiring necessary data from multiple electrical devices. 【0809】 "Emotion recognition means" refers to methods and devices used to understand a user's emotional state. 【0810】 "Computational means" refers to the technologies and processes used to perform necessary analyses and calculations based on collected data. 【0811】 "Communication methods" refer to methods and devices for conveying analysis results and proposed content to users. 【0812】 "Control means" refers to methods or devices for managing electrical equipment based on instructions from the user. 【0813】 "Anomaly detection means" refers to methods and devices for analyzing data provided by security devices to identify the occurrence of anomalies. 【0814】 "Security management measures" refer to functions and systems that notify users in the event of an anomaly and control electrical devices as necessary. 【0815】 "Content suggestion means" refers to methods and devices for selecting and recommending entertainment content based on past viewing data and emotional states. 【0816】 "Playback means" refers to methods or devices for displaying or playing content selected by the user. 【0817】 This invention is a system that centrally manages multiple electrical devices in the home and optimizes the living environment according to the user's emotional state. The system mainly consists of a server, terminals, an emotion engine, and the user. 【0818】 The server collects energy usage data from multiple electrical devices. This includes smart meters and device sensors that track power consumption. The server integrates this collected data and uses AI algorithms to analyze it and optimize energy consumption. Specifically, it creates power optimization plans based on past consumption patterns. 【0819】 For example, the server can suggest operating the washing machine at times when electricity rates are high during the day. 【0820】 The device uses its camera and microphone to transmit the user's facial expressions and voice to the emotion engine. The emotion engine identifies the user's emotions and sends that information to the server. Based on this, the server selects and notifies the user of the most suitable energy plan and entertainment content. 【0821】 For example, when a user is relaxing, the system might suggest relaxing music along with detailed power-saving tips. 【0822】 Furthermore, the server can monitor data from security devices in real time and provide flexible responses based on emotional states. 【0823】 Examples of prompts include, "Please explain how to optimize the power consumption of smart devices in your home," and "Please tell me about an algorithm that suggests entertainment based on the user's emotions." 【0824】 This invention is expected to make home life more comfortable and energy-efficient. 【0825】 The flow of the specific processing in Example 2 will be explained using Figure 13. 【0826】 Step 1: 【0827】 The server collects energy usage data from each electrical appliance installed in the home. This data includes the amount of electricity each device consumes at any given time. The server records this data in a database in real time and stores it as baseline data for analyzing energy usage patterns. 【0828】 Step 2: 【0829】 The device uses camera and microphone sensors to capture the user's facial expressions and voice as input in order to understand the user's emotional state. The emotion engine analyzes this data and sends the detected emotional state (e.g., relaxed, stressed, focused) to the server. The server stores this information in an emotion database and uses it in the next step. 【0830】 Step 3: 【0831】 The server uses an AI algorithm to perform data calculations to optimize energy consumption, taking the energy usage data collected in Step 1 and the user's emotional state obtained in Step 2 as input. This allows it to output an optimal energy plan, such as suggestions for peak shifting based on energy usage patterns or suggestions for temperature adjustments based on the user's emotional state. 【0832】 Step 4: 【0833】 The server notifies the user of the optimal energy plan obtained in step 3 via communication. The notification includes specific energy-saving methods and suggestions for when to turn devices on and off. The user can review this on their device screen and approve or modify the plan. 【0834】 Step 5: 【0835】 The server automatically controls each electrical appliance in the home based on the user's approved plan. For example, it adjusts the air conditioner's temperature setting to match the user's relaxation state. It also sets the start times for washing machines and dishwashers based on the proposed power usage time. 【0836】 Step 6: 【0837】 The server monitors real-time data from security devices as input and outputs flexible response measures tailored to the emotional state if an anomaly occurs. In the event of an anomaly, the user is notified of the situation and prompt action is taken as needed. 【0838】 Step 7: 【0839】 The server utilizes a generative AI model to suggest entertainment content based on the user's emotional state and past viewing history. It receives emotional state and history data as input, and the AI ​​outputs a content plan recommending relaxing music and videos, which is then provided to the user. 【0840】 (Application Example 2) 【0841】 Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0842】 In modern home environments, it is common for multiple information devices to be introduced and controlled individually, but this leads to wasted energy and inefficiencies between devices. Furthermore, while flexible responses that respond to users' emotions are required, current systems have difficulty accurately understanding users' emotional states and controlling devices accordingly. As a result, home life is not always comfortable, and security concerns remain. 【0843】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. 【0844】 In this invention, the server includes information gathering means for acquiring data from multiple information devices in the home environment, processing means for performing analysis to optimize energy consumption based on the acquired data, and emotion adaptation means for recognizing the user's emotional state and providing appropriate information and controlling devices based on the acquired emotion data. As a result, not only is energy consumption in the home optimized, but device management tailored to each user's emotions becomes possible, realizing a more comfortable and safe living environment. 【0845】 An "information gathering device" is a device that has the function of acquiring data on usage status and condition from multiple information devices within the home environment. 【0846】 A "processing device" is a device that analyzes acquired data and performs calculations and decisions to optimize energy consumption. 【0847】 A "transmission means" is a device that has a communication function to notify users of an optimized energy plan. 【0848】 "Operating means" refers to a device that has the function of controlling multiple information devices based on a plan approved by the user. 【0849】 An "emotional adaptation device" is a device that analyzes the user's facial expressions and voice, recognizes their emotional state, and provides appropriate information or operates equipment based on that recognition. 【0850】 An "anomaly detection means" is a device that collects data from monitoring equipment in real time and has the function of automatically detecting abnormal situations. 【0851】 A "safety management device" is a device that has the function of notifying users of detected abnormal situations, receiving necessary instructions, and controlling multiple information devices. 【0852】 A "psychological response device" is a device that, in abnormal situations, considers the user's psychological state using emotional adaptation tools and provides appropriate countermeasures. 【0853】 A "content suggestion device" is a device that analyzes a user's past usage data and suggests entertainment content based on the results. 【0854】 A "sentiment analysis device" is a device that analyzes the emotional state of a user and has the function of selecting the most appropriate content based on that analysis. 【0855】 A "playback device" is a device that has the function of playing back content selected by the user in an optimal environment within the home. 【0856】 This invention is a system for realizing integrated control of multiple information devices within a home environment. Specific embodiments thereof are described below. 【0857】 The server is configured using a Raspberry Pi and connects to multiple information devices via a home network. As a means of information gathering, the server has the functionality to acquire usage status and energy data from each information device via a smart home appliance API. Furthermore, as a means of emotional adaptation, it uses an emotion recognition algorithm combining OpenCV and TensorFlow to analyze the user's facial expressions and voice data. 【0858】 The devices used are smartphones and tablets, and they connect via Bluetooth or Wi-Fi to receive notifications from the server. The means of communication include notifying users of analyzed, optimized energy plans and content suggestions based on their emotions. 【0859】 Users control information devices and approve energy plans through their terminals. Emotional adaptation mechanisms provide appropriate information and services based on the user's current emotional state. For example, when a user is relaxed, they can review and approve the details of the energy plan proposed by the system. Furthermore, data from monitoring devices allows anomaly detection mechanisms to monitor the home's security status in real time, and if an anomaly occurs, security management mechanisms respond quickly. Psychological adaptation mechanisms provide notifications that take into account the user's emotions during anomalies. 【0860】 For example, if a user is spending a holiday afternoon in their living room and their smile is detected, a prompt message will be generated stating, "The user's current emotional state is relaxed. Recommended content is healing music." Based on this information, the system can select appropriate content and play it through the home speakers. 【0861】 The flow of a specific process in Application Example 2 will be explained using Figure 14. 【0862】 Step 1: 【0863】 The server acquires energy data from information devices installed in the home using data collection methods. The input data is the usage status of each information device, and the output is integrated energy consumption data. By collecting this data, a foundation is formed for understanding energy consumption patterns within the home. 【0864】 Step 2: 【0865】 The server uses OpenCV and TensorFlow to analyze user facial expressions and audio data input from the camera and microphone using emotion-adaptive mechanisms. The input is the user's raw audio and video data, and the output is data indicating the user's emotional state. This analysis allows for real-time understanding of the user's current emotional state. 【0866】 Step 3: 【0867】 The server uses the energy data obtained in Step 1 and the emotion data obtained in Step 2 to generate a prompt sentence using a generative AI model. The input is the collected energy data and the user's emotion state data, and the output is the prompt sentence. This prompt sentence is used to organize the information necessary for proposing a service. 【0868】 Step 4: 【0869】 The server performs analysis to optimize energy consumption and transmits the optimized energy plan to the terminal using a communication method. The input is combined energy data, and the output is the optimized energy plan. This calculation enables efficient energy use that avoids peak times. 【0870】 Step 5: 【0871】 The terminal receives an optimized energy plan from the server and notifies the user. The input is the energy plan obtained from the server, and the output is the screen displaying the information. This allows the user to check their energy plan to see where they can reduce their energy consumption. 【0872】 Step 6: 【0873】 The user sends approval or modification of the notified energy plan to the server via their terminal. The input is data about the plan selected by the user, and the output is feedback to the server. This allows for the optimization of energy consumption with the user's permission. 【0874】 Step 7: 【0875】 The server uses emotion adaptation tools to select appropriate entertainment content based on the emotional state acquired in step 2, following the instructions in the prompt message, and then activates the playback tool to play it on the terminal. The input consists of the prompt message and content selection criteria, and the output is entertainment optimized for the user. This allows the user to experience content that best matches their current emotions. 【0876】 The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data. 【0877】 Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. 【0878】 In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414. 【0879】 Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion. 【0880】 Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together. 【0881】 These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression. 【0882】 The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become. 【0883】 Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant. 【0884】 The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more." 【0885】 The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values. 【0886】 The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format. 【0887】 In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data. 【0888】 In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56. 【0889】 Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12. 【0890】 Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56. 【0891】 The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory. 【0892】 The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor. 【0893】 Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources. 【0894】 Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose. 【0895】 The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above. 【0896】 All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference. 【0897】 The following is further disclosed regarding the embodiments described above. 【0898】 (Claim 1) 【0899】 Information gathering means for acquiring data from multiple electronic devices in a home environment, 【0900】 A computational means for performing analysis to optimize energy consumption based on acquired data, 【0901】 A communication method that notifies the user of an optimized energy plan based on the analysis results, 【0902】 A control means that controls multiple electronic devices based on a plan approved by the user, 【0903】 A system that includes this. 【0904】 (Claim 2) 【0905】 An anomaly detection method that collects data from security devices in real time and detects abnormalities, 【0906】 A security management means that notifies the user of the detection results and controls multiple electronic devices by receiving commands from the user, 【0907】 The system according to claim 1, further comprising: 【0908】 (Claim 3) 【0909】 A content suggestion method that analyzes and proposes entertainment content based on users' past viewing data, 【0910】 A playback method for playing content selected by the user, 【0911】 The system according to claim 1, further comprising: 【0912】 "Example 1" 【0913】 (Claim 1) 【0914】 Information gathering means that acquire information from multiple electrical devices in the home environment, 【0915】 A computation means that performs analysis to optimize energy consumption based on the acquired information, 【0916】 A communication method for transmitting an optimized energy plan to the user based on the analysis results, 【0917】 A control means that controls multiple electrical machines based on a plan approved by the user, 【0918】 A system that includes this. 【0919】 (Claim 2) 【0920】 An anomaly identification means that collects information from security devices in real time and identifies anomalies, 【0921】 A safety management means that notifies the user of the identification result, receives instructions from the user and controls multiple electrical machines, 【0922】 The system according to claim 1, further comprising: 【0923】 (Claim 3) 【0924】 A content suggestion method that analyzes and suggests entertainment content based on the user's past viewing information, 【0925】 A playback method for playing back content selected by the user, 【0926】 The system according to claim 1, further comprising: 【0927】 "Application Example 1" 【0928】 (Claim 1) 【0929】 Information gathering means that acquire data from multiple electronic devices and the entire artificial structure within the home environment, 【0930】 A computational means for performing analysis to optimize energy consumption based on acquired data, 【0931】 A means of communication to notify members of society of an optimized energy plan based on the analysis results, 【0932】 A control means that controls multiple electronic devices based on a plan approved by members of society, 【0933】 A system that includes this. 【0934】 (Claim 2) 【0935】 An anomaly detection means that collects data from safety protection devices in real time and detects abnormalities, 【0936】 A safety management system that notifies members of society of detection results, receives commands from members of society, and controls multiple electronic devices, 【0937】 The system according to claim 1, further comprising: 【0938】 (Claim 3) 【0939】 A means of presenting information and entertainment content that analyzes and proposes based on past experience data of members of society, 【0940】 A means of playback for reproducing information and entertainment content selected by members of society, 【0941】 The system according to claim 1, further comprising: 【0942】 "Example 2 of combining an emotion engine" 【0943】 (Claim 1) 【0944】 A data collection method for acquiring energy usage data from multiple electrical devices in a home environment, 【0945】 An emotion recognition means that recognizes the user's emotional state using an emotion engine, 【0946】 A computational means for performing analysis to optimize energy consumption based on acquired energy data and emotional state data, 【0947】 A communication method that notifies the user of an optimized energy plan based on the analysis results and the user's emotional state, 【0948】 A control means that controls multiple electrical devices based on a plan approved by the user, 【0949】 A system that includes this. 【0950】 (Claim 2) 【0951】 An anomaly detection means that collects data from security devices in real time and responds flexibly to anomalies according to emotional states, 【0952】 A security management means that notifies the user of the detection results, receives commands from the user and controls multiple electrical devices, 【0953】 The system according to claim 1, further comprising: 【0954】 (Claim 3) 【0955】 A content suggestion method that analyzes and proposes entertainment content based on the user's emotional state and past viewing data, 【0956】 A playback method for playing content selected by the user, 【0957】 The system according to claim 1, further comprising: 【0958】 "Application example 2 when combining with an emotional engine" 【0959】 (Claim 1) 【0960】 A means of collecting information that acquires data from multiple information devices within the home environment, 【0961】 A processing means that performs analysis to optimize energy consumption based on acquired data, 【0962】 A means of communication that notifies users of an optimized energy plan based on the analysis results, 【0963】 An operating means for controlling multiple information devices based on a plan approved by the user, 【0964】 An emotional adaptation means that recognizes the user's emotional state and provides appropriate information or controls devices based on the acquired emotional data, 【0965】 A system that includes this. 【0966】 (Claim 2) 【0967】 An anomaly detection means that collects data from monitoring devices in real time and detects abnormalities, 【0968】 A security management means that notifies the user of the detection results, receives instructions from the user and controls multiple information devices, 【0969】 Psychological response measures that use emotional adaptation methods to provide appropriate responses that take into account the user's psychological state during abnormal situations, 【0970】 The system according to claim 1, further comprising: 【0971】 (Claim 3) 【0972】 A content suggestion method that analyzes and proposes entertainment content based on users' past usage data, 【0973】 A sentiment analysis tool that recommends appropriate content according to the user's emotional state, 【0974】 A playback method for playing content selected by the user, 【0975】 The system according to claim 1, further comprising: [Explanation of symbols] 【0976】 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

[Claim 1] Information gathering means for acquiring data from multiple electronic devices in a home environment, A computational means for performing analysis to optimize energy consumption based on acquired data, A communication method that notifies the user of an optimized energy plan based on the analysis results, A control means that controls multiple electronic devices based on a plan approved by the user, A system that includes this. [Claim 2] An anomaly detection method that collects data from security devices in real time and detects abnormalities, A security management means that notifies the user of the detection results and controls multiple electronic devices by receiving commands from the user, The system according to claim 1, further comprising: [Claim 3] A content suggestion method that analyzes and proposes entertainment content based on users' past viewing data, A playback method for playing content selected by the user, The system according to claim 1, further comprising:

Images