system

Abstract

We provide a system that can improve the efficiency and convenience of food management. [Solution] A system comprising: means for automatically acquiring food identification information and expiration dates using a sensor device installed in a household storage device; means for managing the inventory and expiration dates on a computer system based on the acquired food information; means for inputting and updating information on the user's preferences and health needs and storing this information on the computer system; means for a computer program to automatically generate an optimal cooking recipe based on the stored inventory information and user information; means for displaying preferred recipes from the generated recipes on the user terminal and enabling selection; and means for generating cooking procedures and a shopping list of missing ingredients based on the recipe selected by the user and providing them to the user terminal.

Description

【Technical Field】 , , 【0004】 , , , , 【0005】 , , , , , 【0001】 The technology of the present disclosure relates to a system. 【Background Art】 【0002】 Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance that responds to the user utterance. 【Prior Art Documents】 【Patent Documents】 【0003】 【Patent Document 1】 Japanese Unexamined Patent Application Publication No. 2022-180282 【Summary of the Invention】 【Problems to be Solved by the Invention】 【0004】 In food management within a household, food loss due to overlooking the expiration date of food and the difficulty of selecting recipes that suit the user's preferences and health needs are problems. In particular, for dual-income households with busy lives and novice cooks, efficient and waste-free food management and recipe selection tend to be cumbersome. Also, the current system has not fully solved the problem of easily obtaining recipes that meet special dietary needs. 【Means for Solving the Problems】 【0005】 This invention provides a system that automatically acquires food identification information and expiration dates using sensor devices installed in home storage equipment, and uses this information for a computer system to manage inventory and expiration dates. It also automatically generates recipes using AI based on user preferences and health needs. Furthermore, it reduces food waste by suggesting recipes that should be prioritized based on the expiration dates of ingredients. Finally, it creates a shopping list of missing ingredients and provides appropriate cooking advice via a terminal display, thereby improving the efficiency and convenience of food management. 【0006】 A "sensor device" is a mechanical or electronic device installed in a household storage system to automatically acquire food identification information and expiration dates. 【0007】 "Food identification information" refers to information used to identify the type, name, quantity, and other characteristics of food. 【0008】 "Best before date" is information that indicates the period during which food can maintain its best quality. 【0009】 A "computer system" is a collection of electronic computing devices that process, store, and analyze data, and automatically perform calculations based on instructions. 【0010】 "Inventory" refers to information about the total amount of food currently stored in a household, as well as details about that amount. 【0011】 A "user profile" is a collection of data that includes personal information such as a user's preferences, health needs, and dietary restrictions. 【0012】 "Generative AI" is an artificial intelligence technology that automatically generates new recipes and information based on given data. 【0013】 A "recipe" is a set of instructions that describes the steps and necessary information for cooking different ingredients in a specific way. 【0014】 The "shopping list" is a list that itemizes the foods and other items that the user needs to procure. 【0015】 "Natural language processing technology" is a technology for enabling a computer to understand, analyze, and generate human language. 【Brief Description of the Drawings】 【0016】 [Figure 1] It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] [[ID=三十九]]It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13]It is a sequence diagram showing the processing flow of the data processing system in Example 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined. 【Mode for Carrying Out the Invention】 【0017】 Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings. 【0018】 First, the language used in the following description will be explained. 【0019】 In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be one arithmetic unit or a combination of a plurality of arithmetic units. Also, the processor may be one type of arithmetic unit or a combination of a plurality of types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like. 【0020】 In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor. 【0021】 In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc. 【0022】 In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark). 【0023】 In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or." 【0024】 [First Embodiment] 【0025】 Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment. 【0026】 As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server. 【0027】 The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). 【0028】 The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52. 【0029】 The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input. 【0030】 The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor. 【0031】 Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54. 【0032】 Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14. 【0033】 As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30. 【0034】 The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. 【0035】 In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48. 【0036】 Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal". 【0037】 This invention provides a system that efficiently manages food consumption and offers recipes tailored to dietary needs within the home. This system primarily consists of sensor devices, a computer system, and a user interface. 【0038】 The sensor device is installed in the home and automatically acquires identification information and expiration dates for stored food items. This information is transmitted to a server and recorded in a food database. The server uses this information to manage inventory and identify food items nearing their expiration date. 【0039】 Users can use devices such as smartphones and PCs to input information about their preferences, allergies, and specific dietary needs. This information is sent to the server and stored as a user profile. 【0040】 The server integrates acquired inventory information and user profiles, and uses a generation AI to automatically generate recipes. These recipes are designed to accommodate user preferences and health needs, and also prioritize the use of ingredients nearing their expiration date. The terminal displays these recipes to the user, making them available for selection. 【0041】 When a user selects a recipe from the presented options, the server generates detailed cooking instructions and displays them on the device. Furthermore, it automatically adds any missing ingredients needed for the selected recipe to a shopping list and provides it to the user. This process utilizes natural language processing technology, and the server provides cooking advice in text format through the user interface. 【0042】 As a concrete example, consider a scenario where a user has chicken, tomatoes, and spinach in their refrigerator and wants to follow a low-carbohydrate diet. The server generates a recipe for "Chicken and Spinach Tomato Stew" using these ingredients and presents it to the user's device. This recipe addresses the user's diet needs while also considering the ingredients' approaching expiration dates. 【0043】 In this way, users can easily prepare healthy meals while simultaneously minimizing food waste. This invention provides an environment that allows this entire process to be carried out seamlessly. 【0044】 The following describes the processing flow. 【0045】 Step 1: 【0046】 The server uses sensor devices installed in the storage unit to automatically scan food items for identification information and expiration dates. This information is sent to the server and recorded in the food information database. 【0047】 Step 2: 【0048】 Users use their devices to input their food preferences, allergy information, and diet type, and send this data to the server via the device. The server stores this information in the user profile. 【0049】 Step 3: 【0050】 The server periodically queries the database to check inventory levels and ingredients nearing their expiration dates. This helps identify ingredients with high priority for use. 【0051】 Step 4: 【0052】 The server uses a generative AI to generate several optimal recipes based on saved user profiles and the latest inventory information. This also takes into account prioritizing the use of ingredients nearing their expiration date. 【0053】 Step 5: 【0054】 The terminal presents the generated recipes to the user, displaying them in a selectable format. This allows the user to choose the menu item they want to cook from the specified recipes. 【0055】 Step 6: 【0056】 When a user selects a recipe, the server generates detailed advice on cooking steps and necessary tools based on that recipe. The terminal then provides this information to the user. 【0057】 Step 7: 【0058】 The server identifies ingredients needed for the selected recipe that are not in stock and lists them. The terminal displays this shopping list to the user and prompts them to confirm the necessary items. 【0059】 This series of steps allows users to efficiently manage their food supply and prepare meals that meet their health needs. 【0060】 (Example 1) 【0061】 Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal." 【0062】 Traditional home food management and meal preparation methods have challenges, such as ineffectively providing recipe suggestions tailored to inventory levels and individual health needs. In particular, there is a need for methods that can efficiently prepare healthy meals while reducing food waste. Conventional technologies fail to utilize ingredients nearing their expiration date and lack the means to accommodate users' specific preferences and health requirements. 【0063】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means. 【0064】 In this invention, the server includes means for automatically acquiring food identification information and expiration dates using sensor devices installed in household storage devices, means for managing the inventory and expiration dates of the food on a computer system based on the acquired food information, and means for inputting and updating information on the user's preferences and health requirements and storing this information on the computer system. This makes it possible to prioritize the use of ingredients nearing their expiration date and to suggest optimal cooking procedures that meet the user's health needs. 【0065】 A "sensor device" is a device installed in a household storage system that automatically acquires food identification information and expiration dates. 【0066】 A "computer system" is a device that integrates acquired food information and user information to enable inventory management and the generation of optimal cooking procedures. 【0067】 "User health requirements" refers to health-related conditions, including the user's individual preferences, allergies, and special nutritional needs. 【0068】 A "generative AI model" is a type of artificial intelligence that automatically generates the optimal cooking procedure based on user information and inventory information, by taking prompt messages. 【0069】 A "prompt message" is the text input to a generative AI model, and it contains data that includes the conditions and purpose of the data being used. 【0070】 "Natural language processing technology" is a technology in which a computer system analyzes input from a user, understands instructions in human language, and provides the results in text format. 【0071】 "Cooking instructions" refer to the cooking methods and processes generated based on acquired food information and user information, and are specific cooking instructions presented to the user. 【0072】 This invention is a system for providing food management and cooking procedures tailored to individual health needs. It mainly consists of a sensor device, a computer system, and a user terminal. 【0073】 The server uses sensor devices to acquire identification information and expiration dates for food items in the home. These sensor devices include hardware such as RFID tags and barcode scanners. This enables the collection of highly accurate food information. 【0074】 The acquired food information is transmitted to a computer system and recorded in a food database. The server uses this information to manage inventory and identify foods nearing their expiration date. 【0075】 Users input their preferences, allergies, and dietary needs using their smartphones or PCs. This information is transmitted to the server via the user's device and stored in the computer system as an individual user profile. This enables the provision of personalized services. 【0076】 The generation AI model uses stored food inventory data and user profiles to automatically generate cooking instructions best suited to the user's needs. Prompt messages include specific instructions such as, "Inventory information: chicken, tomatoes, spinach. User wants a low-carb diet. Generate a diet-friendly recipe." 【0077】 The terminal displays the generated cooking instructions to the user, allowing them to make a selection. Based on the recipe selected by the user, the server generates detailed cooking instructions and sends them to the terminal. Furthermore, any missing ingredients are automatically added to the shopping list and provided to the user. Natural language processing technology is utilized to display cooking advice in text format. In this way, users can efficiently prepare healthy meals and minimize food waste. 【0078】 The flow of the specific processing in Example 1 will be explained using Figure 11. 【0079】 Step 1: 【0080】 The server uses sensor devices to acquire identification information and expiration dates for food items in the home. This input data includes RFID tags and barcodes on the food items. The server analyzes this data to extract the food name and expiration date, and records it in an inventory database. This process allows the homeowner to know in real time what kinds of food items are in their home, how much of each they are, and how soon they will expire. 【0081】 Step 2: 【0082】 Users input their preferences, allergies, and health requirements via their smartphones or PCs. This information is sent from the device to the server. The server generates and stores a user profile based on this data. This profile information is used to generate recipes tailored to each user's individual needs. 【0083】 Step 3: 【0084】 The server retrieves food information from the inventory database and matches it with the user profile. The server then inputs a prompt message into the generating AI model. This prompt message includes specific conditions such as, "Inventory information: chicken, tomatoes, spinach. User desires a low-carbohydrate diet." Based on this, the generating AI model automatically generates the optimal cooking procedure. 【0085】 Step 4: 【0086】 The terminal displays cooking instructions received from the server to the user, allowing them to make selections. The final recipe is determined by the user selecting from the displayed options. The user's selection is confirmed by the terminal and sent to the server. 【0087】 Step 5: 【0088】 The server generates detailed cooking instructions and information on missing ingredients based on the recipe selected by the user. This process matches the selected recipe with inventory data to identify any missing ingredients. The generated cooking instructions and shopping list are sent to the terminal and provided to the user. 【0089】 Step 6: 【0090】 The terminal displays cooking advice to the user in real time. The server uses natural language processing technology to create specific advice that the user needs during cooking in text format and sends it to the terminal. This allows the user to perform cooking tasks more smoothly. 【0091】 (Application Example 1) 【0092】 Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal." 【0093】 Traditional home food management systems have presented challenges, such as the difficulty for users to efficiently obtain recipes based on their preferences and health needs. Furthermore, inadequate management of food expiration dates often led to food waste. Additionally, systems capable of providing voice-based cooking advice were limited, frequently causing inconvenience to users during cooking. There is a need to address these challenges and provide users with a more efficient and healthy way to manage and utilize food. 【0094】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. 【0095】 In this invention, the server includes means for automatically acquiring food identification information and expiration dates using a measuring device installed in a home information processing device, means for managing the inventory and expiration dates on an information processing system based on the acquired food information, and means for inputting and updating information on the user's preferences and health needs and storing this information on the information processing system. As a result, the user can receive recipes perfectly suited to their health condition and preferences via voice, while also being able to use ingredients while considering the expiration dates of the food, thereby reducing food waste and enabling efficient cooking. 【0096】 A "household information processing device" is an electronic device used to process information within the home. 【0097】 A "measuring device" is a device used to obtain identification information and expiration dates for food products. 【0098】 An "information processing system" is a system for processing and managing acquired information. 【0099】 An "information processing program" is a program that runs on an information processing system and generates the optimal cooking procedure. 【0100】 A "user terminal" is a terminal device that a user directly operates to check information. 【0101】 A "household robot" is an automated device that plays a role in assisting people within the home. 【0102】 "Sound" is a means of transmitting information through hearing. 【0103】 "Natural language processing technology" is a technology that enables computers to analyze and process natural language used by humans. 【0104】 To implement this invention, an information processing device installed in the home is used. The in-home measuring device acquires food identification information and expiration date, and transmits this information to a server. The server uses an information processing system to organize and manage the acquired data. The user can input their preferences and health needs using a voice interface via a home robot. In this process, a speech recognition library is used to convert the user's speech into digital data. 【0105】 On the server side, an information processing program is executed to generate an optimal cooking recipe that prioritizes the use of food items nearing their expiration date. A generation AI model is utilized in this process, making adjustments based on the user's individual health needs. The generated recipe is then provided to the user via voice or text through their terminal or a home robot. 【0106】 The home robot has a voice output function that reads out generated recipes and cooking instructions, presenting them to the user. This allows the user to receive cooking instructions in real time, and a shopping list of missing ingredients is automatically generated as needed. 【0107】 As a concrete example, a recipe for "Chicken and Tomato Stew" is generated using tomatoes nearing their expiration date from among the chicken, eggs, and tomatoes in the refrigerator, and a household robot guides the user through this recipe by voice. If the user asks the robot to "suggest a low-calorie dinner recipe," an example of a prompt message would be, "Please generate a low-calorie recipe as requested by the user. The ingredients are chicken breast and broccoli. Please prioritize ingredients that are nearing their expiration date." 【0108】 The flow of a specific process in Application Example 1 will be explained using Figure 12. 【0109】 Step 1: 【0110】 When a user places food in their home information processing device, the measuring device automatically acquires the food's identification information and expiration date. The data obtained from the measuring device is identified using RFID tags or barcode readers and converted into a digital format. This digital data is transmitted to a server and stored in a food database. 【0111】 Step 2: 【0112】 The server analyzes a stored food database to manage food inventory status and expiration dates. Specifically, it uses database queries to identify food items nearing their expiration date. This allows for arrangements to be made to ensure that food is consumed in a timely manner. 【0113】 Step 3: 【0114】 Users communicate their preferences and health needs to a home robot via voice. Voice recognition technology converts the voice into text data, which is then sent to a server. This text data is stored within the information system as a user profile. 【0115】 Step 4: 【0116】 The server uses a generative AI model to automatically generate optimal cooking recipes based on stored food information and user profiles. Prompts are used to instruct this AI model, generating recipes tailored to the user's health needs. This process takes into account the food's expiration date and nutritional value. 【0117】 Step 5: 【0118】 The generated cooking recipe is displayed on the user's device in either audio or text format. A home robot guides the user through the recipe by voice, allowing them to quickly understand the cooking process and take action. 【0119】 Step 6: 【0120】 Based on the recipe selected by the user, the server generates cooking instructions and compiles a shopping list of necessary ingredients. This list can be viewed on the user's terminal and is helpful in selecting ingredients while considering their expiration dates. 【0121】 Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions. 【0122】 This invention provides a system for managing food within the home that considers the user's emotional state and suggests recipes appropriate to that emotional state. This system combines a sensor device, a computer system, a user interface, and an emotion engine. 【0123】 Sensor devices are installed in home storage units and automatically detect food identification information and expiration dates. This information is transmitted to a server and stored as logs in a food information database. The server uses this data to manage inventory and expiration dates. 【0124】 Users input their food preferences, allergy information, and diet needs via devices such as smartphones and PCs. They can also express their emotions using voice or text input. This information is transferred to a server and stored as a user profile. 【0125】 The emotion engine analyzes the user's input data to recognize their current emotional state. This emotional information is taken into consideration when the server suggests recipes. For example, if the user is stressed, the emotion engine will prioritize suggesting recipes that include ingredients with relaxing effects. Such recipes are automatically created by the generative AI. 【0126】 The server selects and displays an appropriate recipe on the terminal based on the user profile and emotional information. The user can then choose from the presented recipes and proceed with cooking. Once the user selects a recipe, the server provides the terminal with cooking instructions and necessary cooking utensils based on that recipe. 【0127】 For example, if the emotion engine determines that a user is feeling anxious, the server generates a recipe for "herb chicken with chamomile to alleviate anxiety" and presents it to the device. This approach allows users to have a meal experience that is sensitive to their emotions. 【0128】 This system utilizes natural language processing technology and emotion recognition capabilities to provide menu suggestions and cooking assistance tailored to the user's emotional state. This allows users to maintain a healthy and emotionally balanced diet. 【0129】 The following describes the processing flow. 【0130】 Step 1: 【0131】 The server uses sensor devices installed in home storage systems to automatically scan food items for identification and expiration dates, recording this information in a database. This information is then used for food inventory management. 【0132】 Step 2: 【0133】 Users input their food preferences, allergy information, and specific dietary needs through a device, which then transmits this data to a server. Furthermore, users can input their emotions via voice or text and send them to the server. 【0134】 Step 3: 【0135】 The server analyzes the emotional information received from the user using an emotion engine to identify the user's current emotional state (e.g., stress, anxiety, joy). Based on this analysis, it selects a recipe. 【0136】 Step 4: 【0137】 The server uses generative AI to generate multiple optimal recipes based on database inventory information, user profiles, and the results of the emotion engine. In this process, it prioritizes the use of ingredients that are appropriate to the user's emotional state. 【0138】 Step 5: 【0139】 The device displays a list of generated recipes to the user and explains the benefits of each recipe (e.g., emotional improvement, health benefits). This allows the user to select a recipe that matches their preferences. 【0140】 Step 6: 【0141】 When a user selects a recipe, the server generates detailed cooking instructions based on that recipe and displays them on the terminal. It also sends a shopping list of any missing ingredients to the terminal for the user to review. 【0142】 Step 7: 【0143】 The server uses natural language processing technology to provide users with real-time cooking advice to support the cooking process. The terminal displays this information, supporting the user's cooking experience. 【0144】 Through this series of processes, users can easily and efficiently make food choices that align with their emotions and health needs. 【0145】 (Example 2) 【0146】 Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal." 【0147】 In modern households, proper food management and providing meals tailored to individual health needs and mental states are crucial amidst busy daily lives. However, performing these tasks manually is extremely time-consuming and prone to errors. In particular, checking expiration dates and selecting recipes that suit individual moods are difficult to adapt to each person's circumstances. A system is needed to solve these problems. 【0148】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. 【0149】 In this invention, the server has means for automatically acquiring food identification information and expiration date using a sensor device installed in a home storage device, 【0150】 A means for managing the inventory and expiration date of food products on an information processing device based on acquired food information, 【0151】 A means equipped with an emotion recognition function that analyzes the user's emotions and selects a cooking method appropriate to that state, 【0152】 This includes automating inventory management and allowing users to receive optimal recipe suggestions tailored to their emotions and health needs. 【0153】 A "sensor device" is a device installed in a household storage system to automatically detect food identification information and expiration dates. 【0154】 "Food identification information" refers to specific information about food products, including information identified by barcodes or RFID tags. 【0155】 The "best before date" refers to the date by which food should ideally be consumed while maintaining its quality, and is information that guarantees the safety and quality of food to consumers. 【0156】 An "information processing device" is an electronic device used to manage and analyze data such as food identification information and expiration dates. 【0157】 "Emotion recognition functionality" is a technology that recognizes a user's current emotional state based on input data obtained from the user. 【0158】 A "generative AI model" is an artificial intelligence algorithm used to automatically generate new information or suggestions based on given inputs or prompts. 【0159】 A "prompt statement" is an input statement used to give specific instructions or requests to a generative AI model, and it plays a role in controlling the output that is generated. 【0160】 A "user terminal" is an electronic device used by a user to input information or receive suggested data. 【0161】 This invention is a system for managing food within the home and suggesting meals that are tailored to the user's emotional state. This system is comprised of a combination of sensor devices, an information processing device, a user interface, and an emotion recognition function. 【0162】 The sensor device is installed in the home storage unit and is responsible for automatically acquiring food identification information and expiration dates. The information acquired by the sensor device is transmitted to a server, where the information processing unit manages inventory and expiration dates. Based on this data, the information processing unit updates the status of the food in real time. 【0163】 Users can input their food preferences, allergy information, and diet needs using devices such as smartphones and personal computers. They can also provide emotional data through voice or text input. This input information is stored on a server and used as a user profile. 【0164】 The emotion recognition function analyzes the user's input data and recognizes their emotional state to understand the user's current psychological condition. Based on this, the server uses a generative AI model to generate recipes that are appropriate for the user's emotions. Prompt messages may take the form of, "The user is currently stressed, so please suggest a recipe that will help them relax." 【0165】 The recipes presented to the user are automatically generated by a generative AI model, taking into account emotional information provided by the emotion recognition function. Users can select recipes through their device, and information about cooking procedures and necessary cooking utensils will be provided. Specifically, if a user is feeling anxious, a recipe like "Herb Chicken with Chamomile to Relieve Anxiety" will be suggested. 【0166】 In summary, this system supports users in leading a healthy and emotionally satisfying diet. 【0167】 The flow of the specific processing in Example 2 will be explained using Figure 13. 【0168】 Step 1: 【0169】 The sensor device detects food identification information and expiration dates in household storage devices. 【0170】 The input is food stored in a storage device, and the output is identification information and expiration date. This information is sent to a server and recorded as a log in a database. This provides basic data on food inventory and expiration dates. 【0171】 Step 2: 【0172】 Users enter personal information such as their food preferences, allergy information, and diet needs using their smartphones or personal computers. 【0173】 As input, users provide their preferences and health information, and as output, this information is stored on the server. As a result of this information being accumulated in a database as a user profile, it becomes possible to manage individual dietary needs. 【0174】 Step 3: 【0175】 The emotion recognition function analyzes emotional input provided from the user's device and recognizes the user's current emotional state. 【0176】 The input is emotional information expressed by the user in voice or text, and the output is a labeled emotional state. This data is then processed to identify emotions and measure their intensity. 【0177】 Step 4: 【0178】 The server generates prompt statements for the generative AI model based on emotional information. 【0179】 The emotional state obtained in the previous step is used as input, and a prompt sentence is generated as output. This allows the AI ​​model to generate a prompt appropriate to the situation, such as "Please suggest a recipe to relieve stress." 【0180】 Step 5: 【0181】 The server uses prompt messages to retrieve the appropriate recipe from the generated AI model. 【0182】 The input consists of generated prompt text and user profile information, and the output is a recipe. The AI ​​model uses this information to list recipes that match the user's emotions. 【0183】 Step 6: 【0184】 The server sends the suggested recipe to the user via the terminal and displays it to the user. 【0185】 The system takes a generated recipe as input and displays a list of recipes on the terminal as output. The user can then make a meal selection based on this list. 【0186】 Step 7: 【0187】 The user uses their device to select their preferred recipe from the ones presented. 【0188】 The input is a list of displayed recipes, and the output is the recipe selected by the user, which is recorded on the server. The selection result is reflected in the cooking support in the next step. 【0189】 Step 8: 【0190】 The server provides the terminal with detailed cooking instructions and the necessary cooking utensils based on the selected recipe. 【0191】 The input is a recipe selected by the user, and the output is a detailed cooking process displayed on the terminal. This allows the user to prepare a meal by following the instructions. 【0192】 (Application Example 2) 【0193】 Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal". 【0194】 Currently, many households do not adequately manage their food, leading to spoilage and waste. Furthermore, appropriate meal suggestions are not provided based on users' emotional states, lacking consideration for individual lifestyles and health conditions. Therefore, there is a need for a system that efficiently manages food within the home and provides a comfortable eating experience through meal suggestions tailored to users' emotions and health status. 【0195】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. 【0196】 In this invention, the server includes means for automatically acquiring food identification information and expiration dates using sensor devices installed in household storage devices, means for managing the inventory and expiration dates on a computer system based on the acquired food information, means for analyzing the user's emotional state and automatically creating and providing recipes appropriate to those emotions using an AI model, and means for a household robot to provide cooking assistance based on the provided recipes. This reduces food waste, enables personalized meal suggestions and cooking assistance that are tailored to the user's emotional state, and allows for a more comfortable eating experience. 【0197】 "Household storage equipment" refers to storage spaces or refrigerators installed in a home for the purpose of preserving food. 【0198】 A "sensor device" is a device installed in a household storage system that automatically acquires food identification information and expiration dates. 【0199】 "Food identification information" refers to information used to identify the type and name of food, and may include barcodes or RFID tags. 【0200】 The "best before date" refers to the date by which food can be consumed at its optimal quality, and serves as a guideline for the safe consumption of food. 【0201】 A "computer system" is a combination of electronic devices and software used for processing, storing, and managing data. 【0202】 "Inventory information" refers to data about the types and quantities of food currently stored in the storage device. 【0203】 "User preferences" refer to information that indicates an individual's preferences for specific foods or dishes. 【0204】 "Health needs" refers to the dietary requirements based on the user's health status and dietary restrictions. 【0205】 A "computer program" is a collection of code that runs within a computer system to automate a specific task. 【0206】 A "generative AI model" is an artificial intelligence model trained to generate new information or content based on given data. 【0207】 A "household robot" is a robotic device designed for use in the home to automate or support various tasks. 【0208】 This invention utilizes several hardware and software components to enable efficient food management within the home. First, a server obtains food identification information and expiration dates from sensor devices installed in home storage units. This information is then used by a computer system for inventory management. Sensors such as barcode scanners and RFID tag readers can be used. 【0209】 Users input information about their preferences and health needs using smartphones or tablets and store it in a computer system. This data is analyzed using natural language processing technology and reflected in user profiles. The software used includes natural language processing libraries such as NLTK and spaCy. 【0210】 The server uses an emotion recognition engine to analyze the user's emotional state and recognize the current emotional state from the input data. IBM Watson® Natural Language Understanding can be used for emotion recognition. Subsequently, a generative AI model is used to automatically create a recipe appropriate to the user's emotions and provide it to the terminal. Generative AI models such as OpenAI® GPT are utilized in this process. 【0211】 As a concrete example, if a user voice-inputs "I'm tired from work today," the emotion engine classifies the emotion as "fatigue" and generates a "stamina curry" recipe to boost energy. Then, a household robot assists with cooking based on the recipe, allowing the user to immediately prepare the suggested dish. 【0212】 An example of a prompt message would be, "The user's current emotional state is fatigue. Please suggest a recommended recipe for a dish that will replenish their energy." This allows the user to choose a meal that suits their mood that day, helping them to lead a fulfilling life both physically and mentally. 【0213】 The flow of a specific process in Application Example 2 will be explained using Figure 14. 【0214】 Step 1: 【0215】 The server obtains food identification information and expiration dates from sensor devices installed in home storage systems. Inputs include barcodes and RFID tags read by the sensors. This information is stored in a database on the server and registered as inventory information. Specifically, the server analyzes the data obtained from the sensors to identify the type of food and its expiration date. 【0216】 Step 2: 【0217】 Users input information about their preferences and health needs via their smartphones. This input data includes food preferences, allergy information, and dietary needs. This information is analyzed using a natural language processing library and stored on the server as a user profile. Through this analysis, the database accumulates the user's dietary preferences. 【0218】 Step 3: 【0219】 The server acquires the user's emotional state through voice and text input and analyzes it using an emotion recognition engine. The input is emotional expression in voice or text format. The output is a classification of the user's emotional state. Specifically, emotion recognition software scans the text data and assigns emotion labels. 【0220】 Step 4: 【0221】 The server uses a generative AI model to automatically generate appropriate recipes based on the user's emotional state and preferences. The input consists of the user profile and emotional state. The AI ​​model uses this information to generate recommended dishes. Specifically, it prompts the generative AI and collects recipe suggestions. 【0222】 Step 5: 【0223】 The generated recipes are displayed on the user's device, allowing them to select one. The input is the recipe draft created in step 4. The user selects a recipe from the presented options, and the selected recipe information is output to the user's device. The device displays the recipe details. 【0224】 Step 6: 【0225】 Based on the recipe selected by the user, the server issues cooking instructions to the home robot. The input is the selected recipe sent from the user's terminal. The server communicates the necessary cooking steps to the robot, and the robot begins cooking according to the instructions. Specifically, the robot performs tasks such as preparing ingredients and simple cooking steps. 【0226】 The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data. 【0227】 Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. 【0228】 In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14. 【0229】 [Second Embodiment] 【0230】 Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment. 【0231】 As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server. 【0232】 The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). 【0233】 The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52. 【0234】 The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46. 【0235】 Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision). 【0236】 Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner. 【0237】 Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56. 【0238】 The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30. 【0239】 The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. 【0240】 In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48. 【0241】 Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal". 【0242】 This invention provides a system that efficiently manages food consumption and offers recipes tailored to dietary needs within the home. This system primarily consists of sensor devices, a computer system, and a user interface. 【0243】 The sensor device is installed in the home and automatically acquires identification information and expiration dates for stored food items. This information is transmitted to a server and recorded in a food database. The server uses this information to manage inventory and identify food items nearing their expiration date. 【0244】 Users can use devices such as smartphones and PCs to input information about their preferences, allergies, and specific dietary needs. This information is sent to the server and stored as a user profile. 【0245】 The server integrates acquired inventory information and user profiles, and uses a generation AI to automatically generate recipes. These recipes are designed to accommodate user preferences and health needs, and also prioritize the use of ingredients nearing their expiration date. The terminal displays these recipes to the user, making them available for selection. 【0246】 When a user selects a recipe from the presented options, the server generates detailed cooking instructions and displays them on the device. Furthermore, it automatically adds any missing ingredients needed for the selected recipe to a shopping list and provides it to the user. This process utilizes natural language processing technology, and the server provides cooking advice in text format through the user interface. 【0247】 As a concrete example, consider a scenario where a user has chicken, tomatoes, and spinach in their refrigerator and wants to follow a low-carbohydrate diet. The server generates a recipe for "Chicken and Spinach Tomato Stew" using these ingredients and presents it to the user's device. This recipe addresses the user's diet needs while also considering the ingredients' approaching expiration dates. 【0248】 In this way, users can easily prepare healthy meals while simultaneously minimizing food waste. This invention provides an environment that allows this entire process to be carried out seamlessly. 【0249】 The following describes the processing flow. 【0250】 Step 1: 【0251】 The server uses sensor devices installed in the storage unit to automatically scan food items for identification information and expiration dates. This information is sent to the server and recorded in the food information database. 【0252】 Step 2: 【0253】 Users use their devices to input their food preferences, allergy information, and diet type, and send this data to the server via the device. The server stores this information in the user profile. 【0254】 Step 3: 【0255】 The server periodically queries the database to check inventory levels and ingredients nearing their expiration dates. This helps identify ingredients with high priority for use. 【0256】 Step 4: 【0257】 The server uses a generative AI to generate several optimal recipes based on saved user profiles and the latest inventory information. This also takes into account prioritizing the use of ingredients nearing their expiration date. 【0258】 Step 5: 【0259】 The terminal presents the generated recipes to the user, displaying them in a selectable format. This allows the user to choose the menu item they want to cook from the specified recipes. 【0260】 Step 6: 【0261】 When a user selects a recipe, the server generates detailed advice on cooking steps and necessary tools based on that recipe. The terminal then provides this information to the user. 【0262】 Step 7: 【0263】 The server identifies ingredients needed for the selected recipe that are not in stock and lists them. The terminal displays this shopping list to the user and prompts them to confirm the necessary items. 【0264】 This series of steps allows users to efficiently manage their food supply and prepare meals that meet their health needs. 【0265】 (Example 1) 【0266】 Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal." 【0267】 Traditional home food management and meal preparation methods have challenges, such as ineffectively providing recipe suggestions tailored to inventory levels and individual health needs. In particular, there is a need for methods that can efficiently prepare healthy meals while reducing food waste. Conventional technologies fail to utilize ingredients nearing their expiration date and lack the means to accommodate users' specific preferences and health requirements. 【0268】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means. 【0269】 In this invention, the server includes means for automatically acquiring food identification information and expiration dates using sensor devices installed in household storage devices, means for managing the inventory and expiration dates of the food on a computer system based on the acquired food information, and means for inputting and updating information on the user's preferences and health requirements and storing this information on the computer system. This makes it possible to prioritize the use of ingredients nearing their expiration date and to suggest optimal cooking procedures that meet the user's health needs. 【0270】 A "sensor device" is a device installed in a household storage system that automatically acquires food identification information and expiration dates. 【0271】 A "computer system" is a device that integrates acquired food information and user information to enable inventory management and the generation of optimal cooking procedures. 【0272】 "User health requirements" refers to health-related conditions, including the user's individual preferences, allergies, and special nutritional needs. 【0273】 A "generative AI model" is a type of artificial intelligence that automatically generates the optimal cooking procedure based on user information and inventory information, by taking prompt messages. 【0274】 A "prompt message" is the text input to a generative AI model, and it contains data that includes the conditions and purpose of the data being used. 【0275】 "Natural language processing technology" is a technology in which a computer system analyzes input from a user, understands instructions in human language, and provides the results in text format. 【0276】 "Cooking instructions" refer to the cooking methods and processes generated based on acquired food information and user information, and are specific cooking instructions presented to the user. 【0277】 This invention is a system for providing food management and cooking procedures tailored to individual health needs. It mainly consists of a sensor device, a computer system, and a user terminal. 【0278】 The server uses sensor devices to acquire identification information and expiration dates for food items in the home. These sensor devices include hardware such as RFID tags and barcode scanners. This enables the collection of highly accurate food information. 【0279】 The acquired food information is transmitted to a computer system and recorded in a food database. The server uses this information to manage inventory and identify foods nearing their expiration date. 【0280】 The user inputs their preferences, allergies, and diet needs using a smartphone or PC. This information is sent to the server via the user terminal and stored in the computer system as an individual user profile. This enables the provision of personalized services. 【0281】 The generative AI model automatically generates cooking procedures optimal for user needs using the stored food inventory data and user profiles. The prompt text includes specific instructions such as "The inventory information is chicken, tomatoes, and spinach. The user desires a low-carb diet. Please generate a recipe suitable for the diet." 【0282】 The terminal displays the generated cooking procedures to the user and enables selection. Based on the recipe selected by the user, the server generates detailed cooking procedures and sends them to the terminal. Furthermore, the missing ingredients are automatically added to the shopping list and provided to the user. Natural language processing technology can be utilized to display advice during cooking in text form. In this way, the user can efficiently prepare health-conscious meals and minimize food loss. 【0283】 The flow of the specific process in Example 1 will be described using FIG. 11. 【0284】 Step 1: 【0285】 The server uses a sensor device to obtain the identification information and expiration date of the food in the home. This input data includes RFID tags or barcode data of the food, and the server analyzes this to extract the food name and expiration date and records them in the inventory database. Through this process, it is possible to grasp in real time what foods are in the home, how many there are, and when their expiration dates are approaching. 【0286】 Step 2: 【0287】 Users input their preferences, allergies, and health requirements via their smartphones or PCs. This information is sent from the device to the server. The server generates and stores a user profile based on this data. This profile information is used to generate recipes tailored to each user's individual needs. 【0288】 Step 3: 【0289】 The server retrieves food information from the inventory database and matches it with the user profile. The server then inputs a prompt message into the generating AI model. This prompt message includes specific conditions such as, "Inventory information: chicken, tomatoes, spinach. User desires a low-carbohydrate diet." Based on this, the generating AI model automatically generates the optimal cooking procedure. 【0290】 Step 4: 【0291】 The terminal displays cooking instructions received from the server to the user, allowing them to make selections. The final recipe is determined by the user selecting from the displayed options. The user's selection is confirmed by the terminal and sent to the server. 【0292】 Step 5: 【0293】 The server generates detailed cooking instructions and information on missing ingredients based on the recipe selected by the user. This process matches the selected recipe with inventory data to identify any missing ingredients. The generated cooking instructions and shopping list are sent to the terminal and provided to the user. 【0294】 Step 6: 【0295】 The terminal displays cooking advice to the user in real time. The server uses natural language processing technology to create specific advice that the user needs during cooking in text format and sends it to the terminal. This allows the user to perform cooking tasks more smoothly. 【0296】 (Application Example 1) 【0297】 Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal." 【0298】 Traditional home food management systems have presented challenges, such as the difficulty for users to efficiently obtain recipes based on their preferences and health needs. Furthermore, inadequate management of food expiration dates often led to food waste. Additionally, systems capable of providing voice-based cooking advice were limited, frequently causing inconvenience to users during cooking. There is a need to address these challenges and provide users with a more efficient and healthy way to manage and utilize food. 【0299】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. 【0300】 In this invention, the server includes means for automatically acquiring food identification information and expiration dates using a measuring device installed in a home information processing device, means for managing the inventory and expiration dates on an information processing system based on the acquired food information, and means for inputting and updating information on the user's preferences and health needs and storing this information on the information processing system. As a result, the user can receive recipes perfectly suited to their health condition and preferences via voice, while also being able to use ingredients while considering the expiration dates of the food, thereby reducing food waste and enabling efficient cooking. 【0301】 A "household information processing device" is an electronic device used to process information within the home. 【0302】 A "measuring device" is a device used to obtain identification information and expiration dates for food products. 【0303】 An "information processing system" is a system for processing and managing acquired information. 【0304】 The "information processing program" is a program that operates on an information processing system and generates an optimal cooking procedure. 【0305】 The "user terminal" is a terminal device that a user directly operates to check information. 【0306】 The "household robot" is an automated device that has a role of assisting people within a household. 【0307】 "Voice" is a means of transmitting information by auditory perception. 【0308】 The "natural language processing technology" is a technology for a computer to analyze and process natural languages used by people. 【0309】 To implement this invention, an information processing device installed within a household is used. The measurement device within the household acquires identification information of food and expiration dates, and transmits this information to a server. The server utilizes an information processing system to organize and manage the acquired data. The user can input their preferences and health needs through a voice interface via the household robot. At this time, a voice recognition library is used to convert the user's speech content into digital data. 【0310】 On the server side, the information processing program is executed, and an optimal cooking recipe that preferentially uses food with approaching expiration dates is generated. At this time, a generation AI model is utilized to make adjustments based on the individual health needs of the user. The generated recipe is provided to the user in voice or text through the user terminal or the household robot. 【0311】 The household robot has a voice output function, reads out the generated recipe and cooking procedure, and presents it to the user. Thereby, the user can receive cooking instructions in real time, and a shopping list for missing ingredients is also automatically generated as needed. 【0312】 As a concrete example, a recipe for "Chicken and Tomato Stew" is generated using tomatoes nearing their expiration date from among the chicken, eggs, and tomatoes in the refrigerator, and a household robot guides the user through this recipe by voice. If the user asks the robot to "suggest a low-calorie dinner recipe," an example of a prompt message would be, "Please generate a low-calorie recipe as requested by the user. The ingredients are chicken breast and broccoli. Please prioritize ingredients that are nearing their expiration date." 【0313】 The flow of a specific process in Application Example 1 will be explained using Figure 12. 【0314】 Step 1: 【0315】 When a user places food in their home information processing device, the measuring device automatically acquires the food's identification information and expiration date. The data obtained from the measuring device is identified using RFID tags or barcode readers and converted into a digital format. This digital data is transmitted to a server and stored in a food database. 【0316】 Step 2: 【0317】 The server analyzes a stored food database to manage food inventory status and expiration dates. Specifically, it uses database queries to identify food items nearing their expiration date. This allows for arrangements to be made to ensure that food is consumed in a timely manner. 【0318】 Step 3: 【0319】 Users communicate their preferences and health needs to a home robot via voice. Voice recognition technology converts the voice into text data, which is then sent to a server. This text data is stored within the information system as a user profile. 【0320】 Step 4: 【0321】 The server uses a generative AI model to automatically generate optimal cooking recipes based on stored food information and user profiles. Prompts are used to instruct this AI model, generating recipes tailored to the user's health needs. This process takes into account the food's expiration date and nutritional value. 【0322】 Step 5: 【0323】 The generated cooking recipe is displayed on the user's device in either audio or text format. A home robot guides the user through the recipe by voice, allowing them to quickly understand the cooking process and take action. 【0324】 Step 6: 【0325】 Based on the recipe selected by the user, the server generates cooking instructions and compiles a shopping list of necessary ingredients. This list can be viewed on the user's terminal and is helpful in selecting ingredients while considering their expiration dates. 【0326】 Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions. 【0327】 This invention provides a system for managing food within the home that considers the user's emotional state and suggests recipes appropriate to that emotional state. This system combines a sensor device, a computer system, a user interface, and an emotion engine. 【0328】 Sensor devices are installed in home storage units and automatically detect food identification information and expiration dates. This information is transmitted to a server and stored as logs in a food information database. The server uses this data to manage inventory and expiration dates. 【0329】 Users input their food preferences, allergy information, and diet needs via devices such as smartphones and PCs. They can also express their emotions using voice or text input. This information is transferred to a server and stored as a user profile. 【0330】 The emotion engine analyzes the user's input data to recognize their current emotional state. This emotional information is taken into consideration when the server suggests recipes. For example, if the user is stressed, the emotion engine will prioritize suggesting recipes that include ingredients with relaxing effects. Such recipes are automatically created by the generative AI. 【0331】 The server selects and displays an appropriate recipe on the terminal based on the user profile and emotional information. The user can then choose from the presented recipes and proceed with cooking. Once the user selects a recipe, the server provides the terminal with cooking instructions and necessary cooking utensils based on that recipe. 【0332】 For example, if the emotion engine determines that a user is feeling anxious, the server generates a recipe for "herb chicken with chamomile to alleviate anxiety" and presents it to the device. This approach allows users to have a meal experience that is sensitive to their emotions. 【0333】 This system utilizes natural language processing technology and emotion recognition capabilities to provide menu suggestions and cooking assistance tailored to the user's emotional state. This allows users to maintain a healthy and emotionally balanced diet. 【0334】 The following describes the processing flow. 【0335】 Step 1: 【0336】 The server uses sensor devices installed in home storage systems to automatically scan food items for identification and expiration dates, recording this information in a database. This information is then used for food inventory management. 【0337】 Step 2: 【0338】 Users input their food preferences, allergy information, and specific dietary needs through a device, which then transmits this data to a server. Furthermore, users can input their emotions via voice or text and send them to the server. 【0339】 Step 3: 【0340】 The server analyzes the emotional information received from the user using an emotion engine to identify the user's current emotional state (e.g., stress, anxiety, joy). Based on this analysis, it selects a recipe. 【0341】 Step 4: 【0342】 The server uses generative AI to generate multiple optimal recipes based on database inventory information, user profiles, and the results of the emotion engine. In this process, it prioritizes the use of ingredients that are appropriate to the user's emotional state. 【0343】 Step 5: 【0344】 The device displays a list of generated recipes to the user and explains the benefits of each recipe (e.g., emotional improvement, health benefits). This allows the user to select a recipe that matches their preferences. 【0345】 Step 6: 【0346】 When a user selects a recipe, the server generates detailed cooking instructions based on that recipe and displays them on the terminal. It also sends a shopping list of any missing ingredients to the terminal for the user to review. 【0347】 Step 7: 【0348】 The server uses natural language processing technology to provide users with real-time cooking advice to support the cooking process. The terminal displays this information, supporting the user's cooking experience. 【0349】 Through this series of processes, users can easily and efficiently make food choices that align with their emotions and health needs. 【0350】 (Example 2) 【0351】 Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal". 【0352】 In modern households, proper food management and providing meals tailored to individual health needs and mental states are crucial amidst busy daily lives. However, performing these tasks manually is extremely time-consuming and prone to errors. In particular, checking expiration dates and selecting recipes that suit individual moods are difficult to adapt to each person's circumstances. A system is needed to solve these problems. 【0353】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. 【0354】 In this invention, the server has means for automatically acquiring food identification information and expiration date using a sensor device installed in a home storage device, 【0355】 A means for managing the inventory and expiration date of food products on an information processing device based on acquired food information, 【0356】 A means equipped with an emotion recognition function that analyzes the user's emotions and selects a cooking method appropriate to that state, 【0357】 This includes automating inventory management and allowing users to receive optimal recipe suggestions tailored to their emotions and health needs. 【0358】 A "sensor device" is a device installed in a household storage system to automatically detect food identification information and expiration dates. 【0359】 "Food identification information" refers to specific information about food products, including information identified by barcodes or RFID tags. 【0360】 The "best before date" refers to the date by which food should ideally be consumed while maintaining its quality, and is information that guarantees the safety and quality of food to consumers. 【0361】 An "information processing device" is an electronic device used to manage and analyze data such as food identification information and expiration dates. 【0362】 "Emotion recognition functionality" is a technology that recognizes a user's current emotional state based on input data obtained from the user. 【0363】 A "generative AI model" is an artificial intelligence algorithm used to automatically generate new information or suggestions based on given inputs or prompts. 【0364】 A "prompt statement" is an input statement used to give specific instructions or requests to a generative AI model, and it plays a role in controlling the output that is generated. 【0365】 A "user terminal" is an electronic device used by a user to input information or receive suggested data. 【0366】 This invention is a system for managing food within the home and suggesting meals that are tailored to the user's emotional state. This system is comprised of a combination of sensor devices, an information processing device, a user interface, and an emotion recognition function. 【0367】 The sensor device is installed in the home storage unit and is responsible for automatically acquiring food identification information and expiration dates. The information acquired by the sensor device is transmitted to a server, where the information processing unit manages inventory and expiration dates. Based on this data, the information processing unit updates the status of the food in real time. 【0368】 Users can input their food preferences, allergy information, and diet needs using devices such as smartphones and personal computers. They can also provide emotional data through voice or text input. This input information is stored on a server and used as a user profile. 【0369】 The emotion recognition function analyzes the user's input data and recognizes their emotional state to understand the user's current psychological condition. Based on this, the server uses a generative AI model to generate recipes that are appropriate for the user's emotions. Prompt messages may take the form of, "The user is currently stressed, so please suggest a recipe that will help them relax." 【0370】 The recipes presented to the user are automatically generated by a generative AI model, taking into account emotional information provided by the emotion recognition function. Users can select recipes through their device, and information about cooking procedures and necessary cooking utensils will be provided. Specifically, if a user is feeling anxious, a recipe like "Herb Chicken with Chamomile to Relieve Anxiety" will be suggested. 【0371】 In summary, this system supports users in leading a healthy and emotionally satisfying diet. 【0372】 The flow of the specific processing in Example 2 will be explained using Figure 13. 【0373】 Step 1: 【0374】 The sensor device detects food identification information and expiration dates in household storage devices. 【0375】 The input is food stored in a storage device, and the output is identification information and expiration date. This information is sent to a server and recorded as a log in a database. This provides basic data on food inventory and expiration dates. 【0376】 Step 2: 【0377】 Users enter personal information such as their food preferences, allergy information, and diet needs using their smartphones or personal computers. 【0378】 As input, users provide their preferences and health information, and as output, this information is stored on the server. As a result of this information being accumulated in a database as a user profile, it becomes possible to manage individual dietary needs. 【0379】 Step 3: 【0380】 The emotion recognition function analyzes emotional input provided from the user's device and recognizes the user's current emotional state. 【0381】 The input is emotional information expressed by the user in voice or text, and the output is a labeled emotional state. This data is then processed to identify emotions and measure their intensity. 【0382】 Step 4: 【0383】 The server generates prompt statements for the generative AI model based on emotional information. 【0384】 The emotional state obtained in the previous step is used as input, and a prompt sentence is generated as output. This allows the AI ​​model to generate a prompt appropriate to the situation, such as "Please suggest a recipe to relieve stress." 【0385】 Step 5: 【0386】 The server uses prompt messages to retrieve the appropriate recipe from the generated AI model. 【0387】 The input consists of generated prompt text and user profile information, and the output is a recipe. The AI ​​model uses this information to list recipes that match the user's emotions. 【0388】 Step 6: 【0389】 The server sends the suggested recipe to the user via the terminal and displays it to the user. 【0390】 The system takes a generated recipe as input and displays a list of recipes on the terminal as output. The user can then make a meal selection based on this list. 【0391】 Step 7: 【0392】 The user uses their device to select their preferred recipe from the ones presented. 【0393】 The input is a list of displayed recipes, and the output is the recipe selected by the user, which is recorded on the server. The selection result is reflected in the cooking support in the next step. 【0394】 Step 8: 【0395】 The server provides the terminal with detailed cooking instructions and the necessary cooking utensils based on the selected recipe. 【0396】 The input is a recipe selected by the user, and the output is a detailed cooking process displayed on the terminal. This allows the user to prepare a meal by following the instructions. 【0397】 (Application Example 2) 【0398】 Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal." 【0399】 Currently, many households do not adequately manage their food, leading to spoilage and waste. Furthermore, appropriate meal suggestions are not provided based on users' emotional states, lacking consideration for individual lifestyles and health conditions. Therefore, there is a need for a system that efficiently manages food within the home and provides a comfortable eating experience through meal suggestions tailored to users' emotions and health status. 【0400】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. 【0401】 In this invention, the server includes means for automatically acquiring food identification information and expiration dates using sensor devices installed in household storage devices, means for managing the inventory and expiration dates on a computer system based on the acquired food information, means for analyzing the user's emotional state and automatically creating and providing recipes appropriate to those emotions using an AI model, and means for a household robot to provide cooking assistance based on the provided recipes. This reduces food waste, enables personalized meal suggestions and cooking assistance that are tailored to the user's emotional state, and allows for a more comfortable eating experience. 【0402】 "Household storage equipment" refers to storage spaces or refrigerators installed in a home for the purpose of preserving food. 【0403】 A "sensor device" is a device installed in a household storage system that automatically acquires food identification information and expiration dates. 【0404】 "Food identification information" refers to information used to identify the type and name of food, and may include barcodes or RFID tags. 【0405】 The "best before date" refers to the date by which food can be consumed at its optimal quality, and serves as a guideline for the safe consumption of food. 【0406】 A "computer system" is a combination of electronic devices and software used for processing, storing, and managing data. 【0407】 "Inventory information" refers to data about the types and quantities of food currently stored in the storage device. 【0408】 "User preferences" refer to information that indicates an individual's preferences for specific foods or dishes. 【0409】 "Health needs" refers to the dietary requirements based on the user's health status and dietary restrictions. 【0410】 A "computer program" is a collection of code that runs within a computer system to automate a specific task. 【0411】 A "generative AI model" is an artificial intelligence model trained to generate new information or content based on given data. 【0412】 A "household robot" is a robotic device designed for use in the home to automate or support various tasks. 【0413】 This invention utilizes several hardware and software components to enable efficient food management within the home. First, a server obtains food identification information and expiration dates from sensor devices installed in home storage units. This information is then used by a computer system for inventory management. Sensors such as barcode scanners and RFID tag readers can be used. 【0414】 Users input information about their preferences and health needs using smartphones or tablets and store it in a computer system. This data is analyzed using natural language processing technology and reflected in user profiles. The software used includes natural language processing libraries such as NLTK and spaCy. 【0415】 The server uses an emotion recognition engine to analyze the user's emotional state and recognize the current emotional state from the input data. IBM Watson Natural Language Understanding can be used for emotion recognition. Subsequently, a generative AI model is used to automatically create a recipe appropriate to the user's emotions and provide it to the terminal. Generative AI models such as OpenAI GPT are utilized in this process. 【0416】 As a concrete example, if a user voice-inputs "I'm tired from work today," the emotion engine classifies the emotion as "fatigue" and generates a "stamina curry" recipe to boost energy. Then, a household robot assists with cooking based on the recipe, allowing the user to immediately prepare the suggested dish. 【0417】 An example of a prompt message would be, "The user's current emotional state is fatigue. Please suggest a recommended recipe for a dish that will replenish their energy." This allows the user to choose a meal that suits their mood that day, helping them to lead a fulfilling life both physically and mentally. 【0418】 The flow of a specific process in Application Example 2 will be explained using Figure 14. 【0419】 Step 1: 【0420】 The server obtains food identification information and expiration dates from sensor devices installed in home storage systems. Inputs include barcodes and RFID tags read by the sensors. This information is stored in a database on the server and registered as inventory information. Specifically, the server analyzes the data obtained from the sensors to identify the type of food and its expiration date. 【0421】 Step 2: 【0422】 Users input information about their preferences and health needs via their smartphones. This input data includes food preferences, allergy information, and dietary needs. This information is analyzed using a natural language processing library and stored on the server as a user profile. Through this analysis, the database accumulates the user's dietary preferences. 【0423】 Step 3: 【0424】 The server acquires the user's emotional state through voice and text input and analyzes it using an emotion recognition engine. The input is emotional expression in voice or text format. The output is a classification of the user's emotional state. Specifically, emotion recognition software scans the text data and assigns emotion labels. 【0425】 Step 4: 【0426】 The server uses a generative AI model to automatically generate appropriate recipes based on the user's emotional state and preferences. The input consists of the user profile and emotional state. The AI ​​model uses this information to generate recommended dishes. Specifically, it prompts the generative AI and collects recipe suggestions. 【0427】 Step 5: 【0428】 The generated recipes are displayed on the user's device, allowing them to select one. The input is the recipe draft created in step 4. The user selects a recipe from the presented options, and the selected recipe information is output to the user's device. The device displays the recipe details. 【0429】 Step 6: 【0430】 Based on the recipe selected by the user, the server issues cooking instructions to the home robot. The input is the selected recipe sent from the user's terminal. The server communicates the necessary cooking steps to the robot, and the robot begins cooking according to the instructions. Specifically, the robot performs tasks such as preparing ingredients and simple cooking steps. 【0431】 The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data. 【0432】 Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. 【0433】 In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214. 【0434】 [Third Embodiment] 【0435】 Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment. 【0436】 As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server. 【0437】 The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). 【0438】 The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52. 【0439】 The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46. 【0440】 Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision). 【0441】 Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner. 【0442】 Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56. 【0443】 The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30. 【0444】 The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. 【0445】 In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48. 【0446】 Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal". 【0447】 This invention provides a system that efficiently manages food consumption and offers recipes tailored to dietary needs within the home. This system primarily consists of sensor devices, a computer system, and a user interface. 【0448】 The sensor device is installed in the home and automatically acquires identification information and expiration dates for stored food items. This information is transmitted to a server and recorded in a food database. The server uses this information to manage inventory and identify food items nearing their expiration date. 【0449】 Users can use devices such as smartphones and PCs to input information about their preferences, allergies, and specific dietary needs. This information is sent to the server and stored as a user profile. 【0450】 The server integrates acquired inventory information and user profiles, and uses a generation AI to automatically generate recipes. These recipes are designed to accommodate user preferences and health needs, and also prioritize the use of ingredients nearing their expiration date. The terminal displays these recipes to the user, making them available for selection. 【0451】 When a user selects a recipe from the presented options, the server generates detailed cooking instructions and displays them on the device. Furthermore, it automatically adds any missing ingredients needed for the selected recipe to a shopping list and provides it to the user. This process utilizes natural language processing technology, and the server provides cooking advice in text format through the user interface. 【0452】 As a concrete example, consider a scenario where a user has chicken, tomatoes, and spinach in their refrigerator and wants to follow a low-carbohydrate diet. The server generates a recipe for "Chicken and Spinach Tomato Stew" using these ingredients and presents it to the user's device. This recipe addresses the user's diet needs while also considering the ingredients' approaching expiration dates. 【0453】 In this way, users can easily prepare healthy meals while simultaneously minimizing food waste. This invention provides an environment that allows this entire process to be carried out seamlessly. 【0454】 The following describes the processing flow. 【0455】 Step 1: 【0456】 The server uses sensor devices installed in the storage unit to automatically scan food items for identification information and expiration dates. This information is sent to the server and recorded in the food information database. 【0457】 Step 2: 【0458】 Users use their devices to input their food preferences, allergy information, and diet type, and send this data to the server via the device. The server stores this information in the user profile. 【0459】 Step 3: 【0460】 The server periodically queries the database to check inventory levels and ingredients nearing their expiration dates. This helps identify ingredients with high priority for use. 【0461】 Step 4: 【0462】 The server uses a generative AI to generate several optimal recipes based on saved user profiles and the latest inventory information. This also takes into account prioritizing the use of ingredients nearing their expiration date. 【0463】 Step 5: 【0464】 The terminal presents the generated recipes to the user, displaying them in a selectable format. This allows the user to choose the menu item they want to cook from the specified recipes. 【0465】 Step 6: 【0466】 When a user selects a recipe, the server generates detailed advice on cooking steps and necessary tools based on that recipe. The terminal then provides this information to the user. 【0467】 Step 7: 【0468】 The server identifies ingredients needed for the selected recipe that are not in stock and lists them. The terminal displays this shopping list to the user and prompts them to confirm the necessary items. 【0469】 This series of steps allows users to efficiently manage their food supply and prepare meals that meet their health needs. 【0470】 (Example 1) 【0471】 Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal." 【0472】 Traditional home food management and meal preparation methods have challenges, such as ineffectively providing recipe suggestions tailored to inventory levels and individual health needs. In particular, there is a need for methods that can efficiently prepare healthy meals while reducing food waste. Conventional technologies fail to utilize ingredients nearing their expiration date and lack the means to accommodate users' specific preferences and health requirements. 【0473】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means. 【0474】 In this invention, the server includes means for automatically acquiring food identification information and expiration dates using sensor devices installed in household storage devices, means for managing the inventory and expiration dates of the food on a computer system based on the acquired food information, and means for inputting and updating information on the user's preferences and health requirements and storing this information on the computer system. This makes it possible to prioritize the use of ingredients nearing their expiration date and to suggest optimal cooking procedures that meet the user's health needs. 【0475】 A "sensor device" is a device installed in a household storage system that automatically acquires food identification information and expiration dates. 【0476】 A "computer system" is a device that integrates acquired food information and user information to enable inventory management and the generation of optimal cooking procedures. 【0477】 "User health requirements" refers to health-related conditions, including the user's individual preferences, allergies, and special nutritional needs. 【0478】 A "generative AI model" is a type of artificial intelligence that automatically generates the optimal cooking procedure based on user information and inventory information, by taking prompt messages. 【0479】 A "prompt message" is the text input to a generative AI model, and it contains data that includes the conditions and purpose of the data being used. 【0480】 "Natural language processing technology" is a technology in which a computer system analyzes input from a user, understands instructions in human language, and provides the results in text format. 【0481】 "Cooking instructions" refer to the cooking methods and processes generated based on acquired food information and user information, and are specific cooking instructions presented to the user. 【0482】 This invention is a system for providing food management and cooking procedures tailored to individual health needs. It mainly consists of a sensor device, a computer system, and a user terminal. 【0483】 The server uses sensor devices to acquire identification information and expiration dates for food items in the home. These sensor devices include hardware such as RFID tags and barcode scanners. This enables the collection of highly accurate food information. 【0484】 The acquired food information is transmitted to a computer system and recorded in a food database. The server uses this information to manage inventory and identify foods nearing their expiration date. 【0485】 Users input their preferences, allergies, and dietary needs using their smartphones or PCs. This information is transmitted to the server via the user's device and stored in the computer system as an individual user profile. This enables the provision of personalized services. 【0486】 The generation AI model uses stored food inventory data and user profiles to automatically generate cooking instructions best suited to the user's needs. Prompt messages include specific instructions such as, "Inventory information: chicken, tomatoes, spinach. User wants a low-carb diet. Generate a diet-friendly recipe." 【0487】 The terminal displays the generated cooking instructions to the user, allowing them to make a selection. Based on the recipe selected by the user, the server generates detailed cooking instructions and sends them to the terminal. Furthermore, any missing ingredients are automatically added to the shopping list and provided to the user. Natural language processing technology is utilized to display cooking advice in text format. In this way, users can efficiently prepare healthy meals and minimize food waste. 【0488】 The flow of the specific processing in Example 1 will be explained using Figure 11. 【0489】 Step 1: 【0490】 The server uses sensor devices to acquire identification information and expiration dates for food items in the home. This input data includes RFID tags and barcodes on the food items. The server analyzes this data to extract the food name and expiration date, and records it in an inventory database. This process allows the homeowner to know in real time what kinds of food items are in their home, how much of each they are, and how soon they will expire. 【0491】 Step 2: 【0492】 Users input their preferences, allergies, and health requirements via their smartphones or PCs. This information is sent from the device to the server. The server generates and stores a user profile based on this data. This profile information is used to generate recipes tailored to each user's individual needs. 【0493】 Step 3: 【0494】 The server retrieves food information from the inventory database and matches it with the user profile. The server then inputs a prompt message into the generating AI model. This prompt message includes specific conditions such as, "Inventory information: chicken, tomatoes, spinach. User desires a low-carbohydrate diet." Based on this, the generating AI model automatically generates the optimal cooking procedure. 【0495】 Step 4: 【0496】 The terminal displays cooking instructions received from the server to the user, allowing them to make selections. The final recipe is determined by the user selecting from the displayed options. The user's selection is confirmed by the terminal and sent to the server. 【0497】 Step 5: 【0498】 The server generates detailed cooking instructions and information on missing ingredients based on the recipe selected by the user. This process matches the selected recipe with inventory data to identify any missing ingredients. The generated cooking instructions and shopping list are sent to the terminal and provided to the user. 【0499】 Step 6: 【0500】 The terminal displays cooking advice to the user in real time. The server uses natural language processing technology to create specific advice that the user needs during cooking in text format and sends it to the terminal. This allows the user to perform cooking tasks more smoothly. 【0501】 (Application Example 1) 【0502】 Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal." 【0503】 Traditional home food management systems have presented challenges, such as the difficulty for users to efficiently obtain recipes based on their preferences and health needs. Furthermore, inadequate management of food expiration dates often led to food waste. Additionally, systems capable of providing voice-based cooking advice were limited, frequently causing inconvenience to users during cooking. There is a need to address these challenges and provide users with a more efficient and healthy way to manage and utilize food. 【0504】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. 【0505】 In this invention, the server includes means for automatically acquiring food identification information and expiration dates using a measuring device installed in a home information processing device, means for managing the inventory and expiration dates on an information processing system based on the acquired food information, and means for inputting and updating information on the user's preferences and health needs and storing this information on the information processing system. As a result, the user can receive recipes perfectly suited to their health condition and preferences via voice, while also being able to use ingredients while considering the expiration dates of the food, thereby reducing food waste and enabling efficient cooking. 【0506】 A "household information processing device" is an electronic device used to process information within the home. 【0507】 A "measuring device" is a device used to obtain identification information and expiration dates for food products. 【0508】 An "information processing system" is a system for processing and managing acquired information. 【0509】 An "information processing program" is a program that runs on an information processing system and generates the optimal cooking procedure. 【0510】 A "user terminal" is a terminal device that a user directly operates to check information. 【0511】 A "household robot" is an automated device that plays a role in assisting people within the home. 【0512】 "Sound" is a means of transmitting information through hearing. 【0513】 "Natural language processing technology" is a technology that enables computers to analyze and process natural language used by humans. 【0514】 To implement this invention, an information processing device installed in the home is used. The in-home measuring device acquires food identification information and expiration date, and transmits this information to a server. The server uses an information processing system to organize and manage the acquired data. The user can input their preferences and health needs using a voice interface via a home robot. In this process, a speech recognition library is used to convert the user's speech into digital data. 【0515】 On the server side, an information processing program is executed to generate an optimal cooking recipe that prioritizes the use of food items nearing their expiration date. A generation AI model is utilized in this process, making adjustments based on the user's individual health needs. The generated recipe is then provided to the user via voice or text through their terminal or a home robot. 【0516】 The home robot has a voice output function that reads out generated recipes and cooking instructions, presenting them to the user. This allows the user to receive cooking instructions in real time, and a shopping list of missing ingredients is automatically generated as needed. 【0517】 As a concrete example, a recipe for "Chicken and Tomato Stew" is generated using tomatoes nearing their expiration date from among the chicken, eggs, and tomatoes in the refrigerator, and a household robot guides the user through this recipe by voice. If the user asks the robot to "suggest a low-calorie dinner recipe," an example of a prompt message would be, "Please generate a low-calorie recipe as requested by the user. The ingredients are chicken breast and broccoli. Please prioritize ingredients that are nearing their expiration date." 【0518】 The flow of a specific process in Application Example 1 will be explained using Figure 12. 【0519】 Step 1: 【0520】 When a user places food in their home information processing device, the measuring device automatically acquires the food's identification information and expiration date. The data obtained from the measuring device is identified using RFID tags or barcode readers and converted into a digital format. This digital data is transmitted to a server and stored in a food database. 【0521】 Step 2: 【0522】 The server analyzes a stored food database to manage food inventory status and expiration dates. Specifically, it uses database queries to identify food items nearing their expiration date. This allows for arrangements to be made to ensure that food is consumed in a timely manner. 【0523】 Step 3: 【0524】 Users communicate their preferences and health needs to a home robot via voice. Voice recognition technology converts the voice into text data, which is then sent to a server. This text data is stored within the information system as a user profile. 【0525】 Step 4: 【0526】 The server uses a generative AI model to automatically generate optimal cooking recipes based on stored food information and user profiles. Prompts are used to instruct this AI model, generating recipes tailored to the user's health needs. This process takes into account the food's expiration date and nutritional value. 【0527】 Step 5: 【0528】 The generated cooking recipe is displayed on the user's device in either audio or text format. A home robot guides the user through the recipe by voice, allowing them to quickly understand the cooking process and take action. 【0529】 Step 6: 【0530】 Based on the recipe selected by the user, the server generates cooking instructions and compiles a shopping list of necessary ingredients. This list can be viewed on the user's terminal and is helpful in selecting ingredients while considering their expiration dates. 【0531】 Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions. 【0532】 This invention provides a system for managing food within the home that considers the user's emotional state and suggests recipes appropriate to that emotional state. This system combines a sensor device, a computer system, a user interface, and an emotion engine. 【0533】 Sensor devices are installed in home storage units and automatically detect food identification information and expiration dates. This information is transmitted to a server and stored as logs in a food information database. The server uses this data to manage inventory and expiration dates. 【0534】 Users input their food preferences, allergy information, and diet needs via devices such as smartphones and PCs. They can also express their emotions using voice or text input. This information is transferred to a server and stored as a user profile. 【0535】 The emotion engine analyzes the user's input data to recognize their current emotional state. This emotional information is taken into consideration when the server suggests recipes. For example, if the user is stressed, the emotion engine will prioritize suggesting recipes that include ingredients with relaxing effects. Such recipes are automatically created by the generative AI. 【0536】 The server selects and displays an appropriate recipe on the terminal based on the user profile and emotional information. The user can then choose from the presented recipes and proceed with cooking. Once the user selects a recipe, the server provides the terminal with cooking instructions and necessary cooking utensils based on that recipe. 【0537】 For example, if the emotion engine determines that a user is feeling anxious, the server generates a recipe for "herb chicken with chamomile to alleviate anxiety" and presents it to the device. This approach allows users to have a meal experience that is sensitive to their emotions. 【0538】 This system utilizes natural language processing technology and emotion recognition capabilities to provide menu suggestions and cooking assistance tailored to the user's emotional state. This allows users to maintain a healthy and emotionally balanced diet. 【0539】 The following describes the processing flow. 【0540】 Step 1: 【0541】 The server uses sensor devices installed in home storage systems to automatically scan food items for identification and expiration dates, recording this information in a database. This information is then used for food inventory management. 【0542】 Step 2: 【0543】 Users input their food preferences, allergy information, and specific dietary needs through a device, which then transmits this data to a server. Furthermore, users can input their emotions via voice or text and send them to the server. 【0544】 Step 3: 【0545】 The server analyzes the emotional information received from the user using an emotion engine to identify the user's current emotional state (e.g., stress, anxiety, joy). Based on this analysis, it selects a recipe. 【0546】 Step 4: 【0547】 The server uses generative AI to generate multiple optimal recipes based on database inventory information, user profiles, and the results of the emotion engine. In this process, it prioritizes the use of ingredients that are appropriate to the user's emotional state. 【0548】 Step 5: 【0549】 The device displays a list of generated recipes to the user and explains the benefits of each recipe (e.g., emotional improvement, health benefits). This allows the user to select a recipe that matches their preferences. 【0550】 Step 6: 【0551】 When a user selects a recipe, the server generates detailed cooking instructions based on that recipe and displays them on the terminal. It also sends a shopping list of any missing ingredients to the terminal for the user to review. 【0552】 Step 7: 【0553】 The server uses natural language processing technology to provide users with real-time cooking advice to support the cooking process. The terminal displays this information, supporting the user's cooking experience. 【0554】 Through this series of processes, users can easily and efficiently make food choices that align with their emotions and health needs. 【0555】 (Example 2) 【0556】 Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal." 【0557】 In modern households, proper food management and providing meals tailored to individual health needs and mental states are crucial amidst busy daily lives. However, performing these tasks manually is extremely time-consuming and prone to errors. In particular, checking expiration dates and selecting recipes that suit individual moods are difficult to adapt to each person's circumstances. A system is needed to solve these problems. 【0558】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. 【0559】 In this invention, the server has means for automatically acquiring food identification information and expiration date using a sensor device installed in a home storage device, 【0560】 A means for managing the inventory and expiration date of food products on an information processing device based on acquired food information, 【0561】 A means equipped with an emotion recognition function that analyzes the user's emotions and selects a cooking method appropriate to that state, 【0562】 This includes automating inventory management and allowing users to receive optimal recipe suggestions tailored to their emotions and health needs. 【0563】 A "sensor device" is a device installed in a household storage system to automatically detect food identification information and expiration dates. 【0564】 "Food identification information" refers to specific information about food products, including information identified by barcodes or RFID tags. 【0565】 The "best before date" refers to the date by which food should ideally be consumed while maintaining its quality, and is information that guarantees the safety and quality of food to consumers. 【0566】 An "information processing device" is an electronic device used to manage and analyze data such as food identification information and expiration dates. 【0567】 "Emotion recognition functionality" is a technology that recognizes a user's current emotional state based on input data obtained from the user. 【0568】 A "generative AI model" is an artificial intelligence algorithm used to automatically generate new information or suggestions based on given inputs or prompts. 【0569】 A "prompt statement" is an input statement used to give specific instructions or requests to a generative AI model, and it plays a role in controlling the output that is generated. 【0570】 A "user terminal" is an electronic device used by a user to input information or receive suggested data. 【0571】 This invention is a system for managing food within the home and suggesting meals that are tailored to the user's emotional state. This system is comprised of a combination of sensor devices, an information processing device, a user interface, and an emotion recognition function. 【0572】 The sensor device is installed in the home storage unit and is responsible for automatically acquiring food identification information and expiration dates. The information acquired by the sensor device is transmitted to a server, where the information processing unit manages inventory and expiration dates. Based on this data, the information processing unit updates the status of the food in real time. 【0573】 Users can input their food preferences, allergy information, and diet needs using devices such as smartphones and personal computers. They can also provide emotional data through voice or text input. This input information is stored on a server and used as a user profile. 【0574】 The emotion recognition function analyzes the user's input data and recognizes their emotional state to understand the user's current psychological condition. Based on this, the server uses a generative AI model to generate recipes that are appropriate for the user's emotions. Prompt messages may take the form of, "The user is currently stressed, so please suggest a recipe that will help them relax." 【0575】 The recipes presented to the user are automatically generated by a generative AI model, taking into account emotional information provided by the emotion recognition function. Users can select recipes through their device, and information about cooking procedures and necessary cooking utensils will be provided. Specifically, if a user is feeling anxious, a recipe like "Herb Chicken with Chamomile to Relieve Anxiety" will be suggested. 【0576】 In summary, this system supports users in leading a healthy and emotionally satisfying diet. 【0577】 The flow of the specific processing in Example 2 will be explained using Figure 13. 【0578】 Step 1: 【0579】 The sensor device detects food identification information and expiration dates in household storage devices. 【0580】 The input is food stored in a storage device, and the output is identification information and expiration date. This information is sent to a server and recorded as a log in a database. This provides basic data on food inventory and expiration dates. 【0581】 Step 2: 【0582】 Users enter personal information such as their food preferences, allergy information, and diet needs using their smartphones or personal computers. 【0583】 As input, users provide their preferences and health information, and as output, this information is stored on the server. As a result of this information being accumulated in a database as a user profile, it becomes possible to manage individual dietary needs. 【0584】 Step 3: 【0585】 The emotion recognition function analyzes emotional input provided from the user's device and recognizes the user's current emotional state. 【0586】 The input is emotional information expressed by the user in voice or text, and the output is a labeled emotional state. This data is then processed to identify emotions and measure their intensity. 【0587】 Step 4: 【0588】 The server generates prompt statements for the generative AI model based on emotional information. 【0589】 The emotional state obtained in the previous step is used as input, and a prompt sentence is generated as output. This allows the AI ​​model to generate a prompt appropriate to the situation, such as "Please suggest a recipe to relieve stress." 【0590】 Step 5: 【0591】 The server uses prompt messages to retrieve the appropriate recipe from the generated AI model. 【0592】 The input consists of generated prompt text and user profile information, and the output is a recipe. The AI ​​model uses this information to list recipes that match the user's emotions. 【0593】 Step 6: 【0594】 The server sends the suggested recipe to the user via the terminal and displays it to the user. 【0595】 The system takes a generated recipe as input and displays a list of recipes on the terminal as output. The user can then make a meal selection based on this list. 【0596】 Step 7: 【0597】 The user uses their device to select their preferred recipe from the ones presented. 【0598】 The input is a list of displayed recipes, and the output is the recipe selected by the user, which is recorded on the server. The selection result is reflected in the cooking support in the next step. 【0599】 Step 8: 【0600】 The server provides the terminal with detailed cooking instructions and the necessary cooking utensils based on the selected recipe. 【0601】 The input is a recipe selected by the user, and the output is a detailed cooking process displayed on the terminal. This allows the user to prepare a meal by following the instructions. 【0602】 (Application Example 2) 【0603】 Next, we will explain Application Example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal." 【0604】 Currently, many households do not adequately manage their food, leading to spoilage and waste. Furthermore, appropriate meal suggestions are not provided based on users' emotional states, lacking consideration for individual lifestyles and health conditions. Therefore, there is a need for a system that efficiently manages food within the home and provides a comfortable eating experience through meal suggestions tailored to users' emotions and health status. 【0605】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. 【0606】 In this invention, the server includes means for automatically acquiring food identification information and expiration dates using sensor devices installed in household storage devices, means for managing the inventory and expiration dates on a computer system based on the acquired food information, means for analyzing the user's emotional state and automatically creating and providing recipes appropriate to those emotions using an AI model, and means for a household robot to provide cooking assistance based on the provided recipes. This reduces food waste, enables personalized meal suggestions and cooking assistance that are tailored to the user's emotional state, and allows for a more comfortable eating experience. 【0607】 "Household storage equipment" refers to storage spaces or refrigerators installed in a home for the purpose of preserving food. 【0608】 A "sensor device" is a device installed in a household storage system that automatically acquires food identification information and expiration dates. 【0609】 "Food identification information" refers to information used to identify the type and name of food, and may include barcodes or RFID tags. 【0610】 The "best before date" refers to the date by which food can be consumed at its optimal quality, and serves as a guideline for the safe consumption of food. 【0611】 A "computer system" is a combination of electronic devices and software used for processing, storing, and managing data. 【0612】 "Inventory information" refers to data about the types and quantities of food currently stored in the storage device. 【0613】 "User preferences" refer to information that indicates an individual's preferences for specific foods or dishes. 【0614】 "Health needs" refers to the dietary requirements based on the user's health status and dietary restrictions. 【0615】 A "computer program" is a collection of code that runs within a computer system to automate a specific task. 【0616】 A "generative AI model" is an artificial intelligence model trained to generate new information or content based on given data. 【0617】 A "household robot" is a robotic device designed for use in the home to automate or support various tasks. 【0618】 This invention utilizes several hardware and software components to enable efficient food management within the home. First, a server obtains food identification information and expiration dates from sensor devices installed in home storage units. This information is then used by a computer system for inventory management. Sensors such as barcode scanners and RFID tag readers can be used. 【0619】 Users input information about their preferences and health needs using smartphones or tablets and store it in a computer system. This data is analyzed using natural language processing technology and reflected in user profiles. The software used includes natural language processing libraries such as NLTK and spaCy. 【0620】 The server uses an emotion recognition engine to analyze the user's emotional state and recognize the current emotional state from the input data. IBM Watson Natural Language Understanding can be used for emotion recognition. Subsequently, a generative AI model is used to automatically create a recipe appropriate to the user's emotions and provide it to the terminal. Generative AI models such as OpenAI GPT are utilized in this process. 【0621】 As a concrete example, if a user voice-inputs "I'm tired from work today," the emotion engine classifies the emotion as "fatigue" and generates a "stamina curry" recipe to boost energy. Then, a household robot assists with cooking based on the recipe, allowing the user to immediately prepare the suggested dish. 【0622】 An example of a prompt message would be, "The user's current emotional state is fatigue. Please suggest a recommended recipe for a dish that will replenish their energy." This allows the user to choose a meal that suits their mood that day, helping them to lead a fulfilling life both physically and mentally. 【0623】 The flow of a specific process in Application Example 2 will be explained using Figure 14. 【0624】 Step 1: 【0625】 The server obtains food identification information and expiration dates from sensor devices installed in home storage systems. Inputs include barcodes and RFID tags read by the sensors. This information is stored in a database on the server and registered as inventory information. Specifically, the server analyzes the data obtained from the sensors to identify the type of food and its expiration date. 【0626】 Step 2: 【0627】 Users input information about their preferences and health needs via their smartphones. This input data includes food preferences, allergy information, and dietary needs. This information is analyzed using a natural language processing library and stored on the server as a user profile. Through this analysis, the database accumulates the user's dietary preferences. 【0628】 Step 3: 【0629】 The server acquires the user's emotional state through voice and text input and analyzes it using an emotion recognition engine. The input is emotional expression in voice or text format. The output is a classification of the user's emotional state. Specifically, emotion recognition software scans the text data and assigns emotion labels. 【0630】 Step 4: 【0631】 The server uses a generative AI model to automatically generate appropriate recipes based on the user's emotional state and preferences. The input consists of the user profile and emotional state. The AI ​​model uses this information to generate recommended dishes. Specifically, it prompts the generative AI and collects recipe suggestions. 【0632】 Step 5: 【0633】 The generated recipes are displayed on the user's device, allowing them to select one. The input is the recipe draft created in step 4. The user selects a recipe from the presented options, and the selected recipe information is output to the user's device. The device displays the recipe details. 【0634】 Step 6: 【0635】 Based on the recipe selected by the user, the server issues cooking instructions to the home robot. The input is the selected recipe sent from the user's terminal. The server communicates the necessary cooking steps to the robot, and the robot begins cooking according to the instructions. Specifically, the robot performs tasks such as preparing ingredients and simple cooking steps. 【0636】 The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data. 【0637】 Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. 【0638】 In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314. 【0639】 [Fourth Embodiment] 【0640】 Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment. 【0641】 As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server. 【0642】 The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network). 【0643】 The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52. 【0644】 The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46. 【0645】 Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision). 【0646】 Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner. 【0647】 The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes. 【0648】 Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56. 【0649】 The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30. 【0650】 The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. 【0651】 In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48. 【0652】 Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0653】 This invention provides a system that efficiently manages food consumption and offers recipes tailored to dietary needs within the home. This system primarily consists of sensor devices, a computer system, and a user interface. 【0654】 The sensor device is installed in the home and automatically acquires identification information and expiration dates for stored food items. This information is transmitted to a server and recorded in a food database. The server uses this information to manage inventory and identify food items nearing their expiration date. 【0655】 Users can use devices such as smartphones and PCs to input information about their preferences, allergies, and specific dietary needs. This information is sent to the server and stored as a user profile. 【0656】 The server integrates acquired inventory information and user profiles, and uses a generation AI to automatically generate recipes. These recipes are designed to accommodate user preferences and health needs, and also prioritize the use of ingredients nearing their expiration date. The terminal displays these recipes to the user, making them available for selection. 【0657】 When a user selects a recipe from the presented options, the server generates detailed cooking instructions and displays them on the device. Furthermore, it automatically adds any missing ingredients needed for the selected recipe to a shopping list and provides it to the user. This process utilizes natural language processing technology, and the server provides cooking advice in text format through the user interface. 【0658】 As a concrete example, consider a scenario where a user has chicken, tomatoes, and spinach in their refrigerator and wants to follow a low-carbohydrate diet. The server generates a recipe for "Chicken and Spinach Tomato Stew" using these ingredients and presents it to the user's device. This recipe addresses the user's diet needs while also considering the ingredients' approaching expiration dates. 【0659】 In this way, users can easily prepare healthy meals while simultaneously minimizing food waste. This invention provides an environment that allows this entire process to be carried out seamlessly. 【0660】 The following describes the processing flow. 【0661】 Step 1: 【0662】 The server uses sensor devices installed in the storage unit to automatically scan food items for identification information and expiration dates. This information is sent to the server and recorded in the food information database. 【0663】 Step 2: 【0664】 Users use their devices to input their food preferences, allergy information, and diet type, and send this data to the server via the device. The server stores this information in the user profile. 【0665】 Step 3: 【0666】 The server periodically queries the database to check inventory levels and ingredients nearing their expiration dates. This helps identify ingredients with high priority for use. 【0667】 Step 4: 【0668】 The server uses a generative AI to generate several optimal recipes based on saved user profiles and the latest inventory information. This also takes into account prioritizing the use of ingredients nearing their expiration date. 【0669】 Step 5: 【0670】 The terminal presents the generated recipes to the user, displaying them in a selectable format. This allows the user to choose the menu item they want to cook from the specified recipes. 【0671】 Step 6: 【0672】 When a user selects a recipe, the server generates detailed advice on cooking steps and necessary tools based on that recipe. The terminal then provides this information to the user. 【0673】 Step 7: 【0674】 The server identifies ingredients needed for the selected recipe that are not in stock and lists them. The terminal displays this shopping list to the user and prompts them to confirm the necessary items. 【0675】 This series of steps allows users to efficiently manage their food supply and prepare meals that meet their health needs. 【0676】 (Example 1) 【0677】 Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0678】 Traditional home food management and meal preparation methods have challenges, such as ineffectively providing recipe suggestions tailored to inventory levels and individual health needs. In particular, there is a need for methods that can efficiently prepare healthy meals while reducing food waste. Conventional technologies fail to utilize ingredients nearing their expiration date and lack the means to accommodate users' specific preferences and health requirements. 【0679】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means. 【0680】 In this invention, the server includes means for automatically acquiring food identification information and expiration dates using sensor devices installed in household storage devices, means for managing the inventory and expiration dates of the food on a computer system based on the acquired food information, and means for inputting and updating information on the user's preferences and health requirements and storing this information on the computer system. This makes it possible to prioritize the use of ingredients nearing their expiration date and to suggest optimal cooking procedures that meet the user's health needs. 【0681】 A "sensor device" is a device installed in a household storage system that automatically acquires food identification information and expiration dates. 【0682】 A "computer system" is a device that integrates acquired food information and user information to enable inventory management and the generation of optimal cooking procedures. 【0683】 "User health requirements" refers to health-related conditions, including the user's individual preferences, allergies, and special nutritional needs. 【0684】 A "generative AI model" is a type of artificial intelligence that automatically generates the optimal cooking procedure based on user information and inventory information, by taking prompt messages. 【0685】 A "prompt message" is the text input to a generative AI model, and it contains data that includes the conditions and purpose of the data being used. 【0686】 "Natural language processing technology" is a technology in which a computer system analyzes input from a user, understands instructions in human language, and provides the results in text format. 【0687】 "Cooking instructions" refer to the cooking methods and processes generated based on acquired food information and user information, and are specific cooking instructions presented to the user. 【0688】 This invention is a system for providing food management and cooking procedures tailored to individual health needs. It mainly consists of a sensor device, a computer system, and a user terminal. 【0689】 The server uses sensor devices to acquire identification information and expiration dates for food items in the home. These sensor devices include hardware such as RFID tags and barcode scanners. This enables the collection of highly accurate food information. 【0690】 The acquired food information is transmitted to a computer system and recorded in a food database. The server uses this information to manage inventory and identify foods nearing their expiration date. 【0691】 Users input their preferences, allergies, and dietary needs using their smartphones or PCs. This information is transmitted to the server via the user's device and stored in the computer system as an individual user profile. This enables the provision of personalized services. 【0692】 The generation AI model uses stored food inventory data and user profiles to automatically generate cooking instructions best suited to the user's needs. Prompt messages include specific instructions such as, "Inventory information: chicken, tomatoes, spinach. User wants a low-carb diet. Generate a diet-friendly recipe." 【0693】 The terminal displays the generated cooking instructions to the user, allowing them to make a selection. Based on the recipe selected by the user, the server generates detailed cooking instructions and sends them to the terminal. Furthermore, any missing ingredients are automatically added to the shopping list and provided to the user. Natural language processing technology is utilized to display cooking advice in text format. In this way, users can efficiently prepare healthy meals and minimize food waste. 【0694】 The flow of the specific processing in Example 1 will be explained using Figure 11. 【0695】 Step 1: 【0696】 The server uses sensor devices to acquire identification information and expiration dates for food items in the home. This input data includes RFID tags and barcodes on the food items. The server analyzes this data to extract the food name and expiration date, and records it in an inventory database. This process allows the homeowner to know in real time what kinds of food items are in their home, how much of each they are, and how soon they will expire. 【0697】 Step 2: 【0698】 Users input their preferences, allergies, and health requirements via their smartphones or PCs. This information is sent from the device to the server. The server generates and stores a user profile based on this data. This profile information is used to generate recipes tailored to each user's individual needs. 【0699】 Step 3: 【0700】 The server retrieves food information from the inventory database and matches it with the user profile. The server then inputs a prompt message into the generating AI model. This prompt message includes specific conditions such as, "Inventory information: chicken, tomatoes, spinach. User desires a low-carbohydrate diet." Based on this, the generating AI model automatically generates the optimal cooking procedure. 【0701】 Step 4: 【0702】 The terminal displays cooking instructions received from the server to the user, allowing them to make selections. The final recipe is determined by the user selecting from the displayed options. The user's selection is confirmed by the terminal and sent to the server. 【0703】 Step 5: 【0704】 The server generates detailed cooking instructions and information on missing ingredients based on the recipe selected by the user. This process matches the selected recipe with inventory data to identify any missing ingredients. The generated cooking instructions and shopping list are sent to the terminal and provided to the user. 【0705】 Step 6: 【0706】 The terminal displays cooking advice to the user in real time. The server uses natural language processing technology to create specific advice that the user needs during cooking in text format and sends it to the terminal. This allows the user to perform cooking tasks more smoothly. 【0707】 (Application Example 1) 【0708】 Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0709】 Traditional home food management systems have presented challenges, such as the difficulty for users to efficiently obtain recipes based on their preferences and health needs. Furthermore, inadequate management of food expiration dates often led to food waste. Additionally, systems capable of providing voice-based cooking advice were limited, frequently causing inconvenience to users during cooking. There is a need to address these challenges and provide users with a more efficient and healthy way to manage and utilize food. 【0710】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. 【0711】 In this invention, the server includes means for automatically acquiring food identification information and expiration dates using a measuring device installed in a home information processing device, means for managing the inventory and expiration dates on an information processing system based on the acquired food information, and means for inputting and updating information on the user's preferences and health needs and storing this information on the information processing system. As a result, the user can receive recipes perfectly suited to their health condition and preferences via voice, while also being able to use ingredients while considering the expiration dates of the food, thereby reducing food waste and enabling efficient cooking. 【0712】 A "household information processing device" is an electronic device used to process information within the home. 【0713】 A "measuring device" is a device used to obtain identification information and expiration dates for food products. 【0714】 An "information processing system" is a system for processing and managing acquired information. 【0715】 An "information processing program" is a program that runs on an information processing system and generates the optimal cooking procedure. 【0716】 A "user terminal" is a terminal device that a user directly operates to check information. 【0717】 A "household robot" is an automated device that plays a role in assisting people within the home. 【0718】 "Sound" is a means of transmitting information through hearing. 【0719】 "Natural language processing technology" is a technology that enables computers to analyze and process natural language used by humans. 【0720】 To implement this invention, an information processing device installed in the home is used. The in-home measuring device acquires food identification information and expiration date, and transmits this information to a server. The server uses an information processing system to organize and manage the acquired data. The user can input their preferences and health needs using a voice interface via a home robot. In this process, a speech recognition library is used to convert the user's speech into digital data. 【0721】 On the server side, an information processing program is executed to generate an optimal cooking recipe that prioritizes the use of food items nearing their expiration date. A generation AI model is utilized in this process, making adjustments based on the user's individual health needs. The generated recipe is then provided to the user via voice or text through their terminal or a home robot. 【0722】 The home robot has a voice output function that reads out generated recipes and cooking instructions, presenting them to the user. This allows the user to receive cooking instructions in real time, and a shopping list of missing ingredients is automatically generated as needed. 【0723】 As a concrete example, a recipe for "Chicken and Tomato Stew" is generated using tomatoes nearing their expiration date from among the chicken, eggs, and tomatoes in the refrigerator, and a household robot guides the user through this recipe by voice. If the user asks the robot to "suggest a low-calorie dinner recipe," an example of a prompt message would be, "Please generate a low-calorie recipe as requested by the user. The ingredients are chicken breast and broccoli. Please prioritize ingredients that are nearing their expiration date." 【0724】 The flow of a specific process in Application Example 1 will be explained using Figure 12. 【0725】 Step 1: 【0726】 When a user places food in their home information processing device, the measuring device automatically acquires the food's identification information and expiration date. The data obtained from the measuring device is identified using RFID tags or barcode readers and converted into a digital format. This digital data is transmitted to a server and stored in a food database. 【0727】 Step 2: 【0728】 The server analyzes a stored food database to manage food inventory status and expiration dates. Specifically, it uses database queries to identify food items nearing their expiration date. This allows for arrangements to be made to ensure that food is consumed in a timely manner. 【0729】 Step 3: 【0730】 Users communicate their preferences and health needs to a home robot via voice. Voice recognition technology converts the voice into text data, which is then sent to a server. This text data is stored within the information system as a user profile. 【0731】 Step 4: 【0732】 The server uses a generative AI model to automatically generate optimal cooking recipes based on stored food information and user profiles. Prompts are used to instruct this AI model, generating recipes tailored to the user's health needs. This process takes into account the food's expiration date and nutritional value. 【0733】 Step 5: 【0734】 The generated cooking recipe is displayed on the user's device in either audio or text format. A home robot guides the user through the recipe by voice, allowing them to quickly understand the cooking process and take action. 【0735】 Step 6: 【0736】 Based on the recipe selected by the user, the server generates cooking instructions and compiles a shopping list of necessary ingredients. This list can be viewed on the user's terminal and is helpful in selecting ingredients while considering their expiration dates. 【0737】 Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions. 【0738】 This invention provides a system for managing food within the home that considers the user's emotional state and suggests recipes appropriate to that emotional state. This system combines a sensor device, a computer system, a user interface, and an emotion engine. 【0739】 Sensor devices are installed in home storage units and automatically detect food identification information and expiration dates. This information is transmitted to a server and stored as logs in a food information database. The server uses this data to manage inventory and expiration dates. 【0740】 Users input their food preferences, allergy information, and diet needs via devices such as smartphones and PCs. They can also express their emotions using voice or text input. This information is transferred to a server and stored as a user profile. 【0741】 The emotion engine analyzes the user's input data to recognize their current emotional state. This emotional information is taken into consideration when the server suggests recipes. For example, if the user is stressed, the emotion engine will prioritize suggesting recipes that include ingredients with relaxing effects. Such recipes are automatically created by the generative AI. 【0742】 The server selects and displays an appropriate recipe on the terminal based on the user profile and emotional information. The user can then choose from the presented recipes and proceed with cooking. Once the user selects a recipe, the server provides the terminal with cooking instructions and necessary cooking utensils based on that recipe. 【0743】 For example, if the emotion engine determines that a user is feeling anxious, the server generates a recipe for "herb chicken with chamomile to alleviate anxiety" and presents it to the device. This approach allows users to have a meal experience that is sensitive to their emotions. 【0744】 This system utilizes natural language processing technology and emotion recognition capabilities to provide menu suggestions and cooking assistance tailored to the user's emotional state. This allows users to maintain a healthy and emotionally balanced diet. 【0745】 The following describes the processing flow. 【0746】 Step 1: 【0747】 The server uses sensor devices installed in home storage systems to automatically scan food items for identification and expiration dates, recording this information in a database. This information is then used for food inventory management. 【0748】 Step 2: 【0749】 Users input their food preferences, allergy information, and specific dietary needs through a device, which then transmits this data to a server. Furthermore, users can input their emotions via voice or text and send them to the server. 【0750】 Step 3: 【0751】 The server analyzes the emotional information received from the user using an emotion engine to identify the user's current emotional state (e.g., stress, anxiety, joy). Based on this analysis, it selects a recipe. 【0752】 Step 4: 【0753】 The server uses generative AI to generate multiple optimal recipes based on database inventory information, user profiles, and the results of the emotion engine. In this process, it prioritizes the use of ingredients that are appropriate to the user's emotional state. 【0754】 Step 5: 【0755】 The device displays a list of generated recipes to the user and explains the benefits of each recipe (e.g., emotional improvement, health benefits). This allows the user to select a recipe that matches their preferences. 【0756】 Step 6: 【0757】 When a user selects a recipe, the server generates detailed cooking instructions based on that recipe and displays them on the terminal. It also sends a shopping list of any missing ingredients to the terminal for the user to review. 【0758】 Step 7: 【0759】 The server uses natural language processing technology to provide users with real-time cooking advice to support the cooking process. The terminal displays this information, supporting the user's cooking experience. 【0760】 Through this series of processes, users can easily and efficiently make food choices that align with their emotions and health needs. 【0761】 (Example 2) 【0762】 Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0763】 In modern households, proper food management and providing meals tailored to individual health needs and mental states are crucial amidst busy daily lives. However, performing these tasks manually is extremely time-consuming and prone to errors. In particular, checking expiration dates and selecting recipes that suit individual moods are difficult to adapt to each person's circumstances. A system is needed to solve these problems. 【0764】 The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. 【0765】 In this invention, the server has means for automatically acquiring food identification information and expiration date using a sensor device installed in a home storage device, 【0766】 A means for managing the inventory and expiration date of food products on an information processing device based on acquired food information, 【0767】 A means equipped with an emotion recognition function that analyzes the user's emotions and selects a cooking method appropriate to that state, 【0768】 This includes automating inventory management and allowing users to receive optimal recipe suggestions tailored to their emotions and health needs. 【0769】 A "sensor device" is a device installed in a household storage system to automatically detect food identification information and expiration dates. 【0770】 "Food identification information" refers to specific information about food products, including information identified by barcodes or RFID tags. 【0771】 The "best before date" refers to the date by which food should ideally be consumed while maintaining its quality, and is information that guarantees the safety and quality of food to consumers. 【0772】 An "information processing device" is an electronic device used to manage and analyze data such as food identification information and expiration dates. 【0773】 "Emotion recognition functionality" is a technology that recognizes a user's current emotional state based on input data obtained from the user. 【0774】 A "generative AI model" is an artificial intelligence algorithm used to automatically generate new information or suggestions based on given inputs or prompts. 【0775】 A "prompt statement" is an input statement used to give specific instructions or requests to a generative AI model, and it plays a role in controlling the output that is generated. 【0776】 A "user terminal" is an electronic device used by a user to input information or receive suggested data. 【0777】 This invention is a system for managing food within the home and suggesting meals that are tailored to the user's emotional state. This system is comprised of a combination of sensor devices, an information processing device, a user interface, and an emotion recognition function. 【0778】 The sensor device is installed in the home storage unit and is responsible for automatically acquiring food identification information and expiration dates. The information acquired by the sensor device is transmitted to a server, where the information processing unit manages inventory and expiration dates. Based on this data, the information processing unit updates the status of the food in real time. 【0779】 Users can input their food preferences, allergy information, and diet needs using devices such as smartphones and personal computers. They can also provide emotional data through voice or text input. This input information is stored on a server and used as a user profile. 【0780】 The emotion recognition function analyzes the user's input data and recognizes their emotional state to understand the user's current psychological condition. Based on this, the server uses a generative AI model to generate recipes that are appropriate for the user's emotions. Prompt messages may take the form of, "The user is currently stressed, so please suggest a recipe that will help them relax." 【0781】 The recipes presented to the user are automatically generated by a generative AI model, taking into account emotional information provided by the emotion recognition function. Users can select recipes through their device, and information about cooking procedures and necessary cooking utensils will be provided. Specifically, if a user is feeling anxious, a recipe like "Herb Chicken with Chamomile to Relieve Anxiety" will be suggested. 【0782】 In summary, this system supports users in leading a healthy and emotionally satisfying diet. 【0783】 The flow of the specific processing in Example 2 will be explained using Figure 13. 【0784】 Step 1: 【0785】 The sensor device detects food identification information and expiration dates in household storage devices. 【0786】 The input is food stored in a storage device, and the output is identification information and expiration date. This information is sent to a server and recorded as a log in a database. This provides basic data on food inventory and expiration dates. 【0787】 Step 2: 【0788】 Users enter personal information such as their food preferences, allergy information, and diet needs using their smartphones or personal computers. 【0789】 As input, users provide their preferences and health information, and as output, this information is stored on the server. As a result of this information being accumulated in a database as a user profile, it becomes possible to manage individual dietary needs. 【0790】 Step 3: 【0791】 The emotion recognition function analyzes emotional input provided from the user's device and recognizes the user's current emotional state. 【0792】 The input is emotional information expressed by the user in voice or text, and the output is a labeled emotional state. This data is then processed to identify emotions and measure their intensity. 【0793】 Step 4: 【0794】 The server generates prompt statements for the generative AI model based on emotional information. 【0795】 The emotional state obtained in the previous step is used as input, and a prompt sentence is generated as output. This allows the AI ​​model to generate a prompt appropriate to the situation, such as "Please suggest a recipe to relieve stress." 【0796】 Step 5: 【0797】 The server uses prompt messages to retrieve the appropriate recipe from the generated AI model. 【0798】 The input consists of generated prompt text and user profile information, and the output is a recipe. The AI ​​model uses this information to list recipes that match the user's emotions. 【0799】 Step 6: 【0800】 The server sends the suggested recipe to the user via the terminal and displays it to the user. 【0801】 The system takes a generated recipe as input and displays a list of recipes on the terminal as output. The user can then make a meal selection based on this list. 【0802】 Step 7: 【0803】 The user uses their device to select their preferred recipe from the ones presented. 【0804】 The input is a list of displayed recipes, and the output is the recipe selected by the user, which is recorded on the server. The selection result is reflected in the cooking support in the next step. 【0805】 Step 8: 【0806】 The server provides the terminal with detailed cooking instructions and the necessary cooking utensils based on the selected recipe. 【0807】 The input is a recipe selected by the user, and the output is a detailed cooking process displayed on the terminal. This allows the user to prepare a meal by following the instructions. 【0808】 (Application Example 2) 【0809】 Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal". 【0810】 Currently, many households do not adequately manage their food, leading to spoilage and waste. Furthermore, appropriate meal suggestions are not provided based on users' emotional states, lacking consideration for individual lifestyles and health conditions. Therefore, there is a need for a system that efficiently manages food within the home and provides a comfortable eating experience through meal suggestions tailored to users' emotions and health status. 【0811】 The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. 【0812】 In this invention, the server includes means for automatically acquiring food identification information and expiration dates using sensor devices installed in household storage devices, means for managing the inventory and expiration dates on a computer system based on the acquired food information, means for analyzing the user's emotional state and automatically creating and providing recipes appropriate to those emotions using an AI model, and means for a household robot to provide cooking assistance based on the provided recipes. This reduces food waste, enables personalized meal suggestions and cooking assistance that are tailored to the user's emotional state, and allows for a more comfortable eating experience. 【0813】 "Household storage equipment" refers to storage spaces or refrigerators installed in a home for the purpose of preserving food. 【0814】 A "sensor device" is a device installed in a household storage system that automatically acquires food identification information and expiration dates. 【0815】 "Food identification information" refers to information used to identify the type and name of food, and may include barcodes or RFID tags. 【0816】 The "best before date" refers to the date by which food can be consumed at its optimal quality, and serves as a guideline for the safe consumption of food. 【0817】 A "computer system" is a combination of electronic devices and software used for processing, storing, and managing data. 【0818】 "Inventory information" refers to data about the types and quantities of food currently stored in the storage device. 【0819】 "User preferences" refer to information that indicates an individual's preferences for specific foods or dishes. 【0820】 "Health needs" refers to the dietary requirements based on the user's health status and dietary restrictions. 【0821】 A "computer program" is a collection of code that runs within a computer system to automate a specific task. 【0822】 A "generative AI model" is an artificial intelligence model trained to generate new information or content based on given data. 【0823】 A "household robot" is a robotic device designed for use in the home to automate or support various tasks. 【0824】 This invention utilizes several hardware and software components to enable efficient food management within the home. First, a server obtains food identification information and expiration dates from sensor devices installed in home storage units. This information is then used by a computer system for inventory management. Sensors such as barcode scanners and RFID tag readers can be used. 【0825】 Users input information about their preferences and health needs using smartphones or tablets and store it in a computer system. This data is analyzed using natural language processing technology and reflected in user profiles. The software used includes natural language processing libraries such as NLTK and spaCy. 【0826】 The server uses an emotion recognition engine to analyze the user's emotional state and recognize the current emotional state from the input data. IBM Watson Natural Language Understanding can be used for emotion recognition. Subsequently, a generative AI model is used to automatically create a recipe appropriate to the user's emotions and provide it to the terminal. Generative AI models such as OpenAI GPT are utilized in this process. 【0827】 As a concrete example, if a user voice-inputs "I'm tired from work today," the emotion engine classifies the emotion as "fatigue" and generates a "stamina curry" recipe to boost energy. Then, a household robot assists with cooking based on the recipe, allowing the user to immediately prepare the suggested dish. 【0828】 An example of a prompt message would be, "The user's current emotional state is fatigue. Please suggest a recommended recipe for a dish that will replenish their energy." This allows the user to choose a meal that suits their mood that day, helping them to lead a fulfilling life both physically and mentally. 【0829】 The flow of a specific process in Application Example 2 will be explained using Figure 14. 【0830】 Step 1: 【0831】 The server obtains food identification information and expiration dates from sensor devices installed in home storage systems. Inputs include barcodes and RFID tags read by the sensors. This information is stored in a database on the server and registered as inventory information. Specifically, the server analyzes the data obtained from the sensors to identify the type of food and its expiration date. 【0832】 Step 2: 【0833】 Users input information about their preferences and health needs via their smartphones. This input data includes food preferences, allergy information, and dietary needs. This information is analyzed using a natural language processing library and stored on the server as a user profile. Through this analysis, the database accumulates the user's dietary preferences. 【0834】 Step 3: 【0835】 The server acquires the user's emotional state through voice and text input and analyzes it using an emotion recognition engine. The input is emotional expression in voice or text format. The output is a classification of the user's emotional state. Specifically, emotion recognition software scans the text data and assigns emotion labels. 【0836】 Step 4: 【0837】 The server uses a generative AI model to automatically generate appropriate recipes based on the user's emotional state and preferences. The input consists of the user profile and emotional state. The AI ​​model uses this information to generate recommended dishes. Specifically, it prompts the generative AI and collects recipe suggestions. 【0838】 Step 5: 【0839】 The generated recipes are displayed on the user's device, allowing them to select one. The input is the recipe draft created in step 4. The user selects a recipe from the presented options, and the selected recipe information is output to the user's device. The device displays the recipe details. 【0840】 Step 6: 【0841】 Based on the recipe selected by the user, the server issues cooking instructions to the home robot. The input is the selected recipe sent from the user's terminal. The server communicates the necessary cooking steps to the robot, and the robot begins cooking according to the instructions. Specifically, the robot performs tasks such as preparing ingredients and simple cooking steps. 【0842】 The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data. 【0843】 Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. 【0844】 In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414. 【0845】 Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion. 【0846】 Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together. 【0847】 These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression. 【0848】 The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become. 【0849】 Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant. 【0850】 The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more." 【0851】 The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values. 【0852】 The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format. 【0853】 In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data. 【0854】 In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56. 【0855】 Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12. 【0856】 Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56. 【0857】 The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory. 【0858】 The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor. 【0859】 Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources. 【0860】 Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose. 【0861】 The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above. 【0862】 All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference. 【0863】 The following is further disclosed regarding the embodiments described above. 【0864】 (Claim 1) 【0865】 A means for automatically acquiring food identification information and expiration dates using a sensor device installed in a household storage device, 【0866】 A means of managing the inventory and expiration date of food products on a computer system based on acquired food information, 【0867】 A means for inputting and updating information about user preferences and health needs, and for storing this information in a computer system, 【0868】 A means by which a computer program automatically generates the optimal cooking recipe based on stored inventory information and user information, 【0869】 A means to display and allow the user to select their preferred recipe from the generated recipes on their device, 【0870】 A means for generating cooking instructions and a shopping list of missing ingredients based on a recipe selected by the user, and providing them to the user's terminal. 【0871】 A system that includes this. 【0872】 (Claim 2) 【0873】 The system according to claim 1, wherein the computer system identifies food items that are nearing their expiration date and generates recipes that prioritize the use of those items. 【0874】 (Claim 3) 【0875】 The system according to claim 1, wherein the computer system analyzes user input using natural language processing technology and provides cooking advice in text format. 【0876】 "Example 1" 【0877】 (Claim 1) 【0878】 A device that automatically acquires food identification information and expiration dates using a sensor device installed in a household storage unit, 【0879】 A device that manages the inventory and expiration dates of food products on a computer system based on acquired food information, 【0880】 A device for inputting and updating information on the user's preferences and health requirements, and storing this information in a computer system, 【0881】 A device that automatically generates the optimal cooking procedure using a generated AI model based on stored inventory information and user information, 【0882】 A device that displays and allows the user to select the preferred cooking procedure from the generated procedures on their terminal, 【0883】 A device that generates cooking instructions and a shopping list of missing ingredients based on the cooking procedure selected by the user, and provides them to the user's terminal. 【0884】 A device that uses natural language processing technology to provide users with cooking advice in text format, 【0885】 A system that includes this. 【0886】 (Claim 2) 【0887】 The system according to claim 1, wherein the computing system identifies food items that are nearing their expiration date and generates cooking procedures that prioritize the use of those items. 【0888】 (Claim 3) 【0889】 The system according to claim 1, wherein the computer system generates cooking procedures based on prompt statements using a generation AI model and derives a dish suitable for the user's health requirements. 【0890】 "Application Example 1" 【0891】 (Claim 1) 【0892】 A means for automatically acquiring food identification information and expiration date using a measuring device installed in a household information processing device, 【0893】 A means of managing the inventory and expiration date of food products on an information processing system based on acquired food information, 【0894】 A means for inputting and updating information on user preferences and health needs, and storing this information in an information processing system, 【0895】 A means by which an information processing program automatically generates the optimal cooking procedure based on stored inventory information and user information, 【0896】 A means to display and allow the user to select the preferred procedure from the generated cooking procedures on their terminal, 【0897】 A means for generating a cooking method and a shopping list of missing ingredients based on the cooking procedure selected by the user, and providing them to the user's terminal. 【0898】 A method for converting cooking instructions generated based on food information acquired using a household robot into voice commands and providing them to the user, 【0899】 A system that includes this. 【0900】 (Claim 2) 【0901】 The system according to claim 1, wherein the information processing system identifies food items that are nearing their expiration date and generates cooking procedures that prioritize the use of those items. 【0902】 (Claim 3) 【0903】 The system according to claim 1, wherein the information processing system analyzes user input using natural language processing technology and provides cooking advice in voice format. 【0904】 "Example 2 of combining an emotion engine" 【0905】 (Claim 1) 【0906】 A means for automatically acquiring food identification information and expiration dates using a sensor device installed in a household storage device, 【0907】 A means for managing the inventory and expiration date of food products on an information processing device based on acquired food information, 【0908】 A means for inputting and updating information on user preferences and health needs, and storing this information on an information processing device, 【0909】 A means by which an information processing program automatically generates the optimal cooking method based on stored inventory information and user information, 【0910】 A means to display the preferred means from among the generated means on the user terminal and allow selection, 【0911】 A means for generating process procedures and a shopping list of missing materials based on the method selected by the user, and providing them to the user's terminal, 【0912】 A means equipped with an emotion recognition function that analyzes the user's emotions and selects a cooking method appropriate to that state, 【0913】 A means of generating recipes using a generative AI model and prompt sentences based on the user's emotional state, 【0914】 A system that includes this. 【0915】 (Claim 2) 【0916】 The system according to claim 1, wherein the information processing device identifies food items that are nearing their expiration date and generates means for prioritizing their use. 【0917】 (Claim 3) 【0918】 The system according to claim 1, wherein the information processing device analyzes user input using natural language processing technology and provides cooking advice in text format. 【0919】 "Application example 2 when combining with an emotional engine" 【0920】 (Claim 1) 【0921】 A means for automatically acquiring food identification information and expiration dates using a sensor device installed in a household storage device, 【0922】 A means of managing the inventory and expiration date of food products on a computer system based on acquired food information, 【0923】 A means for inputting and updating information about user preferences and health needs, and for storing this information in a computer system, 【0924】 A means by which a computer program automatically generates the optimal cooking recipe based on stored inventory information and user information, 【0925】 A means to display and allow the user to select their preferred recipe from the generated recipes on their device, 【0926】 A means for generating cooking instructions and a shopping list of missing ingredients based on a recipe selected by the user, and providing them to the user's terminal. 【0927】 A means of analyzing the user's emotional state and automatically creating and providing a recipe appropriate to that emotion using an AI model, 【0928】 A means by which a household robot provides cooking assistance based on the provided recipe, 【0929】 A system that includes this. 【0930】 (Claim 2) 【0931】 The system according to claim 1, wherein the computer system identifies food items that are nearing their expiration date and generates recipes that prioritize the use of those items. 【0932】 (Claim 3) 【0933】 The system according to claim 1, wherein the computer system analyzes user input using natural language processing technology and provides cooking advice in text format. [Explanation of symbols] 【0934】 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

[Claim 1] A means for automatically acquiring food identification information and expiration dates using a sensor device installed in a household storage device, A means of managing the inventory and expiration date of food products on a computer system based on acquired food information, A means for inputting and updating information about user preferences and health needs, and for storing this information in a computer system, A means by which a computer program automatically generates the optimal cooking recipe based on stored inventory information and user information, A means to display and allow the user to select their preferred recipe from the generated recipes on their device, A means for generating cooking instructions and a shopping list of missing ingredients based on a recipe selected by the user, and providing them to the user's terminal. A system that includes this. [Claim 2] The system according to claim 1, wherein the computer system identifies food items that are nearing their expiration date and generates recipes that prioritize the use of those items. [Claim 3] The system according to claim 1, wherein the computer system analyzes user input using natural language processing technology and provides cooking advice in text format.

Images