Refrigerator and refrigerator system

Abstract

To provide a refrigerator capable of easily managing the names and expiration dates of foods stored in the refrigerator.SOLUTION: A refrigerator 1 comprises an information acquisition unit 11, an estimation unit 12, and a memory unit 10. The information acquisition unit 11 acquires information on food stored in the refrigerator. The estimation unit 12 estimates either a food name or a consumption-related expiration date using a pre-registered estimation model based on the information acquired by the information acquisition unit 11. The one estimated by the estimation unit 12 and the other of the food name and consumption-related expiration date are stored in the memory unit 10 in association with each other.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a refrigerator and a refrigerator system.

Background Art

[0002] Patent Document 1 describes a refrigerator. The refrigerator described in Patent Document 1 receives wireless tag information including a food name, an expiration date, etc. from a wireless tag attached to food and manages it as food information.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In order to manage food information in the refrigerator described in Patent Document 1, it is necessary to include in advance the information to be managed as food information in the wireless tag. There was a problem that the merchant had to write the food information according to the food at the time of shipment with a reader / writer, which was time-consuming.

[0005] The present disclosure has been made to solve the above-described problems. An object of the present disclosure is to provide a refrigerator and a refrigerator system capable of easily managing the food name and expiration date of stored food in the storage compartment.

Means for Solving the Problems

[0006] The refrigerator according to the present disclosure includes an information acquisition unit that acquires information regarding stored food in the storage compartment, an estimation unit that estimates either a food name or a consumption-related expiration date using a registered estimation model based on the information acquired by the information acquisition unit, and a storage unit that associates and stores the one estimated by the estimation unit with the other of the food name or the consumption-related expiration date.

[0007] The refrigerator system according to the present disclosure includes a refrigerator and an information management device communicable with the refrigerator. The information management device includes an information acquisition unit that acquires information on food stored in the refrigerator, an estimation unit that estimates one of a food name or a consumption-related expiration date using a registered estimation model based on the information acquired by the information acquisition unit, and a storage unit that stores, in association with each other, the one estimated by the estimation unit and the other of the food name or the consumption-related expiration date.

Effect of the Invention

[0008] According to the present disclosure, it is possible to easily manage the food name and expiration date of food stored in the refrigerator.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Embodiments for Carrying Out the Invention

[0010] Hereinafter, a detailed description will be given with reference to the drawings. Duplicate descriptions will be simplified or omitted as appropriate. In each figure, the same reference numerals indicate the same or corresponding parts.

[0011] Embodiment 1. FIG. 1 is a diagram showing an example of the refrigerator 1 in Embodiment 1. The refrigerator 1 includes a heat-insulating box body (not shown) that serves as the main body. One or more spaces are formed in the heat-insulating box body. The space is a space for storing food. Hereinafter, this space is also referred to as the interior of the refrigerator (inside the refrigerator). The refrigerator 1 includes a door 2 for opening and closing the space. The opening and closing method of the door 2 may be any method.

[0012] The refrigerator 1 further includes a camera 3, a lighting device 4, a display 5, a speaker 6, an input device 7, and an information management device 8.

[0013] The camera 3 photographs the interior of the refrigerator. If food is stored in the refrigerator, the food is photographed by the camera 3. The image information of the interior of the refrigerator photographed by the camera 3 is transmitted to the information management device 8.

[0014] The lighting device 4 illuminates the interior of the refrigerator. It is preferable that the lighting device 4 has a function of illuminating not only the entire interior of the refrigerator but also an arbitrary partial area of the interior of the refrigerator. As an example, the lighting device 4 includes an LED as a light source. The display 5 displays characters and the like and provides information to the user. The speaker 6 outputs sound and provides information to the user.

[0015] In the example shown in this embodiment, the lighting device 4, the display 5, and the speaker 6 are used as notification devices for notifying the user of information. One or two of the lighting device 4, the display 5, and the speaker 6 may be provided in the refrigerator 1 as a notification device. Another device may be provided in the refrigerator 1 as a notification device. A device not provided in the refrigerator 1, such as a smartphone owned by the user, may be used as a notification device.

[0016] The input device 7 is a device for a user to operate and input information. The information input by the user from the input device 7 is transmitted to the information management device 8. The input device 7 may be provided with buttons. A touch panel type display having the functions of the input device 7 and the display 5 may be provided in the refrigerator 1. A device not provided in the refrigerator 1, such as a smartphone owned by the user, may be used as the input device.

[0017] The information management device 8 includes, for example, a storage unit 10, an information acquisition unit 11, an estimation unit 12, and a determination unit 13. Hereinafter, with reference to FIGS. 2 to 4, the basic functions of the information management device 8 will be described in detail. FIG. 2 is a flowchart showing an operation example of the information management device 8. First, with reference to FIG. 2, the information management function by the information management device 8 will be described.

[0018] In the information management device 8, a process for determining whether information on the stored foods in the refrigerator has been acquired is performed (S101). Hereinafter, this information is also referred to as stored food information. The stored foods include the foods stored in the refrigerator. The stored foods may include both the foods already stored in the refrigerator and the foods to be stored in the refrigerator in the future.

[0019] The information on the stored foods in the refrigerator is acquired by the information acquisition unit 11. That is, when the information acquisition unit 11 acquires the stored food information, it is determined as Yes in S101. In the specific example shown in FIG. 1, the stored food information is the image information inside the refrigerator taken by the camera 3. As an example, the information acquisition unit 11 acquires the image information inside the refrigerator taken by the camera 3 at regular intervals.

[0020] The information acquisition unit 11 may acquire information other than the image information inside the refrigerator as the stored food information. As an example, the refrigerator 1 may be provided with an optical sensor (not shown). The optical sensor receives the reflected light of the light emitted from the LED. The information on the light received by the optical sensor is transmitted to the information management device 8. In such a case, the information acquisition unit 11 acquires the light reception information from the optical sensor as the stored food information.

[0021] As another example, the refrigerator 1 may be provided with a reading device (not shown). The reading device reads, for example, characters and patterns described on a receipt. Information such as the characters read by the reading device is transmitted to the information management device 8. In such a case, the information acquisition unit 11 acquires the information such as the characters read by the reading device as stored food information.

[0022] As another example, the reading device may read a barcode attached to food. The barcode information read by the reading device is transmitted to the information management device 8. In such a case, the information acquisition unit 11 acquires the barcode information read by the reading device as stored food information.

[0023] Note that the receipts and barcodes read by the reading device are not prepared in advance for the refrigerator 1. For example, the reading device can read receipts issued at various stores. The reading device may read the receipts collectively as mere images.

[0024] As another example, the information acquisition unit 11 may acquire stored food information from an external device. For example, the stored food information may be information indicating a purchase history of an online supermarket. In such a case, the information acquisition unit 11 acquires the stored food information from the external device via a network such as the Internet.

[0025] When it is determined Yes in S101, in the information management device 8, a process of estimating the food name of the stored food is performed (S102). In S102, the estimation unit 12 estimates the food name of the stored food based on the stored food information acquired by the information acquisition unit 11. When performing the estimation process in S102, the estimation unit 12 uses an estimation model registered in advance in the information management device 8. The estimation model is stored in a model storage unit (not shown) in the information management device 8. In the specific example shown in FIG. 2, the estimation model is a model for estimating the food name of the stored food from the stored food information acquired by the information acquisition unit 11.

[0026] As an example, a food database is registered in advance in the information management device 8. The estimation unit 12 analyzes the image inside the warehouse captured by the camera 3, and identifies the color, shape, surface unevenness degree, etc. of the stored food. The estimation unit 12 may estimate the food name of the stored food by comparing the identified color, shape, surface unevenness degree, etc. of the stored food with the information registered in the food database.

[0027] As another example, the estimation model may be a trained model obtained by machine learning. As an algorithm for training the model, known algorithms such as supervised learning, unsupervised learning, or semi-supervised learning can be used. The estimation model may be a model obtained using AI technologies other than machine learning. The estimation model may be updated periodically or irregularly.

[0028] If the estimation model is a trained model, the estimation unit 12 infers the food name of the stored food obtained by using the trained model. In this case, the estimation unit 12 has a function as an inference unit. That is, in S102, the estimation unit 12 inputs the stored food information acquired by the information acquisition unit 11 into the trained model, and outputs the food name of the stored food inferred from this stored food information. Note that in the example shown in this embodiment, "estimation" includes the meaning of "inference".

[0029] When the food name of the stored food is estimated in S102, the information management device 8 performs a process of determining the consumption-related expiration date of the stored food (S103). The consumption-related expiration date is the expiration date related to the consumption of the food. The consumption-related expiration date is, for example, the expiration date of the food. The consumption-related expiration date may be the best-before date of the food. In the following description, for ease of understanding, the best-before date is adopted as the consumption-related expiration date. That is, in the following description, "best-before date" may be read as "consumption-related expiration date". In S103, the determination unit 13 determines the best-before date of the stored food based on the food name of the stored food estimated by the estimation unit 12.

[0030] The expiration date of the stored food may be uniquely determined when the food name of the stored food is known. In such a case, a correspondence table showing the combination of the food name and the expiration date may be registered in advance in the information management device 8. The determination unit 13 can derive the expiration date from the food name by referring to the correspondence table. The determination unit 13 may determine the expiration date of the stored food by other methods.

[0031] Next, in S104, the food name of the stored food estimated by the estimation unit 12 in S102 and the expiration date of the stored food determined by the determination unit 13 in S103 are stored in the storage unit 10 in association with each other.

[0032] In the example shown in FIG. 2, the management of the food name and the expiration date of the stored food in the warehouse can be easily performed. That is, in the case of the refrigerator 1, in order to manage the food name and the expiration date of the stored food in the warehouse, it is not necessary for the merchant shipping the food to input information into the wireless tag, or for the user of the refrigerator 1 to manually input the food name and the expiration date individually. In the case of this refrigerator 1, the labor required for managing the food name and the expiration date can be significantly reduced.

[0033] Note that, in the above, an example has been described in which the estimation unit 12 has a function of estimating the food name and the determination unit 13 has a function of determining the expiration date. This is just an example. As another example, the estimation unit 12 may have a function of estimating the expiration date and the determination unit 13 may have a function of determining the food name.

[0034] In such a case, in S102, the estimation unit 12 estimates the expiration date of the stored food using a registered estimation model based on the stored food information acquired by the information acquisition unit 11. In this example, the estimation model is a model for estimating the expiration date of the stored food from the stored food information acquired by the information acquisition unit 11. Also, in S103, the determination unit 13 determines the food name of the stored food based on the expiration date of the stored food estimated by the estimation unit 12. In S104, the expiration date of the stored food estimated by the estimation unit 12 in S102 and the food name of the stored food determined by the determination unit 13 in S103 are stored in the storage unit 10 in association with each other.

[0035] As another example, the estimation unit 12 may have a function of estimating both the food name and the expiration date related to consumption. In such a case, the information management device 8 may not include the determination unit 13.

[0036] In this example, in S102, based on the stored food information acquired by the information acquisition unit 11, the estimation unit 12 estimates both the food name and the expiration date of the stored food using a registered estimation model. The estimation model is a model for estimating the food name and the expiration date of the stored food from the stored food information acquired by the information acquisition unit 11.

[0037] In this example, if the estimation model is a learned model, the estimation unit 12 infers the food name and the expiration date of the stored food obtained by using the learned model. That is, the estimation unit 12 has a function as an inference unit, and in S102, by inputting the stored food information acquired by the information acquisition unit 11 into the learned model, the food name and the expiration date of the stored food inferred from this stored food information are output. Then, in S104, the food name and the expiration date of the stored food estimated by the estimation unit 12 in S102 are stored in the storage unit 10 in an associated manner.

[0038] Next, referring to FIG. 3, the information update function by the information management device 8 will be described. FIG. 3 is a flowchart showing another operation example of the information management device 8. When the operation flow shown in FIG. 3 is performed, the information management device 8 further includes an opening detection unit 14 and an update unit 15.

[0039] In the information management device 8, a process is performed to determine whether there is any opened stored food in the warehouse (S201). The opening detection unit 14 detects that an unopened stored food has been opened based on the image information of the inside of the warehouse acquired by the information acquisition unit 11. For example, when the food name "milk in a paper pack" of the stored food is estimated by the estimation unit 12, the opening detection unit 14 performs an analysis process on the image information of the inside of the warehouse for the stored product to determine whether the pouring spout has been opened. When the opening detection unit 14 detects through the analysis process that the pouring spout has been opened, it is determined as Yes in S201.

[0040] When it is detected in S201 that an unopened stored food has been opened, the information management device 8 performs a process of updating the expiration date of the stored food (S202). In the storage unit 10, the food name and the expiration date are stored in association with each other for a large number of stored foods. For the stored food for which the opening has been detected by the opening detection unit 14, the food name and the expiration date are also stored in the storage unit 10 in association with each other. In S202, the update unit 15 shortens the expiration date of the stored food for which the opening has been detected by the opening detection unit 14 among the stored foods whose expiration dates are stored in the storage unit 10.

[0041] For example, consider a case where through the process shown in S104, the unopened food name "milk in a paper pack" and the expiration date "December 30th" are stored in the storage unit 10 in association with each other. In this case, when the opening detection unit 14 detects that "milk in a paper pack" has been opened, the update unit 15 shortens the expiration date by 3 days and sets it to "December 27th". When the update result by the update unit 15 is reflected, the food name "milk in a paper pack" and the expiration date "December 27th" are stored in the storage unit 10 in association with each other.

[0042] Note that regarding how much to shorten the expiration date when the opening is detected by the opening detection unit 14, the user may be able to set it arbitrarily by operating the input device 7.

[0043] Next, referring to FIG. 4, the notification function of the information management device 8 will be described. FIG. 4 is a flowchart showing another operation example of the information management device 8. When the operation flow shown in FIG. 4 is performed, the information management device 8 further includes a determination unit 16 and a notification control unit 17.

[0044] In the information management device 8, a process of determining whether or not a notification condition is satisfied is performed (S301). The notification condition is a condition for performing notification regarding the expiration date of the stored food stored in the storage unit 10. The determination unit 16 determines whether or not the notification condition is satisfied based on the expiration date of the stored food stored in the storage unit 10.

[0045] The notification condition is set in advance. As an example, consider a case where the food name "milk in a paper pack" and the expiration date "December 27th" are stored in the storage unit 10 in association with each other. For example, the notification condition is satisfied when it is the expiration date. In this example, the notification condition is satisfied on December 27th. The notification condition may also be satisfied on the day before the expiration date. In this example, the notification condition is satisfied on December 26th. As another example, the notification condition may be satisfied on the day before the expiration date and also on the expiration date. In this example, the notification condition is satisfied on December 26th and is satisfied again on December 27th. When it is determined by the determination unit 16 that the notification condition is satisfied, it is determined as Yes in S301.

[0046] When it is determined as Yes in S301, in the information management device 8, notification regarding the expiration date is performed (S302). The notification control unit 17 controls the notification device. When it is determined as Yes in S301, the notification control unit 17 causes the notification device to perform notification regarding the expiration date of the stored food. For example, if the notification condition is satisfied because it is the day before the expiration date of the food name "milk in a paper pack", the notification control unit 17 causes the notification device to notify that the next day is the expiration date of the milk in the paper pack.

[0047] If the notification device is the display 5, the notification control unit 17 may display on the display 5, "The expiration date of the milk in the paper pack is tomorrow." If the notification device is the speaker 6, the notification control unit 17 may output a voice from the speaker 6 saying, "The expiration date of the milk in the paper pack is tomorrow." If an external device such as a smartphone is used as the notification device, the notification control unit 17 may transmit a signal for causing the external device to perform notification regarding the expiration date from the communication unit (not shown).

[0048] When the notification device is the lighting device 4, the information management device 8 may further include an opening / closing detection unit 18. The opening / closing detection unit 18 detects that the door 2 is open. After determining Yes in S301, when the door 2 opens, that is, when the opening / closing detection unit 18 detects that the door 2 is open, the notification control unit 17 controls the lighting device 4 to inform the position of the stored food whose expiration date has expired or is about to expire with light. For example, the notification control unit 17 may control the lighting device 4 so that only the stored food is illuminated. The notification control unit 17 may control the lighting device 4 so that the shelf on which the stored food is located blinks.

[0049] In the example shown in FIG. 4, it is possible to notify the user that the expiration date of the stored food has expired or is about to expire. Thereby, the waste of food due to expiration can be reduced.

[0050] Note that the notification conditions may be arbitrarily set by the user by operating the input device 7. To realize such a function, the information management device 8 may further include a setting unit 19. The setting unit 19 sets the notification conditions based on the information input from the input device 7. Thereby, the user can set the timing of notification by operating the input device 7. As another example, the user can set the number of notifications by operating the input device 7.

[0051] The above-described basic functions may be adopted in the refrigerator 1 in any combination. Below, an example of the refrigerator 1 in which the information management function and the notification function are adopted will be described. FIG. 5 is a flowchart showing another operation example of the information management device 8.

[0052] The information acquisition unit 11 acquires the stored food information at regular intervals. As an example, the information acquisition unit 11 acquires the image information inside the cabinet photographed by the camera 3 every W minutes. W is an arbitrary value. The value of W may be 5 or 60.

[0053] When new image information is acquired by the information acquisition unit 11, the estimation unit 12 first compares the latest image information acquired by the information acquisition unit 11 with the image information from the previous time (X minutes ago) (S401). Next, the estimation unit 12 determines whether or not there is a new stored food in the cabinet based on the comparison result (S402). The determination in S402 is made based on the difference between the latest image information and the previous image information. When the information acquisition unit 11 acquires the light reception information from the optical sensor, the estimation unit 12 may detect the freshness state of the stored food from the light reception information and determine that there is a new stored food in the cabinet.

[0054] When the estimation unit 12 determines that there is a new stored food in the cabinet (Yes in S402), it estimates the food name of the new stored food (S403). The determination unit 13 determines the expiration date of the new stored food based on the food name estimated by the estimation unit 12 (S404). Then, the food name estimated in S403 and the expiration date determined in S404 are stored in the storage unit 10 in association with each other (S405).

[0055] Note that the estimation unit 12 may further determine whether or not there is a stored food that has disappeared from the cabinet in S402. In such a case, for the stored food that has disappeared from the cabinet, the information on the food name and the expiration date is deleted from the storage unit 10.

[0056] If it is not determined by the estimation unit 12 that there is new stored food (No in S402), the process proceeds to the process of S406. S406 to S408 show an example of notification conditions. When the notification conditions are satisfied, the notification shown in S409 is performed. The process shown in S409 is the same as the notification process shown in S302.

[0057] The determination unit 16 determines whether there is any stored food with a shelf life stored in the storage unit 10 and the number of days until the shelf life is less than X days (S406). The value of X is set in advance. If there is stored food with the number of days until the shelf life less than X days, it is determined as Yes by the determination unit 16 in S406. If it is determined as No in S406, the notification conditions are not satisfied.

[0058] When the determination unit 16 determines as Yes in S406 for a specific stored food, next, it determines whether the notification regarding the shelf life of the stored food has been performed Y or more times (S407). The value of Y is set in advance. If the notification regarding the shelf life of the stored food has not been performed Y or more times, it is determined as No by the determination unit 16 in S407. If it is determined as No in S407, the notification conditions are satisfied. When the notification conditions are satisfied, the notification regarding the shelf life of the stored food is performed (S409).

[0059] If the notification regarding the shelf life of the stored food has already been performed Y or more times, it is determined as Yes by the determination unit 16 in S407. When the determination unit 16 determines as Yes in S407, next, it determines whether the number of days until the shelf life of the stored food is less than Z days (S408). Z < X, and the value of Z is set in advance. If the number of days until the shelf life is less than Z days, it is determined as Yes by the determination unit 16 in S408. If it is determined as Yes in S408, the notification conditions are satisfied. When the notification conditions are satisfied, the notification regarding the shelf life of the stored food is performed (S409). On the other hand, if it is determined as No in S408, the notification conditions are not satisfied.

[0060] In addition to the above-described functions, the information management device 8 of the refrigerator 1 may have a function of learning the usage cycle of food by the user. For example, when it is determined Yes in S402, in S405, the name of the new stored food and the expiration date are associated and stored in the storage unit 10. Also, for the stored food that has disappeared from inside the refrigerator, the information on the food name and the expiration date is deleted from the storage unit 10. Therefore, the information management device 8 can learn the usage cycle of the stored food based on the period during which the food name and the expiration date are stored in the storage unit 10. The information management device 8 may have a function of automatically ordering the food based on the usage cycle of the learned stored food by cooperating with an online supermarket.

[0061] As another function, the information management device 8 of the refrigerator 1 may have a function of proposing foods and menus in consideration of the user's health and the like. For example, the information management device 8 acquires information regarding the user's health, that is, health information, from an external device or the input device 7. The health information may include healthcare data indicating the user's weight, blood pressure, etc., information such as body temperature acquired from a vital sensor, and information such as an electronic medical record acquired from an external institution. Based on such health information or the input information from the input device 7, the information management device 8 may provide foods that are better to ingest from the nutrients necessary for the user, or may provide a menu that can effectively incorporate the nutrients.

[0062] In the present embodiment, an example in which the information management device 8 is provided in the refrigerator 1 has been described. As another example, the information management device 8 may be provided as a device separate from the refrigerator 1. For example, the refrigerator system includes the refrigerator 1 and an information management device 8 that can communicate with the refrigerator 1. The information management device 8 may be provided in a server that can communicate with the refrigerator 1. In this case, not all of the above-described functions of the information management device 8 need to be provided in the refrigerator 1, or a part of the above-described functions may be provided in the refrigerator 1.

[0063] FIG. 6 is a diagram showing an example of the hardware resources of the information management apparatus 8. The information management apparatus 8 includes a processing circuit 20 including a processor 21 and a memory 22 as hardware resources. The processing circuit 20 may include a plurality of processors 21. The processing circuit 20 may include a plurality of memories 22.

[0064] In the present embodiment, each part indicated by reference numerals 10 to 19 indicates a function of the information management apparatus 8. The functions of the storage unit 10 and the model storage unit are realized by the memory 22. The functions of each part indicated by reference numerals 11 to 19 can be realized by software, firmware, or a combination of software and firmware described as a program. The program is stored in the memory 22. The information management apparatus 8 realizes the functions of each part indicated by reference numerals 11 to 19 by executing the program stored in the memory 22 by the processor 21 (computer).

[0065] The processor 21 is also referred to as a CPU (Central Processing Unit), a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, or a DSP. As the memory 22, a semiconductor memory, a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, or a DVD may be adopted. The adoptable semiconductor memories include RAM, ROM, flash memory, EPROM, and EEPROM.

[0066] FIG. 7 is a diagram showing another example of the hardware resources of the information management apparatus 8. In the example shown in FIG. 7, the information management apparatus 8 includes a processing circuit 20 including a processor 21, a memory 22, and dedicated hardware 23. FIG. 7 shows an example in which a part of the functions of the information management apparatus 8 is realized by the dedicated hardware 23. All of the functions of the information management apparatus 8 may be realized by the dedicated hardware 23. As the dedicated hardware 23, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof can be adopted.

[0067] Examples of aspects that may be included in the present disclosure are specified below as appendices.

[0068] [Appendix 1] An information acquisition unit that acquires information regarding stored foods in the refrigerator; An estimation unit that estimates either a food name or a consumption-related expiration date using a registered estimation model based on the information acquired by the information acquisition unit; A storage unit that associates and stores the one estimated by the estimation unit with the other of the food name or the consumption-related expiration date; A refrigerator comprising the above. [Appendix 2] Further comprising a determination unit that determines the other based on the one estimated by the estimation unit, The refrigerator according to Appendix 1, wherein the one estimated by the estimation unit and the other determined by the determination unit are associated and stored in the storage unit. [Appendix 3] The estimation unit estimates both a food name and a consumption-related expiration date based on the information acquired by the information acquisition unit, The refrigerator according to Appendix 1, wherein the food name estimated by the estimation unit and the consumption-related expiration date are associated and stored in the storage unit. [Appendix 4] A camera; An opening detection unit; An update unit; Further comprising the above, The information acquisition unit acquires image information inside the refrigerator taken by the camera, The opening detection unit detects that an unopened stored food has been opened based on the image information acquired by the information acquisition unit, The update unit shortens the consumption-related expiration date of the stored food in which the consumption-related expiration date is stored in the storage unit and which has been detected by the opening detection unit as having been opened, among the refrigerators according to any one of Appendices 1 to 3. [Appendix 5] An alarm control unit that controls an alarm; A determination unit that determines whether a notification condition is satisfied based on the consumption-related deadline stored in the memory unit; further comprising; The notification control unit causes the notifier to perform a notification regarding the consumption-related deadline when the determination unit determines that the notification condition is satisfied. The refrigerator according to any one of Supplementary Notes 1 to 4. [Supplementary Note 6] An input device for a user to operate and input information; A setting unit that sets the notification condition based on the information input from the input device; The refrigerator according to Supplementary Note 5, further comprising. [Supplementary Note 7] The notifier includes a lighting device, After the determination unit determines that the notification condition is satisfied, when the door is opened, the notification control unit controls the lighting device to notify, by light, the position of the stored food whose consumption-related deadline has expired or is about to expire. The refrigerator according to Supplementary Note 5 or 6. [Supplementary Note 8] A refrigerator; An information management device capable of communicating with the refrigerator; comprising; The information management device: An information acquisition unit that acquires information regarding the stored food in the refrigerator; An estimation unit that estimates one of the food name or the consumption-related deadline using a registered estimation model based on the information acquired by the information acquisition unit; A storage unit that stores, in association with each other, the one estimated by the estimation unit and the other of the food name or the consumption-related deadline; A refrigerator system comprising.

[0069] The matters described in Supplementary Notes 2 to 7 may be added to Supplementary Note 8 in the same manner as adding to Supplementary Note 1.

Explanation of Signs

[0070] 1 Refrigerator, 2 Door, 3 Camera, 4 Lighting device, 5 Display, 6 Speaker, 7 Input device, 8 Information management device, 10 Memory unit, 11 Information acquisition unit, 12 Estimation unit, 13 Decision unit, 14 Opening detection unit, 15 Update unit, 16 Judgment unit, 17 Notification control unit, 18 Opening / closing detection unit, 19 Setting unit, 20 Processing circuit, 21 Processor, 22 Memory, 23 Dedicated hardware

Claims

1. An information acquisition unit that acquires information regarding stored foods in the refrigerator; An estimation unit that estimates either the food name or the consumption-related expiration date using a pre-registered estimation model based on the information acquired by the information acquisition unit; A storage unit that associates and stores the one estimated by the estimation unit with the other of the food name or the consumption-related expiration date; A refrigerator comprising the above.

2. The refrigerator further comprises a determination unit that determines the other based on the one estimated by the estimation unit, wherein the one estimated by the estimation unit and the other determined by the determination unit are associated and stored in the storage unit, as described in Claim 1.

3. The estimation unit estimates both the food name and the consumption-related expiration date based on the information acquired by the information acquisition unit, wherein the food name and the consumption-related expiration date estimated by the estimation unit are associated and stored in the storage unit, as described in Claim 1.

4. A camera; An opening detection unit; An update unit; The refrigerator further comprising the above, wherein the information acquisition unit acquires image information inside the refrigerator captured by the camera, the opening detection unit detects that an unopened stored food has been opened based on the image information acquired by the information acquisition unit, and the update unit shortens the consumption-related expiration date of the stored food in which the consumption-related expiration date is stored in the storage unit and which has been detected by the opening detection unit as having been opened, as described in any one of Claims 1 to 3.

5. A notification control unit that controls a notifier; A determination unit that determines whether a notification condition is satisfied based on the consumption-related expiration date stored in the storage unit; The refrigerator further comprising the above, wherein when the determination unit determines that the notification condition is satisfied, the notification control unit causes the notifier to perform a notification regarding the consumption-related expiration date, as described in any one of Claims 1 to 3.

6. An input device for a user to operate and input information; A setting unit that sets the notification condition based on the information input from the input device; The refrigerator according to Claim 5, further comprising the above.

7. The notifier includes a lighting device, and after the determination unit determines that the notification condition is satisfied, when the door opens, the notification control unit controls the lighting device to inform, by light, the position of the stored food whose consumption-related expiration date has expired or is about to expire, as described in Claim 5.

8. A refrigerator; An information management device capable of communicating with the refrigerator; Comprising the above. The information management device an information acquisition unit that acquires information about food stored in the refrigerator an estimation unit that estimates either the food name or the consumption-related expiration date using a pre-registered estimation model based on the information acquired by the information acquisition unit a storage unit that stores the association between the one estimated by the estimation unit and the other of the food name or the consumption-related expiration date a refrigerator system including the above components

Images