Tag, control method, and control system

Abstract

A tag (40A) comprises: a temperature indicating member (42); and an identification section (47) for displaying identifying information that allows for unique identification by the external appearance thereof. This control method involves: imaging, with a camera, foodstuffs that are stored inside a refrigerator or a first article of food which is a stored foodstuff; generating an image in which a tag (40A) attached to the first article of food is shown; acquiring the temperature of the first article of food by analyzing the color of the temperature indicating member (42) provided to the tag (40A) shown in the generated image; generating control information for controlling the cooling inside the refrigerator by comparing the temperature acquired and the proper temperature range of inside the refrigerator; and transmitting the generated control information to the refrigerator.

Description

Tag, control method, and control system

[0001] The present disclosure relates to a tag, a control method, and a control system.

[0002] There is a technology for managing items by matching the identification information of the items stored in the storage container with a photograph of the items inside the storage container (see, for example, Patent Document 1).

[0003] Japanese Patent Application Laid-Open No. 2019-191663

[0004] The present disclosure provides a tag, a control method, and a control system for properly managing food stored in a refrigerator.

[0005] The tag in the present disclosure is a tag that includes a temperature indicating material and an identification section that displays identification information that can be uniquely identified by appearance.

[0006] The tags of the present disclosure allow for proper management of food stored in a refrigerator.

[0007] 1 is a block diagram showing the functional configuration of a control system in an embodiment. FIG. 2 is a schematic diagram showing a first example of a tag in an embodiment. FIG. 3 is a schematic diagram showing a second example of a tag in an embodiment. FIG. 4 is a schematic diagram showing a third example of a tag in an embodiment. FIG. 5 is a schematic diagram showing changes in the third example of a tag in an embodiment. FIG. 6 is an explanatory diagram showing an example of changes in the temperature of food in an embodiment. FIG. 7 is an explanatory diagram showing a table showing edible periods of food in an embodiment. FIG. 8 is an explanatory diagram showing first master data showing edible periods of food in an embodiment. FIG. 9 is an explanatory diagram showing second master data showing edible periods of food in an embodiment. FIG. 10 is an explanatory diagram showing third master data showing edible periods of food in an embodiment. FIG. 11 is an explanatory diagram showing fourth master data showing edible periods of food in an embodiment. FIG. 12 is an explanatory diagram showing a first example of an image displayed by a control system in an embodiment. FIG. 13 is an explanatory diagram showing a second example of an image displayed by a control system in an embodiment. FIG. 14 is a flow diagram showing processing of a control system in an embodiment.

[0008] The present inventor(s) have found that the following problems arise with regard to the management of food stored in a refrigerator, as described in the "Background Art" section.

[0009] The temperature inside a refrigerator is controlled based on the temperature detected by a temperature sensor installed inside the refrigerator. Because the temperature sensor detects the temperature of the air inside the refrigerator, it takes some time for the temperature sensor to detect a temperature rise after a relatively hot food item is placed inside the refrigerator. Furthermore, after the temperature rise is detected, it takes even more time for the refrigerator's cooling function to return the temperature inside the refrigerator to the temperature before the temperature rise.

[0010] Furthermore, between the time when the temperature starts to rise due to the food being stored in the refrigerator and the time when the temperature returns to the temperature it was before the food was stored in the refrigerator, the temperatures of other foods may rise, and the other foods stored in the refrigerator may become spoiled (in other words, become inedible).

[0011] Thus, when the temperature inside the refrigerator is controlled based on the temperature sensor provided in the refrigerator, there is a problem in that the temperature of the food may rise as described above.

[0012] The present disclosure provides a tag, a control method, and a control system for properly managing food stored in a refrigerator.

[0013] A tag according to one aspect of the present disclosure is a tag including a temperature indicating material and an identification section that displays identification information that can be uniquely identified by appearance.

[0014] According to the above aspect, image analysis of a captured image showing the tag allows both the temperature and identification information indicated by the tag to be acquired simultaneously. For example, if the tag is attached to food stored in a refrigerator, the refrigerator's cooling control can be performed based on the temperature indicated by the tag. In this way, the tag allows for appropriate management of the food stored in the refrigerator.

[0015] The temperature indicating material may include a temperature indicating ink.

[0016] According to the above aspect, since the temperature indicator contains a temperature indicator ink, the temperature indicator can be easily produced by printing. Also, temperature indicators with various designs can be easily produced at low cost. Therefore, the tag can more easily and appropriately manage food stored in a refrigerator.

[0017] The tag may also be metal-free.

[0018] According to the above aspect, since the tag does not contain metal, it is possible to avoid reflection of electromagnetic waves or generation of sparks by metal when the microwave oven is operating, making it safer to use. Therefore, the tag can more safely and appropriately manage food stored in the refrigerator.

[0019] The tag may also have an attachment portion that is attached to the food product or to a food container or packaging, or may be part of the food container or packaging.

[0020] According to the above aspect, the tag is attached to the food by the attachment portion or is in contact with the food as part of the food container or packaging, so that the tag has approximately the same temperature as the food. Therefore, the temperature of the food can be obtained with higher accuracy by image analysis of an image showing the tag. Therefore, the tag can obtain the food temperature with higher accuracy, allowing for appropriate management of food stored in a refrigerator.

[0021] The tag may further include a display unit that displays a predetermined upper temperature limit for food stored in the refrigerator.

[0022] According to the above aspect, since the tag has a display unit, it can warn the user not to store food in the refrigerator that exceeds a predetermined upper temperature limit for food stored in the refrigerator. Therefore, the tag can appropriately manage the food stored in the refrigerator while preventing relatively high-temperature food from being stored in the refrigerator.

[0023] A control method according to one aspect of the present disclosure is a control method that takes an image of food stored in a refrigerator or a first food that is the stored food using a camera, generates an image showing a tag as described in claim 1 attached to the first food, obtains the temperature of the first food by analyzing the color of the temperature indicator provided in the tag shown in the generated image, compares the obtained temperature with an appropriate temperature range for the interior of the refrigerator, generates control information for controlling cooling of the interior of the refrigerator, and transmits the generated control information to the refrigerator.

[0024] According to the above aspect, the cooling control of the refrigerator can be performed based on the temperature of the food stored in the refrigerator. In this way, the above control method can appropriately manage the food stored in the refrigerator.

[0025] Furthermore, when generating the control information, if it is determined that the acquired temperature is higher than the appropriate temperature range, control information may be generated that controls the refrigerator to increase cooling.

[0026] According to the above aspect, when the temperature of a food item is higher than the appropriate temperature range, the refrigerator's cooling is strengthened, thereby hastening the temperature drop of the food item and suppressing an increase in the temperature of other foods stored in the refrigerator. Therefore, the above control method can appropriately manage the temperature of the food items stored in the refrigerator by suppressing an increase in the temperature of the food items.

[0027] In addition, the cooling of the refrigerator may be continuously controlled by repeatedly generating and transmitting the control information based on photographing the first food item stored inside the refrigerator.

[0028] According to the above aspect, the cooling of the refrigerator is continuously controlled, so that the temperature of the food stored in the refrigerator can be prevented from rising. Therefore, the above control method can appropriately manage the temperature of the food stored in the refrigerator by preventing the temperature from rising.

[0029] In addition, the position within the storage of the tag shown in the generated image may be analyzed, and when generating the control information, control information may be generated that controls to increase cooling at the position where a tag having a temperature higher than the appropriate temperature range is present.

[0030] According to the above aspect, the location of the food in the refrigerator that is above the appropriate temperature range is used to strengthen cooling of the location where the food is located, thereby further accelerating the decrease in temperature of the food and suppressing an increase in the temperature of other foods stored in the refrigerator. Therefore, the above control method can appropriately manage the temperature of the food stored in the refrigerator by suppressing an increase in temperature.

[0031] In addition, the identification information displayed by the identification unit of the tag shown in the image may be obtained, and food information indicating the expiration date or best before date of the first food to which the tag is attached may be generated in association with the identification information, and presentation control may be performed to present the food information.

[0032] According to the above aspect, the expiration date or best-before date (also called a use-by date) of each food item is presented to the user, which allows the user to recognize the expiration date of each food item, promotes effective use of food items, and reduces food waste. Therefore, the above control method can appropriately manage food items stored in the refrigerator while promoting effective use of food items and reducing food waste.

[0033] Furthermore, the identification information may be used to obtain transition information indicating the temperature change of the first food, and the obtained transition information may be used to adjust the expiration date or best-before date of the first food, and the presentation control may present the food information using the adjusted expiration date or best-before date.

[0034] According to the above aspect, the expiration date and other information are adjusted based on the temperature change of the food stored in the refrigerator. This allows the expiration date and other information to reflect the fact that food stored in the refrigerator will spoil faster if it is left outside the refrigerator and then stored back inside, contributing to safe food consumption by users. Therefore, the above control method allows for appropriate management of food stored in the refrigerator.

[0035] A control system according to one embodiment of the present disclosure is a control system including: an imaging unit that photographs food stored in a refrigerator or a first food that is stored in the refrigerator using a camera and generates an image showing the tag described in claim 1 attached to the first food; an analysis unit that acquires the temperature of the first food by analyzing the color of the temperature indicator provided in the tag that appears in the generated image; and a control unit that generates control information for controlling cooling inside the refrigerator by comparing the acquired temperature with an appropriate temperature range for the refrigerator interior, and transmits the generated control information to the refrigerator.

[0036] According to the above aspect, the control system achieves the same effects as the above control method.

[0037] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of well-known matters or redundant explanation of substantially the same configuration may be omitted. This is to avoid unnecessary redundancy in the following explanation and to facilitate understanding by those skilled in the art.

[0038] The inventor(s) provide the accompanying drawings and the following description to enable those skilled in the art to fully understand the present disclosure, and do not intend for them to limit the subject matter described in the claims.

[0039] (Embodiment) In this embodiment, a tag, a control method, and a control system for appropriately managing food stored in a refrigerator will be described.

[0040] FIG. 1 is a block diagram showing the configuration of a control system 1 according to this embodiment.

[0041] 1, the control system 1 includes a server 10, a refrigerator 20, and a terminal 30. The devices included in the control system 1 are connected to each other via a network N so as to be able to communicate with each other.

[0042] Refrigerator 20 refrigerates food stored therein. Here, an example will be described in which food items 26A and 26B (also referred to as food items 26A, etc.) are stored inside refrigerator 20. Food items 26A and 26B are respectively affixed with tags 40A and 40B (also referred to as tags 40A, etc.). Each of food items 26A, etc. corresponds to a first food item. Note that the number of food items 26A, etc. is not limited to two, and may be any number equal to or greater than one.

[0043] The term "food" generally refers to food in the form stored in refrigerator 20, and more specifically, it can refer to the food itself (i.e., food without a container or packaging), or the container in which the food is stored and the food, or the packaging sheet in which the food is packaged and the food.

[0044] The "inside" of refrigerator 20 means the interior of a room provided in refrigerator 20, and more specifically, may mean the interior of a refrigerator compartment provided in refrigerator 20 (appropriate temperature range is, for example, 2°C to 5°C), the interior of a freezer compartment provided in refrigerator 20 (appropriate temperature range is, for example, -18°C or below), or the interior of a vegetable compartment provided in refrigerator 20 (appropriate temperature range is, for example, 3°C to 8°C).

[0045] The refrigerator 20 may be a refrigerator having a refrigerator compartment and a freezer compartment, or may further have other compartments (such as a chilled compartment or a vegetable compartment). The refrigerator 20 may also be a refrigerator having only a refrigerator compartment, or a refrigerator having only a freezer compartment (which may also be called a freezer or a freezer). The compartments of the refrigerator 20 may have, for example, doors that can be opened and closed by the doors. The compartments of the refrigerator 20 may also have, for example, drawers that can be pulled out and pushed back by the drawers.

[0046] Here, the tag 40A will be described. The tag 40A is used to uniquely identify the food item 26A. The tag 40A is also used by the server 10 to acquire the temperature of the food item 26A, and contributes to the cooling control of the refrigerator 20.

[0047] The tag 40B is similar to the tag 40A except that it is used for the food 26B, and therefore a description thereof will be omitted.

[0048] 2 is a schematic diagram showing a first example of a tag 40A according to the present embodiment. The tag 40A will be described using the X-axis, Y-axis, and Z-axis shown in FIG.

[0049] 2 is a sheet member parallel to the XY plane. For example, the lengths in the X-axis and Y-axis directions are about 1 cm to 10 cm, and the length in the Z-axis direction (i.e., thickness) is several mm or less, but is not limited to these.

[0050] As shown in FIG. 2, the tag 40A includes a temperature indicator 41 and an identification unit 47.

[0051] The temperature indicating section 41 has a temperature indicating material 42 that changes color depending on the temperature. The temperature indicating material 42 is a reversible temperature indicating material that changes color and then returns to its original color when the temperature returns to its original state.

[0052] As an example, a plurality of temperature indicating materials 42 are arranged in a direction parallel to the X axis.

[0053] The plurality of temperature indicators 42 are configured to indicate temperatures in a temperature range, for example, from 0° C. to 50° C., which includes the appropriate temperature range for the interior of the refrigerator compartment. The plurality of temperature indicators 42 are associated with temperature ranges in increments of 5° C. in the direction in which the X coordinate increases.

[0054] Each of the plurality of temperature indicating materials 42 is configured to change color within a corresponding temperature range. In other words, each of the plurality of temperature indicating materials 42 is configured to change color to a first color below the temperature range associated with the corresponding temperature indicating material 42, a second color above the temperature range, and the first color, the second color, or an intermediate color between the first color and the second color within the temperature range. Here, the first color and the second color are different.

[0055] The temperature indicator 41 may also have a display 43 that displays the temperature ranges associated with each of the temperature indicators 42, located on the negative Y-axis side of the temperature indicator 42. Specifically, the display 43 displays temperature scales such as "0°C," "5°C," "10°C," ..., and "50°C." The unit (i.e., "°C") may be omitted, or some of the scales (e.g., "5°C," "15°C," etc.) may be omitted, as long as they do not mislead the user. The color of the text on the display 43 is not limited to black, and may be any color, such as blue or red. The display 43 is not a required component, and the temperature indicator 41 may not have the display 43.

[0056] 2, of the multiple temperature indicators 42, the temperature indicator 42 located furthest from the negative side of the X axis corresponds to a temperature range of 0° C. to 5° C., the temperature indicator 42 second from the negative side of the X axis corresponds to a temperature range of 5° C. to 10° C., and the temperature indicator 42 located furthest from the positive side of the X axis corresponds to a temperature range of 45° C. to 50° C. In addition, in FIG. 2, the “° C.” included in temperature scales other than “50° C.” is omitted, and temperature scales with a 5 to the last digit are also omitted.

[0057] In addition, in the tag 40A used inside the freezer compartment, the multiple temperature indicators 42 may be configured as a whole to indicate temperature within a temperature range that includes the appropriate temperature range of the freezer compartment (e.g., -20°C to 10°C, etc.).

[0058] In addition, display unit 43 is a display unit that displays a predetermined temperature (also called a predetermined temperature) as the upper limit temperature for food stored inside refrigerator 20, and specifically may have at least one of display unit 44 and display unit 45.

[0059] The display unit 44 displays the temperature scale indicating the predetermined temperature in a manner different from that of the other display units 43 among the plurality of display units 43. The display unit 44 displays "40°C" in FIG. 2 in a larger size and in bold than the characters on the other display units 43. The color of the characters on the display unit 44 is not limited to black, and may be any color, such as blue or red. The display unit 44 may be displayed in a color different from that of the characters on the other display units 43.

[0060] The display unit 45 is a figure that surrounds the temperature indicating materials 42 that are associated with a temperature range equal to or lower than the predetermined temperature among the plurality of temperature indicating materials 42. The shape of the display unit 45 is not limited to a rectangle and may be other figures. The inside of the display unit 45 may be filled with a color or a dot pattern, etc.

[0061] In this way, since display unit 43 has a display unit (at least one of display units 44 and 45) that displays the predetermined temperature, the user can be warned not to store food 26A that exceeds the predetermined temperature in the storage unit.

[0062] Specifically, the temperature indicating material 42 is made of a temperature indicating ink, a synthetic resin mixed with a temperature indicating material, or a cloth or paper made of fibers mixed with a temperature indicating material.

[0063] When the temperature indicator 42 contains a temperature indicator ink, the temperature indicator 41 is produced by printing, which has the effect of allowing temperature indicators 41 with various designs to be produced easily and at low cost.

[0064] Although Figure 2 illustrates a case in which the temperature indicator 41 includes multiple temperature indicators 42, the temperature indicator 41 may also include a single temperature indicator 42, and the single temperature indicator 42 may be configured to indicate temperature by changing into multiple colors within a temperature range of 0°C to 50°C, which includes the appropriate temperature range for the interior of the refrigerator compartment.

[0065] Identification unit 47 displays identification information that can be uniquely identified by appearance. The identification information can uniquely identify food stored in refrigerator 20. The identification information may be identification information generally assigned to products (e.g., a JAN code (Japanese Article Number) or a GTIN (Global Trade Item Number) code), or may be a code determined by the user so as to uniquely identify a food within the range of foods stored in refrigerator 20.

[0066] While the illustration shows an example in which the identification unit 47 is a barcode, the present invention is not limited to this and may be a two-dimensional code (e.g., a QR code (registered trademark)), a color code, letters, symbols, or figures. The identification unit 47 may be generated on the tag 40A by printing or the like during the manufacturing process of the tag 40A, or may be generated separately from the tag 40A and then attached to the tag 40A. In the latter case, for example, the identification unit 47 may be attached to the tag 40A by having an adhesive applied to the back side and then pasting it on the tag 40A.

[0067] Furthermore, when the external shape of tag 40A is configured to be uniquely identifiable by appearance, the external shape of tag 40A functions as identification section 47. That is, although an example in which tag 40A has a rectangular external shape is shown in Fig. 2, the external shape of tag 40A may be a circle, a polygon, a figure having a concave-convex pattern on part or all of the periphery, or any other figure, and the external shape of such tag 40A functions as identification section 47.

[0068] Tag 40A may be configured without including metal. In this case, food 26A can be heated in a microwave oven with tag 40A attached. If tag 40A were to include metal, the metal could reflect electromagnetic waves, causing sparks and causing the microwave oven to malfunction when food 26A with tag 40A attached is heated in a microwave oven.

[0069] The tag 40A may have an attachment portion that can be attached to the food product 26A. The attachment portion may be, for example, an adhesive attached to the surface of the tag 40A opposite to the surface on which the temperature indicator 41 and the identification portion 47 are attached. The attachment portion may also be a clip that fastens the tag 40A to the food product 26A. The tag 40A may also be part of the container or packaging of the food product 26A.

[0070] It is also possible to use a combination of a barcode, QR code, etc. and the outer shape of the tag 40A as the identification unit 47, in other words, a combination of a barcode, QR code, etc. and the outer shape of the tag 40A. Furthermore, when the tag 40A is attached to a container or is part of the container, the outer shape of the container can also be used as the identification unit 47. Furthermore, it is also possible to use a combination of a barcode, QR code, etc. and the outer shape of the container, or a combination of a barcode, QR code, etc. and the outer shape of the tag 40A and the outer shape of the container as the identification unit 47.

[0071] Another example of the tag 40A according to this embodiment will be described.

[0072] FIG. 3 is a schematic diagram showing a tag 40C which is a second example of the tag according to this embodiment.

[0073] The tag 40C shown in FIG. 3 does not have the display section 43 of the tag 40A.

[0074] The tag 40C shown in FIG. 3 is used by the server 10 to acquire the temperature of the food 26A, similar to the tag 40A, and contributes to the cooling control of the refrigerator 20.

[0075] 4 and 5 are schematic diagrams showing a tag 40D which is a third example of the tag according to this embodiment.

[0076] The tag 40D shown in Fig. 4 has a temperature indicator 41 that includes a single temperature indicator 42C. For example, when the temperature exceeds a predetermined temperature, the temperature indicator 42C changes color to a different color from when the temperature is below the predetermined temperature (see Fig. 5).

[0077] The tag 40D shown in FIG. 4 is used by the server 10 to acquire the temperature of the food 26A, similar to the tag 40A, and contributes to the cooling control of the refrigerator 20.

[0078] Returning to FIG. 1, the functional parts of the refrigerator 20 will be described.

[0079] The refrigerator 20 has a communication IF (interface) 21 , a processor 22 , a storage 23 , an imaging unit 24 , and a cooling unit 25 .

[0080] The communication IF 21 is a communication interface that can be connected to the network N. The communication IF 21 transmits and receives communication packets to and from other devices when the refrigerator 20 communicates with other devices through the network N. The communication IF 21 is, for example, a Wi-Fi (registered trademark) communication interface.

[0081] The processor 22 controls the operation of the refrigerator 20. The processor 22 controls the operation of the refrigerator 20 by executing a predetermined program using a memory (not shown).

[0082] The storage 23 is a storage device that stores information and is realized by, for example, a hard disk drive (HDD) or a solid state drive (SSD).

[0083] The imaging unit 24 is a camera that photographs food stored in the refrigerator 20 or food items such as food 26A, and generates an image showing the food items 26A. The imaging unit 24 operates under the control of the processor 22. The image generated by the imaging unit 24 shows the food items 26A, etc., as well as tags 40A attached to the food items 26A, etc. The imaging unit 24 transmits the generated image to the server 10 via the communication IF 21. The imaging unit 24 may repeatedly capture images and generate images. The interval between capture and image generation is, for example, from several seconds to several minutes, but is not limited to this. When the imaging unit 24 repeatedly captures images and generates images, it may transmit an image to the server 10 each time an image is generated, or may transmit multiple images to the server 10 collectively.

[0084] The imaging unit 24 is attached in a position and orientation that allows it to capture images of food stored in or removed from the refrigerator 20. For example, the imaging unit 24 is attached to a position above the front of the refrigerator compartment of the refrigerator 20 in an orientation facing downward. The imaging unit 24 is also attached to the door of the refrigerator compartment of the refrigerator 20 in an orientation facing the interior of the refrigerator 20. The imaging unit 24 may be installed inside or outside the refrigerator 20. If there are multiple imaging units 24, one may be attached to each compartment of the refrigerator 20.

[0085] The cooling unit 25 is a cooling device that cools the interior of the refrigerator 20. The cooling unit 25 operates under the control of the processor 22.

[0086] Cooling unit 25 has a heat pump that takes in air inside the refrigerator and cools it, a fan that circulates the cooled air, an air outlet that blows the air cooled by the heat pump into the refrigerator, and a control unit that controls the heat pump, the fan, etc. Cooling unit 25 acquires control information from server 10 using communication IF 21, and controls the operation of the heat pump and the fan in accordance with the control information acquired from server 10 under the control of processor 22, thereby controlling the cooling strength inside refrigerator 20. Cooling unit 25 may have multiple air outlets, and in that case, cooling unit 25 may control the blowing of cool air from each of the multiple air outlets in accordance with the control information.

[0087] The terminal 30 includes a communication IF 31 , a processor 32 , and a display screen 33 .

[0088] The communication IF 31 is a communication interface that can be connected to the network N. The communication IF 31 transmits and receives communication packets to and from other devices when the terminal 30 communicates with other devices through the network N. The communication IF 31 is, for example, a Wi-Fi communication interface or a mobile phone network communication interface.

[0089] The processor 32 controls the operation of the terminal 30. The processor 32 controls the operation of the terminal 30 by executing a predetermined program using a memory (not shown).

[0090] The display screen 33 is a display device that displays information. For example, the display screen 33 displays the food information acquired from the server 10 via the communication IF 31 as an image. Note that instead of the display screen 33, a speaker that outputs the food information as sound may be provided. Alternatively, instead of the display screen 33, a presentation unit having at least one of the display device and the speaker may be provided.

[0091] Network N may be comprised of any communication line or network, and may include, for example, the Internet, a mobile phone carrier network, an Internet provider's access network, or a public access network.

[0092] Server 10 controls the cooling of the interior of refrigerator 20 based on the temperature of food 26A and other items stored in refrigerator 20. Server 10 also controls terminal 30 to display food information, including the expiration date of the food, based on whether food 26A and other items are stored in the interior and on the temperature change of food 26A and other items. Note that the expiration date of the food may be used instead of the expiration date. The same applies hereinafter.

[0093] The server 10 includes a communication IF 11 , a processor 12 , and a storage 13 .

[0094] The communication IF 11 is a communication interface that can be connected to the network N. The communication IF 11 transmits and receives communication packets to and from other devices when a functional unit of the server 10 communicates with other devices through the network N. The communication IF 11 is, for example, an Ethernet (registered trademark) communication interface.

[0095] The processor 12 controls the operation of the server 10. The processor 12 controls the operation of the server 10 by executing a predetermined program using a memory (not shown), thereby realizing an acquisition unit 14, an analysis unit 15, a cooling control unit 16, and a food management unit 17.

[0096] The acquisition unit 14 acquires an image showing the interior of the refrigerator 20 via the communication IF 11.

[0097] The analysis unit 15 acquires the identification information displayed by the identification unit 47 included in the tag 40A shown in the image by analyzing the image acquired by the acquisition unit 14. More specifically, the analysis unit 15 performs image analysis processing on the image acquired by the acquisition unit 14 to identify the identification unit 47 included in the tag 40A shown in the image acquired by the acquisition unit 14, and also acquires the identification information displayed by the identification unit 47.

[0098] The analysis unit 15 also analyzes the image acquired by the acquisition unit 14 to acquire the temperature indicated by the tag 40A shown in the image. More specifically, the analysis unit 15 performs image analysis processing on the image acquired by the acquisition unit 14 to identify the temperature indicator 41 included in the tag 40A shown in the image acquired by the acquisition unit 14, and acquires the temperature indicated by the tag 40A based on the color indicated by the temperature indicator 41. The analysis unit 15 has correspondence information that associates the color indicated by the temperature indicator 41 with the temperature of the tag 40A, and acquires the temperature of the tag 40A based on the color indicated by the temperature indicator 41 by referring to the correspondence information. The temperature of the tag 40A acquired in this manner is also referred to as the "temperature indicated by the tag 40A." The analysis unit 15 acquires the temperature indicated by the tag 40A as the temperature of the food 26A. Note that the analysis unit 15 may acquire the temperature indicated by the tag 40A independently of the temperature of the food 26A.

[0099] The analysis unit 15 can not only obtain the temperature indicated by the tag 40A directly from the color indicated by the temperature indicator 41, but can also obtain the temperature indicated by the tag 40A using the area of ​​the portion of the temperature indicator 42 whose color has changed from the first color. The portion whose color has changed from the first color is determined using, for example, a luminance value, which has the effect of making the determination process easier.

[0100] Analysis unit 15 may also store the acquired temperature together with the time the temperature was acquired as transition information 18. Furthermore, if food 26A stored inside the refrigerator is temporarily taken out and then stored back inside, analysis unit 15 may estimate the temperature during the period food 26A was left outside the refrigerator (in other words, the period food 26A was outside the refrigerator) and add the estimated temperature to transition information 18. The transition of the temperature during the period food 26A was left outside the refrigerator may be estimated, for example, by assuming that the temperature is the same as the temperature inside the refrigerator when food 26A is taken out, and that the temperature gradually approaches room temperature from that point onwards and eventually reaches room temperature.

[0101] Here, the room temperature may be, for example, a temperature sensed by a sensor in an air conditioner installed in the space where the refrigerator 20 is installed, or a temperature sensed by a sensor installed in the space to measure the room temperature, or a temperature predetermined for each season or time of year, or a temperature predetermined for all year round regardless of the season or time of year.

[0102] The temperature transition from the temperature inside the refrigerator to room temperature can be calculated using well-known techniques from the temperature difference between the temperature of food 26A and room temperature, the heat capacity of food 26A, etc. The transition information 18 will be described in detail later.

[0103] The analysis unit 15 may also analyze the position within the fridge of the tag 40A that appears in the image acquired by the acquisition unit 14. If there are multiple imaging units 24, the position at which the imaging unit 24 that captured the image is attached may be used to analyze the position within the fridge of the tag 40A that appears in the image acquired by the acquisition unit 14. The position at which the imaging unit 24 that captured the image is attached can be acquired from information previously assigned to the image, or from structures that appear in the image (for example, the position and shape of the wall or shelf inside the fridge).

[0104] Note that, if a user putting or taking out food 26A is captured in the image acquired by acquisition unit 14, analysis unit 15 may analyze the user. For example, when multiple users are assumed to use refrigerator 20, user analysis involves identifying which of the multiple users captured in the image is the user who uses refrigerator 20. The multiple users who use refrigerator 20 are, for example, multiple people living in the residence where refrigerator 20 is installed.

[0105] Cooling control unit 16 generates control information for controlling the cooling of the interior of refrigerator 20 and transmits the generated control information to refrigerator 20. Specifically, cooling control unit 16 generates the control information by comparing the temperature indicated by tag 40A acquired by analysis unit 15 with the appropriate temperature range for the interior of refrigerator 20, and transmits the generated control information to refrigerator 20 via communication IF 11. The control information transmitted by cooling control unit 16 is received by refrigerator 20 and used to control the cooling performed by cooling unit 25 in accordance with control by processor 22 of refrigerator 20.

[0106] Specifically, the control information includes information for controlling the strength of cooling. For example, when analysis unit 15 determines that the temperature inside refrigerator 20 is higher than the appropriate temperature range inside refrigerator 20, cooling control unit 16 generates control information for controlling refrigerator 20 to be more powerful.

[0107] When the imaging unit 24 repeatedly photographs food 26A and the like stored inside the refrigerator 20 and transmits the generated images to the server 10, the cooling control unit 16 can continuously control the cooling of the refrigerator 20 by repeatedly obtaining the temperature inside the refrigerator 20 using the received images and generating and transmitting control information.

[0108] Furthermore, when the analysis unit 15 analyzes the position of the tag 40A, the cooling control unit 16 may generate control information for controlling to strengthen cooling at the position where the tag 40A having a temperature higher than the appropriate temperature range is located. More specifically, the control information is control information for controlling to strengthen the cool air blown out of the outlet among the multiple outlets that blows cool air toward the position where the tag 40A having a temperature higher than the appropriate temperature range is located (in other words, the outlet that is relatively close to the above position) on the assumption that the cooling unit 25 has multiple air outlets.

[0109] In addition, when the analysis unit 15 analyzes the dimensions of the tag 40A, the cooling control unit 16 may generate control information that further strengthens the cooling or that extends the period of time for which the cooling is strengthened, the larger the dimensions of the tag 40A.

[0110] The food management unit 17 manages the food products 26A, etc. stored in the refrigerator. This management includes, for example, managing the expiration dates of the food products 26A. Specifically, the food management unit 17 generates food information indicating the expiration dates of the food products 26A, etc., in association with the identification information of each of the food products 26A, etc. stored in the refrigerator. When generating the food information, the food management unit 17 obtains the expiration dates of the food products 26A, etc., by referring to correspondence information that associates multiple foods with predetermined edible periods for each food product. The food management unit 17 may adjust the expiration dates by referring to the transition information 18.

[0111] The food management unit 17 also performs presentation control to cause the generated food information to be presented on the terminal 30. Specifically, the presentation control includes transmitting the food information to the terminal 30 and controlling the terminal 30 to display the food information as, for example, an image.

[0112] The food management unit 17 may adjust the expiration date of the food product 26A, etc., using the transition information 18 generated by the analysis unit 15. In this case, the presentation control controls the presentation of the food product information using the adjusted expiration date.

[0113] The storage 13 is a storage device that stores information. The storage 13 is realized by, for example, a hard disk drive (HDD) or a solid state drive (SSD). The storage 13 stores transition information 18. The transition information 18 is, for example, stored by the analysis unit 15 and read by the food management unit 17.

[0114] The arrangement of the functional units included in the control system 1 shown in FIG. 1 is an example, and the arrangement of the functional units may be different.

[0115] For example, the cooling control unit 16 included in the server 10 may be included in the refrigerator 20. In this case, the analysis unit 15 included in the server 10 may also be included in the refrigerator 20. In this manner, the refrigerator 20 can generate control information from the image captured by the imaging unit 24 within the refrigerator 20 and control the cooling inside the refrigerator 20 without transmitting the image to the server 10. This configuration has the advantage of not being affected by the time lag of communication via the network N.

[0116] Alternatively, for example, the acquisition unit 14, analysis unit 15, cooling control unit 16, and food management unit 17 provided in the server 10 may be provided in the refrigerator 20, and the transition information 18 may be provided in the storage 23 of the refrigerator 20. With such a configuration, the system is not affected by the time lag and the server 10 is not required, which has the effect of simplifying the system configuration. As a result, there are effects of reducing costs and power consumption.

[0117] Fig. 6 is an explanatory diagram showing an example of the temperature transition of food 26A in this embodiment. The solid line in Fig. 6 is an example of the temperature transition of food 26A acquired by analysis unit 15 when food 26A is stored in refrigerator 20 before time T1 and after time T2. The dashed line in Fig. 6 shows the temperature transition of food 26A estimated from the temperature transition shown by the solid line, the heat capacity of food 26A, the cooling capacity of refrigerator 20, etc. Note that acquiring the temperature transition shown by the dashed line in Fig. 6 is not essential.

[0118] 6 shows that before time T1, the temperature of food 26A was continuously acquired and remained at temperature TA, where TA is the temperature inside the refrigerator.

[0119] It also shows that the temperature of food 26A could not be acquired between time T1 and time T2.

[0120] Furthermore, after time T2, the temperature of food 26A can be continuously acquired, and it is shown that the temperature is temperature TB at time T2, gradually decreases after time T2, reaches approximately temperature TA at time T3, and remains at temperature TA from time T3 onwards. Here, temperature TB is the temperature outside the refrigerator, i.e., room temperature.

[0121] The food management unit 17 adjusts the expiration date of the food 26A etc. based on the temperature change.

[0122] For example, if the temperature of food 26A remains approximately at temperature TA, the expiration date of food 26A can be determined to be the point at which the predetermined edible period in refrigeration has elapsed, starting from the point at which food 26A was first stored in the refrigerator.

[0123] On the other hand, if there is a period during which the temperature of food 26A is higher than temperature TA (also referred to as the room temperature period), the refrigerated expiration date of food 26A is adjusted to be shorter. In this adjustment, the longer the room temperature period, the shorter the expiration date is adjusted. The room temperature period may be a period P1 during which the temperature of food 26A is generally higher than temperature TA (e.g., higher than a temperature 10% higher than room temperature), or, if the temperature transition shown by the dashed line in Figure 6 has been acquired, it may be a period P2 during which the temperature of food 26A is generally equal to room temperature (e.g., within a range of ±10% of room temperature).

[0124] The management of food 26A and the like by food management unit 17 will be described with reference to FIGS.

[0125] Fig. 7 is an explanatory diagram showing a first table showing the edible period of food in this embodiment. The table shown in Fig. 7 is a main table used for managing food 26A, etc. The table shown in Fig. 7, together with the master data shown in Figs. 8 to 10, is used by the food management unit 17 for managing food 26A, etc.

[0126] The table shown in FIG. 7 shows, for each food item 26A etc., a management ID, identification information, identification type, food ID, dish ID, storage start date and time, and name in association with each other.

[0127] The management ID is identification information that can uniquely identify the food item, and is used by the food management unit 17 to manage the food item.

[0128] The identification information is displayed by the identification unit 47 of the tag 40A or the like attached to the food. The identification information makes it possible to uniquely identify the food stored in the refrigerator 20. The identification information is obtained by the analysis unit 15 when the food is stored in the refrigerator 20.

[0129] The identification type indicates the type of identification information. Specifically, the identification type may be "JAN" indicating that the identification information is a JAN code, or "USER" indicating that the identification information is a code determined by the user.

[0130] The food ID is identification information for the food when the food is obtained by the user in that state (for example, when purchased at a grocery store).

[0131] The dish ID is identification information of the food in the case where the food is a dish prepared by the user (a so-called prepared dish).

[0132] The storage start date and time is the date and time when the food item was first stored in the refrigerator 20.

[0133] The name is the name of the food. The name may be the name of the food obtained by image recognition from an image taken when the food is stored in refrigerator 20, or the name of the food input by the user when the food is stored in refrigerator 20.

[0134] The table shown in FIG. 7 may further include a user ID, an image capture unit ID, or a room ID.

[0135] The user ID is an identifier of the user who first put the food item in the refrigerator 20. The user ID is available when the user is analyzed by the analysis unit 15. The user ID may have a meaning as the owner of the food item.

[0136] The imaging unit ID is an identifier of the imaging unit 24 that captured the image of the food. When there are multiple imaging units 24, the imaging unit ID is set so that each of the multiple imaging units 24 can be uniquely identified. When the cooling unit 25 has multiple air outlets, the imaging unit ID is used by the cooling control unit 16 to control the blowing of cool air from each air outlet. More specifically, the imaging unit ID contributes to control to strengthen the cool air blown out from the air outlet that sends cool air toward the location where the food is located.

[0137] The room ID is an identifier of a room in the refrigerator 20 in which the food is stored. When there are multiple rooms, the room ID is set so that each of the multiple rooms can be uniquely identified. When the refrigerator 20 has multiple rooms, the room ID is used by the cooling control unit 16 to control the blowing of cool air. More specifically, the room ID contributes to control to strengthen the cool air blown out from the air outlet of the room in which the food is stored.

[0138] Fig. 8 is an explanatory diagram showing the first master data indicating the edible period of food products in this embodiment. The master data shown in Fig. 8 is master data indicating the edible period of food products for each JAN code, and is predetermined master data. The master data shown in Fig. 8 is applied to foods to which a JAN code has been assigned.

[0139] 8 shows, for each food item, its identification information, name, and edible period. The edible period is a predetermined period that indicates the standard edible period for the food item when stored and preserved in the refrigerator 20 (more specifically, in the refrigerator compartment, freezer compartment, and vegetable compartment).

[0140] 9 is an explanatory diagram showing second master data indicating the edible period of a food product in this embodiment. The master data shown in FIG. 9 is predetermined master data indicating the edible period of a food product for each food product ID. The master data shown in FIG. 9 is applied when the name of the food product is manually input by a user or when the name of the food product is determined by image recognition processing of an image.

[0141] 9 shows a food ID, a name, and an edible period for each food item, which are associated with each other. The edible periods include the edible periods when the food item is stored in the refrigerator compartment, the freezer compartment, and the vegetable compartment.

[0142] 10 is an explanatory diagram showing third master data indicating the edible period of food in this embodiment. The master data shown in FIG. 10 is master data indicating the edible period of food for each dish ID, and is predetermined master data. The master data shown in FIG. 10 is applied when the name of a food cooked by a user is manually input or when the name of the food is determined by image recognition processing of an image.

[0143] 10 shows the identification information, name, and edible period for each food item in association with each other. The edible period includes the edible periods when the food item is stored in the refrigerator compartment, the freezer compartment, and the vegetable compartment.

[0144] The food management unit 17 manages the food 26A and the like by referring to the tables and master data shown in FIGS.

[0145] For example, in Fig. 7, a food product with a management ID of 1000 has identification information "4900000000123" which is a JAN code, is named "egg," and has a storage start date and time of "June 3, 2022, 10:00." By using the master data shown in Fig. 8 as the master data containing the above-mentioned identification information which is a JAN code, it is shown that the edible period of "egg" when stored in a refrigerator is 14 days.

[0146] 7 shows that the food product with management ID 1002 has identification information "10002000" which is a code defined by the user, the name is "stir-fried vegetables", and the storage start date and time is "June 10, 2022, 18:45". By using the master data shown in FIG. 10 as master data including the identification information which is the code defined by the user, it is shown that the edible period of "stir-fried vegetables" is two days when stored in the refrigerator, and two weeks when stored in the freezer.

[0147] 8 to 10 may include a room temperature warning period and a room temperature warning period. The room temperature warning period is a warning period for when food 26A, etc. is left at room temperature, and is a period during which the user is advised to consume food that has been left outside the refrigerator beyond that period as soon as possible. The room temperature warning period is a warning period for when food 26A, etc. is left at room temperature, and is a period during which the user is notified of the risk of food poisoning for food that has been left outside the refrigerator beyond that period.

[0148] Fig. 11 is an explanatory diagram showing a fourth master data indicating the edible period of food in this embodiment. The master data shown in Fig. 11 is obtained by adding a room temperature leaving warning period and a room temperature leaving caution period to the master data shown in Fig. 9.

[0149] The master data shown in FIG. 11 indicates that the warning period for leaving "pork belly slices" when left at room temperature is 30 minutes, and the caution period for leaving "pork belly slices" when left at room temperature is 60 minutes.

[0150] The room temperature warning period and the room temperature caution period may be set appropriately depending on the season or the room temperature. The room temperature warning period and the room temperature caution period shown in Figure 11 are an example when the room temperature is 25°C in the summer.

[0151] 12 is an explanatory diagram showing an image 51, which is a first example of an image displayed by the control system 1 in this embodiment. The image 51 is an example of an image displayed by the terminal 30 under the control of the server 10.

[0152] Image 51 shows the names of food items 26A, etc. stored in refrigerator 20, and includes table 52 showing the expiration dates of the food items in association with each of food items 26A, etc. Note that instead of table 52, an image showing the above content in a format other than a table may be used.

[0153] The food item column in table 52 is generated from the name column of the table shown in FIG. 7, and the expiration date column is generated from the current time and a predetermined edible period.

[0154] Table 52 shows that food items 26A and the like stored in refrigerator 20 include eggs and stir-fried vegetables. It also shows that the expiration date of the eggs is "14 days left" (i.e., 14 days from the current time, and so on), and that the expiration date of the stir-fried vegetables is "2 days left." Here, it is assumed that the eggs are raw eggs purchased at a grocery store, and the stir-fried vegetables have been cooked by the user and then stored in refrigerator 20.

[0155] Figure 13 is an explanatory diagram showing image 54, which is a second example of an image displayed by control system 1 in this embodiment. Like image 51 (see Figure 12), image 54 is an example of an image displayed by terminal 30 under the control of server 10. More specifically, image 54 is an image displayed by terminal 30 after image 51 is displayed and a food item, stir-fried vegetables, is left outside the refrigerator for 30 minutes and then placed back inside the refrigerator.

[0156] The food item column and the expiration date column in table 55 have the same meaning as in table 52 .

[0157] In table 55, the food column for stir-fried vegetables has the character string "(outside the oven for 30 minutes)" added to it. This character string indicates that the stir-fried vegetables have been left outside the oven for 30 minutes.

[0158] A mark 56 may be displayed to alert the user to foods that are relatively close to their expiration date. An example of a food that is relatively close to its expiration date is a food that is within "one day" of its expiration date. By visually recognizing the mark 56, the user can recognize that the food marked with the mark 56 must be consumed as soon as possible, which has the effect of promoting effective use of food and preventing food waste.

[0159] The expiration date of the stir-fried vegetables may be adjusted to a shorter date. For example, the expiration date of the stir-fried vegetables may be adjusted to "one more day." This indicates that the expiration date is adjusted because the stir-fried vegetables have been left outside the refrigerator for 30 minutes, causing the temperature of the stir-fried vegetables to become higher than the temperature TA inside the refrigerator 20 (more specifically, to reach room temperature).

[0160] 12 or 13, the displayed food items may include only food items owned by the user of the terminal 30. In other words, food items other than those owned by the user of the terminal 30 may not be included. Also, the image may be configured so that the mark 56 is displayed only in the image displayed on the terminal 30 of the user who owns the food item. The users who own the food items may be managed using the table shown in FIG.

[0161] 12 or 13, the image displayed by the terminal 30 may be configured so that the food or the expiration date of the food can be modified based on a user operation. The image may be configured so that the terminal that can modify the food or the expiration date of the food is limited to the terminal 30 of the user who owns the food.

[0162] FIG. 14 is a flowchart showing the processing of the control system 1 in this embodiment.

[0163] In step S101, refrigerator 20 uses a camera to photograph food stored in refrigerator 20 or food 26A (corresponding to first food) that is a stored food, and generates an image showing tag 40A attached to food 26A.

[0164] In step S102, the server 10 acquires the temperature of the food 26A by analyzing the color of the temperature indicator 42 provided on the tag 40A shown in the image generated by the refrigerator 20.

[0165] In step S103, the server 10 compares the temperature acquired in step S102 with the appropriate temperature range for the interior of the refrigerator 20, and generates control information for controlling the cooling of the interior of the refrigerator 20.

[0166] In step S104, the server 10 transmits the control information generated in step S103 to the refrigerator 20. The refrigerator 20 receives the transmitted control information and controls the cooling of the refrigerator interior in accordance with the received control information.

[0167] By the series of processes shown in FIG. 14, the control system 1 can appropriately manage the food stored in the refrigerator.

[0168] As described above, the tag of the above embodiment allows both the temperature and identification information indicated by the tag to be acquired simultaneously by performing image analysis on an image of the tag captured by a camera. For example, if the tag is attached to food stored in a refrigerator, the refrigerator's cooling control can be performed based on the temperature indicated by the tag. In this way, the tag allows for appropriate management of the food stored in the refrigerator.

[0169] In addition, since the temperature indicator contains a temperature indicator ink, the temperature indicator can be easily produced by printing. Also, temperature indicators with various designs can be easily produced at low cost. Therefore, the tag can more easily and appropriately manage food stored in a refrigerator.

[0170] Furthermore, because the tag does not contain metal, it is possible to avoid electromagnetic wave reflection or sparks caused by metal when the microwave oven is operating, making it safer to use. Therefore, the tag can more safely and appropriately manage food stored in the refrigerator.

[0171] Furthermore, because the tag is attached to the food by an attachment part or is in contact with the food as part of the food container or packaging, the tag has approximately the same temperature as the food. Therefore, the temperature of the food can be obtained with greater accuracy through image analysis of an image showing the tag. Therefore, the tag can obtain the food temperature with greater accuracy, allowing for appropriate management of food stored in a refrigerator.

[0172] Furthermore, since the tag has a display unit, it can warn the user not to store food in the refrigerator that exceeds a predetermined upper temperature limit for food stored in the refrigerator. Therefore, the tag can appropriately manage the food stored in the refrigerator while preventing relatively high-temperature food from being stored in the refrigerator.

[0173] Furthermore, according to the control method of the above embodiment, the cooling control of the refrigerator can be performed based on the temperature of the food stored in the refrigerator. In this way, the control method can appropriately manage the food stored in the refrigerator.

[0174] Furthermore, by increasing the cooling power of the refrigerator when the temperature of the food is higher than the appropriate temperature range, the temperature of the food can be reduced more quickly and the temperature of other foods stored in the refrigerator can be prevented from rising. Therefore, the control method can appropriately manage the temperature of the food stored in the refrigerator by preventing the temperature from rising.

[0175] Furthermore, since the cooling of the refrigerator is continuously controlled, the temperature of the food stored in the refrigerator can be prevented from rising. Therefore, the control method can appropriately manage the temperature of the food stored in the refrigerator by preventing the temperature from rising.

[0176] Furthermore, by using the location in the refrigerator where the food is located that is higher than the appropriate temperature range, the cooling of the location where the food is located is strengthened, which further accelerates the decrease in the temperature of the food and prevents the temperature of other foods stored in the refrigerator from rising. Therefore, the above control method can appropriately manage the temperature of the food stored in the refrigerator by preventing a rise in the temperature of the food.

[0177] Furthermore, by displaying the expiration date or best-before date (also called "use-by date") for each food item to the user, the user is made aware of the expiration date for each food item, which has the effect of promoting effective use of food and reducing food waste. Therefore, the above control method can appropriately manage food stored in the refrigerator while making effective use of food and reducing food waste.

[0178] In addition, the expiration date and other information are adjusted based on the temperature change of the food stored in the refrigerator. This allows the expiration date and other information to reflect the fact that food stored in the refrigerator will spoil faster if it is left outside and then put back inside, contributing to safe food consumption by users. Therefore, the above control method allows for appropriate management of food stored in the refrigerator.

[0179] As described above, the embodiments have been described as examples of the technology in the present disclosure, and for that purpose, the accompanying drawings and detailed description have been provided.

[0180] Therefore, the components shown in the accompanying drawings and detailed description may include not only essential components for solving the problem, but also components that are not essential for solving the problem in order to illustrate the above implementation. Therefore, the fact that these non-essential components are shown in the accompanying drawings or detailed description should not be interpreted as immediately indicating that these non-essential components are essential.

[0181] Furthermore, since the above-described embodiments are intended to illustrate the technology of the present disclosure, various modifications, substitutions, additions, omissions, etc. may be made within the scope of the claims or their equivalents.

[0182] The present disclosure is applicable to a system for managing food stored in a refrigerator.

[0183] REFERENCE SIGNS LIST 1 Control system 10 Server 11, 21, 31 Communication IF 12, 22, 32 Processor 13, 23 Storage 14 Acquisition unit 15 Analysis unit 16 Cooling control unit 17 Food management unit 18 Progression information 20 Refrigerator 24 Imaging unit 25 Cooling unit 26A, 26B Food 30 Terminal 33 Display screen 40A, 40B, 40C, 40D Tag 41 Temperature indicator 42, 42C Temperature indicator 43, 44, 45 Display unit 47 Identification unit 51, 54 Image 52, 55 Table 56 Mark N Network

Claims

1. A temperature indicating material; and an identification unit that displays identification information that is uniquely identifiable by appearance. tag.

2. The temperature indicating material includes a temperature indicating ink. The tag of claim 1.

3. The tag does not contain metal. The tag of claim 1.

4. The tag is having an attachment portion adapted to be attached to a food product or a food container or package, or It is part of a food container or packaging The tag of claim 1.

5. The tag may further comprise: The refrigerator is provided with a display unit that displays a predetermined temperature as the upper limit temperature for food stored in the refrigerator. The tag according to any one of claims 1 to 4.

6. A food item stored in a refrigerator or a first food item that is a food item stored in the refrigerator is photographed by a camera, and an image showing the tag according to claim 1 attached to the first food item is generated; acquiring a temperature of the first food by analyzing a color of the temperature-indicating material of the tag shown in the generated image; By comparing the acquired temperature with an appropriate temperature range for the interior of the refrigerator, control information for controlling cooling of the interior of the refrigerator is generated, and the generated control information is transmitted to the refrigerator. Control methods.

7. When generating the control information, When it is determined that the acquired temperature is higher than the appropriate temperature range, control information is generated to control the refrigerator to strengthen cooling. The control method according to claim 6.

8. The control information is generated and transmitted repeatedly based on the image of the first food stored in the refrigerator, thereby continuously controlling the cooling of the refrigerator. The control method according to claim 6.

9. Analyzing the position of the tag shown in the generated image within the warehouse; When generating the control information, Generate control information for controlling the cooling of the location where the tag having a temperature higher than the appropriate temperature range is present. The control method according to claim 6.

10. acquiring the identification information displayed by the identification unit of the tag shown in the image; generating food information indicating a use-by date or a best-before date of the first food to which the tag is attached, in association with the identification information; The food information is presented. The control method according to any one of claims 6 to 9.

11. moreover, obtaining temperature transition information indicating a transition of the first food using the identification information; Adjusting the expiration date or best-before date of the first food product using the acquired transition information; In the presentation control, the adjusted expiration date or best-before date is used to present the food information. The control method according to claim 10.

12. an imaging unit that captures an image of a food item stored in the refrigerator or a first food item that is a food item stored in the refrigerator, and generates an image showing the tag according to claim 1 attached to the first food item; an analysis unit that acquires the temperature of the first food by analyzing the color of the temperature-indicating material included in the tag shown in the generated image; a control unit that generates control information for controlling cooling of the interior of the refrigerator by comparing the acquired temperature with an appropriate temperature range for the interior of the refrigerator, and transmits the generated control information to the refrigerator. Control system.

13. A tag, comprising: The tag is A temperature indicating material; an identification unit that displays identification information that is uniquely identifiable by appearance; The food product has an attachment part that is attached to a food product or a container or package of the food product, or is a part of the container or package of the food product, The temperature indicating material is used to analyze the temperature of food or food containers or packaging. tag.