Refrigerator

Abstract

To realize a refrigerator capable of calling user's attention by a method with high cost-effectiveness.SOLUTION: A refrigerator (1) includes: a cold room (10) having a storage area for storing stored objects; a door (20) for opening / closing the cold room; air outlets (H1-H4) disposed in a depth wall (10a) of the storage area, and blowing cool air to the storage area; imaging sections (61-64) disposed at a height higher than a height of the air outlets inside the door, and photographing the inside of the storage area from the door; and a determination section for determining an arrangement state of stored objects stored in the storage area based on the image photographed by the imaging sections.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a refrigerator. [Background technology]

[0002] Patent Document 1 discloses a technology that performs image recognition inside a refrigerator, and if the refrigerator is being used in an inappropriate manner, displays the information on a display device to alert the user. In this technology, a camera installed at the top of the back side of the refrigerator as seen from the door side captures an image of the area below the camera, and performs image recognition on the obtained image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 5-45042 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with the camera described in Patent Document 1, it is difficult to confirm whether a path is secured for the cold air discharged from the air outlet to circulate inside the refrigerator. In addition, since the camera is installed at the back of the refrigerator, there is a risk that it will take away food storage space. Furthermore, it is difficult to use this camera for purposes other than those disclosed in Patent Document 1. The above camera is not suitable for purposes such as capturing a wide image of the inside of the refrigerator to manage the food stored therein. Therefore, for such purposes, it is necessary to install a camera capable of capturing a wide image of the inside of the refrigerator in addition to the above camera, which is problematic in terms of cost-effectiveness.

[0005] An object of one aspect of the present invention is to provide a refrigerator that has a simple configuration and can prompt a user to ensure a cool air circulation path inside the refrigerator. [Means for solving the problem]

[0006] In order to solve the above problems, a refrigerator according to one embodiment of the present invention comprises a storage compartment having a storage area for storing items, a door for opening and closing the storage compartment, an air outlet provided on a rear wall of the storage area for blowing cool air into the storage area, an imaging unit provided inside the door at a height equal to or higher than the height of the air outlet for capturing images of the inside of the storage area from the door, and a determination unit for determining the arrangement of items stored in the storage area based on the image captured by the imaging unit. Effect of the Invention

[0007] According to the refrigerator of one aspect of the present invention, a simple configuration can be used to encourage a user to ensure a circulation path for cool air inside the refrigerator. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a front view of a refrigerator according to a first embodiment with the door open. [Diagram 2] 1 is a front view of the inside of the right door of a refrigerator according to embodiment 1. FIG. [Diagram 3] 1 is a side cross-sectional view of a refrigeration compartment of a refrigerator according to embodiment 1. FIG. [Figure 4] FIG. 2(a) is a front view of the refrigerator according to the first embodiment with the door closed, and (b) is a cross-sectional view taken along line AA of (a). [Diagram 5] FIG. 1 is a block diagram showing the configuration of a main part of a refrigerator according to a first embodiment. [Figure 6] FIG. 1A is a diagram showing an example of an image captured by the imaging unit, FIG. 1B is a diagram showing another example of an image captured by the imaging unit, and FIG. 1C is a diagram showing yet another example of an image captured by the imaging unit. [Figure 7] 4 is a flowchart showing a process in the refrigerator according to the first embodiment. [Figure 8] 13(a) to 13(c) are plan views each showing an example of a state in which an image of the air outlet is not included in an image captured by an imaging section. [Figure 9] FIG. 11 is a diagram showing an example of an image captured by an imaging unit in the refrigerator according to the second embodiment. [Figure 10] FIG. 11 is a diagram showing a part of light incident on an imaging unit in a refrigerator according to embodiment 2. [Figure 11] 10 is a flowchart showing a process in a refrigerator according to a second embodiment. [Figure 12] FIG. 11 is a block diagram showing the configuration of a main part of a refrigerator according to embodiment 3. [Figure 13] FIG. 11 is a diagram showing a partial optical path of light that forms an image captured by an imaging section and an upper imaging section in a refrigerator according to embodiment 3. [Figure 14] 11 is a flowchart showing a process in a refrigerator according to embodiment 3. [Figure 15] FIG. 11 is a block diagram showing the configuration of a main part of a refrigerator according to embodiment 4. [Figure 16] 13 is a diagram showing a part of light incident on an imaging unit and a lower imaging unit in a refrigerator according to embodiment 4. FIG. [Figure 17] FIG. 10(a) is a diagram showing an example of an image captured by an imaging unit in a refrigerator according to embodiment 4, and FIG. 10(b) is a diagram showing an example of an image captured by a lower imaging unit in a refrigerator according to embodiment 4. [Figure 18] 4 is a cross-sectional view showing an example of the structure of the optical region. FIG. [Figure 19] 13 is a flowchart showing a process in a refrigerator according to embodiment 4. [Figure 20] FIG. 13(a) is a diagram showing an example of an image captured by an imaging unit in a refrigerator according to embodiment 5, and FIG. 13(b) is a diagram showing an example of an image captured by a lower imaging unit in a refrigerator according to embodiment 5. [Figure 21] 13 is a flowchart showing a process in a refrigerator according to embodiment 5. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] [Embodiment 1] Hereinafter, one embodiment of the present invention will be described in detail.

[0010] Fig. 1 is a front view of refrigerator 1 according to this embodiment with door 20 open. Fig. 2 is a front view of the inside of right door 21 of refrigerator 1. Fig. 3 is a side cross-sectional view of refrigeration compartment 10 (storage compartment) equipped in refrigerator 1. Fig. 4(a) is a front view of refrigerator 1 with door 20 closed, and Fig. 4(b) is a cross-sectional view taken along line AA in Fig. 4(a).

[0011] As shown in Fig. 1 to Fig. 4, refrigerator 1 includes a refrigerator compartment 10, a door 20, an ice making compartment 30, a vegetable compartment 40, and a freezer compartment 50. In Fig. 1, ice making compartment 30, vegetable compartment 40, and freezer compartment 50 are shown with their doors closed. Note that the refrigerator according to this embodiment only needs to include at least refrigerator compartment 10, and does not necessarily need to include ice making compartment 30, vegetable compartment 40, and freezer compartment 50.

[0012] The refrigerator compartment 10 is formed of a heat-insulating box filled with a heat insulating material. Inside the refrigerator compartment 10, storage shelves 11, 12, and 13 for placing items B (see FIG. 6, etc.) are provided. The storage shelves 11 to 13 are formed of a light-transmitting material such as glass or resin.

[0013] The interior of the refrigeration chamber 10 is divided into storage areas R1, R2, R3, and R4 by placement shelves 11, 12, and 13, in that order from the top. In addition, air outlets H1, H2, H3, and H4 that blow cold air into the refrigeration chamber 10 are provided in the back wall 10a of the refrigeration chamber 10, in this order from the top. Specifically, the air outlets H1 to H4 blow cold air into the storage areas R1 to R4, respectively. In addition, a return port (not shown) is provided at the bottom end of the refrigeration chamber 10, and the cold air blown into the refrigeration chamber 10 is collected from the return port, thereby circulating the cold air.

[0014] Further, the air outlets H1 to H4 have a shape that can be identified by the determination unit 71 described later. For example, the surrounding area of ​​the air outlets H1 to H4 in the back wall 10a is formed of a white flat surface, and the air outlets H1 to H4 are formed in a predetermined shape (e.g., a rectangle or ellipse as shown in the figure) that can be identified by contrast with the surrounding area. Therefore, the determination unit 71 can easily identify the air outlets H1 to H4 in the images captured by the imaging units 61 to 64 described later. The surrounding area is provided across the top and bottom of the back wall 10a.

[0015] Door 20 is provided on the front surface of refrigerator compartment 10 so as to be openable and closable. Specifically, door 20 has a right door 21 and a left door 22, and each door rotates around a rotation shaft provided at the right end and left end of refrigerator compartment 10 to open and close refrigerator compartment 10. However, door 20 may be a single door that opens and closes refrigerator compartment 10 by rotating around a rotation shaft provided at the right end or left end of refrigerator compartment 10.

[0016] On the inside of the right door 21, the imaging units 61, 62, 63, and 64 for imaging the refrigerator compartment 10 are provided in this order from the top. Specifically, the imaging units 61-64 image the insides of the storage areas R1-R4, respectively. The imaging units 61-64 are provided at a height equal to or higher than the height of the air outlets H1-H4. Also, the imaging units 61-64 are provided at positions that substantially coincide with the positions of the air outlets H1-H4 in the width direction of the refrigerator compartment 10, respectively. Furthermore, the imaging units 61-64 are arranged in a vertical line at the open end of the right door 21 as shown in FIG. 2, and no storage units such as door pockets are arranged above or below the imaging units 61-64. This makes it possible to prevent stored items stored above or below the imaging units 61-64 from covering the imaging areas of the imaging units 61-64. In addition, since the area in front of the imaging units 61 to 64 is an open area that penetrates in the vertical direction, the cool air blown out from the air outlets H1 to H4 can circulate downward in the refrigerator compartment 10, without impeding the circulation of the cool air.

[0017] The imaging units 61 to 64 may be various known imaging devices such as a CCD (Charge Coupled Device) camera or a CMOS (Complementary Metal Oxide Semiconductor) camera. Each of the imaging units 61 to 64 may be equipped with a lens for capturing an image of a wide range, such as a wide-angle lens or a fisheye lens.

[0018] As shown in (a) of FIG. 4, a display unit 23 is provided on the outer surface of the right door 21. The display unit 23 may be, for example, a liquid crystal display. The display unit 23 displays an image for presenting information related to the operation of the refrigerator to a user. As shown in (b) of FIG. 4, the storage shelf 11 is formed of a light-transmitting material and is surrounded by an opaque edge 11b. Although not shown, the storage shelves 12 and 13 are similarly configured.

[0019] In the following description, it is assumed that the storage shelves 11 to 13 are provided in this order from top to bottom. Also, it is assumed that the door 20 side is the front side, and the rear wall 10a side is the rear side.

[0020] Fig. 5 is a block diagram showing the configuration of the main parts of refrigerator 1. As shown in Fig. 5, refrigerator 1 includes imaging units 61-64, display unit 23, control unit 70, and storage unit 80. Imaging units 61-64 and display unit 23 are as described above.

[0021] The control unit 70 includes a determination unit 71 and a notification unit 72. The determination unit 71 determines the arrangement of the items stored in each of the storage areas R1-R4 based on the images captured by each of the imaging units 61-64. Specifically, the determination unit 71 determines whether or not the cool air discharged from each of the air outlets H1-H4 can flow to the corresponding imaging unit 61-64. The determination method used by the determination unit 71 will be described later.

[0022] The notification unit 72 notifies the user when the determination unit 71 determines that a path (circulation path) through which cool air discharged from any of the air outlets H1 to H4 flows forward is blocked. The notification unit 72 can issue a warning to the user, for example, by displaying a warning image on the display unit 23. If the refrigerator 1 has a speaker, the notification unit 72 may issue a warning to the user by outputting a warning sound from the speaker. Alternatively, if the refrigerator 1 has a network function, the notification unit 72 may issue a warning to the user via a device external to the refrigerator 1, such as the user's smartphone.

[0023] In the following description, a state in which the circulation path of cool air from any one of the air outlets H1 to H4 is blocked may be simply described as "any one of the air outlets H1 to H4 is blocked."

[0024] The storage unit 80 stores data necessary for the control of the refrigerator 1 by the control unit 70. The refrigerator 1 does not necessarily need to include the storage unit 80, and may be configured to be able to communicate with an external storage device.

[0025] Hereinafter, the determination by the determination unit 71 will be described with respect to the storage area R2 (target storage area). As a specific example, a case will be described in which the determination unit 71 determines whether the air outlet H2 is blocked based on an image captured by the imaging unit 62.

[0026] Fig. 6(a) is a diagram showing an example of an image captured by the imaging unit 62. In the example shown in Fig. 6(a), an image of the entire air outlet H2 is included in the area of ​​the rear wall 10a among the images captured by the imaging unit 62. In this case, it is clear that the path through which the cool air from the air outlet H2 flows forward is not blocked.

[0027] Also, even if the image captured by the imaging unit 62 does not include the air outlet H2, it is possible that there is no problem with the flow of cool air.

[0028] Fig. 6(b) is a diagram showing another example of an image captured by the imaging unit 62. In the example shown in Fig. 6(b), since a stored item B is present in front of the air outlet H2, the image captured by the imaging unit 62 does not include an image of the air outlet H2. However, the captured image includes the rear wall 10a1 above the lower end of the air outlet H2. In this case, the cool air from the air outlet H2 can reach the door 20 on which the imaging unit 62 is installed through the upper part of the storage area R2 (near the lower surface of the storage shelf 11), which means that it can be determined that the circulation path of the cool air is not blocked.

[0029] FIG. 6(c) is a diagram showing yet another example of an image captured by the imaging unit 62. In the example shown in FIG. 6(c), the height of the stored item B is higher than in the example shown in FIG. 6(b). For this reason, neither the air outlet H2 nor the back wall 10a1 is included in the image, but the back wall 10a is included in the image. In this case, the path through which the cold air from the air outlet H2 flows is not blocked. However, the cold air cannot flow forward in a straight line, and the circulating cold air makes it difficult to efficiently cool the stored item B in the storage area R2, so this is a state that requires attention.

[0030] The back wall 10a1 above the air outlet H2 includes at least the upper part of the air outlet H2, but may also include a predetermined area closer to the side wall than the upper part of the air outlet H2. Also, it may include a predetermined area on the side of the air outlet H2. In a part of the back wall 10a, the back wall 10a1 has an area where a straight line connecting the back wall 10a1 and the imaging unit 62 forms a path through which cool air from the air outlet H2 can flow efficiently.

[0031] In addition, it is preferable that the back wall 10a has a pattern that can be identified by the determination unit 71. If the back wall 10a has a pattern, the area of ​​the image of the back wall 10a can be easily calculated by calculating the area of ​​the pattern in the image captured by the imaging units 61 to 64. In a typical refrigerator, since the inner wall is white, if the stored item B is white like tofu, it is difficult to calculate the area of ​​the image of the back wall 10a by distinguishing between the back wall 10a and the stored item B. In contrast, if the back wall 10a has a pattern in the refrigerator 1, the area of ​​the image of the back wall 10a can be calculated by distinguishing between the back wall 10a and the stored item B. Note that the back wall 10a may also have a pattern around the above-mentioned air outlets H1 to H4.

[0032] The pattern on the back wall 10a may be, for example, vertical stripes as shown in Fig. 1. In this case, the pitch of the vertical stripes in the left-right direction may not be uniform. In addition, the back wall 10a1 above the air outlet H2 may have a pattern different from that in other areas of the back wall 10a.

[0033] 7 is a flowchart showing the process for each of the storage areas R1 to R4 in the refrigerator 1. In the following explanation, the storage area R2 is used as an example, but the same applies to the storage areas R1, R3 and R4.

[0034] First, the determination unit 71 acquires an image from the imaging unit 62 (S01). Next, the determination unit 71 determines whether the acquired image includes an image of the air outlet H2 (S02). If the acquired image does not include an image of the air outlet H2 (NO in S02), the determination unit 71 determines whether the image includes an image of the back wall 10a1 above the air outlet H2 (S03). If the image does not include an image of the back wall 10a1 above the air outlet H2 (NO in S03), the determination unit 71 determines whether the image includes an image of the back wall 10a (S04). If the image does not include an image of the back wall 10a (NO in S04), the determination unit 71 determines that the path of the cool air from the air outlet H2 is blocked (x determination) (S05A).

[0035] On the other hand, if the image includes an image of the air outlet H2 (YES in S02) or if the image includes an image of the back wall 10a1 above the air outlet H2 (YES in S03), the determination unit 71 determines that the path of the cool air from the air outlet H2 is secured (◯ determination) (S05B). If the image includes an image of the back wall 10a (YES in S04), the determination unit 71 determines that there is resistance to the path of the cool air from the air outlet H2 (△ determination) (S05C).

[0036] In steps S02 to S04, the determination of whether an image of the air outlet H2, the back wall 10a1, or the back wall 10a is included may be based on, for example, whether the determination unit 71 can recognize the air outlet H2, the back wall 10a1, or the back wall 10a by image recognition. The above determination may be based on, for example, whether an image of the air outlet H2, the back wall 10a1, or the back wall 10a is included in a predetermined size or more after the image of the air outlet H2, the back wall 10a1, or the back wall 10a is recognized by image recognition. Here, the predetermined size may be, for example, a predetermined percentage (for example, 30%, 50%, or 70%) of the size of the image when the entire air outlet H2, the back wall 10a1, or the back wall 10a is imaged. In this case, the above predetermined percentage may be different in each of steps S02 to S04.

[0037] The above process is applied to each of the storage areas R1 to R4 (S06), and the route of the cool air from each of the air outlets H1 to H4 is judged. Then, based on each judgment, a comprehensive judgment is made as to whether or not there is a problem in securing the route of the cool air (S07). The judgment unit 71 performs the comprehensive judgment, for example, as follows.

[0038] The determination unit 71 determines that there is no problem if none of the storage areas R1 to R4 is judged as ×. Also, the determination unit 71 determines that there is no problem if any one of the storage areas R1 to R4 is judged as × but any one or more of the others are judged as ○. On the other hand, the determination unit 71 determines that there is a problem if two or more of the storage areas R1 to R4 are judged as ×, or if any one of the storage areas is judged as × and the others are judged as △ (S08).

[0039] If the judgment unit 71 judges that there is a problem in the overall judgment (YES in S08), the notification unit 72 notifies the user of this (S09). At this time, the notification unit 72 also notifies the user of any of the storage areas R1 to R4 that have been judged as x. Note that the above-mentioned method of overall judgment is one example, and the judgment unit 71 may perform the overall judgment using a different method. For example, the judgment unit 71 may immediately judge that there is a problem if any of the storage areas R1 to R4 have been judged as x.

[0040] As described above, the imaging units 61-64 are provided at a height equal to or higher than the height of the air outlets H1-H4. Therefore, in steps S02 and S03, the air outlets can be viewed from above, reducing the effect of the height of the stored item B. In other words, even if the circulation path of the cool air from the air outlets H1-H4 is secured in the upper part of the storage areas R1-R4, the judgment unit 71 may give a △ or × judgment because the stored item B placed near the imaging units 61-64 cannot capture the images of the air outlets H1-H4 and the upper back wall 10a1.

[0041] As described above, according to the refrigerator 1, it is possible to determine whether the flow of cool air from the air outlets H1-H4 in each of the storage areas R1-R4 is blocked or not based on the images captured by the imaging units 61-64, and to notify the user if it is blocked.

[0042] In addition to observing the air outlets H1-H4, the imaging units 61-64 can also be used to manage the stored item B stored in the refrigerator 1. For example, an image of the stored item B stored in the refrigerator 1 can be sent to the user's mobile device or the like, allowing the user to check the stored item B while away from home. Therefore, according to the refrigerator 1, the imaging units 61-64 can be used for multiple purposes, and the simple configuration can encourage the user to ensure a circulation path for cool air inside the refrigerator.

[0043] The refrigerator according to the embodiment of the present disclosure may include only one storage shelf, or may include four or more storage shelves. In this case, the number of storage areas varies depending on the number of storage shelves. The refrigerator according to the embodiment of the present disclosure preferably includes imaging units in a number equal to the number of storage areas.

[0044] [Embodiment 2] Hereinafter, another embodiment of the present invention will be described. For convenience of explanation, the same reference numerals are given to members having the same functions as those described in the above embodiment, and the explanations thereof will not be repeated. For simplicity, the refrigerator according to this embodiment will also be referred to as refrigerator 1.

[0045] 8(a) to 8(c) are plan views showing examples of a state in which an image of the air outlet H2 is not included in the image captured by the imaging unit 62. In the example shown in FIG. 8(a), the stored item B is arranged in the immediate vicinity of the air outlet H2. In this case, the air outlet H2 can be said to be blocked. In the example shown in FIG. 8(b), the stored item B is arranged at a position slightly away from the air outlet H2 so as to surround the air outlet H2. In this case, depending on the height of the stored item B, the air outlet H2 cannot be said to be blocked. In the example shown in FIG. 8(c), the stored item B is arranged near the midpoint between the air outlet H2 and the imaging unit 62 and on both sides of the midpoint. In this case, since there is a sufficient space between the air outlet H2 and the stored item B, the air outlet H2 is not blocked. However, in the storage area R2 of the refrigerator 1 of the first embodiment, when the height of the stored item B is high enough that the back wall 10a1 cannot be imaged, it is difficult to determine the states of FIG. 8(a) to 8(c) from the image captured by the imaging unit 62.

[0046] FIG. 9 is a diagram showing an example of an image captured by imaging unit 62 in refrigerator 1. FIG. 10 is a diagram showing a portion of light incident on imaging unit 62 in refrigerator 1. As shown in FIGS. 9 and 10, refrigerator 1 includes mirror 11a that is provided on the upper surface of storage area R2 and reflects an upward view from air outlet H2 to imaging unit 62. Therefore, according to refrigerator 1, even if an image captured by imaging unit 62 does not include an image directly capturing air outlet H2 as shown in FIGS. 9 and 10, determination unit 71 can determine whether air outlet H2 is blocked or not based on the image of air outlet H2 reflected on mirror 11a. Similarly, refrigerator 1 may include mirrors on the lower surfaces of each of shelves 12 and 13.

[0047] FIG. 11 is a flowchart showing the process in the refrigerator 1 according to this embodiment.

[0048] First, the determination unit 71 acquires an image from the imaging unit 62 (S1). Next, the determination unit 71 determines whether or not an image of the air outlet H2 of a predetermined size or more is included in the area of ​​the back wall 10a of the acquired image (S2). If an image of the air outlet H2 of a predetermined size or more is not included in the area of ​​the back wall 10a (NO in S2), the determination unit 71 determines whether or not an image of the air outlet H2 of a predetermined size or more is included in the area of ​​the mirror 11a of the image (S3). If an image of the air outlet H2 of a predetermined size or more is not included in the area of ​​the mirror 11a (NO in S3), the determination unit 71 determines that the air outlet H2 is blocked (S4).

[0049] On the other hand, if the image of the air outlet H2 is included in the area of ​​the back wall at a size equal to or larger than a predetermined size (YES in S2), or if the image of the air outlet H2 is included in the area of ​​the mirror 11a at a size equal to or larger than a predetermined size (YES in S3), the judgment unit 71 judges that the air outlet H2 is not blocked and terminates the processing.

[0050] As in the above example, the determination unit 71 can determine whether each of the air outlets H1, H3, and H4 is blocked based on the images captured by the imaging units 61, 63, and 64, respectively. Thereafter, a comprehensive determination is made in the same manner as in the first embodiment.

[0051] Note that in the refrigerator 1 according to this embodiment, similar to the refrigerator 1 according to embodiment 1, a comprehensive judgment may be made after each of the storage areas R1 to R4 is judged as either O, △, or ×. Conversely, in the refrigerator 1 according to embodiment 1, similar to the refrigerator 1 according to this embodiment, a notification may be given to the user when it is judged that the flow of cool air from the corresponding air outlets H1 to H4 is blocked in any of the storage areas R1 to R4.

[0052] Furthermore, since the positions of the imaging units 61-64 in the refrigerator 1 are constant, the area corresponding to the back wall 10a and the area corresponding to the mirror 11a in the images captured by the imaging units 61-64 are also approximately constant. Therefore, these areas may be identified in advance and stored in the storage unit 80. Furthermore, the images of the air outlet H2 in the areas corresponding to the back wall 10a and the area corresponding to the mirror 11a in the images captured by the imaging units 61-64 may be identified by image recognition.

[0053] As described above, refrigerator 1 according to this embodiment is provided with mirror 11a on the underside of storage shelf 11, making it easier to observe air outlets H1 to H4 compared to refrigerator 1 according to the first embodiment.

[0054] In the state shown in FIG. 8(c), there is a gap between the stored items B. Therefore, even if the captured image does not show the images of the air outlets H1-H4, it is considered that the image of the back wall 10a is shown. When the captured image shows the image of the back wall 10a, a path for circulating cool air is formed between the back wall 10a and any one of the imaging units 61-64 that have captured the image of the back wall 10a. Then, as shown in FIG. 1 and FIG. 2, if the front area of ​​the imaging units 61-64 is an open-air area that penetrates in the vertical direction, the cool air that has circulated from the back wall 10a to any one of the imaging units 61-64 via the above-mentioned path can circulate to the return port provided at the lower end of the refrigerator compartment 10 via the open-air area. Therefore, the determination unit 71 may further execute a step of determining whether the air outlets H1-H4 are blocked based on whether the acquired image includes the back wall 10a, as in the refrigerator according to the first embodiment.

[0055] Specifically, the determination unit 71 determines that the air outlets H1-H4 are not blocked if the area of ​​the image of the rear wall 10a in the captured image is equal to or larger than a predetermined value. On the other hand, the determination unit 71 determines that the air outlets H1-H4 are blocked if the area of ​​the image of the rear wall 10a in the captured image is not equal to or larger than a predetermined value. This determination may be performed, for example, between steps S3 and S4 described above.

[0056] Furthermore, the determination unit 71 may execute the process of step S3 in addition to the process in embodiment 1. Specifically, for example, the determination unit 71 may add the execution result of the process equivalent to step S3 to at least one of steps S02, S03, and S04 in Fig. 7. The image acquired through the mirror 11a corresponds to an image viewed from a higher position than the image acquired in embodiment 1, so that the influence of the height of the stored item B can be further reduced.

[0057] Also, the image acquired through the mirror 11a makes it easier to determine the distance from the air outlet H2 or the back wall 10a to the stored item B. For this reason, the determination unit 71 may measure the distance based on the acquired image, and perform a process of determining △ or × as in the first embodiment if the distance is equal to or less than a predetermined distance. In this case, the determination unit 71 determines that the circulation path of the cool air is not sufficiently secured when it determines that the distance between the air outlet H2 and the stored item B placed in front of the air outlet H2 is equal to or less than a predetermined distance.

[0058] The predetermined distance is preset for each storage area according to the amount of cool air blown out from the air outlet, the flow rate, and the size and shape of the storage area. As an example, if there is an object stored less than 2 cm away from the air outlet, it may be judged as "X", and if there is an object stored more than 2 cm and less than 4 cm away, it may be judged as "△". The predetermined distance may be set and changed by the user. Such a judgment based on the distance may also be performed in other embodiments described later.

[0059] [Embodiment 3] Other embodiments of the present invention will be described below. For ease of explanation, the same reference numerals are given to members having the same functions as those described in the above embodiment, and the description thereof will not be repeated.

[0060] FIG. 12 is a block diagram showing the configuration of the main parts of the refrigerator 2 according to this embodiment. The refrigerator 2 has the same configuration as the refrigerator 1. However, for convenience of explanation, in the block diagram shown in FIG. 12, among the imaging units 61 to 64, only the imaging unit 62 is shown as an imaging unit, and the imaging unit 61 is shown as an "upper imaging unit 61" to clearly indicate that it is an imaging unit located above the imaging unit 62. The upper imaging unit 61 is provided on the inside of the door 20, above the imaging unit 62, and captures an image of the inside of the refrigerator compartment 10 from the door 20. More specifically, the upper imaging unit 61 can capture an image of the storage area R2 from the storage area R1 (upper storage area) above the storage area R2 (attention storage area). In addition, in the refrigerator 2, the determination unit 71 determines whether the air outlet H2 of the storage area R2 is blocked or not based on the image captured by the imaging unit 62 and the image captured by the upper imaging unit 61.

[0061] FIG. 13 is a diagram showing a part of the optical path of the light forming the image captured by the imaging unit 62 and the upper imaging unit 61 in the refrigerator 2. As shown in FIG. 13, the upper imaging unit 61 is provided above the imaging unit 62 and can capture an image of the storage area R2 from the storage area R1 (upper storage area). Therefore, even if the image of the air outlet H2 included in the image captured by the imaging unit 62 is small, the determination unit 71 can determine that the air outlet H2 is not blocked by the stored item B based on the image captured by the upper imaging unit 61. In this way, capturing an image of the storage area R2 by the imaging unit 62 and the upper imaging unit 61 makes it easier to observe the state of the path of the cool air from the air outlet H2.

[0062] FIG. 14 is a flowchart showing the process in the refrigerator 2.

[0063] First, the determination unit 71 acquires images from the imaging unit 62 and the upper imaging unit 61 (S11). Next, the determination unit 71 determines whether or not the image of the air outlet H2 is included in the area of ​​the back wall 10a in the image acquired from the imaging unit 62 in a size greater than or equal to a predetermined size (S12). If the image acquired from the imaging unit 62 does not include an image of the air outlet H2 in a size greater than or equal to a predetermined size (NO in S12), the determination unit 71 determines whether or not the distance between the air outlet H2 and the stored item B placed in front of the air outlet H2 is greater than or equal to a predetermined distance in the image acquired from the upper imaging unit 61 (S13). As a method for determining the distance, for example, a method such as (i) determining whether or not the image acquired from the upper imaging unit 61 includes an image of the air outlet H2 in a size greater than or equal to a predetermined size, or (ii) recognizing the air outlet H2 and the stored item B from the acquired image and measuring the distance can be used. If the distance between the air outlet H2 and the stored item B is not equal to or greater than a predetermined distance (NO in S13), the determination unit 71 determines that the air outlet H2 is blocked (S14).

[0064] On the other hand, if the image acquired from the imaging unit 62 includes an image of the air outlet H2 of a predetermined size or more (YES in S12), or if it is determined from the image acquired from the upper imaging unit 61 that the distance between the air outlet H2 and the stored item B is a predetermined distance or more (YES in S13), the determination unit 71 determines that the air outlet H2 is not blocked and ends the process. Note that the predetermined size and distance are as described in the first and second embodiments.

[0065] The determination unit 71 can also determine whether or not the air outlets H3 and H4 are blocked in the same manner as the process shown in Fig. 14. When making a determination regarding the air outlet H3, the determination unit 71 makes the above determination based on images captured by the imaging units 63 and 62. When making a determination regarding the air outlet H4, the determination unit 71 makes the above determination based on images captured by the imaging units 64 and 63. Thereafter, the determination unit 71 makes a comprehensive determination in the same manner as in the first embodiment.

[0066] However, for the air outlet H1, none of the imaging units 61 to 64 can be used as the upper imaging unit. Therefore, for the air outlet H1, the determination unit 71 may determine whether the air outlet H1 is blocked based only on the image captured by the imaging unit 61, as in the first embodiment.

[0067] As described above, in the refrigerator 2, it is possible to determine whether the air outlets H1-H4 are blocked based on a plurality of images captured by the imaging units 61-64, and to issue a warning to the user if the air outlets H1-H4 are blocked. Therefore, in the refrigerator 2, by the determination unit 71 determining with high accuracy whether the air outlets H1-H4 are blocked, it is possible to more accurately urge the user to ensure a circulation path for cool air inside the refrigerator.

[0068] The process in refrigerator 2 may be applied to refrigerator 1 in the above-described embodiment 1 or 2. For example, determination unit 71 may perform the determination in step S13 after the above-described step S04 or S3 in refrigerator 1.

[0069] [Embodiment 4] Other embodiments of the present invention are described below.

[0070] FIG. 15 is a block diagram showing the configuration of the main parts of the refrigerator 3 according to this embodiment. The refrigerator 3 includes the imaging units 61 to 64, similar to the refrigerator 1. However, for convenience of explanation, in the block diagram shown in FIG. 15, among the imaging units 61 to 64, only the imaging unit 62 is shown as an imaging unit, and the imaging unit 63 is shown as a "lower imaging unit 63" to clearly indicate that it is an imaging unit located below the imaging unit 62. The lower imaging unit 63 is provided on the inside of the door 20, below the imaging unit 62, and captures an image of the inside of the refrigerator compartment 10 from the door 20. More specifically, the lower imaging unit 63 can capture an image of the storage area R2 through the placement shelf 12 from a storage area R3 (lower storage area) that is lower than the storage area R2 (attention storage area). In the refrigerator 3, the determination unit 71 determines whether the air outlet H2 of the storage area R2 is blocked or not, based on the image captured by the imaging unit 62 and the image captured by the lower imaging unit 63.

[0071] Fig. 16 is a diagram showing some of the light incident on the imaging unit 62 and the lower imaging unit 63 in the refrigerator 3. As in the other embodiments, light from the storage area R2, including light from the air outlet H2, is incident on the imaging unit 62 as shown in Fig. 16. On the other hand, light from the storage area R3, including light from the lower surface of the storage shelf 12, is incident on the lower imaging unit 63 as shown in Fig. 16.

[0072] FIG. 17(a) is a diagram showing an example of an image captured by the imaging unit 62 in the refrigerator 3. FIG. 17(b) is a diagram showing an example of an image captured by the lower imaging unit 63 in the refrigerator 3. As shown in FIG. 16 and FIG. 17(a) and (b), in the refrigerator 3, an optical region 12a having optical properties that directs a part of light from the storage region R2 that has passed through the storage shelf 12 toward the lower imaging unit 63 is provided near the air outlet H2 of the storage shelf 12 that defines the lower end of the storage region R2. Therefore, as shown in FIG. 17(b), the lower imaging unit 63 can capture an image of the stored item B placed on the optical region 12a. Since the optical region 12a is provided up to the edge of the rear wall 10a side of the storage shelf 12, the lower imaging unit 63 can capture an image of the position of the stored item B closest to the air outlet H2. However, in the refrigerator 3, the storage shelf 12 does not necessarily have to be provided with the optical region 12a.

[0073] In this embodiment, the determination unit 71 determines whether the air outlet H2 is blocked based on the image captured by the imaging unit 62 and also based on the image captured by the lower imaging unit 63. When making a determination based on the image captured by the lower imaging unit 63, specifically, the determination unit 71 determines whether the air outlet H2 is blocked based on the position of the image of the stored item B in the area corresponding to the optical area 12a among the images captured by the lower imaging unit 63. More specifically, the determination unit 71 determines that the air outlet H2 is blocked when the image of the stored item B in the area corresponding to the optical area 12a is not located a predetermined distance (e.g., 2 cm) or more away from the back wall 10a having the air outlet H2.

[0074] Fig. 18 is a cross-sectional view showing an example of the structure of the optical region 12a. The optical region 12a may have a sawtooth shape on the lower side of the cross section, as shown in Fig. 18, for example. Specifically, the lower surface of the optical region 12a may have a structure in which vertical surfaces and surfaces inclined so that the front side is lower than the back side are alternately repeated. In this case, a part of the light directed downward from the stored item B placed on the optical region 12a is refracted in the optical region 12a and directed toward the lower imaging unit 63.

[0075] Also, the optical region 12a may be a surface processed to scatter light, for example. In this case, the processed surface may be processed to have a milky white appearance, for example. Also, the optical region 12a may be subjected to an anti-reflection treatment so that the light passing through the storage shelf 12 can be easily observed. Since the lower imaging unit 63 is also provided at a height equal to or higher than the height of the air outlet H3 like the other imaging units, the distance between the storage shelf 12 and the lower imaging unit 63 in the height direction becomes small, and the exit angle of the light emitted from the lower surface of the storage shelf 12 toward the lower imaging unit 63 becomes large (close to parallel to the lower surface of the storage shelf 12). If the exit angle is equal to or higher than the critical angle, the light passing through the storage shelf 12 does not reach the lower imaging unit 63, that is, the lower imaging unit 63 cannot image the stored items in the storage area R2 placed on the storage shelf 12. Therefore, in this embodiment, the placement shelf 12 is provided with an optical region 12 a so that light passing through the placement shelf 12 can reach the lower imaging section 63 .

[0076] As described above, the storage shelf 12 is provided with an opaque edge 11b (see FIG. 4(b)) around it. The edge 11b on the rear wall 10a side is located in front of the air outlet H2. The determination unit 71 may recognize the edge 11b and calculate the distance from the edge 11b to the stored item B on the optical region 12a.

[0077] FIG. 19 is a flowchart showing the process in the refrigerator 3.

[0078] First, the determination unit 71 acquires images from the imaging unit 62 and the lower imaging unit 63 (S21). Next, the determination unit 71 determines whether or not an image of the air outlet H2 of a predetermined size or more is included in the area of ​​the back wall 10a in the image acquired from the imaging unit 62 (S22). If an image of the air outlet H2 of a predetermined size or more is not included in the image acquired from the imaging unit 62 (NO in S22), the determination unit 71 determines whether or not the distance between the air outlet H2 and a stored item placed in front of the air outlet H2 is a predetermined distance or more in the image acquired from the lower imaging unit 63 (S23). If the distance between the air outlet H2 and the stored item is not a predetermined distance or more in the image acquired from the lower imaging unit 63 (NO in S23), the determination unit 71 determines that the air outlet H2 is blocked (S24).

[0079] On the other hand, if the image acquired from the imaging unit 62 includes an image of the air outlet H2 of a predetermined size or more (YES in S22), or if it is determined from the image acquired from the lower imaging unit 63 that the distance between the air outlet H2 and the stored items is a predetermined distance or more (YES in S23), the determination unit 71 determines that the air outlet H2 is not blocked and ends the process. The predetermined size and distance are as described in the first and second embodiments.

[0080] The determination unit 71 can also determine whether the circulation path of cool air is blocked for the air outlets H1 and H3 in the same manner as the process shown in Fig. 19. When making a determination for the air outlet H1, the determination unit 71 makes the above determination based on images captured by the imaging units 61 and 62 (lower imaging units). When making a determination for the air outlet H3, the determination unit 71 makes the above determination based on images captured by the imaging units 63 and 64.

[0081] However, for the air outlet H4, none of the imaging units 61 to 64 can be used as the lower imaging unit. Therefore, for the air outlet H4, the determination unit 71 may determine whether or not the air outlet H4 is blocked based only on the image captured by the imaging unit 61, as in the first embodiment, for example.

[0082] The process in refrigerator 3 may be applied to the above-mentioned refrigerators 1 or 2. For example, the determination unit 71 may perform the determination in step S23 after the above-mentioned step S04 or S3 in refrigerator 1, or after step S13 in refrigerator 2.

[0083] [Embodiment 5] Other embodiments of the present invention are described below.

[0084] The refrigerator according to this embodiment has substantially the same configuration as the above-described refrigerator 3. Therefore, in the following description, the refrigerator according to this embodiment will also be referred to as the refrigerator 3.

[0085] FIG. 20(a) is a diagram showing an example of an image captured by the imaging unit 62 in the refrigerator 3 according to this embodiment. FIG. 20(b) is a diagram showing an example of an image captured by the lower imaging unit 63 in the refrigerator 3 according to this embodiment. The refrigerator 3 according to this embodiment includes a light irradiator 15 in addition to the configuration of the refrigerator 3 according to the third embodiment. As shown in FIG. 20(a), the light irradiator 15 is arranged to irradiate the storage area R2 with light from above. Therefore, as shown in FIG. 20(b), the lower imaging unit 63 captures an image of a shadow BS of a stored item B, which is cast by light from the light irradiator 15 on the storage shelf 12 that defines the lower end of the storage area S2. In this embodiment, the determination unit 71 makes a determination using the area of ​​the image of the shadow BS in the image captured by the lower imaging unit 63.

[0086] FIG. 21 is a flowchart showing the process in the refrigerator 3 of this embodiment.

[0087] First, the determination unit 71 acquires images from the imaging unit 62 and the lower imaging unit 63 (S31). Next, the determination unit 71 determines whether or not an image of the air outlet H2 of a predetermined size or more is included in the area of ​​the back wall 10a in the image acquired from the imaging unit 62 (S32). If the image acquired from the imaging unit 62 does not include an image of the air outlet H2 of a predetermined size or more (NO in S32), the determination unit 71 determines whether or not an image of a shadow BS of a stored item B of a predetermined size or more is included in the area of ​​the shelf 12 near the air outlet H2 in the image acquired from the lower imaging unit 63 (S33). If the image acquired from the lower imaging unit 63 includes an image of the shadow of the stored item B of a predetermined size or more (YES in S33), the determination unit 71 determines that the air outlet H2 is blocked (S34).

[0088] On the other hand, if the image acquired from the imaging unit 62 does not include an image of the air outlet H2 of a predetermined size or more (YES in S32), or if the image acquired from the lower imaging unit 63 does not include an image of the shadow of the stored item B of a predetermined size or more (NO in S33), the judgment unit 71 judges that the air outlet H2 is not blocked and terminates the processing.

[0089] In this embodiment, the determination unit 71 may determine whether or not the image acquired from the lower imaging unit 63 includes not only an image of the shadow BS of the stored item B but also an image including the stored item B of a predetermined size or more. The determination unit 71 may also determine whether or not the image includes the stored item B of a predetermined size or more using only the image of the stored item B.

[0090] In the present embodiment, the determination unit 71 may determine whether or not the distance between the air outlet H2 and the stored item B placed in front of the air outlet H2 is a predetermined distance or more from an image of a shadow BS of the stored item B in an image acquired from the lower imaging unit 63. In this case, since the position of the shadow BS of the stored item B changes depending on the light from the light irradiation unit 15 and the height of the stored item B, it is preferable to use a different distance standard for determining that the air outlet H2 is blocked than that of the fourth embodiment.

[0091] In addition, in a refrigerator according to one aspect of the present disclosure, the third or fourth embodiment may be combined with the second embodiment. That is, for example, the determination unit 71 may determine whether the air outlet H1 is blocked or not based on images acquired from the imaging unit 61 and the imaging unit 62. Furthermore, the determination unit 71 may determine whether the air outlet H2 is blocked or not based on images acquired from the imaging unit 62, the imaging unit 61, and the imaging unit 63. Furthermore, the determination unit 71 may determine whether the air outlet H3 is blocked or not based on images acquired from the imaging unit 63, the imaging unit 62, and the imaging unit 64. Furthermore, the determination unit 71 may determine whether the air outlet H4 is blocked or not based on images acquired from the imaging unit 64 and the imaging unit 63.

[0092] That is, in the refrigerator according to the embodiment of the present disclosure, the determination unit 71 may determine whether or not the air outlet H2 is blocked, based on images captured by the imaging unit 62 and the imaging unit 61 or the imaging unit 63. The determination unit 71 may also determine whether or not the air outlet H3 (lower air outlet) is blocked, based on images captured by the imaging units 62 and 63. The determination unit 71 may also determine whether or not the air outlet H1 (upper air outlet) is blocked, based on images captured by the imaging units 62 and 61. In this way, the determination unit 71 can determine whether or not a plurality of air outlets are blocked, based on images captured from a plurality of directions.

[0093] The process in refrigerator 3 according to the present embodiment may be applied to the above-described refrigerators 1 to 3. For example, the determination unit 71 may perform the determination in step S33 after the above-described step S04 or S3 in refrigerator 1, step S13 in refrigerator 2, or step S23 in refrigerator 3 according to the fourth embodiment.

[0094] [Software implementation example] The control blocks of the refrigerators 1 to 3 (particularly, the determination unit 71 and the notification unit 72) may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or may be realized by software.

[0095] In the latter case, the refrigerators 1 to 3 are provided with a computer that executes instructions of a program, which is software that realizes each function. The computer includes, for example, at least one processor (control device) and at least one computer-readable recording medium storing the program. The object of the present invention is achieved by the processor reading the program from the recording medium and executing it in the computer. The processor may be, for example, a CPU (Central Processing Unit). The recording medium may be a "non-transitory tangible medium," such as a ROM (Read Only Memory) or the like, as well as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like. The refrigerator may further include a RAM (Random Access Memory) into which the program is expanded. The program may be supplied to the computer via any transmission medium (such as a communication network or a broadcast wave) capable of transmitting the program. Note that one aspect of the present invention may also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.

[0096] 〔summary〕 A refrigerator according to aspect 1 of the present invention comprises a storage compartment having a storage area for storing items, a door for opening and closing the storage compartment, an air outlet provided on a rear wall of the storage area for blowing cool air into the storage area, an imaging unit provided inside the door at a height equal to or higher than the air outlet for capturing images of the inside of the storage area from the door, and a determination unit for determining the arrangement of items stored in the storage area based on images captured by the imaging unit.

[0097] According to the above configuration, the imaging unit, which is provided inside the door and captures an image of the refrigerator compartment, is provided at a height equal to or higher than the height of the air outlet. The determination unit determines the arrangement of the items stored in the storage area based on the image captured by the imaging unit. The imaging unit can also be used to manage the items stored in the refrigerator. Therefore, a refrigerator that can encourage the user to ensure a circulation path for cool air inside the refrigerator with a simple configuration can be realized.

[0098] A refrigerator according to a second aspect of the present invention is, in the above-mentioned first aspect, preferably, the air outlet has a shape that allows the determination portion to be identified.

[0099] According to the above configuration, the determination unit can identify the air outlet in the image captured by the imaging unit.

[0100] A refrigerator according to a third aspect of the present invention is, in the above-mentioned first or second aspect, preferably further including a predetermined pattern on the rear wall so that the determination portion is identifiable.

[0101] According to the above configuration, the determination section can identify the back wall in the image captured by the imaging section.

[0102] The refrigerator according to Aspect 4 of the present invention, in any one of Aspects 1 to 3 above, preferably further comprises a mirror provided on an upper surface of the storage area and reflecting an image upward from the air outlet to the imaging unit.

[0103] According to the above configuration, the mirror makes it easier to observe the state of the path of cool air from the air outlet.

[0104] A refrigerator according to aspect 5 of the present invention, in any of aspects 1 to 4 above, further comprises a lower imaging unit provided on the inside of the door below the imaging unit and imaging the inside of the storage chamber from the door, wherein the storage chamber is divided into a plurality of storage areas by a plurality of translucent storage shelves on which stored items are placed, and wherein the imaging unit images a storage area of ​​interest which is a storage area including the air outlet, and it is preferable that the lower imaging unit is capable of imaging the storage area of ​​interest from a lower storage area of ​​the storage area which is below the storage area of ​​interest, via the storage shelves.

[0105] According to the above configuration, the refrigerator includes an imaging unit and a lower imaging unit provided below the imaging unit, and captures images of the target storage area including the air outlet from multiple directions. By capturing images from multiple directions, it becomes easier to observe the state of the path of cool air from the air outlet.

[0106] A refrigerator according to aspect 6 of the present invention may be such that, in aspect 5 above, an optical area having optical properties that direct a portion of the light from the storage area of ​​interest that is transmitted through the storage shelf toward the lower imaging unit is provided near the air outlet of the storage shelf that defines the lower end of the storage area of ​​interest.

[0107] According to the above configuration, light from the vicinity of the air outlet is more likely to be directed toward the lower imaging section, which makes it easier for the lower imaging section to observe the state in the vicinity of the air outlet.

[0108] The refrigerator according to aspect 7 of the present invention, in accordance with aspect 5 above, may further include a light irradiation unit that irradiates light from above onto the storage area of ​​interest, and the lower imaging unit may image a shadow cast by the light on the storage shelf that defines the lower end of the storage area of ​​interest.

[0109] According to the above configuration, a shadow is cast on the placement shelf by the light emitted by the light emitting unit. By capturing an image of the shadow by the lower imaging unit, the state in the vicinity of the air outlet can be more easily observed.

[0110] The refrigerator according to aspect 8 of the present invention, in any of aspects 1 to 7 above, may further include a determination unit that determines whether or not at least one of the air outlet and a specified area of ​​the rear wall has been photographed, and a notification unit that notifies a user when the determination unit determines that the air outlet and the specified area of ​​the rear wall have not been photographed.

[0111] According to the above configuration, the determination unit determines whether at least one of the air outlet and the predetermined area of ​​the back wall is captured by the imaging unit. Furthermore, if neither the air outlet nor the predetermined area of ​​the back wall is captured, the notification unit notifies the user. Therefore, it is possible to alert the user when the circulation path of the cool air from the air outlet is blocked.

[0112] The refrigerator according to aspect 9 of the present invention, in any of aspects 5 to 7 above, may further include a determination unit that determines the distance between the air outlet and a stored item placed in front of the air outlet based on images captured by at least one of the imaging unit and the lower imaging unit, and an alarm unit that alerts a user when the determination unit determines that the distance between the air outlet and a stored item placed in front of the air outlet is less than a predetermined distance.

[0113] According to the above configuration, the determination unit determines the distance between the air outlet and the stored items based on images captured from multiple directions. Furthermore, when the determination unit determines that the distance is equal to or less than a predetermined distance, the notification unit notifies the user of the fact. Therefore, the user can be alerted when the circulation path of the cool air from the air outlet is blocked.

[0114] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. The technical scope of the present invention also includes embodiments obtained by appropriately combining the technical means disclosed in the different embodiments. Furthermore, new technical features can be formed by combining the technical means disclosed in the respective embodiments. [Explanation of symbols]

[0115] 1, 2, 3 Refrigerator 10 Refrigerator 10a Back wall 11~13 Storage shelf 11a Mirror 12a Optical area 15 Light irradiation unit 20 Door 61 Imaging unit, upper imaging unit 62 Imaging unit 63 Imaging unit, lower imaging unit 64 Imaging unit 71 Judgment section 72 Notification Department B. Storage items BS shadow H1~H4 outlet R1 storage area, upper storage area R2 Storage area, attention storage area R3 storage area, lower storage area R4 Storage area

Claims

1. a storage chamber having a storage area for storing items; A door for opening and closing the storage chamber; An air outlet provided on a back wall of the storage area for blowing cool air into the storage area; An imaging unit that is provided inside the door at a height equal to or higher than the height of the air outlet and captures an image of the inside of the storage area from the door; a determination unit that determines an arrangement state of items stored in the storage area based on an image captured by the imaging unit.

2. The refrigerator according to claim 1, wherein the air outlet has a shape that allows the determination portion to be identified.

3. The refrigerator according to claim 1 or 2, characterized in that a predetermined pattern is provided on the rear wall so that the determination portion can be identified.

4. The refrigerator according to any one of claims 1 to 3, further comprising a mirror provided on an upper surface of the storage area to reflect an image of the upper side from the air outlet to the imaging unit.

5. A lower imaging unit is provided on the inside of the door below the imaging unit, and captures an image of the inside of the storage chamber from the door. The storage chamber is divided into a plurality of storage areas by a plurality of light-transmitting shelves on which items are placed, The imaging unit images a target storage area that is a storage area including the air outlet, among the storage areas; 5. The refrigerator according to claim 1, wherein the lower imaging unit is capable of imaging the target storage area from a lower storage area that is lower than the target storage area among the storage areas, through the storage shelf.

6. The refrigerator according to claim 5, characterized in that an optical area having optical properties that direct a portion of the light from the storage area of ​​interest that has passed through the storage shelf toward the lower imaging unit is provided near the air outlet of the storage shelf that defines the lower end of the storage area of ​​interest.

7. Further comprising a light irradiation unit that irradiates the target storage area with light from above, The refrigerator according to claim 5, wherein the lower imaging unit images a shadow cast by the light on the storage shelf that defines a lower end of the target storage area.

8. The determination unit determines whether or not at least one of the air outlet and a predetermined area of ​​the back wall is photographed, The refrigerator according to any one of claims 1 to 7, further comprising a notification unit that notifies a user when the determination unit determines that the air outlet and a predetermined area of ​​the rear wall have not been photographed.

9. The determination unit determines a distance between the air outlet and a storage item placed in front of the air outlet based on an image captured by at least one of the imaging unit and the lower imaging unit, The refrigerator according to any one of claims 5 to 7, further comprising an alarm unit that notifies a user when the determination unit determines that the distance between the air outlet and a stored item placed in front of the air outlet is equal to or shorter than a predetermined distance.

Images