Storage and storage systems

Abstract

To provide a storehouse capable of suitably photographing a storage chamber.SOLUTION: A refrigerator 100 includes: a casing 1 provided with a plurality of storage chambers; refrigeration chamber doors 211, 212, an ice-making chamber door 221, an upper stage freezing chamber door 231, a lower stage freezing chamber door 241 and a vegetable chamber door 251, which are associated with the respective storage chambers; a plurality of door sensors for detecting opening / closing of the respective doors; and a camera unit 3 provided on an upper side of the casing 1 so as to photograph a lower side. Each of the doors is overlapped with other prescribed doors in a height direction in a closed state, and the camera unit 3 performs photographing in a state where the door corresponding to one of the plurality of storage chambers is opened, and does not perform photographing in a state where the doors corresponding to two or more of the plurality of storage chambers are opened, alternatively, the image photographed in the state is not displayed on a portable terminal of a user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a reservoir. etc. Regarding. [Background technology]

[0002] As a technology for photographing a storage compartment or the like of a refrigerator with a camera, for example, the technology described in Patent Document 1 is known. That is, Patent Document 1 describes a refrigerator in which the refrigerator compartment, vegetable compartment, ice maker compartment, switchable compartment, and freezer compartment can be photographed in one image using a camera unit when the door is open. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-42626 Summary of the Invention [Problem to be solved by the invention]

[0004] For example, when an image is captured with multiple doors (such as multiple refrigerator doors) at different heights open, the storage compartment corresponding to the lower door of the multiple open doors may be hidden by the upper door as seen from the camera. As such, Patent Document 1 does not take into consideration the specific circumstances when multiple doors are open, and there is room for improvement. [Means for solving the problem]

[0005] The storage facility according to the present disclosure comprises a housing in which a plurality of storage compartments are provided, a plurality of doors corresponding to each of the storage compartments, a plurality of door sensors that detect the opening and closing of each of the doors, and a camera unit that is provided on the upper side of the housing and takes pictures below, wherein each of the doors overlaps with another predetermined door in the vertical direction when closed, and the camera unit takes pictures when the door corresponding to one of the plurality of storage compartments is open, and does not take pictures when the doors corresponding to two or more of the plurality of storage compartments are open, or the image taken in this state is not displayed on the user's mobile device. [Brief explanation of the drawings]

[0006] [Figure 1] FIG. 1 is a front view of a refrigerator according to a first embodiment. [Figure 2] FIG. 1 is a side view of a refrigerator according to a first embodiment. [Figure 3] FIG. 1 is a front view of a refrigerator according to a first embodiment with the left and right refrigerator compartment doors open. [Figure 4] FIG. 1 is a plan view of a refrigerator according to a first embodiment with the left and right refrigerator compartment doors open. [Figure 5] 1 is a perspective view of a camera unit of a refrigerator according to a first embodiment, viewed from diagonally below. FIG. [Figure 6A] FIG. 2 is a front view of the camera unit of the refrigerator according to the first embodiment. [Figure 6B] 6B is a cross-sectional view of the refrigerator according to the first embodiment taken along the line II-II in FIG. 6A. FIG. [Figure 7] 1 is a system configuration diagram of a refrigerator according to a first embodiment. [Figure 8A] FIG. 1 is a schematic side view of a refrigerator according to a first embodiment with all doors closed. [Figure 8B] FIG. 2 is a schematic side view of the refrigerator according to the first embodiment, with both the lower freezer compartment door and the vegetable compartment door fully pulled out. [Figure 8C]FIG. 2 is a schematic side view of the refrigerator according to the first embodiment, in which the lower freezer compartment door is fully pulled out, while the vegetable compartment door is slightly pulled out. [Figure 9] 3 is an explanatory diagram showing the correspondence between the detection result of the door sensor in the refrigerator according to the first embodiment and the display content of the mobile terminal. FIG. [Figure 10] 4 is a flowchart of a process executed by a control unit of the refrigerator according to the first embodiment. [Figure 11A] 10 is an example of a photograph taken by a camera unit of a refrigerator according to the first embodiment, in a state where no image processing has been performed. [Figure 11B] 2 is a diagram showing an example of an unfolded image after image processing, which is a result of photography by a camera unit of the refrigerator according to the first embodiment. [Figure 12] FIG. 10 is a front view of a refrigerator according to a second embodiment. [Figure 13] 10 is a flowchart of a process executed by a control unit of a refrigerator according to a second embodiment. [Figure 14] FIG. 10 is a schematic cross-sectional view of a refrigerator according to a third embodiment. [Figure 15] FIG. 10 is a perspective view of a camera unit of a refrigerator according to a first modified example, viewed from diagonally below. [Figure 16] FIG. 10 is an explanatory diagram schematically illustrating a laser emitted from a distance measuring sensor in the refrigerator according to the first modified example. [Figure 17] FIG. 10 is a schematic diagram showing a state in which distance measuring sensors are installed one by one in correspondence with each of the drawer-type doors in a refrigerator according to a second modified example. [Figure 18] FIG. 11 is a perspective view of a camera unit of a refrigerator according to a third modified example, viewed from diagonally below. [Figure 19] FIG. 11 is an explanatory diagram schematically showing the field of view of a range image sensor in a refrigerator according to a third modified example. DETAILED DESCRIPTION OF THE INVENTION

[0007] First Embodiment FIG. 1 is a front view of a refrigerator 100 according to the first embodiment. Refrigerator 100 (storage compartment) shown in FIG. 1 is a device for storing food and the like at low temperatures, and includes a housing 1, refrigerator compartment doors 211, 212, and other doors, and a camera unit 3. Housing 1 is configured with an outer box 11 made of steel plate and an inner box 12 (see FIG. 3) made of resin, between which an insulating material (not shown) such as vacuum insulation material or urethane foam is filled. Housing 1 also has multiple storage compartments. In the example of FIG. 1, the multiple storage compartments include, from top to bottom, refrigerator compartment 21, ice making compartment 22 and upper freezer compartment 23 lined up on the left and right, lower freezer compartment 24, and vegetable compartment 25.

[0008] Refrigerator 100 also has multiple doors associated with the respective storage compartments, including refrigerator compartment doors 211 and 212, ice-making compartment door 221, upper freezer compartment door 231, lower freezer compartment door 241, and vegetable compartment door 251. Refrigerator compartment doors 211 and 212 are a pair of left and right French-style doors that form refrigerator compartment 21 by closing opening 10 (see FIG. 2) on the front side of housing 1. Left refrigerator compartment door 211 is rotatable about the axis of hinge 211a (see FIG. 4) at the left end. The same applies to right refrigerator compartment door 212.

[0009] The remaining doors, ice compartment door 221, upper freezer compartment door 231, lower freezer compartment door 241, and vegetable compartment door 251, are all drawer-type doors. These drawer-type doors are lower in height than refrigerator compartment doors 211, 212. In other words, refrigerator compartment doors 211, 212, which are French-style doors, are higher in height than the multiple drawer-type doors.

[0010] A vegetable compartment container 252 (see FIG. 8B) is installed behind (at the back of) the vegetable compartment door 251. The vegetable compartment door 251 and the vegetable compartment container 252 are designed to be pulled out together (the same applies to other drawer-type doors). Note that the "storage compartment" corresponding to a drawer-type door is the internal space of the container that is pulled out together with the drawer-type door. For example, the vegetable compartment 25 is the internal space of the vegetable compartment container 252 (see FIG. 8B) that is pulled out together with the vegetable compartment door 251.

[0011] Although not shown, refrigerator 100 includes a compressor, a radiator (condenser), a capillary tube (throttle mechanism), and a cooler (evaporator). A refrigerant circulates through the compressor, radiator, capillary tube, and cooler in this order, and the air in each storage compartment is cooled by heat exchange with the refrigerant flowing through the cooler. Camera unit 3 shown in Fig. 1 is provided on the upper side of housing 1 and photographs the storage compartment when a predetermined door is opened.

[0012] FIG. 2 is a side view of the refrigerator 100. As shown in Fig. 2, camera unit 3 includes a main body 31 and a support 32. Main body 31 has a function of capturing an image of a storage compartment or the like when a predetermined door of refrigerator 100 is opened. Support 32 supports main body 31 and is installed on the top surface of housing 1.

[0013] A lens 31a is provided near the front end of the main body 31. The lens 31a is an optical element that refracts light and focuses it on the image sensor 31d (see FIG. 6B). For example, a fisheye lens is used as this lens 31a. The lens 31a faces downward so that it can capture an image of the storage compartment when a specific door of the refrigerator 100 is opened. The camera unit 3 is configured to capture an image of the downward direction. Note that the term "capturing an image of the downward direction" includes cases where the optical axis of the lens 31a is vertical, as well as cases where the optical axis is inclined at a specific angle from the vertical direction.

[0014] As shown in Fig. 2, lens 31a is located forward of the front end of housing 1 (opening 10 of housing 1). More preferably, lens 31a is located further forward than the front surface of refrigerator compartment doors 211, 212 (see Fig. 1) in the closed state. This makes it easier for lens 31a to see refrigerator compartment 21 (see Fig. 1), for example, when refrigerator compartment doors 211, 212 are opened. Also, makes it easier for lens 31a to see vegetable compartment 25 (see Fig. 1), for example, when vegetable compartment door 251 is pulled out.

[0015] 2 is a device for transmitting image data captured by the camera unit 3 to a server 63 (see FIG. 7). In the example of FIG. 2, the wireless LAN unit 4 is installed near the rear end of the top surface of the housing 1.

[0016] FIG. 3 is a front view of the refrigerator 100 with the left and right refrigerator compartment doors 211, 212 open. As shown in Fig. 3, refrigerator compartment 21 is provided with a plurality of shelves 213 that divides refrigerator compartment 21 into predetermined sections. An inner panel 211b of left refrigerator compartment door 211 is provided with a plurality of door pockets 211c for storing food and the like (similar to right refrigerator compartment door 212). When, for example, left and right refrigerator compartment doors 211, 212 are opened, refrigerator compartment 21 and food and the like in door pockets 211c, 212c come into the field of view of lens 31a of camera unit 3 in a bird's-eye view.

[0017] Furthermore, each of the left and right refrigerator compartment doors 211, 212 is provided with a photography button 7 that is pressed by the user when manually photographing the storage compartment using the camera unit 3. In the example of Fig. 3, the photography button 7 is provided on the left refrigerator compartment door 211 at the bottom of the surface opposite the axis of hinge 211a (see Fig. 4) of this refrigerator compartment door 211. The photography button 7 is also provided in a similar position on the right refrigerator compartment door 212.

[0018] FIG. 4 is a plan view of the refrigerator 100 with the left and right refrigerator compartment doors 211, 212 open. As shown in Fig. 4, hinges 211a and 212a are provided on the top surface of housing 1. Hinge 211a on the left side pivotally supports refrigerator compartment door 211 so that it can rotate freely (the same applies to hinge 212a on the right side). Main body 31 of camera unit 3 extends in an elongated shape in the front-to-rear direction. The position of main body 31 in the left-to-right direction may be directly above the joint between refrigerator compartment doors 211 and 212 (see Fig. 1), or may be in another predetermined position.

[0019] FIG. 5 is a perspective view of the camera unit 3 when viewed from diagonally below. The main body 31 of the camera unit 3 includes the lens 31a, a case 31b, and a cover 31c. The case 31b has a rectangular parallelepiped shape that is elongated in the front-to-rear direction. A circular hole (not shown) is provided on the underside near the front end of the case 31b, and the lens 31a is exposed through this hole.

[0020] Case 31b has a long, narrow hole (no reference symbol is shown) in the left-right direction on the rear side of lens 31a, and cover 31c is fitted into this hole. Cover 31c is a translucent resin member that protects camera LED 31f (see FIG. 6B) and diffuses light from camera LED 31f.

[0021] FIG. 6A is a front view of the camera unit 3. FIG. 6A, the main body 31 of the camera unit 3 is placed above the support part 32. The main body 31 is placed near the center of the support part 32 in the left-right direction.

[0022] FIG. 6B is a cross-sectional view taken along line II-II in FIG. 6A. The main body 31 of the camera unit 3 includes the lens 31a, case 31b, and cover 31c, as well as an image sensor 31d, an LED board 31e, a camera LED 31f, a buzzer 31g, and a camera control board 31h. The image sensor 31d is a device that photoelectrically converts light incident through the lens 31a to generate captured image data. For example, a CCD sensor (Charge Coupled Device) or a CMOS sensor (Complementary Metal Oxide Semiconductor) is used as the image sensor 31d.

[0023] The LED board 31e is a board on which the camera LED 31f and the buzzer 31g are mounted. The camera LED 31f is a light source that lights up when the camera unit 3 is taking a picture. This allows, for example, when the vegetable compartment door 251 (see FIG. 1) is opened, the vegetable compartment 25 (see FIG. 1) to be photographed with appropriate brightness. The buzzer 31g emits a predetermined sound when the camera unit 3 is taking a picture. The camera control board 31h is a board on which the camera microcomputer 311h is mounted, and is mounted at the rear of the case 31b.

[0024] FIG. 7 is a system configuration diagram of the refrigerator 100. 7, the refrigerator 100 includes a camera unit 3, a wireless LAN unit 4, a door sensor 5, a control panel 6, a shooting button 7, and a control unit 8. The camera unit 3 includes the lens 31a, image sensor 31d, camera LED 31f, and buzzer 31g, as well as a camera / communication control SoC 31k.

[0025] The camera / communication control SoC 31k is an integrated circuit that integrates circuits having microcomputer functions and other applied functions on a single chip and is designed to function in cooperation with each other. The camera / communication control SoC 31k communicates with the control unit 8 in a predetermined manner and outputs a shooting command to the image sensor 31d. As a result, captured image data is input from the image sensor 31d to the camera / communication control SoC 31k.

[0026] The wireless LAN unit 4 is a device that transmits and receives data to and from the server 63 via the network 62 or the like. The wireless LAN unit 4 transmits captured image data acquired by the camera / communication control SoC 31k to the router 61. The router 61 is a communication relay device that transmits captured image data received from the wireless LAN unit 4 to the server 63 via the network 62. The server 63 performs predetermined processing on the captured image data and stores the data in association with the identification information of the refrigerator 100. When the server 63 receives a request signal for an image of the interior of the refrigerator 100 from a mobile terminal 64 that has been paired via the control panel 6, the server 63 transmits the captured image data to the mobile terminal 64. Examples of such mobile terminals 64 that can be used are mobile phones, smartphones, tablets, and wearable devices.

[0027] The door sensor 5 is a sensor that detects the opening and closing of each door of the refrigerator 100. Although one door sensor 5 is shown in FIG. 7, in reality, at least one door sensor 5 is provided for each door. A predetermined signal indicating the opening and closing state of the door is output from the door sensor 5 to the control unit 8. Control panel 6 displays the status of refrigerator 100 and accepts operations such as changing settings, and is provided, for example, on the surface of refrigerator compartment doors 211, 212 (see FIG. 1). As described above, photographing button 7 (see also FIG. 3) is a button that is pressed by the user when manually photographing using camera unit 3.

[0028] The control unit 8 is, for example, a microcomputer, and although not shown, is configured to include electronic circuits such as a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), and various interfaces. The control unit 8 reads out a program stored in the ROM and loads it into the RAM, and the CPU executes various processes. The processes performed by the control unit 8 will be described later.

[0029] FIG. 8A is a schematic side view of the refrigerator 100 with all doors closed. As shown in Fig. 8A, refrigerator 100 is provided with a plurality of door sensors 5, including door sensor 52 on right-side refrigerator compartment door 212 (see Fig. 1), door sensor 53 on upper freezer compartment door 231, door sensor 54 on lower freezer compartment door 241, and door sensor 55 on vegetable compartment door 251. In addition, although not shown in Fig. 8A, door sensors 5 are also provided on left-side refrigerator compartment door 211 (see Fig. 1) and ice-making compartment door 221 (see Fig. 1).

[0030] For example, door sensor 52 of right-side refrigerator compartment door 211 includes magnet 52a embedded in refrigerator compartment door 212 and Hall element 52b provided in a position facing magnet 52a on housing 1. A predetermined signal corresponding to the open / closed state of refrigerator compartment door 212 is output from Hall element 52b to control unit 8 (see FIG. 7). The remaining door sensors 5 have a similar configuration.

[0031] As shown in Fig. 8A, each door of refrigerator 100 overlaps with another predetermined door in the height direction when closed. To be more specific, for example, right-side refrigerator compartment door 212 (see also Fig. 1) overlaps in the height direction with upper freezer compartment door 231, lower freezer compartment door 241, and vegetable compartment door 251 when closed. Also, for example, vegetable compartment door 251 overlaps in the height direction with ice making compartment door 221 (see Fig. 1), upper freezer compartment door 231, and lower freezer compartment door 241 in the closed state in addition to left and right refrigerator compartment doors 211, 212 (see Fig. 1).

[0032] FIG. 8B is a schematic side view showing a state in which both the lower freezer compartment door 241 and the vegetable compartment door 251 are fully pulled out. As described above, the drawer-type lower freezer door 241 and vegetable compartment door 251 overlap in the height direction when closed (see FIG. 1). Therefore, as shown in FIG. 8B, when both lower freezer door 241 and vegetable compartment door 251 are fully pulled out, it is possible to photograph lower freezer container 242 from the perspective of camera unit 3, but vegetable compartment container 252 is hidden by lower freezer container 242.

[0033] FIG. 8C is a schematic side view showing a state in which lower freezer compartment door 241 is fully pulled out, while vegetable compartment door 251 is pulled out only slightly. For example, the door sensor 55 of the vegetable compartment door 251 outputs an open signal to the control unit 8 (see FIG. 7) even when the vegetable compartment door 251 is only slightly open (the same applies to the remaining door sensors 5). Then, for example, if a specific door remains open for a specific period of time, a buzzer 31g (see FIG. 7) sounds. This prevents the user from forgetting to close the door and suppresses a decrease in cooling capacity and an increase in power consumption due to cool air leaking.

[0034] Therefore, for example, even when the drawer-type vegetable compartment door 251 is fully pulled out (see FIG. 8B), or even when the vegetable compartment door 251 is pulled out only a little (see FIG. 8C), a predetermined open signal is output from the door sensor 55 to the control unit 8 (see FIG. 7) without any particular distinction being made between the two. In this case, for example, when open signals are input from the door sensors 5 of the lower freezer compartment door 241 and the vegetable compartment door 251, the control unit 8 cannot determine the degree to which each door is open, making it difficult to determine whether it is the lower freezer compartment 24 (see FIG. 8B) or the vegetable compartment 25 (see FIG. 8C) that is in the field of view of the camera unit 3.

[0035] On the other hand, in consideration of user convenience, when a captured image is displayed on the mobile terminal 64 (see FIG. 7), it is desirable to indicate which storage compartment the captured image belongs to. Therefore, in the first embodiment, the camera unit 3 is configured to capture an image when a door corresponding to one storage compartment is opened. Furthermore, when doors corresponding to two or more storage compartments are open, the camera unit 3 is configured not to capture an image. This allows the control unit 8 (see FIG. 7) to appropriately identify the storage compartment that appears in the captured image by the camera unit 3.

[0036] FIG. 9 is an explanatory diagram showing the correspondence between the detection results of the door sensor and the display contents of the mobile terminal (see also FIG. 1 as appropriate). In FIG. 9, "R" indicates refrigerator compartment 21, "F" indicates lower freezer compartment 24, and "V" indicates vegetable compartment 25. In FIG. 9, "○" corresponds to the case where an open signal is output from a predetermined door sensor 5 (see FIG. 7). In FIG. 9, "○" in refrigerator compartment 21 (i.e., "R") corresponds to the case where at least one of left and right refrigerator compartment doors 211, 212 is open. In FIG. 9, "×" corresponds to the case where a close signal is output from a predetermined door sensor (see FIG. 7). In FIG. 9, "Mobile terminal display content" indicates the display content of mobile terminal 64 (see FIG. 7) in the state of door sensor 5 of each of "R", "F", and "V". Although omitted in FIG. 9, it is assumed that ice-making compartment door 221 and upper freezer compartment door 231 are all closed.

[0037] For example, when vegetable compartment door 251 is open and the remaining doors are closed, it can be said that the door corresponding to "one storage compartment" is open. In such a case, control unit 8 (see FIG. 7) takes an image and associates vegetable compartment 25 with the captured image ("V" in "Mobile device display content" in FIG. 9). Also, when lower freezer compartment door 241 is open and the remaining doors are closed, control unit 8 (see FIG. 7) associates the captured image with lower freezer compartment 24 ("F" in "Mobile device display content" in FIG. 9).

[0038] In this way, camera unit 3 takes an image with the door corresponding to one of the multiple storage compartments open. Then, when an image is taken by camera unit 3, control unit 8 (see FIG. 7) causes the captured image based on this image to be displayed on mobile terminal 64 (see FIG. 7) in a state associated with one storage compartment. This allows control unit 8 to determine which storage compartment door is open (i.e., which storage compartment has been photographed) based on the detection result of door sensor 5.

[0039] Furthermore, for example, when the lower freezer door 241 and the vegetable compartment door 251 are open, the control unit 8 (see FIG. 7) prevents the camera unit 3 from taking an image. As a result, the captured image in this case is not displayed on the mobile terminal 64 ("No display" in "Mobile terminal display content" in FIG. 9). Furthermore, when at least one of the refrigerator compartment doors 211, 212 is open and the vegetable compartment door 251 is also open, the control unit 8 (see FIG. 7) prevents the camera unit 3 from taking an image.

[0040] In this way, the camera unit 3 does not take an image when the doors corresponding to two or more of the multiple storage compartments are open. This prevents errors from occurring in associating the captured image with the storage compartment. Note that even when an image is taken with the doors corresponding to two or more storage compartments open, the captured image in this state may not be displayed on the user's mobile terminal 64. Specifically, the control unit 8 may discard the captured image or prohibit transmission of the captured image to the server 63 (see FIG. 7).

[0041] Furthermore, when multiple drawer doors that overlap in the height direction in the closed state are open, camera unit 3 may not take an image, or an image taken in this state may not be displayed on user's mobile terminal 64. This prevents, for example, an image taken when lower freezer door 241 is fully open and vegetable compartment door 251 is slightly open (see FIG. 8C) from being displayed on mobile terminal 64 as an image taken of vegetable compartment 25.

[0042] Although omitted in Figure 9, for example, when at least one of the left and right refrigerator compartment doors 211, 212 is open and the remaining doors are closed, the camera unit 3 also takes an image, and the image taken at that time is associated with the refrigerator compartment 21. Also, for example, it is preferable that camera unit 3 takes a photograph when both ice making compartment door 221 and upper freezer compartment door 231 are pulled out. In other words, it is preferable that the multiple doors include at least one pair of doors that do not overlap in the height direction when closed, and that camera unit take a photograph even when at least this pair of doors is open. This is because ice making compartment door 221 and upper freezer compartment door 231 do not overlap in the height direction, so there is no risk of an error in associating the photographed image with the storage compartment.

[0043] FIG. 10 is a flowchart of the process executed by the control unit of the refrigerator (see FIG. 7 as appropriate). At the time of "START" in FIG. 10, all doors of the refrigerator 100 may be in a closed state, or a predetermined door may be in an open state. In step S101, the control unit 8 determines whether or not an open signal has been input from the door sensor 5. That is, the control unit 8 determines whether or not at least one of the multiple doors of the refrigerator 100 has been opened. In step S101, if an open signal has not been input from the door sensor 5 (S101: No), the control unit 8 repeats the process of step S101. In addition, in step S101, if an open signal has been input from the door sensor 5 (S101: Yes), the process of the control unit 8 proceeds to step S102.

[0044] In step S102, control unit 8 turns on camera LED 31c. By turning on camera LED 31c in this way, light is more likely to be irradiated onto the specified storage compartment when photography is subsequently performed (S107). Also, although not shown in Figure 10, when at least one of refrigerator compartment doors 211, 212 (see Figure 1) is opened, the interior light (not shown) of refrigerator compartment 21 is also turned on.

[0045] Next, in step S103, the control unit 8 determines whether a predetermined time (for example, several seconds) has passed since the open signal was input from the door sensor 5. This predetermined time is set based on the average time it takes for the door of the refrigerator 100 to be fully opened. In step S103, if the predetermined time has not passed since the open signal was input from the door sensor 5 (S103: No), the control unit 8 repeats the process of step S103. On the other hand, if the predetermined time has passed since the open signal was input from the door sensor 5 (S103: Yes), the process of the control unit 8 proceeds to step S104.

[0046] In step S104, the control unit 8 determines whether a door corresponding to one storage compartment is open. Note that, as with the left and right refrigerator compartment doors 211, 212 (see FIG. 1), two doors may be associated with one storage compartment. In step S104, if the open door does not correspond to one storage compartment (S104: No), the control unit 8 ends the series of processes without capturing an image ("END" in FIG. 9B). In other words, the control unit 8 does not capture an image when doors corresponding to two or more storage compartments are open. This prevents erroneous recognition of the storage compartment corresponding to the captured image. Furthermore, if a door corresponding to one storage compartment is opened in step S104 (S104: Yes), the control unit 8 proceeds to step S105.

[0047] In step S105, the control unit 8 sounds the buzzer 31g. Sounding the buzzer 31g in this way allows the user to know that the camera unit 3 is about to take a picture. Next, in step S106, the control unit 8 performs exposure adjustment. That is, the control unit 8 adjusts the gain (sensitivity to brightness) when amplifying the electrical signal from the image sensor 31d (see FIG. 7), as well as adjusting the shutter speed, etc. For example, the control unit 8 adjusts the gain so that the average luminance value of the captured image data falls within a predetermined range. By performing exposure adjustment in this manner, it is possible to suppress blown-out highlights (halation) and crushed shadows in the captured image.

[0048] Next, in step S107, the control unit 8 outputs a shooting command. That is, the control unit 8 captures, as photographed image data, an electrical signal output from the image sensor 31d (see FIG. 7) by photoelectric conversion and further amplified by a predetermined gain. In this way, since the image is captured with the door corresponding to one storage compartment open, the storage compartment can be appropriately associated with the captured image. Note that the correspondence between each door sensor 5 and storage compartment is assumed to be stored in advance.

[0049] In step S108, the control unit 8 determines whether or not a close signal has been input from each door sensor 5. That is, the control unit 8 determines whether or not all of the doors of the refrigerator 100 are closed. In step S108, if there is at least one door sensor 5 that has received an open signal (S108: No), the control unit 8 proceeds to step S109.

[0050] In step S109, the control unit 8 determines whether or not a predetermined time has passed since the most recent image capture. This predetermined time is a cycle (for example, several seconds, 10 seconds, or several tens of seconds) when the control unit 8 repeats image capture, and is set in advance. If the predetermined time has not passed since the most recent image capture in step S109 (S109: No), the control unit 8 repeats the process of step S109. On the other hand, if the predetermined time has passed since the most recent image capture (S109: Yes), the process of the control unit 8 returns to step S106.

[0051] Furthermore, if a close signal is input from each door sensor 5 in step S108 (S108: Yes), the control unit 8 proceeds to the process of step S110. In step S110, the control unit 8 turns off the camera LED 31c. When both refrigerator compartment doors 211, 212 are closed, the control unit 8 also turns off the interior light (not shown) in addition to the camera LED 31c. In step S111, the control unit 8 selects a photographing result. For example, the control unit 8 selects the most recent photographing result from among the plurality of photographing results stored as the photographing result to be transmitted to the server 63.

[0052] In step S112, the control unit 8 transmits the photographed result to the server 63. As a result, the photographed image data is transmitted to the server 63 via the wireless LAN unit 4, the router 61, and the network 62 shown in FIG. 7 in this order. When the control unit 8 transmits the photographed result to the server 63, it may transmit to the server 63 identification information of the storage room corresponding to the photographed image (or the door sensor 5 that output the open signal). This is because the area (range of pixels) in which the storage room appears on the photographed image differs depending on which of the multiple doors is open. After performing the process of step S111, the control unit 8 ends the series of processes (END).

[0053] FIG. 11A shows an example of the result of shooting with the camera unit, without image processing. Note that in FIG. 11A, the top of the page is the front and the bottom is the rear, so the left and right are reversed compared to FIG. 3 and the like. In the example of FIG. 11A, image capture is performed with crisper door 251 open and the remaining doors closed. As described above, a fisheye lens is used as lens 31a of camera unit 3 (see FIG. 5), allowing image capture over a wide angle of view. However, without image processing, as shown in FIG. 11A, ridgelines that are actually straight appear curved in the captured image, and even for ridgelines of the same length, the number of pixels in the captured image decreases the farther they are from camera unit 3.

[0054] FIG. 11B is an example of a developed image obtained by the camera unit after image processing. Predetermined image processing is performed by server 63 (see FIG. 7), converting the image into an expanded image of vegetable compartment 25 (inside vegetable compartment container 252) as viewed from above, as shown in FIG. 11B. This expanded image is displayed on mobile terminal 64 (see FIG. 7), allowing the user to see at a glance what foods are stored in vegetable compartment 25. Although not specifically shown in FIG. 11B, predetermined characters or a picture indicating that it is a "vegetable compartment" may be associated with the captured image and displayed on mobile terminal 64. This makes it easier for the user to understand that the captured image is of vegetable compartment 25.

[0055] According to the first embodiment, the camera unit 3 takes an image when one of the multiple doors of the refrigerator 100 corresponding to one storage compartment is open. This allows the captured image to be properly associated with the storage compartment. Furthermore, the camera unit 3 is configured not to take an image when two or more doors corresponding to two or more storage compartments are open. This prevents errors from occurring in the association of the captured image with the storage compartment.

[0056] Furthermore, according to the first embodiment, when one of the multiple doors is opened, an image is captured and displayed on the mobile terminal 64 in association with the storage compartment. This allows a user looking at the mobile terminal 64 to know at a glance what is stored in which storage compartment of the refrigerator 100, thereby improving convenience for the user. Furthermore, because the control unit 8 determines whether or not to capture an image based on the detection result of the door sensor 5, association of the captured image with the storage compartment can be performed by a relatively simple process.

[0057] Second Embodiment The second embodiment differs from the first embodiment in that a piece of paper P1 (see FIG. 12) on which a predetermined note has been written is attached to the refrigerator compartment door 211 with a magnet M1 (see FIG. 12), and photographs are taken by the camera unit 3 with each door closed. The second embodiment also differs from the first embodiment in that a pressure-sensitive display 9 (see FIG. 12) is installed on the refrigerator compartment door 211. Note that the configuration of the camera unit 3 (see FIGS. 5, 6A, and 6B) and the processing of the control unit 8 when at least one door is opened (see FIG. 10) are the same as those in the first embodiment. Therefore, only the parts that are different from the first embodiment will be described, and a description of the overlapping parts will be omitted.

[0058] FIG. 12 is a front view of a refrigerator 100A according to the second embodiment. As shown in Fig. 12, a pressure-sensitive display 9 is provided on refrigerator compartment door 211 of refrigerator 100A. Pressure-sensitive display 9 not only displays setting information for refrigerator 100A, but also has a function of accepting operations by a user using a pen-type device (not shown). For example, a memo pad using a pressure-sensitive plastic liquid crystal display is used as such a pressure-sensitive display 9. The user can then write notes and the like by hand on pressure-sensitive display 9 using the pen-type device (not shown).

[0059] Of the multiple doors shown in Fig. 12, at least refrigerator compartment doors 211, 212 are made of steel plate so that a magnetic attractive force is generated between them and magnet M1. Note that the surfaces of refrigerator compartment doors 211, 212 may be subjected to a predetermined surface treatment. In the example of Fig. 12, a piece of paper P1 with the words "yogurt, milk, pudding" written by hand is attached to the left refrigerator compartment door 211 with two magnets M1, M1. This note is, for example, a list of foods that a user at home would like another user to buy for them.

[0060] The user may write the predetermined memo on paper P1 and attach it with a magnet M1, or may use a pen-type device (not shown) to write it on the pressure-sensitive display 9. Also, the refrigerator compartment doors 211 and 212 each have a shooting button that is pressed when taking a manual photograph. Nga For example, when the user presses the photograph button with each door of the refrigerator 100 closed, N Pressing the button causes the camera unit 3 to take a picture of the paper P1 or the pressure-sensitive display 9. Note that the user can also cause the camera unit 3 to take a picture by operating the mobile terminal 64 (see FIG. 7) in a predetermined manner.

[0061] Furthermore, a predetermined mark K1 is provided on the refrigerator compartment door 211 to indicate a recommended position for attaching paper P1 or a thin plate (not shown) for notes to the surface of the refrigerator compartment door 211 using the magnet M1. An example of the thin plate (not shown) for notes is a whiteboard. In the example of FIG. 12, an inverted L-shaped mark K1 is provided on the refrigerator compartment door 211 near the upper left corner when viewed from the front, but the mark K1 may have another shape such as a "+" shape, and may be provided in another position. Furthermore, the recommended position for attaching paper P1 or a thin plate (not shown) may be described in the instruction manual for the refrigerator 100A.

[0062] The higher the height position of the paper P1 when viewed from the camera unit 3 (i.e., the closer it is to the camera unit 3), the clearer the area of ​​the paper P1 will appear in the captured image. Therefore, a predetermined mark K1 is provided on the surface of the refrigerator compartment door 211, which is higher in height than the other doors. Note that the mark K1 may be provided on the right refrigerator compartment door 212, or the mark K1 may be provided on each of the left and right refrigerator compartment doors 211, 212.

[0063] FIG. 13 is a flowchart of the process executed by the control unit of the refrigerator (also see FIG. 12 as appropriate). It is assumed that pairing between refrigerator 100A and user's mobile terminal 64 (see FIG. 7) has already been set up at the time of "START" in Fig. 13. It is also assumed that the user has written a predetermined note on at least one of paper P1 attached to refrigerator compartment door 211 and pressure-sensitive display 9.

[0064] In step S201, the control unit 8 determines whether or not a shooting operation has been performed. Also The control unit 8 determines whether a predetermined photographing operation has been performed on the mobile terminal 64 (see FIG. 7). If a photographing operation has been performed in step S201 (S201: Yes), the control unit 8 proceeds to step S202. If a photographing operation has not been performed in step S201 (S201: No), the control unit 8 repeats the process of step S201.

[0065] In step S202, the control unit 8 determines whether each door of the refrigerator 100A is closed. That is, the control unit 8 determines whether a close signal is input from the door sensor 5 (see FIG. 7) of each door of the refrigerator 100A. If at least one door is open in step S202 (S202: No), the control unit 8 proceeds to step S203.

[0066] In step S203, the control unit 8 performs a storage room photographing process. Note that the storage room photographing process is similar to the processes in steps S102 to S112 (see FIG. 10) described in the first embodiment, and therefore a description thereof will be omitted. Also, if each door is closed in step S202 (S202: Yes), the process by the control unit 8 proceeds to step S204.

[0067] In step S204, the control unit 8 sounds the buzzer 31g. Sounding the buzzer 31g in this way allows the user to know that the camera unit 3 is about to take a picture. In step S205, the control unit 8 performs exposure adjustment. That is, the control unit 8 adjusts the sensitivity (gain) to brightness and the shutter speed in the camera unit 3.

[0068] In step S206, the control unit 8 outputs a command to take a photograph. As a result, an electric signal amplified by a predetermined gain is taken into the camera unit 3 as photographed image data. In this way, when each of the doors of the refrigerator 100A is closed, pressing the photograph button Also When a predetermined photographing operation is performed on the mobile terminal 64 (see FIG. 7) (S201: Yes), the camera unit 3 takes a photograph (S206). In step S207, the control unit 8 transmits the photographing result to the server 63 (see FIG. 7). After performing the process of step S207, the control unit 8 ends the series of processes (END).

[0069] Note that server 63 (see FIG. 7) may extract text data from a captured image of a state in which memo paper P1 (see FIG. 12) or a thin plate (not shown) is attached to refrigerator compartment door 211 made of steel plate with magnet M1 (see FIG. 12), and display this text data on mobile terminal 64 (see FIG. 7). In this case, server 63 may extract the text data after cutting out the area of ​​paper P1 from the captured image.

[0070] Also, instead of the server 63 (see FIG. 7), the control unit 8 (see FIG. 7) may extract text data from the captured image and display this text data on the mobile terminal 64 (see FIG. 7). This reduces the processing load on the server 63, since the amount of text data is significantly smaller than when the captured image data is sent to the server 63.

[0071] After checking the contents displayed on the portable terminal 64, the user may send the captured image or text data to, for example, another user's portable terminal. For example, the user may write down on a piece of paper P1 (see FIG. 12) or on the pressure-sensitive display 9 (see FIG. 12) what he or she wants a family member to buy, then take a picture of it with the camera unit 3, and send the captured image (or text data) to the family member's portable terminal.

[0072] Also, while the user is talking on the mobile terminal 64, the user may write notes on paper P1, take a picture of the notes with the camera unit 3, and have the captured image (or text data) displayed on the user's mobile terminal 64. Also, the server 63 may read the user's schedule (dates and plans) based on the text data, and then register this content in a predetermined schedule application. The registered content of the schedule application is displayed in a predetermined manner on the user's mobile terminal 64.

[0073] In addition, for example, a child who does not have a mobile device 64 can write a note on a piece of paper P1 and then press the shooting button. N It is also possible to press the button to have the camera unit 3 take a photograph. In this case, the photographed image (or text data) of the child's memo may be displayed on the parent's mobile terminal 64, which has been registered in advance. Furthermore, the user may be able to select whether or not to extract text data from a photographed image of a memo by operating the mobile terminal 64. This increases the degree of freedom in settings related to photography.

[0074] Furthermore, when one of the multiple drawer doors is pulled out, the camera unit 3 may take an image, and the server 63 (see FIG. 7) may extract image data of the area in the captured image showing the storage compartment and the area in which the paper P1 or the pressure-sensitive display 9 is shown. In this case, the server 63 generates an unfolded image of the storage compartment (see FIG. 11B) and also generates a captured image (or text data) of the paper P1, etc. Furthermore, when one of the multiple drawer doors is pulled out, the server 63 (see FIG. 7) may cut out the area in which the paper P1 or the pressure-sensitive display 9 is shown from the captured image data, and then extract the text data.

[0075] According to the second embodiment, the camera unit 3 can capture an image of a note written by a user on paper P1 or pressure-sensitive display 9, and the captured image can be displayed on the user's mobile terminal 64. In addition, the server 63 or the control unit 8 can extract text data from the captured image of the note, and display the text data on the user's mobile terminal 64. This can further improve the convenience of the refrigerator 100A compared to the first embodiment.

[0076] Third Embodiment The third embodiment differs from the first embodiment in that door opening switches 6a and 6b (see FIG. 14) are provided on the control panel 6, and when the user touches the door opening switch 6b, for example, the drawer-type vegetable compartment door 251 (see FIG. 14) is opened by the door opening device 256 (see FIG. 14). Note that other aspects (such as the configuration of the camera unit 3) are the same as those of the first embodiment. Therefore, only the parts that are different from the first embodiment will be described, and a description of the overlapping parts will be omitted.

[0077] FIG. 14 is a schematic cross-sectional view of a refrigerator 100B according to the third embodiment. As shown in Fig. 14, door opening switches 6a and 6b are provided on the control panel 6 of the refrigerator compartment door 212 of the refrigerator 100B. One door opening switch 6a is a switch that is pressed when the door opening device 246 is to open the lower freezer compartment door 241. The other door opening switch 6b is a switch that is pressed when the door opening device 256 is to open the vegetable compartment door 251. Touch panel type switches may be used as these door opening switches 6a and 6b.

[0078] The door opening switches 6a and 6b may be proximity sensors that detect the approach of a human hand, or may be mechanical switches. Although Fig. 14 shows an example in which the door opening switches 6a and 6b are provided on the control panel 6, the door opening switches 6a and 6b may also be provided in other predetermined positions.

[0079] Refrigerator 100B also includes frame 243, connecting member 244, and support member 245 as members that transmit the driving force of door-opening device 246 to lower freezer container 242. Frame 243 is U-shaped (or rectangular frame-shaped) in a plan view, and both ends thereof are fixed to the inner surfaces of lower freezer door 241. Frame 243 is also in close proximity to (or in contact with) the side and back surfaces of lower freezer container 242. Connecting member 244 connects frame 243 and support member 245, and extends in the vertical direction. Support member 245 is provided near door-opening device 246 and extends in the front-rear direction. When door-opening device 246 is driven, support member 245, connecting member 244, and frame 243, as well as lower freezer door 241 and lower freezer container 242, move forward together.

[0080] The refrigerator 100B also includes a door opening device 246. The door opening device 246 is a device that opens the lower freezer compartment door 241 (door) in response to operation of the door opening switch 6a. A motor (not shown) or a solenoid (not shown), for example, is used as a drive source for the door opening device 246. When the door opening switch 6a is operated, the door opening device 246 is driven in a predetermined manner based on a command from the control unit 8 (see FIG. 7).

[0081] Refrigerator 100B also includes a frame 253, a connecting member 254, a support member 255, and a door opening device 256 as components for opening vegetable compartment door 251 in response to operation of door opening switch 6b. These components are similar to the components used to open lower freezer compartment door 241, and therefore description thereof will be omitted. Vegetable compartment door 251 may be opened by actuation of door opening device 256 without the user applying force, or door opening device 256 may assist the user in opening vegetable compartment door 251 (the same applies to opening lower freezer compartment door 241).

[0082] In such a configuration, it is preferable that the camera unit 3 takes a photograph when a predetermined time has elapsed since the door opening switch 6a was operated. Here, when the camera unit 3 takes a photograph, the current flowing through the door opening device 246 is assumed to be equal to or less than a predetermined value. In other words, when the current flowing through the door opening device 246 is greater than the predetermined value, the camera unit 3 does not take a photograph. The aforementioned "predetermined value" is a current threshold that serves as a criterion for determining whether or not the camera unit 3 is permitted to take a photograph, and is set in advance. The same applies when the other door opening device 256 is driven.

[0083] For example, immediately after the door open switch 6a is pressed, a large current often flows through the motor (not shown) of the door opening device 246. Meanwhile, while the camera unit 3 is capturing an image, a large amount of power is consumed by the camera unit 3. Therefore, in the third embodiment, the camera unit 3 is configured to capture an image after the current flowing through the door opening devices 246, 256 has fallen below a predetermined value. In other words, the camera unit 3 is configured to capture an image so as to avoid a time when a large current flows through the door opening devices 246, 256. This not only prevents the momentary power consumption of the refrigerator 100B from exceeding a predetermined upper limit, but also improves the reliability of the refrigerator 100B.

[0084] The third embodiment is also applicable to the case where a door opening device for a French door such as the refrigerator compartment doors 211, 212 is used, in addition to the door opening devices 246, 256 for a drawer door.

[0085] <<Variations>> The refrigerator 100 and the like according to the present disclosure have been described above in accordance with various embodiments, but are not limited to these descriptions and may be modified in various ways. For example, in the first embodiment, a case has been described in which it is determined whether or not the camera unit 3 is capable of capturing images based on the detection result of the door sensor 5, but this is not limiting. That is, as will be described next, it may be determined whether or not the camera unit 3 is capable of capturing images based on the detection result of the distance measurement sensor 33 (see FIG. 15).

[0086] FIG. 15 is a perspective view of camera unit 3C of the refrigerator according to the first modification, viewed from diagonally below. 15 includes a distance measurement sensor 33 in addition to the components described in the first embodiment (see FIG. 5). The distance measurement sensor 33 is a sensor that measures the distance from itself to a predetermined object. As such a distance measurement sensor 33, for example, a LiDAR using laser light, a RADAR using electromagnetic waves, or an ultrasonic distance measurement sensor may be used.

[0087] 15, the distance measurement sensor 33 is disposed between the lens 31a and the cover 31c of the camera unit 3C in the front-rear direction, but the position of the distance measurement sensor 33 can be changed as appropriate. In the following, as an example, a case where the distance measurement sensor 33 is a LiDAR will be described.

[0088] FIG. 16 is an explanatory diagram schematically illustrating a laser emitted from distance measurement sensor 33 in refrigerator 100C according to the first modification. 16, the distance measuring sensor 33 is installed so that its optical axis is tilted diagonally forward at a predetermined angle θ with respect to the vertical direction. This allows the control unit 8 to determine, for example, whether the vegetable compartment door 251 is pulled out based on the detection value of the distance measuring sensor 33 while limiting the length by which the camera unit 3C protrudes forward.

[0089] It is also possible to calculate the drawer length (length relative to the closed state) when each drawer door is pulled out based on the detection value of distance measurement sensor 33. The angle θ of the optical axis of distance measurement sensor 33 is set in advance at the design stage so that control unit 8 can determine whether or not each of upper freezer compartment door 231, lower freezer compartment door 241, and vegetable compartment door 251 is pulled out a predetermined percentage or more of the upper limit of the drawer length (for example, more than half of the upper limit).

[0090] The processing by control unit 8 may be the same as in the first embodiment (see FIG. 10), or the following processing may be performed. That is, when both lower freezer door 241 and vegetable compartment door 251 are fully open, camera unit 3 may take an image and associate the captured image with lower freezer compartment 24. This is because, in this case, lower freezer compartment 24, which is located at a relatively high height when viewed from camera unit 3, is captured in the image. In this way, when multiple drawer-type doors that overlap in the vertical direction in the closed state are opened, control unit 8 may associate the captured image with a specific storage compartment based on the length of each drawer.

[0091] FIG. 17 is a schematic diagram of a refrigerator 100D according to a second modification, in which distance measuring sensors are provided one for each drawer-type door. In the example of FIG. 17 , distance measuring sensors 34, 35, and 36 are provided on the inner surface of the rear panel 1a of the refrigerator housing 1. Distance measuring sensor 34 is a sensor for measuring the drawer length when the upper freezer container 232 is pulled out, and is provided on the rear panel 1a in a position facing the upper freezer container 232. The drawer length is calculated based on the change in the measured value of the distance between the upper freezer container 232 and distance measuring sensor 34 (the change from the closed state). Distance measuring sensor 35 shown in FIG. 17 is provided facing the lower freezer container 242, and another distance measuring sensor 36 is provided facing the vegetable compartment container 252. By providing distance measuring sensors 34, 35, and 36 in this manner, each drawer door can associate a captured image with a specific storage compartment based on the drawer length. Note that the locations of distance measuring sensors 34, 35, and 36 are not limited to the inner surface of the rear panel 1a of the housing 1 and can be changed as appropriate.

[0092] FIG. 18 is a perspective view of a camera unit 3E of a refrigerator according to the third modification, viewed from diagonally below. The camera unit 3E shown in FIG. 18 includes a distance image sensor 37 in addition to the components described in the first embodiment (see FIG. 5). The distance image sensor 37 is a sensor that generates a distance image of a predetermined area. For example, a distance image sensor based on a time-of-flight (TOF) method or a patterned illumination method is used as this distance image sensor 37. In the example of FIG. 18, the distance image sensor 37 is disposed between the lens 31a and cover 31c of the camera unit 3E in the front-rear direction, but the position of the distance image sensor 37 can be changed as appropriate.

[0093] FIG. 19 is an explanatory diagram schematically showing the field of view of the range image sensor in a refrigerator 100E according to the third modified example. As shown in FIG. 19, the distance image sensor 37 is installed in the main body 31 of the camera unit 3E so as to generate a distance image of the lower part. The distance image sensor 37 is also installed so that, when the drawer door is pulled out, the drawer door is within the field of view of the solid angle φ (the measurement area of ​​the distance image). In the example of FIG. 19, when the vegetable compartment door 251 is fully pulled out, the interior of the vegetable compartment container 252 (i.e., the vegetable compartment 25) is within the field of view of the distance image sensor 37. This allows the control unit 8 (see FIG. 7) to calculate how far the vegetable compartment door 251 is pulled out based on the measurement results of the distance image sensor 37, even if the camera unit 3E is not extended forward very far. Therefore, the storage compartment and the captured image can be displayed on the mobile terminal 64 in an appropriate correspondence with each other.

[0094] Furthermore, in the first embodiment, the camera unit 3 does not take images when the doors corresponding to two or more storage compartments are open, but this is not limited to this. That is, the camera unit 3 may take images even when at least one of the multiple drawer-type doors is drawn out and the French-style door is also open. Because the French-style refrigerator compartment doors 211, 212 are relatively high in height, it is possible to capture images of the refrigerator compartment 21 even when the drawer-type doors are open. Note that in the above-described control, the order in which the drawer-type doors and French-style doors are opened is not particularly limited.

[0095] In addition, in each embodiment, the door sensor 5 has been described as including a magnet and a Hall element, but this is not limiting. For example, the door sensor 5 may be a mechanical type. In addition, in each embodiment, the refrigerator 100 has been described as having refrigerator compartment doors 211, 212 as a pair of French doors, but this is not limited thereto. For example, the refrigerator may have multiple pairs of French doors (not shown) that are at different heights when closed. In this case, a drawer door may be provided, or a drawer door may not be provided. Furthermore, a refrigerator (not shown) that is not provided with French doors may be configured to have multiple drawer doors that are at different heights when closed.

[0096] In addition, in each embodiment, the case where the control unit 8 (see FIG. 7) is provided separately from the camera unit 3 has been described, but this is not limiting. For example, the camera unit 3 may be configured to take on at least some of the functions of the control unit 8.

[0097] In addition, in each embodiment, the case where one photographing button 7 is provided at the bottom of each refrigerator compartment door 211, 212 has been described, but the location of the photographing button 7 can be changed as appropriate. For example, a photographing button (not shown) may be provided on a predetermined drawer-type door. In the second embodiment, the mark K1 and the pressure-sensitive display 9 are provided on the refrigerator compartment door 211 of the refrigerator 100A (see FIG. 12), but this is not limiting. That is, one of the mark K1 and the pressure-sensitive display 9 may be omitted.

[0098] Furthermore, when camera unit 3 takes a photograph, the luminous intensity (degree of brightness of the light source) of camera LED 31c may be set higher when the height position of the door in the open state is relatively low than when the height position of the door in the open state is relatively high. For example, control unit 8 may set the luminous intensity of camera LED 31c to be higher when vegetable compartment door 251 is opened than when refrigerator compartment doors 211, 212 are opened. This makes it possible to obtain a clear photographed image under appropriate brightness even when the vertical distance between camera LED 31c and the subject to be photographed is relatively long.

[0099] In addition, in each embodiment, a fisheye lens is used as the lens 31a (see FIG. 7) of the camera unit 3, but this is not limiting. For example, a general lens other than a fisheye lens may be used as the lens 31a of the camera unit 3.

[0100] The refrigerator 100 and the like described in each embodiment are merely examples, and the present invention can be applied to other types of refrigerators. For example, each embodiment can be applied to a refrigerator with a single-wing refrigerator compartment door (not shown) or a portable refrigerator (not shown). Furthermore, the "storage" to which each embodiment can be applied is not limited to a refrigerator. In this case, the housing of the "storage" may be configured so that there is no particular distinction between an outer box and an inner box. Furthermore, each embodiment can also be applied to a freezer or a storage cabinet as a "storage".

[0101] In addition, the programs executed by the control unit 8 (see Figure 7) and the server 63 (see Figure 7) can be provided via a communication line, or can be written to a recording medium such as a CD-ROM and distributed. Furthermore, each embodiment has been described in detail to clearly explain the present invention, and is not necessarily limited to having all of the configurations described. Furthermore, some of the configurations of the embodiments can be added to, deleted from, or replaced with other configurations. Furthermore, the mechanisms and configurations described above are those that are considered necessary for the explanation, and do not necessarily represent all mechanisms and configurations of the product. [Explanation of symbols]

[0102] 1 chassis 3, 3C, 3E camera unit 4 Wireless LAN unit 5,52,53,54,55 Door sensors 6. Control Panel 6a, 6b Door open switch 7. Shooting button 8 Control Unit 9 Pressure-sensitive display 21 Refrigerator (storage room) 22 Ice making room (storage room) 23 Upper freezer compartment (storage compartment) 24 Lower freezer compartment (storage compartment) 25 Vegetable compartment (storage compartment) 33, 34, 35, 36 Distance measurement sensor 37 Range image sensor 61 Router 62 Network 63 servers 64 Mobile Devices 211,212 Refrigerator doors (doors, French doors) 221 Ice maker door (door, pull-out door) 231 Upper freezer door (door, pull-out door) 241 Lower freezer door (door, pull-out door) 251 Vegetable compartment door (door, pull-out door) 246,256 Door opening device 100, 100A, 100B, 100C, 100D, 100E Refrigerator (storage) K1 Mark M1 magnet P1 Paper

Claims

1. a housing in which a plurality of storage compartments are provided; a plurality of doors associated with each of the storage compartments; a plurality of door sensors for detecting the opening and closing of each of the doors; a camera unit provided on the upper side of the housing for capturing images of a downward direction, Each of the doors overlaps with another predetermined door in a height direction when closed, The camera unit includes: taking an image with the door corresponding to one of the plurality of storage compartments open; This storage facility does not take photographs when the doors corresponding to two or more of the storage compartments are open, or prevents images taken in this state from being displayed on the user's mobile terminal.

2. When an image is taken by the camera unit, the image is displayed on the mobile terminal in a state where the image is associated with the one storage room. The storage facility according to claim 1, characterized in that

3. the plurality of doors includes a plurality of retractable doors; The camera unit does not take pictures when the plurality of drawer-type doors that are overlapped in the height direction in the closed state are open, or the image taken in this state is not displayed on the user's mobile terminal. The storage facility according to claim 1, characterized in that

4. The plurality of doors include at least one pair of doors that do not overlap in the height direction when closed, The camera unit is configured to take photographs even when the at least one pair of doors is open. The storage facility according to claim 1, characterized in that

5. the plurality of doors includes a plurality of pull-out doors and French doors; The French door is higher in height than the plurality of pull-out doors; The camera unit can take pictures even when at least one of the plurality of drawer doors is drawn out and the French doors are open. The storage facility according to claim 1, characterized in that

6. The plurality of doors include a door made of steel plate and provided with a shooting button; the photographing button is provided at a position where photographing operation can be performed when each of the plurality of doors is closed, When a predetermined photographing operation is performed on the photographing button or the mobile terminal with each of the plurality of doors closed, the camera unit photographs. The storage facility according to claim 1, characterized in that

7. The plurality of doors include a door provided with a photographing button and a pressure-sensitive display; the photographing button is provided at a position where photographing operation can be performed when each of the plurality of doors is closed, When a predetermined photographing operation is performed on the photographing button or the mobile terminal with each of the plurality of doors closed, the camera unit photographs. The storage facility according to claim 1, characterized in that

8. The device is provided with a control unit that extracts text data from a captured image of a steel door with a piece of paper or thin sheet of memo paper attached to it with a magnet, and displays the text data on the mobile terminal. The storage facility according to claim 6 or claim 7, characterized in that:

9. a door opening switch provided on a predetermined door; a door opening device that opens the door in response to operation of the door opening switch, When a predetermined time has elapsed since the door open switch was operated, the camera unit takes an image. When the camera unit is photographing, the current flowing through the door opening device is below a predetermined value. The storage facility according to claim 1, characterized in that

10. A housing in which a plurality of storage compartments are provided; a plurality of doors associated with each of the storage compartments; a plurality of door sensors for detecting the opening and closing of each of the doors; a camera unit provided on the upper side of the housing for capturing images of a downward direction, Each of the doors overlaps with another predetermined door in a height direction when closed, The camera unit includes: taking an image with the door corresponding to one of the plurality of storage compartments open; A storage system in which photographs are not taken when the doors corresponding to two or more of the storage rooms are open, or images taken in this state are not displayed on the user's mobile terminal.

Images