Storage house

Abstract

To provide a storage house that properly captures images of storage chambers.SOLUTION: A storage house comprises: a housing 1 having a plurality of storage chambers that are opened and closed by doors; an imaging section (camera unit 3) that captures images of the storage chambers; and a timer section 8a that measures elapsed time in response to the opening of any one of the doors from a state in which all of the doors of the storage chambers are closed. Imaging is performed by the imaging section in accordance with the measured elapsed time. The timer section 8a continues the measurement of elapsed time even if other doors are subsequently opened or closed after the timing has started. When imaging is performed based on the measurement of elapsed time, if one door is open, imaging is executed. On the other hand, if multiple doors are open, imaging is not executed.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The present invention relates to a storage device.

Background Art

[0002] As a technique for photographing a storage room or the like of a refrigerator, for example, the technique described in Patent Document 1 is known. That is, in Patent Document 1, when the door of the refrigerator compartment is opened, the position of the camera is confirmed. If the camera is at the first photographing position, it remains as it is. If the camera is at a position other than the first position, it is driven by a motor to move to that position, and at the same time, photographing inside the refrigerator compartment is started by the camera at regular time intervals T1 (for example, 0.2 seconds).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] According to Patent Document 1, the vegetable compartment, the freezer compartment, etc. also have the same operation as when photographing inside the refrigerator compartment. However, due to the opening and closing timings of a plurality of storage rooms, the photographing timing becomes complicated, and there is a possibility that the user may become uneasy as to whether photographing is being performed. Thus, there is room for improvement in order to ensure the photographing timing when a plurality of doors are opened.

Means for Solving the Problems

[0005] The storage device according to the present disclosure includes a housing having a plurality of storage chambers opened and closed by doors, an imaging unit for imaging the storage chambers, and a timing unit for measuring the elapsed time since any one of the doors was opened in response to all the doors of the storage chambers being in a closed state. The imaging unit executes imaging according to the measurement of the elapsed time, and the timing unit continues the measurement as it is even if another door is opened or closed after the start of the measurement.

Brief Description of the Drawings

[0006]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6A

Figure 6B

Figure 7

Figure 8A

Figure 8B

Figure 8C

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13A

Figure 13B

Mode for Carrying Out the Invention

[0007] The mode for carrying out the present invention will be described in detail with appropriate reference to the drawings. FIG. 1 is a front view of a refrigerator 100 according to an embodiment. The refrigerator 100 (storage) shown in FIG. 1 is a device for storing foods and the like at a low temperature, and includes, in addition to a housing 1, each door such as refrigerator doors 211 and 212, and a camera unit 3. The housing 1 has a structure in which a heat insulating material (not shown) such as a vacuum heat insulating material or urethane foam is filled between an outer box 11 made of a steel plate and an inner box 12 made of resin (see FIG. 3). Further, a plurality of storage rooms are provided in the housing 1. In the example of FIG. 1, as a plurality of storage rooms, in order from the top, a refrigerator compartment 21, an ice making compartment 22 and an upper freezer compartment 23 arranged side by side on the left and right, a lower freezer compartment 24, and a vegetable compartment 25 are provided.

[0008] Further, the refrigerator 100 includes, as a plurality of doors associated with each storage room, refrigerator doors 211 and 212, an ice making compartment door 221, an upper freezer compartment door 231, a lower freezer compartment door 241, and a vegetable compartment door 251. The refrigerator doors 211 and 212 are a pair of French doors on the left and right that form the refrigerator compartment 21 by closing the opening 10 (see FIG. 2) on the front side of the housing 1. The left refrigerator door 211 is rotatable about the axis of the hinge 211a at the left end (see FIG. 4). The same applies to the right refrigerator door 212.

[0009] The remaining doors, namely the ice-making chamber door 221, the upper freezer door 231, the lower freezer door 241, and the vegetable compartment door 251, are each drawer-type doors. These drawer-type doors are positioned lower in height than the refrigerator doors 211, 212. In other words, the refrigerator doors 211, 212, which are French doors, are positioned higher in height than the plurality of drawer-type doors (the refrigerator doors 211, 212 are closer to the camera unit 3 and the camera LED 31f than the drawer-type doors).

[0010] A vegetable compartment container 252 (see FIG. 8B) is installed on the rear side (inner side) of the vegetable compartment door 251. The vegetable compartment door 251 and the vegetable compartment container 252 are integrally pulled out (the same applies to the other drawer-type doors). Note that the "storage compartment" corresponding to the drawer-type door shall be the internal space of the container that is integrally pulled out with the drawer-type door. For example, the vegetable compartment 25 is the internal space of the vegetable compartment container 252 (see FIG. 8B) that is integrally pulled out with the vegetable compartment door 251.

[0011] Although not shown in the figure, the refrigerator 100 includes a compressor, a radiator (condenser), a capillary tube (throttling mechanism), and a cooler (evaporator). The refrigerant circulates sequentially through the compressor, the radiator, the capillary tube, and the cooler, and the air in each storage compartment is cooled by heat exchange with the refrigerant flowing through the cooler. The camera unit 3 shown in FIG. 1 is for photographing the storage compartment when a predetermined door is opened, and is provided on the upper side of the housing 1.

[0012] FIG. 2 is a side view of the refrigerator 100 according to the embodiment. As shown in FIG. 2, the camera unit 3 includes a main body portion 31 and a support portion 32. The main body portion 31 has a function of photographing the storage compartment and the like when a predetermined door of the refrigerator 100 is opened. The support portion 32 supports the main body portion 31 and is installed on the upper surface of the housing 1.

[0013] Near the front end of the main body 31, a lens 31a is provided. The lens 31a is an optical element that refracts light and focuses it on an image sensor 31d (see FIG. 6B). As such a lens 31a, for example, a fish-eye lens is used. Further, so that the storage compartment can be photographed when a predetermined door of the refrigerator 100 is opened, the lens 31a faces downward. And the camera unit 3 is configured to photograph downward. Note that, in addition to the case where the direction of the optical axis of the lens 31a is the vertical direction, the case where the optical axis is inclined obliquely by a predetermined amount from the vertical direction is also included in the matter of "photographing downward".

[0014] As shown in FIG. 2, the lens 31a is located in front of the front end of the housing 1 (the opening 10 of the housing 1). More preferably, the lens 31a is located further in front of the front surfaces of the closed refrigerator doors 211, 212 (see FIG. 1). Thereby, for example, when the refrigerator doors 211, 212 are opened, the refrigerator compartment 21 (see FIG. 1) easily enters the field of view of the lens 31a. Also, for example, when the vegetable compartment door 251 is pulled out, the vegetable compartment 25 (see FIG. 1) easily enters the field of view of the lens 31a.

[0015] The wireless LAN unit 4 shown in FIG. 2 is a device for transmitting the photographed image data of the camera unit 3 to a server 63 (see FIG. 7). In the example of FIG. 2, the wireless LAN unit 4 is installed near the rear end of the upper surface of the housing 1.

[0016] FIG. 3 is a front view of the refrigerator 100 according to the embodiment with the left and right refrigerator doors 211, 212 opened. As shown in FIG. 3, the refrigerator compartment 21 is provided with a plurality of shelf plates 213 that partition the refrigerator compartment 21 in a predetermined manner. The inner plate 211b of the left refrigerator door 211 is provided with a plurality of door pockets 211c for accommodating food and the like (the same applies to the right refrigerator door 212). And, for example, when the left and right refrigerator doors 211, 212 are opened, the food and the like in the refrigerator compartment 21 and the door pockets 211c, 212c are configured to enter the field of view of the lens 31a of the camera unit 3 in an overlooking manner.

[0017] When manually photographing the storage room using the camera unit 3, the photographing buttons 7 pressed by the user are provided one by one on the left and right refrigerator doors 211 and 212. In the example of FIG. 3, on the left refrigerator door 211, the photographing button 7 is provided at the lower part of the surface on the side opposite to the axis of the hinge 211a (see FIG. 4) of this refrigerator door 211. Also, the photographing button 7 is provided at the same position on the right refrigerator door 212.

[0018] FIG. 4 is a plan view of the state in which the left and right refrigerator doors 211 and 212 of the refrigerator 100 according to the embodiment are opened. As shown in FIG. 4, hinges 211a and 212a are provided on the upper surface of the housing 1. The left hinge 211a pivotally supports the refrigerator door 211 rotatably (the same applies to the right hinge 212a). Also, the main body portion 31 of the camera unit 3 extends longitudinally in the front-rear direction. The position of the main body portion 31 in the left-right direction may be directly above the joint of the refrigerator doors 211 and 212 (see FIG. 1), or may be at other predetermined positions.

[0019] FIG. 5 is a perspective view of the camera unit 3 according to the embodiment as viewed from diagonally below. The main body portion 31 of the camera unit 3 includes, in addition to the above-described lens 31a, a case 31b and a cover 31c. The case 31b has a rectangular parallelepiped shape elongated in the front-rear direction. A circular hole (reference numeral not shown) is provided on the lower surface near the front end of the case 31b, and the lens 31a is exposed through this hole.

[0020] In the case 31b, an elongated hole (reference numeral not shown) is provided on the rear side of the lens 31a in the left-right direction, and the cover 31c is fitted into this hole. The cover 31c is a translucent resin member for protecting the camera LED 31f (see FIG. 6B) or diffusing the light from the camera LED 31f.

[0021] FIG. 6A is a front view of the camera unit 3 according to the embodiment. As shown in FIG. 6A, the main body 31 of the camera unit 3 is installed above the support portion 32. Also, in the left - right direction, the main body 31 is installed near the center of the support portion 32.

[0022] FIG. 6B is a cross - sectional view taken along the arrow II - II in FIG. 6A. The main body 31 of the camera unit 3 includes, in addition to the above - mentioned lens 31a, case 31b, and cover 31c, an image sensor 31d, an LED substrate 31e, a camera LED 31f, a buzzer 31g, and a camera control board 31h. The image sensor 31d is an element that photoelectrically converts the light incident through the lens 31a and generates photographed image data. As such an image sensor 31d, for example, a CCD sensor (Charge Coupled Device) or a CMOS sensor (Complementary Metal Oxide Semiconductor) is used.

[0023] The LED substrate 31e is a substrate on which the camera LED 31f and the buzzer 31g are installed. The camera LED 31f is a light source that lights up when the camera unit 3 takes a picture. Thereby, for example, when the vegetable compartment door 251 (see FIG. 1) is opened, the vegetable compartment 25 (see FIG. 1) is photographed under appropriate brightness. The buzzer 31g emits a predetermined sound when the camera unit 3 takes a picture. The camera control board 31h is a board on which the camera microcomputer 311h is mounted and is installed at the rear part of the case 31b.

[0024] FIG. 7 is a system configuration diagram of the refrigerator 100 according to the embodiment. As shown in FIG. 7, the refrigerator 100 includes a camera unit 3, a wireless LAN unit 4, a door sensor 5, a control panel 6, a photographing button 7, and a control unit 8. The camera unit 3 includes, in addition to the above - mentioned lens 31a, image sensor 31d, camera LED 31f, and buzzer 31g, a camera / communication control SoC 31k.

[0025] The camera / communication control SoC 31k is an integrated circuit designed to integrate circuits with the functions of a microcomputer and other application functions on one chip and to function in cooperation. The camera / communication control SoC 31k communicates with the control unit 8 as predetermined and outputs a shooting command to the image sensor 31d. As a result, shooting image data is input from the image sensor 31d to the camera / communication control SoC 31k.

[0026] The wireless LAN unit 4 is a device that transmits and receives data to and from the server 63 via a network 62 or the like. The wireless LAN unit 4 transmits the shooting image data acquired by the camera / communication control SoC 31k to the router 61. The router 61 is a communication relay device and transmits the shooting image data received from the wireless LAN unit 4 to the server 63 via the network 62. The server 63 performs predetermined processing on the shooting image data and stores it in association with the identification information of the refrigerator 100. In addition, when the server 63 receives a request signal for an in-refrigerator image from the mobile terminal 64 for which pairing setting has been performed via the control panel 6, the server 63 transmits the shooting image data to the mobile terminal 64. As such a mobile terminal 64, for example, in addition to a mobile phone and a smartphone, a tablet or a wearable terminal is used.

[0027] The door sensor 5 is a sensor that detects the opening and closing of each door of the refrigerator 100. Although one door sensor 5 is shown in FIG. 7, actually, at least one door sensor 5 is provided for each door. And a predetermined signal indicating the opening and closing state of the door is output from the door sensor 5 to the control unit 8. By providing the door sensor 5 for each door in this way, it is possible to associate the shooting image with the storage room.

[0028] The control unit 8 has a timing unit 8a therein, and the timing unit 8a measures the elapsed time from the time when all the doors of the storage room are closed to the time when any door is opened.

[0029] The control panel 6 displays the state of the refrigerator 100 and accepts operations such as setting changes, etc., and is provided, for example, on the surface of the refrigerator doors 211, 212 (see FIG. 1). The shooting button 7 (also see FIG. 3) is a button that is pressed by the user when manually shooting using the camera unit 3 as described above.

[0030] The control unit 8 is, for example, a microcomputer, and although not shown in the figure, it is configured to include electronic circuits such as a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and various interfaces. Then, the program stored in the ROM is read out and expanded in the RAM, and the CPU executes various processes. Note that the processes performed by the control unit 8 will be described later.

[0031] FIG. 8A is a schematic side view of the state in which each door of the refrigerator 100 according to the embodiment is closed. As shown in FIG. 8A, in the refrigerator 100, as a plurality of door sensors 5, in addition to the door sensor 52 of the right refrigerator door 212 (see FIG. 1), the door sensor 53 of the upper freezer door 231, the door sensor 54 of the lower freezer door 241, and the door sensor 55 of the vegetable compartment door 251 are installed. In addition, although not shown in FIG. 8A, door sensors 5 are also installed on the left refrigerator door 211 (see FIG. 1) and the ice making compartment door 221 (see FIG. 1), respectively.

[0032] For example, the door sensor 52 of the right refrigerator door 211 includes a magnet 52a embedded in the refrigerator door 212 and a Hall element 52b provided at a position in the housing 1 facing the magnet 52a. And a predetermined signal corresponding to the open / closed state of the refrigerator door 212 is output from the Hall element 52b to the control unit 8 (see FIG. 7). Note that the remaining plurality of door sensors 5 also have the same configuration.

[0033] As shown in FIG. 8A, each door of the refrigerator 100 overlaps with another predetermined door in the height direction in the closed state. Specifically, for example, the right-side refrigerator compartment door 212 (see also FIG. 1) overlaps with the upper freezer compartment door 231, the lower freezer compartment door 241, and the vegetable compartment door 251 in the height direction in the closed state. Also, for example, the vegetable compartment door 251 overlaps with the left and right refrigerator compartment doors 211 and 212 (see FIG. 1), the ice-making compartment door 221 (see FIG. 1), the upper freezer compartment door 231, and the lower freezer compartment door 241 in the height direction in the closed state.

[0034] FIG. 8B is a schematic side view of a state in which both the lower freezer compartment door 241 and the vegetable compartment door 251 according to the embodiment are fully pulled out. As described above, the pull-out type lower freezer compartment door 241 and the vegetable compartment door 251 overlap in the height direction in the closed state (see FIG. 1). Therefore, as shown in FIG. 8B, when both the lower freezer compartment door 241 and the vegetable compartment door 251 are fully pulled out, it is possible to photograph the lower freezer compartment container 242 as viewed from the camera unit 3, but the vegetable compartment container 252 is hidden by the lower freezer compartment container 242.

[0035] FIG. 8C is a schematic side view of a state in which the lower freezer compartment door 241 according to the embodiment is fully pulled out while the vegetable compartment door 251 is pulled out only a little. For example, the door sensor 55 of the vegetable compartment door 251 is configured to output an open signal to the control unit 8 (see FIG. 7) even when the vegetable compartment door 251 is opened only a little (the same applies to the remaining door sensors 5). And, for example, when the duration of the state in which a predetermined door remains open reaches a predetermined value, the buzzer 31g (see FIG. 7) sounds. This prevents forgetting to close the door and suppresses a decrease in cooling capacity and an increase in power consumption due to cold air leakage.

[0036] Therefore, for example, even when the drawer - type vegetable compartment door 251 is fully pulled out (see Fig. 8B), or even when the vegetable compartment door 251 is pulled out only slightly (see Fig. 8C), in either case, a predetermined open signal is output from the door sensor 55 to the control unit 8 (see Fig. 7) without any particular distinction. Then, for example, when open signals are input from the door sensors 5 of the lower - stage freezer door 241 and the vegetable compartment door 251 respectively, since the degree of opening of each door is not grasped by the control unit 8, it becomes difficult to determine whether it is the lower - stage freezer 24 (see Fig. 8B) or the vegetable compartment 25 (see Fig. 8C) that is within the field of view of the camera unit 3.

[0037] On the other hand, considering the convenience for the user, when displaying the captured image on the mobile terminal 64 (see Fig. 7), it is desirable to indicate which storage compartment the captured image is of. Therefore, in the embodiment, the camera unit 3 is configured to perform shooting when the door corresponding to one storage compartment is opened. Also, when the doors corresponding to two or more storage compartments are opened, the camera unit 3 is configured not to perform shooting. Thus, the control unit 8 (see Fig. 7) can appropriately identify the storage compartment shown in the captured image of the camera unit 3.

[0038] In this way, the camera unit 3 is configured not to perform shooting when the doors corresponding to two or more of the plurality of storage compartments are opened. This can prevent an error from occurring in the association between the captured image and the storage compartment.

[0039] Also, when the plurality of drawer - type doors that overlap in the height direction in the closed state are opened (when the open signals of the door sensors 5 of the plurality of drawer - type doors are output), the camera unit 3 does not perform shooting. This can prevent, for example, a situation where a captured image in a state where the lower - stage freezer door 241 is fully opened while the vegetable compartment door 251 is slightly opened (see Fig. 8C) is displayed on the mobile terminal 64 as a captured image of the vegetable compartment 25.

[0040] Note that, for example, even when at least one of the left and right refrigerator doors 211 and 212 is opened and the remaining doors are in the closed state, the camera unit 3 performs imaging, and the captured image at that time is associated with the refrigerator compartment 21.

[0041] Also, for example, when both the ice-making chamber door 221 and the upper freezer door 231 are pulled out, the camera unit 3 may be made to perform imaging. That is, among the plurality of doors, at least one pair of doors that do not overlap in the height direction in the closed state is included, and the camera unit may be made to perform imaging even when the at least one pair of doors described above is opened. This is because the ice-making chamber door 221 and the upper freezer door 231 do not overlap in the height direction, so no error occurs in the association between the captured image and the storage compartment.

[0042] FIG. 9 is a flowchart of a process S100 executed by the control unit 8 of the refrigerator 100 according to the embodiment (refer to FIG. 7 as appropriate). Note that at the time of "START" in FIG. 9, each door of the refrigerator 100 is in the closed state.

[0043] In step S101, the control unit 8 determines whether an open signal has been input from the door sensor 5. That is, the control unit 8 determines whether at least one of the plurality of doors of the refrigerator 100 has been opened. In step S101, when no open signal is input from the door sensor 5 (step S101: No), the control unit 8 repeats the process of step S101. Also, in step S101, when an open signal is input from the door sensor 5 (step S101: Yes), the process of the control unit 8 proceeds to step S102.

[0044] In step S102, the timer unit 8a in the control unit 8 starts timing. In step S103, the control unit 8 turns on the camera LED 31f. By also turning on the camera LED 31f in this way, when shooting is performed thereafter (step S123), the predetermined storage chamber is more likely to be irradiated with light. Also, although omitted in FIG. 9, when at least one of the refrigerator doors 211 and 212 (see FIG. 1) is opened, the interior light (not shown) of the refrigerator compartment 21 is also turned on.

[0045] Next, in step S104, the control unit 8 takes a picture according to the timekeeping, but determines whether or not a predetermined time (first predetermined time; for example, several seconds) has elapsed since an open signal was input from the door sensor 5. This first predetermined time is set based on the average time until the door of the refrigerator 100 is fully opened. In step S103, when the first predetermined time has not elapsed since an open signal was input from the door sensor 5 (step S104: No), the control unit 8 does not take a picture in this case and repeats the process of step S104. Also, when the first predetermined time has elapsed since an open signal was input from the door sensor 5 (step S104: Yes), the process of the control unit 8 proceeds to step S105.

[0046] In step S105, the control unit 8 determines whether or not the door corresponding to one storage chamber is open. Note that there may be a case where two doors are associated with one storage chamber, such as the left and right refrigerator doors 211 and 212 (see FIG. 1). In step S105, when the doors for a plurality of storage chambers are open (step S105: No), the control unit 8 proceeds to step S107 without taking a picture. That is, the control unit 8 does not perform imaging when the doors corresponding to two or more storage chambers are open. Thereby, misrecognition of the storage chamber corresponding to the captured image can be prevented. Also, when the door corresponding to one storage chamber is opened in step S105 (step S105: Yes), the process of the control unit 8 proceeds to step S106.

[0047] In step S106, the control unit 8 determines whether or not a storage room (first storage room) having an interior light is open. If the storage room having the interior light is open (step S106: Yes), the control unit 8 proceeds to step S121. If a storage room (second storage room) having no interior light is open (step S106: No), the control unit 8 proceeds to step S131.

[0048] In step S121, the control unit 8 turns off the interior light, and in step S122, the control unit 8 sounds the buzzer 31g. By sounding the buzzer 31g in this way, the user can recognize that shooting by the camera unit 3 is being performed.

[0049] Next, in step S123, the control unit 8 performs exposure adjustment. That is, the control unit 8 adjusts the gain (sensitivity to brightness) when amplifying the electrical signal from the image sensor 31d (see FIG. 7), and also adjusts the shutter speed and the like. For example, the control unit 8 adjusts the above-described gain so that the luminance average value of the captured image data is within a predetermined range. By performing exposure adjustment in this way, whiteout (halation) and black crush in the captured image can be suppressed.

[0050] Next, in step S124, the control unit 8 outputs a shooting command. That is, the control unit 8 captures, as captured image data, the electrical signal output from the image sensor 31d (see FIG. 7) by photoelectric conversion and further amplified with a predetermined gain. In this way, since shooting is performed with the door corresponding to one storage room open, the storage room and the captured image can be appropriately associated. It is assumed that the correspondence relationship between each door sensor 5 and the storage room is stored in advance.

[0051] Then, in step S125, the control unit 8 turns on the interior light and proceeds to step S107. As a result, since the storage room (for example, the refrigerator 21) is irradiated with light, it becomes easier for the user to visually recognize the storage room.

[0052] On the other hand, in step S131, the control unit 8 turns off the camera LED 31f, and in step S132, the control unit 8 sounds the buzzer 31g. By sounding the buzzer 31g in this way, the user can grasp that the shooting by the camera unit 3 is being performed.

[0053] Next, in step S133, the control unit 8 performs exposure adjustment. That is, the control unit 8 adjusts the gain (sensitivity to brightness) when amplifying the electrical signal from the image sensor 31d (see FIG. 7), and also adjusts the shutter speed and the like. For example, the control unit 8 adjusts the gain so that the luminance average value of the captured image data is included within a predetermined range. By performing exposure adjustment in this way, it is possible to suppress overexposure (halation) and underexposure in the captured image.

[0054] Next, in step S134, the control unit 8 outputs a shooting command. That is, the control unit 8 captures, as captured image data, the electrical signal output from the image sensor 31d (see FIG. 7) by photoelectric conversion and further amplified with a predetermined gain. In this way, since shooting is performed with the door corresponding to one storage chamber open, it is possible to appropriately associate the storage chamber with the captured image. It is assumed that the correspondence relationship between each door sensor 5 and the storage chamber is stored in advance.

[0055] Then, in step S135, the control unit 8 turns on the camera LED 31f and proceeds to step S107.

[0056] In step S107, the control unit 8 determines whether or not a close signal has been input from each door sensor 5. That is, the control unit 8 determines whether or not all of the plurality of doors of the refrigerator 100 have been closed. In step S107, if there is at least one of the plurality of door sensors 5 that has received an open signal input (step S107: No), the process of the control unit 8 proceeds to step S108.

[0057] In step S108, the control unit 8 takes a photograph according to the time measurement, and determines whether or not a predetermined time (second predetermined time) has elapsed since the most recent photograph was taken. This second predetermined time is the cycle (for example, several seconds, 10 seconds, or several tens of seconds) when the control unit 8 repeats photographing, and is set in advance. If the second predetermined time has not elapsed since the most recent photograph was taken in step S108 (step S108: No), the control unit 8 repeats the process of step S108. On the other hand, if the second predetermined time has elapsed since the most recent photograph was taken (step S108: Yes), the process of the control unit 8 returns to step S105.

[0058] Also, if an input of a close signal is received from each door sensor 5 in step S107 (step S107: Yes), the process of the control unit 8 proceeds to the process of step S110. In step S110, the timer unit 8a of the control unit 8 ends the time measurement. In step S111, the control unit 8 turns off the camera LED 31f. When both of the refrigerator doors 211 and 212 are closed, the control unit 8 also turns off the interior light (not shown) in addition to the camera LED 31f.

[0059] In step S112, the control unit 8 selects a photographing result. For example, the control unit 8 selects the most recent one among the plurality of stored photographing results as the photographing result for transmission to the server 63.

[0060] In step S113, the control unit 8 transmits the photographing result to the server 63. As a result, the photographed image data is transmitted to the server 63 via the wireless LAN unit 4, the router 61, and the network 62 shown in FIG. 7 in sequence. When the control unit 8 transmits the photographing result to the server 63, the identification information of the storage room (or the door sensor 5 that output the open signal) corresponding to the photographed image may be transmitted to the server 63. This is because the area (range of pixels) in which the storage room appears in the photographed image differs depending on which of the plurality of doors is open. After performing the process of step S113, the control unit 8 ends a series of processes (END).

[0061] In this embodiment, the storage compartment (e.g., the refrigerator 100) includes an illumination unit (e.g., the camera LED 31f) provided outside the housing 1, a first storage compartment (e.g., the refrigerator compartment 21) provided inside the housing 1 and having an interior light, and a second storage compartment (e.g., the vegetable compartment 25) provided inside the housing 1 and not having an interior light. When taking a picture with the door of the first storage compartment open, the control unit 8 turns off the interior light, turns on the illumination unit (while it is on), causes the imaging unit (e.g., the camera unit 3) to take a picture, and then turns on the interior light after the picture is taken. Thereby, the user can be made aware that the first storage compartment has been photographed. This will be described later with reference to FIG. 9.

[0062] Also, when taking a picture with the door of the second storage compartment open, the control unit 8 turns off the illumination unit and then takes a picture, and then turns on the illumination unit. Thereby, the user can be made aware that the second storage compartment has been photographed. This will be described later with reference to FIG. 9.

[0063] Also, when the imaging unit takes a picture according to the measurement of the elapsed time, if one door is open, it takes a picture, and if a plurality of doors are open, it does not take a picture.

[0064] Next, an example of the processing of the control unit 8 shown in FIG. 9 will be specifically described. FIG. 10 is a diagram showing the relationship between imaging and illumination by the camera unit 3 according to the embodiment. FIG. 10 shows the process of opening and closing the door of the refrigerator 100 in chronological order. This will be described with reference to FIGS. 1 and 9 as appropriate.

[0065] The time series 10A shows the process of opening and closing the refrigerator compartment doors 211 and 212. When the refrigerator compartment doors 211 and 212 are opened in step S101, the timing starts in step S102, the camera LED 31f is turned on in step 103, and the interior light of the refrigerator compartment 21 is turned on.

[0066] When a predetermined time (the first predetermined time; for example, 3 seconds) elapses in step S104, only the door of the refrigerator compartment 21 is opened in step S105, and it is determined in step S106 that it is a storage compartment having an interior light. Then, the interior light is turned off in step S121, after steps S122 and S123, shooting is performed in step S124, and after the shooting is completed, the interior light is turned on in step S125.

[0067] And, if the door is not closed in step S107, when a predetermined time (the second predetermined time; for example, 5 seconds) elapses in step S108, the process returns to step S105, shooting is performed at each predetermined time, and if the door is closed in step S107, the timing ends in step S110, and the camera LED 31f is turned off in step S11. Note that the second predetermined time is several seconds, 10 seconds, or several tens of seconds as described above, but here it is, for example, 5 seconds.

[0068] In time series 10A, the end of each shooting can be recognized by the turning off and on of the interior light, and it can be recognized that the user has been photographed.

[0069] Time series 10B shows the process in which the vegetable compartment door 251 is opened and then closed. When the vegetable compartment door 251 is opened in step S101, the timing starts in step S102, and the camera LED 31f is turned on in step 103. Since the vegetable compartment 25 does not have an interior light, the interior light is "none".

[0070] When a predetermined time (the first predetermined time; for example, 3 seconds) elapses in step S104, only the door of the vegetable compartment 25 is opened in step S105, and it is determined in step S106 that it is a storage compartment without an interior light. Then, the camera LED 31f is turned off in step S131, after steps S132 and S133, shooting is performed in step S134, and after the shooting is completed, the camera LED 31f is turned on in step S135. That is, shooting is performed according to the timing.

[0071] If the door is not closed in step S107, when a predetermined time (second predetermined time; for example, 5 seconds) elapses in step S108, the process returns to step S105, and shooting is performed every second predetermined time. If the door is closed in step S107, the timing ends in step S110, and the camera LED 31f is turned off in step S111. That is, shooting is performed according to the timing.

[0072] In time series 10B, the end of each shooting can be recognized by the user based on the off and on states of the camera LED 31f, indicating that the user has been photographed.

[0073] FIG. 11 is a diagram showing an example of shooting timing and image selection according to the embodiment. Similar to FIG. 10, FIG. 11 shows the process of opening and closing the refrigerator door in time series. Description will be made with reference to FIG. 9 as appropriate.

[0074] Since time series 11A is the same as time series 10A, details of the shooting process are omitted, but multiple shootings are performed. In this case, the final image taken in step S112 is selected, and the shooting result, which is the selected image, is transmitted to the server 63 in step S113.

[0075] Since time series 11B is the same as time series 10B, details of the shooting process are omitted, but multiple shootings are performed. In this case, the final image taken in step S112 is selected, and the shooting result, which is the selected image, is transmitted to the server 63. In both time series 11A and time series 11B, if multiple shootings are performed for the same storage compartment, the final taken image is transmitted to the server 63.

[0076] Note that the final image is selected because it is highly likely to be an image in a state where the user has finished the work of putting in and taking out items in the storage compartment. Incidentally, if it is not the final image, there is a possibility that a part of the user's body who is putting in and taking out items is captured (so that the items may not be visible), a possibility that an image of an item taken out after shooting is captured, or a possibility that an item put in after shooting is not captured.

[0077] FIG. 12 is a diagram showing another example of a shooting timing and an image selection according to an embodiment. FIG. 12 shows a process in which a door of a refrigerator is opened and closed in time series. This will be described with reference to FIGS. 1 and 9 as appropriate.

[0078] In time series 12A, when the refrigerator doors 211 and 212 are opened and a predetermined time (first predetermined time; for example, 3 seconds) has elapsed, the storage compartment (refrigerator compartment 21) is photographed. When the next predetermined time (for example, 5 seconds) has elapsed, it is determined in step S105 that the doors for a plurality of storage compartments are open (step S105: No), and the storage compartment is not photographed. Thereafter, when the next predetermined time (second predetermined time; for example, 5 seconds) has elapsed, it is determined in step S105 that the door for one storage compartment is open (step S105: Yes), and it is determined in step S106 that the storage compartment does not have an interior light (step S106: No), and the refrigerator compartment (vegetable compartment 25) is photographed in step S134. In the case of time series 12A, the final images of the refrigerator compartment 21 and the vegetable compartment 25 photographed in step S112 are selected, and the photographing result, which is the selected image, is transmitted to the server 63 in step S113.

[0079] In time series 12B, when the refrigerator doors 211 and 212 are opened and a predetermined time (first predetermined time; for example, 3 seconds) has elapsed, it is determined in step S105 that the doors for a plurality of storage compartments are open (step S105: No), and the storage compartment is not photographed. When the next predetermined time (for example, 5 seconds) has elapsed, it is determined in step S105 that the door for one of the plurality of storage compartments is open (step S105: Yes), and the storage compartment (refrigerator compartment 21) is photographed in step S124. Thereafter, when the next predetermined time (second predetermined time; for example, 5 seconds) has elapsed, it is determined in step S105 that the door for one storage compartment is open (step S105: Yes), and it is determined in step S106 that the storage compartment does not have an interior light (step S106: No), and the refrigerator compartment (vegetable compartment 25) is photographed in step S134. In the case of time series 12B, the final images of the refrigerator compartment 21 and the vegetable compartment 25 photographed in step S112 are selected, and the photographing result, which is the selected image, is transmitted to the server 63 in step S113.

[0080] In FIG. 12, the timing unit 8a measures the elapsed time from when all the doors of the storage room are closed to when any one of the doors is opened. Further, the control unit 8 executes shooting by the shooting unit in response to the measurement of the elapsed time, and the timing unit continues the measurement as it is even when another door is opened or closed after the start of the measurement.

[0081] FIG. 13A shows a shooting result of the camera unit 3, which is an example of a state where image processing has not been performed. Note that in FIG. 13A, due to the relationship where the upper side of the paper is the front and the lower side of the paper is the rear, the left and right are reversed with respect to FIG. 3 and the like.

[0082] In the example of FIG. 13A, the vegetable compartment door 251 is opened, and shooting is performed with the remaining doors closed. As described above, since a fish-eye lens is used as the lens 31a of the camera unit 3 (see FIG. 5), imaging can be performed with a wide angle of view. However, in a state where image processing has not been performed, as shown in FIG. 13A, actually, the straight ridge line is curved in the captured image, and even for ridge lines of the same length, the number of pixels on the captured image decreases as the position is farther from the camera unit 3.

[0083] FIG. 13B shows a shooting result of the camera unit 3, which is an example of a developed image in a state where image processing has been performed. By performing predetermined image processing in the server 63 (see FIG. 7), as shown in FIG. 13B, it is converted into a developed image of the vegetable compartment 25 (inside the vegetable compartment container 252) viewed from above. By displaying such a developed image on the mobile terminal 64 (see FIG. 7), the user can grasp at a glance what foods are stored in the vegetable compartment 25. Although not particularly shown in FIG. 13B, a predetermined character or pattern indicating that it is the "vegetable compartment" may be associated with the captured image and displayed on the mobile terminal 64. This makes it easier for the user to recognize that it is a captured image of the vegetable compartment 25. Incidentally, since the door sensor 5 is attached to each door, the control unit 8 can recognize which storage room the captured image is from.

[0084] As described above, the refrigerator according to the present embodiment includes a housing 1 having a plurality of storage chambers opened and closed by doors, a photographing unit (camera unit 3) for photographing the storage chambers, and a timing unit 8a for measuring the elapsed time from when all the doors of the storage chambers are closed until any one of the doors is opened. In response to the measurement of the elapsed time, the photographing unit executes photographing. The timing unit continues the timing as it is even when other doors are opened or closed after the start of the timing. According to this, even when a plurality of doors are opened, the storage chambers can be appropriately photographed.

[0085] In the embodiment, the case where a fish-eye lens is used as the lens 31a (see FIG. 7) of the camera unit 3 has been described, but it is not limited to this. For example, a general lens other than the fish-eye lens may be used as the lens 31a of the camera unit 3.

[0086] In addition, the refrigerator 100 etc. described in each embodiment are examples, and can also be applied to refrigerators of other forms. For example, the embodiments can also be applied to a refrigerator having a single-opening type storage chamber door (not shown) or a portable refrigerator (not shown).

[0087] Also, the "refrigerator" to which each embodiment can be applied is not limited to a refrigerator. In this case, the housing of the "refrigerator" may have a configuration without a particular distinction such as an outer box and an inner box. Also, as the "refrigerator", the embodiments can be applied to a freezer or a storage cabinet.

[0088] In addition, the programs executed by the control unit 8 (see FIG. 7) and the server 63 (see FIG. 7) can be provided via a communication line, and can also be written on a recording medium such as a CD-ROM and distributed.

[0089] Also, each embodiment has been described in detail for easy understanding of the present invention, and is not necessarily limited to the one having all the configurations described. Also, it is possible to add, delete, or replace a part of the configuration of the embodiment with other configurations. Also, the mechanisms and configurations described above show those considered necessary for explanation, and not necessarily all mechanisms and configurations are shown on the product.

Explanation of Signs

[0090] 1 Housing 3 Camera Unit (Photographing Unit) 4 Wireless LAN Unit 5, 52, 53, 54, 55 Door Sensor 6 Control Panel 7 Photographing Button 8 Control Unit 8a Timing Unit 21 Refrigerator Compartment (Storage Compartment, First Storage Compartment) 22 Ice Making Compartment (Storage Compartment, Second Storage Compartment) 23 Upper Freezer Compartment (Storage Compartment, Second Storage Compartment) 24 Lower Freezer Compartment (Storage Compartment, Second Storage Compartment) 25 Vegetable Compartment (Storage Compartment, Second Storage Compartment) 31f Camera LED (Illumination Unit) 61 Router 62 Network 63 Server 64 Mobile Terminal 211, 212 Refrigerator Door (Door, French Door) 221 Ice Making Compartment Door (Door, Drawer-Type Door) 231 Upper Freezer Compartment Door (Door, Drawer-Type Door) 241 Lower Freezer Compartment Door (Door, Drawer-Type Door) 251 Vegetable Compartment Door (Door, Drawer-Type Door) 100 Refrigerator (Storage)

Claims

1. A housing having a plurality of storage rooms opened and closed by doors, An imaging unit for imaging the storage room, A timer for measuring the elapsed time from when all the doors of the storage room are closed until any one of the doors is opened, and comprising: A storage cabinet that, in response to the measurement of the elapsed time, executes imaging by the imaging unit, and the timer continues the measurement as it is even if other doors are opened or closed after the start of the measurement.

2. When imaging in response to the measurement of the elapsed time, if one door is open, imaging is performed. The storage cabinet according to claim 1, characterized in that.

3. When imaging in response to the measurement of the elapsed time, if a plurality of doors are open, imaging is not performed. The storage cabinet according to claim 1, characterized in that.

4. The storage cabinet is A lighting unit provided outside the housing, A first storage room having an interior light provided inside the housing, A second storage room having no interior light provided inside the housing, and comprising: When imaging is performed with the door of the first storage room open, the interior light is turned off, the imaging unit is made to perform imaging with the lighting unit lit, and the interior light is turned on after imaging. The storage cabinet according to claim 1, characterized in that.

5. The storage cabinet is A lighting unit provided outside the housing, A first storage room having an interior light provided inside the housing, A second storage room having no interior light provided inside the housing, and comprising: When imaging is performed with the door of the second storage room open, the lighting unit is turned off and then imaging is performed, and then the lighting unit is turned on. The storage cabinet according to claim 1, characterized in that.

6. After the door of the storage room is opened, if imaging is performed a plurality of times for the same storage room, the final image taken is sent to a server. The storage cabinet according to claim 1, characterized in that.

7. The storage room is a refrigerating chamber, a freezing chamber, and / or a vegetable chamber. The storage cabinet according to claim 1, characterized in that.

Images