Storage box
By positioning a camera unit and adjusting the illuminating unit's brightness based on the first door's state, the refrigerator effectively prevents flare and ensures clear imaging of the second storage chamber.
Patent Information
- Application Number
- JP2024004115
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-01-15
- Publication Date
- 2025-07-28
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing refrigerator imaging systems suffer from flare issues due to light reflection off the first storage unit door during photography of the second storage unit, leading to unclear images.
The refrigerator is equipped with a camera unit outside the housing, a first storage chamber with a first door inside, and an illuminating unit outside the housing that adjusts its brightness based on the state of the first door, ensuring appropriate illumination for the second storage chamber photography.
This configuration prevents flare and ensures clear photography of the second storage chamber by minimizing light reflection from the first door, allowing accurate identification of stored items.
Smart Images

Figure 2025110274000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a storage device.
Background Art
[0002] As a technique for photographing a storage room or the like of a refrigerator, for example, the technique described in Patent Document 1 is known. That is, Patent Document 1 includes illumination for illuminating an article, and a camera control unit further controls the illumination. When it is determined that the door of the second storage unit located farther from the installation position of the illumination than the first storage unit is in an open state when viewed from the installation position of the illumination, the illumination is controlled to illuminate the article with stronger light than when it is determined that the door of the first storage unit is in an open state.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] According to Patent Document 1, illumination for illuminating food ingredients is further installed adjacent to the camera. As described above, when photographing the second storage unit, the camera control unit controls the illumination to illuminate the food ingredients with stronger light than when it is determined that the rotating door of the first storage unit is in an open state. In this case, when strong light hits the door of the first storage unit, it may be reflected on the door of the first storage unit and white spots (flare) may occur in the photographed image, and there is room for improvement to make the photographing clear.
Means for Solving the Problems
[0005] The storage device according to the present disclosure includes a photographing unit provided outside the housing, a first storage chamber having a first door inside the housing, a second storage chamber inside the housing, and an illuminating unit provided outside the housing that illuminates at least a part of the first door when the photographing unit photographs the second storage chamber with the first door in a closed state. When the photographing unit photographs the second storage chamber with the first door in a closed state, the illuminating unit is configured to light less brightly or turn off compared to when the first door is open.
Brief Description of the Drawings
[0006]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6A
Figure 6B
Figure 7
Figure 8A
Figure 8B
Figure 8C
Figure 9
Figure 10A
Figure 10B
Figure 11A
Figure 11B
Figure 12
Figure 13
Mode for Carrying Out the Invention
[0007] ≪First Embodiment≫ FIG. 1 is a front view of a refrigerator 100 according to the first embodiment. The refrigerator 100 (storage) shown in FIG. 1 is a device for storing food and the like at a low temperature, and includes, in addition to the housing 1, each door such as refrigerator doors 211 and 212, and a camera unit 3. The housing 1 has a structure in which a heat insulating material (not shown) such as a vacuum heat insulating material or urethane foam is filled between an outer box 11 made of a steel plate and an inner box 12 made of resin (see FIG. 3). Further, a plurality of storage rooms are provided in the housing 1. In the example of FIG. 1, as the plurality of storage rooms, in order from the top, there are provided a refrigerator compartment 21, an ice making compartment 22 and an upper freezer compartment 23 arranged side by side on the left and right, a lower freezer compartment 24, and a vegetable compartment 25.
[0008] In addition, the refrigerator 100 includes a plurality of doors associated with each storage compartment, namely, refrigerator doors 211 and 212, an ice-making compartment door 221, an upper freezer compartment door 231, a lower freezer compartment door 241, and a vegetable compartment door 251. Note that glass, painted steel plates, etc. are used for the design surface of the doors. The refrigerator doors 211 and 212 are a pair of French doors that form the refrigerator compartment 21 by closing the opening 10 (see FIG. 2) on the front side of the housing 1. The left refrigerator door 211 is rotatable about the axis of the hinge 211a (see FIG. 4) at the left end. The same applies to the right refrigerator door 212. Incidentally, the refrigerator doors 211 and 212 are the first doors that are provided to be openable and closable at the opening of the housing 1 and define the first storage compartment (refrigerator compartment 21) inside the housing 1. Also, the ice-making compartment door 221, the upper freezer compartment door 231, the lower freezer compartment door 241, and the vegetable compartment door 251 are pull-out type second doors located below the first door and closing the opening on the front side of the housing 1.
[0009] The remaining doors, namely, the ice-making compartment door 221, the upper freezer compartment door 231, the lower freezer compartment door 241, and the vegetable compartment door 251, are each pull-out type doors. These pull-out type doors are positioned lower in height than the refrigerator doors 211 and 212. In other words, the refrigerator doors 211 and 212, which are French doors, are positioned higher in height than the plurality of pull-out type doors.
[0010] A vegetable compartment container 252 (see FIG. 8B) is installed on the rear side (inner side) of the vegetable compartment door 251. The vegetable compartment door 251 and the vegetable compartment container 252 are pulled out integrally (the same applies to the other pull-out type doors). Note that the "storage compartment" corresponding to the pull-out type door is defined as the internal space of the container that is pulled out integrally with the pull-out type door. For example, the vegetable compartment 25 is the internal space of the vegetable compartment container 252 (see FIG. 8B) that is pulled out integrally with the vegetable compartment door 251. The ice-making compartment 22, the upper freezer compartment 23, the lower freezer compartment 24, and the vegetable compartment 25 are the second storage compartments configured as pull-out type storage compartments that are pulled out by pulling out the second door.
[0011] The refrigerator 100 includes, although not shown in the drawings, a compressor, a radiator (condenser), a capillary tube (throttling mechanism), and a cooler (evaporator). Refrigerant circulates sequentially through the compressor, radiator, capillary tube, and cooler, and the air in each storage compartment is cooled by heat exchange with the refrigerant flowing through the cooler. The camera unit 3 shown in FIG. 1 is configured to photograph the storage compartment when a predetermined door is opened, and is provided on the upper side of the housing 1.
[0012] FIG. 2 is a side view of the refrigerator 100 according to the embodiment. As shown in FIG. 2, the camera unit 3 includes a main body portion 31 and a support portion 32. The main body portion 31 has a function of photographing the storage compartment and the like when a predetermined door of the refrigerator 100 is opened. The support portion 32 supports the main body portion 31 and is installed on the upper surface of the housing 1.
[0013] Near the front end of the main body portion 31, a lens 31a is provided. The lens 31a is an optical element that refracts light and focuses it on an image sensor 31d (see FIG. 6B). For example, a fish-eye lens is used as such a lens 31a. Further, so that the storage compartment can be photographed when a predetermined door of the refrigerator 100 is opened, the lens 31a faces downward. And the camera unit 3 is configured to photograph downward. In addition to the case where the direction of the optical axis of the lens 31a is the vertical direction, the case where the optical axis is inclined obliquely by a predetermined amount from the vertical direction is also included in the matter of "photographing downward".
[0014] As shown in FIG. 2, the lens 31a is located in front of the front end of the housing 1 (the opening 10 of the housing 1). More preferably, the lens 31a is located further in front of the front surfaces of the closed refrigerator compartment doors 211, 212 (see FIG. 1). Thereby, for example, when the refrigerator compartment doors 211, 212 are opened, the refrigerator compartment 21 (see FIG. 1) easily enters the field of view of the lens 31a. Also, for example, when the vegetable compartment door 251 is pulled out, the vegetable compartment 25 (see FIG. 1) easily enters the field of view of the lens 31a.
[0015] The wireless LAN unit 4 shown in Fig. 2 is a device for transmitting the photographed image data of the camera unit 3 to the server 63 (see Fig. 7). In the example of Fig. 2, the wireless LAN unit 4 is installed near the rear end of the upper surface of the housing 1. However, without particular limitation, it may be arranged inside the camera unit 3 and the support portion 32, in the heat insulation space or storage space (shelves, containers, pockets, etc.) of the refrigerator doors 211, 212 of the refrigerator compartment, the ice making chamber door 221, the upper freezer compartment door 231, the lower freezer compartment door 241, and the vegetable compartment door 251, inside the hinges 211a, 212a of Fig. 4, near the door sensor 5 of Fig. 7, or inside the control panel 6. Also, as another communication method, for example, it may be via a proximity communication method such as Bluetooth (registered trademark), RFID, or NFC.
[0016] Fig. 3 is a front view of the refrigerator 100 according to the embodiment with the left and right refrigerator doors 211, 212 opened. As shown in Fig. 3, the refrigerator compartment 21 is provided with a plurality of shelf boards 213 that partition this refrigerator compartment 21 into predetermined sections. On the inner plate 211b of the left refrigerator door 211, a plurality of door pockets 211c for accommodating foods and the like are provided (the same applies to the right refrigerator door 212). And, for example, when the left and right refrigerator doors 211, 212 are opened, the foods and the like in the refrigerator compartment 21 and the door pockets 211c, 212c are panoramically within the field of view of the lens 31a of the camera unit 3.
[0017] Also, as an example, when manually photographing the storage compartment using the camera unit 3, photographing buttons 7 that are pressed by the user are provided one by one on the left and right refrigerator doors 211, 212. In the example of Fig. 3, on the left refrigerator door 211, the photographing button 7 is provided at the lower part of the surface on the side opposite to the axis of the hinge 211a (see Fig. 4) of this refrigerator door 211. Also, the photographing button 7 is provided at the same position on the right refrigerator door 212.
[0018] FIG. 4 is a plan view of the refrigerator 100 according to the embodiment with the left and right refrigerator doors 211 and 212 open. As shown in FIG. 4, hinges 211a and 212a are provided on the upper surface of the housing 1. The left hinge 211a pivotally supports the refrigerator door 211 (the same applies to the right hinge 212a). Further, the main body 31 of the camera unit 3 extends longitudinally in the front-rear direction. The position of the main body 31 in the left-right direction may be directly above the joint of the refrigerator doors 211 and 212 (see FIG. 1), or may be at other predetermined positions.
[0019] FIG. 5 is a perspective view of the camera unit 3 according to the embodiment as viewed obliquely from below. The main body 31 of the camera unit 3 includes, in addition to the above-described lens 31a, a case 31b and a cover 31c. The case 31b has a rectangular parallelepiped shape elongated in the front-rear direction. A circular hole (not shown) is provided on the lower surface near the front end of the case 31b, and the lens 31a is exposed through this hole.
[0020] In the case 31b, an elongated hole (not shown) is provided in the left-right direction behind the lens 31a, and the cover 31c is fitted into this hole. The cover 31c is a translucent resin member for protecting the camera LED 31f (see FIG. 6B) or diffusing the light from the camera LED 31f.
[0021] FIG. 6A is a front view of the camera unit 3 according to the embodiment. As shown in FIG. 6A, the main body 31 of the camera unit 3 is installed above the support portion 32. Further, in the left-right direction, the main body 31 is installed near the center of the support portion 32.
[0022] FIG. 6B is a cross-sectional view taken along the line II-II of FIG. 6A. The main body 31 of the camera unit 3 includes, as examples, an image sensor 31d, an LED board 31e, a camera LED 31f, a buzzer 31g, and a camera control board 31h, in addition to the above-described lens 31a, case 31b, and cover 31c, each as an independent board. However, for example, they may be integrated into an integrated board configuration. The image sensor 31d is an element that photoelectrically converts light incident through the lens 31a and generates photographed image data. As such an image sensor 31d, for example, a CCD sensor (Charge Coupled Device) or a CMOS sensor (Complementary Metal Oxide Semiconductor) is used. Note that a plurality of the image sensor 31d and the lens 31a may be provided, and they may be provided for distance measurement detection to the object to be photographed.
[0023] The LED board 31e is an example of a board on which the camera LED 31f and the buzzer 31g are installed. The camera LED 31f is a light source that lights up when the camera unit 3 takes a picture. Thereby, for example, when the vegetable room door 251 (see FIG. 1) is opened, the vegetable room 25 (see FIG. 1) is photographed under appropriate brightness. The buzzer 31g emits a predetermined sound when the camera unit 3 takes a picture. The camera control board 31h is a board on which the camera microcomputer 311h is mounted, and may be installed, for example, at the front part (the lens 31a side) or the rear part of the case 31b.
[0024] FIG. 7 is a system configuration diagram of the refrigerator 100 according to the embodiment. As shown in FIG. 7, the refrigerator 100 includes a camera unit 3, a wireless LAN unit 4, a door sensor 5, a control panel 6, a shooting button 7, and a control unit 8. The camera unit 3 includes a camera / communication control SoC 31k in addition to the above-described lens 31a, image sensor 31d, camera LED 31f, and buzzer 31g. Note that the present camera unit 3 is powered through the control unit 8 of the refrigerator 100. However, for example, by providing an external power supply method (not shown) such as a battery, the camera unit 3 can be installed at an arbitrary position (magnet attachment, adhesive tape attachment, etc.) as an independent camera unit without passing through the control unit 8 for a refrigerator 100 that does not have a wireless communication function.
[0025] The camera / communication control SoC 31k is an integrated circuit in which circuits having functions of a microcomputer and other application functions are integrated on one chip and designed to function in cooperation. The camera / communication control SoC 31k communicates with the control unit 8 at a predetermined time and outputs a shooting command to the image sensor 31d. As a result, shooting image data is input from the image sensor 31d to the camera / communication control SoC 31k.
[0026] The wireless LAN unit 4 is a device that transmits and receives data to and from the server 63 via a network 62 or the like. The wireless LAN unit 4 transmits the shooting image data acquired by the camera / communication control SoC 31k to the router 61. The router 61 is a communication relay device and transmits the shooting image data received from the wireless LAN unit 4 to the server 63 via the network 62. The server 63 performs predetermined processing on the shooting image data and stores it in association with the identification information of the refrigerator 100. Further, when the server 63 receives a request signal for an in-cabinet image of the refrigerator 100 from the mobile terminal 64 in which pairing setting has been performed via the control panel 6, the server 63 transmits the shooting image data to the mobile terminal 64. As such a mobile terminal 64, for example, in addition to a mobile phone and a smartphone, a tablet or a wearable terminal is used.
[0027] The door sensor 5 is a sensor that detects the opening and closing of each door of the refrigerator 100. Although only one door sensor 5 is shown in FIG. 7, in reality, at least one door sensor 5 is provided for each door. And a predetermined signal indicating the open / closed state of the door is output from the door sensor 5 to the control unit 8.
[0028] The control panel 6 is for displaying the state of the refrigerator 100 and accepting operations such as setting changes, and is provided, for example, on the surfaces of the refrigerator doors 211, 212 (see FIG. 1) or inside the refrigerator compartment (not shown). The shooting button 7 (also see FIG. 3) is an example of a button that is pressed by the user when manually shooting using the camera unit 3 as described above.
[0029] The control unit 8 is, for example, a microcomputer, and although not shown, includes electronic circuits such as a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and various interfaces. And the program stored in the ROM is read out and expanded in the RAM, and the CPU executes various processes. Note that the processes performed by the control unit 8 will be described later.
[0030] FIG. 8A is a schematic side view of the refrigerator 100 according to this embodiment with each door closed. As shown in FIG. 8A, in the refrigerator 100, as a plurality of door sensors 5, in addition to the door sensor 52 of the right refrigerator door 212 (see FIG. 1), the door sensor 53 of the upper freezer door 231, the door sensor 54 of the lower freezer door 241, and the door sensor 55 of the vegetable compartment door 251 are installed. In addition, although not shown in FIG. 8A, door sensors 5 are also installed on the left refrigerator door 211 (see FIG. 1) and the ice maker door 221 (see FIG. 1), respectively.
[0031] For example, the door sensor 52 of the right refrigerator door 211 includes a magnet 52a embedded in the refrigerator door 212 and a Hall element 52b provided at a position in the housing 1 facing the magnet 52a. And a predetermined signal corresponding to the open / closed state of the refrigerator door 212 is output from the Hall element 52b to the control unit 8 (see FIG. 7). Note that the remaining plurality of door sensors 5 also have the same configuration.
[0032] As shown in FIG. 8A, each door of the refrigerator 100 overlaps with another predetermined door in the height direction in the closed state. Specifically, for example, the right refrigerator door 212 (see also FIG. 1) overlaps with the upper freezer door 231, the lower freezer door 241, and the vegetable compartment door 251 in the height direction in the closed state. Also, for example, the vegetable compartment door 251 overlaps with the left and right refrigerator doors 211, 212 (see FIG. 1), the ice maker door 221 (see FIG. 1), the upper freezer door 231, and the lower freezer door 241 in the height direction in the closed state.
[0033] FIG. 8B is a schematic side view of a state in which both the lower freezer door 241 and the vegetable compartment door 251 according to the embodiment are fully pulled out. As described above, the drawer-type lower freezer door 241 and the vegetable compartment door 251 overlap in the height direction in the closed state (see FIG. 1). Therefore, as shown in FIG. 8B, when both the lower freezer door 241 and the vegetable compartment door 251 are fully pulled out, it is possible to photograph the lower freezer container 242 as seen from the camera unit 3, but the vegetable compartment container 252 is hidden by the lower freezer container 242.
[0034] FIG. 8C is a schematic side view of a state in which the lower freezer door 241 according to the embodiment is fully pulled out while the vegetable compartment door 251 is pulled out only slightly (half door). For example, the door sensor 55 of the vegetable compartment door 251 is configured to output an open signal to the control unit 8 (see FIG. 7) even when the vegetable compartment door 251 is opened only slightly (the same applies to the remaining door sensors 5). And, for example, when the duration of a state in which a predetermined door remains open reaches a predetermined value, the buzzer 31g (see FIG. 7) sounds. This prevents forgetting to close the door and suppresses a decrease in cooling capacity and an increase in power consumption due to cold air leakage.
[0035] Therefore, for example, even when the drawer-type vegetable compartment door 251 is fully pulled out (see FIG. 8B), or when the vegetable compartment door 251 is pulled out only slightly (see FIG. 8C), in either case, without any particular distinction, a predetermined open signal is output from the door sensor 55 to the control unit 8 (see FIG. 7). Then, for example, in a state where open signals are input from the door sensors 5 of the lower freezer door 241 and the vegetable compartment door 251 respectively, since the control unit 8 does not grasp the degree of opening of each door, it becomes difficult to determine whether it is the lower freezer 24 that is within the field of view of the camera unit 3 (see FIG. 8B), or the vegetable compartment 25 (see FIG. 8C).
[0036] On the other hand, considering the convenience for the user, when displaying the captured image on the mobile terminal 64 (see FIG. 7), it is desirable to indicate which storage compartment the captured image is of. Therefore, in the first embodiment, the camera unit 3 is configured to perform shooting when a door corresponding to one storage compartment is opened. Also, in a state where doors corresponding to two or more storage compartments are opened, the camera unit 3 is configured not to perform shooting. This allows the control unit 8 (see FIG. 7) to appropriately identify the storage compartment shown in the captured image of the camera unit 3.
[0037] In this way, the camera unit 3 is configured not to perform imaging when the doors corresponding to two or more of the plurality of storage compartments are open. This can prevent errors from occurring in associating the captured images with the storage compartments.
[0038] Also, when a plurality of drawer-type doors that overlap in the height direction in the closed state are open, the camera unit 3 does not perform imaging. This can prevent, for example, a captured image in a state where the lower freezer door 241 is fully open while the vegetable compartment door 251 is slightly open (see FIG. 8C) from being displayed on the mobile terminal 64 as a captured image of the vegetable compartment 25.
[0039] Note that, for example, when at least one of the left and right refrigerator doors 211 and 212 is open and the remaining doors are in the closed state, imaging is also performed by the camera unit 3, and the captured image at that time is associated with the refrigerator compartment 21.
[0040] Also, for example, when both the ice-making compartment door 221 and the upper freezer door 231 are pulled out, the camera unit 3 may be made to perform imaging. That is, among the plurality of doors, at least one pair of doors that do not overlap in the height direction in the closed state is included, and the camera unit may be made to perform imaging even when the at least one pair of doors described above is open. This is because the ice-making compartment door 221 and the upper freezer door 231 do not overlap in the height direction, so errors do not occur in associating the captured image with the storage compartment.
[0041] FIG. 9 is a flowchart of the processing executed by the control unit of the refrigerator (refer to FIG. 7 as appropriate). Note that at the time of "START" in FIG. 10, each door of the refrigerator 100 may be in the closed state, or a predetermined door may be in the open state.
[0042] In step S101, the control unit 8 determines whether an open signal is input from the door sensor 5. That is, the control unit 8 determines whether at least one of the plurality of doors of the refrigerator 100 is opened. In step S101, if no open signal is input from the door sensor 5 (S101: No), the control unit 8 repeats the process of step S101. Also, in step S101, if an open signal is input from the door sensor 5 (S101: Yes), the process of the control unit 8 proceeds to step S102.
[0043] In step S102, the control unit 8 turns on the camera LED 31f. By also turning on the camera LED 31f in this way, when shooting is performed later (S107), the predetermined storage chamber is easily irradiated with light. Also, although omitted in FIG. 10, when at least one of the refrigerator doors 211, 212 (see FIG. 1) is opened, the interior light (not shown) of the refrigerator compartment 21 is also turned on.
[0044] Next, in step S103, the control unit 8 determines whether a predetermined time (a first predetermined time, for example, several seconds) has elapsed since an open signal was input from the door sensor 5. This predetermined time (the first predetermined time) is set based on the average time until the door of the refrigerator 100 is fully opened. In step S103, if the predetermined time has not elapsed since an open signal was input from the door sensor 5 (S103: No), the control unit 8 repeats the process of step S103. Also, if the predetermined time has elapsed since an open signal was input from the door sensor 5 (S103: Yes), the process of the control unit 8 proceeds to step S104.
[0045] In step S104, the control unit 8 determines whether the door corresponding to one storage compartment is open. Note that, as in the case of the left and right refrigerator doors 211 and 212 (see FIG. 1), there may be a case where two doors are associated with one storage compartment. In step S104, if the open door does not correspond to one storage compartment (S104: No), the control unit 8 ends the series of processes without performing imaging (the "END" in FIG. 9B). That is, the control unit 8 does not perform imaging when the doors corresponding to two or more storage compartments are open. This can prevent misrecognition of the storage compartment corresponding to the captured image. Also, in step S104, if the door corresponding to one storage compartment is open (S104: Yes), the process of the control unit 8 proceeds to step S105.
[0046] In step S105, the control unit 8 sounds the buzzer 31g. By sounding the buzzer 31g in this way, the user can recognize that imaging by the camera unit 3 is to be performed. Next, in step S106, the control unit 8 performs exposure adjustment. That is, the control unit 8 adjusts the gain (sensitivity to brightness) when amplifying the electrical signal from the image sensor 31d (see FIG. 7), and also adjusts the shutter speed and the like. For example, the control unit 8 adjusts the above-described gain so that the luminance average value of the captured image data is within a predetermined range. By performing exposure adjustment in this way, whiteout (halation) and black crush in the captured image can be suppressed.
[0047] Next, in step S107, the control unit 8 outputs a shooting command. That is, the control unit 8 captures, as captured image data, the electrical signal output from the image sensor 31d (see FIG. 7) by photoelectric conversion and further amplified with a predetermined gain. In this way, since imaging is performed with the door corresponding to one storage compartment open, the association between the storage compartment and the captured image can be appropriately made. It is assumed that the correspondence relationship between each door sensor 5 and the storage compartment is stored in advance.
[0048] In step S108, the control unit 8 determines whether a close signal has been input from each door sensor 5. That is, the control unit 8 determines whether all of the plurality of doors of the refrigerator 100 have been closed. In step S108, if there is at least one door sensor 5 among the plurality of door sensors 5 from which an open signal has been input (S108: No), the process of the control unit 8 proceeds to step S109.
[0049] In step S109, the control unit 8 determines whether a predetermined time (second predetermined time) has elapsed since the most recent shooting. This predetermined time (second predetermined time) is the cycle (for example, several seconds, 10 seconds, or several tens of seconds) when the control unit 8 repeats shooting and is set in advance. In step S109, if the predetermined time has not elapsed since the most recent shooting (S109: No), the control unit 8 repeats the process of step S109. On the other hand, if the predetermined time has elapsed since the most recent shooting (S109: Yes), the process of the control unit 8 returns to step S106.
[0050] Also, in step S108, if a close signal has been input from each door sensor 5 (S108: Yes), the process of the control unit 8 proceeds to the process of step S110. In step S110, the control unit 8 turns off the camera LED 31f. In addition, when both of the refrigerator doors 211 and 212 are closed, the control unit 8 also turns off the interior light (not shown) in addition to the camera LED 31f. In step S111, the control unit 8 selects a shooting result. For example, the control unit 8 selects the most recent one among the plurality of stored shooting results as the shooting result for transmission to the server 63.
[0051] In step S112, the control unit 8 transmits the imaging result to the server 63. As a result, the captured image data is transmitted to the server 63 via the wireless LAN unit 4, the router 61, and the network 62 shown in FIG. 7 in sequence. When the control unit 8 transmits the imaging result to the server 63, the identification information of the storage room (or the door sensor 5 that outputs an open signal) corresponding to the captured image may be transmitted to the server 63. This is because the area (pixel range) in which the storage room appears in the captured image differs depending on which of the plurality of doors is open. After performing the process of step S111, the control unit 8 ends a series of processes (END).
[0052] (Whiteout situation) FIG. 10A is an explanatory diagram schematically showing the illumination range of the illumination unit according to the first embodiment. FIG. 10B is an example in which whiteout (flare) due to reflection of the refrigerator door occurs. The illumination light from the camera LED 31f is irradiated at an irradiation angle φ through the cover 31c. In the case of FIG. 10A, the upper freezer 23, the lower freezer 24, and the storage of the vegetable compartment 25 can be irradiated. In this case, since the illumination light is irradiated on the refrigerator door 212 as shown in FIG. 10B, whiteout due to reflection occurs (refer to the whiteout portion due to reflection).
[0053] (Measures against whiteout) In the refrigerator of the present embodiment, a photographing unit (for example, an image sensor 31d) provided outside the housing 1, a first storage room (for example, a refrigerator compartment 21) having a first door (for example, refrigerator doors 211, 212) inside the housing 1, a second storage room (for example, a vegetable compartment 25) inside the housing 1, and an illumination unit (for example, a camera LED 31f) provided outside the housing 1 and lighting up when the photographing unit photographs the second storage room with the first door closed and illuminating at least a part of the first door. When the photographing unit photographs the second storage room with the first door closed, the illumination unit lights up darker or turns off than when the first door is open. Thereby, whiteout due to reflection from the first door can be prevented, and the storage room (drawer-type storage room) can be appropriately photographed.
[0054] In other words, in the refrigerator of the present embodiment, a photographing unit provided outside the housing, a first door provided to be openable and closable at an opening on the front side of the housing, a first storage chamber defined in the housing by the first door, a drawer-type second door located below the first door and closing the opening on the front side of the housing, a second storage chamber configured as a drawer-type storage chamber pulled out by pulling out the second door, an illumination unit provided outside the housing and lighting up when the photographing unit photographs the second storage chamber with the first door closed and illuminating at least a part of the first door. When the photographing unit photographs the second storage chamber with the first door closed, the illumination unit lights up darker or goes out than when the first door is open. Or it lights up darker or goes out step by step.
[0055] In order to prevent white blooming, it is desirable that the surface of the first door is black glass (dark-colored glass). Specifically, in the case of a dark-colored door with a reflectance of 1 to 30% or a light-colored door with a reflectance of 30 to 70%, since the diffuse reflection is large, the illumination unit should light up darker or go out. Alternatively, it is advisable to adjust the directivity of the illumination unit so as not to hit the first door. Furthermore, in the case of a polished metal surface, resin surface, or mirror glass with a reflectance of 70 to 99%, since the diffuse reflection is small, it is advisable to adjust the angle of the illumination unit so that light does not enter the lens 31a (see FIG. 6B). Note that glass doors are often used in high-class refrigerators because they give a luxurious impression in terms of design.
[0056] (Modification example for countermeasures against white blooming) In other refrigerators, a photographing unit (for example, image sensor 31d) provided outside the housing 1, a first storage chamber (for example, refrigerator compartment 21) having a first door (for example, refrigerator compartment doors 211, 212) inside the housing 1, a second storage chamber (for example, vegetable compartment 25) having an in-chamber illumination unit (not shown) inside the housing 1, and an out-of-chamber illumination unit (for example, camera LED 31f) provided outside the housing 1 are provided. When photographing the first storage chamber, the out-of-chamber illumination unit lights up, and when photographing the second storage chamber, the in-chamber illumination unit lights up. Thereby, the illumination light from the out-of-chamber illumination unit is not irradiated onto the first door (since the out-of-chamber illumination unit does not light up), white blooming due to reflection from the first door can be prevented, and the storage chamber can be photographed appropriately.
[0057] Note that the interior lighting unit of the refrigerator compartment 21 is provided, for example, at the ceiling portion (high position) of the refrigerator compartment 21 as its height position, and at around the center in the depth direction (front-rear direction) of the refrigerator compartment 21 (from a position slightly deeper than the front end to further back). Also, for example, the lighting unit may be provided with dimming means having a plurality of colors in addition to single-color light, and may be arranged in a plurality of places on the inner side walls of the compartment (left and right side walls), or may be independently installed on a plurality of shelves 213. Furthermore, by arranging a plurality of lighting units at the partition portion (not shown) between the first door (for example, the refrigerator compartment doors 211, 212) and the second storage compartment (for example, the vegetable compartment 25) in FIG. 3, the second storage compartment can also be appropriately photographed.
[0058] That is, it is assumed that the interior lighting unit is provided at a position (with a structure and configuration such that the light of the interior lighting does not directly enter) where even if the interior lighting unit is lit during shooting, the light of the interior lighting does not directly enter the lens in the camera unit 3. Of course, the interior lighting unit is provided at an appropriate position in consideration of the visibility of the items stored in the compartment, ease of manufacture, ease of maintenance, cost, etc. However, it is preferable that even if the interior lighting unit is lit during shooting, it is arranged at a position where its light does not have an adverse effect on the image, or has a structure that does not affect shooting.
[0059] (Shooting example) FIG. 11A shows an example of the shooting result of the camera unit, in a state where image processing has not been performed. Note that in FIG. 11A, due to the relationship where the upper side of the paper surface is the front and the lower side of the paper surface is the rear, the left and right are reversed with respect to FIG. 3 and the like.
[0060] In the example of FIG. 11A, the vegetable compartment door 251 is open, and imaging is performed with each of the remaining doors closed. As described above, since a fisheye lens is used as the lens 31a of the camera unit 3 (see FIG. 5), imaging can be performed with a wide angle of view. However, in a state where no image processing is performed, as shown in FIG. 11A, actually, the straight ridge line is curved in the captured image, and even for ridge lines of the same length, the number of pixels on the captured image decreases as the position is farther from the camera unit 3.
[0061] FIG. 11B is an example of a developed image in a state where image processing has been performed on the imaging result of the camera unit. By performing predetermined image processing in the server 63 (see FIG. 7), as shown in FIG. 11B, it is converted into a developed image of the vegetable compartment 25 (inside the vegetable compartment container 252) viewed from above. By displaying such a developed image on the mobile terminal 64 (see FIG. 7), the user can grasp at a glance what foods are stored in the vegetable compartment 25. Although not particularly shown in FIG. 11B, a predetermined character or pattern indicating that it is a "vegetable compartment" may be associated with the captured image and displayed on the mobile terminal 64. This makes it easier for the user to recognize that it is a captured image of the vegetable compartment 25.
[0062] ≪Second Embodiment≫ FIG. 12 is an explanatory diagram of the lighting unit having the lighting direction changing mechanism 33 according to the second embodiment. FIG. 12 has a lighting direction changing mechanism 33 as compared with FIG. 6B. FIG. 12 shows an enlarged view 12A of the tip of the camera unit 3 (the same as FIG. 6B), a detailed view 12B of the broken-line circle in the enlarged view 12A, and change examples 12C1, 12C2, 12C3 of the lighting direction.
[0063] From the detailed view 12B, the lighting direction changing mechanism 33 includes a plurality of LEDs, i.e., LED1L, LED2L, and LED3L, and a glass sphere 34. The directivity of the camera lighting is adjusted by energizing the LEDs 1L to 3L according to the reflectance of the door design surface (glass door, gray mirror-colored door). The spot angle is adjusted by the refraction of the glass sphere, and the directivity is also changed when imaging the refrigerator compartment 21 and when imaging the drawer compartment.
[0064] In the case of the lighting direction change example 12C1, it is the case where the refrigerator compartment 21 is irradiated in the door direction. In the case of the lighting direction change example 12C2, it is the case where the vegetable compartment 25 is irradiated. In the case of the lighting direction change example 12C3, it is the case where the irradiation is directed slightly in front of the vegetable compartment 25. Thus, the lighting direction can be freely adjusted.
[0065] The storage compartment of the present embodiment includes a photographing unit (for example, image sensor 31d) provided outside the housing 1, a first storage compartment (for example, refrigerator compartment 21) having a first door (for example, refrigerator doors 211, 212) inside the housing 1, a second storage compartment (for example, vegetable compartment 25) having a second door (for example, vegetable compartment door 251) inside the housing 1, and a lighting unit provided outside the housing 1 and having a lighting direction changing mechanism 33 that illuminates the first storage compartment when the first door is open, does not illuminate a part of the first door when the second door is open, and illuminates the second storage compartment. When the photographing unit photographs the second storage compartment with the first door closed, the lighting unit changes its direction so as to illuminate the second storage compartment. Thereby, the storage compartment can be appropriately photographed.
[0066] (Application to Others) In the first embodiment and the second embodiment, the refrigerator 100 having one French door has been described, but it is not limited to this. For example, the present embodiment can also be applied to a refrigerator having two French doors.
[0067] FIG. 13 is an explanatory view of a four-door type refrigerator 100A. FIG. 13 shows a front view 13A of the refrigerator 100A, a side cross-sectional view 13B of the refrigerator 100A, and a front view 13C of the left door of the lower French door (French door) of the refrigerator 100A in an open state.
[0068] The refrigerator 100A includes a first storage compartment 26 having a first French door (doors 261, 262), and a second storage compartment 27 having a second French door (doors 271, 272). A plurality of door pockets 271c for storing food and the like are provided on the inner plate of the door 271 of the second storage compartment 27. An ice making unit 274 is provided above the door pocket 271c. A plurality of drawer containers 273 are stored in the second storage compartment 27. Further, a control panel 6A is provided on the surface of the door 261.
[0069] The camera unit 3 shown in FIG. 13 is configured to photograph the storage compartment when a predetermined door is opened, and is provided on the upper side of the housing.
[0070] The refrigerator 100A, which is a storage refrigerator, includes a photographing unit (for example, image sensor 31d) provided outside the housing, a first storage compartment 26 having a first door (doors 261, 262) inside the housing, a second storage compartment 27 inside the housing, and an illumination unit (for example, camera LED 31f) provided outside the housing and configured to illuminate at least a part of the first door when the photographing unit photographs the second storage compartment with the first door closed. When the photographing unit photographs the second storage compartment with the first door closed, the illumination unit lights up darker or turns off than when the first door is open. Thereby, white flying due to reflection from the first door can be prevented, and the storage compartment can be appropriately photographed.
[0071] In the above embodiment, the case where a fisheye lens is used as the lens 31a (see FIG. 7) of the camera unit 3 has been described, but the present invention is not limited to this. For example, a general lens other than the fisheye lens may be used as the lens 31a of the camera unit 3.
[0072] Also, the refrigerators 100, 100A, etc. described in each embodiment are examples, and the present invention can also be applied to other types of refrigerators. For example, the present invention can also be applied to a refrigerator having a single-opening type refrigerator door (not shown) or a portable refrigerator (not shown).
[0073] Also, the "storage" to which each embodiment is applicable is not limited to a refrigerator. In this case, the housing of the "storage" may have a configuration without a particular distinction such as an outer box and an inner box. Further, each embodiment can also be applied to a freezer or a storage cabinet as the "storage".
[0074] Also, the program executed by the control unit 8 (see FIG. 7) and the server 63 (see FIG. 7) can be provided via a communication line, and can also be written on a recording medium such as a CD-ROM and distributed. Also, each embodiment is described in detail for easy understanding of the present invention, and is not necessarily limited to the one having all the configurations described. Also, it is possible to add, delete, or replace a part of the configuration of the embodiment with another configuration. Also, the mechanisms and configurations described above show those considered necessary for explanation, and not necessarily all the mechanisms and configurations are shown in the product.
Explanation of Reference Numerals
[0075] 1 Housing 3 Camera unit (imaging unit) 4 Wireless LAN unit 5, 52, 53, 54, 55 Door sensor 6 Control panel 7 Imaging button 8 Control unit 21 Refrigerating chamber (storage chamber, first storage chamber) 22 Ice-making chamber (storage chamber, second storage chamber, drawer-type storage chamber) 23 Upper freezer (storage chamber, second storage chamber, drawer-type storage chamber) 24 Lower freezer (storage chamber, second storage chamber, drawer-type storage chamber) 25 Vegetable chamber (storage chamber, second storage chamber, drawer-type storage chamber) 31a Lens 31f Camera LED (lighting unit, external lighting unit) 33 Lighting direction changing mechanism 61 Router 62 Network 63 Server 64 Mobile terminal 211, 212 Refrigerator door (door, French door, French-style door, first door) 221 Ice-making compartment door (door, drawer-type door) 231 Upper freezer compartment door (door, drawer-type door) 241 Lower freezer compartment door (door, drawer-type door) 251 Vegetable compartment door (door, drawer-type door) 100, 100A Refrigerator (storage)
Claims
1. A photographing unit provided outside the housing, a first storage chamber having a first door inside the housing, a second storage chamber inside the housing, an illumination unit provided outside the housing, which illuminates at least a part of the first door when it lights up when the photographing unit photographs the second storage chamber with the first door closed, and a storage cabinet in which, when the photographing unit photographs the second storage chamber with the first door closed, the illumination unit lights up darker or goes out than when the first door is open.
2. A photographing unit provided outside the housing, a first storage chamber having a first door inside the housing, a second storage chamber having an internal illumination unit inside the housing, an external illumination unit provided outside the housing, and a storage cabinet in which the external illumination unit lights up when photographing the first storage chamber, and the internal illumination unit lights up when photographing the second storage chamber.
3. A photographing unit provided outside the housing, a first storage chamber having a first door inside the housing, a second storage chamber having a second door inside the housing, an illumination unit provided outside the housing, having an illumination direction changing mechanism so as to illuminate the first storage chamber with the first door open, and when the second door is open, not illuminate a part of the first door and illuminate the second storage chamber, and a storage cabinet in which, when the photographing unit photographs the second storage chamber with the first door closed, the illumination unit changes its direction so as to illuminate the second storage chamber.
4. The first door is made of black glass on its surface The storage cabinet according to any one of Claims 1 to 3, characterized in that.
5. The second storage chamber is a drawer-type storage chamber that is pulled out to the front side of the housing The storage cabinet according to any one of Claims 1 to 3, characterized in that.
6. The second storage chamber is a storage chamber having a French door The storage cabinet according to any one of Claims 1 to 3, characterized in that.
Citation Information
Patent Citations
Imaging system
JP2009111656A
Cold storage
JP2016031222A
Refrigerator
JP2020197373A
Refrigerator and system
JP2021096066A
Method for processing image data in refrigerator and refrigerator
JP2022035347A