Storage and Camera Unit

Abstract

To provide a storage cabinet, etc., that prevent an inappropriate photographic image from being transmitted to a server.SOLUTION: A refrigerator 100 comprises a case comprising a refrigerating chamber, a refrigerating chamber door for closing an opening of the case, a door pocket installed on the interior side of the refrigerating chamber door, and a camera unit 3 installed outside the case, and for photographing at least the refrigerating chamber, and comprises a control unit 8 for preventing a photographic image of the camera unit 3 from being displayed on a portable terminal of a user when a stored object in the door pocket or the door pocket is shown in a first region in the photographic image.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The present disclosure relates to a storage cabinet or the like.

Background Art

[0002] As a technique for photographing a refrigerator compartment or the like of a refrigerator with a camera and displaying the photographing result on a user's mobile terminal, for example, the one described in Patent Document 1 is known. That is, Patent Document 1 describes "creating a new image using data of a plurality of the images photographed by the imaging unit from different angles based on the opening and closing angle of the door".

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the technique of Patent Document 1, a three-dimensional composite image is created, but there is room for simplifying the processing. As such simplification of the processing, for example, it is also conceivable to extract edges from a photographed image of a refrigerator and calculate the opening angle of the door based on the edges. However, when the exterior color of the refrigerator and the color of the inner box are similar and the luminance difference on the photographed image is small, the extraction accuracy of the edges becomes low, so further improvement is desired.

Means for Solving the Problems

[0005] The storage device according to the present disclosure includes a housing having a storage chamber, a door that closes the opening of the housing, a door pocket installed on the inner side of the door, and a camera unit installed outside the housing that photographs at least the storage chamber. The storage device also includes a control unit that, when the stored item in the door pocket or the door pocket is reflected in a first region in the captured image of the camera unit, does not display the captured image on the user's mobile terminal. , the first area is near the opening edge of the housing in the captured image, and is set on the side of the rotation axis of the door and on the storage chamber side rather than the ridge line of the opening edge. It was decided as follows.

Brief Description of the Drawings

[0006]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6A

Figure 6B

Figure 7

Figure 8

Figure 9

Figure 10A

Figure 10B

Figure 10C

Figure 10D

Figure 11A

Figure 11B

Figure 12A

Figure 12B

Figure 13

Mode for Carrying Out the Invention

[0007] ≪First Embodiment≫ FIG. 1 is a front view of a refrigerator 100 according to the first embodiment. The refrigerator 100 (storage) is a device for cooling food and the like, and includes, in addition to the housing 1, each door such as refrigerator doors 211 and 212, and a camera unit 3. The housing 1 has a plurality of storage rooms inside. In the example of FIG. 1, as storage rooms of the refrigerator 100, a refrigerator compartment 21, an ice making compartment 22 and an upper freezer compartment 23 arranged side by side on the left and right, a vegetable compartment 24, and a lower freezer compartment 25 are provided in order from the top.

[0008] The housing 1 is configured such that a heat insulating material (not shown) such as urethane foam is filled between an inner box 12 made of resin that forms a storage chamber (see FIG. 3) and an outer box 11 made of a steel plate. A plurality of openings 10a (see FIG. 2) corresponding to each chamber are provided on the front side (front surface side) of the housing 1. For example, when foods and the like are put through the opening 10a of the refrigerating chamber 21, the refrigerator doors 211 and 212 of the refrigerating chamber are opened. Further, when the refrigerator doors 211 and 212 of the refrigerating chamber are closed, the opening 10a of the refrigerating chamber 21 is in a closed state. Thus, the refrigerator doors 211 and 212 (doors) have functions such as closing the opening 10a of the housing 1.

[0009] As shown in FIG. 1, the refrigerator 100 includes left and right refrigerator doors 211 and 212 as hinge-type doors that form a refrigerating chamber 21 (storage chamber) together with the housing 1. The left refrigerator door 211 is rotatable about the axis of a hinge 211a (see FIG. 4). The same applies to the right refrigerator door 212. Further, the refrigerator 100 includes a drawer-type door, and in addition to an ice-making chamber door 221 and an upper-stage freezing chamber door 231, also includes a vegetable chamber door 241 and a lower-stage freezing chamber door 251.

[0010] The refrigerating chamber 21 is provided with a plurality of shelf plates 213 (see FIG. 3) that partition the refrigerating chamber 21 into a predetermined configuration. A plurality of door pockets 211c (see FIG. 3) for storing foods and the like are installed on the inner side of the left refrigerator door 211 (door) (the same applies to the right refrigerator door 212). The ice-making chamber 22 shown in FIG. 1 is provided with an ice-making chamber container (not shown) that is pulled out integrally with the ice-making chamber door 221. Similarly, the upper-stage freezing chamber 23 is provided with an upper-stage freezing chamber container (not shown), and the vegetable chamber 24 is provided with a vegetable chamber container (not shown). Further, the lower-stage freezing chamber 25 is provided with a lower-stage freezing chamber container (not shown).

[0011] The refrigerator 100 includes, although not shown in the figures, a compressor, a radiator (condenser), a capillary tube (throttling mechanism), and an evaporator. Refrigerant circulates sequentially through the compressor, radiator, capillary tube, and evaporator, and the air in the storage compartment is cooled by heat exchange with the refrigerant flowing through the evaporator. The camera unit 3 shown in FIG. 1 photographs at least the storage compartment (e.g., the refrigerator compartment 21) of the refrigerator 100 and is installed outside the housing 1 (on the upper side of the housing 1 in FIG. 1).

[0012] FIG. 2 is a side view of the refrigerator 100. As shown in FIG. 2, the camera unit 3 includes a main body portion 31 and a support portion 32. The main body portion 31 photographs the storage compartment of the refrigerator 100 and the like. The support portion 32 supports the main body portion 31 and is installed on the upper surface of the housing 1.

[0013] Near the front end of the main body portion 31, a lens 31a (also see FIG. 5) is installed. The lens 31a is an optical element that refracts and focuses light and is installed so as to face downward. As such a lens 31a, for example, a fish-eye lens is used, but it is not limited thereto.

[0014] As shown in FIG. 2, the lens 31a is located in front of the front end of the housing 1 (i.e., the opening 10a). More preferably, the lens 31a is located further in front of the front surfaces of the closed refrigerator compartment doors 211, 212 (see FIG. 1). Thereby, for example, when the refrigerator compartment doors 211, 212 are opened, the refrigerator compartment 21 easily enters the field of view of the lens 31a. It is also possible to photograph the vegetable compartment 24 etc. (see FIG. 1) with the camera unit 3 when a drawer-type door such as the vegetable compartment door 241 is open.

[0015] FIG. 3 is a front view of the refrigerator 100 with the left and right refrigerator compartment doors 211, 212 opened. As shown in FIG. 3, a plurality of door pockets 211c for storing food and the like are provided on the inner plate 211b of the left refrigerator door 211 (the same applies to the right refrigerator door 212). When the left and right refrigerator doors 211 and 212 are opened, the food and the like in the refrigerator compartment 21 and the door pockets 211c and 212c are panoramically within the field of view of the lens 31a of the camera unit 3 (see also FIG. 8).

[0016] Near the edge of the inner plate 211b of the left refrigerator door 211, a square frame-shaped packing 211d is installed. The packing 211d is a resin member for enhancing the airtightness of the refrigerator compartment 21. When the refrigerator door 211 is closed, the packing 211d comes into contact (adheres) with the periphery of the opening 10a of the housing 1 (see FIG. 4).

[0017] The side piece 211e shown in FIG. 3 is a plate-shaped member forming the side surface of the refrigerator door 211 and extends longitudinally in the vertical direction. The refrigerator door 211 includes, in addition to the side piece 211e provided on the side opposite to the axis of the hinge 211a (see FIG. 4), another side piece 211f (see FIG. 4) provided near the axis of the hinge 211a. These side pieces 211e and 211f (see FIG. 4) both extend in the vertical direction and are provided parallel to the axis of the hinge 211a (see FIG. 4). The same applies to the right refrigerator door 212.

[0018] Also, when manually photographing the refrigerator compartment 21 using the camera unit 3, photographing buttons 5 pressed by the user are installed one by one on the left and right refrigerator doors 211 and 212. In the example of FIG. 3, the photographing buttons 5 are installed one by one at the lower parts of the left and right side pieces 211e and 212e.

[0019] FIG. 4 is a plan view of the state in which the left and right refrigerator doors 211 and 212 of the refrigerator 100 are opened. As shown in FIG. 4, hinges 211a and 212a are installed on the upper surface of the housing 1. The left hinge 211a pivotally supports the refrigerator door 211 (the same applies to the right hinge 212a). Also, in the example of FIG. 4, in the left - right direction, the camera unit 3 is arranged slightly to the left of the center of the housing 1 of the refrigerator 100. More specifically, the camera unit 3 is arranged directly above the joint of the closed refrigerator doors 211 and 212 (see also FIG. 1). Thus, when the refrigerator doors 211 and 212 are opened, the food and the like in the door pockets 211c and 212c are likely to come into the field of view of the camera unit 3.

[0020] FIG. 5 is a perspective view of the camera unit 3 as seen from diagonally below and looking up. As shown in FIG. 5, the main body 31 of the camera unit 3 includes, in addition to the above - mentioned lens 31a (see also FIG. 2), a case 31b and an LED cover 31c. The case 31b of the main body 31 generally has an elongated rectangular parallelepiped shape in the front - rear direction. A circular hole (not shown in the figure) is provided on the lower surface near the front end of the case 31b, and the lens 31a is exposed through this hole. On the lower surface of the case 31b, behind (the back side) the lens 31a, an elongated hole in the left - right direction (not shown in the figure) is provided, and the LED cover 31c is fitted into this hole. The LED cover 31c is a translucent resin member for protecting the camera LED 31d (see FIG. 6B).

[0021] FIG. 6A is a front view of the camera unit 3. As shown in FIG. 6A, the main body 31 of the camera unit 3 is installed above the support part 32. Also, in the left - right direction, the main body 31 is installed near the center of the support part 32.

[0022] FIG. 6B is a cross - sectional view taken along the line II - II in FIG. 6A. As shown in FIG. 6B, the camera unit 3 includes, in addition to the above - mentioned lens 31a (see also FIG. 5), LED cover 31c (see also FIG. 5), case 31b, a camera LED 31d, and a circuit board 31e.

[0023] The camera LED 31d (lighting unit) is a light source that illuminates a storage compartment such as the refrigerator compartment 21. That is, the camera LED 31d is installed outside the housing 1 (in the upper side of the housing 1 in this embodiment) so that the camera unit 3 can photograph the refrigerator compartment 21 (see FIG. 3) and the door pockets 211c, 212c (see FIG. 3) under appropriate brightness. And when at least one of the refrigerator compartment doors 211, 212 (see FIG. 3) is opened, the camera LED 31d is turned on. In the example of FIG. 6B, the camera LED 31d is arranged in front of the front end (the opening 10a of the housing 1) of the housing 1 (see FIG. 2) of the refrigerator 100. That is, in a plan view, the camera LED 31d is located in front (outside) of the opening 10a (see FIG. 2) of the housing 1. As a result, the light emitted from the camera LED 31d is likely to enter the refrigerator compartment 21 and the like, so that a clear photographing result is easily obtained. A translucent LED cover 31c (see also FIG. 5) is installed below the camera LED 31d.

[0024] The circuit board 31e is a printed circuit board on which an image sensor 31f (see FIG. 7) and a camera / communication control SoC 31g (System-on-a-Chip: see FIG. 7) described later are mounted. By housing the lens 31a, the camera LED 31d, and the circuit board 31e in one case 31b in this way, the camera unit 3 can be miniaturized compared to the case where these are provided separately.

[0025] FIG. 7 is a system configuration diagram including the camera unit 3 of the refrigerator 100. As shown in FIG. 7, in addition to the camera unit 3, the refrigerator 100 includes a door sensor 4, a photographing button 5, an operation panel 6, an in-compartment light 7, a control unit 8, and a wireless LAN unit 9. The door sensor 4 outputs a predetermined signal indicating the open / closed state of the refrigerator doors 211, 212 (see FIG. 1) to the control unit 8. Although FIG. 7 shows only one door sensor 4, actually, a plurality of door sensors 4 are provided corresponding to each door of the refrigerator 100 (see FIG. 1). For example, when the left refrigerator door 211 (see FIG. 1) is opened, a predetermined open signal is output from the door sensor 4 corresponding to this refrigerator door 211 to the control unit 8.

[0026] The shooting button 5 (also see FIG. 3) is a button that is pressed by the user when manually shooting using the camera unit 3 as described above. The operation panel 6 is a panel for inputting predetermined setting information based on the user's operation. The interior light 7 is a light source that illuminates the refrigerator compartment 21 (storage compartment) and is installed on the wall of the refrigerator compartment 21.

[0027] The control unit 8 is, for example, a microcomputer and, although not shown, is configured to include electronic circuits such as a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and various interfaces. Then, the program stored in the ROM is read out and expanded in the RAM, and the CPU executes various processes. Note that the processes performed by the control unit 8 will be described later.

[0028] The camera unit 3 includes, in addition to the lens 31a (also see FIG. 6B) and the camera LED 31d (also see FIG. 6B), an image sensor 31f, a camera / communication control SoC 31g, and a buzzer 31h. The image sensor 31f is an element that photoelectrically converts the light incident through the lens 31a to generate photographed image data. As such an image sensor 31f, for example, a CCD sensor (Charge Coupled Device) or a CMOS sensor (Complementary Metal Oxide Semiconductor) is used.

[0029] The camera / communication control SoC 31g is an integrated circuit designed to integrate circuits with the functions of a microcontroller and other application functions on one chip and make them function in cooperation. The camera / communication control SoC 31g communicates with the control unit 8 as specified and outputs a shooting command to the image sensor 31f. As a result, the data of the captured image is input from the image sensor 31f to the camera / communication control SoC 31g.

[0030] The buzzer 31h emits a predetermined sound, for example, when an error occurs during shooting by the camera unit 3. Note that a predetermined sound may be emitted from the buzzer 31h when shooting starts in the camera unit 3.

[0031] The wireless LAN unit 9 transmits the data of the captured image output from the camera / communication control SoC 31g to the router 51. The router 51 is a communication relay device and transmits the data of the captured image received from the wireless LAN unit 9 to the server 53 via the network 52. The server 53 performs predetermined processing based on the data of the captured image and stores it in association with the identification information of the refrigerator 100. In addition, when the server 53 receives a request signal for a captured image (image inside the refrigerator) of the refrigerator 100 from the user's mobile terminal 54, the server 53 transmits the data of the captured image to the mobile terminal 54. As such a mobile terminal 54, in addition to mobile phones and smartphones, tablets and wearable terminals are used.

[0032] FIG. 8 shows an example of the shooting result by the camera unit in a state where image processing has not been performed. In FIG. 8, due to the relationship where the upper side of the paper is the front and the lower side of the paper is the rear, the left and right are reversed compared to FIG. 3 etc. (the same applies to FIG. 9). In the example of FIG. 8, both the left and right refrigerator doors 211, 212 are open, and in addition to the refrigerator compartment 21, the door pocket 211c of the left refrigerator door 211 and the door pocket 212c of the right refrigerator door 212 are also captured.

[0033] In particular, when a fish-eye lens is used as the lens 31a of the camera unit 3 (see FIG. 5), imaging can be performed with a wide angle of view. However, in a state where no image processing is performed, as shown in FIG. 8, linear ridgelines are imaged as curved, and even for ridgelines of the same length, the number of pixels on the captured image decreases as the distance from the camera unit 3 increases.

[0034] FIG. 9 shows a shooting result by the camera unit 3 and is an example of a state in which predetermined image processing has been performed. For example, based on the shooting result of FIG. 8, when predetermined image processing is performed by the server 53 (see FIG. 7), it is converted into a captured image (developed image) as if the refrigerator compartment 21 and the left and right refrigerator compartment doors 211 and 212 were viewed from the front. By displaying such a captured image on the mobile terminal 54 (see FIG. 7), the user can grasp at a glance what foods are stored in the refrigerator compartment 21 and the like.

[0035] Note that it is desirable to display a captured image of the state in which the refrigerator compartment doors 211 and 212 (see FIG. 3) are fully opened on the mobile terminal 54 (see FIG. 7). This is because if the opening angle of the refrigerator compartment doors 211 and 212 is too small, a part of the door pockets 211c and 212c will be reflected in the area of the refrigerator compartment 21 in the developed image as shown in FIG. 10, resulting in poor visibility. Therefore, in the first embodiment, as will be described below, when at least one of the predetermined first regions A1 to A8 (see FIG. 10A) on the captured image includes the door pockets 211c, 212c, etc. (see FIG. 3), the control unit 8 prevents the captured image from being displayed on the user's mobile terminal 54 (see FIG. 7).

[0036] By using such a method, even when the exterior color of the refrigerator 100 (for example, white) and the color of the inner box 12 (see FIG. 3) (for example, white) are similar and the luminance difference on the captured image is small, and the accuracy of edge extraction is low, the control unit 8 can appropriately detect a shortage in the opening angle of the refrigerator compartment doors 211 and 212 during shooting.

[0037] FIG. 10A is an explanatory diagram of a shooting result by the camera unit, in the case where the opening angle of the refrigerator compartment door 212 is about 70°. In addition, in FIG. 10A, due to the relationship where the upper side of the paper surface is the front and the lower side of the paper surface is the rear, the left and right sides are reversed with respect to FIG. 3 and the like (the same applies to FIGS. 10B, 10C, and 10D). The first regions A1 to A4 on the left side of the paper surface in FIG. 10A are regions on the captured image used for determining whether the opening angle of the refrigerator door 212 is insufficient, and are preset. Specifically, the first regions A1 to A4 are set near the opening edge of the housing 1 in the captured image, on the rotation axis side of the refrigerator door 212 (door). For example, when the opening angle of the refrigerator door 212 is 60° or less (when the opening angle at the time of shooting is insufficient), the end of the door pocket 212c (the end on the rotation axis side of the refrigerator door 212) often appears near the opening edge of the housing 1. Therefore, in the first embodiment, the control unit 8 (see FIG. 7) detects that the opening angle of the refrigerator door 212 is insufficient based on whether the door pocket 212c or the like appears in the first regions A1 to A4. In the example of FIG. 10A, four rectangular first regions A1 to A4 with different sizes are arranged adjacent to each other in sequence.

[0038] The first regions A5 to A8 on the right side of the paper surface in FIG. 10A are regions on the captured image used for determining whether the opening angle of the other refrigerator door 211 is insufficient, and are preset. In the example of FIG. 10A, four rectangular first regions A5 to A8 with different sizes are arranged adjacent to each other in sequence. These first regions A5 to A8 are set to be substantially symmetric in the horizontal direction with respect to the other first regions A1 to A4.

[0039] The positions and areas (number of pixels) of the first regions A1 to A8 are preset based on prior experiments or the like. Specifically, when the opening angle of the refrigerator door 212 is equal to or greater than a predetermined value (for example, 70°), as shown in FIG. 10A, the foods or the like in the door pocket 212c and the door pocket 212c itself are not reflected in any of the first regions A1 to A4, and the first regions A1 to A4 are set. Also, the first regions A1 to A4 are set so that the ridge lines (edges) near the opening of the housing 1 do not appear in the first regions A1 to A4. Note that the same applies to the other first regions A5 to A8. Hereinafter, the foods or the like stored in the door pocket 212c and the door pocket 212c are referred to as "the door pocket 212c and the like".

[0040] The rectangular second region B1 shown in FIG. 10A is a region used to determine whether the opening angle of the refrigerator door 212 is insufficient when the door pocket 212c and the like do not appear in any of the first regions A1 to A4. In the example of FIG. 10A, in the captured image, the second region B1 is set so that the ridge line R1 of the opening edge (upper edge of the opening) of the housing 1 is included. Details of the second region B1 will be described later.

[0041] FIG. 10B is an explanatory diagram of the shooting result by the camera unit when the opening angle of the refrigerator door 212 is about 60°. In the example of FIG. 10B, when the opening angle of the refrigerator door 212 becomes about 60°, a part of the can C1 (the stored item closest to the rotation axis of the refrigerator door 212) stored in the door pocket 212c is reflected in the first region A1. Note that when no foods or the like are stored in the door pocket 212c, a part of the door pocket 212c is reflected in the first region A1. Since the reflectance of light of the inner box 12 (see FIG. 3) of the housing 1 and the door pocket 212c is different, the ridge line of the door pocket 212c is extracted as a predetermined edge in the captured image.

[0042] Also, when shooting is repeated during the process of closing the refrigerator door 212 from a fully open state, the door pocket 212c, etc. often first enters the first area A1 and then sequentially enters the first areas A2, A3, and A4. In this way, a plurality of first areas A1 to A4 are set corresponding to the opening angle of the refrigerator door 212. Similarly, a plurality of first areas A5 to A8 are set corresponding to the opening angle of the other refrigerator door 211.

[0043] The control unit 8 (see FIG. 7) converts, for example, a captured image (a color image) into grayscale and further performs binarization processing. That is, the control unit 8 performs binarization processing by setting the value of pixels with a luminance of a predetermined value or more to '1' (white) and the value of pixels with a luminance less than the predetermined value to '0' (black). Then, for example, when the total number of black pixels existing inside the first area A1 is equal to or more than a predetermined value, the control unit 8 determines that the door pocket 212c, etc. are reflected in the first area A1.

[0044] In addition, when the number of consecutive black pixels in the vertical or horizontal direction in the first area A1 is equal to or more than a predetermined value (that is, there are edges in the vertical or horizontal direction), the control unit 8 may determine that the door pocket 212c, etc. are reflected in the first area A1. When the door pocket 212c, etc. are reflected in the first area A1, the control unit 8 prevents the captured image from being displayed on the user's mobile terminal 54 (see FIG. 7). Thereby, it is possible to prevent a captured image with poor visibility from being displayed on the user's mobile terminal 54 (see FIG. 7).

[0045] FIG. 10C is an explanatory diagram of the shooting result by the camera unit when the opening angle of the refrigerator door 212 is about 20°. In the example of FIG. 10C, the edge of the can C2 is reflected in the first area A2, and the edges of the cans C1 are reflected in the other first areas A3 and A4. When the door pocket 212c, etc. are reflected in the first area A2 in this way, the control unit 8 prevents the captured image from being displayed on the user's mobile terminal 54 (see FIG. 7).

[0046] FIG. 10D is an explanatory diagram of a shooting result by the camera unit when the opening angle of the refrigerator door 212 is about 15°. As shown in FIG. 10D, when the opening angle of the refrigerator door 212 becomes considerably small, all of the first regions A1 to A4 may be included in the portion where the upper surface of the refrigerator door 212 is imaged. As a result, the door pocket 212c or the like may not be imaged in the first regions A1 to A4. Even in such a state, a second region B1 is provided so that the control unit 8 can appropriately determine the insufficient opening angle of the refrigerator door 212 during shooting. Note that the other second region B2 is used when detecting the insufficient opening angle of the refrigerator door 211.

[0047] As described above, in the captured image, the second region B1 is set so that the ridge line R1 of the opening edge of the housing 1 enters. And even when neither food etc. (stored items) nor the door pocket 212c are imaged in the first regions A1 to A4, when the average luminance of the portion B11 (the portion indicated by dots) closer to the refrigerator door 212 (door) than the ridge line R1 in the second region B1 is equal to or lower than a predetermined value, the control unit 8 does not cause the captured image to be displayed on the user's mobile terminal 54 (see FIG. 7).

[0048] When the refrigerator door 212 is opened even slightly, a part of the refrigerator 21 (see FIG. 3) is imaged in the portion B11 closer to the refrigerator door 212 than the ridge line R1 in the second region B1. When the opening angle of the refrigerator door 212 becomes considerably small, the light from the camera LED 31d (see FIG. 6B) is blocked by the refrigerator door 212, so that the portion B11 of the second region B1 becomes dark and its luminance becomes equal to or lower than the predetermined value. Thus, even when the door pocket 212c or the like is not imaged in the first regions A1 to A4, the control unit 8 can appropriately detect the insufficient opening angle of the refrigerator door 212 by using the average luminance of the portion B11 of the second region B1.

[0049] FIGS. 11A and 11B are flowcharts of processes executed by the control unit of the refrigerator (also refer to FIG. 7 as appropriate). Note that at the time of "START" in FIG. 11A, it is assumed that the left and right refrigerator doors 211 and 212 (see FIG. 3) are in the closed state. In step S101, the control unit 8 determines whether an open signal is input from the door sensor 4. That is, the control unit 8 determines whether at least one of the left and right refrigerator doors 211, 212 (see FIG. 3) is opened. In step S101, if no open signal is input from the door sensor 4 (S101: No), the control unit 8 repeats the process of step S101. On the other hand, in step S101, if an open signal is input from the door sensor 4 (S101: Yes), the process of the control unit 8 proceeds to step S102.

[0050] In step S102, the control unit 8 turns on the camera LED 31c. As a result, since the refrigerator compartment 21 is irradiated with light, it becomes easier for the user to visually recognize the refrigerator compartment 21, and it is also possible to prepare for subsequent photographing. The camera LED 31c continues to be lit until both the left and right refrigerator doors 211, 212 are closed. When turning on the camera LED 31d, the control unit 8 may turn off the interior light 7, or may also turn on the interior light 7.

[0051] Next, in step S103, the control unit 8 performs exposure adjustment. That is, the control unit 8 adjusts the gain (sensitivity to brightness) when amplifying the electrical signal output from the image sensor 31f, and also adjusts the shutter speed of the camera unit 3. For example, the control unit 8 adjusts the above-described gain so that the average luminance of the photographed image data is within a predetermined range. By performing exposure adjustment in this way, it is possible to suppress overexposure (halation) and underexposure in the photographed image. In step S104, the control unit 8 captures the photographed image. That is, the control unit 8 captures, as a photographed image, the electrical signal output from the image sensor 31f by photoelectric conversion and further amplified with a predetermined gain.

[0052] Hereinafter, mainly the case where one of the refrigerator doors 212 (see FIG. 3) is opened will be described, but the same applies to the case where the other refrigerator door 211 (see FIG. 3) is opened. In step S105 of FIG. 11B, the control unit 8 determines whether a door pocket 212c or the like is captured in the first regions A1 to A4 (see FIG. 10A) in the captured image. If the door pocket 212c or the like is captured in at least one of the first regions A1 to A4 (S105: Yes), the process of the control unit 8 proceeds to step S107. For example, as shown in FIGS. 10B and 10C, if cans C1 and C2 are captured in at least one of the first regions A1 to A4, the process of the control unit 8 proceeds to step S107.

[0053] In step S107, the control unit 8 discards the captured result. That is, if the food or the like (stored item) in the door pocket 212c or the door pocket 212c is captured in at least one of the plurality of first regions A1 to A4 (S105: Yes), the control unit 8 does not display the captured image on the user's mobile terminal 54 (see FIG. 7). For example, when the door pocket 212c or the like is captured in at least one of the first regions A1 to A4, the control unit 8 does not transmit the data of the captured image to the server 53 (see FIG. 7), so that the captured image is not displayed on the user's mobile terminal 54 (see FIG. 7). Thereby, it is possible to prevent a captured image with poor visibility from being displayed on the user's mobile terminal 54.

[0054] Next, in step S108, the control unit 8 sounds the buzzer 31h. That is, if the food or the like (stored item) in the door pocket 212c or the door pocket 212c is captured in at least one of the first regions A1 to A4 (S105: Yes), the control unit 8 sounds the buzzer 31h. Thereby, it is possible to notify the user that an appropriate captured image was not generated in this capture. Also, in step S105, if the door pocket 212c or the like is not captured in any of the first regions A1 to A4 (S105: No), the process of the control unit 8 proceeds to step S106.

[0055] In step S106, the control unit 8 determines whether the average luminance of the portion B11 (see FIG. 10D) in the second region B1, which is closer to the refrigerator door 212 than the ridge line R1, is equal to or less than a predetermined value. If the average luminance of the portion B11 in the second region B1 is equal to or less than the predetermined value (S106: Yes), the control unit 8 discards the imaging result (S107) and sounds the buzzer 31h (S108). This can prevent a captured image with poor visibility from being displayed on the user's mobile terminal 54.

[0056] Also, in step S106, if the average luminance of the portion B11 in the second region B1 is higher than the predetermined value (S106: No), the process of the control unit 8 proceeds to step S109. In step S109, the control unit 8 stores the imaging result. This is because there is a high possibility that the refrigerator doors 211 and 212 are fully opened. After performing the process of step S108 or S109, the process of the control unit 8 proceeds to step S110.

[0057] In step S110, the control unit 8 determines whether a close signal has been input from the door sensor 4. If no close signal has been input from the door sensor 4 (S110: No), the process of the control unit 8 returns to step S104 (capturing of the captured image) in FIG. 11A. Also, in step S110 in FIG. 11B, if a close signal has been input from the door sensor 4 (S110: Yes), the process of the control unit 8 proceeds to step S111.

[0058] In step S111, the control unit 8 turns off the camera LED 31c. In step S112, the control unit 8 selects the imaging result. For example, the control unit 8 selects the latest one among the plurality of stored imaging results as the imaging result for transmission to the server 53.

[0059] In step S113, the control unit 8 transmits the imaging result to the server 53. That is, the control unit 8 transmits the data of the captured image to the server 53 via the wireless LAN unit 9, the router 51, and the network 52 shown in FIG. 7 in sequence. After performing the process of step S113, the control unit 8 ends a series of processes (END).

[0060] Note that in the server 53, in the imaging result, in addition to each area on the left side and the right side of the refrigerator compartment 21 (see FIG. 3), the area of one refrigerator compartment door 211 (see FIG. 3) and the area of the other refrigerator compartment door 212 (see FIG. 3) are extracted. And in the server 53, the images of the respective areas are updated to the latest ones individually. Further, in response to a request signal from the mobile terminal 54, the captured image data is transmitted from the server 53 to the mobile terminal 54 and is displayed on a display (not shown) of the mobile terminal 54 in a predetermined manner.

[0061] According to the first embodiment, when at least one of the first areas A1 to A4 on the captured image includes the door pockets 211c, 212c, etc., the control unit 8 does not display the captured image on the user's mobile terminal 54. Thereby, even when the exterior color of the refrigerator 100 and the color of the inner box 12 are similar and the luminance difference on the captured image is small, the control unit 8 can appropriately detect the shortage of the opening angle of the refrigerator compartment doors 211 and 212. Therefore, it is possible to prevent the captured image in a state where the opening angle of the refrigerator compartment door 212 is small from being displayed on the user's mobile terminal 54.

[0062] Also, according to the first embodiment, even when the door pocket 212c is not included in any of the first areas A1 to A4 of the captured image, when the average luminance of the portion B11 (see FIG. 10D) closer to the refrigerator compartment door 212 than the ridge line R1 in the second area B1 is equal to or lower than a predetermined value, the control unit 8 does not display the captured image on the user's mobile terminal 54. Thereby, even when the opening angle of the refrigerator compartment door 212 is considerably small, based on the average luminance of the portion B11 of the second area B1, the control unit 8 can appropriately detect the shortage of the opening angle.

[0063] ≪Second Embodiment≫ In the second embodiment, the control unit 8 corrects the positions of the first regions A1 to A4 (see FIG. 12A) based on the position of the ridge line R1 (see FIG. 12A) in the second region B1, which is different from the first embodiment. Note that other aspects are the same as those in the first embodiment. Therefore, the parts different from the first embodiment will be described, and the description of overlapping parts will be omitted.

[0064] FIG. 12A is an explanatory diagram when the camera unit is photographed while being inclined at a predetermined angle. As described above, the housing 1 of the refrigerator compartment 21 (see FIG. 2) is filled with a heat insulating material such as urethane foam. However, due to the foaming pressure of the heat insulating material, the top plate of the housing 1 may bulge slightly. As a result, the top plate of the housing 1 is not parallel to the horizontal plane. For example, the height position of the front part of the camera unit 3 (see FIG. 2) may be slightly lower than that of the rear part. In such a case, since the field of view of the camera unit 3 is shifted inward of the compartment from the original range, even when the refrigerator compartment door 212 is fully opened, the edge of the opening edge of the housing 1 may be reflected in the first regions A1 to A4.

[0065] In the example of FIG. 12A, even when the refrigerator compartment door 212 is fully opened, the vertical edge of the housing 1 is reflected in the first regions A1 to A4. Similarly, when the left refrigerator compartment door 211 is fully opened, the edge of the housing 1 may be reflected in at least one of the first regions A5 to A8.

[0066] Therefore, in the second embodiment, based on the position of the ridge line R1 in the second region B1, the control unit 8 (see FIG. 7) corrects the positions of the first regions A1 to A8 in the captured image. When the front end (or rear end) of the camera unit 3 is tilted upward, the first regions A1 to A8 and the second regions B1 and B2 are displaced by a predetermined amount from their original positions, and the amount of displacement (number of pixels) is common to the first regions A1 to A8 and the second regions B1 and B2. Therefore, for example, the amount of displacement of the second region B1 can be used to correct the positions of the first regions A1 to A8. It is also possible to use the amount of displacement of the other second region B2 to correct the positions of the first regions A1 to A8.

[0067] Figure 12B is an enlarged view of the second region B1 on the captured image. In addition, in Figure 12B, in order to clarify the position (dashed line) of the original ridge line R1, the portion B11 closer to the refrigerator door 212 than the ridge line R1 is not shown by dots. The line segment L1 shown in Figure 12 is an approximation of the ridge line R1 of the opening edge of the housing 1 included in the second region B1 by a straight line. One of the two intersections of the rectangular boundary line of the second region B1 and the line segment L1 is used to calculate the deviation amount ΔY. The "deviation amount ΔY" described above is the number of pixels by which the first regions A1 to A8 and the second regions B1 and B2 are shifted from their original positions on the captured image.

[0068] Based on Figure 12, the reference position P1 is one side of the two intersections of the ridge line R1a (dashed line) of the opening edge of the housing 1 when the camera unit 3 (see Figure 2) is not tilted and the rectangular boundary line of the second region B1, and is preset. That is, the original position of the intersection Q1 when the camera unit 3 is normally installed on the housing 1 is the reference position P1. The control unit 8 (see Figure 7) calculates the deviation amount ΔY of the first regions A1 to A8 due to the tilt of the camera unit 3 based on the number of pixels in the vertical direction between the reference position P1 and the intersection Q1. A predetermined mathematical formula or data table is preset so that the larger the number of pixels between the reference position P1 and the intersection Q1, the larger the deviation amount ΔY.

[0069] Then, the control unit 8 corrects the positions of the first regions A1 to A8 so as to cancel the deviation amount ΔY. In the example of Figure 12A, as shown by the white arrows, the positions of the first regions A1 to A8 on the captured image are each moved inward of the storage. In this way, by moving the first regions A1 to A8 to their original positions, even when the camera unit 3 is slightly tilted, the opening edge of the housing 1 is not captured in the first regions A1 to A8.

[0070] Figure 13 is a flowchart of the process executed by the control unit of the refrigerator (also refer to Figure 7 as appropriate). Note that, since steps S101 to S104 in FIG. 13 are the same as those in the first embodiment (see FIG. 11A), the description thereof will be omitted. After capturing the photographed image in step S104, the process of the control unit 8 proceeds to step S201. In step S201, the control unit 8 calculates the deviation amount ΔY. That is, the control unit 8 calculates the difference between the actual position of the intersection point Q1 between the boundary line of the second region B1 and the ridge line R1 of the opening edge of the housing 1 (approximated by the line segment L1 in the example of FIG. 12B) and a predetermined reference position P1 (see FIG. 12B), which is the position of the intersection point Q1 when the camera unit 3 is normally installed in the housing 1, as the "deviation amount ΔY".

[0071] In step S202, the control unit 8 determines whether the deviation amount ΔY exceeds the allowable range. Here, the "allowable range" is a threshold value that serves as a criterion for determining whether to correct the positions of the first regions A1 to A8 (see FIG. 12A) and is set in advance. In step S202, if the deviation amount ΔY exceeds the allowable range (S202: Yes), the process of the control unit 8 proceeds to step S203.

[0072] In step S203, the control unit 8 corrects the positions of the first regions A1 to A8 (see FIG. 12A). That is, the control unit 8 corrects the positions of the first regions A1 to A8 based on the deviation amount ΔY (difference) between the intersection point Q1 (see FIG. 12B) and the reference position P1 (see FIG. 12B). Specifically, the control unit 8 moves the positions of the first regions A1 to A8 on the photographed image so as to cancel out the deviation amount ΔY. After performing the process of step S203, the control unit 8 performs the processes of steps S105 to S113 (see FIG. 11B) in the same manner as in the first embodiment. Thereby, even when the camera unit 3 is tilted, the control unit 8 can appropriately detect the insufficient opening angles of the refrigerator doors 211 and 212.

[0073] In step S103, the control unit 8 may correct the positions of the first regions A1 to A8 and also correct the positions of the second regions B1 and B2. That is, the control unit 8 may move the first regions A1 to A8 and the second regions B1 and B2 so as to cancel the displacement amount ΔY described above. The same effect can be achieved by such processing. Also, in step S202, when the displacement amount ΔY is within the allowable range (S202: No), the control unit 8 performs the processes of steps S105 to S113 (see FIG. 11B) in the same manner as in the first embodiment without particularly correcting the first regions A1 to A8.

[0074] According to the second embodiment, even when the camera unit 3 is tilted, the first regions A1 to A8 are moved to appropriate positions, so that the insufficient opening angles of the refrigerator doors 211 and 212 can be appropriately detected.

[0075] ≪Modification Example≫ As described above, the refrigerator 100 and the like according to the present disclosure have been described in embodiments, but the present disclosure is not limited to these descriptions, and various modifications can be made. For example, in each embodiment, the case where four rectangular first regions A1 to A4 (see FIG. 10A) are set on one side in the left - right direction and four rectangular first regions A5 to A8 (see FIG. 10A) are set on the other side has been described, but the present disclosure is not limited to this. That is, the position, number, and shape of the "first region" can be appropriately changed. In such a configuration, when the stored items in the door pockets 211c and 212c or the door pockets 211c and 212c are reflected in the first region in the captured image of the camera unit 3, the control unit 8 does not display the data of the captured image on the user's mobile terminal 54. Thereby, it is possible to prevent a captured image with poor visibility from being displayed on the mobile terminal 54. Note that the position, number, and shape of the second regions B1 and B2 can also be appropriately changed.

[0076] Also, in each embodiment, although the control unit 8 detects an insufficient opening angle of the refrigerator doors 211 and 212 based on the luminance of the second regions B1 and B2 (see FIG. 10A) in addition to the luminance of the first regions A1 to A4 (see FIG. 10A), the processing related to the second regions B1 and B2 may be omitted. For example, when a plurality of captured images in which the door pockets 211c and 212c or the items stored therein are reflected in any of the first regions A1 to A4 are continuously captured, the control unit 8 may perform the following processing. That is, among the plurality of captured images described above, the control unit 8 may not transmit to the server 53 the images captured one time before (or up to a plurality of times before) based on the captured image with the earliest capture timing, and the images captured one time after (or up to a plurality of times after) based on the captured image with the latest capture timing. Thereby, it is possible to prevent the captured image in the state as shown in FIG. 10D from being displayed on the mobile terminal 54 (see FIG. 7) without particularly using the second regions B1 and B2.

[0077] Further, in the captured image of the camera unit 3, neither the food etc. (stored items) in the door pockets 211c and 212c nor the door pockets 211c and 212c are reflected in the first regions A1 to A8 (see FIG. 10A), and further, when the average luminance of the portions B11 and B21 closer to the refrigerator doors 211 and 212 than the ridge line R1 in the second regions B1 and B2 is higher than a predetermined value, the control unit 8 may display the captured image on the user's mobile terminal 54. Thereby, it is possible to display the captured image in a state where the refrigerator doors 211 and 212 are fully opened on the mobile terminal 54.

[0078] Also, in the second embodiment, although the process of correcting the positions of each of one set of first regions A1 to A4 and the other set of first regions A5 to A8 based on the position of the ridge line R1 in the second region B1 (see FIG. 12A) has been described, the present invention is not limited to this. That is, based on the position of the ridge line R1 in the second region B1 (see FIG. 12A) on one side in the left-right direction, the control unit 8 may correct the positions of the first regions A1 to A4 on one side. Similarly, based on the position of the ridge line R1 in the second region B2 (see FIG. 12A) on the other side, the control unit 8 may correct the positions of the first regions A5 to A8 on the other side.

[0079] Also, in the second embodiment, although the process in which the control unit 8 corrects the positions of the first regions A1 to A8 based on the ridge line R1 of the opening edge of the housing 1 in the second region B1 (see FIG. 12A) has been described, the present invention is not limited to this. That is, in the second region B1, based on a predetermined ridge line (edge of the housing 1) different from the opening edge of the housing 1, the control unit 8 may correct the positions of the first regions A1 to A8.

[0080] Also, in each embodiment, the case where the opening angles of the refrigerator doors 211 and 212 are not particularly calculated has been described, but the present invention is not limited to this. That is, when the control unit 8 calculates the opening angles of the refrigerator doors 211 and 212 based on the captured image, if the door pockets 211c, 212c, etc. are reflected in any of the first regions A1 to A8, the captured image may not be displayed on the user's mobile terminal 54.

[0081] Also, in each embodiment, the case where the second regions B1 and B2 (see FIG. 10A) are set so that the ridge line R1 of the opening edge of the housing 1 passes through has been described, but the present invention is not limited to this. That is, in the captured image, the second regions B1 and B2 may be set so that a part of the refrigerator compartment 21 includes all of the second regions B1 and B2. For example, when none of the door pockets 212c, etc. are reflected in any of the first regions A1 to A4, and the average luminance of the second region B1 is below a predetermined value, the control unit 8 does not display the captured image on the user's mobile terminal 54.

[0082] Further, in the case where the camera unit 3 is considerably tilted in the second embodiment, the ridge line R1 of the opening edge of the housing 1 may not be shown in the second region B1 (see FIG. 12B). In such a case, the control unit 8 may transmit a predetermined error signal to the server 53 so that an error display is performed on the user's mobile terminal 54. Thereby, the user can grasp that maintenance or replacement of the camera unit 3 is required.

[0083] Also, in the second embodiment, the case where the deviation amount ΔY is calculated based on the position of the intersection Q1 between the line segment L1 when the ridge line R1 (see FIG. 12B) is approximated by a straight line and the rectangular boundary line of the second region B1 has been described, but it is not limited to this. That is, the deviation amount ΔY may be calculated based on the position of the intersection between the ridge line R1 itself and the boundary line of the second region B1.

[0084] Also, in each embodiment, the case where the first regions A1 to A8 (see FIG. 10A) are set based on predetermined coordinates (absolute coordinates) on the captured image has been described, but it is not limited to this. For example, a predetermined marker (not shown) may be attached near the opening edge of the housing 1 on the rotation axis side of the refrigerator doors 211, 212 (doors), and the first regions A1 to A8 (see FIG. 10A) may be set based on the position of the marker in the captured image. In this way, by using the marker (not shown) attached to the housing 1 for calibration (position adjustment) of the first regions A1 to A8, the positions of the first regions A1 to A8 can be appropriately set. In addition to the position and number of the markers described above, the color, size, and material of the markers can be changed as appropriate. Also, in each embodiment, the case where the camera unit 3 is integrally installed in the refrigerator 100 has been described, but it is not limited to this. For example, the camera unit 3 may be an optional product sold as a single unit and may be configured to be detachable from the housing 1 (see FIG. 1) of the refrigerator 100.

[0085] Also, in each embodiment, although the control unit 8 (see FIG. 7) of the refrigerator 100 has been described as performing a process of detecting an insufficient opening angle of the refrigerator door 211, 212 based on the captured image, it is not limited to this. For example, when food or the like (stored items) in the door pockets 211c, 212c or the door pockets 211c, 212c are captured in the first regions A1 to A4 (see FIG. 10A) in the captured image of the camera unit 3, the camera unit 3 may be provided with a "control unit" that does not display the captured image on the user's mobile terminal 54. Even with such a configuration, the same effects as those of each embodiment can be achieved. Also, in each embodiment, although the process of the control unit 8 (see FIG. 7) not transmitting the data of the captured image to the server 53 (see FIG. 7) when detecting an insufficient opening angle of the refrigerator door 211, 212 has been described, it is not limited to this. For example, when detecting an insufficient opening angle of the refrigerator door 211, 212, when the control unit 8 transmits the captured image to the server 53, predetermined data indicating that the opening angle is insufficient may be attached to the captured image. The server 53 does not transmit the captured image with the predetermined data indicating the insufficient opening angle to the user's mobile terminal 54 (see FIG. 7). Such a process is also included in the matter of the control unit 8 not displaying a predetermined captured image on the user's mobile terminal 54.

[0086] Also, in each embodiment, although the case where a fisheye lens is used as the lens 31a (see FIG. 5) of the camera unit 3 has been described, it is not limited to this. For example, a general lens other than the fisheye lens may be used as the lens 31a of the camera unit 3.

[0087] Also, in each embodiment, although the configuration in which the camera unit 3 includes a buzzer 31h (see FIG. 7) has been described, it is not limited to this. That is, a buzzer may be installed at a predetermined position outside the camera unit 3 in the refrigerator 100.

[0088] Also, in each embodiment, the configuration in which the camera unit 3 (see FIG. 2) that generates a captured image is provided on the upper surface of the housing 1 has been described, but the present invention is not limited to this. That is, the camera unit 3 may be provided at another predetermined position outside the housing 1.

[0089] Further, in each embodiment, the refrigerator 100 including the French - style refrigerator doors 211 and 212 (see FIG. 3) has been described, but the present invention is not limited to this. For example, the embodiments can also be applied to a refrigerator having a single - opening - type refrigerator door (not shown) or a portable refrigerator (not shown). Also, the "storage device" to which each embodiment can be applied is not limited to a refrigerator. That is, the embodiments can also be applied to various types of hinged "storage devices". In this case, the housing of the "storage device" may have a configuration in which there is no particular distinction such as an outer box and an inner box. Further, for example, the embodiments can also be applied to a chest - type freezer or a storage cabinet. Also, the embodiments can be applied to a storage device having an upward - opening door (a flip - up door), a downward - opening door, a folding door, etc. Further, for example, the embodiments can also be applied to a closet having a folding door.

[0090] Also, all or part of a program that executes the method for detecting insufficient opening angles of the refrigerator doors 211 and 212 described in each embodiment may be executed by one or more computers (not shown). The above - described program can also be provided via a communication line, and can also be written on a recording medium such as a CD - ROM and distributed.

[0091] Also, each embodiment has been described in detail for the purpose of clearly explaining the present disclosure, and is not necessarily limited to those having all the configurations described. Also, for a part of the configuration of the embodiment, addition, deletion, or replacement of other configurations is possible. Also, the above - described mechanisms and configurations show those considered necessary for explanation, and not necessarily all the mechanisms and configurations are shown on the product.

Explanation of Reference Numerals

[0092] 1 Housing 3 Camera Unit 4 Door Sensor 5 Shooting Button 6 Operation Panel 7 Interior Light 8 Control Unit 9 Wireless LAN Unit 10a Opening 21 Refrigerator Compartment (Storage Compartment) 31a Lens 31d Camera LED 31h Buzzer 53 Server 54 Mobile Terminal 100 Refrigerator (Storage) 211,212 Refrigerator Door (Door) 211c,212c Door Pocket A1,A2,A3,A4 First Region B1,B2 Second Region B11,B21 Portion (Portion on the side closer to the door than the ridge line in the second region) R1 Ridge Line (Ridge line of the opening edge of the housing) P1 Reference Position Q1 Intersection Point

Claims

1. A housing having a storage room, A door that closes the opening of the housing, A door pocket installed on the inner side of the door within the storage, A camera unit installed outside the housing that captures at least the storage room, and A control unit that, when an item stored in the door pocket or the door pocket is reflected in a first area in the captured image of the camera unit, prevents the captured image from being displayed on the user's mobile terminal, The first area is near the opening edge of the housing in the captured image, on the side of the rotation axis of the door, and on the storage room side of the ridge line of the opening edge, a storage cabinet.

2. A plurality of the first areas are set, The control unit, when the stored item or the door pocket is reflected in at least one of the plurality of first areas, prevents the captured image from being displayed on the user's mobile terminal. The storage cabinet according to claim 1, characterized in that.

3. Equipped with a buzzer that emits a predetermined sound, The control unit sounds the buzzer when the stored item or the door pocket is reflected in the first area. The storage cabinet according to claim 1, characterized in that.

4. In the captured image, a second area is set so that the ridge line of the opening edge of the housing is included, Even when neither the stored item nor the door pocket is reflected in the first area, when the average luminance of the portion closer to the door than the ridge line in the second area is equal to or lower than a predetermined value, the control unit prevents the captured image from being displayed on the user's mobile terminal. The storage cabinet according to claim 1, characterized in that.

5. In the captured image, a second area is set so that the ridge line of the opening edge of the housing is included, The control unit, when neither the stored item nor the door pocket is reflected in the first area and further when the average luminance of the portion closer to the door than the ridge line in the second area is higher than a predetermined value, causes the captured image to be displayed on the user's mobile terminal. The storage cabinet according to claim 1, characterized in that.

6. In the captured image, a second area is set so that the ridge line of the opening edge of the housing is included, The control unit corrects the position of the first area based on the difference between the actual position of the intersection of the boundary line of the second area and the ridge line and a predetermined reference position that is the position of the intersection when the camera unit is normally installed on the housing. The storage device according to claim 1, characterized in that

7. When the stored item or the door pocket is reflected in the first area, the control unit does not transmit the data of the captured image to the server, so as not to display the captured image on the user's mobile terminal. The storage device according to claim 1, characterized in that

8. In the captured image, a second area is set so that the ridge line of the opening edge of the housing is included. When the ridge line is not reflected in the second area in the captured image, the control unit causes a predetermined error display to be performed on the mobile terminal. The storage device according to claim 1, characterized in that

9. A camera unit installed outside the housing of a storage device, comprising a housing having a storage chamber, a door closing the opening of the housing, and a door pocket installed on the inner side of the door inside the storage, and at least photographing the storage chamber. When the stored item in the door pocket or the door pocket is reflected in the first area in the captured image of the camera unit, the control unit is provided to prevent the captured image from being displayed on the user's mobile terminal. The first area is near the opening edge of the housing in the captured image, on the rotation axis side of the door, and on the storage chamber side of the ridge line of the opening edge. Camera unit.

10. In the captured image, a second area is set so that the ridge line of the opening edge of the housing is included. When the ridge line is not reflected in the second area in the captured image, the control unit causes a predetermined error display to be performed on the mobile terminal. The camera unit according to claim 9, characterized in that

Images