Imaging device and storage

Abstract

The present invention provides an imaging device capable of improving the convenience of a user.　The imaging device according to the present invention is for capturing an image of the interior of a storage, and comprises: a first light that illuminates the inside of the storage; and a second light that notifies the state of the imaging device.

Description

Imaging equipment and storage

[0001] The present disclosure relates to an imaging device and a storage facility.

[0002] Patent Document 1 discloses an imaging device that captures images of a refrigerator. The imaging device disclosed in Patent Document 1 includes a light emitting diode (LED), and when the imaging device captures an image of the interior of the refrigerator, the LED is turned on to illuminate the interior of the refrigerator.

[0003] Japanese Patent Application Laid-Open No. 2023-127928

[0004] The present disclosure provides an imaging device and a repository that can improve user convenience.

[0005] The photographing device according to the present disclosure is a photographing device for photographing the interior of a storage facility, and includes a first light for illuminating the interior of the storage facility and a second light for notifying the user of the status of the photographing device.

[0006] The storage facility in the present disclosure is a storage facility equipped with a camera that captures images of the interior of the storage facility, and the camera includes a first light that illuminates the interior of the storage facility and a second light that notifies the user of the status of the camera. This specification includes the entire contents of Japanese Patent Application No. 2024-027881, filed on February 27, 2024.

[0007] The photographing device and the storage cabinet according to the present disclosure are provided with the second light, which allows the user to understand the status of the photographing device, thereby improving user convenience.

[0008] 1 is a diagram showing the configuration of a management system in embodiment 1. FIG. 2 is a plan view of the photographing device in embodiment 1 as seen from the right. FIG. 3 is a perspective view of a regulating member abutting the front edge of a main box body in embodiment 1 as seen from the front left. FIG. 4 is a plan view of the refrigerator and photographing device in embodiment 1 as seen from the front. FIG. 5 is a plan view of the refrigerator and photographing device in embodiment 1 as seen from the right. FIG. 6 is a plan view of the photographing device attached to the refrigerator in embodiment 1 as seen from above. FIG. 7 is a block diagram showing the configuration related to the control system of the photographing device in embodiment 1. 9 is a table showing the correspondence between information related to check items 1 to 12 in embodiment 1. FIG. 10 is a block diagram showing the configuration of the control system of the terminal device and management server in embodiment 1. FIG. 11 is a flowchart showing the operation of the camera in embodiment 1. FIG. 12 is a flowchart showing the operation of the camera in embodiment 1. FIG. 13 is a flowchart showing the operation of the camera and management server in embodiment 1. FIG. 14 is a flowchart showing the operation of the terminal device and management server in embodiment 1.

[0009] (Knowledge forming the basis of the present disclosure) At the time the inventors came up with the present disclosure, there were camera devices that illuminated the interior of a refrigerator with an LED when photographing the interior. However, the inventors discovered a problem with conventional camera devices in that the user could not grasp the status of the camera, such as whether the camera device was wirelessly connected to an external device or whether the camera device was in an error state, and there was room for improvement in convenience. In order to solve this problem, the inventors came up with the subject matter of the present disclosure. Therefore, the present disclosure provides a camera device and a storage unit that can improve user convenience.

[0010] Hereinafter, embodiments will be described in detail with reference to the drawings. However, more detailed description than necessary may be omitted. For example, detailed description of already well-known matters or redundant description of substantially the same configuration may be omitted. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0011] (Embodiment 1) [1-1. Configuration] [1-1-1. Configuration of management system] Fig. 1 is a diagram showing the configuration of management system 1 in embodiment 1. Management system 1 is a system that manages items stored in refrigerator 2 and imaging device 3 that photographs refrigerator 2. Management system 1 of this embodiment manages images of items stored in refrigerator 2 as an example of managing items. Note that management of items by management system 1 is not limited to these images, and other targets such as expiration dates of items, dates of arrival and departure of items, and types of items may also be managed. Refrigerator 2 is an example of a "storage room."

[0012] In this embodiment, the items stored in the refrigerator 2 include food items, containers for storing food items, etc. The items may be marked with a predetermined marker.

[0013] The management system 1 includes a refrigerator 2. The refrigerator 2 includes a main box 20 with an open front. The main box 20 includes a refrigerator compartment 21, an ice making compartment 22, a fresh freezing compartment 23, a freezer compartment 24, and a vegetable compartment 25. These compartments are cooled with cold air. A revolving door 21A is installed at the opening in the front of the refrigerator compartment 21. The door 21A includes a revolving right door 21B and a revolving left door 21C. The ice making compartment 22, the fresh freezing compartment 23, the freezer compartment 24, and the vegetable compartment 25 are each equipped with a drawer 22A, 23A, 24A, or 25A capable of storing items. Each of the drawers 22A to 25A has an open top when installed. Hereinafter, when the drawers 22A, 23A, 24A, and 25A are collectively referred to without distinction, they will be designated by the symbol "26A" and referred to as "drawer 26A."

[0014] The management system 1 includes a photographing device 3. The photographing device 3 is detachably provided on the top surface 20A of the main box body 20 of the refrigerator 2. The photographing device 3 photographs the refrigerator 2.

[0015] The management system 1 includes a terminal device 4. The terminal device 4 is a portable computer such as a smartphone. An application program related to management of items stored in the refrigerator 2 is installed on the terminal device 4, and the terminal device 4 communicates with the management server 5 using the functions of this application program. In the following description, this application program is referred to as a "management app" and is denoted by the reference number "411."

[0016] 1, a user P who is at home is indicated by a solid line, and a user P who has left home H is indicated by a dotted line. When used by a user P who is at home, the terminal device 4 communicates with the management server 5 via the communication device 6 or without the communication device 6. When used by a user P who has left home H and a communication connection with the communication device 6 cannot be established, the terminal device 4 communicates with the management server 5 without the communication device 6. The communication device 6 is an example of an "external device."

[0017] The communication device 6 is connected to a network NW configured by a public line network or the like, and communicates with the management server 5 via the network NW. The communication device 6 functions as an interface device for connecting the refrigerator 2, the image capturing device 3, and the terminal device 4 to the network NW. The communication device 6 establishes a local network in the home H.

[0018] The management system 1 includes a management server 5. The management server 5 is a server device that manages the items stored in the refrigerators 2 and the image capture devices 3. The management server 5 is connected to a network NW. Note that in each figure, the management server 5 is represented by a single block, but this does not necessarily mean that the management server 5 is composed of a single device.

[0019] [1-1-2. Configuration of the Camera] The configuration of the camera 3 will be described with reference to Figs. 2 to 6. Figs. 2 to 6 illustrate the X-axis, Y-axis, and Z-axis. The X-axis, Y-axis, and Z-axis are perpendicular to one another. The Z-axis indicates the up-down direction, and corresponds to the height direction of the camera 3 in the installed state. The X-axis and Y-axis are parallel to the horizontal direction. The X-axis indicates the left-right direction. The left-right direction corresponds to the left-right direction of the camera 3 in the installed state, in other words, the width direction of the camera 3. The Y-axis indicates the front-to-back direction. The positive direction of the X-axis indicates the right direction. The positive direction of the Y-axis indicates the forward direction. The positive direction of the Z-axis indicates the upward direction.

[0020] Fig. 2 is a plan view of the camera device 3 attached to the refrigerator 2, seen from the right. Fig. 3 is a perspective view of the restricting member 34 abutting against the front edge 20B of the main box body 20, seen from the left front.

[0021] 2 and 3 , the photographing device 3 includes a main body 30 installed on the top surface 20A of the main box 20, and a photographing member 31 extending forward from the main body 30. The photographing member 31 is provided above the front of the main body 30.

[0022] The main body 30 has an operation unit 32 for accepting operations on a front surface 30A. The operation unit 32 includes a power button 32A for turning the power of the photographing device 3 on and off, a communication connection button 32B for wirelessly connecting the photographing device 3 and the communication device 6, and a shooting start button 32C for starting shooting with the photographing device 3. The power button 32A, communication connection button 32B, and shooting start button 32C are arranged in this order from left to right.

[0023] The main body 30 is provided with a notification LED (Light emitting diode) 33 on the front surface 30A, which notifies the user of the status of the image capturing device 3. The notification LED 33 is provided between the power button 32A and the communication connection button 32B in the left-right direction. The notification LED 33 is a group of LEDs made up of LEDs of multiple colors. The notification LED 33 corresponds to an example of a "second light." The notification LED 33 is preferably provided in a location that is not affected by the interior LED 308, which will be described later. For example, the notification LED 33 emits light in the front-to-rear direction of the refrigerator, while the interior LED 308 emits light downward. This prevents a decrease in the user P's visibility of the notification LED 33.

[0024] The arrangement order of the power button 32A, communication connection button 32B, shooting start button 32C, and notification LED 33 on the front surface 30A is not limited to the order shown in FIG. 3, and may be any order.

[0025] The main body 30 includes a regulating member 34. The regulating member 34 abuts against the front edge 20B of the main box body 20 to regulate the position of the imaging member 31 in the front-to-rear direction of the refrigerator 2. The regulating member 34 is a piece extending from the bottom surface 30B of the main body 30. The regulating member 34 extends in the width direction of the main body 30 (the width direction of the imaging device 3) on the front surface 30A of the main body 30, and has a mark 35 at the center in the width direction of the main body 30. The mark 35 indicates the center in the width direction of the imaging device 3. The length of the regulating member 34 extending from the bottom surface 30B is shorter than the length from the top surface 20A of the main box body 20 to a door gasket that is provided at the upper part of the inner surface of the door 21A and is approximately parallel to the top surface 20A.

[0026] Fig. 4 is a plan view of the refrigerator 2 and the camera device 3 attached to the refrigerator 2, viewed from the front. The refrigerator 2 shown in Fig. 4 has its door 21A open. Fig. 5 is a plan view of the refrigerator 2 and the camera device 3 attached to the refrigerator 2, viewed from the right. The refrigerator 2 shown in Fig. 5 has its drawer 25A open, i.e., pulled out. Fig. 6 is a plan view of the camera device 3 attached to the refrigerator 2, viewed from above.

[0027] The photographing device 3 includes a wide-angle camera 301 and a narrow-angle camera 302. The wide-angle camera 301 and the narrow-angle camera 302 are installed at the front end of the lower surface 31A of the photographing member 31. When the photographing device 3 is attached to the refrigerator 2 and the door 21A is closed, the wide-angle camera 301 and the narrow-angle camera 302 are located in front of the door 21A.

[0028] Wide-angle camera 301 has a wider angle than narrow-angle camera 302. When imaging device 3 is attached to refrigerator 2, wide-angle camera 301 captures images of refrigeration compartment 21 from above and in front of refrigerator 2. For example, the imaging range of wide-angle camera 301 includes range A1 shown in FIG. 4 when viewed from the front of refrigerator 2. Range A1 is a range that includes door pockets 21D of right door 21B and left door 21C and the opening of refrigeration compartment 21 when right door 21B and left door 21C are fully open. Furthermore, the imaging range of wide-angle camera 301 includes range A3 shown in FIG. 5 when viewed from the right of refrigerator 2. Range A3 is a range that includes, in the front-to-back direction, the front ends of right door 21B and left door 21C in the open state to the front end of shelf 21E, and also includes the opening of refrigeration compartment 21 in the up-down direction.

[0029] Narrow-angle camera 302 has a narrower angle than wide-angle camera 301. When imaging device 3 is attached to refrigerator 2, narrow-angle camera 302 captures an image of drawer 26A from above and in the front of refrigerator 2. For example, the imaging range of narrow-angle camera 302 includes range A2 shown in FIG. 4 when viewed from the front of refrigerator 2. Range A2 is a range that includes drawer 26A when viewed from the front of refrigerator 2. Also, for example, the imaging range of narrow-angle camera 302 includes range A4 shown in FIG. 5 when viewed from the right of refrigerator 2. Range A4 is a range that includes drawer 26A when it is pulled out to the furthest position in the front-to-back direction.

[0030] The photographing device 3 includes a first distance measurement sensor 303 and a second distance measurement sensor 304. The first distance measurement sensor 303 and the second distance measurement sensor 304 are installed on the main body 30. The first distance measurement sensor 303 is a distance measurement sensor for detecting whether the right door 21B is open or closed. The first distance measurement sensor 303 is, for example, an optical sensor that emits infrared rays. The first distance measurement sensor 303 detects the distance between the right door 21B and itself and outputs a detection value indicating the detected distance. The sensing target of the first distance measurement sensor 303 is a portion of the right door 21B above the upper door gasket. The second distance measurement sensor 304 is a sensor for detecting whether the left door 21C is open or closed. The second distance measurement sensor 304 is, for example, an optical sensor that emits infrared rays. The second distance measurement sensor 304 detects the distance between the left door 21C and itself and outputs a detection value indicating the detected distance. The sensing target of the second distance measurement sensor 304 is the portion of the left door 21C above the upper door packing.

[0031] The imaging device 3 includes a thermopile 305. The thermopile 305 is a sensor for detecting whether the drawer 26A is open or closed. The thermopile 305 is installed at the front end of the lower surface 31A of the imaging member 31. The thermopile 305 outputs a detection value indicating the detected temperature.

[0032] The photography device 3 is equipped with a first interior LED 306 and a second interior LED 307. The first interior LED 306 is installed at the right front end of the underside 31A of the photography member 31 and illuminates the interior of the refrigerator 2. When installed, the optical axis of the first interior LED 306 faces the refrigerator 2. The area illuminated by the first interior LED 306 includes, for example, the door pocket 21D of the right door 21B in the open state, the opening on the front of the refrigeration compartment 21, and the drawer 26A when pulled out to the fullest extent, when viewed from the front of the refrigerator 2.

[0033] The second interior LED 307 is installed at the left front end of the underside 31A of the imaging member 31 and illuminates the interior of the refrigerator 2. When installed, the optical axis of the second interior LED 307 faces the refrigerator 2. When viewed from the front of the refrigerator 2, the area illuminated by the second interior LED 307 includes, for example, the door pocket 21D of the left door 21C in the open state, the opening on the front of the refrigeration compartment 21, and the drawer 26A when pulled out to the fullest extent.

[0034] Hereinafter, when there is no need to distinguish between the first interior LED 306 and the second interior LED 307, they will be referred to as the "interior LED 308" by adding the reference number "308". The interior LED 308 is an example of a "first light". Furthermore, below, when there is no need to distinguish between the wide-angle camera 301 and the narrow-angle camera 302, they will be referred to as the "camera 309" by adding the reference number "309".

[0035] 7 and 8 are block diagrams showing the configuration related to the control system of the image capturing device 3. As shown in Fig. 7 and Fig. 8, the image capturing device 3 includes a power supply control board 310, an operation and display board 311, a sensor board 312, and a control board 313. Note that the functions of the power supply control board 310, the operation and display board 311, the sensor board 312, and the control board 313 of the image capturing device 3 may be performed by other boards.

[0036] The power supply control board 310 is a board that controls the power supply of the imaging device 3. The power supply control board 310 performs processes such as smoothing, rectification, and voltage conversion on the power supplied from a commercial power source, and supplies the processed power to each part of the imaging device 3.

[0037] The operation display board 311 is a board to which are connected a power button 32A, a communication connection button 32B, a shooting start button 32C, and a notification LED 33. The operation display board 311 includes a first processor 100 such as a CPU (Central Processing Unit), a first memory 110, a first communication module 120, and an interface circuit to which other devices and sensors are connected.

[0038] The first memory 110 is a storage device that stores programs and data executed by the first processor 100. The first memory 110 is configured by a non-volatile storage device such as a read-only memory (ROM). The first memory 110 includes a volatile storage device that configures a work area for the first processor 100, such as a random access memory (RAM). The first memory 110 stores data processed by the first processor 100 and a control program 111 executed by the first processor 100.

[0039] The first communication module 120 includes hardware such as a communication circuit and a connector that conforms to a predetermined wired communication standard, and communicates with each board included in the image capturing device 3 under the control of the first processor 100 .

[0040] The first processor 100 reads and executes the control program 111 to function as an operation display communication unit 101 and a notification LED control unit 102. The notification LED control unit 102 is an example of a "second light control unit."

[0041] The operation display communication unit 101 communicates with each board included in the image capturing device 3 via the first communication module 120. When the power button 32A is operated, the operation display communication unit 101 transmits a signal indicating that the power button 32A has been operated to the power supply control board 310. The power supply control board 310 turns the power of the image capturing device 3 on and off in response to the signal transmitted from the operation display communication unit 101. When the communication connection button 32B is operated, the operation display communication unit 101 transmits a signal indicating that the communication connection button 32B has been operated to the control board 313. When the shooting start button 32C is operated, the operation display communication unit 101 transmits a signal indicating that the shooting start button 32C has been operated to the control board 313.

[0042] The notification LED control unit 102 controls the lighting state of the notification LED 33. That is, the notification LED control unit 102 lights up the notification LED 33, blinks the notification LED 33, or turns off the notification LED 33.

[0043] The sensor board 312 is a board to which the first distance measurement sensor 303, the second distance measurement sensor 304, the thermopile 305, the first interior LED 306, the second interior LED 307, and the buzzer 314 are connected.

[0044] The sensor board 312 includes a second processor 200 such as a CPU, a second memory 210, a second communication module 220, and an interface circuit to which other devices and sensors are connected.

[0045] The second memory 210 is a storage device that stores programs and data executed by the second processor 200. The second memory 210 is configured by a non-volatile storage device such as a ROM. The second memory 210 also includes a volatile storage device such as a RAM that configures a work area for the second processor 200. The second memory 210 stores data processed by the second processor 200 and a control program 211 executed by the second processor 200.

[0046] The second communication module 220 includes hardware such as a communication circuit and a connector that conforms to a predetermined wired communication standard, and communicates with the operation display board 311 and the control board 313 under the control of the second processor 200 .

[0047] The second processor 200 reads and executes the control program 211 stored in the second memory 210, thereby functioning as a sensor communication unit 201, an interior LED control unit 202, a first error determination unit 203, and a sound output unit 204. The interior LED control unit 202 is an example of a "first light control unit".

[0048] The sensor communication unit 201 communicates with the operation display board 311 and the control board 313 via the second communication module 220. The sensor communication unit 201 transmits detection values ​​output by each sensor connected to the control board 313 to the control board 313 via the second communication module 220.

[0049] The interior LED control unit 202 controls the lighting state of the interior LED 308. That is, the interior LED control unit 202 turns on the interior LED 308, flashes the interior LED 308, or turns off the interior LED 308.

[0050] The first error determination unit 203 determines whether or not an error has occurred in the image capture device 3. The first error determination unit 203 determines the following three items.

[0051] Check item 1: Is there an abnormality in communication from the sensor board 312 to the control board 313? Check item 2: Is there an abnormality in the power supply from the control board 313? Check item 3: Is the thermopile 305 broken?

[0052] First, a description will be given of determination item 1. For example, the first error determination unit 203 determines determination item 1 by causing the sensor communication unit 201 to transmit a predetermined command to the control board 313. If the sensor communication unit 201 cannot transmit the predetermined command, the first error determination unit 203 determines that communication from the sensor board 312 to the control board 313 is abnormal.

[0053] When the first error determination unit 203 determines that communication from the sensor board 312 to the control board 313 is abnormal for determination item 1, it outputs first request information to the sensor communication unit 201. The first request information is information requesting notification that communication from the sensor board 312 to the control board 313 is abnormal. When the sensor communication unit 201 receives the first request information from the first error determination unit 203, it outputs the first request information to the operation display board 311. When the operation display communication unit 101 receives the first request information, the notification LED control unit 102 causes the notification LED 33 to rapidly blink in orange, notifying that communication from the sensor board 312 to the control board 313 is abnormal. Note that rapid blinking refers to blinking that alternates between turning on for a first period (e.g., 0.17 seconds) and turning off for the first period.

[0054] Next, determination item 2 will be described. For example, the first error determination unit 203 determines determination item 2 by determining whether the power supply voltage supplied from the control board 313 is equal to or lower than a predetermined value. If the first error determination unit 203 determines that the power supply voltage supplied from the control board 313 is equal to or lower than the predetermined value, it determines that the power supply from the control board 313 is abnormal. Note that the first error determination unit 203 may also determine that the power supply from the control board 313 is abnormal if it determines that the power supply voltage supplied from the control board 313 is equal to or higher than the predetermined value.

[0055] When the first error determination unit 203 determines that the power supply from the control board 313 is abnormal for determination item 2, it outputs second request information to the sensor communication unit 201. The second request information is information requesting notification that the power supply from the control board 313 is abnormal. When the sensor communication unit 201 receives the second request information from the first error determination unit 203, it outputs the second request information to the operation display board 311. When the operation display communication unit 101 receives the second request information, the notification LED control unit 102 lights up the notification LED 33 in orange to notify that the power supply from the control board 313 is abnormal.

[0056] Next, a description will be given of determination item 3. For example, the first error determination unit 203 determines determination item 3 by sending a predetermined command to the thermopile 305. If the first error determination unit 203 cannot send the predetermined command to the thermopile 305 or if there is no response from the thermopile 305, it determines that the thermopile 305 is faulty.

[0057] When first error determination unit 203 determines that thermopile 305 has failed for determination item 3, it outputs third request information to sensor communication unit 201. The third request information is information requesting notification that thermopile 305 has failed. When sensor communication unit 201 receives the third request information from first error determination unit 203, it outputs the third request information to operation display board 311. When operation display communication unit 101 receives the third request information, notification LED control unit 102 causes notification LED 33 to flash quickly in red to notify that thermopile 305 has failed.

[0058] The sound output unit 204 outputs sound using a buzzer 314 .

[0059] 7 and 8, the control board 313 is a board to which the wide-angle camera 301, the narrow-angle camera 302, and the wireless communication module 315 are connected. The wireless communication module 315 is a device that includes hardware such as an antenna and a wireless communication circuit.

[0060] The control board 313 includes a third processor 600 such as a CPU, a third memory 610, a third communication module 620, and an interface circuit to which other devices and sensors are connected. The third memory 610 is an example of a “storage unit.”

[0061] The third memory 610 is a storage device that stores programs and data executed by the third processor 600. The third memory 610 is configured with a non-volatile storage device such as a ROM. The third memory 610 also includes a volatile storage device such as a RAM that forms a work area for the third processor 600. The third memory 610 stores data processed by the third processor 600, a control program 611 executed by the third processor 600, an image capture device ID (Identification) 612, and setting data 613. The image capture device ID 612 is information that uniquely identifies the image capture device 3. The setting data 613 is data related to the settings of the image capture device 3. The setting data 613 has multiple setting items. In the setting data 613, a setting value is set for each setting item.

[0062] The third communication module 620 includes hardware such as a communication circuit and a connector that conforms to a predetermined wired communication standard, and communicates with the operation and display board 311 and the control board 313 under the control of the third processor 600 .

[0063] The third processor 600 functions as a first control communication unit 601, a second control communication unit 602, an open / close determination unit 603, a shooting control unit 604, a recording control unit 605, a generation unit 606, a communication determination unit 607, a second error determination unit 608, and a mode switching unit 609 by reading and executing the control program 611 stored in the third memory 610.

[0064] The first control communication unit 601 communicates with the management server 5 via the wireless communication module 315 .

[0065] The second control communication unit 602 communicates with the operation display board 311 and the control board 313 via the third communication module 620. The second control communication unit 602 receives, from the sensor board 312, detection values ​​of various sensors connected to the sensor board 312.

[0066] The open / close determination unit 603 determines whether the right door 21B is open or closed based on the detection value of the first distance measurement sensor 303 received by the second control communication unit 602. When the second control communication unit 602 receives a detection value that differs from the detection value corresponding to the closed state, the open / close determination unit 603 determines that the right door 21B is open. On the other hand, when the second control communication unit 602 receives a detection value corresponding to the closed state, the open / close determination unit 603 determines that the right door 21B is closed.

[0067] The open / close determining unit 603 determines whether the left door 21C is open or closed based on the detection value of the second distance measuring sensor 304 by the second control communication unit 602, in the same manner as the determination for the right door 21B.

[0068] The open / close determination unit 603 determines whether the drawer 26A is open or closed based on the detection value of the thermopile 305 received by the second control communication unit 602. The open / close determination unit 603 determines that the drawer 26A is open when the second control communication unit 602 receives a detection value of the thermopile 305 indicating a temperature equal to or lower than a first predetermined temperature. On the other hand, the open / close determination unit 603 determines that the drawer 26A is closed when the second control communication unit 602 receives a detection value of the thermopile 305 indicating a temperature higher than the first predetermined temperature and equal to or lower than a second predetermined temperature (a temperature higher than the first predetermined temperature). Note that the open / close determination unit 603 may also determine that the drawer 26A is open when the second control communication unit 602 receives a detection value of the thermopile 305 indicating a temperature higher than the second predetermined temperature. In addition, the open / close determination unit 603 may determine that the door 21A or the drawer 26A is in a closed state if a specified marker attached to the door 21A or the drawer 26A changes from a detectable state to an undetectable state, if the door 21A or the drawer 26A becomes unrecognizable on the image, or if the user's movements become unrecognizable on the image.

[0069] When the open / close determination unit 603 determines that the door 21A or the drawer 26A is open, the photography control unit 604 causes the wide-angle camera 301 and the narrow-angle camera 302 to start photographing. When the photography control unit 604 causes the wide-angle camera 301 and the narrow-angle camera 302 to start photographing, the second control communication unit 602 sends lighting request information to the sensor board 312. The lighting request information is information requesting that the interior LED 308 be turned on. When the sensor communication unit 201 receives the lighting request information, the interior LED control unit 202 turns on the interior LED 308.

[0070] Furthermore, when the second control communication unit 602 receives a signal indicating that the shooting start button 32C has been operated from the operation and display board 311, the shooting control unit 604 causes the wide-angle camera 301 and the narrow-angle camera 302 to start shooting. Similarly in this case, when the shooting control unit 604 causes the wide-angle camera 301 and the narrow-angle camera 302 to start shooting, the second control communication unit 602 transmits lighting request information to the sensor board 312.

[0071] Furthermore, when the open / close determination unit 603 determines that the door 21A and the drawer 26A are closed, the photography control unit 604 causes the wide-angle camera 301 and the narrow-angle camera 302 to end photography. When the photography control unit 604 causes the wide-angle camera 301 and the narrow-angle camera 302 to end photography, the second control communication unit 602 sends light-off request information to the sensor board 312. The light-off request information is information requesting that the interior LED 308 be turned off. When the sensor communication unit 201 receives the light-off request information, the interior LED control unit 202 turns off the interior LED 308.

[0072] When open / close determination unit 603 determines that door 21A or drawer 26A is open, recording control unit 605 starts recording the images captured by wide-angle camera 301 and narrow-angle camera 302. That is, recording control unit 605 starts recording recording data 614 in third memory 610. Recording data 614 includes first recording data indicating the images captured by wide-angle camera 301 and second recording data indicating the images captured by narrow-angle camera 302. Recording data 614 is an example of a "captured image."

[0073] In addition, when the second control communication unit 602 receives a signal from the operation display board 311 indicating that the shooting start button 32C has been operated, the recording control unit 605 starts recording the results of the shooting by the wide-angle camera 301 and the narrow-angle camera 302.

[0074] When the open / close determining unit 603 determines that the door 21A and the drawer 26A are closed, the recording control unit 605 ends recording of the images captured by the wide-angle camera 301 and the narrow-angle camera 302 .

[0075] If the third memory 610 already contains recorded data 614, the recording control unit 605 overwrites the recorded data 614 stored in the third memory 610 with the new recorded data 614 each time the recording control unit 605 records the recorded data 614.

[0076] Generation unit 606 generates management data D1. Management data D1 is data to be uploaded to management server 5 and is data for managing the items stored in refrigerator 2. First control communication unit 601 transmits management data D1 generated by generation unit 606 to management server 5.

[0077] The communication determination unit 607 determines whether a wireless communication connection with the communication device 6 has been set. The communication determination unit 607 references the setting data 613 and determines whether a setting value indicating that a wireless communication connection with the communication device 6 has been set is set in the wireless communication connection item. The wireless communication connection item is an item that indicates whether a wireless communication connection with the communication device 6 has been set. If a setting value indicating that a wireless communication connection has been set is not set in the wireless communication connection item, the communication determination unit 607 determines that a wireless communication connection with the communication device 6 has not been set. On the other hand, if a setting value indicating that a wireless communication connection has been set is set in the wireless communication connection item, the communication determination unit 607 determines that a wireless communication connection with the communication device 6 has been set.

[0078] When the communication determination unit 607 determines that a wireless communication connection with the communication device 6 has not been established, it outputs fourth request information to the second control communication unit 602. The fourth request information is information requesting notification that a wireless communication connection has not been established. When the second control communication unit 602 receives the fourth request information from the communication determination unit 607, it outputs the fourth request information to the operation display board 311. When the operation display communication unit 101 receives the fourth request information, the notification LED control unit 102 causes the notification LED 33 to slowly flash green to notify that a wireless communication connection has not been established. Note that the slow flashing refers to flashing that alternates between turning on for a second period (e.g., 1.0 second) longer than the first period described above and turning off for the second period.

[0079] When it is determined that a wireless communication connection with the communication device 6 has been set, the communication determination unit 607 determines whether or not a wireless communication connection with the communication device 6 has been established. The communication determination unit 607 makes this determination by, for example, causing the first control communication unit 601 to transmit a predetermined command. When the first control communication unit 601 cannot transmit the predetermined command, the communication determination unit 607 determines that a wireless communication connection with the communication device 6 has not been established.

[0080] When the communication determination unit 607 determines that it is not connected wirelessly to the communication device 6, it outputs fourth request information to the second control communication unit 602. On the other hand, when the communication determination unit 607 determines that it is connected wirelessly to the communication device 6, it outputs fifth request information to the second control communication unit 602. The fifth request information is information requesting notification that a wireless communication connection is established. When the second control communication unit 602 receives the fifth request information from the communication determination unit 607, it outputs the fifth request information to the operation display board 311. When the operation display communication unit 101 receives the fifth request information, the notification LED control unit 102 lights up the notification LED 33 in green to notify that a wireless communication connection is established.

[0081] The second error determination unit 608 determines whether or not an error has occurred in the image capture device 3. In this embodiment, the second error determination unit 608 determines the following nine items.

[0082] Judgment item 4: Is the communication device 6 malfunctioning or is the management server 5 down? Judgment item 5: Is the temperature of the control board 313 equal to or greater than the first predetermined temperature and less than the second predetermined temperature? Judgment item 6: Is the temperature of the control board 313 equal to or greater than the second predetermined temperature? Judgment item 7: Is it possible to communicate with at least one of the wide-angle camera 301 and the narrow-angle camera 302? Judgment item 8: Is there an abnormality in the communication from the control board 313 to the sensor board 312? Judgment item 9: Is there an overcurrent in the wireless communication module 315? Judgment item 10: Is the wireless communication module 315 malfunctioning? Judgment item 11: Is there an abnormality in the power supply of the control board 313? Judgment item 12: Is there an abnormality in reading data from memory?

[0083] First, a description will be given of determination item 4. For example, the second error determination unit 608 determines determination item 4 by having the first control communication unit 601 send a predetermined command to the management server 5. If the first control communication unit 601 cannot send the predetermined command or if there is no response from the management server 5, the second error determination unit 608 determines that the communication device 6 has failed or the management server 5 has gone down.

[0084] When the second error determination unit 608 determines, with regard to determination item 4, that the communication device 6 has failed or the management server 5 has gone down, it outputs sixth request information to the second control communication unit 602. The sixth request information is information requesting notification that the communication device 6 has failed or the management server 5 has gone down. When the second control communication unit 602 receives the sixth request information from the second error determination unit 608, it outputs the sixth request information to the operation display board 311. When the operation display communication unit 101 receives the sixth request information, the notification LED control unit 102 causes the notification LED 33 to slowly blink in green to notify that the communication device 6 has failed or the management server 5 has gone down.

[0085] Next, determination item 5 will be described. For example, the second error determination unit 608 determines determination item 5 by acquiring the temperature of the control board 313 using a temperature sensor or the like. If the acquired temperature of the control board 313 is equal to or greater than the first predetermined temperature and less than the second predetermined temperature, the second error determination unit 608 determines that the temperature of the control board 313 is equal to or greater than the first predetermined temperature and less than the second predetermined temperature.

[0086] With regard to determination item 5, when the second error determination unit 608 determines that the temperature of the control board 313 is equal to or greater than the first predetermined temperature and less than the second predetermined temperature, it outputs seventh request information to the second control communication unit 602. The seventh request information is information requesting notification that the temperature of the control board 313 is equal to or greater than the first predetermined temperature and less than the second predetermined temperature. When the second control communication unit 602 receives the seventh request information from the second error determination unit 608, it outputs the seventh request information to the operation display board 311. When the operation display communication unit 101 receives the seventh request information, the notification LED control unit 102 causes the notification LED 33 to flash green quickly, notifying that the temperature of the control board 313 is equal to or greater than the first predetermined temperature and less than the second predetermined temperature.

[0087] Next, a description will be given of determination item 6. For example, the second error determination unit 608 determines determination item 6 by acquiring the temperature of the control board 313 using a temperature sensor or the like. If the acquired temperature of the control board 313 is equal to or higher than a second predetermined temperature, the second error determination unit 608 determines that the temperature of the control board 313 is equal to or higher than the second predetermined temperature.

[0088] For determination item 6, when the second error determination unit 608 determines that the temperature of the control board 313 is equal to or higher than the second predetermined temperature, it outputs eighth request information to the second control communication unit 602. The eighth request information is information requesting notification that the temperature of the control board 313 is equal to or higher than the second predetermined temperature. When the second control communication unit 602 receives the eighth request information from the second error determination unit 608, it outputs the eighth request information to the operation display board 311. When the operation display communication unit 101 receives the eighth request information, the notification LED control unit 102 notifies that the temperature of the control board 313 is equal to or higher than the second predetermined temperature by rapidly flashing the notification LED 33 in red.

[0089] Next, determination item 7 will be described. For example, second error determination unit 608 determines determination item 7 by sending a predetermined command to wide-angle camera 301 and narrow-angle camera 302. If second error determination unit 608 is unable to send a predetermined command to at least one of wide-angle camera 301 and narrow-angle camera 302 or if there is no response from at least one of wide-angle camera 301 and narrow-angle camera 302, second error determination unit 608 determines that communication with at least one of wide-angle camera 301 and narrow-angle camera 302 is not possible.

[0090] When second error determination unit 608 determines, with regard to determination item 7, that communication with at least one of wide-angle camera 301 and narrow-angle camera 302 is not possible, it outputs ninth request information to second control communication unit 602. The ninth request information is information requesting notification that communication with at least one of wide-angle camera 301 and narrow-angle camera 302 is not possible. When second control communication unit 602 receives the ninth request information from second error determination unit 608, it outputs the ninth request information to operation display board 311. When operation display communication unit 101 receives the ninth request information, notification LED control unit 102 causes notification LED 33 to flash quickly in red, to notify that communication with at least one of wide-angle camera 301 and narrow-angle camera 302 is not possible.

[0091] Next, a description will be given of determination item 8. For example, the second error determination unit 608 determines determination item 8 by having the second control communication unit 602 transmit a predetermined command to the sensor board 312. If the second control communication unit 602 cannot transmit the predetermined command or if there is no response from the sensor board 312, the second error determination unit 608 determines that communication from the control board 313 to the sensor board 312 is abnormal.

[0092] When the second error determination unit 608 determines that the communication from the control board 313 to the sensor board 312 is abnormal for determination item 8, it outputs tenth request information to the second control communication unit 602. The tenth request information is information requesting notification that the communication from the control board 313 to the sensor board 312 is abnormal. When the second control communication unit 602 receives the tenth request information from the second error determination unit 608, it outputs the tenth request information to the operation display board 311. When the operation display communication unit 101 receives the tenth request information, the notification LED control unit 102 lights up the notification LED 33 normally to notify that the communication from the control board 313 to the sensor board 312 is abnormal. "Normal lighting" means, for example, lighting up the notification LED 33 in green.

[0093] Next, a description will be given of determination item 9. For example, the second error determination unit 608 determines determination item 9 by detecting the resistance value of a resistor included in the wireless communication module 315. If the obtained resistance value is equal to or greater than a predetermined value, the second error determination unit 608 determines that an overcurrent is occurring in the wireless communication module 315.

[0094] When the second error determination unit 608 determines, with regard to determination item 9, that an overcurrent is occurring in the wireless communication module 315, it outputs eleventh request information to the second control communication unit 602. The eleventh request information is information requesting notification that an overcurrent is occurring in the wireless communication module 315. When the second control communication unit 602 receives the eleventh request information from the second error determination unit 608, it outputs tenth request information to the operation display board 311. When the operation display communication unit 101 receives the eleventh request information, the notification LED control unit 102 causes the notification LED 33 to flash quickly in red, to notify that an overcurrent is occurring in the wireless communication module 315.

[0095] Next, a description will be given of determination item 10. For example, the second error determination unit 608 determines determination item 10 by sending a predetermined command to the wireless communication module 315. If the second error determination unit 608 cannot send the predetermined command to the wireless communication module 315 or if the wireless communication module 315 does not respond to the predetermined command, the second error determination unit 608 determines that the wireless communication module 315 is malfunctioning.

[0096] When the second error determination unit 608 determines that the wireless communication module 315 has failed for determination item 10, it outputs twelfth request information to the second control communication unit 602. The twelfth request information is information requesting notification that the wireless communication module 315 has failed. When the second control communication unit 602 receives the twelfth request information from the second error determination unit 608, it outputs the twelfth request information to the operation display board 311. When the operation display communication unit 101 receives the twelfth request information, the notification LED control unit 102 causes the notification LED 33 to slowly flash in red to notify that the wireless communication module 315 has failed.

[0097] Next, a description will be given of determination item 11. For example, the second error determination unit 608 determines whether the power supply voltage of the control board 313 is equal to or lower than a predetermined value, thereby determining determination item 11. If the power supply voltage of the control board 313 is equal to or lower than the predetermined value, the second error determination unit 608 determines that the power supply of the control board 313 is abnormal.

[0098] When the second error determination unit 608 determines that the power supply of the control board 313 is abnormal for determination item 11, it outputs thirteenth request information to the second control communication unit 602. The thirteenth request information is information requesting notification that the power supply of the control board 313 is abnormal. When the second control communication unit 602 receives the thirteenth request information from the second error determination unit 608, it outputs the thirteenth request information to the operation display board 311. When the operation display communication unit 101 receives the thirteenth request information, the notification LED control unit 102 lights up the notification LED 33 in red to notify that the power supply of the control board 313 is abnormal.

[0099] Next, a description will be given of determination item 12. For example, the second error determination unit 608 determines determination item 12 by reading predetermined data from the third memory 610. If the second error determination unit 608 cannot read the predetermined data from the third memory 610 or if the read predetermined data is corrupted, the second error determination unit 608 determines that the reading of the data from the third memory 610 is abnormal.

[0100] When the second error determination unit 608 determines that the reading of data from the third memory 610 is abnormal for determination item 12, it outputs fourteenth request information to the second control communication unit 602. The fourteenth request information is information requesting notification that the reading of data from the memory is abnormal. When the second control communication unit 602 receives the fourteenth request information from the second error determination unit 608, it outputs the fourteenth request information to the operation display board 311. When the operation display communication unit 101 receives the fourteenth request information, the notification LED control unit 102 causes the notification LED 33 to slowly blink in orange to notify that the reading of data from the memory is abnormal.

[0101] As described above, when an error occurs, the notification LED 33 notifies the user of the error by changing the color and lighting pattern according to the type of error. If multiple errors occur simultaneously, multiple types of request information will be sent to the operation and display board 311. In this case, the notification LED control unit 102 controls the lighting state of the notification LED 33 based on the priority order determined for each error.

[0102] 9 is a table CH showing the correspondence relationship between information related to check items 1 to 12, such as priority, type of check item, and lighting state of the notification LED 33. Table CH shown in FIG. 9 shows, for each type of check item, the priority, lighting state of the notification LED 33, and whether or not to display on the terminal device 4. Whether or not to display on the terminal device 4 indicates whether or not an error code for the error that has occurred is displayed on the terminal device 4 when an error occurs. In Table CH shown in FIG. 9, the smaller the numerical value, the higher the priority.

[0103] For example, if the first error determination unit 203 determines that an error has occurred for each of determination items 1, 2, and 3, first request information, second request information, and third request information are transmitted to the operation and display board 311. In this case, the notification LED control unit 102 changes the lighting mode of the notification LED 33 to the lighting mode corresponding to determination item 3, which has the highest priority, according to Table CH in Fig. 9. In other words, the notification LED control unit 102 causes the notification LED 33 to flash quickly in red.

[0104] The priority is determined based on the following considerations: Judgment items related to communication between the camera device 3 and the management server 5 are set to a lower priority than other judgment items. This is because even if the camera device 3 cannot communicate with the management server 5, the results of photography by the camera device 3 can be stored in the camera device 3. In other words, judgment items related to the camera device 3 being unable to take photographs are set to a higher priority.

[0105] Returning to the explanation of Fig. 8, the mode switching unit 609 switches the operation mode of the image capturing device 3 between the normal mode and the maintenance mode. The normal mode is a mode in which operations such as capturing images using the wide-angle camera 301 and the narrow-angle camera 302, communicating with the management server 5, recording, and generating the management data D1 are possible. The maintenance mode is a mode in which maintenance is performed by a service technician, and operations such as capturing images using the wide-angle camera 301 and the narrow-angle camera 302, recording, and generating the management data D1 are impossible.

[0106] When the photographing device 3 is in the normal mode, the mode switching unit 609 switches the operation mode of the photographing device 3 to the maintenance mode if a predetermined operation is performed on at least one of the power button 32A, the communication connection button 32B, and the photographing start button 32C. Here, the predetermined operation is, for example, pressing all three buttons simultaneously. Also, when the photographing device 3 is in the maintenance mode, the mode switching unit 609 switches the operation mode of the photographing device 3 to the normal mode if a predetermined operation is performed on at least one of the power button 32A, the communication connection button 32B, and the photographing start button 32C. Here, the predetermined operation is, for example, pressing all three buttons simultaneously.

[0107] 10 is a block diagram showing the configuration of the control system of the terminal device 4 and the management server 5. The management server 5 includes a server processor 50, which is a processor such as a CPU, a server memory 51, and a server communication module 52. The server processor 50 is connected to the server memory 51 and the server communication module 52.

[0108] The server memory 51 is a storage device that stores programs and data executed by the server processor 50. The server memory 51 is configured with a non-volatile storage device. The server memory 51 also includes a non-volatile storage device that constitutes a work area for the server processor 50. The server memory 51 stores data processed by the server processor 50, a control program 511 executed by the server processor 50, and a management database (DB) 512. The management DB 512 has one record for each image capturing device 3. This one record includes an image capturing device ID 612, image data of the first captured image, and image data of the second captured image. The first captured image and the second captured image will be described later.

[0109] The server communication module 52 includes a communication circuit and connectors that comply with a predetermined communication standard, and communicates with the refrigerator 2, the image capturing device 3, and the terminal device 4 via the network NW.

[0110] The server processor 50 functions as a server communication unit 501 and a server processing unit 502 by reading and executing a control program 511 stored in the server memory 51. The server communication unit 501 communicates with the image capture device 3 and the terminal device 4 via the server communication module 52. The server processing unit 502 performs various information processes using the image capture device 3 and the terminal device 4 as clients.

[0111] [1-1-5. Configuration of Terminal Device] Next, we will explain the configuration of the terminal device 4. The terminal device 4 includes a terminal processor 40, which is a processor such as a CPU, a terminal memory 41, a terminal communication module 42, and a touch panel 43.

[0112] The terminal memory 41 is a storage device that non-volatilely stores programs and data executed by the terminal processor 40. The terminal memory 41 is configured by a non-volatile storage device. The terminal memory 41 also includes RAM that forms the work area of ​​the terminal processor 40. The terminal memory 41 stores data processed by the terminal processor 40, control programs executed by the terminal processor 40, and a management application 411.

[0113] The terminal communication module 42 includes a communication circuit, a connector, etc. that comply with a predetermined communication standard, and communicates with the management server 5 under the control of the terminal processor 40. The touch panel 43 includes a display panel and a touch sensor that is provided on top of or integral with the display panel.

[0114] The terminal processor 40 functions as an application execution unit 400. The application execution unit 400 communicates with the management server 5 via the terminal communication module 42. The application execution unit 400 displays a user interface related to the management of items stored in the refrigerator 2 on the touch panel 43. In the following description, this user interface is referred to as an "application UI." By displaying the application UI, the application execution unit 400 in this embodiment displays images of items stored in the refrigerator 2, error codes of errors that have occurred in the photography device 3, and the like. The application execution unit 400 receives various inputs from the user P via the application UI.

[0115] [1-2. Operation] Next, the operation of each part of the management system 1 according to this embodiment will be described.

[0116] [1-2-1. Operation when power of camera is turned on] First, a description will be given of the operation of the camera 3 when the camera 3 is turned on. When the camera 3 is turned off, the notification LED 33 and the fridge interior LED 308 are turned off.

[0117] When the power button 32A is operated while the power of the photographing device 3 is off, the power of the photographing device 3 is turned on. As the power of the photographing device 3 is turned on, the sound output unit 204 outputs a sound, via the buzzer 314, indicating that the power of the photographing device 3 has been turned on. Also, as the power of the photographing device 3 is turned on, the notification LED control unit 102 causes the notification LED 33 to flash in white. After the notification LED 33 starts flashing in white, the notification LED control unit 102 turns off the notification LED 33 when a predetermined period has elapsed.

[0118] 11 is a flowchart FA showing the operation of the image capturing device 3. [1-2-2. Operation Related to Recording] Next, the operation related to recording of the image capturing device 3 will be described.

[0119] The open / close determining unit 603 determines whether the door 21A or the drawer 26A is in the open state (step SA1).

[0120] If the open / close determining unit 603 determines that the door 21A or the drawer 26A is not in the open state (step SA1: NO), the determination in step SA1 is performed again.

[0121] If the open / close determination unit 603 determines that the door 21A or the drawer 26A is in the open state (step SA1: YES), the photography control unit 604 causes the wide-angle camera 301 and the narrow-angle camera 302 to start photographing (step SA2).

[0122] Next, the recording control unit 605 starts recording the images captured by the wide-angle camera 301 and the narrow-angle camera 302 (step SA3).

[0123] Next, the open / close determination unit 603 determines whether the door 21A and the drawer 26A are closed (step SA4). If the open / close determination unit 603 determines that the door 21A and the drawer 26A are not closed (step SA4: NO), the open / close determination unit 603 performs the determination of step SA4 again.

[0124] On the other hand, if it is determined that door 21A and drawer 26A are closed (step SA4: YES), recording control unit 605 ends recording of the captured image (step SA5), thereby generating new recording data 614 in third memory 610.

[0125] Next, the shooting control unit 604 causes the wide-angle camera 301 and the narrow-angle camera 302 to end shooting (step SA6).

[0126] In the operation of the camera device 3 of this embodiment relating to recording, the operation shown in Fig. 12 is performed in parallel with the operation shown in Fig. 11. Fig. 12 is a flowchart FB showing the operation of the camera device 3.

[0127] The communication determination unit 607 determines whether the imaging control unit 604 has started imaging (step SB1).

[0128] If the communication determination unit 607 determines that the imaging control unit 604 has not started imaging (step SB1: NO), it performs the determination in step SB1 again.

[0129] If the communication determination unit 607 determines that the imaging control unit 604 has started imaging (step SB1: YES), the communication determination unit 607 determines whether a wireless communication connection with the communication device 6 has been established (step SB2).

[0130] If the communication determination unit 607 determines that a wireless communication connection with the communication device 6 has not been established (step SB2: NO), the notification LED control unit 102 causes the notification LED 33 to flash slowly in green (step SB3).

[0131] On the other hand, if the communication determination unit 607 determines that a wireless communication connection with the communication device 6 has been established (step SB2: YES), it determines whether or not the photographing device 3 and the communication device 6 are wirelessly connected (step SB4).

[0132] If the communication determination unit 607 determines that the photographing device 3 and the communication device 6 are not connected via wireless communication (step SB4: NO), the notification LED control unit 102 causes the notification LED 33 to flash slowly in green (step SB3).

[0133] If the communication determination unit 607 determines that the photographing device 3 and the communication device 6 are connected via wireless communication (step SB4: YES), the notification LED control unit 102 lights the notification LED 33 in green (step SB5).

[0134] The notification LED control unit 102 determines whether the photography control unit 604 has finished photography (step SB6). In this embodiment, when the photography control unit 604 finishes photography, the second control communication unit 602 transmits information indicating that photography has finished to the operation display board 311. When the operation display communication unit 101 receives this information, the notification LED control unit 102 makes a positive determination in step SB6.

[0135] If the notification LED control unit 102 determines that the photographing control unit 604 has not finished photographing (step SB6: NO), the notification LED control unit 102 performs the determination in step SB6 again.

[0136] On the other hand, if the photography control unit 604 determines that photography has ended (step SB6: YES), the interior LED control unit 202 turns off the interior LED 308 (step SB7).

[0137] Next, the notification LED control unit 102 determines whether the operation of the image capturing device 3 related to the recording has been completed (step SB8). Note that the operation of the image capturing device 3 related to the recording includes the operation of generating the recording data 614 in the third memory 614.

[0138] If the notification LED control unit 102 determines that the operation of the image capturing device 3 related to the recording has not ended (step SB8: NO), it performs the determination in step SB8 again.

[0139] On the other hand, if the notification LED control unit 102 determines that the operation of the image capturing device 3 related to the recording has not ended (step SB8: YES), it turns off the notification LED 33 (step SB9).

[0140] In step SB8, the notification LED control unit 102 may determine whether the operation of the photographing device 3 related to wireless communication processing has ended, instead of whether the operation of the photographing device 3 related to recording has ended. The wireless communication processing includes the transmission of the management data D1 in step SC6 shown in FIG. 13 .

[0141] [1-2-3. Operations Related to Transmission of Management Data] Next, operations related to transmission of management data D1 will be described. Fig. 13 is a flowchart showing the operations of the camera 3 and the management server 5. In Fig. 13, flowchart FC shows the operations of the camera 3, and flowchart FD shows the operations of the management server 5.

[0142] The generation unit 606 determines whether or not new recording data 614 has been stored in the third memory 610 (step SC1). If the generation unit 606 determines that new recording data 614 has not been stored (step SC1: NO), the generation unit 606 performs the determination of step SC1 again.

[0143] On the other hand, if the generation unit 606 determines that the recording data 614 has been stored (step SC1: YES), it selects the first captured image from the moving image indicated by the first recording data of the recording data 614 stored in the third memory 610 (step SC2).

[0144] Step SC2 will be described in detail. The first captured image is an image captured when the right door 21B and the left door 21C are open at a rotation angle of α°≦θ≦β°, and is an image in which the user P is least visible. α° is, for example, 60°. β° is, for example, 100°.

[0145] The generation unit 606 selects a captured image in which a predetermined marker attached to the door 21A appears from the video image indicated by the first recorded data. The predetermined marker is attached in advance so that it appears in the captured image when the angles of the right door 21B and the left door 21C are α°≦θ≦β°. Next, the generation unit 606 selects, from the selected captured images, the captured image in which the user P appears least as the first captured image. The generation unit 606 recognizes the user P appearing in the captured images by a method such as pattern matching, and sets the captured image in which the area of ​​the image of the recognized user P is the smallest as the captured image in which the user P appears least as the first captured image.

[0146] Returning to the explanation of the flowchart FC, the generation unit 606 selects a second captured image from the moving image represented by the second recorded data of the stored recorded data 614 (step SC3).

[0147] Step SC3 will be described in detail. The second captured image is an image in which the drawer 26A is drawn out to an extent of γ% or more, where 0% is the extent to which the drawer is drawn out when closed and 100% is the extent to which the drawer is drawn out when fully opened. The "drawer extent" refers to the extent to which the drawer is drawn out. The second captured image is also an image in which the user P is least visible. γ% is, for example, 70%.

[0148] The generation unit 606 selects a captured image in which a predetermined marker attached to the inside of the drawer 26A appears from the video image indicated by the second recording data. This predetermined marker is attached in advance so that it appears in the captured image when the drawer 26A is pulled out by γ% or more. Next, the generation unit 606 selects, from the selected captured images, the captured image in which the user P is least visible as the second captured image.

[0149] The generating unit 606 determines whether or not at least one of the first captured image and the second captured image has been selected (step SC4).

[0150] If it is determined that the first captured image and the second captured image have not been selected (step SC4: NO), the generation unit 606 performs the process of step SC1.

[0151] On the other hand, if it is determined that at least one of the first captured image and the second captured image has been selected (step SC4: YES), the generating unit 606 generates management data D1 (step SC5).

[0152] If the first captured image and the second captured image are successfully selected, the generation unit 606 generates management data D1 including image data of the first captured image, image data of the second captured image, and the camera device ID 612. If the first captured image is successfully selected but the second captured image is not successfully selected, the generation unit 606 generates management data D1 including image data of the first captured image and the camera device ID 612. If the second captured image is successfully selected but the first captured image is not successfully selected, the generation unit 606 generates management data D1 including image data of the second captured image and the camera device ID 612.

[0153] Next, the first control communication unit 601 transmits the management data D1 generated by the generation unit 606 to the management server 5 (step SC6).

[0154] As shown in flowchart FD, the server communication unit 501 determines whether or not it has received management data D1 from the image capturing device 3 (step SD1). If the server communication unit 501 determines that it has received management data D1 (step SD1: YES), the server processing unit 502 updates the management DB 512 based on the management data D1 received by the server communication unit 501 (step SD2).

[0155] Step SD2 will be described in detail. The server processing unit 502 identifies from the management DB 512 a record including the camera device ID 612 included in the management data D1, and updates the image data of the first captured image in the identified record to the image data of the first captured image included in the management data D1. The server processing unit 502 identifies from the management DB 512 a record including the camera device ID 612 included in the management data D1, and updates the image data of the second captured image in the identified record to the image data of the second captured image included in the management data D1.

[0156] As described above, in an operation related to recording, the photographing device 3 lights or blinks the notification LED 33 depending on the state of the wireless communication connection with the communication device 6. The photographing device 3 of the present embodiment lights or blinks the notification LED 33 when an error occurs, when the operation mode of the photographing device 3 is the maintenance mode, or when the recorded data 614 is deleted from the third memory 610.

[0157] [1-2-4. Operation when an error occurs] First, the operation of the imaging device 3 when an error occurs will be described. The first error determination unit 608 determines, at a predetermined cycle, whether or not an error has occurred for each of determination items 1 to 3. The second error determination unit 608 also determines, at a predetermined cycle, whether or not an error has occurred for each of determination items 4 to 12.

[0158] Then, when at least one of the first error determination unit 203 and the second error determination unit 608 determines that an error has occurred, the notification LED control unit 102 turns on or blinks the notification LED 33 based on request information received from at least one of the first error determination unit 203 and the second error determination unit 608.

[0159] [1-2-5. Operation When Operation Mode is Maintenance Mode] Next, the operation of the photographing device 3 when the operation mode of the photographing device 3 is the maintenance mode will be described. When the mode switching unit 609 switches the operation mode of the photographing device 3 to the maintenance mode, the second control communication unit 602 transmits information indicating that the operation mode of the photographing device 3 has switched to the maintenance mode to the operation display board 311. Then, when the operation display communication unit 101 receives this information, the notification LED control unit 102 lights or blinks the notification LED 33 in a manner indicating that the operation mode of the photographing device 3 is the maintenance mode. For example, the notification LED control unit 102 lights or blinks the notification LED 33 in a color different from the color used when photographing and the color used when an error has occurred. Furthermore, for example, the notification LED control unit 102 blinks the notification LED 33 at a cycle different from the cycle used when photographing and the cycle when an error has occurred.

[0160] [1-2-6. Operation When Deleting Recorded Data] Next, an operation when deleting recorded data 614 from the third memory 610 will be described. In this embodiment, when a predetermined trigger occurs, the recording control unit 605 deletes the recorded data 614 from the third memory 610. An example of this predetermined trigger is when an operation corresponding to an instruction to initialize the image capturing device 3 is performed on at least one of the power button 32A, the communication connection button 32B, and the image capturing start button 32C. Another example of this predetermined trigger is when the first control communication unit 601 receives information indicating an instruction to initialize the image capturing device 3 from the management server 5.

[0161] When the recording control unit 605 starts deleting the recorded data 614, the second control communication unit 602 transmits information indicating that the deletion of the recorded data 614 has started to the operation display board 311. Then, when the operation display communication unit 101 receives this information, the notification LED control unit 102 causes the notification LED 33 to light up or blink in a manner indicating that the recorded data 614 is being deleted. For example, the notification LED control unit 102 causes the notification LED 33 to light up or blink in different colors when recording, when an error has occurred, and when the device is in maintenance mode. Also, for example, the notification LED control unit 102 causes the notification LED 33 to blink at different cycles when recording, when an error has occurred, and when the device is in maintenance mode.

[0162] [1-2-7. Operation Related to Application UI] Next, the operation of the management system 1 related to the application UI will be described. Fig. 14 is a flowchart showing the operation of the terminal device 4 and the management server 5. In Fig. 14, flowchart FE shows the operation of the terminal device 4, and flowchart FF shows the operation of the management server 5.

[0163] As shown in flowchart FE, the application executing unit 400 determines whether to request image data stored in the management DB 512 from the management server 5 (step SE1). For example, if the management application 411 has been launched, the application executing unit 400 makes a positive determination in step SE1.

[0164] If the application execution unit 400 determines that image data stored in the management DB 512 is to be requested (step SE1: YES), the application execution unit 400 transmits request data requesting the image data to the management server 5 (step SE2). The request data includes the camera ID 612 stored in the terminal memory 41. The terminal device 4 acquires the camera ID 612 at a predetermined timing.

[0165] As shown in flowchart FF, the server communication unit 501 receives the request data (step SF1). Next, the server processing unit 502 obtains image data associated with the photographing device ID 612 included in the request data received by the server communication unit 501 from the management DB 512 (step SF2). Next, the server communication unit 501 transmits the image data obtained by the server processing unit 502 to the terminal device 4 as a response to the request data (step SF3).

[0166] Referring to flowchart FE, the application execution unit 400 receives image data from the management server 5 (step SE3). Next, the application execution unit 400 displays an application UI including an image indicated by the image data received in step SE3 on the touch panel 43 (step SE4).

[0167] [1-3. Effects, etc.] As described above, the camera device 3 that captures images of the refrigerator 2 includes the interior LED 308 that illuminates the interior of the refrigerator 2 and the notification LED 33 that notifies the user of the status of the camera device 3.

[0168] According to this, the notification LED 33 is provided, so that the user P can grasp the status of the photographing device 3. Therefore, convenience for the user P can be improved.

[0169] The photographing device 3 comprises an interior LED control unit 202 that controls the lighting state of the interior LED 308, and a notification LED control unit 102 that controls the lighting state of the notification LED 33. The photographing device 3 is capable of wireless communication with the communication device 6. When the photographing device 3 starts photographing, the interior LED control unit 202 turns on the interior LED 308 light. The notification LED control unit 102 turns on or flashes the notification LED 33 depending on the status of the wireless communication connection between the photographing device 3 and the communication device 6.

[0170] This allows the user P to know that the photographing device 3 is currently photographing while the photographing device 3 is photographing the refrigerator 2, and also to know whether the photographing device 3 is able to communicate with the communication device 6. This improves the convenience for the user P while the photographing device 3 is photographing the refrigerator 2. The user P can also know whether the photographing device 3 is able to transmit the photographed image to the outside.

[0171] The notification LED control unit 102 turns on the notification LED 33 when the photographing device 3 and the communication device 6 are connected via wireless communication, and blinks the notification LED 33 when the photographing device 3 and the communication device 6 are not connected via wireless communication.

[0172] According to this, the lighting state of the notification LED 33 differs depending on whether or not the photographing device 3 and the communication device 6 are connected by wireless communication, so the user P can accurately know whether or not the photographing device 3 and the communication device 6 can communicate.

[0173] When the photographing device 3 has finished photographing, the interior LED control unit 202 turns off the interior LED 308. The notification LED control unit 102 does not turn off the notification LED 33 even when the photographing device 3 has finished photographing, and turns off the notification LED 33 when the operation of the photographing device 3 has finished.

[0174] This allows the user P to distinguish between when the photographing device 3 is not photographing and when the photographing device 3 has finished operating. This improves convenience for the user P.

[0175] The photographing device 3 has a maintenance mode for undergoing maintenance as an operating mode. When the photographing device 3 is in the maintenance mode, the notification LED control unit 102 lights up or blinks the notification LED 33 in a manner indicating that the photographing device 3 is in the maintenance mode.

[0176] According to this, when the photographing device 3 is in the maintenance mode, the notification LED 33 lights up or flashes in a manner indicating that the photographing device 3 is in the maintenance mode, so that the user P can easily know that the photographing device 3 is in the maintenance mode. This improves convenience for the user P. Furthermore, the maintenance person can easily know whether the photographing device 3 is in a state where it will undergo maintenance, and can quickly begin maintenance of the photographing device 3.

[0177] When an error occurs in the photographing device 3, the notification LED control unit 102 lights up or blinks the notification LED 33 in a manner indicating that an error has occurred in the photographing device 3.

[0178] According to this, if an error occurs in the photographing device 3, the notification LED 33 lights up or blinks in a manner indicating that an error has occurred, so that the user P can easily know that an error has occurred in the photographing device 3. Therefore, the user P can easily know whether or not the photographing device 3 can be used, improving convenience for the user P.

[0179] The photographing device 3 includes a third memory 610 that stores recorded data 614 obtained by photographing with the photographing device 3. When the recorded data 614 is deleted from the third memory 610, the notification LED control unit 102 lights or blinks the notification LED 33 in a manner indicating that the recorded data 614 is being deleted.

[0180] According to this, when the recorded data 614 is erased, the notification LED 33 lights up or blinks in a manner indicating that the recorded data 614 is being erased, so that the user P can know whether or not the recorded data 614 has been erased. Therefore, the convenience for the user P when erasing the recorded data 614 can be improved.

[0181] (Other Embodiments) As described above, the first embodiment has been described as an example disclosed in the present application. However, the technology in the present disclosure is not limited to this, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made. It is also possible to combine the components described in the first embodiment to create new embodiments. Therefore, other embodiments will be described below as examples.

[0182] In the first embodiment described above, the refrigerator 2 and the camera device 3 are separate. In other embodiments, the refrigerator 2 may include the camera device 3. That is, in other embodiments, the refrigerator 2 and the camera device 3 may be integrated. In this case, the same effects as those of the first embodiment can be achieved.

[0183] In the first embodiment described above, the refrigerator 2 is exemplified as the "storage" of the present disclosure. However, the "storage" of the present disclosure is not limited to the refrigerator 2 and may be another storage such as a freezer or a room temperature storage.

[0184] In the first embodiment described above, the "first light" and the "second light" of the present disclosure are LEDs. However, at least one of the "first light" and the "second light" of the present disclosure may be configured with other lights such as halogen lights, incandescent lights, and HID lights instead of LEDs.

[0185] In the first embodiment described above, the image capturing device 3 is configured to determine whether 12 types of errors have occurred. In other embodiments, the number of types of errors that the image capturing device 3 determines may be fewer than 12 or more than 12. In this case, it is preferable that the lighting mode of the notification LED 33 differs for each error.

[0186] In other embodiments, the lighting pattern of the notification LED 33 during shooting is not limited to that of the first embodiment described above, and may be a different lighting color, may light and blink differently, or may have a different blinking cycle.

[0187] In other embodiments, the lighting mode of the notification LED 33 when an error occurs in the photographing device 3 is not limited to that of the first embodiment, and may be a different lighting color, may light up and blink differently, or may have a different blinking cycle. However, it is preferable that the lighting mode of the notification LED 33 be different for each error.

[0188] In another embodiment, the notification LED control unit 102 may light up or blink the notification LED 33 only when the door 21A is in the open state.

[0189] In another embodiment, captured images, which are still images captured by each of the cameras 309, may be stored in the third memory 610 instead of the video recording data 614. In this other embodiment, multiple captured images may be stored in the third memory 610 for each of the cameras 309.

[0190] In the first embodiment described above, the second interior LED 307, wide-angle camera 301, narrow-angle camera 302, thermopile 305, and first interior LED 306 are arranged in this order at the front end of the imaging member 31. However, this arrangement is merely an example, and the arrangement of these devices is not limited to that in the first embodiment.

[0191] In the first embodiment described above, the right door 21B and the left door 21C have different widths. In other embodiments, the right door 21B and the left door 21C may have the same width, or the left door 21C may have a width greater than that of the right door 21B.

[0192] In the first embodiment described above, the image capturing device 3 is configured to include the first interior LED 306 and the second interior LED 307. In other embodiments, the first interior LED 306 and the second interior LED 307 may be configured as a single LED.

[0193] In the above-described first embodiment, the sensor for detecting the open / closed state of the drawer 26A is configured with the thermopile 305. However, the sensor for detecting the open / closed state of the drawer 26A may be a distance measurement sensor. In this case, the open / close determination unit 603 determines whether the drawer 26A is open or closed based on the detection value of the distance measurement sensor. When the drawer 26A is pulled out, it detects that there has been movement. The distance measurement sensor may be an infrared type or an ultrasonic type.

[0194] In other embodiments, the camera 309 may be configured to stop recording or capturing images a predetermined time after door 21A or drawer 26A is opened. For example, the predetermined time is one minute. The predetermined time may be extended if it is detected that door 21A or drawer 26A is open, that a person is near refrigerator 2, or that user P is taking or putting items in or out. Furthermore, if it is detected that door 21A or drawer 26A is open, that a person is near refrigerator 2, or that user P is taking or putting items in or out, the camera 309 may stop recording or capturing images a predetermined time after the detection.

[0195] In another embodiment, when the open / close determination unit 603 determines that the door 21A is in the open state, the recording control unit 605 may start recording the images captured by the wide-angle camera 301 and the narrow-angle camera 302. Furthermore, when the open / close determination unit 603 determines that the drawer 26A is in the open state, the recording control unit 605 may start recording the images captured by the narrow-angle camera 302.

[0196] In another embodiment, in addition to the functional units of third processor 600 in embodiment 1, third processor 600 may function as a detection unit that detects an item. During the time from when recording control unit 605 starts recording with wide-angle camera 301 and narrow-angle camera 302 until the recording ends, the detection unit may cut out an image of an item being put in or taken out of refrigerator compartment 21 from the video. Furthermore, if a marker is attached to the item, the detection unit may detect the markered item.

[0197] In another embodiment, in addition to the functional units of third processor 600 in embodiment 1, third processor 600 may function as a person presence determination unit. In this case, image capture device 3 is equipped with a human presence sensor. The person presence determination unit determines whether a person is present around refrigerator 2 based on a detection value of the human presence sensor. More specifically, if the detection value of the human presence sensor corresponds to the presence of a person, the person presence determination unit determines that a person is present around refrigerator 2; otherwise, the person presence determination unit determines that a person is not present around refrigerator 2. When third processor 600 functions as the person presence determination unit, image capture control unit 604 causes wide-angle camera 301 and narrow-angle camera 302 to start capturing images when the human presence determination unit determines that a person is present, and causes wide-angle camera 301 and narrow-angle camera 302 to stop capturing images when the human presence determination unit determines that a person is not present. Furthermore, when the third processor 600 functions as a person presence determination unit, the recording control unit 605 starts recording when the person presence determination unit determines that a person is present, and ends recording when the person presence determination unit determines that a person is not present. This allows the results of shooting by the wide-angle camera 301 and the narrow-angle camera 302 to be appropriately recorded even if the open / close determination unit 603 makes an erroneous determination.

[0198] In the above-described embodiment, the communication device 6 is exemplified as the "external device", but in other embodiments, the "external device" may be the terminal device 4.

[0199] In another embodiment, in addition to the respective functional units of the third processor 600 in the first embodiment, the third processor 600 may also function as an inventory / retrieval determination unit. In this case, the inventory / retrieval determination unit changes the boundary line used for determining inventory / retrieval depending on the opening and closing angles of the left door 21C and the right door 21B, and determines whether an item has been retrieved. Also, the inventory / retrieval determination unit changes the boundary line used for determining inventory / retrieval depending on the degree to which the drawer 26A is pulled out, and determines whether an item has been retrieved.

[0200] In another embodiment, the first captured image may be corrected and then uploaded to the management server 5. An example of image correction is viewpoint conversion correction.

[0201] In the above-described embodiment, the first captured image and the second captured image are used for display on the terminal device 4. However, the first captured image and the second captured image may be used for other purposes, such as detecting items stored in the refrigerator 2.

[0202] In other embodiments, the number of compartments formed in the main box 20 of the refrigerator 2 may be less than or equal to the five types of compartments described above. Also, in other embodiments, the number of doors provided at the opening of the refrigeration compartment 21 may be one.

[0203] The first processor 100, the second processor 200, the third processor 300, the terminal processor 40, and the server processor 50 may be configured by a single processor or by multiple processors. These processors may be hardware programmed to realize the corresponding functional units. That is, these processors may be configured by, for example, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0204] The configurations of the various parts of the management system 1 shown in Figures 7, 8, and 10 are merely examples, and the specific implementation form is not particularly limited. In other words, it is not necessary to implement hardware corresponding to each part individually, and it is also possible to implement a configuration in which a single processor executes a program to realize the functions of each part. Furthermore, some of the functions realized by software in the above-described embodiments may be implemented by hardware, or some of the functions realized by hardware may be implemented by software.

[0205] The step units of the operations shown in Figures 11, 12, 13, and 14 are divided according to the main processing content to make the operations easier to understand, and the operation is not limited by the way the processing units are divided or the names of the processing units. The operations may be divided into more step units depending on the processing content. Furthermore, one step unit may be divided so that it includes more processing. Furthermore, the order of the steps may be changed as appropriate within the scope of the present disclosure.

[0206] It should be noted that the above-described embodiments are intended to illustrate the technology of the present disclosure, and various modifications, substitutions, additions, omissions, etc. may be made within the scope of the claims or their equivalents.

[0207] (Additional Notes) The above description of the embodiments discloses the following techniques.

[0208] (Technology 1) A photographing device for photographing the interior of a storage facility, the photographing device comprising a first light for illuminating the interior of the storage facility and a second light for notifying the user of the status of the photographing device. The provision of the second light allows the user to grasp the status of the photographing device, thereby improving user convenience.

[0209] (Technology 2) The photographing device according to Technology 1 includes a first light control unit that controls the lighting state of the first light and a second light control unit that controls the lighting state of the second light, and the photographing device is capable of wireless communication with an external device. When the photographing device starts photographing, the first light control unit turns on the first light, and the second light control unit turns on or blinks the second light depending on the status of the wireless communication connection between the photographing device and the external device. This allows a user to know that the photographing device is currently photographing while the photographing device is photographing the storage facility, and also allows the user to know whether the photographing device can communicate with the external device. This improves user convenience while the photographing device is photographing the storage facility. Furthermore, the user can know whether the photographing device is in a state where it can transmit photographed images to an external device.

[0210] (Technology 3) The photographing device according to Technology 2, wherein the second light control unit turns on the second light when the photographing device and the external device are connected via wireless communication, and blinks the second light when the photographing device and the external device are not connected via wireless communication. With this, the lighting state of the second light differs depending on whether the photographing device and the external device are connected via wireless communication, so that the user can accurately know whether the photographing device and the external device can communicate with each other.

[0211] (Technology 4) The photographing device according to Technology 2 or Technology 3, wherein the first light control unit turns off the first light when the photographing device finishes photographing, and the second light control unit does not turn off the second light even when the photographing device finishes photographing, but turns off the second light when the operation of the photographing device finishes. This allows the user to distinguish between when the photographing device is not photographing and when the photographing device has finished operating, thereby improving user convenience.

[0212] (Technology 5) The photographing device has a maintenance mode for undergoing maintenance as an operating mode, and is equipped with a second light control unit that controls the lighting state of the second light, and when the photographing device is in the maintenance mode, the second light control unit turns on or flashes the second light in a manner indicating that the photographing device is in the maintenance mode, in a photographing device described in any one of Technology 1 to Technology 4.

[0213] According to this, when the photographing device is in the maintenance mode, the second light turns on or flashes in a manner indicating that the photographing device is in the maintenance mode, so that the user can easily know that the photographing device is in the maintenance mode. This improves user convenience. Furthermore, the maintenance person can easily know whether the photographing device is in a state where maintenance is required, and can quickly begin maintenance of the photographing device.

[0214] (Technology 6) The photographing device according to any one of Technologies 1 to 5, further comprising a second light control unit that controls the lighting state of the second light, and the second light control unit, when an error occurs in the photographing device, turns on or blinks the second light in a manner indicating that an error has occurred in the photographing device. According to this, when an error occurs in the photographing device, the second light turns on or blinks in a manner indicating that an error has occurred, allowing the user to easily know that an error has occurred in the photographing device. This makes it easy to know whether the photographing device can be used, improving user convenience.

[0215] (Technology 7) The photographing device according to any one of Technology 1 to Technology 6, further comprising a second light control unit that controls the lighting state of the second light and a storage unit that stores the photographed image obtained by the photographing device, wherein the second light control unit turns on or blinks the second light in a manner indicating that the photographed image is being erased when the photographed image is erased from the storage unit. According to this, when the photographed image is erased, the second light turns on or blinks in a manner indicating that the photographed image is being erased, allowing the user to know whether the photographed image is being erased. This improves user convenience when erasing photographed images.

[0216] (Technology 8) A storage facility comprising a camera for capturing images of the interior of the storage facility, the camera comprising a first light for illuminating the interior of the storage facility and a second light for notifying the user of the status of the camera. This provides the same effects as the camera of Technology 1 described above.

[0217] As described above, the imaging device and storage cabinet according to the present invention can be used to capture images of the interior of a storage cabinet.

[0218] REFRIGERATOR REFRIGERATOR 1 Management system 2 Refrigerator (storage) 3 Photography device 4 Terminal device 5 Management server 6 Communication device (external device) 33 Notification LED (second light) 40 Terminal processor 41 Terminal memory 42 Terminal communication module 43 Touch panel 50 Server processor 51 Server memory 52 Server communication module 100 First processor 101 Operation display communication unit 102 Notification LED control unit (second light control unit) 110 First memory 111 Control program 120 First communication module 200 Second processor 201 Sensor communication unit 202 Interior LED control unit (first light control unit) 203 First error determination unit 204 Sound output unit 210 Second memory 211 Control program 220 Second communication module 300 Third processor 301 Wide-angle camera 302 Narrow-angle camera 303 First distance measurement sensor 304 Second distance measurement sensor 305 Thermopile 306 First interior fridge LED 307 Second interior fridge LED 308 Interior LED (first light) 309 Camera 310 Power supply control board 311 Operation and display board 312 Sensor board 313 Control board 314 Buzzer 315 Wireless communication module 400 App execution unit 411 Management app 501 Server communication unit 502 Server processing unit 511 Control program 512 Management DB 600 Third processor 601 First control communication unit 602 Second control communication unit 603 Open / close determination unit 604 Photography control unit 605 Recording control unit 606 Generation unit 607 Communication determination unit 608 Second error determination unit 609 Mode switching unit 610 Third memory (storage unit) 611 Control program 612 Photography device ID 613 Setting data 614 Recorded data (photographed image) 620 Third communication module D1 Management data H Home NW Network

Claims

1. A photographing device for photographing the interior of a storage facility, comprising: a first light for illuminating the interior of the storage facility; and a second light for notifying the status of the photographing device.

2. The photographing device according to claim 1, comprising a first light control unit that controls the lighting state of the first light, and a second light control unit that controls the lighting state of the second light, wherein the photographing device is capable of wireless communication with an external device, and when the photographing device starts photographing, the first light control unit turns on the first light, and the second light control unit turns on or blinks the second light depending on the state of the wireless communication connection between the photographing device and the external device.

3. The photographing device according to claim 2, wherein the second light control unit turns on the second light when the photographing device and the external device are connected via wireless communication, and blinks the second light when the photographing device and the external device are not connected via wireless communication.

4. The photographing device according to claim 2 or 3, wherein the first light control unit turns off the first light when the photographing device finishes photographing, and the second light control unit does not turn off the second light even when the photographing device finishes photographing, but turns off the second light when the operation of the photographing device finishes.

5. The photographing device according to claim 1, wherein the photographing device has a maintenance mode as an operating mode for undergoing maintenance, and is provided with a second light control unit that controls the lighting state of the second light, and when the photographing device is in the maintenance mode, the second light control unit lights or flashes the second light in a manner that indicates that the photographing device is in the maintenance mode.

6. The photographing device according to claim 1, further comprising a second light control unit that controls the lighting state of the second light, wherein, when an error occurs in the photographing device, the second light control unit turns on or blinks the second light in a manner that indicates that an error has occurred in the photographing device.

7. The photographing device according to claim 1, comprising: a second light control unit that controls the lighting state of the second light; and a memory unit that stores the captured image obtained by photographing with the photographing device, wherein when the captured image is deleted from the memory unit, the second light control unit turns on or blinks the second light in a manner indicating that the captured image is being deleted.

8. A storage facility comprising a photographing device for photographing the interior of the storage facility, the photographing device comprising a first light for illuminating the interior of the storage facility and a second light for indicating the status of the photographing device.

Images